2024-09-21T12:00:12.951 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-21T12:00:13.065 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T12:00:13.152 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/gabrioux-2024-09-21_10:07:29-orch:cephadm-wip-guits-main-2024-09-21-0813-distro-default-smithi/7913909 branch: wip-guits-main-2024-09-21-0813 description: orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/squid 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: gabrioux@ibm.com first_in_suite: false job_id: '7913909' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/squid ' name: gabrioux-2024-09-21_10:07:29-orch:cephadm-wip-guits-main-2024-09-21-0813-distro-default-smithi no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-guits-main-2024-09-21-0813 ceph: cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mon: mon op complaint time: 120 mon warn on pool no app: false osd: osd op complaint time: 180 conf: global: mon pg warn min per osd: 0 mgr: client mount timeout: 30 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - OSD_DOWN - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 5c1cdc3c470dae78e91a0ed2bcf13509a046d301 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 5c1cdc3c470dae78e91a0ed2bcf13509a046d301 kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-guits-main-2024-09-21-0813 sha1: 5c1cdc3c470dae78e91a0ed2bcf13509a046d301 owner: scheduled_gabrioux@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 3041 sha1: 5c1cdc3c470dae78e91a0ed2bcf13509a046d301 sleep_before_teardown: 0 subset: 1/8 suite: orch:cephadm suite_branch: wip-guits-main-2024-09-21-0813 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_5c1cdc3c470dae78e91a0ed2bcf13509a046d301/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 5c1cdc3c470dae78e91a0ed2bcf13509a046d301 targets: smithi003.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM4Pjg843lG1z0FQm14mx3Y27IgNnEORsyPTT73vDf2AIWUrtjI/Xez0+I+6tHiSd4MD3hC5Q4K5ghyyamtO0ns= smithi192.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEpsgMcQ9tRStcpKjQFLfjHWVzxB8jB6PviqzAozskqnJlEW2NgT4dujPyXq9vYIhdRDZ5xoHEqoTPyIWvuZNKY= tasks: - install: branch: squid exclude_packages: - ceph-volume - print: '**** done install task...' - cephadm: compiled_cephadm_branch: squid conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.ceph.io/ceph-ci/ceph:squid roleless: true - print: '**** done end installing squid cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 1 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay false - cephadm.shell: host.a: - ceph fs set cephfs inline_data true --yes-i-really-really-mean-it - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - ceph-fuse: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: [] meta: {} postmerge: [] variables: fail_fs: true teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-21_10:07:29 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph versions | jq -e '.mgr | length == 1' - ceph versions | jq -e '.mgr | keys' | grep $sha1 - ceph versions | jq -e '.overall | length == 2' - ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '.up_to_date | length == 2' - ceph orch ps - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: gabrioux verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2902 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-09-21T12:00:13.152 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_5c1cdc3c470dae78e91a0ed2bcf13509a046d301/qa; will attempt to use it 2024-09-21T12:00:13.153 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_5c1cdc3c470dae78e91a0ed2bcf13509a046d301/qa/tasks 2024-09-21T12:00:13.153 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-21T12:00:13.155 INFO:teuthology.task.internal:Checking packages... 2024-09-21T12:00:13.181 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '5c1cdc3c470dae78e91a0ed2bcf13509a046d301' 2024-09-21T12:00:13.182 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T12:00:13.182 INFO:teuthology.packaging:ref: None 2024-09-21T12:00:13.182 INFO:teuthology.packaging:tag: None 2024-09-21T12:00:13.182 INFO:teuthology.packaging:branch: wip-guits-main-2024-09-21-0813 2024-09-21T12:00:13.182 INFO:teuthology.packaging:sha1: 5c1cdc3c470dae78e91a0ed2bcf13509a046d301 2024-09-21T12:00:13.182 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-guits-main-2024-09-21-0813 2024-09-21T12:00:13.323 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-5103.g5c1cdc3c 2024-09-21T12:00:13.325 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-21T12:00:13.331 INFO:teuthology.task.internal:no buildpackages task found 2024-09-21T12:00:13.331 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-21T12:00:13.366 INFO:teuthology.task.internal:Saving configuration 2024-09-21T12:00:13.386 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-21T12:00:13.396 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-21T12:00:13.421 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi003.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2024-09-21_10:07:29-orch:cephadm-wip-guits-main-2024-09-21-0813-distro-default-smithi/7913909', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 11:55:28.348589', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM4Pjg843lG1z0FQm14mx3Y27IgNnEORsyPTT73vDf2AIWUrtjI/Xez0+I+6tHiSd4MD3hC5Q4K5ghyyamtO0ns='} 2024-09-21T12:00:13.444 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi192.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/gabrioux-2024-09-21_10:07:29-orch:cephadm-wip-guits-main-2024-09-21-0813-distro-default-smithi/7913909', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-21 11:55:28.350138', 'locked_by': 'scheduled_gabrioux@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEpsgMcQ9tRStcpKjQFLfjHWVzxB8jB6PviqzAozskqnJlEW2NgT4dujPyXq9vYIhdRDZ5xoHEqoTPyIWvuZNKY='} 2024-09-21T12:00:13.444 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-21T12:00:13.450 INFO:teuthology.task.internal:roles: ubuntu@smithi003.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-09-21T12:00:13.450 INFO:teuthology.task.internal:roles: ubuntu@smithi192.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-09-21T12:00:13.450 INFO:teuthology.run_tasks:Running task console_log... 2024-09-21T12:00:13.506 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd4cc9d0280>, signals=[15]) 2024-09-21T12:00:13.506 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-21T12:00:13.511 INFO:teuthology.task.internal:Opening connections... 2024-09-21T12:00:13.511 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi003.front.sepia.ceph.com 2024-09-21T12:00:13.512 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T12:00:13.586 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi192.front.sepia.ceph.com 2024-09-21T12:00:13.586 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T12:00:13.662 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-21T12:00:13.669 DEBUG:teuthology.orchestra.run.smithi003:> uname -m 2024-09-21T12:00:13.687 INFO:teuthology.orchestra.run.smithi003.stdout:x86_64 2024-09-21T12:00:13.687 DEBUG:teuthology.orchestra.run.smithi003:> cat /etc/os-release 2024-09-21T12:00:13.745 INFO:teuthology.orchestra.run.smithi003.stdout:NAME="CentOS Stream" 2024-09-21T12:00:13.746 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION="9" 2024-09-21T12:00:13.746 INFO:teuthology.orchestra.run.smithi003.stdout:ID="centos" 2024-09-21T12:00:13.746 INFO:teuthology.orchestra.run.smithi003.stdout:ID_LIKE="rhel fedora" 2024-09-21T12:00:13.746 INFO:teuthology.orchestra.run.smithi003.stdout:VERSION_ID="9" 2024-09-21T12:00:13.746 INFO:teuthology.orchestra.run.smithi003.stdout:PLATFORM_ID="platform:el9" 2024-09-21T12:00:13.746 INFO:teuthology.orchestra.run.smithi003.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T12:00:13.746 INFO:teuthology.orchestra.run.smithi003.stdout:ANSI_COLOR="0;31" 2024-09-21T12:00:13.746 INFO:teuthology.orchestra.run.smithi003.stdout:LOGO="fedora-logo-icon" 2024-09-21T12:00:13.746 INFO:teuthology.orchestra.run.smithi003.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T12:00:13.746 INFO:teuthology.orchestra.run.smithi003.stdout:HOME_URL="https://centos.org/" 2024-09-21T12:00:13.746 INFO:teuthology.orchestra.run.smithi003.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T12:00:13.746 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T12:00:13.747 INFO:teuthology.orchestra.run.smithi003.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T12:00:13.747 INFO:teuthology.lock.ops:Updating smithi003.front.sepia.ceph.com on lock server 2024-09-21T12:00:13.770 DEBUG:teuthology.orchestra.run.smithi192:> uname -m 2024-09-21T12:00:13.789 INFO:teuthology.orchestra.run.smithi192.stdout:x86_64 2024-09-21T12:00:13.789 DEBUG:teuthology.orchestra.run.smithi192:> cat /etc/os-release 2024-09-21T12:00:13.847 INFO:teuthology.orchestra.run.smithi192.stdout:NAME="CentOS Stream" 2024-09-21T12:00:13.847 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION="9" 2024-09-21T12:00:13.847 INFO:teuthology.orchestra.run.smithi192.stdout:ID="centos" 2024-09-21T12:00:13.847 INFO:teuthology.orchestra.run.smithi192.stdout:ID_LIKE="rhel fedora" 2024-09-21T12:00:13.847 INFO:teuthology.orchestra.run.smithi192.stdout:VERSION_ID="9" 2024-09-21T12:00:13.847 INFO:teuthology.orchestra.run.smithi192.stdout:PLATFORM_ID="platform:el9" 2024-09-21T12:00:13.847 INFO:teuthology.orchestra.run.smithi192.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-21T12:00:13.847 INFO:teuthology.orchestra.run.smithi192.stdout:ANSI_COLOR="0;31" 2024-09-21T12:00:13.847 INFO:teuthology.orchestra.run.smithi192.stdout:LOGO="fedora-logo-icon" 2024-09-21T12:00:13.847 INFO:teuthology.orchestra.run.smithi192.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-21T12:00:13.848 INFO:teuthology.orchestra.run.smithi192.stdout:HOME_URL="https://centos.org/" 2024-09-21T12:00:13.848 INFO:teuthology.orchestra.run.smithi192.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-21T12:00:13.848 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-21T12:00:13.848 INFO:teuthology.orchestra.run.smithi192.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-21T12:00:13.848 INFO:teuthology.lock.ops:Updating smithi192.front.sepia.ceph.com on lock server 2024-09-21T12:00:13.871 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-21T12:00:13.880 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-21T12:00:13.886 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-21T12:00:13.886 DEBUG:teuthology.orchestra.run.smithi003:> test '!' -e /home/ubuntu/cephtest 2024-09-21T12:00:13.889 DEBUG:teuthology.orchestra.run.smithi192:> test '!' -e /home/ubuntu/cephtest 2024-09-21T12:00:13.906 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-21T12:00:13.912 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-21T12:00:13.912 DEBUG:teuthology.orchestra.run.smithi003:> test -z $(ls -A /var/lib/ceph) 2024-09-21T12:00:13.946 DEBUG:teuthology.orchestra.run.smithi192:> test -z $(ls -A /var/lib/ceph) 2024-09-21T12:00:14.000 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-21T12:00:14.053 INFO:teuthology.run_tasks:Running task kernel... 2024-09-21T12:00:14.067 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-21T12:00:14.067 INFO:teuthology.task.kernel:config {'host.a': {'kdb': 1, 'sha1': 'distro'}, 'host.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-21T12:00:14.067 DEBUG:teuthology.orchestra.run.smithi003:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T12:00:14.067 DEBUG:teuthology.orchestra.run.smithi192:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-21T12:00:14.084 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T12:00:14.084 DEBUG:teuthology.orchestra.run.smithi003:> uname -r 2024-09-21T12:00:14.085 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T12:00:14.085 DEBUG:teuthology.orchestra.run.smithi192:> uname -r 2024-09-21T12:00:14.143 INFO:teuthology.orchestra.run.smithi003.stdout:5.14.0-503.el9.x86_64 2024-09-21T12:00:14.143 INFO:teuthology.task.kernel:Running kernel on smithi003: 5.14.0-503.el9.x86_64 2024-09-21T12:00:14.143 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum install -y kernel 2024-09-21T12:00:14.144 INFO:teuthology.orchestra.run.smithi192.stdout:5.14.0-503.el9.x86_64 2024-09-21T12:00:14.144 INFO:teuthology.task.kernel:Running kernel on smithi192: 5.14.0-503.el9.x86_64 2024-09-21T12:00:14.145 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum install -y kernel 2024-09-21T12:00:16.446 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.3 MB 00:00 2024-09-21T12:00:17.064 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS Stream 9 - BaseOS 6.8 MB/s | 8.3 MB 00:01 2024-09-21T12:00:18.180 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS Stream 9 - AppStream 32 MB/s | 20 MB 00:00 2024-09-21T12:00:20.282 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS Stream 9 - AppStream 9.7 MB/s | 20 MB 00:02 2024-09-21T12:00:22.639 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.5 MB 00:00 2024-09-21T12:00:24.057 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS Stream 9 - Extras packages 91 kB/s | 19 kB 00:00 2024-09-21T12:00:24.945 INFO:teuthology.orchestra.run.smithi192.stdout:Extra Packages for Enterprise Linux 30 MB/s | 23 MB 00:00 2024-09-21T12:00:27.681 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS Stream 9 - CRB 1.9 MB/s | 6.5 MB 00:03 2024-09-21T12:00:29.399 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS Stream 9 - Extras packages 43 kB/s | 19 kB 00:00 2024-09-21T12:00:30.309 INFO:teuthology.orchestra.run.smithi192.stdout:lab-extras 39 kB/s | 1.7 kB 00:00 2024-09-21T12:00:30.470 INFO:teuthology.orchestra.run.smithi003.stdout:Extra Packages for Enterprise Linux 24 MB/s | 23 MB 00:00 2024-09-21T12:00:32.191 INFO:teuthology.orchestra.run.smithi192.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-21T12:00:32.191 INFO:teuthology.orchestra.run.smithi192.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-21T12:00:32.273 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2024-09-21T12:00:32.283 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-21T12:00:32.283 INFO:teuthology.orchestra.run.smithi192.stdout: Package Architecture Version Repository Size 2024-09-21T12:00:32.283 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-21T12:00:32.283 INFO:teuthology.orchestra.run.smithi192.stdout:Installing: 2024-09-21T12:00:32.284 INFO:teuthology.orchestra.run.smithi192.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-21T12:00:32.284 INFO:teuthology.orchestra.run.smithi192.stdout:Installing dependencies: 2024-09-21T12:00:32.284 INFO:teuthology.orchestra.run.smithi192.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-21T12:00:32.284 INFO:teuthology.orchestra.run.smithi192.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-21T12:00:32.284 INFO:teuthology.orchestra.run.smithi192.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-21T12:00:32.284 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:00:32.284 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction Summary 2024-09-21T12:00:32.284 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-21T12:00:32.284 INFO:teuthology.orchestra.run.smithi192.stdout:Install 4 Packages 2024-09-21T12:00:32.284 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:00:32.285 INFO:teuthology.orchestra.run.smithi192.stdout:Total download size: 79 M 2024-09-21T12:00:32.285 INFO:teuthology.orchestra.run.smithi192.stdout:Installed size: 126 M 2024-09-21T12:00:32.285 INFO:teuthology.orchestra.run.smithi192.stdout:Downloading Packages: 2024-09-21T12:00:32.677 INFO:teuthology.orchestra.run.smithi192.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 332 kB/s | 36 kB 00:00 2024-09-21T12:00:36.067 INFO:teuthology.orchestra.run.smithi003.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-21T12:00:37.969 INFO:teuthology.orchestra.run.smithi192.stdout:(2/4): kernel-modules-core-5.14.0-508.el9.x86_6 5.4 MB/s | 29 MB 00:05 2024-09-21T12:00:38.057 INFO:teuthology.orchestra.run.smithi003.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-21T12:00:38.057 INFO:teuthology.orchestra.run.smithi003.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-21T12:00:38.153 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-09-21T12:00:38.159 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-21T12:00:38.159 INFO:teuthology.orchestra.run.smithi003.stdout: Package Architecture Version Repository Size 2024-09-21T12:00:38.159 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-21T12:00:38.160 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2024-09-21T12:00:38.160 INFO:teuthology.orchestra.run.smithi003.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-21T12:00:38.160 INFO:teuthology.orchestra.run.smithi003.stdout:Installing dependencies: 2024-09-21T12:00:38.160 INFO:teuthology.orchestra.run.smithi003.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-21T12:00:38.160 INFO:teuthology.orchestra.run.smithi003.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-21T12:00:38.160 INFO:teuthology.orchestra.run.smithi003.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-21T12:00:38.160 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:00:38.160 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2024-09-21T12:00:38.160 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-21T12:00:38.160 INFO:teuthology.orchestra.run.smithi003.stdout:Install 4 Packages 2024-09-21T12:00:38.160 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:00:38.161 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 79 M 2024-09-21T12:00:38.161 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 126 M 2024-09-21T12:00:38.161 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2024-09-21T12:00:38.552 INFO:teuthology.orchestra.run.smithi003.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 123 kB/s | 36 kB 00:00 2024-09-21T12:00:39.277 INFO:teuthology.orchestra.run.smithi192.stdout:(3/4): kernel-core-5.14.0-508.el9.x86_64.rpm 2.3 MB/s | 16 MB 00:06 2024-09-21T12:00:48.609 INFO:teuthology.orchestra.run.smithi192.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 2.2 MB/s | 35 MB 00:16 2024-09-21T12:00:48.610 INFO:teuthology.orchestra.run.smithi192.stdout:-------------------------------------------------------------------------------- 2024-09-21T12:00:48.610 INFO:teuthology.orchestra.run.smithi192.stdout:Total 4.8 MB/s | 79 MB 00:16 2024-09-21T12:00:49.298 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction check 2024-09-21T12:00:49.667 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction check succeeded. 2024-09-21T12:00:49.667 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction test 2024-09-21T12:00:50.632 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction test succeeded. 2024-09-21T12:00:50.633 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction 2024-09-21T12:00:53.077 INFO:teuthology.orchestra.run.smithi192.stdout: Preparing : 1/1 2024-09-21T12:00:53.184 INFO:teuthology.orchestra.run.smithi003.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 1.0 MB/s | 16 MB 00:14 2024-09-21T12:00:53.798 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-21T12:00:53.878 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T12:00:54.676 INFO:teuthology.orchestra.run.smithi003.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 2.1 MB/s | 35 MB 00:16 2024-09-21T12:00:56.643 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T12:00:56.742 INFO:teuthology.orchestra.run.smithi003.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 1.6 MB/s | 29 MB 00:18 2024-09-21T12:00:56.743 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2024-09-21T12:00:56.743 INFO:teuthology.orchestra.run.smithi003.stdout:Total 4.2 MB/s | 79 MB 00:18 2024-09-21T12:00:56.791 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T12:00:57.455 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2024-09-21T12:00:57.828 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2024-09-21T12:00:57.829 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2024-09-21T12:00:58.794 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2024-09-21T12:00:58.794 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2024-09-21T12:01:01.352 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2024-09-21T12:01:01.659 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T12:01:01.700 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T12:01:02.023 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-21T12:01:02.120 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T12:01:04.871 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T12:01:04.997 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T12:01:06.566 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T12:01:10.126 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T12:01:10.173 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T12:01:15.307 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T12:01:44.782 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T12:01:44.823 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-21T12:01:45.105 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T12:01:45.105 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-21T12:01:45.105 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T12:01:45.106 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T12:01:46.020 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T12:01:46.021 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:01:46.021 INFO:teuthology.orchestra.run.smithi192.stdout:Installed: 2024-09-21T12:01:46.021 INFO:teuthology.orchestra.run.smithi192.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-21T12:01:46.021 INFO:teuthology.orchestra.run.smithi192.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-21T12:01:46.021 INFO:teuthology.orchestra.run.smithi192.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-21T12:01:46.021 INFO:teuthology.orchestra.run.smithi192.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-21T12:01:46.021 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:01:46.021 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2024-09-21T12:01:46.389 DEBUG:teuthology.orchestra.run.smithi192:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T12:01:46.468 INFO:teuthology.orchestra.run.smithi192.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T12:01:46.469 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T12:01:46.469 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-21T12:01:46.469 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T12:01:46.470 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T12:01:46.470 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2024-09-21T12:01:46.470 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi192.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T12:01:46.470 DEBUG:teuthology.orchestra.run.smithi192:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T12:01:46.528 INFO:teuthology.orchestra.run.smithi192.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T12:01:46.529 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T12:01:46.529 DEBUG:teuthology.orchestra.run.smithi192:> sudo rpm -qi grub2-tools 2024-09-21T12:01:46.567 INFO:teuthology.orchestra.run.smithi192.stdout:Name : grub2-tools 2024-09-21T12:01:46.567 INFO:teuthology.orchestra.run.smithi192.stdout:Epoch : 1 2024-09-21T12:01:46.567 INFO:teuthology.orchestra.run.smithi192.stdout:Version : 2.06 2024-09-21T12:01:46.567 INFO:teuthology.orchestra.run.smithi192.stdout:Release : 82.el9 2024-09-21T12:01:46.567 INFO:teuthology.orchestra.run.smithi192.stdout:Architecture: x86_64 2024-09-21T12:01:46.567 INFO:teuthology.orchestra.run.smithi192.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T12:01:46.567 INFO:teuthology.orchestra.run.smithi192.stdout:Group : Unspecified 2024-09-21T12:01:46.568 INFO:teuthology.orchestra.run.smithi192.stdout:Size : 8274670 2024-09-21T12:01:46.568 INFO:teuthology.orchestra.run.smithi192.stdout:License : GPLv3+ 2024-09-21T12:01:46.568 INFO:teuthology.orchestra.run.smithi192.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T12:01:46.568 INFO:teuthology.orchestra.run.smithi192.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T12:01:46.568 INFO:teuthology.orchestra.run.smithi192.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T12:01:46.568 INFO:teuthology.orchestra.run.smithi192.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T12:01:46.568 INFO:teuthology.orchestra.run.smithi192.stdout:Packager : builder@centos.org 2024-09-21T12:01:46.568 INFO:teuthology.orchestra.run.smithi192.stdout:Vendor : CentOS 2024-09-21T12:01:46.568 INFO:teuthology.orchestra.run.smithi192.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T12:01:46.568 INFO:teuthology.orchestra.run.smithi192.stdout:Summary : Support tools for GRUB. 2024-09-21T12:01:46.568 INFO:teuthology.orchestra.run.smithi192.stdout:Description : 2024-09-21T12:01:46.568 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:01:46.568 INFO:teuthology.orchestra.run.smithi192.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T12:01:46.568 INFO:teuthology.orchestra.run.smithi192.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T12:01:46.569 INFO:teuthology.orchestra.run.smithi192.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T12:01:46.569 INFO:teuthology.orchestra.run.smithi192.stdout:hardware devices. 2024-09-21T12:01:46.569 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:01:46.569 INFO:teuthology.orchestra.run.smithi192.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T12:01:46.569 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T12:01:46.570 INFO:teuthology.task.kernel:Updating grub on smithi192 to boot 5.14.0-508.el9.x86_64 2024-09-21T12:01:46.570 DEBUG:teuthology.orchestra.run.smithi192:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T12:01:47.293 INFO:teuthology.orchestra.run.smithi192.stderr:Generating grub configuration file ... 2024-09-21T12:01:48.604 INFO:teuthology.orchestra.run.smithi192.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T12:01:48.636 INFO:teuthology.orchestra.run.smithi192.stderr:done 2024-09-21T12:01:48.639 DEBUG:teuthology.orchestra.run.smithi192:> mktemp 2024-09-21T12:01:48.654 INFO:teuthology.orchestra.run.smithi192.stdout:/tmp/tmp.AATDVaEm1O 2024-09-21T12:01:48.654 DEBUG:teuthology.orchestra.run.smithi192:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.AATDVaEm1O 2024-09-21T12:01:48.721 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 0666 /tmp/tmp.AATDVaEm1O 2024-09-21T12:01:48.851 DEBUG:teuthology.orchestra.remote:smithi192:/tmp/tmp.AATDVaEm1O is 6KB 2024-09-21T12:01:48.870 DEBUG:teuthology.orchestra.run.smithi192:> rm -fr /tmp/tmp.AATDVaEm1O 2024-09-21T12:01:48.885 DEBUG:teuthology.orchestra.run.smithi192:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T12:01:48.948 INFO:teuthology.orchestra.run.smithi192.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T12:01:48.948 INFO:teuthology.orchestra.run.smithi192.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T12:01:48.948 INFO:teuthology.orchestra.run.smithi192.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T12:01:48.948 INFO:teuthology.orchestra.run.smithi192.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-21T12:01:48.949 DEBUG:teuthology.orchestra.run.smithi192:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-21T12:01:49.112 DEBUG:teuthology.orchestra.run.smithi192:> sudo shutdown -r now 2024-09-21T12:01:54.185 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T12:01:54.225 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-21T12:01:54.552 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-21T12:01:54.552 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-21T12:01:54.552 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-21T12:01:54.552 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-21T12:01:55.389 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-21T12:01:55.389 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:01:55.389 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2024-09-21T12:01:55.389 INFO:teuthology.orchestra.run.smithi003.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-21T12:01:55.389 INFO:teuthology.orchestra.run.smithi003.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-21T12:01:55.390 INFO:teuthology.orchestra.run.smithi003.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-21T12:01:55.390 INFO:teuthology.orchestra.run.smithi003.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-21T12:01:55.390 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:01:55.390 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-09-21T12:01:55.728 DEBUG:teuthology.orchestra.run.smithi003:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T12:01:55.814 INFO:teuthology.orchestra.run.smithi003.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T12:01:55.814 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T12:01:55.814 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-21T12:01:55.815 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-21T12:01:55.815 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-21T12:01:55.815 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2024-09-21T12:01:55.815 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi003.front.sepia.ceph.com, path=None, version=distro) 2024-09-21T12:01:55.815 DEBUG:teuthology.orchestra.run.smithi003:> rpm -q kernel | sort -rV | head -n 1 2024-09-21T12:01:55.873 INFO:teuthology.orchestra.run.smithi003.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-21T12:01:55.874 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-21T12:01:55.874 DEBUG:teuthology.orchestra.run.smithi003:> sudo rpm -qi grub2-tools 2024-09-21T12:01:55.905 INFO:teuthology.orchestra.run.smithi003.stdout:Name : grub2-tools 2024-09-21T12:01:55.905 INFO:teuthology.orchestra.run.smithi003.stdout:Epoch : 1 2024-09-21T12:01:55.905 INFO:teuthology.orchestra.run.smithi003.stdout:Version : 2.06 2024-09-21T12:01:55.905 INFO:teuthology.orchestra.run.smithi003.stdout:Release : 82.el9 2024-09-21T12:01:55.905 INFO:teuthology.orchestra.run.smithi003.stdout:Architecture: x86_64 2024-09-21T12:01:55.905 INFO:teuthology.orchestra.run.smithi003.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-21T12:01:55.905 INFO:teuthology.orchestra.run.smithi003.stdout:Group : Unspecified 2024-09-21T12:01:55.905 INFO:teuthology.orchestra.run.smithi003.stdout:Size : 8274670 2024-09-21T12:01:55.905 INFO:teuthology.orchestra.run.smithi003.stdout:License : GPLv3+ 2024-09-21T12:01:55.905 INFO:teuthology.orchestra.run.smithi003.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-21T12:01:55.905 INFO:teuthology.orchestra.run.smithi003.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-21T12:01:55.905 INFO:teuthology.orchestra.run.smithi003.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-21T12:01:55.905 INFO:teuthology.orchestra.run.smithi003.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-21T12:01:55.906 INFO:teuthology.orchestra.run.smithi003.stdout:Packager : builder@centos.org 2024-09-21T12:01:55.906 INFO:teuthology.orchestra.run.smithi003.stdout:Vendor : CentOS 2024-09-21T12:01:55.906 INFO:teuthology.orchestra.run.smithi003.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-21T12:01:55.906 INFO:teuthology.orchestra.run.smithi003.stdout:Summary : Support tools for GRUB. 2024-09-21T12:01:55.906 INFO:teuthology.orchestra.run.smithi003.stdout:Description : 2024-09-21T12:01:55.906 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:01:55.906 INFO:teuthology.orchestra.run.smithi003.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-21T12:01:55.906 INFO:teuthology.orchestra.run.smithi003.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-21T12:01:55.906 INFO:teuthology.orchestra.run.smithi003.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-21T12:01:55.906 INFO:teuthology.orchestra.run.smithi003.stdout:hardware devices. 2024-09-21T12:01:55.906 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:01:55.906 INFO:teuthology.orchestra.run.smithi003.stdout:This subpackage provides tools for support of all platforms. 2024-09-21T12:01:55.907 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-21T12:01:55.907 INFO:teuthology.task.kernel:Updating grub on smithi003 to boot 5.14.0-508.el9.x86_64 2024-09-21T12:01:55.907 DEBUG:teuthology.orchestra.run.smithi003:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-21T12:01:56.554 INFO:teuthology.orchestra.run.smithi003.stderr:Generating grub configuration file ... 2024-09-21T12:01:57.909 INFO:teuthology.orchestra.run.smithi003.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-21T12:01:57.939 INFO:teuthology.orchestra.run.smithi003.stderr:done 2024-09-21T12:01:57.942 DEBUG:teuthology.orchestra.run.smithi003:> mktemp 2024-09-21T12:01:57.957 INFO:teuthology.orchestra.run.smithi003.stdout:/tmp/tmp.4FspzjgHzv 2024-09-21T12:01:57.957 DEBUG:teuthology.orchestra.run.smithi003:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.4FspzjgHzv 2024-09-21T12:01:58.023 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod 0666 /tmp/tmp.4FspzjgHzv 2024-09-21T12:01:58.167 DEBUG:teuthology.orchestra.remote:smithi003:/tmp/tmp.4FspzjgHzv is 6KB 2024-09-21T12:01:58.216 DEBUG:teuthology.orchestra.run.smithi003:> rm -fr /tmp/tmp.4FspzjgHzv 2024-09-21T12:01:58.230 DEBUG:teuthology.orchestra.run.smithi003:> sudo /bin/ls /boot/loader/entries || true 2024-09-21T12:01:58.292 INFO:teuthology.orchestra.run.smithi003.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-21T12:01:58.292 INFO:teuthology.orchestra.run.smithi003.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-21T12:01:58.293 INFO:teuthology.orchestra.run.smithi003.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-21T12:01:58.293 INFO:teuthology.orchestra.run.smithi003.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-21T12:01:58.294 DEBUG:teuthology.orchestra.run.smithi003:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-21T12:01:58.448 DEBUG:teuthology.orchestra.run.smithi003:> sudo shutdown -r now 2024-09-21T12:02:19.134 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-09-21T12:02:19.135 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2024-09-21T12:02:19.135 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T12:02:28.455 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-09-21T12:02:28.455 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi003.front.sepia.ceph.com' 2024-09-21T12:02:28.455 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T12:03:19.184 DEBUG:teuthology.orchestra.remote:timed out 2024-09-21T12:03:28.190 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2024-09-21T12:03:28.191 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T12:03:28.458 DEBUG:teuthology.orchestra.remote:timed out 2024-09-21T12:03:28.590 DEBUG:teuthology.orchestra.run.smithi192:> true 2024-09-21T12:03:28.964 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi192.front.sepia.ceph.com' 2024-09-21T12:03:28.964 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "5.14.0-508.el9.x86_64"... 2024-09-21T12:03:28.964 DEBUG:teuthology.orchestra.run.smithi192:> uname -r 2024-09-21T12:03:28.978 INFO:teuthology.orchestra.run.smithi192.stdout:5.14.0-508.el9.x86_64 2024-09-21T12:03:28.979 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-21T12:03:28.979 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T12:03:28.979 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T12:03:29.980 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-09-21T12:03:29.980 DEBUG:teuthology.orchestra.run.smithi192:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-21T12:03:30.067 INFO:teuthology.orchestra.run.smithi192.stdout:ttyS1 2024-09-21T12:03:30.088 DEBUG:teuthology.parallel:result is None 2024-09-21T12:03:37.458 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi003.front.sepia.ceph.com' 2024-09-21T12:03:37.459 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T12:03:40.946 DEBUG:teuthology.orchestra.run.smithi003:> true 2024-09-21T12:03:41.488 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi003.front.sepia.ceph.com' 2024-09-21T12:03:41.488 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "5.14.0-508.el9.x86_64"... 2024-09-21T12:03:41.488 DEBUG:teuthology.orchestra.run.smithi003:> uname -r 2024-09-21T12:03:41.504 INFO:teuthology.orchestra.run.smithi003.stdout:5.14.0-508.el9.x86_64 2024-09-21T12:03:41.505 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-21T12:03:41.505 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-21T12:03:41.505 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-21T12:03:42.506 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-09-21T12:03:42.506 DEBUG:teuthology.orchestra.run.smithi003:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-21T12:03:42.585 INFO:teuthology.orchestra.run.smithi003.stdout:ttyS1 2024-09-21T12:03:42.603 DEBUG:teuthology.parallel:result is None 2024-09-21T12:03:42.604 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-21T12:03:42.613 INFO:teuthology.task.internal:Creating test directory... 2024-09-21T12:03:42.613 DEBUG:teuthology.orchestra.run.smithi003:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T12:03:42.615 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-21T12:03:42.635 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-21T12:03:42.641 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-21T12:03:42.651 INFO:teuthology.task.internal:Creating archive directory... 2024-09-21T12:03:42.651 DEBUG:teuthology.orchestra.run.smithi003:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T12:03:42.671 DEBUG:teuthology.orchestra.run.smithi192:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-21T12:03:42.786 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-21T12:03:42.794 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-21T12:03:42.794 DEBUG:teuthology.orchestra.run.smithi003:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T12:03:42.797 DEBUG:teuthology.orchestra.run.smithi192:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-21T12:03:42.829 INFO:teuthology.orchestra.run.smithi192.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T12:03:42.838 INFO:teuthology.orchestra.run.smithi003.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T12:03:42.840 INFO:teuthology.orchestra.run.smithi192.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T12:03:42.849 INFO:teuthology.orchestra.run.smithi003.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-21T12:03:42.850 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-21T12:03:42.857 INFO:teuthology.task.internal:Configuring sudo... 2024-09-21T12:03:42.857 DEBUG:teuthology.orchestra.run.smithi003:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T12:03:42.893 DEBUG:teuthology.orchestra.run.smithi192:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-21T12:03:42.921 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-21T12:03:42.940 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-21T12:03:42.941 DEBUG:teuthology.orchestra.run.smithi003:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T12:03:42.959 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-21T12:03:42.978 DEBUG:teuthology.orchestra.run.smithi003:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T12:03:43.056 DEBUG:teuthology.orchestra.run.smithi003:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T12:03:43.102 DEBUG:teuthology.orchestra.run.smithi003:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T12:03:43.189 DEBUG:teuthology.orchestra.run.smithi003:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T12:03:43.226 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-09-21T12:03:43.226 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T12:03:43.298 DEBUG:teuthology.orchestra.run.smithi192:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T12:03:43.343 DEBUG:teuthology.orchestra.run.smithi192:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-21T12:03:43.419 DEBUG:teuthology.orchestra.run.smithi192:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T12:03:43.464 DEBUG:teuthology.orchestra.run.smithi192:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-21T12:03:43.508 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-21T12:03:43.509 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-21T12:03:43.575 DEBUG:teuthology.orchestra.run.smithi003:> sudo service rsyslog restart 2024-09-21T12:03:43.578 DEBUG:teuthology.orchestra.run.smithi192:> sudo service rsyslog restart 2024-09-21T12:03:43.622 INFO:teuthology.orchestra.run.smithi003.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T12:03:43.672 INFO:teuthology.orchestra.run.smithi192.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T12:03:44.124 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-21T12:03:44.138 INFO:teuthology.task.internal:Starting timer... 2024-09-21T12:03:44.138 INFO:teuthology.run_tasks:Running task pcp... 2024-09-21T12:03:44.167 INFO:teuthology.run_tasks:Running task selinux... 2024-09-21T12:03:44.186 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-09-21T12:03:44.186 DEBUG:teuthology.orchestra.run.smithi003:> sudo service auditd rotate 2024-09-21T12:03:44.240 INFO:teuthology.orchestra.run.smithi003.stdout:Rotating logs: 2024-09-21T12:03:44.242 DEBUG:teuthology.orchestra.run.smithi192:> sudo service auditd rotate 2024-09-21T12:03:44.300 INFO:teuthology.orchestra.run.smithi192.stdout:Rotating logs: 2024-09-21T12:03:44.302 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-21T12:03:44.302 DEBUG:teuthology.orchestra.run.smithi003:> /usr/sbin/getenforce 2024-09-21T12:03:44.325 INFO:teuthology.orchestra.run.smithi003.stdout:Permissive 2024-09-21T12:03:44.325 DEBUG:teuthology.orchestra.run.smithi192:> /usr/sbin/getenforce 2024-09-21T12:03:44.371 INFO:teuthology.orchestra.run.smithi192.stdout:Permissive 2024-09-21T12:03:44.371 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi003.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi192.front.sepia.ceph.com': 'permissive'} 2024-09-21T12:03:44.371 DEBUG:teuthology.orchestra.run.smithi003:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T12:03:44.397 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T12:03:44.398 DEBUG:teuthology.orchestra.run.smithi192:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T12:03:44.425 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T12:03:44.425 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-21T12:03:44.425 DEBUG:teuthology.orchestra.run.smithi003:> sudo /usr/sbin/setenforce permissive 2024-09-21T12:03:44.470 DEBUG:teuthology.orchestra.run.smithi192:> sudo /usr/sbin/setenforce permissive 2024-09-21T12:03:44.517 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-21T12:03:44.526 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-21T12:03:44.536 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-21T12:03:44.536 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi003.front.sepia.ceph.com,smithi192.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-21T12:07:33.655 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi003.front.sepia.ceph.com'), Remote(name='ubuntu@smithi192.front.sepia.ceph.com')] 2024-09-21T12:07:33.656 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi003.front.sepia.ceph.com' 2024-09-21T12:07:33.657 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi003.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T12:07:33.730 DEBUG:teuthology.orchestra.run.smithi003:> true 2024-09-21T12:07:33.810 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi003.front.sepia.ceph.com' 2024-09-21T12:07:33.810 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi192.front.sepia.ceph.com' 2024-09-21T12:07:33.811 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi192.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-21T12:07:33.886 DEBUG:teuthology.orchestra.run.smithi192:> true 2024-09-21T12:07:33.916 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi192.front.sepia.ceph.com' 2024-09-21T12:07:33.916 INFO:teuthology.run_tasks:Running task clock... 2024-09-21T12:07:33.926 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-21T12:07:33.926 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T12:07:33.927 DEBUG:teuthology.orchestra.run.smithi003:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T12:07:33.929 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-21T12:07:33.929 DEBUG:teuthology.orchestra.run.smithi192:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T12:07:33.957 INFO:teuthology.orchestra.run.smithi003.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T12:07:33.972 INFO:teuthology.orchestra.run.smithi003.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T12:07:33.985 INFO:teuthology.orchestra.run.smithi192.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-21T12:07:33.998 INFO:teuthology.orchestra.run.smithi003.stderr:sudo: ntpd: command not found 2024-09-21T12:07:34.000 INFO:teuthology.orchestra.run.smithi192.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-21T12:07:34.010 INFO:teuthology.orchestra.run.smithi003.stdout:506 Cannot talk to daemon 2024-09-21T12:07:34.023 INFO:teuthology.orchestra.run.smithi192.stderr:sudo: ntpd: command not found 2024-09-21T12:07:34.025 INFO:teuthology.orchestra.run.smithi003.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T12:07:34.034 INFO:teuthology.orchestra.run.smithi192.stdout:506 Cannot talk to daemon 2024-09-21T12:07:34.040 INFO:teuthology.orchestra.run.smithi003.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T12:07:34.049 INFO:teuthology.orchestra.run.smithi192.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-21T12:07:34.062 INFO:teuthology.orchestra.run.smithi192.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-21T12:07:34.104 INFO:teuthology.orchestra.run.smithi003.stderr:bash: line 1: ntpq: command not found 2024-09-21T12:07:34.107 INFO:teuthology.orchestra.run.smithi003.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T12:07:34.107 INFO:teuthology.orchestra.run.smithi003.stdout:=============================================================================== 2024-09-21T12:07:34.107 INFO:teuthology.orchestra.run.smithi003.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T12:07:34.107 INFO:teuthology.orchestra.run.smithi003.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T12:07:34.107 INFO:teuthology.orchestra.run.smithi003.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T12:07:34.107 INFO:teuthology.orchestra.run.smithi003.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T12:07:34.123 INFO:teuthology.orchestra.run.smithi192.stderr:bash: line 1: ntpq: command not found 2024-09-21T12:07:34.126 INFO:teuthology.orchestra.run.smithi192.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T12:07:34.126 INFO:teuthology.orchestra.run.smithi192.stdout:=============================================================================== 2024-09-21T12:07:34.126 INFO:teuthology.orchestra.run.smithi192.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T12:07:34.127 INFO:teuthology.orchestra.run.smithi192.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T12:07:34.127 INFO:teuthology.orchestra.run.smithi192.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T12:07:34.127 INFO:teuthology.orchestra.run.smithi192.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T12:07:34.128 INFO:teuthology.run_tasks:Running task install... 2024-09-21T12:07:34.142 DEBUG:teuthology.task.install:project ceph 2024-09-21T12:07:34.142 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '5c1cdc3c470dae78e91a0ed2bcf13509a046d301'}} 2024-09-21T12:07:34.142 DEBUG:teuthology.task.install:config {'branch': 'squid', 'exclude_packages': ['ceph-volume'], 'flavor': 'default', 'sha1': '5c1cdc3c470dae78e91a0ed2bcf13509a046d301'} 2024-09-21T12:07:34.142 INFO:teuthology.task.install:Using flavor: default 2024-09-21T12:07:34.147 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-21T12:07:34.147 INFO:teuthology.task.install:extra packages: [] 2024-09-21T12:07:34.147 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'squid', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '5c1cdc3c470dae78e91a0ed2bcf13509a046d301', 'tag': None, 'wait_for_package': False} 2024-09-21T12:07:34.148 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T12:07:34.148 INFO:teuthology.packaging:ref: None 2024-09-21T12:07:34.148 INFO:teuthology.packaging:tag: None 2024-09-21T12:07:34.148 INFO:teuthology.packaging:branch: squid 2024-09-21T12:07:34.148 INFO:teuthology.packaging:sha1: 5c1cdc3c470dae78e91a0ed2bcf13509a046d301 2024-09-21T12:07:34.148 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-21T12:07:34.150 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'squid', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '5c1cdc3c470dae78e91a0ed2bcf13509a046d301', 'tag': None, 'wait_for_package': False} 2024-09-21T12:07:34.150 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T12:07:34.150 INFO:teuthology.packaging:ref: None 2024-09-21T12:07:34.150 INFO:teuthology.packaging:tag: None 2024-09-21T12:07:34.150 INFO:teuthology.packaging:branch: squid 2024-09-21T12:07:34.150 INFO:teuthology.packaging:sha1: 5c1cdc3c470dae78e91a0ed2bcf13509a046d301 2024-09-21T12:07:34.150 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-21T12:07:34.360 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/centos/9/flavors/default/ 2024-09-21T12:07:34.360 INFO:teuthology.task.install.rpm:Package version is 19.1.1-373.g4e45e6b4 2024-09-21T12:07:34.392 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/centos/9/flavors/default/ 2024-09-21T12:07:34.393 INFO:teuthology.task.install.rpm:Package version is 19.1.1-373.g4e45e6b4 2024-09-21T12:07:34.469 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T12:07:34.470 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-09-21T12:07:34.470 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T12:07:34.497 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-21T12:07:34.497 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T12:07:34.497 INFO:teuthology.packaging:ref: None 2024-09-21T12:07:34.497 INFO:teuthology.packaging:tag: None 2024-09-21T12:07:34.498 INFO:teuthology.packaging:branch: squid 2024-09-21T12:07:34.498 INFO:teuthology.packaging:sha1: 5c1cdc3c470dae78e91a0ed2bcf13509a046d301 2024-09-21T12:07:34.498 DEBUG:teuthology.orchestra.run.smithi003:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/squid/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T12:07:34.500 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-21T12:07:34.500 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-21T12:07:34.500 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-21T12:07:34.527 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-21T12:07:34.527 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T12:07:34.527 INFO:teuthology.packaging:ref: None 2024-09-21T12:07:34.527 INFO:teuthology.packaging:tag: None 2024-09-21T12:07:34.527 INFO:teuthology.packaging:branch: squid 2024-09-21T12:07:34.527 INFO:teuthology.packaging:sha1: 5c1cdc3c470dae78e91a0ed2bcf13509a046d301 2024-09-21T12:07:34.527 DEBUG:teuthology.orchestra.run.smithi192:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/squid/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-21T12:07:34.565 DEBUG:teuthology.orchestra.run.smithi003:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T12:07:34.594 DEBUG:teuthology.orchestra.run.smithi192:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-21T12:07:34.642 DEBUG:teuthology.orchestra.run.smithi003:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T12:07:34.670 DEBUG:teuthology.orchestra.run.smithi192:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-21T12:07:34.707 INFO:teuthology.orchestra.run.smithi003.stdout:check_obsoletes = 1 2024-09-21T12:07:34.709 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum clean all 2024-09-21T12:07:34.735 INFO:teuthology.orchestra.run.smithi192.stdout:check_obsoletes = 1 2024-09-21T12:07:34.736 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum clean all 2024-09-21T12:07:34.943 INFO:teuthology.orchestra.run.smithi003.stdout:45 files removed 2024-09-21T12:07:34.970 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph-radosgw 2024-09-21T12:07:34.996 INFO:teuthology.orchestra.run.smithi192.stdout:45 files removed 2024-09-21T12:07:35.022 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install ceph-radosgw 2024-09-21T12:07:35.548 INFO:teuthology.orchestra.run.smithi003.stdout:ceph packages for x86_64 299 kB/s | 84 kB 00:00 2024-09-21T12:07:35.568 INFO:teuthology.orchestra.run.smithi192.stdout:ceph packages for x86_64 319 kB/s | 84 kB 00:00 2024-09-21T12:07:35.840 INFO:teuthology.orchestra.run.smithi003.stdout:ceph noarch packages 48 kB/s | 12 kB 00:00 2024-09-21T12:07:35.869 INFO:teuthology.orchestra.run.smithi192.stdout:ceph noarch packages 46 kB/s | 12 kB 00:00 2024-09-21T12:07:36.125 INFO:teuthology.orchestra.run.smithi003.stdout:ceph source packages 7.7 kB/s | 1.9 kB 00:00 2024-09-21T12:07:36.127 INFO:teuthology.orchestra.run.smithi192.stdout:ceph source packages 8.5 kB/s | 1.9 kB 00:00 2024-09-21T12:07:38.861 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS Stream 9 - BaseOS 3.1 MB/s | 8.3 MB 00:02 2024-09-21T12:07:38.866 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS Stream 9 - BaseOS 3.1 MB/s | 8.3 MB 00:02 2024-09-21T12:07:40.521 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS Stream 9 - AppStream 34 MB/s | 20 MB 00:00 2024-09-21T12:07:40.776 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS Stream 9 - AppStream 26 MB/s | 20 MB 00:00 2024-09-21T12:07:44.971 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS Stream 9 - CRB 10 MB/s | 6.5 MB 00:00 2024-09-21T12:07:46.439 INFO:teuthology.orchestra.run.smithi192.stdout:CentOS Stream 9 - Extras packages 89 kB/s | 19 kB 00:00 2024-09-21T12:07:47.268 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS Stream 9 - CRB 2.6 MB/s | 6.5 MB 00:02 2024-09-21T12:07:47.568 INFO:teuthology.orchestra.run.smithi192.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-21T12:07:49.218 INFO:teuthology.orchestra.run.smithi003.stdout:CentOS Stream 9 - Extras packages 28 kB/s | 19 kB 00:00 2024-09-21T12:07:50.175 INFO:teuthology.orchestra.run.smithi003.stdout:Extra Packages for Enterprise Linux 27 MB/s | 23 MB 00:00 2024-09-21T12:07:53.107 INFO:teuthology.orchestra.run.smithi192.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-21T12:07:55.335 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2024-09-21T12:07:55.338 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-21T12:07:55.338 INFO:teuthology.orchestra.run.smithi192.stdout: Package Arch Version Repository Size 2024-09-21T12:07:55.338 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-21T12:07:55.338 INFO:teuthology.orchestra.run.smithi192.stdout:Installing: 2024-09-21T12:07:55.338 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-radosgw x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 11 M 2024-09-21T12:07:55.339 INFO:teuthology.orchestra.run.smithi192.stdout:Upgrading: 2024-09-21T12:07:55.339 INFO:teuthology.orchestra.run.smithi192.stdout: librados2 x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 3.4 M 2024-09-21T12:07:55.339 INFO:teuthology.orchestra.run.smithi192.stdout: librbd1 x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 3.2 M 2024-09-21T12:07:55.339 INFO:teuthology.orchestra.run.smithi192.stdout:Installing dependencies: 2024-09-21T12:07:55.339 INFO:teuthology.orchestra.run.smithi192.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T12:07:55.339 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-base x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 5.4 M 2024-09-21T12:07:55.339 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-common x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 21 M 2024-09-21T12:07:55.339 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-selinux x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 25 k 2024-09-21T12:07:55.339 INFO:teuthology.orchestra.run.smithi192.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T12:07:55.339 INFO:teuthology.orchestra.run.smithi192.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T12:07:55.339 INFO:teuthology.orchestra.run.smithi192.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T12:07:55.339 INFO:teuthology.orchestra.run.smithi192.stdout: libcephfs2 x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 751 k 2024-09-21T12:07:55.339 INFO:teuthology.orchestra.run.smithi192.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T12:07:55.339 INFO:teuthology.orchestra.run.smithi192.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T12:07:55.340 INFO:teuthology.orchestra.run.smithi192.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T12:07:55.340 INFO:teuthology.orchestra.run.smithi192.stdout: libradosstriper1 x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 507 k 2024-09-21T12:07:55.340 INFO:teuthology.orchestra.run.smithi192.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T12:07:55.340 INFO:teuthology.orchestra.run.smithi192.stdout: librgw2 x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 5.3 M 2024-09-21T12:07:55.340 INFO:teuthology.orchestra.run.smithi192.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T12:07:55.340 INFO:teuthology.orchestra.run.smithi192.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T12:07:55.340 INFO:teuthology.orchestra.run.smithi192.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T12:07:55.340 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ceph-argparse x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 45 k 2024-09-21T12:07:55.340 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ceph-common x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 136 k 2024-09-21T12:07:55.340 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cephfs x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 162 k 2024-09-21T12:07:55.340 INFO:teuthology.orchestra.run.smithi192.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T12:07:55.340 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rados x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 321 k 2024-09-21T12:07:55.340 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rbd x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 300 k 2024-09-21T12:07:55.340 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rgw x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 99 k 2024-09-21T12:07:55.341 INFO:teuthology.orchestra.run.smithi192.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T12:07:55.341 INFO:teuthology.orchestra.run.smithi192.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T12:07:55.341 INFO:teuthology.orchestra.run.smithi192.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T12:07:55.341 INFO:teuthology.orchestra.run.smithi192.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T12:07:55.341 INFO:teuthology.orchestra.run.smithi192.stdout:Installing weak dependencies: 2024-09-21T12:07:55.341 INFO:teuthology.orchestra.run.smithi192.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T12:07:55.341 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:07:55.341 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction Summary 2024-09-21T12:07:55.341 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-21T12:07:55.341 INFO:teuthology.orchestra.run.smithi192.stdout:Install 30 Packages 2024-09-21T12:07:55.341 INFO:teuthology.orchestra.run.smithi192.stdout:Upgrade 2 Packages 2024-09-21T12:07:55.341 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:07:55.342 INFO:teuthology.orchestra.run.smithi192.stdout:Total download size: 60 M 2024-09-21T12:07:55.342 INFO:teuthology.orchestra.run.smithi192.stdout:Downloading Packages: 2024-09-21T12:07:55.779 INFO:teuthology.orchestra.run.smithi003.stdout:lab-extras 37 kB/s | 1.7 kB 00:00 2024-09-21T12:07:57.317 INFO:teuthology.orchestra.run.smithi192.stdout:(1/32): ceph-base-19.1.1-373.g4e45e6b4.el9.x86_ 8.7 MB/s | 5.4 MB 00:00 2024-09-21T12:07:57.367 INFO:teuthology.orchestra.run.smithi192.stdout:(2/32): ceph-selinux-19.1.1-373.g4e45e6b4.el9.x 506 kB/s | 25 kB 00:00 2024-09-21T12:07:57.467 INFO:teuthology.orchestra.run.smithi192.stdout:(3/32): libcephfs2-19.1.1-373.g4e45e6b4.el9.x86 7.4 MB/s | 751 kB 00:00 2024-09-21T12:07:57.534 INFO:teuthology.orchestra.run.smithi192.stdout:(4/32): libradosstriper1-19.1.1-373.g4e45e6b4.e 7.5 MB/s | 507 kB 00:00 2024-09-21T12:07:57.909 INFO:teuthology.orchestra.run.smithi192.stdout:(5/32): ceph-common-19.1.1-373.g4e45e6b4.el9.x8 17 MB/s | 21 MB 00:01 2024-09-21T12:07:58.026 INFO:teuthology.orchestra.run.smithi192.stdout:(6/32): ceph-radosgw-19.1.1-373.g4e45e6b4.el9.x 8.0 MB/s | 11 MB 00:01 2024-09-21T12:07:58.051 INFO:teuthology.orchestra.run.smithi192.stdout:(7/32): python3-ceph-argparse-19.1.1-373.g4e45e 319 kB/s | 45 kB 00:00 2024-09-21T12:07:58.077 INFO:teuthology.orchestra.run.smithi192.stdout:(8/32): python3-ceph-common-19.1.1-373.g4e45e6b 2.7 MB/s | 136 kB 00:00 2024-09-21T12:07:58.102 INFO:teuthology.orchestra.run.smithi192.stdout:(9/32): python3-cephfs-19.1.1-373.g4e45e6b4.el9 3.2 MB/s | 162 kB 00:00 2024-09-21T12:07:58.116 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-09-21T12:07:58.124 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-21T12:07:58.124 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repository Size 2024-09-21T12:07:58.124 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-21T12:07:58.124 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2024-09-21T12:07:58.124 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-radosgw x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 11 M 2024-09-21T12:07:58.124 INFO:teuthology.orchestra.run.smithi003.stdout:Upgrading: 2024-09-21T12:07:58.124 INFO:teuthology.orchestra.run.smithi003.stdout: librados2 x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 3.4 M 2024-09-21T12:07:58.124 INFO:teuthology.orchestra.run.smithi003.stdout: librbd1 x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 3.2 M 2024-09-21T12:07:58.124 INFO:teuthology.orchestra.run.smithi003.stdout:Installing dependencies: 2024-09-21T12:07:58.125 INFO:teuthology.orchestra.run.smithi003.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-21T12:07:58.125 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-base x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 5.4 M 2024-09-21T12:07:58.125 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-common x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 21 M 2024-09-21T12:07:58.125 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-selinux x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 25 k 2024-09-21T12:07:58.125 INFO:teuthology.orchestra.run.smithi003.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-21T12:07:58.125 INFO:teuthology.orchestra.run.smithi003.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-21T12:07:58.125 INFO:teuthology.orchestra.run.smithi003.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-21T12:07:58.125 INFO:teuthology.orchestra.run.smithi003.stdout: libcephfs2 x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 751 k 2024-09-21T12:07:58.125 INFO:teuthology.orchestra.run.smithi003.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-21T12:07:58.125 INFO:teuthology.orchestra.run.smithi003.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-21T12:07:58.125 INFO:teuthology.orchestra.run.smithi003.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-21T12:07:58.125 INFO:teuthology.orchestra.run.smithi003.stdout: libradosstriper1 x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 507 k 2024-09-21T12:07:58.125 INFO:teuthology.orchestra.run.smithi003.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-21T12:07:58.125 INFO:teuthology.orchestra.run.smithi003.stdout: librgw2 x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 5.3 M 2024-09-21T12:07:58.125 INFO:teuthology.orchestra.run.smithi003.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-21T12:07:58.126 INFO:teuthology.orchestra.run.smithi003.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-21T12:07:58.126 INFO:teuthology.orchestra.run.smithi003.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-21T12:07:58.126 INFO:teuthology.orchestra.run.smithi003.stdout: python3-ceph-argparse x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 45 k 2024-09-21T12:07:58.126 INFO:teuthology.orchestra.run.smithi003.stdout: python3-ceph-common x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 136 k 2024-09-21T12:07:58.126 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cephfs x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 162 k 2024-09-21T12:07:58.126 INFO:teuthology.orchestra.run.smithi003.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-21T12:07:58.126 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rados x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 321 k 2024-09-21T12:07:58.126 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rbd x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 300 k 2024-09-21T12:07:58.126 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rgw x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 99 k 2024-09-21T12:07:58.126 INFO:teuthology.orchestra.run.smithi003.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-21T12:07:58.126 INFO:teuthology.orchestra.run.smithi003.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-21T12:07:58.126 INFO:teuthology.orchestra.run.smithi003.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-21T12:07:58.126 INFO:teuthology.orchestra.run.smithi003.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-21T12:07:58.126 INFO:teuthology.orchestra.run.smithi003.stdout:Installing weak dependencies: 2024-09-21T12:07:58.126 INFO:teuthology.orchestra.run.smithi003.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-21T12:07:58.127 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:07:58.127 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2024-09-21T12:07:58.127 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-21T12:07:58.127 INFO:teuthology.orchestra.run.smithi003.stdout:Install 30 Packages 2024-09-21T12:07:58.127 INFO:teuthology.orchestra.run.smithi003.stdout:Upgrade 2 Packages 2024-09-21T12:07:58.127 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:07:58.127 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 60 M 2024-09-21T12:07:58.127 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2024-09-21T12:07:58.177 INFO:teuthology.orchestra.run.smithi192.stdout:(10/32): librgw2-19.1.1-373.g4e45e6b4.el9.x86_6 8.3 MB/s | 5.3 MB 00:00 2024-09-21T12:07:58.202 INFO:teuthology.orchestra.run.smithi192.stdout:(11/32): python3-rados-19.1.1-373.g4e45e6b4.el9 2.5 MB/s | 321 kB 00:00 2024-09-21T12:07:58.228 INFO:teuthology.orchestra.run.smithi192.stdout:(12/32): python3-rgw-19.1.1-373.g4e45e6b4.el9.x 1.9 MB/s | 99 kB 00:00 2024-09-21T12:07:58.253 INFO:teuthology.orchestra.run.smithi192.stdout:(13/32): python3-rbd-19.1.1-373.g4e45e6b4.el9.x 1.9 MB/s | 300 kB 00:00 2024-09-21T12:07:58.320 INFO:teuthology.orchestra.run.smithi192.stdout:(14/32): boost-program-options-1.75.0-8.el9.x86 911 kB/s | 107 kB 00:00 2024-09-21T12:07:58.345 INFO:teuthology.orchestra.run.smithi192.stdout:(15/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 491 kB/s | 45 kB 00:00 2024-09-21T12:07:58.371 INFO:teuthology.orchestra.run.smithi192.stdout:(16/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.1 MB/s | 160 kB 00:00 2024-09-21T12:07:58.413 INFO:teuthology.orchestra.run.smithi192.stdout:(17/32): python3-prettytable-0.7.2-27.el9.noarc 1.0 MB/s | 42 kB 00:00 2024-09-21T12:07:58.438 INFO:teuthology.orchestra.run.smithi192.stdout:(18/32): librdkafka-1.6.1-102.el9.x86_64.rpm 5.5 MB/s | 662 kB 00:00 2024-09-21T12:07:58.463 INFO:teuthology.orchestra.run.smithi192.stdout:(19/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.4 MB/s | 292 kB 00:00 2024-09-21T12:07:58.488 INFO:teuthology.orchestra.run.smithi192.stdout:(20/32): qatlib-service-24.02.0-1.el9.x86_64.rp 718 kB/s | 36 kB 00:00 2024-09-21T12:07:58.514 INFO:teuthology.orchestra.run.smithi192.stdout:(21/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 944 kB/s | 47 kB 00:00 2024-09-21T12:07:58.539 INFO:teuthology.orchestra.run.smithi192.stdout:(22/32): qatlib-24.02.0-1.el9.x86_64.rpm 1.7 MB/s | 221 kB 00:00 2024-09-21T12:07:58.598 INFO:teuthology.orchestra.run.smithi192.stdout:(23/32): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.8 MB/s | 308 kB 00:00 2024-09-21T12:07:58.623 INFO:teuthology.orchestra.run.smithi192.stdout:(24/32): liboath-2.6.7-2.el9.x86_64.rpm 2.1 MB/s | 49 kB 00:00 2024-09-21T12:07:58.648 INFO:teuthology.orchestra.run.smithi192.stdout:(25/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 278 kB/s | 26 kB 00:00 2024-09-21T12:07:58.673 INFO:teuthology.orchestra.run.smithi192.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-21T12:07:58.707 INFO:teuthology.orchestra.run.smithi192.stdout:(27/32): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-21T12:07:58.749 INFO:teuthology.orchestra.run.smithi192.stdout:(28/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.2 MB/s | 839 kB 00:00 2024-09-21T12:07:58.808 INFO:teuthology.orchestra.run.smithi192.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-21T12:07:58.891 INFO:teuthology.orchestra.run.smithi192.stdout:(30/32): libarrow-9.0.0-11.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-09-21T12:07:59.139 INFO:teuthology.orchestra.run.smithi003.stdout:(1/32): ceph-base-19.1.1-373.g4e45e6b4.el9.x86_ 9.3 MB/s | 5.4 MB 00:00 2024-09-21T12:07:59.150 INFO:teuthology.orchestra.run.smithi192.stdout:(31/32): librados2-19.1.1-373.g4e45e6b4.el9.x86 8.5 MB/s | 3.4 MB 00:00 2024-09-21T12:07:59.188 INFO:teuthology.orchestra.run.smithi003.stdout:(2/32): ceph-selinux-19.1.1-373.g4e45e6b4.el9.x 506 kB/s | 25 kB 00:00 2024-09-21T12:07:59.242 INFO:teuthology.orchestra.run.smithi192.stdout:(32/32): librbd1-19.1.1-373.g4e45e6b4.el9.x86_6 7.3 MB/s | 3.2 MB 00:00 2024-09-21T12:07:59.247 INFO:teuthology.orchestra.run.smithi192.stdout:-------------------------------------------------------------------------------- 2024-09-21T12:07:59.247 INFO:teuthology.orchestra.run.smithi192.stdout:Total 15 MB/s | 60 MB 00:03 2024-09-21T12:07:59.263 INFO:teuthology.orchestra.run.smithi003.stdout:(3/32): libcephfs2-19.1.1-373.g4e45e6b4.el9.x86 9.8 MB/s | 751 kB 00:00 2024-09-21T12:07:59.339 INFO:teuthology.orchestra.run.smithi003.stdout:(4/32): libradosstriper1-19.1.1-373.g4e45e6b4.e 6.6 MB/s | 507 kB 00:00 2024-09-21T12:07:59.353 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction check 2024-09-21T12:07:59.389 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction check succeeded. 2024-09-21T12:07:59.390 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction test 2024-09-21T12:07:59.672 INFO:teuthology.orchestra.run.smithi003.stdout:(5/32): librgw2-19.1.1-373.g4e45e6b4.el9.x86_64 16 MB/s | 5.3 MB 00:00 2024-09-21T12:07:59.789 INFO:teuthology.orchestra.run.smithi003.stdout:(6/32): ceph-radosgw-19.1.1-373.g4e45e6b4.el9.x 8.6 MB/s | 11 MB 00:01 2024-09-21T12:07:59.814 INFO:teuthology.orchestra.run.smithi003.stdout:(7/32): python3-ceph-argparse-19.1.1-373.g4e45e 318 kB/s | 45 kB 00:00 2024-09-21T12:07:59.840 INFO:teuthology.orchestra.run.smithi003.stdout:(8/32): python3-ceph-common-19.1.1-373.g4e45e6b 2.7 MB/s | 136 kB 00:00 2024-09-21T12:07:59.865 INFO:teuthology.orchestra.run.smithi003.stdout:(9/32): python3-cephfs-19.1.1-373.g4e45e6b4.el9 3.2 MB/s | 162 kB 00:00 2024-09-21T12:07:59.899 INFO:teuthology.orchestra.run.smithi003.stdout:(10/32): python3-rados-19.1.1-373.g4e45e6b4.el9 5.4 MB/s | 321 kB 00:00 2024-09-21T12:07:59.932 INFO:teuthology.orchestra.run.smithi003.stdout:(11/32): python3-rbd-19.1.1-373.g4e45e6b4.el9.x 4.4 MB/s | 300 kB 00:00 2024-09-21T12:07:59.957 INFO:teuthology.orchestra.run.smithi003.stdout:(12/32): python3-rgw-19.1.1-373.g4e45e6b4.el9.x 1.7 MB/s | 99 kB 00:00 2024-09-21T12:08:00.101 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction test succeeded. 2024-09-21T12:08:00.101 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction 2024-09-21T12:08:00.159 INFO:teuthology.orchestra.run.smithi003.stdout:(13/32): ceph-common-19.1.1-373.g4e45e6b4.el9.x 13 MB/s | 21 MB 00:01 2024-09-21T12:08:00.200 INFO:teuthology.orchestra.run.smithi003.stdout:(14/32): boost-program-options-1.75.0-8.el9.x86 400 kB/s | 107 kB 00:00 2024-09-21T12:08:00.258 INFO:teuthology.orchestra.run.smithi003.stdout:(15/32): libpmemobj-1.12.1-1.el9.x86_64.rpm 533 kB/s | 160 kB 00:00 2024-09-21T12:08:00.283 INFO:teuthology.orchestra.run.smithi003.stdout:(16/32): librabbitmq-0.11.0-7.el9.x86_64.rpm 362 kB/s | 45 kB 00:00 2024-09-21T12:08:00.309 INFO:teuthology.orchestra.run.smithi003.stdout:(17/32): librdkafka-1.6.1-102.el9.x86_64.rpm 5.9 MB/s | 662 kB 00:00 2024-09-21T12:08:00.334 INFO:teuthology.orchestra.run.smithi003.stdout:(18/32): python3-prettytable-0.7.2-27.el9.noarc 841 kB/s | 42 kB 00:00 2024-09-21T12:08:00.368 INFO:teuthology.orchestra.run.smithi003.stdout:(19/32): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-09-21T12:08:00.426 INFO:teuthology.orchestra.run.smithi003.stdout:(20/32): qatlib-service-24.02.0-1.el9.x86_64.rp 390 kB/s | 36 kB 00:00 2024-09-21T12:08:00.452 INFO:teuthology.orchestra.run.smithi003.stdout:(21/32): qatzip-libs-1.2.0-1.el9.x86_64.rpm 567 kB/s | 47 kB 00:00 2024-09-21T12:08:00.485 INFO:teuthology.orchestra.run.smithi003.stdout:(22/32): qatlib-24.02.0-1.el9.x86_64.rpm 1.2 MB/s | 221 kB 00:00 2024-09-21T12:08:00.544 INFO:teuthology.orchestra.run.smithi003.stdout:(23/32): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.6 MB/s | 308 kB 00:00 2024-09-21T12:08:00.570 INFO:teuthology.orchestra.run.smithi003.stdout:(24/32): liboath-2.6.7-2.el9.x86_64.rpm 2.1 MB/s | 49 kB 00:00 2024-09-21T12:08:00.586 INFO:teuthology.orchestra.run.smithi003.stdout:(25/32): libarrow-doc-9.0.0-11.el9.noarch.rpm 308 kB/s | 26 kB 00:00 2024-09-21T12:08:00.611 INFO:teuthology.orchestra.run.smithi003.stdout:(26/32): libunwind-1.6.2-1.el9.x86_64.rpm 1.6 MB/s | 67 kB 00:00 2024-09-21T12:08:00.637 INFO:teuthology.orchestra.run.smithi003.stdout:(27/32): re2-20211101-20.el9.x86_64.rpm 7.5 MB/s | 191 kB 00:00 2024-09-21T12:08:00.687 INFO:teuthology.orchestra.run.smithi003.stdout:(28/32): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.2 MB/s | 839 kB 00:00 2024-09-21T12:08:00.737 INFO:teuthology.orchestra.run.smithi003.stdout:(29/32): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-21T12:08:00.863 INFO:teuthology.orchestra.run.smithi003.stdout:(30/32): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-09-21T12:08:00.938 INFO:teuthology.orchestra.run.smithi003.stdout:(31/32): librados2-19.1.1-373.g4e45e6b4.el9.x86 14 MB/s | 3.4 MB 00:00 2024-09-21T12:08:01.013 INFO:teuthology.orchestra.run.smithi003.stdout:(32/32): librbd1-19.1.1-373.g4e45e6b4.el9.x86_6 11 MB/s | 3.2 MB 00:00 2024-09-21T12:08:01.018 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2024-09-21T12:08:01.018 INFO:teuthology.orchestra.run.smithi003.stdout:Total 21 MB/s | 60 MB 00:02 2024-09-21T12:08:01.125 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2024-09-21T12:08:01.165 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2024-09-21T12:08:01.166 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2024-09-21T12:08:01.592 INFO:teuthology.orchestra.run.smithi192.stdout: Preparing : 1/1 2024-09-21T12:08:01.676 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-09-21T12:08:01.705 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-09-21T12:08:01.730 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-09-21T12:08:01.753 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-21T12:08:01.774 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-21T12:08:01.870 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2024-09-21T12:08:01.870 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2024-09-21T12:08:01.963 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-21T12:08:02.017 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-21T12:08:02.414 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-09-21T12:08:02.482 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : librados2-2:19.1.1-373.g4e45e6b4.el9.x86_64 7/34 2024-09-21T12:08:02.574 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librados2-2:19.1.1-373.g4e45e6b4.el9.x86_64 7/34 2024-09-21T12:08:02.664 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-rados-2:19.1.1-373.g4e45e6b4.el9.x86_64 8/34 2024-09-21T12:08:02.692 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libcephfs2-2:19.1.1-373.g4e45e6b4.el9.x86_64 9/34 2024-09-21T12:08:02.746 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: libcephfs2-2:19.1.1-373.g4e45e6b4.el9.x86_64 9/34 2024-09-21T12:08:02.783 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-09-21T12:08:02.830 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-ceph-argparse-2:19.1.1-373.g4e45e6b4.el9.x 11/34 2024-09-21T12:08:02.900 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cephfs-2:19.1.1-373.g4e45e6b4.el9.x86_64 12/34 2024-09-21T12:08:02.927 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libradosstriper1-2:19.1.1-373.g4e45e6b4.el9.x86_64 13/34 2024-09-21T12:08:02.991 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: libradosstriper1-2:19.1.1-373.g4e45e6b4.el9.x86_64 13/34 2024-09-21T12:08:03.043 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-09-21T12:08:03.154 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/34 2024-09-21T12:08:03.185 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-09-21T12:08:03.236 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-09-21T12:08:03.267 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/34 2024-09-21T12:08:03.296 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-09-21T12:08:03.338 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-09-21T12:08:03.393 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2024-09-21T12:08:03.490 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/34 2024-09-21T12:08:03.518 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/34 2024-09-21T12:08:03.543 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/34 2024-09-21T12:08:03.566 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-21T12:08:03.595 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/34 2024-09-21T12:08:03.661 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-09-21T12:08:03.708 INFO:teuthology.orchestra.run.smithi192.stdout: Upgrading : librbd1-2:19.1.1-373.g4e45e6b4.el9.x86_64 22/34 2024-09-21T12:08:03.794 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-21T12:08:03.799 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librbd1-2:19.1.1-373.g4e45e6b4.el9.x86_64 22/34 2024-09-21T12:08:03.830 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-rbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 23/34 2024-09-21T12:08:04.011 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/34 2024-09-21T12:08:04.011 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-09-21T12:08:04.260 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/34 2024-09-21T12:08:04.311 INFO:teuthology.orchestra.run.smithi003.stdout: Upgrading : librados2-2:19.1.1-373.g4e45e6b4.el9.x86_64 7/34 2024-09-21T12:08:04.347 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-09-21T12:08:04.378 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : librgw2-2:19.1.1-373.g4e45e6b4.el9.x86_64 26/34 2024-09-21T12:08:04.405 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: librados2-2:19.1.1-373.g4e45e6b4.el9.x86_64 7/34 2024-09-21T12:08:04.458 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librgw2-2:19.1.1-373.g4e45e6b4.el9.x86_64 26/34 2024-09-21T12:08:04.496 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-rados-2:19.1.1-373.g4e45e6b4.el9.x86_64 8/34 2024-09-21T12:08:04.521 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libcephfs2-2:19.1.1-373.g4e45e6b4.el9.x86_64 9/34 2024-09-21T12:08:04.534 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-rgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 27/34 2024-09-21T12:08:04.563 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86 28/34 2024-09-21T12:08:04.601 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: libcephfs2-2:19.1.1-373.g4e45e6b4.el9.x86_64 9/34 2024-09-21T12:08:04.638 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/34 2024-09-21T12:08:04.682 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-ceph-argparse-2:19.1.1-373.g4e45e6b4.el9.x 11/34 2024-09-21T12:08:04.763 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-cephfs-2:19.1.1-373.g4e45e6b4.el9.x86_64 12/34 2024-09-21T12:08:04.790 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libradosstriper1-2:19.1.1-373.g4e45e6b4.el9.x86_64 13/34 2024-09-21T12:08:04.855 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: libradosstriper1-2:19.1.1-373.g4e45e6b4.el9.x86_64 13/34 2024-09-21T12:08:04.888 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/34 2024-09-21T12:08:05.001 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/34 2024-09-21T12:08:05.031 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/34 2024-09-21T12:08:05.077 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/34 2024-09-21T12:08:05.104 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/34 2024-09-21T12:08:05.150 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/34 2024-09-21T12:08:05.184 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/34 2024-09-21T12:08:05.512 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/34 2024-09-21T12:08:05.554 INFO:teuthology.orchestra.run.smithi003.stdout: Upgrading : librbd1-2:19.1.1-373.g4e45e6b4.el9.x86_64 22/34 2024-09-21T12:08:05.654 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: librbd1-2:19.1.1-373.g4e45e6b4.el9.x86_64 22/34 2024-09-21T12:08:05.684 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-rbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 23/34 2024-09-21T12:08:05.737 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 24/34 2024-09-21T12:08:06.247 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 25/34 2024-09-21T12:08:06.282 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : librgw2-2:19.1.1-373.g4e45e6b4.el9.x86_64 26/34 2024-09-21T12:08:06.354 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: librgw2-2:19.1.1-373.g4e45e6b4.el9.x86_64 26/34 2024-09-21T12:08:06.434 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-rgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 27/34 2024-09-21T12:08:06.459 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86 28/34 2024-09-21T12:08:06.870 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 29/34 2024-09-21T12:08:06.910 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 29/34 2024-09-21T12:08:07.486 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 29/34 2024-09-21T12:08:07.530 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-base-2:19.1.1-373.g4e45e6b4.el9.x86_64 30/34 2024-09-21T12:08:07.622 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-base-2:19.1.1-373.g4e45e6b4.el9.x86_64 30/34 2024-09-21T12:08:07.622 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T12:08:07.622 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T12:08:07.622 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:08:07.665 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-selinux-2:19.1.1-373.g4e45e6b4.el9.x86_64 31/34 2024-09-21T12:08:08.910 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 29/34 2024-09-21T12:08:08.956 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 29/34 2024-09-21T12:08:09.573 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 29/34 2024-09-21T12:08:09.691 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-base-2:19.1.1-373.g4e45e6b4.el9.x86_64 30/34 2024-09-21T12:08:09.785 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-base-2:19.1.1-373.g4e45e6b4.el9.x86_64 30/34 2024-09-21T12:08:09.785 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-21T12:08:09.785 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-21T12:08:09.785 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:08:09.817 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-selinux-2:19.1.1-373.g4e45e6b4.el9.x86_64 31/34 2024-09-21T12:08:17.537 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-selinux-2:19.1.1-373.g4e45e6b4.el9.x86_64 31/34 2024-09-21T12:08:17.537 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /sys 2024-09-21T12:08:17.537 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /proc 2024-09-21T12:08:17.537 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /mnt 2024-09-21T12:08:17.538 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /var/tmp 2024-09-21T12:08:17.538 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /home 2024-09-21T12:08:17.538 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /root 2024-09-21T12:08:17.538 INFO:teuthology.orchestra.run.smithi192.stdout:skipping the directory /tmp 2024-09-21T12:08:17.538 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:08:18.532 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-radosgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 32/34 2024-09-21T12:08:18.561 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 32/34 2024-09-21T12:08:18.561 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T12:08:18.561 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T12:08:18.561 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T12:08:18.562 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T12:08:18.562 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:08:18.563 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-21T12:08:18.651 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-21T12:08:18.651 INFO:teuthology.orchestra.run.smithi192.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-21T12:08:19.861 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-21T12:08:19.861 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-base-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/34 2024-09-21T12:08:19.861 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/34 2024-09-21T12:08:19.862 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-radosgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 3/34 2024-09-21T12:08:19.862 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-selinux-2:19.1.1-373.g4e45e6b4.el9.x86_64 4/34 2024-09-21T12:08:19.862 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libcephfs2-2:19.1.1-373.g4e45e6b4.el9.x86_64 5/34 2024-09-21T12:08:19.862 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libradosstriper1-2:19.1.1-373.g4e45e6b4.el9.x86_64 6/34 2024-09-21T12:08:19.862 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librgw2-2:19.1.1-373.g4e45e6b4.el9.x86_64 7/34 2024-09-21T12:08:19.862 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-ceph-argparse-2:19.1.1-373.g4e45e6b4.el9.x 8/34 2024-09-21T12:08:19.862 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86 9/34 2024-09-21T12:08:19.862 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cephfs-2:19.1.1-373.g4e45e6b4.el9.x86_64 10/34 2024-09-21T12:08:19.862 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-rados-2:19.1.1-373.g4e45e6b4.el9.x86_64 11/34 2024-09-21T12:08:19.862 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-rbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 12/34 2024-09-21T12:08:19.862 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-rgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 13/34 2024-09-21T12:08:19.862 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-09-21T12:08:19.862 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-09-21T12:08:19.863 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-09-21T12:08:19.863 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-09-21T12:08:19.863 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-09-21T12:08:19.863 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-09-21T12:08:19.863 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-09-21T12:08:19.863 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-09-21T12:08:19.863 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-09-21T12:08:19.863 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 23/34 2024-09-21T12:08:19.863 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-09-21T12:08:19.863 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-09-21T12:08:19.863 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-09-21T12:08:19.863 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-09-21T12:08:19.863 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-09-21T12:08:19.864 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : re2-1:20211101-20.el9.x86_64 29/34 2024-09-21T12:08:19.864 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-09-21T12:08:19.864 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librados2-2:19.1.1-373.g4e45e6b4.el9.x86_64 31/34 2024-09-21T12:08:19.864 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-09-21T12:08:19.864 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librbd1-2:19.1.1-373.g4e45e6b4.el9.x86_64 33/34 2024-09-21T12:08:20.033 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-selinux-2:19.1.1-373.g4e45e6b4.el9.x86_64 31/34 2024-09-21T12:08:20.033 INFO:teuthology.orchestra.run.smithi003.stdout:skipping the directory /sys 2024-09-21T12:08:20.033 INFO:teuthology.orchestra.run.smithi003.stdout:skipping the directory /proc 2024-09-21T12:08:20.033 INFO:teuthology.orchestra.run.smithi003.stdout:skipping the directory /mnt 2024-09-21T12:08:20.033 INFO:teuthology.orchestra.run.smithi003.stdout:skipping the directory /var/tmp 2024-09-21T12:08:20.034 INFO:teuthology.orchestra.run.smithi003.stdout:skipping the directory /home 2024-09-21T12:08:20.034 INFO:teuthology.orchestra.run.smithi003.stdout:skipping the directory /root 2024-09-21T12:08:20.034 INFO:teuthology.orchestra.run.smithi003.stdout:skipping the directory /tmp 2024-09-21T12:08:20.034 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:08:20.874 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-09-21T12:08:20.874 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:08:20.874 INFO:teuthology.orchestra.run.smithi192.stdout:Upgraded: 2024-09-21T12:08:20.874 INFO:teuthology.orchestra.run.smithi192.stdout: librados2-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:08:20.874 INFO:teuthology.orchestra.run.smithi192.stdout: librbd1-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:08:20.874 INFO:teuthology.orchestra.run.smithi192.stdout:Installed: 2024-09-21T12:08:20.874 INFO:teuthology.orchestra.run.smithi192.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T12:08:20.874 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-base-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:08:20.874 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:08:20.875 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-radosgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:08:20.875 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-selinux-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:08:20.875 INFO:teuthology.orchestra.run.smithi192.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T12:08:20.875 INFO:teuthology.orchestra.run.smithi192.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T12:08:20.875 INFO:teuthology.orchestra.run.smithi192.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T12:08:20.875 INFO:teuthology.orchestra.run.smithi192.stdout: libcephfs2-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:08:20.875 INFO:teuthology.orchestra.run.smithi192.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T12:08:20.875 INFO:teuthology.orchestra.run.smithi192.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T12:08:20.875 INFO:teuthology.orchestra.run.smithi192.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T12:08:20.875 INFO:teuthology.orchestra.run.smithi192.stdout: libradosstriper1-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:08:20.875 INFO:teuthology.orchestra.run.smithi192.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T12:08:20.875 INFO:teuthology.orchestra.run.smithi192.stdout: librgw2-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:08:20.875 INFO:teuthology.orchestra.run.smithi192.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T12:08:20.875 INFO:teuthology.orchestra.run.smithi192.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T12:08:20.876 INFO:teuthology.orchestra.run.smithi192.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T12:08:20.876 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ceph-argparse-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:08:20.876 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:08:20.876 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cephfs-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:08:20.876 INFO:teuthology.orchestra.run.smithi192.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T12:08:20.876 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rados-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:08:20.876 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:08:20.876 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:08:20.876 INFO:teuthology.orchestra.run.smithi192.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T12:08:20.876 INFO:teuthology.orchestra.run.smithi192.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T12:08:20.876 INFO:teuthology.orchestra.run.smithi192.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T12:08:20.876 INFO:teuthology.orchestra.run.smithi192.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T12:08:20.876 INFO:teuthology.orchestra.run.smithi192.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T12:08:20.876 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:08:20.877 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2024-09-21T12:08:21.050 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-radosgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 32/34 2024-09-21T12:08:21.078 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 32/34 2024-09-21T12:08:21.078 INFO:teuthology.orchestra.run.smithi003.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T12:08:21.079 INFO:teuthology.orchestra.run.smithi003.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-21T12:08:21.079 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T12:08:21.079 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-21T12:08:21.079 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:08:21.080 INFO:teuthology.orchestra.run.smithi003.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-21T12:08:21.169 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 33/34 2024-09-21T12:08:21.169 INFO:teuthology.orchestra.run.smithi003.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-21T12:08:21.254 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install ceph-test 2024-09-21T12:08:21.828 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:00:28 ago on Sat 21 Sep 2024 12:07:53 PM UTC. 2024-09-21T12:08:21.959 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2024-09-21T12:08:21.959 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-21T12:08:21.959 INFO:teuthology.orchestra.run.smithi192.stdout: Package Arch Version Repository Size 2024-09-21T12:08:21.959 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-21T12:08:21.959 INFO:teuthology.orchestra.run.smithi192.stdout:Installing: 2024-09-21T12:08:21.959 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-test x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 49 M 2024-09-21T12:08:21.959 INFO:teuthology.orchestra.run.smithi192.stdout:Installing dependencies: 2024-09-21T12:08:21.959 INFO:teuthology.orchestra.run.smithi192.stdout: libcephsqlite x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 163 k 2024-09-21T12:08:21.960 INFO:teuthology.orchestra.run.smithi192.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T12:08:21.960 INFO:teuthology.orchestra.run.smithi192.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T12:08:21.960 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:08:21.960 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction Summary 2024-09-21T12:08:21.960 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-21T12:08:21.960 INFO:teuthology.orchestra.run.smithi192.stdout:Install 4 Packages 2024-09-21T12:08:21.960 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:08:21.960 INFO:teuthology.orchestra.run.smithi192.stdout:Total download size: 49 M 2024-09-21T12:08:21.961 INFO:teuthology.orchestra.run.smithi192.stdout:Installed size: 209 M 2024-09-21T12:08:21.961 INFO:teuthology.orchestra.run.smithi192.stdout:Downloading Packages: 2024-09-21T12:08:22.181 INFO:teuthology.orchestra.run.smithi192.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.5 MB/s | 304 kB 00:00 2024-09-21T12:08:22.206 INFO:teuthology.orchestra.run.smithi192.stdout:(2/4): libcephsqlite-19.1.1-373.g4e45e6b4.el9.x 743 kB/s | 163 kB 00:00 2024-09-21T12:08:22.232 INFO:teuthology.orchestra.run.smithi192.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-21T12:08:22.392 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 34/34 2024-09-21T12:08:22.392 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-base-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/34 2024-09-21T12:08:22.392 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/34 2024-09-21T12:08:22.392 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-radosgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 3/34 2024-09-21T12:08:22.392 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-selinux-2:19.1.1-373.g4e45e6b4.el9.x86_64 4/34 2024-09-21T12:08:22.392 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libcephfs2-2:19.1.1-373.g4e45e6b4.el9.x86_64 5/34 2024-09-21T12:08:22.392 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libradosstriper1-2:19.1.1-373.g4e45e6b4.el9.x86_64 6/34 2024-09-21T12:08:22.392 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : librgw2-2:19.1.1-373.g4e45e6b4.el9.x86_64 7/34 2024-09-21T12:08:22.392 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-ceph-argparse-2:19.1.1-373.g4e45e6b4.el9.x 8/34 2024-09-21T12:08:22.392 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86 9/34 2024-09-21T12:08:22.392 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-cephfs-2:19.1.1-373.g4e45e6b4.el9.x86_64 10/34 2024-09-21T12:08:22.393 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-rados-2:19.1.1-373.g4e45e6b4.el9.x86_64 11/34 2024-09-21T12:08:22.393 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-rbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 12/34 2024-09-21T12:08:22.393 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-rgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 13/34 2024-09-21T12:08:22.393 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/34 2024-09-21T12:08:22.393 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 15/34 2024-09-21T12:08:22.393 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 16/34 2024-09-21T12:08:22.393 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 17/34 2024-09-21T12:08:22.393 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 18/34 2024-09-21T12:08:22.393 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 19/34 2024-09-21T12:08:22.393 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 20/34 2024-09-21T12:08:22.393 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 21/34 2024-09-21T12:08:22.393 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 22/34 2024-09-21T12:08:22.393 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 23/34 2024-09-21T12:08:22.393 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 24/34 2024-09-21T12:08:22.393 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 25/34 2024-09-21T12:08:22.394 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 26/34 2024-09-21T12:08:22.394 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 27/34 2024-09-21T12:08:22.394 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 28/34 2024-09-21T12:08:22.394 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : re2-1:20211101-20.el9.x86_64 29/34 2024-09-21T12:08:22.394 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 30/34 2024-09-21T12:08:22.394 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : librados2-2:19.1.1-373.g4e45e6b4.el9.x86_64 31/34 2024-09-21T12:08:22.395 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 32/34 2024-09-21T12:08:22.395 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : librbd1-2:19.1.1-373.g4e45e6b4.el9.x86_64 33/34 2024-09-21T12:08:23.442 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 34/34 2024-09-21T12:08:23.443 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:08:23.443 INFO:teuthology.orchestra.run.smithi003.stdout:Upgraded: 2024-09-21T12:08:23.443 INFO:teuthology.orchestra.run.smithi003.stdout: librados2-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:08:23.443 INFO:teuthology.orchestra.run.smithi003.stdout: librbd1-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:08:23.443 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2024-09-21T12:08:23.443 INFO:teuthology.orchestra.run.smithi003.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-21T12:08:23.443 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-base-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:08:23.443 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:08:23.443 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-radosgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:08:23.443 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-selinux-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:08:23.443 INFO:teuthology.orchestra.run.smithi003.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-21T12:08:23.444 INFO:teuthology.orchestra.run.smithi003.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-21T12:08:23.444 INFO:teuthology.orchestra.run.smithi003.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-21T12:08:23.444 INFO:teuthology.orchestra.run.smithi003.stdout: libcephfs2-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:08:23.444 INFO:teuthology.orchestra.run.smithi003.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-21T12:08:23.444 INFO:teuthology.orchestra.run.smithi003.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-21T12:08:23.444 INFO:teuthology.orchestra.run.smithi003.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-21T12:08:23.444 INFO:teuthology.orchestra.run.smithi003.stdout: libradosstriper1-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:08:23.444 INFO:teuthology.orchestra.run.smithi003.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-21T12:08:23.444 INFO:teuthology.orchestra.run.smithi003.stdout: librgw2-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:08:23.444 INFO:teuthology.orchestra.run.smithi003.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-21T12:08:23.444 INFO:teuthology.orchestra.run.smithi003.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-21T12:08:23.444 INFO:teuthology.orchestra.run.smithi003.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-21T12:08:23.444 INFO:teuthology.orchestra.run.smithi003.stdout: python3-ceph-argparse-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:08:23.444 INFO:teuthology.orchestra.run.smithi003.stdout: python3-ceph-common-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:08:23.444 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cephfs-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:08:23.444 INFO:teuthology.orchestra.run.smithi003.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-21T12:08:23.445 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rados-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:08:23.445 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:08:23.445 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:08:23.445 INFO:teuthology.orchestra.run.smithi003.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-21T12:08:23.445 INFO:teuthology.orchestra.run.smithi003.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-21T12:08:23.445 INFO:teuthology.orchestra.run.smithi003.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-21T12:08:23.445 INFO:teuthology.orchestra.run.smithi003.stdout: re2-1:20211101-20.el9.x86_64 2024-09-21T12:08:23.445 INFO:teuthology.orchestra.run.smithi003.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-21T12:08:23.445 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:08:23.445 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-09-21T12:08:23.507 INFO:teuthology.orchestra.run.smithi192.stdout:(4/4): ceph-test-19.1.1-373.g4e45e6b4.el9.x86_6 32 MB/s | 49 MB 00:01 2024-09-21T12:08:23.509 INFO:teuthology.orchestra.run.smithi192.stdout:-------------------------------------------------------------------------------- 2024-09-21T12:08:23.510 INFO:teuthology.orchestra.run.smithi192.stdout:Total 32 MB/s | 49 MB 00:01 2024-09-21T12:08:23.536 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction check 2024-09-21T12:08:23.557 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction check succeeded. 2024-09-21T12:08:23.557 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction test 2024-09-21T12:08:23.818 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph-test 2024-09-21T12:08:23.929 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction test succeeded. 2024-09-21T12:08:23.929 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction 2024-09-21T12:08:24.426 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:00:29 ago on Sat 21 Sep 2024 12:07:55 PM UTC. 2024-09-21T12:08:24.477 INFO:teuthology.orchestra.run.smithi192.stdout: Preparing : 1/1 2024-09-21T12:08:24.559 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-21T12:08:24.567 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-09-21T12:08:24.567 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-21T12:08:24.567 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repository Size 2024-09-21T12:08:24.568 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-21T12:08:24.568 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2024-09-21T12:08:24.568 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-test x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 49 M 2024-09-21T12:08:24.568 INFO:teuthology.orchestra.run.smithi003.stdout:Installing dependencies: 2024-09-21T12:08:24.568 INFO:teuthology.orchestra.run.smithi003.stdout: libcephsqlite x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 163 k 2024-09-21T12:08:24.568 INFO:teuthology.orchestra.run.smithi003.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-21T12:08:24.568 INFO:teuthology.orchestra.run.smithi003.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-21T12:08:24.568 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:08:24.568 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2024-09-21T12:08:24.568 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-21T12:08:24.569 INFO:teuthology.orchestra.run.smithi003.stdout:Install 4 Packages 2024-09-21T12:08:24.569 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:08:24.570 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 49 M 2024-09-21T12:08:24.570 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 209 M 2024-09-21T12:08:24.570 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2024-09-21T12:08:24.606 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-21T12:08:24.634 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libcephsqlite-2:19.1.1-373.g4e45e6b4.el9.x86_64 3/4 2024-09-21T12:08:24.833 INFO:teuthology.orchestra.run.smithi003.stdout:(1/4): libcephsqlite-19.1.1-373.g4e45e6b4.el9.x 767 kB/s | 163 kB 00:00 2024-09-21T12:08:25.208 INFO:teuthology.orchestra.run.smithi003.stdout:(2/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 170 kB/s | 64 kB 00:00 2024-09-21T12:08:25.249 INFO:teuthology.orchestra.run.smithi003.stdout:(3/4): socat-1.7.4.1-6.el9.x86_64.rpm 483 kB/s | 304 kB 00:00 2024-09-21T12:08:26.125 INFO:teuthology.orchestra.run.smithi003.stdout:(4/4): ceph-test-19.1.1-373.g4e45e6b4.el9.x86_6 32 MB/s | 49 MB 00:01 2024-09-21T12:08:26.127 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2024-09-21T12:08:26.127 INFO:teuthology.orchestra.run.smithi003.stdout:Total 32 MB/s | 49 MB 00:01 2024-09-21T12:08:26.158 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2024-09-21T12:08:26.178 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2024-09-21T12:08:26.178 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2024-09-21T12:08:26.567 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2024-09-21T12:08:26.568 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2024-09-21T12:08:27.126 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2024-09-21T12:08:27.217 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-21T12:08:27.266 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-21T12:08:27.293 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libcephsqlite-2:19.1.1-373.g4e45e6b4.el9.x86_64 3/4 2024-09-21T12:08:29.250 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: libcephsqlite-2:19.1.1-373.g4e45e6b4.el9.x86_64 3/4 2024-09-21T12:08:29.342 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-test-2:19.1.1-373.g4e45e6b4.el9.x86_64 4/4 2024-09-21T12:08:31.758 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-test-2:19.1.1-373.g4e45e6b4.el9.x86_64 4/4 2024-09-21T12:08:31.758 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-test-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/4 2024-09-21T12:08:31.758 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libcephsqlite-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/4 2024-09-21T12:08:31.758 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-21T12:08:32.110 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-21T12:08:32.110 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:08:32.111 INFO:teuthology.orchestra.run.smithi192.stdout:Installed: 2024-09-21T12:08:32.111 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-test-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:08:32.111 INFO:teuthology.orchestra.run.smithi192.stdout: libcephsqlite-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:08:32.111 INFO:teuthology.orchestra.run.smithi192.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T12:08:32.111 INFO:teuthology.orchestra.run.smithi192.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T12:08:32.111 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:08:32.111 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2024-09-21T12:08:32.200 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: libcephsqlite-2:19.1.1-373.g4e45e6b4.el9.x86_64 3/4 2024-09-21T12:08:32.294 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-test-2:19.1.1-373.g4e45e6b4.el9.x86_64 4/4 2024-09-21T12:08:32.382 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install ceph 2024-09-21T12:08:32.971 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:00:39 ago on Sat 21 Sep 2024 12:07:53 PM UTC. 2024-09-21T12:08:33.119 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2024-09-21T12:08:33.121 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-21T12:08:33.121 INFO:teuthology.orchestra.run.smithi192.stdout: Package Arch Version Repository Size 2024-09-21T12:08:33.122 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-21T12:08:33.122 INFO:teuthology.orchestra.run.smithi192.stdout:Installing: 2024-09-21T12:08:33.122 INFO:teuthology.orchestra.run.smithi192.stdout: ceph x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 6.6 k 2024-09-21T12:08:33.122 INFO:teuthology.orchestra.run.smithi192.stdout:Installing dependencies: 2024-09-21T12:08:33.122 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mds x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 2.4 M 2024-09-21T12:08:33.122 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 1.5 M 2024-09-21T12:08:33.122 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-modules-core noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 249 k 2024-09-21T12:08:33.122 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mon x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 4.7 M 2024-09-21T12:08:33.122 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-osd x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 17 M 2024-09-21T12:08:33.122 INFO:teuthology.orchestra.run.smithi192.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T12:08:33.122 INFO:teuthology.orchestra.run.smithi192.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T12:08:33.122 INFO:teuthology.orchestra.run.smithi192.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T12:08:33.122 INFO:teuthology.orchestra.run.smithi192.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T12:08:33.122 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T12:08:33.123 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T12:08:33.123 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T12:08:33.123 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T12:08:33.123 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T12:08:33.123 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T12:08:33.123 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T12:08:33.123 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T12:08:33.123 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T12:08:33.123 INFO:teuthology.orchestra.run.smithi192.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T12:08:33.123 INFO:teuthology.orchestra.run.smithi192.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T12:08:33.124 INFO:teuthology.orchestra.run.smithi192.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T12:08:33.124 INFO:teuthology.orchestra.run.smithi192.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T12:08:33.124 INFO:teuthology.orchestra.run.smithi192.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T12:08:33.124 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T12:08:33.124 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T12:08:33.124 INFO:teuthology.orchestra.run.smithi192.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T12:08:33.124 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T12:08:33.124 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T12:08:33.124 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T12:08:33.124 INFO:teuthology.orchestra.run.smithi192.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T12:08:33.124 INFO:teuthology.orchestra.run.smithi192.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T12:08:33.124 INFO:teuthology.orchestra.run.smithi192.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T12:08:33.124 INFO:teuthology.orchestra.run.smithi192.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T12:08:33.124 INFO:teuthology.orchestra.run.smithi192.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T12:08:33.124 INFO:teuthology.orchestra.run.smithi192.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T12:08:33.125 INFO:teuthology.orchestra.run.smithi192.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T12:08:33.125 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:08:33.125 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction Summary 2024-09-21T12:08:33.125 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-21T12:08:33.125 INFO:teuthology.orchestra.run.smithi192.stdout:Install 37 Packages 2024-09-21T12:08:33.125 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:08:33.125 INFO:teuthology.orchestra.run.smithi192.stdout:Total download size: 30 M 2024-09-21T12:08:33.125 INFO:teuthology.orchestra.run.smithi192.stdout:Installed size: 108 M 2024-09-21T12:08:33.125 INFO:teuthology.orchestra.run.smithi192.stdout:Downloading Packages: 2024-09-21T12:08:33.959 INFO:teuthology.orchestra.run.smithi192.stdout:(1/37): ceph-19.1.1-373.g4e45e6b4.el9.x86_64.rp 52 kB/s | 6.6 kB 00:00 2024-09-21T12:08:34.150 INFO:teuthology.orchestra.run.smithi192.stdout:(2/37): ceph-mgr-19.1.1-373.g4e45e6b4.el9.x86_6 4.8 MB/s | 1.5 MB 00:00 2024-09-21T12:08:34.192 INFO:teuthology.orchestra.run.smithi192.stdout:(3/37): ceph-mds-19.1.1-373.g4e45e6b4.el9.x86_6 6.6 MB/s | 2.4 MB 00:00 2024-09-21T12:08:34.284 INFO:teuthology.orchestra.run.smithi192.stdout:(4/37): ceph-mgr-modules-core-19.1.1-373.g4e45e 2.7 MB/s | 249 kB 00:00 2024-09-21T12:08:34.476 INFO:teuthology.orchestra.run.smithi192.stdout:(5/37): ceph-mon-19.1.1-373.g4e45e6b4.el9.x86_6 9.1 MB/s | 4.7 MB 00:00 2024-09-21T12:08:34.510 INFO:teuthology.orchestra.run.smithi192.stdout:(6/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.1 MB/s | 253 kB 00:00 2024-09-21T12:08:34.560 INFO:teuthology.orchestra.run.smithi192.stdout:(7/37): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-21T12:08:34.697 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-test-2:19.1.1-373.g4e45e6b4.el9.x86_64 4/4 2024-09-21T12:08:34.697 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-test-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/4 2024-09-21T12:08:34.697 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libcephsqlite-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/4 2024-09-21T12:08:34.697 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-21T12:08:34.727 INFO:teuthology.orchestra.run.smithi192.stdout:(8/37): ceph-osd-19.1.1-373.g4e45e6b4.el9.x86_6 29 MB/s | 17 MB 00:00 2024-09-21T12:08:34.761 INFO:teuthology.orchestra.run.smithi192.stdout:(9/37): python3-pycparser-2.20-6.el9.noarch.rpm 674 kB/s | 135 kB 00:00 2024-09-21T12:08:34.819 INFO:teuthology.orchestra.run.smithi192.stdout:(10/37): python3-urllib3-1.26.5-6.el9.noarch.rp 3.6 MB/s | 215 kB 00:00 2024-09-21T12:08:34.881 INFO:teuthology.orchestra.run.smithi192.stdout:(11/37): python3-requests-2.25.1-8.el9.noarch.r 812 kB/s | 125 kB 00:00 2024-09-21T12:08:34.948 INFO:teuthology.orchestra.run.smithi192.stdout:(12/37): python3-cryptography-36.0.1-4.el9.x86_ 2.6 MB/s | 1.2 MB 00:00 2024-09-21T12:08:34.973 INFO:teuthology.orchestra.run.smithi192.stdout:(13/37): lua-5.4.4-4.el9.x86_64.rpm 1.2 MB/s | 188 kB 00:00 2024-09-21T12:08:35.015 INFO:teuthology.orchestra.run.smithi192.stdout:(14/37): python3-packaging-20.9-5.el9.noarch.rp 1.8 MB/s | 77 kB 00:00 2024-09-21T12:08:35.027 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-21T12:08:35.027 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:08:35.027 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2024-09-21T12:08:35.027 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-test-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:08:35.027 INFO:teuthology.orchestra.run.smithi003.stdout: libcephsqlite-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:08:35.028 INFO:teuthology.orchestra.run.smithi003.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-21T12:08:35.028 INFO:teuthology.orchestra.run.smithi003.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-21T12:08:35.028 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:08:35.028 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-09-21T12:08:35.041 INFO:teuthology.orchestra.run.smithi192.stdout:(15/37): python3-mako-1.1.4-6.el9.noarch.rpm 1.1 MB/s | 172 kB 00:00 2024-09-21T12:08:35.066 INFO:teuthology.orchestra.run.smithi192.stdout:(16/37): python3-markupsafe-1.1.1-12.el9.x86_64 296 kB/s | 35 kB 00:00 2024-09-21T12:08:35.091 INFO:teuthology.orchestra.run.smithi192.stdout:(17/37): python3-pytz-2021.1-5.el9.noarch.rpm 676 kB/s | 51 kB 00:00 2024-09-21T12:08:35.116 INFO:teuthology.orchestra.run.smithi192.stdout:(18/37): python3-toml-0.10.2-6.el9.noarch.rpm 827 kB/s | 42 kB 00:00 2024-09-21T12:08:35.158 INFO:teuthology.orchestra.run.smithi192.stdout:(19/37): luarocks-3.9.2-5.el9.noarch.rpm 2.2 MB/s | 151 kB 00:00 2024-09-21T12:08:35.184 INFO:teuthology.orchestra.run.smithi192.stdout:(20/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 7.2 MB/s | 172 kB 00:00 2024-09-21T12:08:35.209 INFO:teuthology.orchestra.run.smithi192.stdout:(21/37): lua-devel-5.4.4-4.el9.x86_64.rpm 156 kB/s | 22 kB 00:00 2024-09-21T12:08:35.243 INFO:teuthology.orchestra.run.smithi192.stdout:(22/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 345 kB/s | 43 kB 00:00 2024-09-21T12:08:35.268 INFO:teuthology.orchestra.run.smithi192.stdout:(23/37): python3-jaraco-classes-3.2.1-5.el9.noa 764 kB/s | 18 kB 00:00 2024-09-21T12:08:35.293 INFO:teuthology.orchestra.run.smithi192.stdout:(24/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 128 kB/s | 11 kB 00:00 2024-09-21T12:08:35.316 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph 2024-09-21T12:08:35.318 INFO:teuthology.orchestra.run.smithi192.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 459 kB/s | 23 kB 00:00 2024-09-21T12:08:35.344 INFO:teuthology.orchestra.run.smithi192.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 386 kB/s | 19 kB 00:00 2024-09-21T12:08:35.369 INFO:teuthology.orchestra.run.smithi192.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 390 kB/s | 20 kB 00:00 2024-09-21T12:08:35.394 INFO:teuthology.orchestra.run.smithi192.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 920 kB/s | 46 kB 00:00 2024-09-21T12:08:35.420 INFO:teuthology.orchestra.run.smithi192.stdout:(29/37): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-21T12:08:35.445 INFO:teuthology.orchestra.run.smithi192.stdout:(30/37): python3-cherrypy-18.6.1-2.el9.noarch.r 1.3 MB/s | 358 kB 00:00 2024-09-21T12:08:35.470 INFO:teuthology.orchestra.run.smithi192.stdout:(31/37): python3-portend-3.1.0-2.el9.noarch.rpm 326 kB/s | 16 kB 00:00 2024-09-21T12:08:35.495 INFO:teuthology.orchestra.run.smithi192.stdout:(32/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.7 MB/s | 90 kB 00:00 2024-09-21T12:08:35.521 INFO:teuthology.orchestra.run.smithi192.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 713 kB/s | 36 kB 00:00 2024-09-21T12:08:35.546 INFO:teuthology.orchestra.run.smithi192.stdout:(34/37): python3-pecan-1.4.2-3.el9.noarch.rpm 1.8 MB/s | 272 kB 00:00 2024-09-21T12:08:35.571 INFO:teuthology.orchestra.run.smithi192.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 803 kB/s | 20 kB 00:00 2024-09-21T12:08:35.597 INFO:teuthology.orchestra.run.smithi192.stdout:(36/37): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-21T12:08:35.647 INFO:teuthology.orchestra.run.smithi192.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.3 MB/s | 427 kB 00:00 2024-09-21T12:08:35.650 INFO:teuthology.orchestra.run.smithi192.stdout:-------------------------------------------------------------------------------- 2024-09-21T12:08:35.650 INFO:teuthology.orchestra.run.smithi192.stdout:Total 12 MB/s | 30 MB 00:02 2024-09-21T12:08:35.800 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction check 2024-09-21T12:08:35.841 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction check succeeded. 2024-09-21T12:08:35.841 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction test 2024-09-21T12:08:35.936 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:00:40 ago on Sat 21 Sep 2024 12:07:55 PM UTC. 2024-09-21T12:08:36.080 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-09-21T12:08:36.083 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-21T12:08:36.083 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repository Size 2024-09-21T12:08:36.083 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-21T12:08:36.083 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2024-09-21T12:08:36.083 INFO:teuthology.orchestra.run.smithi003.stdout: ceph x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 6.6 k 2024-09-21T12:08:36.083 INFO:teuthology.orchestra.run.smithi003.stdout:Installing dependencies: 2024-09-21T12:08:36.084 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mds x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 2.4 M 2024-09-21T12:08:36.084 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 1.5 M 2024-09-21T12:08:36.084 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-modules-core noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 249 k 2024-09-21T12:08:36.084 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mon x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 4.7 M 2024-09-21T12:08:36.084 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-osd x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 17 M 2024-09-21T12:08:36.084 INFO:teuthology.orchestra.run.smithi003.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-21T12:08:36.084 INFO:teuthology.orchestra.run.smithi003.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-21T12:08:36.084 INFO:teuthology.orchestra.run.smithi003.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-21T12:08:36.084 INFO:teuthology.orchestra.run.smithi003.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-21T12:08:36.084 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-21T12:08:36.084 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-21T12:08:36.084 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-21T12:08:36.084 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-21T12:08:36.085 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-21T12:08:36.085 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-21T12:08:36.085 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-21T12:08:36.085 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-21T12:08:36.085 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-21T12:08:36.085 INFO:teuthology.orchestra.run.smithi003.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-21T12:08:36.085 INFO:teuthology.orchestra.run.smithi003.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-21T12:08:36.085 INFO:teuthology.orchestra.run.smithi003.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-21T12:08:36.085 INFO:teuthology.orchestra.run.smithi003.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-21T12:08:36.085 INFO:teuthology.orchestra.run.smithi003.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-21T12:08:36.085 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-21T12:08:36.085 INFO:teuthology.orchestra.run.smithi003.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-21T12:08:36.085 INFO:teuthology.orchestra.run.smithi003.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-21T12:08:36.085 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-21T12:08:36.086 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-21T12:08:36.086 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-21T12:08:36.086 INFO:teuthology.orchestra.run.smithi003.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-21T12:08:36.086 INFO:teuthology.orchestra.run.smithi003.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-21T12:08:36.086 INFO:teuthology.orchestra.run.smithi003.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-21T12:08:36.086 INFO:teuthology.orchestra.run.smithi003.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-21T12:08:36.086 INFO:teuthology.orchestra.run.smithi003.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-21T12:08:36.086 INFO:teuthology.orchestra.run.smithi003.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-21T12:08:36.086 INFO:teuthology.orchestra.run.smithi003.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-21T12:08:36.086 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:08:36.086 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2024-09-21T12:08:36.086 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-21T12:08:36.086 INFO:teuthology.orchestra.run.smithi003.stdout:Install 37 Packages 2024-09-21T12:08:36.086 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:08:36.087 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 30 M 2024-09-21T12:08:36.087 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 108 M 2024-09-21T12:08:36.087 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2024-09-21T12:08:36.320 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction test succeeded. 2024-09-21T12:08:36.321 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction 2024-09-21T12:08:36.470 INFO:teuthology.orchestra.run.smithi003.stdout:(1/37): ceph-19.1.1-373.g4e45e6b4.el9.x86_64.rp 50 kB/s | 6.6 kB 00:00 2024-09-21T12:08:36.636 INFO:teuthology.orchestra.run.smithi003.stdout:(2/37): ceph-mgr-19.1.1-373.g4e45e6b4.el9.x86_6 5.1 MB/s | 1.5 MB 00:00 2024-09-21T12:08:36.687 INFO:teuthology.orchestra.run.smithi003.stdout:(3/37): ceph-mds-19.1.1-373.g4e45e6b4.el9.x86_6 6.9 MB/s | 2.4 MB 00:00 2024-09-21T12:08:36.779 INFO:teuthology.orchestra.run.smithi003.stdout:(4/37): ceph-mgr-modules-core-19.1.1-373.g4e45e 2.7 MB/s | 249 kB 00:00 2024-09-21T12:08:36.854 INFO:teuthology.orchestra.run.smithi003.stdout:(5/37): ceph-mon-19.1.1-373.g4e45e6b4.el9.x86_6 12 MB/s | 4.7 MB 00:00 2024-09-21T12:08:37.196 INFO:teuthology.orchestra.run.smithi003.stdout:(6/37): ceph-osd-19.1.1-373.g4e45e6b4.el9.x86_6 30 MB/s | 17 MB 00:00 2024-09-21T12:08:37.505 INFO:teuthology.orchestra.run.smithi003.stdout:(7/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 349 kB/s | 253 kB 00:00 2024-09-21T12:08:37.622 INFO:teuthology.orchestra.run.smithi003.stdout:(8/37): python3-pycparser-2.20-6.el9.noarch.rpm 1.1 MB/s | 135 kB 00:00 2024-09-21T12:08:37.655 INFO:teuthology.orchestra.run.smithi003.stdout:(9/37): python3-ply-3.11-14.el9.noarch.rpm 232 kB/s | 106 kB 00:00 2024-09-21T12:08:37.665 INFO:teuthology.orchestra.run.smithi192.stdout: Preparing : 1/1 2024-09-21T12:08:37.730 INFO:teuthology.orchestra.run.smithi003.stdout:(10/37): python3-requests-2.25.1-8.el9.noarch.r 1.1 MB/s | 125 kB 00:00 2024-09-21T12:08:37.741 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-21T12:08:37.783 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-21T12:08:37.810 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-21T12:08:37.864 INFO:teuthology.orchestra.run.smithi003.stdout:(11/37): python3-cryptography-36.0.1-4.el9.x86_ 1.2 MB/s | 1.2 MB 00:01 2024-09-21T12:08:37.882 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-21T12:08:37.898 INFO:teuthology.orchestra.run.smithi003.stdout:(12/37): lua-5.4.4-4.el9.x86_64.rpm 1.1 MB/s | 188 kB 00:00 2024-09-21T12:08:37.923 INFO:teuthology.orchestra.run.smithi003.stdout:(13/37): python3-urllib3-1.26.5-6.el9.noarch.rp 803 kB/s | 215 kB 00:00 2024-09-21T12:08:37.926 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-21T12:08:37.948 INFO:teuthology.orchestra.run.smithi003.stdout:(14/37): python3-markupsafe-1.1.1-12.el9.x86_64 693 kB/s | 35 kB 00:00 2024-09-21T12:08:37.959 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-21T12:08:37.990 INFO:teuthology.orchestra.run.smithi003.stdout:(15/37): python3-pytz-2021.1-5.el9.noarch.rpm 1.2 MB/s | 51 kB 00:00 2024-09-21T12:08:38.015 INFO:teuthology.orchestra.run.smithi003.stdout:(16/37): python3-mako-1.1.4-6.el9.noarch.rpm 1.1 MB/s | 172 kB 00:00 2024-09-21T12:08:38.041 INFO:teuthology.orchestra.run.smithi003.stdout:(17/37): python3-packaging-20.9-5.el9.noarch.rp 657 kB/s | 77 kB 00:00 2024-09-21T12:08:38.050 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-21T12:08:38.066 INFO:teuthology.orchestra.run.smithi003.stdout:(18/37): python3-toml-0.10.2-6.el9.noarch.rpm 552 kB/s | 42 kB 00:00 2024-09-21T12:08:38.116 INFO:teuthology.orchestra.run.smithi003.stdout:(19/37): luarocks-3.9.2-5.el9.noarch.rpm 3.0 MB/s | 151 kB 00:00 2024-09-21T12:08:38.121 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-21T12:08:38.141 INFO:teuthology.orchestra.run.smithi003.stdout:(20/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 580 kB/s | 43 kB 00:00 2024-09-21T12:08:38.161 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-21T12:08:38.166 INFO:teuthology.orchestra.run.smithi003.stdout:(21/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 3.5 MB/s | 172 kB 00:00 2024-09-21T12:08:38.192 INFO:teuthology.orchestra.run.smithi003.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 429 kB/s | 11 kB 00:00 2024-09-21T12:08:38.196 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-21T12:08:38.217 INFO:teuthology.orchestra.run.smithi003.stdout:(23/37): lua-devel-5.4.4-4.el9.x86_64.rpm 111 kB/s | 22 kB 00:00 2024-09-21T12:08:38.227 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-21T12:08:38.251 INFO:teuthology.orchestra.run.smithi003.stdout:(24/37): python3-jaraco-classes-3.2.1-5.el9.noa 302 kB/s | 18 kB 00:00 2024-09-21T12:08:38.269 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-21T12:08:38.276 INFO:teuthology.orchestra.run.smithi003.stdout:(25/37): python3-jaraco-functools-3.5.0-2.el9.n 850 kB/s | 19 kB 00:00 2024-09-21T12:08:38.301 INFO:teuthology.orchestra.run.smithi003.stdout:(26/37): python3-jaraco-collections-3.0.0-8.el9 275 kB/s | 23 kB 00:00 2024-09-21T12:08:38.302 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-21T12:08:38.327 INFO:teuthology.orchestra.run.smithi003.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 390 kB/s | 20 kB 00:00 2024-09-21T12:08:38.343 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-21T12:08:38.352 INFO:teuthology.orchestra.run.smithi003.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 925 kB/s | 46 kB 00:00 2024-09-21T12:08:38.377 INFO:teuthology.orchestra.run.smithi003.stdout:(29/37): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-21T12:08:38.378 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-21T12:08:38.402 INFO:teuthology.orchestra.run.smithi003.stdout:(30/37): python3-cherrypy-18.6.1-2.el9.noarch.r 1.3 MB/s | 358 kB 00:00 2024-09-21T12:08:38.412 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-21T12:08:38.428 INFO:teuthology.orchestra.run.smithi003.stdout:(31/37): python3-portend-3.1.0-2.el9.noarch.rpm 328 kB/s | 16 kB 00:00 2024-09-21T12:08:38.453 INFO:teuthology.orchestra.run.smithi003.stdout:(32/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.7 MB/s | 90 kB 00:00 2024-09-21T12:08:38.461 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-21T12:08:38.478 INFO:teuthology.orchestra.run.smithi003.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 712 kB/s | 36 kB 00:00 2024-09-21T12:08:38.495 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-21T12:08:38.503 INFO:teuthology.orchestra.run.smithi003.stdout:(34/37): python3-pecan-1.4.2-3.el9.noarch.rpm 1.8 MB/s | 272 kB 00:00 2024-09-21T12:08:38.520 INFO:teuthology.orchestra.run.smithi003.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 1.2 MB/s | 20 kB 00:00 2024-09-21T12:08:38.545 INFO:teuthology.orchestra.run.smithi003.stdout:(36/37): python3-webob-1.8.8-2.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2024-09-21T12:08:38.568 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-21T12:08:38.579 INFO:teuthology.orchestra.run.smithi003.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 4.2 MB/s | 427 kB 00:00 2024-09-21T12:08:38.583 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2024-09-21T12:08:38.583 INFO:teuthology.orchestra.run.smithi003.stdout:Total 12 MB/s | 30 MB 00:02 2024-09-21T12:08:38.706 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-21T12:08:38.742 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2024-09-21T12:08:38.786 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2024-09-21T12:08:38.786 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2024-09-21T12:08:38.786 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-21T12:08:38.848 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-21T12:08:38.894 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-21T12:08:38.943 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-21T12:08:38.999 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-21T12:08:39.186 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-21T12:08:39.232 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-21T12:08:39.276 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2024-09-21T12:08:39.276 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2024-09-21T12:08:39.309 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-21T12:08:39.398 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-21T12:08:39.439 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-21T12:08:39.590 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-21T12:08:39.753 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-373.g4e45e6b4.el9.n 32/37 2024-09-21T12:08:39.800 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-2:19.1.1-373.g4e45e6b4.el9.x86_64 33/37 2024-09-21T12:08:39.827 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mgr-2:19.1.1-373.g4e45e6b4.el9.x86_64 33/37 2024-09-21T12:08:39.827 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T12:08:39.827 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T12:08:39.827 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T12:08:39.827 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T12:08:39.827 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:08:40.675 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2024-09-21T12:08:40.741 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-21T12:08:40.774 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-21T12:08:40.810 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-21T12:08:40.886 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-21T12:08:40.926 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-21T12:08:40.959 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-21T12:08:41.055 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-21T12:08:41.148 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-21T12:08:41.195 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-21T12:08:41.229 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-21T12:08:41.261 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-21T12:08:41.267 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-osd-2:19.1.1-373.g4e45e6b4.el9.x86_64 34/37 2024-09-21T12:08:41.295 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-osd-2:19.1.1-373.g4e45e6b4.el9.x86_64 34/37 2024-09-21T12:08:41.295 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T12:08:41.295 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T12:08:41.295 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T12:08:41.295 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T12:08:41.295 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:08:41.296 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-21T12:08:41.328 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-21T12:08:41.378 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-21T12:08:41.421 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-21T12:08:41.455 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-21T12:08:41.505 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-21T12:08:41.544 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-21T12:08:41.621 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-21T12:08:41.726 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mon-2:19.1.1-373.g4e45e6b4.el9.x86_64 35/37 2024-09-21T12:08:41.750 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mon-2:19.1.1-373.g4e45e6b4.el9.x86_64 35/37 2024-09-21T12:08:41.750 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T12:08:41.750 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T12:08:41.750 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T12:08:41.750 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T12:08:41.750 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:08:41.780 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-21T12:08:41.871 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-21T12:08:41.923 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-21T12:08:41.961 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-21T12:08:41.977 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mds-2:19.1.1-373.g4e45e6b4.el9.x86_64 36/37 2024-09-21T12:08:42.001 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mds-2:19.1.1-373.g4e45e6b4.el9.x86_64 36/37 2024-09-21T12:08:42.001 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T12:08:42.001 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T12:08:42.001 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T12:08:42.001 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T12:08:42.001 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:08:42.019 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-21T12:08:42.066 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-2:19.1.1-373.g4e45e6b4.el9.x86_64 37/37 2024-09-21T12:08:42.083 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-21T12:08:42.287 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-21T12:08:42.339 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-21T12:08:42.420 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-21T12:08:42.511 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-21T12:08:42.555 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-21T12:08:42.678 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-21T12:08:42.850 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-373.g4e45e6b4.el9.n 32/37 2024-09-21T12:08:42.889 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-mgr-2:19.1.1-373.g4e45e6b4.el9.x86_64 33/37 2024-09-21T12:08:42.918 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-mgr-2:19.1.1-373.g4e45e6b4.el9.x86_64 33/37 2024-09-21T12:08:42.918 INFO:teuthology.orchestra.run.smithi003.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T12:08:42.918 INFO:teuthology.orchestra.run.smithi003.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-21T12:08:42.918 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T12:08:42.918 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-21T12:08:42.918 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:08:43.915 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-2:19.1.1-373.g4e45e6b4.el9.x86_64 37/37 2024-09-21T12:08:43.915 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/37 2024-09-21T12:08:43.915 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mds-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/37 2024-09-21T12:08:43.915 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-2:19.1.1-373.g4e45e6b4.el9.x86_64 3/37 2024-09-21T12:08:43.915 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mon-2:19.1.1-373.g4e45e6b4.el9.x86_64 4/37 2024-09-21T12:08:43.915 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-osd-2:19.1.1-373.g4e45e6b4.el9.x86_64 5/37 2024-09-21T12:08:43.915 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-373.g4e45e6b4.el9.n 6/37 2024-09-21T12:08:43.915 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-21T12:08:43.915 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-21T12:08:43.916 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-21T12:08:43.916 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-21T12:08:43.916 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-21T12:08:43.916 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-21T12:08:43.916 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-21T12:08:43.916 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-21T12:08:43.916 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-21T12:08:43.916 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-21T12:08:43.916 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-21T12:08:43.916 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-21T12:08:43.916 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-21T12:08:43.916 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-21T12:08:43.916 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-21T12:08:43.916 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-21T12:08:43.917 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-21T12:08:43.917 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-21T12:08:43.917 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-21T12:08:43.917 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-21T12:08:43.917 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-21T12:08:43.917 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-21T12:08:43.918 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-21T12:08:43.918 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-21T12:08:43.918 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-21T12:08:43.918 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-21T12:08:43.918 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-21T12:08:43.918 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-21T12:08:43.918 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-21T12:08:43.918 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-21T12:08:44.440 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-osd-2:19.1.1-373.g4e45e6b4.el9.x86_64 34/37 2024-09-21T12:08:44.469 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-osd-2:19.1.1-373.g4e45e6b4.el9.x86_64 34/37 2024-09-21T12:08:44.469 INFO:teuthology.orchestra.run.smithi003.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T12:08:44.470 INFO:teuthology.orchestra.run.smithi003.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-21T12:08:44.470 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T12:08:44.470 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-21T12:08:44.470 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:08:44.830 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-21T12:08:44.830 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:08:44.830 INFO:teuthology.orchestra.run.smithi192.stdout:Installed: 2024-09-21T12:08:44.830 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:08:44.830 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mds-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:08:44.830 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:08:44.830 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-modules-core-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T12:08:44.830 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mon-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:08:44.830 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-osd-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:08:44.830 INFO:teuthology.orchestra.run.smithi192.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T12:08:44.830 INFO:teuthology.orchestra.run.smithi192.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T12:08:44.831 INFO:teuthology.orchestra.run.smithi192.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T12:08:44.831 INFO:teuthology.orchestra.run.smithi192.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T12:08:44.831 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T12:08:44.831 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T12:08:44.831 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T12:08:44.831 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T12:08:44.831 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T12:08:44.831 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T12:08:44.831 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T12:08:44.831 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T12:08:44.831 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T12:08:44.831 INFO:teuthology.orchestra.run.smithi192.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T12:08:44.831 INFO:teuthology.orchestra.run.smithi192.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T12:08:44.831 INFO:teuthology.orchestra.run.smithi192.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T12:08:44.831 INFO:teuthology.orchestra.run.smithi192.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T12:08:44.832 INFO:teuthology.orchestra.run.smithi192.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T12:08:44.832 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T12:08:44.832 INFO:teuthology.orchestra.run.smithi192.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T12:08:44.832 INFO:teuthology.orchestra.run.smithi192.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T12:08:44.832 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T12:08:44.832 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T12:08:44.832 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T12:08:44.832 INFO:teuthology.orchestra.run.smithi192.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T12:08:44.832 INFO:teuthology.orchestra.run.smithi192.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T12:08:44.832 INFO:teuthology.orchestra.run.smithi192.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T12:08:44.832 INFO:teuthology.orchestra.run.smithi192.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T12:08:44.832 INFO:teuthology.orchestra.run.smithi192.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T12:08:44.832 INFO:teuthology.orchestra.run.smithi192.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T12:08:44.832 INFO:teuthology.orchestra.run.smithi192.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T12:08:44.832 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:08:44.833 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2024-09-21T12:08:44.924 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-mon-2:19.1.1-373.g4e45e6b4.el9.x86_64 35/37 2024-09-21T12:08:44.949 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-mon-2:19.1.1-373.g4e45e6b4.el9.x86_64 35/37 2024-09-21T12:08:44.949 INFO:teuthology.orchestra.run.smithi003.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T12:08:44.950 INFO:teuthology.orchestra.run.smithi003.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-21T12:08:44.950 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T12:08:44.950 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-21T12:08:44.950 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:08:45.191 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-mds-2:19.1.1-373.g4e45e6b4.el9.x86_64 36/37 2024-09-21T12:08:45.217 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-mds-2:19.1.1-373.g4e45e6b4.el9.x86_64 36/37 2024-09-21T12:08:45.217 INFO:teuthology.orchestra.run.smithi003.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T12:08:45.217 INFO:teuthology.orchestra.run.smithi003.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-21T12:08:45.217 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T12:08:45.217 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-21T12:08:45.217 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:08:45.255 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install ceph-base 2024-09-21T12:08:45.291 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-2:19.1.1-373.g4e45e6b4.el9.x86_64 37/37 2024-09-21T12:08:45.839 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:00:52 ago on Sat 21 Sep 2024 12:07:53 PM UTC. 2024-09-21T12:08:45.927 INFO:teuthology.orchestra.run.smithi192.stdout:Package ceph-base-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T12:08:45.969 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2024-09-21T12:08:45.970 INFO:teuthology.orchestra.run.smithi192.stdout:Nothing to do. 2024-09-21T12:08:45.970 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2024-09-21T12:08:46.034 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install cephadm 2024-09-21T12:08:46.606 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:00:53 ago on Sat 21 Sep 2024 12:07:53 PM UTC. 2024-09-21T12:08:46.736 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2024-09-21T12:08:46.737 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-21T12:08:46.737 INFO:teuthology.orchestra.run.smithi192.stdout: Package Arch Version Repository Size 2024-09-21T12:08:46.737 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-21T12:08:46.737 INFO:teuthology.orchestra.run.smithi192.stdout:Installing: 2024-09-21T12:08:46.737 INFO:teuthology.orchestra.run.smithi192.stdout: cephadm noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 765 k 2024-09-21T12:08:46.737 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:08:46.737 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction Summary 2024-09-21T12:08:46.737 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-21T12:08:46.737 INFO:teuthology.orchestra.run.smithi192.stdout:Install 1 Package 2024-09-21T12:08:46.738 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:08:46.738 INFO:teuthology.orchestra.run.smithi192.stdout:Total download size: 765 k 2024-09-21T12:08:46.738 INFO:teuthology.orchestra.run.smithi192.stdout:Installed size: 772 k 2024-09-21T12:08:46.738 INFO:teuthology.orchestra.run.smithi192.stdout:Downloading Packages: 2024-09-21T12:08:46.993 INFO:teuthology.orchestra.run.smithi192.stdout:cephadm-19.1.1-373.g4e45e6b4.el9.noarch.rpm 2.9 MB/s | 765 kB 00:00 2024-09-21T12:08:46.993 INFO:teuthology.orchestra.run.smithi192.stdout:-------------------------------------------------------------------------------- 2024-09-21T12:08:46.994 INFO:teuthology.orchestra.run.smithi192.stdout:Total 2.9 MB/s | 765 kB 00:00 2024-09-21T12:08:46.994 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction check 2024-09-21T12:08:46.999 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction check succeeded. 2024-09-21T12:08:46.999 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction test 2024-09-21T12:08:47.005 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction test succeeded. 2024-09-21T12:08:47.005 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction 2024-09-21T12:08:47.082 INFO:teuthology.orchestra.run.smithi192.stdout: Preparing : 1/1 2024-09-21T12:08:47.108 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-2:19.1.1-373.g4e45e6b4.el9.x86_64 37/37 2024-09-21T12:08:47.108 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/37 2024-09-21T12:08:47.108 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-mds-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/37 2024-09-21T12:08:47.108 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-mgr-2:19.1.1-373.g4e45e6b4.el9.x86_64 3/37 2024-09-21T12:08:47.108 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-mon-2:19.1.1-373.g4e45e6b4.el9.x86_64 4/37 2024-09-21T12:08:47.108 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-osd-2:19.1.1-373.g4e45e6b4.el9.x86_64 5/37 2024-09-21T12:08:47.108 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-373.g4e45e6b4.el9.n 6/37 2024-09-21T12:08:47.108 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-21T12:08:47.108 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-21T12:08:47.108 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-21T12:08:47.109 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-21T12:08:47.109 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-21T12:08:47.109 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-21T12:08:47.109 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-21T12:08:47.109 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-21T12:08:47.109 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-21T12:08:47.109 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-21T12:08:47.109 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-21T12:08:47.109 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-21T12:08:47.109 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-21T12:08:47.109 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-21T12:08:47.109 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-21T12:08:47.109 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-21T12:08:47.110 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-21T12:08:47.110 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-21T12:08:47.110 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-21T12:08:47.110 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-21T12:08:47.110 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-21T12:08:47.111 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-21T12:08:47.111 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-21T12:08:47.111 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-21T12:08:47.111 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-21T12:08:47.111 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-21T12:08:47.111 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-21T12:08:47.111 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-21T12:08:47.111 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-21T12:08:47.112 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-21T12:08:47.478 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-21T12:08:47.571 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-21T12:08:47.917 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-21T12:08:48.170 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-21T12:08:48.170 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:08:48.170 INFO:teuthology.orchestra.run.smithi192.stdout:Installed: 2024-09-21T12:08:48.170 INFO:teuthology.orchestra.run.smithi192.stdout: cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T12:08:48.170 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:08:48.170 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2024-09-21T12:08:48.211 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-21T12:08:48.211 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:08:48.211 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2024-09-21T12:08:48.211 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:08:48.212 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mds-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:08:48.212 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:08:48.212 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-modules-core-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T12:08:48.212 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mon-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:08:48.212 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-osd-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:08:48.212 INFO:teuthology.orchestra.run.smithi003.stdout: lua-5.4.4-4.el9.x86_64 2024-09-21T12:08:48.212 INFO:teuthology.orchestra.run.smithi003.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-21T12:08:48.212 INFO:teuthology.orchestra.run.smithi003.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-21T12:08:48.212 INFO:teuthology.orchestra.run.smithi003.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-21T12:08:48.212 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-21T12:08:48.212 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-21T12:08:48.212 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-21T12:08:48.213 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-21T12:08:48.213 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-21T12:08:48.213 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-21T12:08:48.213 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-21T12:08:48.213 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-21T12:08:48.213 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-21T12:08:48.213 INFO:teuthology.orchestra.run.smithi003.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-21T12:08:48.213 INFO:teuthology.orchestra.run.smithi003.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-21T12:08:48.213 INFO:teuthology.orchestra.run.smithi003.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-21T12:08:48.213 INFO:teuthology.orchestra.run.smithi003.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-21T12:08:48.213 INFO:teuthology.orchestra.run.smithi003.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-21T12:08:48.213 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-21T12:08:48.213 INFO:teuthology.orchestra.run.smithi003.stdout: python3-ply-3.11-14.el9.noarch 2024-09-21T12:08:48.214 INFO:teuthology.orchestra.run.smithi003.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-21T12:08:48.214 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-21T12:08:48.214 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-21T12:08:48.214 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-21T12:08:48.214 INFO:teuthology.orchestra.run.smithi003.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-21T12:08:48.214 INFO:teuthology.orchestra.run.smithi003.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-21T12:08:48.214 INFO:teuthology.orchestra.run.smithi003.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-21T12:08:48.214 INFO:teuthology.orchestra.run.smithi003.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-21T12:08:48.214 INFO:teuthology.orchestra.run.smithi003.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-21T12:08:48.214 INFO:teuthology.orchestra.run.smithi003.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-21T12:08:48.214 INFO:teuthology.orchestra.run.smithi003.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-21T12:08:48.214 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:08:48.215 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-09-21T12:08:48.416 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install ceph-immutable-object-cache 2024-09-21T12:08:48.563 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph-base 2024-09-21T12:08:49.005 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:00:56 ago on Sat 21 Sep 2024 12:07:53 PM UTC. 2024-09-21T12:08:49.140 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2024-09-21T12:08:49.140 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-21T12:08:49.141 INFO:teuthology.orchestra.run.smithi192.stdout: Package Arch Version Repo Size 2024-09-21T12:08:49.141 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-21T12:08:49.141 INFO:teuthology.orchestra.run.smithi192.stdout:Installing: 2024-09-21T12:08:49.141 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 145 k 2024-09-21T12:08:49.141 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:08:49.141 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction Summary 2024-09-21T12:08:49.141 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-21T12:08:49.141 INFO:teuthology.orchestra.run.smithi192.stdout:Install 1 Package 2024-09-21T12:08:49.141 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:08:49.142 INFO:teuthology.orchestra.run.smithi192.stdout:Total download size: 145 k 2024-09-21T12:08:49.142 INFO:teuthology.orchestra.run.smithi192.stdout:Installed size: 435 k 2024-09-21T12:08:49.142 INFO:teuthology.orchestra.run.smithi192.stdout:Downloading Packages: 2024-09-21T12:08:49.168 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:00:54 ago on Sat 21 Sep 2024 12:07:55 PM UTC. 2024-09-21T12:08:49.258 INFO:teuthology.orchestra.run.smithi003.stdout:Package ceph-base-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T12:08:49.303 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-09-21T12:08:49.304 INFO:teuthology.orchestra.run.smithi003.stdout:Nothing to do. 2024-09-21T12:08:49.304 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-09-21T12:08:49.366 INFO:teuthology.orchestra.run.smithi192.stdout:ceph-immutable-object-cache-19.1.1-373.g4e45e6b 648 kB/s | 145 kB 00:00 2024-09-21T12:08:49.366 INFO:teuthology.orchestra.run.smithi192.stdout:-------------------------------------------------------------------------------- 2024-09-21T12:08:49.367 INFO:teuthology.orchestra.run.smithi192.stdout:Total 644 kB/s | 145 kB 00:00 2024-09-21T12:08:49.367 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction check 2024-09-21T12:08:49.374 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction check succeeded. 2024-09-21T12:08:49.374 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction test 2024-09-21T12:08:49.375 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install cephadm 2024-09-21T12:08:49.431 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction test succeeded. 2024-09-21T12:08:49.431 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction 2024-09-21T12:08:49.576 INFO:teuthology.orchestra.run.smithi192.stdout: Preparing : 1/1 2024-09-21T12:08:49.642 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-373.g4e45e6b4.e 1/1 2024-09-21T12:08:49.666 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-373.g4e45e6b4.e 1/1 2024-09-21T12:08:49.666 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T12:08:49.666 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T12:08:49.666 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:08:49.981 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:00:54 ago on Sat 21 Sep 2024 12:07:55 PM UTC. 2024-09-21T12:08:50.121 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-09-21T12:08:50.122 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-21T12:08:50.122 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repository Size 2024-09-21T12:08:50.122 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-21T12:08:50.122 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2024-09-21T12:08:50.122 INFO:teuthology.orchestra.run.smithi003.stdout: cephadm noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 765 k 2024-09-21T12:08:50.122 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:08:50.122 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2024-09-21T12:08:50.122 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-21T12:08:50.122 INFO:teuthology.orchestra.run.smithi003.stdout:Install 1 Package 2024-09-21T12:08:50.122 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:08:50.123 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 765 k 2024-09-21T12:08:50.123 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 772 k 2024-09-21T12:08:50.123 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2024-09-21T12:08:50.390 INFO:teuthology.orchestra.run.smithi003.stdout:cephadm-19.1.1-373.g4e45e6b4.el9.noarch.rpm 2.8 MB/s | 765 kB 00:00 2024-09-21T12:08:50.390 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2024-09-21T12:08:50.391 INFO:teuthology.orchestra.run.smithi003.stdout:Total 2.8 MB/s | 765 kB 00:00 2024-09-21T12:08:50.391 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2024-09-21T12:08:50.396 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2024-09-21T12:08:50.396 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2024-09-21T12:08:50.402 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2024-09-21T12:08:50.402 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2024-09-21T12:08:50.475 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2024-09-21T12:08:50.551 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-373.g4e45e6b4.e 1/1 2024-09-21T12:08:50.551 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:08:50.551 INFO:teuthology.orchestra.run.smithi192.stdout:Installed: 2024-09-21T12:08:50.551 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-immutable-object-cache-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:08:50.552 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:08:50.552 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2024-09-21T12:08:50.796 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install ceph-mgr 2024-09-21T12:08:50.928 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-21T12:08:51.021 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-21T12:08:51.382 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-21T12:08:51.383 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:00:58 ago on Sat 21 Sep 2024 12:07:53 PM UTC. 2024-09-21T12:08:51.475 INFO:teuthology.orchestra.run.smithi192.stdout:Package ceph-mgr-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T12:08:51.519 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2024-09-21T12:08:51.520 INFO:teuthology.orchestra.run.smithi192.stdout:Nothing to do. 2024-09-21T12:08:51.520 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2024-09-21T12:08:51.591 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install ceph-mgr-dashboard 2024-09-21T12:08:51.644 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 1/1 2024-09-21T12:08:51.644 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:08:51.644 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2024-09-21T12:08:51.644 INFO:teuthology.orchestra.run.smithi003.stdout: cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T12:08:51.644 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:08:51.644 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-09-21T12:08:51.881 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph-immutable-object-cache 2024-09-21T12:08:52.171 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:00:59 ago on Sat 21 Sep 2024 12:07:53 PM UTC. 2024-09-21T12:08:52.303 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2024-09-21T12:08:52.304 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-21T12:08:52.304 INFO:teuthology.orchestra.run.smithi192.stdout: Package Arch Version Repository Size 2024-09-21T12:08:52.304 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-21T12:08:52.304 INFO:teuthology.orchestra.run.smithi192.stdout:Installing: 2024-09-21T12:08:52.304 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-dashboard noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 3.6 M 2024-09-21T12:08:52.304 INFO:teuthology.orchestra.run.smithi192.stdout:Installing dependencies: 2024-09-21T12:08:52.304 INFO:teuthology.orchestra.run.smithi192.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T12:08:52.304 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-grafana-dashboards noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 32 k 2024-09-21T12:08:52.304 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-prometheus-alerts noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 16 k 2024-09-21T12:08:52.304 INFO:teuthology.orchestra.run.smithi192.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T12:08:52.304 INFO:teuthology.orchestra.run.smithi192.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T12:08:52.305 INFO:teuthology.orchestra.run.smithi192.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T12:08:52.305 INFO:teuthology.orchestra.run.smithi192.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T12:08:52.305 INFO:teuthology.orchestra.run.smithi192.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T12:08:52.305 INFO:teuthology.orchestra.run.smithi192.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T12:08:52.305 INFO:teuthology.orchestra.run.smithi192.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T12:08:52.305 INFO:teuthology.orchestra.run.smithi192.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T12:08:52.305 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:08:52.305 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction Summary 2024-09-21T12:08:52.305 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-21T12:08:52.305 INFO:teuthology.orchestra.run.smithi192.stdout:Install 12 Packages 2024-09-21T12:08:52.305 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:08:52.306 INFO:teuthology.orchestra.run.smithi192.stdout:Total download size: 8.7 M 2024-09-21T12:08:52.306 INFO:teuthology.orchestra.run.smithi192.stdout:Installed size: 105 M 2024-09-21T12:08:52.306 INFO:teuthology.orchestra.run.smithi192.stdout:Downloading Packages: 2024-09-21T12:08:52.488 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:00:57 ago on Sat 21 Sep 2024 12:07:55 PM UTC. 2024-09-21T12:08:52.627 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-09-21T12:08:52.628 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-21T12:08:52.628 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repo Size 2024-09-21T12:08:52.628 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-21T12:08:52.628 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2024-09-21T12:08:52.628 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 145 k 2024-09-21T12:08:52.628 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:08:52.628 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2024-09-21T12:08:52.628 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-21T12:08:52.628 INFO:teuthology.orchestra.run.smithi003.stdout:Install 1 Package 2024-09-21T12:08:52.628 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:08:52.628 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 145 k 2024-09-21T12:08:52.628 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 435 k 2024-09-21T12:08:52.628 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2024-09-21T12:08:52.837 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-immutable-object-cache-19.1.1-373.g4e45e6b 698 kB/s | 145 kB 00:00 2024-09-21T12:08:52.837 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2024-09-21T12:08:52.837 INFO:teuthology.orchestra.run.smithi003.stdout:Total 693 kB/s | 145 kB 00:00 2024-09-21T12:08:52.838 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2024-09-21T12:08:52.846 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2024-09-21T12:08:52.846 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2024-09-21T12:08:52.907 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2024-09-21T12:08:52.907 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2024-09-21T12:08:53.027 INFO:teuthology.orchestra.run.smithi192.stdout:(1/12): ceph-prometheus-alerts-19.1.1-373.g4e45 103 kB/s | 16 kB 00:00 2024-09-21T12:08:53.053 INFO:teuthology.orchestra.run.smithi192.stdout:(2/12): ceph-grafana-dashboards-19.1.1-373.g4e4 172 kB/s | 32 kB 00:00 2024-09-21T12:08:53.057 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2024-09-21T12:08:53.121 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-373.g4e45e6b4.e 1/1 2024-09-21T12:08:53.147 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-373.g4e45e6b4.e 1/1 2024-09-21T12:08:53.147 INFO:teuthology.orchestra.run.smithi003.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T12:08:53.147 INFO:teuthology.orchestra.run.smithi003.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-21T12:08:53.147 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:08:53.228 INFO:teuthology.orchestra.run.smithi192.stdout:(3/12): ceph-mgr-dashboard-19.1.1-373.g4e45e6b4 9.9 MB/s | 3.6 MB 00:00 2024-09-21T12:08:53.278 INFO:teuthology.orchestra.run.smithi192.stdout:(4/12): python3-protobuf-3.14.0-13.el9.noarch.r 1.2 MB/s | 269 kB 00:00 2024-09-21T12:08:53.337 INFO:teuthology.orchestra.run.smithi192.stdout:(5/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 9.2 MB/s | 548 kB 00:00 2024-09-21T12:08:53.362 INFO:teuthology.orchestra.run.smithi192.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 778 kB/s | 19 kB 00:00 2024-09-21T12:08:53.396 INFO:teuthology.orchestra.run.smithi192.stdout:(7/12): protobuf-3.14.0-13.el9.x86_64.rpm 2.7 MB/s | 1.0 MB 00:00 2024-09-21T12:08:53.438 INFO:teuthology.orchestra.run.smithi192.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 3.4 MB/s | 144 kB 00:00 2024-09-21T12:08:53.488 INFO:teuthology.orchestra.run.smithi192.stdout:(9/12): python3-grpcio-1.46.7-10.el9.x86_64.rpm 16 MB/s | 2.0 MB 00:00 2024-09-21T12:08:53.513 INFO:teuthology.orchestra.run.smithi192.stdout:(10/12): python3-repoze-lru-0.7-16.el9.noarch.r 408 kB/s | 31 kB 00:00 2024-09-21T12:08:53.539 INFO:teuthology.orchestra.run.smithi192.stdout:(11/12): python3-routes-2.5.1-5.el9.noarch.rpm 3.6 MB/s | 188 kB 00:00 2024-09-21T12:08:54.072 INFO:teuthology.orchestra.run.smithi192.stdout:(12/12): protobuf-compiler-3.14.0-13.el9.x86_64 1.0 MB/s | 863 kB 00:00 2024-09-21T12:08:54.077 INFO:teuthology.orchestra.run.smithi192.stdout:-------------------------------------------------------------------------------- 2024-09-21T12:08:54.077 INFO:teuthology.orchestra.run.smithi192.stdout:Total 4.9 MB/s | 8.7 MB 00:01 2024-09-21T12:08:54.111 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-373.g4e45e6b4.e 1/1 2024-09-21T12:08:54.111 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:08:54.111 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2024-09-21T12:08:54.111 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-immutable-object-cache-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:08:54.112 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:08:54.112 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-09-21T12:08:54.127 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction check 2024-09-21T12:08:54.145 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction check succeeded. 2024-09-21T12:08:54.145 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction test 2024-09-21T12:08:54.340 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph-mgr 2024-09-21T12:08:54.348 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction test succeeded. 2024-09-21T12:08:54.348 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction 2024-09-21T12:08:54.881 INFO:teuthology.orchestra.run.smithi192.stdout: Preparing : 1/1 2024-09-21T12:08:54.952 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:00:59 ago on Sat 21 Sep 2024 12:07:55 PM UTC. 2024-09-21T12:08:54.972 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-21T12:08:55.008 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-21T12:08:55.044 INFO:teuthology.orchestra.run.smithi003.stdout:Package ceph-mgr-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T12:08:55.054 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-21T12:08:55.089 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-09-21T12:08:55.090 INFO:teuthology.orchestra.run.smithi003.stdout:Nothing to do. 2024-09-21T12:08:55.090 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-09-21T12:08:55.093 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-21T12:08:55.156 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph-mgr-dashboard 2024-09-21T12:08:55.198 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-21T12:08:55.327 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-21T12:08:55.421 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-21T12:08:55.469 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-21T12:08:55.693 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-21T12:08:55.733 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-373.g4e45e6b4.el9. 10/12 2024-09-21T12:08:55.761 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:01:00 ago on Sat 21 Sep 2024 12:07:55 PM UTC. 2024-09-21T12:08:55.898 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-09-21T12:08:55.900 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-21T12:08:55.900 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repository Size 2024-09-21T12:08:55.900 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-21T12:08:55.900 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2024-09-21T12:08:55.900 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-dashboard noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 3.6 M 2024-09-21T12:08:55.900 INFO:teuthology.orchestra.run.smithi003.stdout:Installing dependencies: 2024-09-21T12:08:55.900 INFO:teuthology.orchestra.run.smithi003.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-21T12:08:55.900 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-grafana-dashboards noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 32 k 2024-09-21T12:08:55.900 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-prometheus-alerts noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 16 k 2024-09-21T12:08:55.900 INFO:teuthology.orchestra.run.smithi003.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-21T12:08:55.900 INFO:teuthology.orchestra.run.smithi003.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-21T12:08:55.901 INFO:teuthology.orchestra.run.smithi003.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-21T12:08:55.901 INFO:teuthology.orchestra.run.smithi003.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-21T12:08:55.901 INFO:teuthology.orchestra.run.smithi003.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-21T12:08:55.901 INFO:teuthology.orchestra.run.smithi003.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-21T12:08:55.901 INFO:teuthology.orchestra.run.smithi003.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-21T12:08:55.901 INFO:teuthology.orchestra.run.smithi003.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-21T12:08:55.901 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:08:55.901 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2024-09-21T12:08:55.901 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-21T12:08:55.901 INFO:teuthology.orchestra.run.smithi003.stdout:Install 12 Packages 2024-09-21T12:08:55.901 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:08:55.902 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 8.7 M 2024-09-21T12:08:55.902 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 105 M 2024-09-21T12:08:55.902 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2024-09-21T12:08:56.657 INFO:teuthology.orchestra.run.smithi003.stdout:(1/12): ceph-grafana-dashboards-19.1.1-373.g4e4 214 kB/s | 32 kB 00:00 2024-09-21T12:08:56.681 INFO:teuthology.orchestra.run.smithi003.stdout:(2/12): ceph-prometheus-alerts-19.1.1-373.g4e45 95 kB/s | 16 kB 00:00 2024-09-21T12:08:56.787 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-373.g4e45e6b4.el9 11/12 2024-09-21T12:08:56.825 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-373.g4e45e6b4.el9.noar 12/12 2024-09-21T12:08:56.882 INFO:teuthology.orchestra.run.smithi003.stdout:(3/12): ceph-mgr-dashboard-19.1.1-373.g4e45e6b4 9.5 MB/s | 3.6 MB 00:00 2024-09-21T12:08:57.182 INFO:teuthology.orchestra.run.smithi003.stdout:(4/12): protobuf-compiler-3.14.0-13.el9.x86_64. 2.8 MB/s | 863 kB 00:00 2024-09-21T12:08:57.232 INFO:teuthology.orchestra.run.smithi003.stdout:(5/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 11 MB/s | 548 kB 00:00 2024-09-21T12:08:57.266 INFO:teuthology.orchestra.run.smithi003.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 585 kB/s | 19 kB 00:00 2024-09-21T12:08:57.333 INFO:teuthology.orchestra.run.smithi003.stdout:(7/12): python3-grpcio-1.46.7-10.el9.x86_64.rpm 31 MB/s | 2.0 MB 00:00 2024-09-21T12:08:57.366 INFO:teuthology.orchestra.run.smithi003.stdout:(8/12): python3-protobuf-3.14.0-13.el9.noarch.r 393 kB/s | 269 kB 00:00 2024-09-21T12:08:57.400 INFO:teuthology.orchestra.run.smithi003.stdout:(9/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 2.1 MB/s | 144 kB 00:00 2024-09-21T12:08:57.425 INFO:teuthology.orchestra.run.smithi003.stdout:(10/12): python3-repoze-lru-0.7-16.el9.noarch.r 527 kB/s | 31 kB 00:00 2024-09-21T12:08:57.450 INFO:teuthology.orchestra.run.smithi003.stdout:(11/12): python3-routes-2.5.1-5.el9.noarch.rpm 3.8 MB/s | 188 kB 00:00 2024-09-21T12:08:57.717 INFO:teuthology.orchestra.run.smithi003.stdout:(12/12): protobuf-3.14.0-13.el9.x86_64.rpm 974 kB/s | 1.0 MB 00:01 2024-09-21T12:08:57.722 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2024-09-21T12:08:57.722 INFO:teuthology.orchestra.run.smithi003.stdout:Total 4.8 MB/s | 8.7 MB 00:01 2024-09-21T12:08:57.776 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2024-09-21T12:08:57.796 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2024-09-21T12:08:57.796 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2024-09-21T12:08:58.019 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2024-09-21T12:08:58.020 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2024-09-21T12:08:58.043 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-373.g4e45e6b4.el9.noar 12/12 2024-09-21T12:08:58.043 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-373.g4e45e6b4.el9 1/12 2024-09-21T12:08:58.043 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-373.g4e45e6b4.el9.noar 2/12 2024-09-21T12:08:58.043 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-373.g4e45e6b4.el9. 3/12 2024-09-21T12:08:58.043 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-21T12:08:58.043 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-21T12:08:58.043 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-21T12:08:58.043 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-21T12:08:58.043 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-21T12:08:58.043 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-21T12:08:58.043 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-21T12:08:58.044 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-21T12:08:58.357 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-21T12:08:58.357 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:08:58.357 INFO:teuthology.orchestra.run.smithi192.stdout:Installed: 2024-09-21T12:08:58.357 INFO:teuthology.orchestra.run.smithi192.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T12:08:58.357 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-grafana-dashboards-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T12:08:58.358 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-dashboard-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T12:08:58.358 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-prometheus-alerts-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T12:08:58.358 INFO:teuthology.orchestra.run.smithi192.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T12:08:58.358 INFO:teuthology.orchestra.run.smithi192.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T12:08:58.358 INFO:teuthology.orchestra.run.smithi192.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T12:08:58.358 INFO:teuthology.orchestra.run.smithi192.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T12:08:58.358 INFO:teuthology.orchestra.run.smithi192.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T12:08:58.358 INFO:teuthology.orchestra.run.smithi192.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T12:08:58.358 INFO:teuthology.orchestra.run.smithi192.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T12:08:58.358 INFO:teuthology.orchestra.run.smithi192.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T12:08:58.358 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:08:58.358 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2024-09-21T12:08:58.599 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-21T12:08:58.686 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2024-09-21T12:08:58.777 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-21T12:08:58.829 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-21T12:08:58.877 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-21T12:08:58.913 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-21T12:08:59.034 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-21T12:08:59.171 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-21T12:08:59.177 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:01:06 ago on Sat 21 Sep 2024 12:07:53 PM UTC. 2024-09-21T12:08:59.262 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-21T12:08:59.309 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2024-09-21T12:08:59.310 INFO:teuthology.orchestra.run.smithi192.stdout:====================================================================================== 2024-09-21T12:08:59.311 INFO:teuthology.orchestra.run.smithi192.stdout: Package Arch Version Repository Size 2024-09-21T12:08:59.311 INFO:teuthology.orchestra.run.smithi192.stdout:====================================================================================== 2024-09-21T12:08:59.311 INFO:teuthology.orchestra.run.smithi192.stdout:Installing: 2024-09-21T12:08:59.311 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 7.4 M 2024-09-21T12:08:59.311 INFO:teuthology.orchestra.run.smithi192.stdout:Installing dependencies: 2024-09-21T12:08:59.311 INFO:teuthology.orchestra.run.smithi192.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T12:08:59.311 INFO:teuthology.orchestra.run.smithi192.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T12:08:59.311 INFO:teuthology.orchestra.run.smithi192.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T12:08:59.311 INFO:teuthology.orchestra.run.smithi192.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T12:08:59.311 INFO:teuthology.orchestra.run.smithi192.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T12:08:59.311 INFO:teuthology.orchestra.run.smithi192.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T12:08:59.311 INFO:teuthology.orchestra.run.smithi192.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T12:08:59.311 INFO:teuthology.orchestra.run.smithi192.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T12:08:59.312 INFO:teuthology.orchestra.run.smithi192.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T12:08:59.312 INFO:teuthology.orchestra.run.smithi192.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T12:08:59.312 INFO:teuthology.orchestra.run.smithi192.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T12:08:59.312 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:08:59.312 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction Summary 2024-09-21T12:08:59.312 INFO:teuthology.orchestra.run.smithi192.stdout:====================================================================================== 2024-09-21T12:08:59.312 INFO:teuthology.orchestra.run.smithi192.stdout:Install 12 Packages 2024-09-21T12:08:59.312 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:08:59.313 INFO:teuthology.orchestra.run.smithi192.stdout:Total download size: 38 M 2024-09-21T12:08:59.313 INFO:teuthology.orchestra.run.smithi192.stdout:Installed size: 212 M 2024-09-21T12:08:59.313 INFO:teuthology.orchestra.run.smithi192.stdout:Downloading Packages: 2024-09-21T12:08:59.319 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-21T12:08:59.346 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-21T12:08:59.378 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-373.g4e45e6b4.el9. 10/12 2024-09-21T12:08:59.580 INFO:teuthology.orchestra.run.smithi192.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.3 MB/s | 191 kB 00:00 2024-09-21T12:08:59.613 INFO:teuthology.orchestra.run.smithi192.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 4.4 MB/s | 801 kB 00:00 2024-09-21T12:08:59.672 INFO:teuthology.orchestra.run.smithi192.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 356 kB/s | 33 kB 00:00 2024-09-21T12:08:59.714 INFO:teuthology.orchestra.run.smithi192.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 437 kB/s | 18 kB 00:00 2024-09-21T12:08:59.756 INFO:teuthology.orchestra.run.smithi192.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 926 kB/s | 38 kB 00:00 2024-09-21T12:08:59.931 INFO:teuthology.orchestra.run.smithi192.stdout:(6/12): ceph-mgr-diskprediction-local-19.1.1-37 15 MB/s | 7.4 MB 00:00 2024-09-21T12:09:00.048 INFO:teuthology.orchestra.run.smithi192.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 2.0 MB/s | 245 kB 00:00 2024-09-21T12:09:00.373 INFO:teuthology.orchestra.run.smithi192.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 3.9 MB/s | 3.0 MB 00:00 2024-09-21T12:09:00.465 INFO:teuthology.orchestra.run.smithi192.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.7 MB/s | 250 kB 00:00 2024-09-21T12:09:00.509 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-373.g4e45e6b4.el9 11/12 2024-09-21T12:09:00.554 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-373.g4e45e6b4.el9.noar 12/12 2024-09-21T12:09:00.982 INFO:teuthology.orchestra.run.smithi192.stdout:(10/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 4.0 MB/s | 4.9 MB 00:01 2024-09-21T12:09:01.291 INFO:teuthology.orchestra.run.smithi192.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 4.1 MB/s | 5.1 MB 00:01 2024-09-21T12:09:01.864 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-373.g4e45e6b4.el9.noar 12/12 2024-09-21T12:09:01.864 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-373.g4e45e6b4.el9 1/12 2024-09-21T12:09:01.864 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-373.g4e45e6b4.el9.noar 2/12 2024-09-21T12:09:01.864 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-373.g4e45e6b4.el9. 3/12 2024-09-21T12:09:01.864 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-21T12:09:01.864 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-21T12:09:01.864 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-21T12:09:01.864 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-21T12:09:01.864 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-21T12:09:01.864 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-21T12:09:01.864 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-21T12:09:01.864 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-21T12:09:02.195 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-21T12:09:02.195 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:09:02.195 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2024-09-21T12:09:02.195 INFO:teuthology.orchestra.run.smithi003.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-21T12:09:02.195 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-grafana-dashboards-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T12:09:02.195 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-dashboard-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T12:09:02.195 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-prometheus-alerts-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T12:09:02.195 INFO:teuthology.orchestra.run.smithi003.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-21T12:09:02.195 INFO:teuthology.orchestra.run.smithi003.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-21T12:09:02.195 INFO:teuthology.orchestra.run.smithi003.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-21T12:09:02.195 INFO:teuthology.orchestra.run.smithi003.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-21T12:09:02.195 INFO:teuthology.orchestra.run.smithi003.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-21T12:09:02.196 INFO:teuthology.orchestra.run.smithi003.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-21T12:09:02.196 INFO:teuthology.orchestra.run.smithi003.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-21T12:09:02.196 INFO:teuthology.orchestra.run.smithi003.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-21T12:09:02.196 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:09:02.196 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-09-21T12:09:02.411 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-21T12:09:03.016 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:01:08 ago on Sat 21 Sep 2024 12:07:55 PM UTC. 2024-09-21T12:09:03.156 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-09-21T12:09:03.157 INFO:teuthology.orchestra.run.smithi003.stdout:====================================================================================== 2024-09-21T12:09:03.157 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repository Size 2024-09-21T12:09:03.157 INFO:teuthology.orchestra.run.smithi003.stdout:====================================================================================== 2024-09-21T12:09:03.158 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2024-09-21T12:09:03.158 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 7.4 M 2024-09-21T12:09:03.158 INFO:teuthology.orchestra.run.smithi003.stdout:Installing dependencies: 2024-09-21T12:09:03.158 INFO:teuthology.orchestra.run.smithi003.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-21T12:09:03.158 INFO:teuthology.orchestra.run.smithi003.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-21T12:09:03.158 INFO:teuthology.orchestra.run.smithi003.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-21T12:09:03.158 INFO:teuthology.orchestra.run.smithi003.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-21T12:09:03.158 INFO:teuthology.orchestra.run.smithi003.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-21T12:09:03.158 INFO:teuthology.orchestra.run.smithi003.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-21T12:09:03.158 INFO:teuthology.orchestra.run.smithi003.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-21T12:09:03.158 INFO:teuthology.orchestra.run.smithi003.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-21T12:09:03.158 INFO:teuthology.orchestra.run.smithi003.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-21T12:09:03.158 INFO:teuthology.orchestra.run.smithi003.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-21T12:09:03.159 INFO:teuthology.orchestra.run.smithi003.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-21T12:09:03.159 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:09:03.159 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2024-09-21T12:09:03.159 INFO:teuthology.orchestra.run.smithi003.stdout:====================================================================================== 2024-09-21T12:09:03.159 INFO:teuthology.orchestra.run.smithi003.stdout:Install 12 Packages 2024-09-21T12:09:03.159 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:09:03.160 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 38 M 2024-09-21T12:09:03.160 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 212 M 2024-09-21T12:09:03.160 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2024-09-21T12:09:03.533 INFO:teuthology.orchestra.run.smithi003.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 885 kB/s | 191 kB 00:00 2024-09-21T12:09:03.658 INFO:teuthology.orchestra.run.smithi003.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 2.3 MB/s | 801 kB 00:00 2024-09-21T12:09:03.775 INFO:teuthology.orchestra.run.smithi003.stdout:(3/12): ceph-mgr-diskprediction-local-19.1.1-37 16 MB/s | 7.4 MB 00:00 2024-09-21T12:09:03.800 INFO:teuthology.orchestra.run.smithi003.stdout:(4/12): flexiblas-3.0.4-8.el9.x86_64.rpm 122 kB/s | 33 kB 00:00 2024-09-21T12:09:03.842 INFO:teuthology.orchestra.run.smithi003.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 273 kB/s | 18 kB 00:00 2024-09-21T12:09:03.868 INFO:teuthology.orchestra.run.smithi003.stdout:(6/12): openblas-0.3.26-2.el9.x86_64.rpm 575 kB/s | 38 kB 00:00 2024-09-21T12:09:03.959 INFO:teuthology.orchestra.run.smithi003.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 2.6 MB/s | 245 kB 00:00 2024-09-21T12:09:04.201 INFO:teuthology.orchestra.run.smithi003.stdout:(8/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 21 MB/s | 5.1 MB 00:00 2024-09-21T12:09:04.294 INFO:teuthology.orchestra.run.smithi003.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 2.7 MB/s | 250 kB 00:00 2024-09-21T12:09:04.377 INFO:teuthology.orchestra.run.smithi003.stdout:(10/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 9.2 MB/s | 4.9 MB 00:00 2024-09-21T12:09:04.427 INFO:teuthology.orchestra.run.smithi003.stdout:(11/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rp 3.9 MB/s | 3.0 MB 00:00 2024-09-21T12:09:04.749 INFO:teuthology.orchestra.run.smithi192.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 3.8 MB/s | 16 MB 00:04 2024-09-21T12:09:04.750 INFO:teuthology.orchestra.run.smithi192.stdout:-------------------------------------------------------------------------------- 2024-09-21T12:09:04.751 INFO:teuthology.orchestra.run.smithi192.stdout:Total 7.0 MB/s | 38 MB 00:05 2024-09-21T12:09:05.108 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction check 2024-09-21T12:09:05.134 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction check succeeded. 2024-09-21T12:09:05.134 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction test 2024-09-21T12:09:05.202 INFO:teuthology.orchestra.run.smithi003.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 18 MB/s | 16 MB 00:00 2024-09-21T12:09:05.203 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2024-09-21T12:09:05.204 INFO:teuthology.orchestra.run.smithi003.stdout:Total 19 MB/s | 38 MB 00:02 2024-09-21T12:09:05.571 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2024-09-21T12:09:05.580 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction test succeeded. 2024-09-21T12:09:05.580 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction 2024-09-21T12:09:05.598 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2024-09-21T12:09:05.598 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2024-09-21T12:09:06.061 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2024-09-21T12:09:06.062 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2024-09-21T12:09:06.353 INFO:teuthology.orchestra.run.smithi192.stdout: Preparing : 1/1 2024-09-21T12:09:06.431 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-21T12:09:06.502 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-21T12:09:06.596 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-21T12:09:06.640 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-21T12:09:06.825 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-21T12:09:06.855 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-21T12:09:06.861 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2024-09-21T12:09:06.931 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-21T12:09:06.942 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-21T12:09:06.993 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-21T12:09:07.098 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-21T12:09:07.136 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-21T12:09:07.328 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-21T12:09:07.359 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-21T12:09:07.438 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-21T12:09:07.595 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-21T12:09:07.719 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-21T12:09:08.146 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-21T12:09:08.268 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-21T12:09:08.982 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-21T12:09:09.583 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-21T12:09:10.019 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-21T12:09:10.055 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-373.g4e45e6 12/12 2024-09-21T12:09:10.672 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-21T12:09:10.699 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-373.g4e45e6 12/12 2024-09-21T12:09:12.712 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-373.g4e45e6 12/12 2024-09-21T12:09:12.712 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-373.g4e45e6 1/12 2024-09-21T12:09:12.712 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-21T12:09:12.712 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-21T12:09:12.713 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-21T12:09:12.713 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-21T12:09:12.713 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-21T12:09:12.713 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-21T12:09:12.713 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-21T12:09:12.713 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-21T12:09:12.713 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-21T12:09:12.713 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-21T12:09:13.134 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-21T12:09:13.134 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:09:13.134 INFO:teuthology.orchestra.run.smithi192.stdout:Installed: 2024-09-21T12:09:13.134 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-diskprediction-local-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T12:09:13.134 INFO:teuthology.orchestra.run.smithi192.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T12:09:13.135 INFO:teuthology.orchestra.run.smithi192.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T12:09:13.135 INFO:teuthology.orchestra.run.smithi192.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T12:09:13.135 INFO:teuthology.orchestra.run.smithi192.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T12:09:13.135 INFO:teuthology.orchestra.run.smithi192.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T12:09:13.135 INFO:teuthology.orchestra.run.smithi192.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T12:09:13.135 INFO:teuthology.orchestra.run.smithi192.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T12:09:13.135 INFO:teuthology.orchestra.run.smithi192.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T12:09:13.135 INFO:teuthology.orchestra.run.smithi192.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T12:09:13.135 INFO:teuthology.orchestra.run.smithi192.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T12:09:13.135 INFO:teuthology.orchestra.run.smithi192.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T12:09:13.135 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:09:13.135 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2024-09-21T12:09:13.264 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-373.g4e45e6 12/12 2024-09-21T12:09:13.264 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-373.g4e45e6 1/12 2024-09-21T12:09:13.264 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-21T12:09:13.264 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-21T12:09:13.264 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-21T12:09:13.264 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-21T12:09:13.264 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-21T12:09:13.265 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-21T12:09:13.265 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-21T12:09:13.265 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-21T12:09:13.265 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-21T12:09:13.265 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-21T12:09:13.523 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install ceph-mgr-rook 2024-09-21T12:09:13.654 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-21T12:09:13.654 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:09:13.654 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2024-09-21T12:09:13.654 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-diskprediction-local-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T12:09:13.654 INFO:teuthology.orchestra.run.smithi003.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-21T12:09:13.655 INFO:teuthology.orchestra.run.smithi003.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-21T12:09:13.655 INFO:teuthology.orchestra.run.smithi003.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-21T12:09:13.655 INFO:teuthology.orchestra.run.smithi003.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-21T12:09:13.655 INFO:teuthology.orchestra.run.smithi003.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-21T12:09:13.655 INFO:teuthology.orchestra.run.smithi003.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-21T12:09:13.655 INFO:teuthology.orchestra.run.smithi003.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-21T12:09:13.655 INFO:teuthology.orchestra.run.smithi003.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-21T12:09:13.655 INFO:teuthology.orchestra.run.smithi003.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-21T12:09:13.655 INFO:teuthology.orchestra.run.smithi003.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-21T12:09:13.655 INFO:teuthology.orchestra.run.smithi003.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-21T12:09:13.655 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:09:13.655 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-09-21T12:09:14.063 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph-mgr-rook 2024-09-21T12:09:14.127 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:01:21 ago on Sat 21 Sep 2024 12:07:53 PM UTC. 2024-09-21T12:09:14.262 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2024-09-21T12:09:14.263 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-21T12:09:14.263 INFO:teuthology.orchestra.run.smithi192.stdout: Package Arch Version Repository Size 2024-09-21T12:09:14.263 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-21T12:09:14.263 INFO:teuthology.orchestra.run.smithi192.stdout:Installing: 2024-09-21T12:09:14.263 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-rook noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 49 k 2024-09-21T12:09:14.263 INFO:teuthology.orchestra.run.smithi192.stdout:Installing dependencies: 2024-09-21T12:09:14.263 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T12:09:14.263 INFO:teuthology.orchestra.run.smithi192.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T12:09:14.264 INFO:teuthology.orchestra.run.smithi192.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T12:09:14.264 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T12:09:14.264 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T12:09:14.264 INFO:teuthology.orchestra.run.smithi192.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T12:09:14.264 INFO:teuthology.orchestra.run.smithi192.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T12:09:14.264 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T12:09:14.264 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T12:09:14.264 INFO:teuthology.orchestra.run.smithi192.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T12:09:14.264 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T12:09:14.264 INFO:teuthology.orchestra.run.smithi192.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T12:09:14.264 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:09:14.264 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction Summary 2024-09-21T12:09:14.265 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-21T12:09:14.265 INFO:teuthology.orchestra.run.smithi192.stdout:Install 13 Packages 2024-09-21T12:09:14.265 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:09:14.265 INFO:teuthology.orchestra.run.smithi192.stdout:Total download size: 2.2 M 2024-09-21T12:09:14.265 INFO:teuthology.orchestra.run.smithi192.stdout:Installed size: 26 M 2024-09-21T12:09:14.265 INFO:teuthology.orchestra.run.smithi192.stdout:Downloading Packages: 2024-09-21T12:09:14.522 INFO:teuthology.orchestra.run.smithi192.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 302 kB/s | 26 kB 00:00 2024-09-21T12:09:14.548 INFO:teuthology.orchestra.run.smithi192.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 174 kB/s | 19 kB 00:00 2024-09-21T12:09:14.623 INFO:teuthology.orchestra.run.smithi192.stdout:(3/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.9 MB/s | 222 kB 00:00 2024-09-21T12:09:14.648 INFO:teuthology.orchestra.run.smithi192.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.6 MB/s | 159 kB 00:00 2024-09-21T12:09:14.668 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:01:19 ago on Sat 21 Sep 2024 12:07:55 PM UTC. 2024-09-21T12:09:14.673 INFO:teuthology.orchestra.run.smithi192.stdout:(5/13): ceph-mgr-rook-19.1.1-373.g4e45e6b4.el9. 209 kB/s | 49 kB 00:00 2024-09-21T12:09:14.699 INFO:teuthology.orchestra.run.smithi192.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 54 kB 00:00 2024-09-21T12:09:14.724 INFO:teuthology.orchestra.run.smithi192.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 2.7 MB/s | 279 kB 00:00 2024-09-21T12:09:14.774 INFO:teuthology.orchestra.run.smithi192.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 320 kB/s | 32 kB 00:00 2024-09-21T12:09:14.799 INFO:teuthology.orchestra.run.smithi192.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 140 kB/s | 14 kB 00:00 2024-09-21T12:09:14.806 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-09-21T12:09:14.807 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-21T12:09:14.807 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repository Size 2024-09-21T12:09:14.807 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-21T12:09:14.807 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2024-09-21T12:09:14.807 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-rook noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 49 k 2024-09-21T12:09:14.807 INFO:teuthology.orchestra.run.smithi003.stdout:Installing dependencies: 2024-09-21T12:09:14.807 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-21T12:09:14.807 INFO:teuthology.orchestra.run.smithi003.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-21T12:09:14.808 INFO:teuthology.orchestra.run.smithi003.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-21T12:09:14.808 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-21T12:09:14.808 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-21T12:09:14.808 INFO:teuthology.orchestra.run.smithi003.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-21T12:09:14.808 INFO:teuthology.orchestra.run.smithi003.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-21T12:09:14.808 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-21T12:09:14.808 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-21T12:09:14.808 INFO:teuthology.orchestra.run.smithi003.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-21T12:09:14.808 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-21T12:09:14.808 INFO:teuthology.orchestra.run.smithi003.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-21T12:09:14.808 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:09:14.808 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2024-09-21T12:09:14.808 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-21T12:09:14.808 INFO:teuthology.orchestra.run.smithi003.stdout:Install 13 Packages 2024-09-21T12:09:14.808 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:09:14.809 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 2.2 M 2024-09-21T12:09:14.809 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 26 M 2024-09-21T12:09:14.809 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2024-09-21T12:09:14.825 INFO:teuthology.orchestra.run.smithi192.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-21T12:09:14.850 INFO:teuthology.orchestra.run.smithi192.stdout:(11/13): python3-google-auth-2.34.0-1.el9.noarc 1.9 MB/s | 220 kB 00:00 2024-09-21T12:09:14.875 INFO:teuthology.orchestra.run.smithi192.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.7 MB/s | 90 kB 00:00 2024-09-21T12:09:14.909 INFO:teuthology.orchestra.run.smithi192.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 7.7 MB/s | 1.0 MB 00:00 2024-09-21T12:09:14.911 INFO:teuthology.orchestra.run.smithi192.stdout:-------------------------------------------------------------------------------- 2024-09-21T12:09:14.912 INFO:teuthology.orchestra.run.smithi192.stdout:Total 3.4 MB/s | 2.2 MB 00:00 2024-09-21T12:09:14.974 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction check 2024-09-21T12:09:14.989 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction check succeeded. 2024-09-21T12:09:14.989 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction test 2024-09-21T12:09:15.079 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction test succeeded. 2024-09-21T12:09:15.081 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction 2024-09-21T12:09:15.083 INFO:teuthology.orchestra.run.smithi003.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 331 kB/s | 26 kB 00:00 2024-09-21T12:09:15.108 INFO:teuthology.orchestra.run.smithi003.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 187 kB/s | 19 kB 00:00 2024-09-21T12:09:15.183 INFO:teuthology.orchestra.run.smithi003.stdout:(3/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.1 MB/s | 159 kB 00:00 2024-09-21T12:09:15.209 INFO:teuthology.orchestra.run.smithi003.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.2 MB/s | 222 kB 00:00 2024-09-21T12:09:15.234 INFO:teuthology.orchestra.run.smithi003.stdout:(5/13): ceph-mgr-rook-19.1.1-373.g4e45e6b4.el9. 216 kB/s | 49 kB 00:00 2024-09-21T12:09:15.259 INFO:teuthology.orchestra.run.smithi003.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 54 kB 00:00 2024-09-21T12:09:15.293 INFO:teuthology.orchestra.run.smithi003.stdout:(7/13): python3-pyasn1-modules-0.4.8-6.el9.noar 2.5 MB/s | 279 kB 00:00 2024-09-21T12:09:15.343 INFO:teuthology.orchestra.run.smithi003.stdout:(8/13): python3-cachetools-4.2.4-1.el9.noarch.r 296 kB/s | 32 kB 00:00 2024-09-21T12:09:15.368 INFO:teuthology.orchestra.run.smithi003.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 129 kB/s | 14 kB 00:00 2024-09-21T12:09:15.394 INFO:teuthology.orchestra.run.smithi003.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-21T12:09:15.419 INFO:teuthology.orchestra.run.smithi003.stdout:(11/13): python3-google-auth-2.34.0-1.el9.noarc 1.9 MB/s | 220 kB 00:00 2024-09-21T12:09:15.452 INFO:teuthology.orchestra.run.smithi003.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.5 MB/s | 90 kB 00:00 2024-09-21T12:09:15.494 INFO:teuthology.orchestra.run.smithi003.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 6.8 MB/s | 1.0 MB 00:00 2024-09-21T12:09:15.497 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2024-09-21T12:09:15.497 INFO:teuthology.orchestra.run.smithi003.stdout:Total 3.2 MB/s | 2.2 MB 00:00 2024-09-21T12:09:15.565 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2024-09-21T12:09:15.581 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2024-09-21T12:09:15.581 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2024-09-21T12:09:15.585 INFO:teuthology.orchestra.run.smithi192.stdout: Preparing : 1/1 2024-09-21T12:09:15.681 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2024-09-21T12:09:15.682 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2024-09-21T12:09:15.758 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-21T12:09:15.827 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-21T12:09:15.890 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-21T12:09:15.936 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-21T12:09:15.978 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-21T12:09:16.080 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-21T12:09:16.181 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-21T12:09:16.237 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-21T12:09:16.320 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2024-09-21T12:09:16.500 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-21T12:09:16.555 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-21T12:09:16.611 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-21T12:09:16.655 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-21T12:09:16.697 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-21T12:09:16.803 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-21T12:09:16.964 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-21T12:09:17.026 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-21T12:09:17.038 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-21T12:09:17.068 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-21T12:09:17.091 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-21T12:09:17.124 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-21T12:09:17.146 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-rook-2:19.1.1-373.g4e45e6b4.el9.noarch 13/13 2024-09-21T12:09:17.855 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-21T12:09:17.904 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-21T12:09:17.938 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-21T12:09:17.943 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-373.g4e45e6b4.el9.noarch 13/13 2024-09-21T12:09:17.943 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-rook-2:19.1.1-373.g4e45e6b4.el9.noarch 1/13 2024-09-21T12:09:17.943 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-21T12:09:17.943 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-21T12:09:17.943 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-21T12:09:17.944 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-21T12:09:17.944 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-21T12:09:17.944 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-21T12:09:17.944 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-21T12:09:17.944 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-21T12:09:17.944 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-21T12:09:17.944 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-21T12:09:17.944 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-21T12:09:17.986 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-21T12:09:18.015 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-mgr-rook-2:19.1.1-373.g4e45e6b4.el9.noarch 13/13 2024-09-21T12:09:18.271 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-21T12:09:18.271 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:09:18.271 INFO:teuthology.orchestra.run.smithi192.stdout:Installed: 2024-09-21T12:09:18.271 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-rook-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T12:09:18.271 INFO:teuthology.orchestra.run.smithi192.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T12:09:18.271 INFO:teuthology.orchestra.run.smithi192.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T12:09:18.271 INFO:teuthology.orchestra.run.smithi192.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T12:09:18.271 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T12:09:18.272 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T12:09:18.272 INFO:teuthology.orchestra.run.smithi192.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T12:09:18.272 INFO:teuthology.orchestra.run.smithi192.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T12:09:18.272 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T12:09:18.272 INFO:teuthology.orchestra.run.smithi192.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T12:09:18.272 INFO:teuthology.orchestra.run.smithi192.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T12:09:18.272 INFO:teuthology.orchestra.run.smithi192.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T12:09:18.272 INFO:teuthology.orchestra.run.smithi192.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T12:09:18.272 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:09:18.272 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2024-09-21T12:09:18.540 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install ceph-mgr-cephadm 2024-09-21T12:09:18.810 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-373.g4e45e6b4.el9.noarch 13/13 2024-09-21T12:09:18.810 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-mgr-rook-2:19.1.1-373.g4e45e6b4.el9.noarch 1/13 2024-09-21T12:09:18.810 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-21T12:09:18.810 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-21T12:09:18.811 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-21T12:09:18.811 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-21T12:09:18.811 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-21T12:09:18.811 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-21T12:09:18.811 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-21T12:09:18.811 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-21T12:09:18.811 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-21T12:09:18.812 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-21T12:09:18.812 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-21T12:09:19.126 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:01:26 ago on Sat 21 Sep 2024 12:07:53 PM UTC. 2024-09-21T12:09:19.143 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-21T12:09:19.143 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:09:19.143 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2024-09-21T12:09:19.144 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-rook-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T12:09:19.144 INFO:teuthology.orchestra.run.smithi003.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-21T12:09:19.144 INFO:teuthology.orchestra.run.smithi003.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-21T12:09:19.144 INFO:teuthology.orchestra.run.smithi003.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-21T12:09:19.144 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-21T12:09:19.144 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-21T12:09:19.144 INFO:teuthology.orchestra.run.smithi003.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-21T12:09:19.144 INFO:teuthology.orchestra.run.smithi003.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-21T12:09:19.144 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-21T12:09:19.144 INFO:teuthology.orchestra.run.smithi003.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-21T12:09:19.144 INFO:teuthology.orchestra.run.smithi003.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-21T12:09:19.144 INFO:teuthology.orchestra.run.smithi003.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-21T12:09:19.144 INFO:teuthology.orchestra.run.smithi003.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-21T12:09:19.144 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:09:19.145 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-09-21T12:09:19.260 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2024-09-21T12:09:19.260 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-21T12:09:19.260 INFO:teuthology.orchestra.run.smithi192.stdout: Package Arch Version Repository Size 2024-09-21T12:09:19.260 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-21T12:09:19.261 INFO:teuthology.orchestra.run.smithi192.stdout:Installing: 2024-09-21T12:09:19.261 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-cephadm noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 146 k 2024-09-21T12:09:19.261 INFO:teuthology.orchestra.run.smithi192.stdout:Installing dependencies: 2024-09-21T12:09:19.261 INFO:teuthology.orchestra.run.smithi192.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T12:09:19.261 INFO:teuthology.orchestra.run.smithi192.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T12:09:19.261 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T12:09:19.261 INFO:teuthology.orchestra.run.smithi192.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T12:09:19.261 INFO:teuthology.orchestra.run.smithi192.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T12:09:19.261 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:09:19.261 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction Summary 2024-09-21T12:09:19.261 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-21T12:09:19.261 INFO:teuthology.orchestra.run.smithi192.stdout:Install 6 Packages 2024-09-21T12:09:19.261 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:09:19.262 INFO:teuthology.orchestra.run.smithi192.stdout:Total download size: 7.0 M 2024-09-21T12:09:19.262 INFO:teuthology.orchestra.run.smithi192.stdout:Installed size: 33 M 2024-09-21T12:09:19.262 INFO:teuthology.orchestra.run.smithi192.stdout:Downloading Packages: 2024-09-21T12:09:19.423 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph-mgr-cephadm 2024-09-21T12:09:19.853 INFO:teuthology.orchestra.run.smithi192.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.7 MB/s | 248 kB 00:00 2024-09-21T12:09:19.903 INFO:teuthology.orchestra.run.smithi192.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 11 MB/s | 548 kB 00:00 2024-09-21T12:09:19.928 INFO:teuthology.orchestra.run.smithi192.stdout:(3/6): ceph-mgr-cephadm-19.1.1-373.g4e45e6b4.el 671 kB/s | 146 kB 00:00 2024-09-21T12:09:19.962 INFO:teuthology.orchestra.run.smithi192.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 982 kB/s | 58 kB 00:00 2024-09-21T12:09:20.036 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:01:25 ago on Sat 21 Sep 2024 12:07:55 PM UTC. 2024-09-21T12:09:20.054 INFO:teuthology.orchestra.run.smithi192.stdout:(5/6): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 6.0 MB 00:00 2024-09-21T12:09:20.079 INFO:teuthology.orchestra.run.smithi192.stdout:(6/6): python3-typing-extensions-4.12.2-2.el9.n 494 kB/s | 74 kB 00:00 2024-09-21T12:09:20.082 INFO:teuthology.orchestra.run.smithi192.stdout:-------------------------------------------------------------------------------- 2024-09-21T12:09:20.082 INFO:teuthology.orchestra.run.smithi192.stdout:Total 8.5 MB/s | 7.0 MB 00:00 2024-09-21T12:09:20.153 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction check 2024-09-21T12:09:20.164 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction check succeeded. 2024-09-21T12:09:20.164 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction test 2024-09-21T12:09:20.176 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-09-21T12:09:20.177 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-21T12:09:20.177 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repository Size 2024-09-21T12:09:20.177 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-21T12:09:20.177 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2024-09-21T12:09:20.177 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-cephadm noarch 2:19.1.1-373.g4e45e6b4.el9 ceph-noarch 146 k 2024-09-21T12:09:20.177 INFO:teuthology.orchestra.run.smithi003.stdout:Installing dependencies: 2024-09-21T12:09:20.177 INFO:teuthology.orchestra.run.smithi003.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-21T12:09:20.177 INFO:teuthology.orchestra.run.smithi003.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-21T12:09:20.177 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-21T12:09:20.177 INFO:teuthology.orchestra.run.smithi003.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-21T12:09:20.177 INFO:teuthology.orchestra.run.smithi003.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-21T12:09:20.177 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:09:20.177 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2024-09-21T12:09:20.178 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-21T12:09:20.178 INFO:teuthology.orchestra.run.smithi003.stdout:Install 6 Packages 2024-09-21T12:09:20.178 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:09:20.178 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 7.0 M 2024-09-21T12:09:20.178 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 33 M 2024-09-21T12:09:20.178 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2024-09-21T12:09:20.263 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction test succeeded. 2024-09-21T12:09:20.264 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction 2024-09-21T12:09:20.570 INFO:teuthology.orchestra.run.smithi192.stdout: Preparing : 1/1 2024-09-21T12:09:20.680 INFO:teuthology.orchestra.run.smithi003.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.8 MB/s | 248 kB 00:00 2024-09-21T12:09:20.730 INFO:teuthology.orchestra.run.smithi003.stdout:(2/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 11 MB/s | 548 kB 00:00 2024-09-21T12:09:20.744 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-21T12:09:20.755 INFO:teuthology.orchestra.run.smithi003.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 2.2 MB/s | 58 kB 00:00 2024-09-21T12:09:20.780 INFO:teuthology.orchestra.run.smithi003.stdout:(4/6): ceph-mgr-cephadm-19.1.1-373.g4e45e6b4.el 616 kB/s | 146 kB 00:00 2024-09-21T12:09:20.797 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-21T12:09:20.806 INFO:teuthology.orchestra.run.smithi003.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.5 MB/s | 74 kB 00:00 2024-09-21T12:09:20.889 INFO:teuthology.orchestra.run.smithi003.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 17 MB/s | 6.0 MB 00:00 2024-09-21T12:09:20.891 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2024-09-21T12:09:20.892 INFO:teuthology.orchestra.run.smithi003.stdout:Total 9.8 MB/s | 7.0 MB 00:00 2024-09-21T12:09:20.966 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2024-09-21T12:09:20.977 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2024-09-21T12:09:20.977 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2024-09-21T12:09:21.084 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2024-09-21T12:09:21.084 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2024-09-21T12:09:21.324 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-21T12:09:21.397 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2024-09-21T12:09:21.408 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-21T12:09:21.472 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-21T12:09:21.501 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 6/6 2024-09-21T12:09:21.586 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-21T12:09:21.643 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-21T12:09:22.196 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-21T12:09:22.280 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-21T12:09:22.291 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 6/6 2024-09-21T12:09:22.291 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 1/6 2024-09-21T12:09:22.291 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-21T12:09:22.291 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-21T12:09:22.291 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-21T12:09:22.291 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-21T12:09:22.352 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-21T12:09:22.387 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 6/6 2024-09-21T12:09:22.555 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-21T12:09:22.555 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:09:22.555 INFO:teuthology.orchestra.run.smithi192.stdout:Installed: 2024-09-21T12:09:22.555 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-mgr-cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T12:09:22.555 INFO:teuthology.orchestra.run.smithi192.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T12:09:22.555 INFO:teuthology.orchestra.run.smithi192.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T12:09:22.555 INFO:teuthology.orchestra.run.smithi192.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T12:09:22.555 INFO:teuthology.orchestra.run.smithi192.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T12:09:22.556 INFO:teuthology.orchestra.run.smithi192.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T12:09:22.556 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:09:22.556 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2024-09-21T12:09:22.815 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install ceph-fuse 2024-09-21T12:09:23.229 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 6/6 2024-09-21T12:09:23.230 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 1/6 2024-09-21T12:09:23.230 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-21T12:09:23.230 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-21T12:09:23.230 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-21T12:09:23.230 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-21T12:09:23.396 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:01:30 ago on Sat 21 Sep 2024 12:07:53 PM UTC. 2024-09-21T12:09:23.499 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-21T12:09:23.499 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:09:23.499 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2024-09-21T12:09:23.499 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-mgr-cephadm-2:19.1.1-373.g4e45e6b4.el9.noarch 2024-09-21T12:09:23.499 INFO:teuthology.orchestra.run.smithi003.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-21T12:09:23.499 INFO:teuthology.orchestra.run.smithi003.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-21T12:09:23.499 INFO:teuthology.orchestra.run.smithi003.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-21T12:09:23.499 INFO:teuthology.orchestra.run.smithi003.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-21T12:09:23.499 INFO:teuthology.orchestra.run.smithi003.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-21T12:09:23.499 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:09:23.500 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-09-21T12:09:23.527 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2024-09-21T12:09:23.528 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-21T12:09:23.528 INFO:teuthology.orchestra.run.smithi192.stdout: Package Arch Version Repository Size 2024-09-21T12:09:23.528 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-21T12:09:23.528 INFO:teuthology.orchestra.run.smithi192.stdout:Installing: 2024-09-21T12:09:23.528 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-fuse x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 897 k 2024-09-21T12:09:23.528 INFO:teuthology.orchestra.run.smithi192.stdout:Installing dependencies: 2024-09-21T12:09:23.528 INFO:teuthology.orchestra.run.smithi192.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T12:09:23.528 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:09:23.528 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction Summary 2024-09-21T12:09:23.528 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-21T12:09:23.528 INFO:teuthology.orchestra.run.smithi192.stdout:Install 2 Packages 2024-09-21T12:09:23.528 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:09:23.529 INFO:teuthology.orchestra.run.smithi192.stdout:Total download size: 976 k 2024-09-21T12:09:23.529 INFO:teuthology.orchestra.run.smithi192.stdout:Installed size: 2.9 M 2024-09-21T12:09:23.529 INFO:teuthology.orchestra.run.smithi192.stdout:Downloading Packages: 2024-09-21T12:09:23.738 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install ceph-fuse 2024-09-21T12:09:23.831 INFO:teuthology.orchestra.run.smithi192.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 451 kB/s | 80 kB 00:00 2024-09-21T12:09:23.906 INFO:teuthology.orchestra.run.smithi192.stdout:(2/2): ceph-fuse-19.1.1-373.g4e45e6b4.el9.x86_6 3.5 MB/s | 897 kB 00:00 2024-09-21T12:09:23.907 INFO:teuthology.orchestra.run.smithi192.stdout:-------------------------------------------------------------------------------- 2024-09-21T12:09:23.907 INFO:teuthology.orchestra.run.smithi192.stdout:Total 2.5 MB/s | 976 kB 00:00 2024-09-21T12:09:23.919 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction check 2024-09-21T12:09:23.940 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction check succeeded. 2024-09-21T12:09:23.941 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction test 2024-09-21T12:09:24.021 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction test succeeded. 2024-09-21T12:09:24.021 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction 2024-09-21T12:09:24.205 INFO:teuthology.orchestra.run.smithi192.stdout: Preparing : 1/1 2024-09-21T12:09:24.341 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:01:29 ago on Sat 21 Sep 2024 12:07:55 PM UTC. 2024-09-21T12:09:24.358 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-21T12:09:24.430 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : ceph-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/2 2024-09-21T12:09:24.480 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-09-21T12:09:24.482 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-21T12:09:24.482 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repository Size 2024-09-21T12:09:24.482 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-21T12:09:24.482 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2024-09-21T12:09:24.482 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-fuse x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 897 k 2024-09-21T12:09:24.482 INFO:teuthology.orchestra.run.smithi003.stdout:Installing dependencies: 2024-09-21T12:09:24.483 INFO:teuthology.orchestra.run.smithi003.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-21T12:09:24.483 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:09:24.483 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2024-09-21T12:09:24.483 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-21T12:09:24.483 INFO:teuthology.orchestra.run.smithi003.stdout:Install 2 Packages 2024-09-21T12:09:24.483 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:09:24.484 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 976 k 2024-09-21T12:09:24.484 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 2.9 M 2024-09-21T12:09:24.484 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2024-09-21T12:09:24.791 INFO:teuthology.orchestra.run.smithi003.stdout:(1/2): ceph-fuse-19.1.1-373.g4e45e6b4.el9.x86_6 3.1 MB/s | 897 kB 00:00 2024-09-21T12:09:24.966 INFO:teuthology.orchestra.run.smithi003.stdout:(2/2): fuse-2.9.9-16.el9.x86_64.rpm 173 kB/s | 80 kB 00:00 2024-09-21T12:09:24.967 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2024-09-21T12:09:24.967 INFO:teuthology.orchestra.run.smithi003.stdout:Total 2.0 MB/s | 976 kB 00:00 2024-09-21T12:09:24.979 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2024-09-21T12:09:25.002 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2024-09-21T12:09:25.003 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2024-09-21T12:09:25.088 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2024-09-21T12:09:25.089 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2024-09-21T12:09:25.116 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: ceph-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/2 2024-09-21T12:09:25.116 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : ceph-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/2 2024-09-21T12:09:25.279 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2024-09-21T12:09:25.401 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-21T12:09:25.401 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:09:25.401 INFO:teuthology.orchestra.run.smithi192.stdout:Installed: 2024-09-21T12:09:25.401 INFO:teuthology.orchestra.run.smithi192.stdout: ceph-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-21T12:09:25.401 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:09:25.401 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2024-09-21T12:09:25.431 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-21T12:09:25.502 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : ceph-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/2 2024-09-21T12:09:25.737 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install librados-devel 2024-09-21T12:09:26.224 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: ceph-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 2/2 2024-09-21T12:09:26.224 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : ceph-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/2 2024-09-21T12:09:26.337 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:01:33 ago on Sat 21 Sep 2024 12:07:53 PM UTC. 2024-09-21T12:09:26.477 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2024-09-21T12:09:26.478 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-21T12:09:26.478 INFO:teuthology.orchestra.run.smithi192.stdout: Package Arch Version Repo Size 2024-09-21T12:09:26.478 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-21T12:09:26.478 INFO:teuthology.orchestra.run.smithi192.stdout:Installing: 2024-09-21T12:09:26.478 INFO:teuthology.orchestra.run.smithi192.stdout: librados-devel x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 127 k 2024-09-21T12:09:26.478 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:09:26.478 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction Summary 2024-09-21T12:09:26.478 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-21T12:09:26.478 INFO:teuthology.orchestra.run.smithi192.stdout:Install 1 Package 2024-09-21T12:09:26.478 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:09:26.478 INFO:teuthology.orchestra.run.smithi192.stdout:Total download size: 127 k 2024-09-21T12:09:26.479 INFO:teuthology.orchestra.run.smithi192.stdout:Installed size: 456 k 2024-09-21T12:09:26.479 INFO:teuthology.orchestra.run.smithi192.stdout:Downloading Packages: 2024-09-21T12:09:26.514 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-21T12:09:26.514 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:09:26.514 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2024-09-21T12:09:26.514 INFO:teuthology.orchestra.run.smithi003.stdout: ceph-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-21T12:09:26.514 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:09:26.514 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-09-21T12:09:26.685 INFO:teuthology.orchestra.run.smithi192.stdout:librados-devel-19.1.1-373.g4e45e6b4.el9.x86_64. 613 kB/s | 127 kB 00:00 2024-09-21T12:09:26.686 INFO:teuthology.orchestra.run.smithi192.stdout:-------------------------------------------------------------------------------- 2024-09-21T12:09:26.686 INFO:teuthology.orchestra.run.smithi192.stdout:Total 609 kB/s | 127 kB 00:00 2024-09-21T12:09:26.686 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction check 2024-09-21T12:09:26.691 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction check succeeded. 2024-09-21T12:09:26.691 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction test 2024-09-21T12:09:26.756 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction test succeeded. 2024-09-21T12:09:26.756 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction 2024-09-21T12:09:26.815 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install librados-devel 2024-09-21T12:09:26.906 INFO:teuthology.orchestra.run.smithi192.stdout: Preparing : 1/1 2024-09-21T12:09:27.008 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : librados-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T12:09:27.435 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:01:32 ago on Sat 21 Sep 2024 12:07:55 PM UTC. 2024-09-21T12:09:27.490 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: librados-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T12:09:27.578 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-09-21T12:09:27.579 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-21T12:09:27.579 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repo Size 2024-09-21T12:09:27.579 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-21T12:09:27.579 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2024-09-21T12:09:27.579 INFO:teuthology.orchestra.run.smithi003.stdout: librados-devel x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 127 k 2024-09-21T12:09:27.579 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:09:27.579 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2024-09-21T12:09:27.579 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-21T12:09:27.579 INFO:teuthology.orchestra.run.smithi003.stdout:Install 1 Package 2024-09-21T12:09:27.579 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:09:27.580 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 127 k 2024-09-21T12:09:27.580 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 456 k 2024-09-21T12:09:27.580 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2024-09-21T12:09:27.738 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : librados-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T12:09:27.738 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:09:27.738 INFO:teuthology.orchestra.run.smithi192.stdout:Installed: 2024-09-21T12:09:27.738 INFO:teuthology.orchestra.run.smithi192.stdout: librados-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:09:27.738 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:09:27.738 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2024-09-21T12:09:27.771 INFO:teuthology.orchestra.run.smithi003.stdout:librados-devel-19.1.1-373.g4e45e6b4.el9.x86_64. 663 kB/s | 127 kB 00:00 2024-09-21T12:09:27.771 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2024-09-21T12:09:27.772 INFO:teuthology.orchestra.run.smithi003.stdout:Total 658 kB/s | 127 kB 00:00 2024-09-21T12:09:27.772 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2024-09-21T12:09:27.778 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2024-09-21T12:09:27.778 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2024-09-21T12:09:27.845 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2024-09-21T12:09:27.845 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2024-09-21T12:09:27.997 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install libcephfs2 2024-09-21T12:09:28.002 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2024-09-21T12:09:28.105 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : librados-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T12:09:28.571 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: librados-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T12:09:28.590 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:01:35 ago on Sat 21 Sep 2024 12:07:53 PM UTC. 2024-09-21T12:09:28.680 INFO:teuthology.orchestra.run.smithi192.stdout:Package libcephfs2-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T12:09:28.723 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2024-09-21T12:09:28.724 INFO:teuthology.orchestra.run.smithi192.stdout:Nothing to do. 2024-09-21T12:09:28.724 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2024-09-21T12:09:28.800 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install libcephfs-devel 2024-09-21T12:09:28.839 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : librados-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T12:09:28.839 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:09:28.839 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2024-09-21T12:09:28.839 INFO:teuthology.orchestra.run.smithi003.stdout: librados-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:09:28.839 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:09:28.839 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-09-21T12:09:29.107 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install libcephfs2 2024-09-21T12:09:29.390 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:01:36 ago on Sat 21 Sep 2024 12:07:53 PM UTC. 2024-09-21T12:09:29.527 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2024-09-21T12:09:29.527 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-21T12:09:29.527 INFO:teuthology.orchestra.run.smithi192.stdout: Package Arch Version Repo Size 2024-09-21T12:09:29.527 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-21T12:09:29.528 INFO:teuthology.orchestra.run.smithi192.stdout:Installing: 2024-09-21T12:09:29.528 INFO:teuthology.orchestra.run.smithi192.stdout: libcephfs-devel x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 32 k 2024-09-21T12:09:29.528 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:09:29.528 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction Summary 2024-09-21T12:09:29.528 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-21T12:09:29.528 INFO:teuthology.orchestra.run.smithi192.stdout:Install 1 Package 2024-09-21T12:09:29.528 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:09:29.528 INFO:teuthology.orchestra.run.smithi192.stdout:Total download size: 32 k 2024-09-21T12:09:29.529 INFO:teuthology.orchestra.run.smithi192.stdout:Installed size: 142 k 2024-09-21T12:09:29.529 INFO:teuthology.orchestra.run.smithi192.stdout:Downloading Packages: 2024-09-21T12:09:29.714 INFO:teuthology.orchestra.run.smithi192.stdout:libcephfs-devel-19.1.1-373.g4e45e6b4.el9.x86_64 171 kB/s | 32 kB 00:00 2024-09-21T12:09:29.714 INFO:teuthology.orchestra.run.smithi192.stdout:-------------------------------------------------------------------------------- 2024-09-21T12:09:29.715 INFO:teuthology.orchestra.run.smithi192.stdout:Total 170 kB/s | 32 kB 00:00 2024-09-21T12:09:29.715 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction check 2024-09-21T12:09:29.717 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:01:34 ago on Sat 21 Sep 2024 12:07:55 PM UTC. 2024-09-21T12:09:29.718 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction check succeeded. 2024-09-21T12:09:29.718 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction test 2024-09-21T12:09:29.752 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction test succeeded. 2024-09-21T12:09:29.752 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction 2024-09-21T12:09:29.809 INFO:teuthology.orchestra.run.smithi003.stdout:Package libcephfs2-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T12:09:29.845 INFO:teuthology.orchestra.run.smithi192.stdout: Preparing : 1/1 2024-09-21T12:09:29.856 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-09-21T12:09:29.857 INFO:teuthology.orchestra.run.smithi003.stdout:Nothing to do. 2024-09-21T12:09:29.857 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-09-21T12:09:29.925 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install libcephfs-devel 2024-09-21T12:09:29.960 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : libcephfs-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T12:09:30.368 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: libcephfs-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T12:09:30.539 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:01:35 ago on Sat 21 Sep 2024 12:07:55 PM UTC. 2024-09-21T12:09:30.618 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : libcephfs-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T12:09:30.619 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:09:30.619 INFO:teuthology.orchestra.run.smithi192.stdout:Installed: 2024-09-21T12:09:30.619 INFO:teuthology.orchestra.run.smithi192.stdout: libcephfs-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:09:30.619 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:09:30.619 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2024-09-21T12:09:30.677 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-09-21T12:09:30.678 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-21T12:09:30.678 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repo Size 2024-09-21T12:09:30.678 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-21T12:09:30.678 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2024-09-21T12:09:30.678 INFO:teuthology.orchestra.run.smithi003.stdout: libcephfs-devel x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 32 k 2024-09-21T12:09:30.678 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:09:30.678 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2024-09-21T12:09:30.678 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-21T12:09:30.678 INFO:teuthology.orchestra.run.smithi003.stdout:Install 1 Package 2024-09-21T12:09:30.678 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:09:30.679 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 32 k 2024-09-21T12:09:30.679 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 142 k 2024-09-21T12:09:30.679 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2024-09-21T12:09:30.811 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install librados2 2024-09-21T12:09:30.841 INFO:teuthology.orchestra.run.smithi003.stdout:libcephfs-devel-19.1.1-373.g4e45e6b4.el9.x86_64 196 kB/s | 32 kB 00:00 2024-09-21T12:09:30.841 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2024-09-21T12:09:30.842 INFO:teuthology.orchestra.run.smithi003.stdout:Total 195 kB/s | 32 kB 00:00 2024-09-21T12:09:30.842 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2024-09-21T12:09:30.845 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2024-09-21T12:09:30.845 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2024-09-21T12:09:30.859 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2024-09-21T12:09:30.859 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2024-09-21T12:09:30.955 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2024-09-21T12:09:31.075 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : libcephfs-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T12:09:31.387 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:01:38 ago on Sat 21 Sep 2024 12:07:53 PM UTC. 2024-09-21T12:09:31.465 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: libcephfs-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T12:09:31.477 INFO:teuthology.orchestra.run.smithi192.stdout:Package librados2-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T12:09:31.519 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2024-09-21T12:09:31.521 INFO:teuthology.orchestra.run.smithi192.stdout:Nothing to do. 2024-09-21T12:09:31.521 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2024-09-21T12:09:31.597 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install librbd1 2024-09-21T12:09:31.717 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : libcephfs-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T12:09:31.717 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:09:31.717 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2024-09-21T12:09:31.717 INFO:teuthology.orchestra.run.smithi003.stdout: libcephfs-devel-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:09:31.717 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:09:31.717 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-09-21T12:09:31.909 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install librados2 2024-09-21T12:09:32.178 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:01:39 ago on Sat 21 Sep 2024 12:07:53 PM UTC. 2024-09-21T12:09:32.267 INFO:teuthology.orchestra.run.smithi192.stdout:Package librbd1-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T12:09:32.310 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2024-09-21T12:09:32.311 INFO:teuthology.orchestra.run.smithi192.stdout:Nothing to do. 2024-09-21T12:09:32.312 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2024-09-21T12:09:32.380 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install python3-rados 2024-09-21T12:09:32.520 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:01:37 ago on Sat 21 Sep 2024 12:07:55 PM UTC. 2024-09-21T12:09:32.614 INFO:teuthology.orchestra.run.smithi003.stdout:Package librados2-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T12:09:32.662 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-09-21T12:09:32.662 INFO:teuthology.orchestra.run.smithi003.stdout:Nothing to do. 2024-09-21T12:09:32.662 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-09-21T12:09:32.736 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install librbd1 2024-09-21T12:09:32.962 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:01:39 ago on Sat 21 Sep 2024 12:07:53 PM UTC. 2024-09-21T12:09:33.051 INFO:teuthology.orchestra.run.smithi192.stdout:Package python3-rados-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T12:09:33.094 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2024-09-21T12:09:33.095 INFO:teuthology.orchestra.run.smithi192.stdout:Nothing to do. 2024-09-21T12:09:33.095 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2024-09-21T12:09:33.164 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install python3-rgw 2024-09-21T12:09:33.346 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:01:38 ago on Sat 21 Sep 2024 12:07:55 PM UTC. 2024-09-21T12:09:33.437 INFO:teuthology.orchestra.run.smithi003.stdout:Package librbd1-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T12:09:33.483 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-09-21T12:09:33.484 INFO:teuthology.orchestra.run.smithi003.stdout:Nothing to do. 2024-09-21T12:09:33.484 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-09-21T12:09:33.553 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install python3-rados 2024-09-21T12:09:33.741 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:01:40 ago on Sat 21 Sep 2024 12:07:53 PM UTC. 2024-09-21T12:09:33.830 INFO:teuthology.orchestra.run.smithi192.stdout:Package python3-rgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T12:09:33.872 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2024-09-21T12:09:33.874 INFO:teuthology.orchestra.run.smithi192.stdout:Nothing to do. 2024-09-21T12:09:33.874 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2024-09-21T12:09:33.949 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install python3-cephfs 2024-09-21T12:09:34.158 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:01:39 ago on Sat 21 Sep 2024 12:07:55 PM UTC. 2024-09-21T12:09:34.248 INFO:teuthology.orchestra.run.smithi003.stdout:Package python3-rados-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T12:09:34.294 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-09-21T12:09:34.295 INFO:teuthology.orchestra.run.smithi003.stdout:Nothing to do. 2024-09-21T12:09:34.295 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-09-21T12:09:34.369 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install python3-rgw 2024-09-21T12:09:34.531 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:01:41 ago on Sat 21 Sep 2024 12:07:53 PM UTC. 2024-09-21T12:09:34.622 INFO:teuthology.orchestra.run.smithi192.stdout:Package python3-cephfs-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T12:09:34.666 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2024-09-21T12:09:34.666 INFO:teuthology.orchestra.run.smithi192.stdout:Nothing to do. 2024-09-21T12:09:34.667 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2024-09-21T12:09:34.741 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install python3-rbd 2024-09-21T12:09:34.972 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:01:39 ago on Sat 21 Sep 2024 12:07:55 PM UTC. 2024-09-21T12:09:35.063 INFO:teuthology.orchestra.run.smithi003.stdout:Package python3-rgw-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T12:09:35.108 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-09-21T12:09:35.109 INFO:teuthology.orchestra.run.smithi003.stdout:Nothing to do. 2024-09-21T12:09:35.110 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-09-21T12:09:35.176 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install python3-cephfs 2024-09-21T12:09:35.322 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:01:42 ago on Sat 21 Sep 2024 12:07:53 PM UTC. 2024-09-21T12:09:35.410 INFO:teuthology.orchestra.run.smithi192.stdout:Package python3-rbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T12:09:35.453 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2024-09-21T12:09:35.454 INFO:teuthology.orchestra.run.smithi192.stdout:Nothing to do. 2024-09-21T12:09:35.454 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2024-09-21T12:09:35.521 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install rbd-fuse 2024-09-21T12:09:35.786 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:01:40 ago on Sat 21 Sep 2024 12:07:55 PM UTC. 2024-09-21T12:09:35.879 INFO:teuthology.orchestra.run.smithi003.stdout:Package python3-cephfs-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T12:09:35.925 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-09-21T12:09:35.926 INFO:teuthology.orchestra.run.smithi003.stdout:Nothing to do. 2024-09-21T12:09:35.926 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-09-21T12:09:36.001 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install python3-rbd 2024-09-21T12:09:36.105 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:01:43 ago on Sat 21 Sep 2024 12:07:53 PM UTC. 2024-09-21T12:09:36.237 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2024-09-21T12:09:36.238 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-21T12:09:36.238 INFO:teuthology.orchestra.run.smithi192.stdout: Package Architecture Version Repository Size 2024-09-21T12:09:36.238 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-21T12:09:36.238 INFO:teuthology.orchestra.run.smithi192.stdout:Installing: 2024-09-21T12:09:36.238 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-fuse x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 85 k 2024-09-21T12:09:36.238 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:09:36.238 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction Summary 2024-09-21T12:09:36.238 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-21T12:09:36.238 INFO:teuthology.orchestra.run.smithi192.stdout:Install 1 Package 2024-09-21T12:09:36.238 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:09:36.239 INFO:teuthology.orchestra.run.smithi192.stdout:Total download size: 85 k 2024-09-21T12:09:36.239 INFO:teuthology.orchestra.run.smithi192.stdout:Installed size: 231 k 2024-09-21T12:09:36.239 INFO:teuthology.orchestra.run.smithi192.stdout:Downloading Packages: 2024-09-21T12:09:36.450 INFO:teuthology.orchestra.run.smithi192.stdout:rbd-fuse-19.1.1-373.g4e45e6b4.el9.x86_64.rpm 405 kB/s | 85 kB 00:00 2024-09-21T12:09:36.451 INFO:teuthology.orchestra.run.smithi192.stdout:-------------------------------------------------------------------------------- 2024-09-21T12:09:36.451 INFO:teuthology.orchestra.run.smithi192.stdout:Total 402 kB/s | 85 kB 00:00 2024-09-21T12:09:36.451 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction check 2024-09-21T12:09:36.458 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction check succeeded. 2024-09-21T12:09:36.458 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction test 2024-09-21T12:09:36.521 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction test succeeded. 2024-09-21T12:09:36.522 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction 2024-09-21T12:09:36.604 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:01:41 ago on Sat 21 Sep 2024 12:07:55 PM UTC. 2024-09-21T12:09:36.676 INFO:teuthology.orchestra.run.smithi192.stdout: Preparing : 1/1 2024-09-21T12:09:36.694 INFO:teuthology.orchestra.run.smithi003.stdout:Package python3-rbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 is already installed. 2024-09-21T12:09:36.741 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-09-21T12:09:36.742 INFO:teuthology.orchestra.run.smithi003.stdout:Nothing to do. 2024-09-21T12:09:36.742 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-09-21T12:09:36.789 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : rbd-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T12:09:36.814 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install rbd-fuse 2024-09-21T12:09:37.200 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: rbd-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T12:09:37.417 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:01:42 ago on Sat 21 Sep 2024 12:07:55 PM UTC. 2024-09-21T12:09:37.527 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : rbd-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T12:09:37.527 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:09:37.527 INFO:teuthology.orchestra.run.smithi192.stdout:Installed: 2024-09-21T12:09:37.527 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:09:37.527 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:09:37.527 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2024-09-21T12:09:37.556 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-09-21T12:09:37.556 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-21T12:09:37.556 INFO:teuthology.orchestra.run.smithi003.stdout: Package Architecture Version Repository Size 2024-09-21T12:09:37.556 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-21T12:09:37.556 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2024-09-21T12:09:37.556 INFO:teuthology.orchestra.run.smithi003.stdout: rbd-fuse x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 85 k 2024-09-21T12:09:37.557 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:09:37.557 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2024-09-21T12:09:37.557 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-21T12:09:37.557 INFO:teuthology.orchestra.run.smithi003.stdout:Install 1 Package 2024-09-21T12:09:37.557 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:09:37.557 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 85 k 2024-09-21T12:09:37.557 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 231 k 2024-09-21T12:09:37.558 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2024-09-21T12:09:37.744 INFO:teuthology.orchestra.run.smithi003.stdout:rbd-fuse-19.1.1-373.g4e45e6b4.el9.x86_64.rpm 459 kB/s | 85 kB 00:00 2024-09-21T12:09:37.744 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2024-09-21T12:09:37.745 INFO:teuthology.orchestra.run.smithi003.stdout:Total 455 kB/s | 85 kB 00:00 2024-09-21T12:09:37.745 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2024-09-21T12:09:37.752 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2024-09-21T12:09:37.753 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2024-09-21T12:09:37.787 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install rbd-mirror 2024-09-21T12:09:37.820 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2024-09-21T12:09:37.820 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2024-09-21T12:09:37.970 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2024-09-21T12:09:38.087 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : rbd-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T12:09:38.375 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:01:45 ago on Sat 21 Sep 2024 12:07:53 PM UTC. 2024-09-21T12:09:38.511 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: rbd-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T12:09:38.512 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2024-09-21T12:09:38.514 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-21T12:09:38.514 INFO:teuthology.orchestra.run.smithi192.stdout: Package Arch Version Repo Size 2024-09-21T12:09:38.514 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-21T12:09:38.514 INFO:teuthology.orchestra.run.smithi192.stdout:Installing: 2024-09-21T12:09:38.514 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-mirror x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 3.1 M 2024-09-21T12:09:38.514 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:09:38.514 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction Summary 2024-09-21T12:09:38.515 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-21T12:09:38.515 INFO:teuthology.orchestra.run.smithi192.stdout:Install 1 Package 2024-09-21T12:09:38.515 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:09:38.515 INFO:teuthology.orchestra.run.smithi192.stdout:Total download size: 3.1 M 2024-09-21T12:09:38.515 INFO:teuthology.orchestra.run.smithi192.stdout:Installed size: 13 M 2024-09-21T12:09:38.515 INFO:teuthology.orchestra.run.smithi192.stdout:Downloading Packages: 2024-09-21T12:09:38.764 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : rbd-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T12:09:38.765 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:09:38.765 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2024-09-21T12:09:38.765 INFO:teuthology.orchestra.run.smithi003.stdout: rbd-fuse-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:09:38.765 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:09:38.765 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-09-21T12:09:38.838 INFO:teuthology.orchestra.run.smithi192.stdout:rbd-mirror-19.1.1-373.g4e45e6b4.el9.x86_64.rpm 9.6 MB/s | 3.1 MB 00:00 2024-09-21T12:09:38.838 INFO:teuthology.orchestra.run.smithi192.stdout:-------------------------------------------------------------------------------- 2024-09-21T12:09:38.839 INFO:teuthology.orchestra.run.smithi192.stdout:Total 9.6 MB/s | 3.1 MB 00:00 2024-09-21T12:09:38.839 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction check 2024-09-21T12:09:38.848 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction check succeeded. 2024-09-21T12:09:38.848 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction test 2024-09-21T12:09:38.931 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction test succeeded. 2024-09-21T12:09:38.932 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction 2024-09-21T12:09:39.047 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install rbd-mirror 2024-09-21T12:09:39.356 INFO:teuthology.orchestra.run.smithi192.stdout: Preparing : 1/1 2024-09-21T12:09:39.422 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : rbd-mirror-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T12:09:39.446 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: rbd-mirror-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T12:09:39.446 INFO:teuthology.orchestra.run.smithi192.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T12:09:39.446 INFO:teuthology.orchestra.run.smithi192.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T12:09:39.446 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T12:09:39.446 INFO:teuthology.orchestra.run.smithi192.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T12:09:39.447 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:09:39.657 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:01:44 ago on Sat 21 Sep 2024 12:07:55 PM UTC. 2024-09-21T12:09:39.796 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-09-21T12:09:39.797 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-21T12:09:39.797 INFO:teuthology.orchestra.run.smithi003.stdout: Package Arch Version Repo Size 2024-09-21T12:09:39.797 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-21T12:09:39.797 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2024-09-21T12:09:39.797 INFO:teuthology.orchestra.run.smithi003.stdout: rbd-mirror x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 3.1 M 2024-09-21T12:09:39.797 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:09:39.798 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2024-09-21T12:09:39.798 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-21T12:09:39.798 INFO:teuthology.orchestra.run.smithi003.stdout:Install 1 Package 2024-09-21T12:09:39.798 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:09:39.798 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 3.1 M 2024-09-21T12:09:39.798 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 13 M 2024-09-21T12:09:39.798 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2024-09-21T12:09:40.122 INFO:teuthology.orchestra.run.smithi003.stdout:rbd-mirror-19.1.1-373.g4e45e6b4.el9.x86_64.rpm 9.6 MB/s | 3.1 MB 00:00 2024-09-21T12:09:40.122 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2024-09-21T12:09:40.123 INFO:teuthology.orchestra.run.smithi003.stdout:Total 9.5 MB/s | 3.1 MB 00:00 2024-09-21T12:09:40.123 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2024-09-21T12:09:40.133 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2024-09-21T12:09:40.133 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2024-09-21T12:09:40.219 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2024-09-21T12:09:40.219 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2024-09-21T12:09:40.527 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : rbd-mirror-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T12:09:40.527 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:09:40.527 INFO:teuthology.orchestra.run.smithi192.stdout:Installed: 2024-09-21T12:09:40.527 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-mirror-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:09:40.527 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:09:40.527 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2024-09-21T12:09:40.676 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2024-09-21T12:09:40.748 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : rbd-mirror-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T12:09:40.776 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: rbd-mirror-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T12:09:40.776 INFO:teuthology.orchestra.run.smithi003.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-21T12:09:40.776 INFO:teuthology.orchestra.run.smithi003.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-21T12:09:40.777 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T12:09:40.777 INFO:teuthology.orchestra.run.smithi003.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-21T12:09:40.777 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:09:40.779 DEBUG:teuthology.orchestra.run.smithi192:> sudo yum -y install rbd-nbd 2024-09-21T12:09:41.377 INFO:teuthology.orchestra.run.smithi192.stdout:Last metadata expiration check: 0:01:48 ago on Sat 21 Sep 2024 12:07:53 PM UTC. 2024-09-21T12:09:41.518 INFO:teuthology.orchestra.run.smithi192.stdout:Dependencies resolved. 2024-09-21T12:09:41.518 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-21T12:09:41.519 INFO:teuthology.orchestra.run.smithi192.stdout: Package Architecture Version Repository Size 2024-09-21T12:09:41.519 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-21T12:09:41.519 INFO:teuthology.orchestra.run.smithi192.stdout:Installing: 2024-09-21T12:09:41.519 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-nbd x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 170 k 2024-09-21T12:09:41.519 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:09:41.519 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction Summary 2024-09-21T12:09:41.519 INFO:teuthology.orchestra.run.smithi192.stdout:================================================================================ 2024-09-21T12:09:41.519 INFO:teuthology.orchestra.run.smithi192.stdout:Install 1 Package 2024-09-21T12:09:41.519 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:09:41.519 INFO:teuthology.orchestra.run.smithi192.stdout:Total download size: 170 k 2024-09-21T12:09:41.520 INFO:teuthology.orchestra.run.smithi192.stdout:Installed size: 494 k 2024-09-21T12:09:41.520 INFO:teuthology.orchestra.run.smithi192.stdout:Downloading Packages: 2024-09-21T12:09:41.734 INFO:teuthology.orchestra.run.smithi192.stdout:rbd-nbd-19.1.1-373.g4e45e6b4.el9.x86_64.rpm 795 kB/s | 170 kB 00:00 2024-09-21T12:09:41.735 INFO:teuthology.orchestra.run.smithi192.stdout:-------------------------------------------------------------------------------- 2024-09-21T12:09:41.735 INFO:teuthology.orchestra.run.smithi192.stdout:Total 789 kB/s | 170 kB 00:00 2024-09-21T12:09:41.735 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction check 2024-09-21T12:09:41.743 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction check succeeded. 2024-09-21T12:09:41.743 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction test 2024-09-21T12:09:41.811 INFO:teuthology.orchestra.run.smithi192.stdout:Transaction test succeeded. 2024-09-21T12:09:41.811 INFO:teuthology.orchestra.run.smithi192.stdout:Running transaction 2024-09-21T12:09:41.893 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : rbd-mirror-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T12:09:41.893 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:09:41.893 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2024-09-21T12:09:41.893 INFO:teuthology.orchestra.run.smithi003.stdout: rbd-mirror-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:09:41.893 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:09:41.894 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-09-21T12:09:41.970 INFO:teuthology.orchestra.run.smithi192.stdout: Preparing : 1/1 2024-09-21T12:09:42.075 INFO:teuthology.orchestra.run.smithi192.stdout: Installing : rbd-nbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T12:09:42.161 DEBUG:teuthology.orchestra.run.smithi003:> sudo yum -y install rbd-nbd 2024-09-21T12:09:42.525 INFO:teuthology.orchestra.run.smithi192.stdout: Running scriptlet: rbd-nbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T12:09:42.744 INFO:teuthology.orchestra.run.smithi192.stdout: Verifying : rbd-nbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T12:09:42.744 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:09:42.744 INFO:teuthology.orchestra.run.smithi192.stdout:Installed: 2024-09-21T12:09:42.744 INFO:teuthology.orchestra.run.smithi192.stdout: rbd-nbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:09:42.744 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:09:42.744 INFO:teuthology.orchestra.run.smithi192.stdout:Complete! 2024-09-21T12:09:42.774 INFO:teuthology.orchestra.run.smithi003.stdout:Last metadata expiration check: 0:01:47 ago on Sat 21 Sep 2024 12:07:55 PM UTC. 2024-09-21T12:09:42.913 INFO:teuthology.orchestra.run.smithi003.stdout:Dependencies resolved. 2024-09-21T12:09:42.914 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-21T12:09:42.915 INFO:teuthology.orchestra.run.smithi003.stdout: Package Architecture Version Repository Size 2024-09-21T12:09:42.915 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-21T12:09:42.915 INFO:teuthology.orchestra.run.smithi003.stdout:Installing: 2024-09-21T12:09:42.915 INFO:teuthology.orchestra.run.smithi003.stdout: rbd-nbd x86_64 2:19.1.1-373.g4e45e6b4.el9 ceph 170 k 2024-09-21T12:09:42.915 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:09:42.915 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction Summary 2024-09-21T12:09:42.915 INFO:teuthology.orchestra.run.smithi003.stdout:================================================================================ 2024-09-21T12:09:42.915 INFO:teuthology.orchestra.run.smithi003.stdout:Install 1 Package 2024-09-21T12:09:42.915 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:09:42.916 INFO:teuthology.orchestra.run.smithi003.stdout:Total download size: 170 k 2024-09-21T12:09:42.916 INFO:teuthology.orchestra.run.smithi003.stdout:Installed size: 494 k 2024-09-21T12:09:42.916 INFO:teuthology.orchestra.run.smithi003.stdout:Downloading Packages: 2024-09-21T12:09:42.996 DEBUG:teuthology.parallel:result is None 2024-09-21T12:09:43.125 INFO:teuthology.orchestra.run.smithi003.stdout:rbd-nbd-19.1.1-373.g4e45e6b4.el9.x86_64.rpm 812 kB/s | 170 kB 00:00 2024-09-21T12:09:43.126 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2024-09-21T12:09:43.126 INFO:teuthology.orchestra.run.smithi003.stdout:Total 806 kB/s | 170 kB 00:00 2024-09-21T12:09:43.126 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction check 2024-09-21T12:09:43.135 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction check succeeded. 2024-09-21T12:09:43.135 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction test 2024-09-21T12:09:43.202 INFO:teuthology.orchestra.run.smithi003.stdout:Transaction test succeeded. 2024-09-21T12:09:43.203 INFO:teuthology.orchestra.run.smithi003.stdout:Running transaction 2024-09-21T12:09:43.363 INFO:teuthology.orchestra.run.smithi003.stdout: Preparing : 1/1 2024-09-21T12:09:43.460 INFO:teuthology.orchestra.run.smithi003.stdout: Installing : rbd-nbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T12:09:43.886 INFO:teuthology.orchestra.run.smithi003.stdout: Running scriptlet: rbd-nbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T12:09:44.154 INFO:teuthology.orchestra.run.smithi003.stdout: Verifying : rbd-nbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 1/1 2024-09-21T12:09:44.154 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:09:44.154 INFO:teuthology.orchestra.run.smithi003.stdout:Installed: 2024-09-21T12:09:44.154 INFO:teuthology.orchestra.run.smithi003.stdout: rbd-nbd-2:19.1.1-373.g4e45e6b4.el9.x86_64 2024-09-21T12:09:44.154 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:09:44.154 INFO:teuthology.orchestra.run.smithi003.stdout:Complete! 2024-09-21T12:09:44.388 DEBUG:teuthology.parallel:result is None 2024-09-21T12:09:44.388 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T12:09:44.388 INFO:teuthology.packaging:ref: None 2024-09-21T12:09:44.388 INFO:teuthology.packaging:tag: None 2024-09-21T12:09:44.388 INFO:teuthology.packaging:branch: squid 2024-09-21T12:09:44.388 INFO:teuthology.packaging:sha1: 5c1cdc3c470dae78e91a0ed2bcf13509a046d301 2024-09-21T12:09:44.389 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-21T12:09:44.600 DEBUG:teuthology.orchestra.run.smithi003:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T12:09:44.623 INFO:teuthology.orchestra.run.smithi003.stdout:19.1.1-373.g4e45e6b4.el9 2024-09-21T12:09:44.623 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-373.g4e45e6b4.el9 2024-09-21T12:09:44.623 INFO:teuthology.task.install:The correct ceph version 19.1.1-373.g4e45e6b4 is installed. 2024-09-21T12:09:44.625 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-21T12:09:44.625 INFO:teuthology.packaging:ref: None 2024-09-21T12:09:44.625 INFO:teuthology.packaging:tag: None 2024-09-21T12:09:44.625 INFO:teuthology.packaging:branch: squid 2024-09-21T12:09:44.625 INFO:teuthology.packaging:sha1: 5c1cdc3c470dae78e91a0ed2bcf13509a046d301 2024-09-21T12:09:44.625 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-21T12:09:44.834 DEBUG:teuthology.orchestra.run.smithi192:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-21T12:09:44.859 INFO:teuthology.orchestra.run.smithi192.stdout:19.1.1-373.g4e45e6b4.el9 2024-09-21T12:09:44.860 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-373.g4e45e6b4.el9 2024-09-21T12:09:44.860 INFO:teuthology.task.install:The correct ceph version 19.1.1-373.g4e45e6b4 is installed. 2024-09-21T12:09:44.861 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-21T12:09:44.862 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-09-21T12:09:44.862 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T12:09:44.890 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-21T12:09:44.890 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-21T12:09:44.930 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-21T12:09:44.930 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-09-21T12:09:44.930 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T12:09:44.958 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T12:09:45.024 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-21T12:09:45.024 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/usr/bin/daemon-helper 2024-09-21T12:09:45.053 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-21T12:09:45.121 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-21T12:09:45.121 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-09-21T12:09:45.121 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T12:09:45.158 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T12:09:45.225 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-21T12:09:45.225 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-21T12:09:45.252 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-21T12:09:45.318 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-21T12:09:45.318 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-09-21T12:09:45.318 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T12:09:45.344 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T12:09:45.410 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-21T12:09:45.411 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/usr/bin/stdin-killer 2024-09-21T12:09:45.436 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-21T12:09:45.501 INFO:teuthology.run_tasks:Running task print... 2024-09-21T12:09:45.510 INFO:teuthology.task.print:**** done install task... 2024-09-21T12:09:45.511 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-21T12:09:45.606 INFO:tasks.cephadm:Config: {'compiled_cephadm_branch': 'squid', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'global': {'mon pg warn min per osd': 0}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}}, 'image': 'quay.ceph.io/ceph-ci/ceph:squid', 'roleless': True, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'OSD_DOWN', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '5c1cdc3c470dae78e91a0ed2bcf13509a046d301'} 2024-09-21T12:09:45.606 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:squid 2024-09-21T12:09:45.607 INFO:tasks.cephadm:Cluster fsid is 641beec0-7812-11ef-baf6-efdc52797490 2024-09-21T12:09:45.607 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-21T12:09:45.607 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-09-21T12:09:45.607 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi003': '172.21.15.3', 'mon.smithi192': '172.21.15.192'} 2024-09-21T12:09:45.607 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-21T12:09:45.607 DEBUG:teuthology.orchestra.run.smithi003:> sudo hostname $(hostname -s) 2024-09-21T12:09:45.634 DEBUG:teuthology.orchestra.run.smithi192:> sudo hostname $(hostname -s) 2024-09-21T12:09:45.660 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra for squid 2024-09-21T12:09:45.660 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=5c1cdc3c470dae78e91a0ed2bcf13509a046d301 2024-09-21T12:09:45.799 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '5c1cdc3c470dae78e91a0ed2bcf13509a046d301', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/83200/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.3.0-5103-g5c1cdc3c', 'node_name': '172.21.2.5+braggi05', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.3.0-5103.g5c1cdc3c'}, 'url': 'https://2.chacra.ceph.com/r/ceph/wip-guits-main-2024-09-21-0813/5c1cdc3c470dae78e91a0ed2bcf13509a046d301/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-21 10:00:04.055809', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-guits-main-2024-09-21-0813', 'chacra_url': 'https://2.chacra.ceph.com/repos/ceph/wip-guits-main-2024-09-21-0813/5c1cdc3c470dae78e91a0ed2bcf13509a046d301/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-09-21T12:09:46.002 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref squid, sha1 4e45e6b490e6cbe082cdf155fea780438ec53fc7 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&ref=squid 2024-09-21T12:09:46.004 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/centos/9/x86_64/flavors/default/cephadm 2024-09-21T12:09:46.004 INFO:tasks.cephadm:Downloading cephadm from url: https://1.chacra.ceph.com/binaries/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/centos/9/x86_64/flavors/default/cephadm 2024-09-21T12:09:46.005 DEBUG:teuthology.orchestra.run.smithi003:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T12:09:46.359 INFO:teuthology.orchestra.run.smithi003.stdout:-rw-r--r--. 1 ubuntu ubuntu 784608 Sep 21 12:09 /home/ubuntu/cephtest/cephadm 2024-09-21T12:09:46.360 DEBUG:teuthology.orchestra.run.smithi192:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/4e45e6b490e6cbe082cdf155fea780438ec53fc7/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-21T12:09:46.741 INFO:teuthology.orchestra.run.smithi192.stdout:-rw-r--r--. 1 ubuntu ubuntu 784608 Sep 21 12:09 /home/ubuntu/cephtest/cephadm 2024-09-21T12:09:46.742 DEBUG:teuthology.orchestra.run.smithi003:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T12:09:46.762 DEBUG:teuthology.orchestra.run.smithi192:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-21T12:09:46.793 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:squid on all hosts... 2024-09-21T12:09:46.793 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid pull 2024-09-21T12:09:46.805 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid pull 2024-09-21T12:09:48.402 INFO:teuthology.orchestra.run.smithi192.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:squid... 2024-09-21T12:09:48.430 INFO:teuthology.orchestra.run.smithi003.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:squid... 2024-09-21T12:10:36.167 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-21T12:10:36.167 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph_version": "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)", 2024-09-21T12:10:36.167 INFO:teuthology.orchestra.run.smithi003.stdout: "image_id": "164465d2334a36ec69b5e540adc75ef73c92a8a0546664850c2173107383597c", 2024-09-21T12:10:36.167 INFO:teuthology.orchestra.run.smithi003.stdout: "repo_digests": [ 2024-09-21T12:10:36.167 INFO:teuthology.orchestra.run.smithi003.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64" 2024-09-21T12:10:36.168 INFO:teuthology.orchestra.run.smithi003.stdout: ] 2024-09-21T12:10:36.168 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-21T12:10:37.161 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-09-21T12:10:37.162 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_version": "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)", 2024-09-21T12:10:37.162 INFO:teuthology.orchestra.run.smithi192.stdout: "image_id": "164465d2334a36ec69b5e540adc75ef73c92a8a0546664850c2173107383597c", 2024-09-21T12:10:37.162 INFO:teuthology.orchestra.run.smithi192.stdout: "repo_digests": [ 2024-09-21T12:10:37.162 INFO:teuthology.orchestra.run.smithi192.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64" 2024-09-21T12:10:37.162 INFO:teuthology.orchestra.run.smithi192.stdout: ] 2024-09-21T12:10:37.162 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-09-21T12:10:37.190 DEBUG:teuthology.orchestra.run.smithi003:> sudo mkdir -p /etc/ceph 2024-09-21T12:10:37.224 DEBUG:teuthology.orchestra.run.smithi192:> sudo mkdir -p /etc/ceph 2024-09-21T12:10:37.253 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod 777 /etc/ceph 2024-09-21T12:10:37.294 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 777 /etc/ceph 2024-09-21T12:10:37.320 INFO:tasks.cephadm:Writing seed config... 2024-09-21T12:10:37.321 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-09-21T12:10:37.321 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-09-21T12:10:37.321 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-09-21T12:10:37.321 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-09-21T12:10:37.321 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-09-21T12:10:37.321 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-21T12:10:37.321 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-21T12:10:37.321 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-09-21T12:10:37.322 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-09-21T12:10:37.322 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-21T12:10:37.322 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-21T12:10:37.322 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-09-21T12:10:37.322 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-21T12:10:37.322 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-21T12:10:37.322 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-21T12:10:37.322 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-21T12:10:37.322 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-21T12:10:37.322 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-09-21T12:10:37.322 INFO:tasks.cephadm: override: [mgr] client mount timeout = 30 2024-09-21T12:10:37.322 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-21T12:10:37.322 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-21T12:10:37.322 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-21T12:10:37.323 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-21T12:10:37.323 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-21T12:10:37.323 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-21T12:10:37.323 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-21T12:10:37.323 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-09-21T12:10:37.323 DEBUG:teuthology.orchestra.run.smithi003:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-21T12:10:37.353 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 641beec0-7812-11ef-baf6-efdc52797490 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false client mount timeout = 30 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2024-09-21T12:10:37.353 DEBUG:teuthology.orchestra.run.smithi003:mon.smithi003> sudo journalctl -f -n 0 -u ceph-641beec0-7812-11ef-baf6-efdc52797490@mon.smithi003.service 2024-09-21T12:10:37.395 INFO:tasks.cephadm:Bootstrapping... 2024-09-21T12:10:37.395 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid -v bootstrap --fsid 641beec0-7812-11ef-baf6-efdc52797490 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.3 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-21T12:10:37.609 INFO:teuthology.orchestra.run.smithi003.stdout:-------------------------------------------------------------------------------- 2024-09-21T12:10:37.609 INFO:teuthology.orchestra.run.smithi003.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:squid', '-v', 'bootstrap', '--fsid', '641beec0-7812-11ef-baf6-efdc52797490', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.3', '--skip-admin-label'] 2024-09-21T12:10:37.610 INFO:teuthology.orchestra.run.smithi003.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-21T12:10:37.610 INFO:teuthology.orchestra.run.smithi003.stdout:Verifying podman|docker is present... 2024-09-21T12:10:37.634 INFO:teuthology.orchestra.run.smithi003.stdout:/bin/podman: stdout 5.2.2 2024-09-21T12:10:37.635 INFO:teuthology.orchestra.run.smithi003.stdout:Verifying lvm2 is present... 2024-09-21T12:10:37.635 INFO:teuthology.orchestra.run.smithi003.stdout:Verifying time synchronization is in place... 2024-09-21T12:10:37.643 INFO:teuthology.orchestra.run.smithi003.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-21T12:10:37.643 INFO:teuthology.orchestra.run.smithi003.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-21T12:10:37.649 INFO:teuthology.orchestra.run.smithi003.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-21T12:10:37.649 INFO:teuthology.orchestra.run.smithi003.stdout:systemctl: stdout inactive 2024-09-21T12:10:37.656 INFO:teuthology.orchestra.run.smithi003.stdout:systemctl: stdout enabled 2024-09-21T12:10:37.662 INFO:teuthology.orchestra.run.smithi003.stdout:systemctl: stdout active 2024-09-21T12:10:37.663 INFO:teuthology.orchestra.run.smithi003.stdout:Unit chronyd.service is enabled and running 2024-09-21T12:10:37.663 INFO:teuthology.orchestra.run.smithi003.stdout:Repeating the final host check... 2024-09-21T12:10:37.685 INFO:teuthology.orchestra.run.smithi003.stdout:/bin/podman: stdout 5.2.2 2024-09-21T12:10:37.685 INFO:teuthology.orchestra.run.smithi003.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-21T12:10:37.685 INFO:teuthology.orchestra.run.smithi003.stdout:systemctl is present 2024-09-21T12:10:37.686 INFO:teuthology.orchestra.run.smithi003.stdout:lvcreate is present 2024-09-21T12:10:37.692 INFO:teuthology.orchestra.run.smithi003.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-21T12:10:37.692 INFO:teuthology.orchestra.run.smithi003.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-21T12:10:37.698 INFO:teuthology.orchestra.run.smithi003.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-21T12:10:37.698 INFO:teuthology.orchestra.run.smithi003.stdout:systemctl: stdout inactive 2024-09-21T12:10:37.705 INFO:teuthology.orchestra.run.smithi003.stdout:systemctl: stdout enabled 2024-09-21T12:10:37.712 INFO:teuthology.orchestra.run.smithi003.stdout:systemctl: stdout active 2024-09-21T12:10:37.712 INFO:teuthology.orchestra.run.smithi003.stdout:Unit chronyd.service is enabled and running 2024-09-21T12:10:37.712 INFO:teuthology.orchestra.run.smithi003.stdout:Host looks OK 2024-09-21T12:10:37.712 INFO:teuthology.orchestra.run.smithi003.stdout:Cluster fsid: 641beec0-7812-11ef-baf6-efdc52797490 2024-09-21T12:10:37.712 INFO:teuthology.orchestra.run.smithi003.stdout:Acquiring lock 140010736539488 on /run/cephadm/641beec0-7812-11ef-baf6-efdc52797490.lock 2024-09-21T12:10:37.712 INFO:teuthology.orchestra.run.smithi003.stdout:Lock 140010736539488 acquired on /run/cephadm/641beec0-7812-11ef-baf6-efdc52797490.lock 2024-09-21T12:10:37.713 INFO:teuthology.orchestra.run.smithi003.stdout:Verifying IP 172.21.15.3 port 3300 ... 2024-09-21T12:10:37.713 INFO:teuthology.orchestra.run.smithi003.stdout:Verifying IP 172.21.15.3 port 6789 ... 2024-09-21T12:10:37.713 INFO:teuthology.orchestra.run.smithi003.stdout:Base mon IP(s) is [172.21.15.3:3300, 172.21.15.3:6789], mon addrv is [v2:172.21.15.3:3300,v1:172.21.15.3:6789] 2024-09-21T12:10:37.718 INFO:teuthology.orchestra.run.smithi003.stdout:/sbin/ip: stdout default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.3 metric 100 2024-09-21T12:10:37.718 INFO:teuthology.orchestra.run.smithi003.stdout:/sbin/ip: stdout 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.3 metric 100 2024-09-21T12:10:37.719 INFO:teuthology.orchestra.run.smithi003.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-21T12:10:37.719 INFO:teuthology.orchestra.run.smithi003.stdout:/sbin/ip: stdout fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-09-21T12:10:37.719 INFO:teuthology.orchestra.run.smithi003.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1792sec hoplimit 64 pref medium 2024-09-21T12:10:37.722 INFO:teuthology.orchestra.run.smithi003.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-21T12:10:37.722 INFO:teuthology.orchestra.run.smithi003.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-21T12:10:37.722 INFO:teuthology.orchestra.run.smithi003.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-21T12:10:37.722 INFO:teuthology.orchestra.run.smithi003.stdout:/sbin/ip: stdout 4: ens1f0: mtu 1500 state UP qlen 1000 2024-09-21T12:10:37.722 INFO:teuthology.orchestra.run.smithi003.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:febd:15dc/64 scope link 2024-09-21T12:10:37.722 INFO:teuthology.orchestra.run.smithi003.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-21T12:10:37.723 INFO:teuthology.orchestra.run.smithi003.stdout:Mon IP `172.21.15.3` is in CIDR network `172.21.0.0/20` 2024-09-21T12:10:37.723 INFO:teuthology.orchestra.run.smithi003.stdout:Mon IP `172.21.15.3` is in CIDR network `172.21.0.0/20` 2024-09-21T12:10:37.723 INFO:teuthology.orchestra.run.smithi003.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-21T12:10:37.723 INFO:teuthology.orchestra.run.smithi003.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-21T12:10:37.724 INFO:teuthology.orchestra.run.smithi003.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:squid... 2024-09-21T12:10:38.186 INFO:teuthology.orchestra.run.smithi003.stdout:/bin/podman: stdout 164465d2334a36ec69b5e540adc75ef73c92a8a0546664850c2173107383597c 2024-09-21T12:10:38.186 INFO:teuthology.orchestra.run.smithi003.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:squid... 2024-09-21T12:10:38.186 INFO:teuthology.orchestra.run.smithi003.stdout:/bin/podman: stderr Getting image source signatures 2024-09-21T12:10:38.187 INFO:teuthology.orchestra.run.smithi003.stdout:/bin/podman: stderr Copying blob sha256:66069d7a5240ff24cb47e5b84cff1b0dd6013e59abb2a061101c2af76e3da9e1 2024-09-21T12:10:38.187 INFO:teuthology.orchestra.run.smithi003.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-21T12:10:38.187 INFO:teuthology.orchestra.run.smithi003.stdout:/bin/podman: stderr Copying config sha256:164465d2334a36ec69b5e540adc75ef73c92a8a0546664850c2173107383597c 2024-09-21T12:10:38.187 INFO:teuthology.orchestra.run.smithi003.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-21T12:10:39.108 INFO:teuthology.orchestra.run.smithi003.stdout:ceph: stdout ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable) 2024-09-21T12:10:39.108 INFO:teuthology.orchestra.run.smithi003.stdout:Ceph version: ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable) 2024-09-21T12:10:39.108 INFO:teuthology.orchestra.run.smithi003.stdout:Extracting ceph user uid/gid from container image... 2024-09-21T12:10:40.105 INFO:teuthology.orchestra.run.smithi003.stdout:stat: stdout 167 167 2024-09-21T12:10:40.106 INFO:teuthology.orchestra.run.smithi003.stdout:Creating initial keys... 2024-09-21T12:10:41.146 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph-authtool: stdout AQDAt+5mpYsRGhAAfMudQ2UrEVDIr3S6rO+oEw== 2024-09-21T12:10:42.151 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph-authtool: stdout AQDBt+5m5HIaHBAAkYcl1Sz5oQkIZvKmA7n3Tw== 2024-09-21T12:10:43.232 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph-authtool: stdout AQDCt+5mvvvtHBAAj0FBEYjV/75aFWqeS728Gg== 2024-09-21T12:10:43.233 INFO:teuthology.orchestra.run.smithi003.stdout:Creating initial monmap... 2024-09-21T12:10:44.164 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-21T12:10:44.164 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-21T12:10:44.164 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 641beec0-7812-11ef-baf6-efdc52797490 2024-09-21T12:10:44.164 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-21T12:10:44.164 INFO:teuthology.orchestra.run.smithi003.stdout:monmaptool for smithi003 [v2:172.21.15.3:3300,v1:172.21.15.3:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-21T12:10:44.164 INFO:teuthology.orchestra.run.smithi003.stdout:setting min_mon_release = quincy 2024-09-21T12:10:44.164 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/monmaptool: set fsid to 641beec0-7812-11ef-baf6-efdc52797490 2024-09-21T12:10:44.164 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-21T12:10:44.164 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:10:44.164 INFO:teuthology.orchestra.run.smithi003.stdout:Creating mon... 2024-09-21T12:10:45.061 INFO:teuthology.orchestra.run.smithi003.stdout:create mon.smithi003 on 2024-09-21T12:10:45.274 INFO:teuthology.orchestra.run.smithi003.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-21T12:10:45.417 INFO:teuthology.orchestra.run.smithi003.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-21T12:10:45.589 INFO:teuthology.orchestra.run.smithi003.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-641beec0-7812-11ef-baf6-efdc52797490.target → /etc/systemd/system/ceph-641beec0-7812-11ef-baf6-efdc52797490.target. 2024-09-21T12:10:45.589 INFO:teuthology.orchestra.run.smithi003.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-641beec0-7812-11ef-baf6-efdc52797490.target → /etc/systemd/system/ceph-641beec0-7812-11ef-baf6-efdc52797490.target. 2024-09-21T12:10:45.833 INFO:teuthology.orchestra.run.smithi003.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-641beec0-7812-11ef-baf6-efdc52797490@mon.smithi003 2024-09-21T12:10:45.833 INFO:teuthology.orchestra.run.smithi003.stdout:systemctl: stderr Failed to reset failed state of unit ceph-641beec0-7812-11ef-baf6-efdc52797490@mon.smithi003.service: Unit ceph-641beec0-7812-11ef-baf6-efdc52797490@mon.smithi003.service not loaded. 2024-09-21T12:10:45.999 INFO:teuthology.orchestra.run.smithi003.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-641beec0-7812-11ef-baf6-efdc52797490.target.wants/ceph-641beec0-7812-11ef-baf6-efdc52797490@mon.smithi003.service → /etc/systemd/system/ceph-641beec0-7812-11ef-baf6-efdc52797490@.service. 2024-09-21T12:10:46.524 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:10:46 smithi003 podman[27658]: 2024-09-21 12:10:46.481891991 +0000 UTC m=+0.361130194 container start f3c4b248c1c5daa44d0b3a904a971ebff9ac82220f4f182b744be2bc505ae947 (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-mon-smithi003, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-4e45e6b, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-21T12:10:46.525 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:10:46 smithi003 ceph-mon[27678]: mkfs 641beec0-7812-11ef-baf6-efdc52797490 2024-09-21T12:10:46.569 INFO:teuthology.orchestra.run.smithi003.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T12:10:46.569 INFO:teuthology.orchestra.run.smithi003.stdout:systemctl: stdout disabled 2024-09-21T12:10:46.576 INFO:teuthology.orchestra.run.smithi003.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T12:10:46.577 INFO:teuthology.orchestra.run.smithi003.stdout:systemctl: stdout inactive 2024-09-21T12:10:46.577 INFO:teuthology.orchestra.run.smithi003.stdout:firewalld.service is not enabled 2024-09-21T12:10:46.577 INFO:teuthology.orchestra.run.smithi003.stdout:Not possible to enable service . firewalld.service is not available 2024-09-21T12:10:46.577 INFO:teuthology.orchestra.run.smithi003.stdout:Waiting for mon to start... 2024-09-21T12:10:46.577 INFO:teuthology.orchestra.run.smithi003.stdout:Waiting for mon... 2024-09-21T12:10:46.792 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:10:46 smithi003 ceph-mon[27678]: mon.smithi003 is new leader, mons smithi003 in quorum (ranks 0) 2024-09-21T12:10:46.792 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:10:46 smithi003 bash[27658]: f3c4b248c1c5daa44d0b3a904a971ebff9ac82220f4f182b744be2bc505ae947 2024-09-21T12:10:46.792 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:10:46 smithi003 systemd[1]: Started Ceph mon.smithi003 for 641beec0-7812-11ef-baf6-efdc52797490. 2024-09-21T12:10:47.557 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout cluster: 2024-09-21T12:10:47.557 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout id: 641beec0-7812-11ef-baf6-efdc52797490 2024-09-21T12:10:47.557 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-21T12:10:47.557 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout 2024-09-21T12:10:47.557 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout services: 2024-09-21T12:10:47.558 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi003 (age 0.540173s) 2024-09-21T12:10:47.558 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-21T12:10:47.558 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-21T12:10:47.558 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout 2024-09-21T12:10:47.558 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout data: 2024-09-21T12:10:47.558 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-21T12:10:47.558 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-21T12:10:47.558 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-21T12:10:47.558 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout pgs: 2024-09-21T12:10:47.558 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout 2024-09-21T12:10:47.558 INFO:teuthology.orchestra.run.smithi003.stdout:mon is available 2024-09-21T12:10:47.558 INFO:teuthology.orchestra.run.smithi003.stdout:Assimilating anything we can from ceph.conf... 2024-09-21T12:10:47.651 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:10:47 smithi003 ceph-mon[27678]: mon.smithi003 is new leader, mons smithi003 in quorum (ranks 0) 2024-09-21T12:10:47.651 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:10:47 smithi003 ceph-mon[27678]: monmap epoch 1 2024-09-21T12:10:47.652 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:10:47 smithi003 ceph-mon[27678]: fsid 641beec0-7812-11ef-baf6-efdc52797490 2024-09-21T12:10:47.652 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:10:47 smithi003 ceph-mon[27678]: last_changed 2024-09-21T12:10:43.597094+0000 2024-09-21T12:10:47.652 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:10:47 smithi003 ceph-mon[27678]: created 2024-09-21T12:10:43.597094+0000 2024-09-21T12:10:47.652 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:10:47 smithi003 ceph-mon[27678]: min_mon_release 19 (squid) 2024-09-21T12:10:47.652 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:10:47 smithi003 ceph-mon[27678]: election_strategy: 1 2024-09-21T12:10:47.652 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:10:47 smithi003 ceph-mon[27678]: 0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.smithi003 2024-09-21T12:10:47.652 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:10:47 smithi003 ceph-mon[27678]: fsmap 2024-09-21T12:10:47.652 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:10:47 smithi003 ceph-mon[27678]: osdmap e1: 0 total, 0 up, 0 in 2024-09-21T12:10:47.652 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:10:47 smithi003 ceph-mon[27678]: mgrmap e1: no daemons active 2024-09-21T12:10:47.652 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:10:47 smithi003 ceph-mon[27678]: from='client.? 172.21.15.3:0/2732060903' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-21T12:10:49.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:10:49 smithi003 ceph-mon[27678]: from='client.? 172.21.15.3:0/1040636442' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-21T12:10:49.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:10:49 smithi003 ceph-mon[27678]: from='client.? 172.21.15.3:0/1040636442' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-21T12:10:55.403 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout 2024-09-21T12:10:55.403 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout [global] 2024-09-21T12:10:55.403 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout fsid = 641beec0-7812-11ef-baf6-efdc52797490 2024-09-21T12:10:55.403 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.3:3300,v1:172.21.15.3:6789] 2024-09-21T12:10:55.403 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-21T12:10:55.403 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-21T12:10:55.403 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-21T12:10:55.403 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-21T12:10:55.404 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout 2024-09-21T12:10:55.404 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-21T12:10:55.404 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-21T12:10:55.404 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout 2024-09-21T12:10:55.404 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout [osd] 2024-09-21T12:10:55.404 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-21T12:10:55.404 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-21T12:10:55.404 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-21T12:10:55.404 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-21T12:10:55.404 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-21T12:10:55.404 INFO:teuthology.orchestra.run.smithi003.stdout:Generating new minimal ceph.conf... 2024-09-21T12:10:58.456 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:10:58 smithi003 ceph-mon[27678]: from='client.? 172.21.15.3:0/686892876' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:10:58.988 INFO:teuthology.orchestra.run.smithi003.stdout:Restarting the monitor... 2024-09-21T12:10:59.272 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:10:59 smithi003 systemd[1]: Stopping Ceph mon.smithi003 for 641beec0-7812-11ef-baf6-efdc52797490... 2024-09-21T12:10:59.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:10:59 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-mon-smithi003[27673]: 2024-09-21T12:10:59.268+0000 7fea26b14640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi003 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T12:10:59.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:10:59 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-mon-smithi003[27673]: 2024-09-21T12:10:59.268+0000 7fea26b14640 -1 mon.smithi003@0(leader) e1 *** Got Signal Terminated *** 2024-09-21T12:10:59.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:10:59 smithi003 podman[27929]: 2024-09-21 12:10:59.454888989 +0000 UTC m=+0.281736412 container died f3c4b248c1c5daa44d0b3a904a971ebff9ac82220f4f182b744be2bc505ae947 (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-mon-smithi003, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-4e45e6b, io.buildah.version=1.37.2) 2024-09-21T12:10:59.980 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:10:59 smithi003 podman[27929]: 2024-09-21 12:10:59.744800206 +0000 UTC m=+0.571647629 container cleanup f3c4b248c1c5daa44d0b3a904a971ebff9ac82220f4f182b744be2bc505ae947 (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-mon-smithi003, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-4e45e6b, org.label-schema.build-date=20240731) 2024-09-21T12:10:59.980 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:10:59 smithi003 bash[27929]: ceph-641beec0-7812-11ef-baf6-efdc52797490-mon-smithi003 2024-09-21T12:11:00.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:10:59 smithi003 podman[27942]: 2024-09-21 12:10:59.978964231 +0000 UTC m=+0.522787588 container remove f3c4b248c1c5daa44d0b3a904a971ebff9ac82220f4f182b744be2bc505ae947 (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-mon-smithi003, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-4e45e6b, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-21T12:11:00.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 systemd[1]: ceph-641beec0-7812-11ef-baf6-efdc52797490@mon.smithi003.service: Deactivated successfully. 2024-09-21T12:11:00.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 systemd[1]: Stopped Ceph mon.smithi003 for 641beec0-7812-11ef-baf6-efdc52797490. 2024-09-21T12:11:00.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 systemd[1]: Starting Ceph mon.smithi003 for 641beec0-7812-11ef-baf6-efdc52797490... 2024-09-21T12:11:00.616 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 podman[28035]: 2024-09-21 12:11:00.329722269 +0000 UTC m=+0.100770933 container create 16bccf2c750392e6587a98d2400bb78eb3896ce56a2f0e9a141b9697643aafd2 (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-mon-smithi003, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-4e45e6b, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD) 2024-09-21T12:11:00.617 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 podman[28035]: 2024-09-21 12:11:00.245422048 +0000 UTC m=+0.016470737 image pull 164465d2334a36ec69b5e540adc75ef73c92a8a0546664850c2173107383597c quay.ceph.io/ceph-ci/ceph:squid 2024-09-21T12:11:00.617 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 podman[28035]: 2024-09-21 12:11:00.540496556 +0000 UTC m=+0.311545237 container init 16bccf2c750392e6587a98d2400bb78eb3896ce56a2f0e9a141b9697643aafd2 (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-mon-smithi003, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=squid-4e45e6b, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-21T12:11:00.617 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 podman[28035]: 2024-09-21 12:11:00.543927786 +0000 UTC m=+0.314976448 container start 16bccf2c750392e6587a98d2400bb78eb3896ce56a2f0e9a141b9697643aafd2 (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-mon-smithi003, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=squid-4e45e6b, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-21T12:11:00.617 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: set uid:gid to 167:167 (ceph:ceph) 2024-09-21T12:11:00.617 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable), process ceph-mon, pid 2 2024-09-21T12:11:00.617 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: pidfile_write: ignore empty --pid-file 2024-09-21T12:11:00.617 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: load: jerasure load: lrc 2024-09-21T12:11:00.617 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: RocksDB version: 7.9.2 2024-09-21T12:11:00.617 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Git sha 0 2024-09-21T12:11:00.617 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Compile date 2024-09-20 20:39:57 2024-09-21T12:11:00.617 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: DB SUMMARY 2024-09-21T12:11:00.617 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: DB Session ID: 4YJQ73V01RM4517VZIX4 2024-09-21T12:11:00.618 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: CURRENT file: CURRENT 2024-09-21T12:11:00.618 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: IDENTITY file: IDENTITY 2024-09-21T12:11:00.618 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-21T12:11:00.618 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi003/store.db dir, Total Num: 1, files: 000008.sst 2024-09-21T12:11:00.618 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi003/store.db: 000009.log size: 95805 ; 2024-09-21T12:11:00.618 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.error_if_exists: 0 2024-09-21T12:11:00.618 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.create_if_missing: 0 2024-09-21T12:11:00.618 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.paranoid_checks: 1 2024-09-21T12:11:00.619 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T12:11:00.619 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T12:11:00.619 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T12:11:00.619 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.env: 0x561ecd32e940 2024-09-21T12:11:00.619 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.fs: PosixFileSystem 2024-09-21T12:11:00.619 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.info_log: 0x561ecf3858c0 2024-09-21T12:11:00.619 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.max_file_opening_threads: 16 2024-09-21T12:11:00.620 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.statistics: (nil) 2024-09-21T12:11:00.620 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.use_fsync: 0 2024-09-21T12:11:00.620 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.max_log_file_size: 0 2024-09-21T12:11:00.620 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T12:11:00.620 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T12:11:00.620 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T12:11:00.620 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T12:11:00.620 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.allow_fallocate: 1 2024-09-21T12:11:00.620 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T12:11:00.620 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T12:11:00.620 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.use_direct_reads: 0 2024-09-21T12:11:00.620 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T12:11:00.620 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T12:11:00.620 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.db_log_dir: 2024-09-21T12:11:00.621 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.wal_dir: 2024-09-21T12:11:00.621 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T12:11:00.621 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T12:11:00.621 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T12:11:00.621 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T12:11:00.621 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T12:11:00.621 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T12:11:00.621 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T12:11:00.621 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T12:11:00.621 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.write_buffer_manager: 0x561ecf394dc0 2024-09-21T12:11:00.621 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T12:11:00.621 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T12:11:00.621 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T12:11:00.621 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T12:11:00.622 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T12:11:00.622 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T12:11:00.622 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T12:11:00.622 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T12:11:00.622 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.unordered_write: 0 2024-09-21T12:11:00.622 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T12:11:00.622 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T12:11:00.622 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T12:11:00.622 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T12:11:00.622 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.row_cache: None 2024-09-21T12:11:00.622 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.wal_filter: None 2024-09-21T12:11:00.622 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T12:11:00.622 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T12:11:00.622 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.two_write_queues: 0 2024-09-21T12:11:00.622 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T12:11:00.623 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.wal_compression: 0 2024-09-21T12:11:00.623 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.atomic_flush: 0 2024-09-21T12:11:00.623 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T12:11:00.623 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T12:11:00.623 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T12:11:00.623 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.log_readahead_size: 0 2024-09-21T12:11:00.623 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T12:11:00.623 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T12:11:00.623 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T12:11:00.623 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T12:11:00.623 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T12:11:00.623 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T12:11:00.623 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T12:11:00.623 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.max_background_jobs: 2 2024-09-21T12:11:00.624 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.max_background_compactions: -1 2024-09-21T12:11:00.624 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.max_subcompactions: 1 2024-09-21T12:11:00.624 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T12:11:00.624 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T12:11:00.624 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T12:11:00.624 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T12:11:00.624 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T12:11:00.624 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T12:11:00.624 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T12:11:00.624 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T12:11:00.624 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.max_open_files: -1 2024-09-21T12:11:00.624 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T12:11:00.624 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T12:11:00.624 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T12:11:00.624 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T12:11:00.624 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.max_background_flushes: -1 2024-09-21T12:11:00.625 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Compression algorithms supported: 2024-09-21T12:11:00.625 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: kZSTD supported: 0 2024-09-21T12:11:00.625 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: kXpressCompression supported: 0 2024-09-21T12:11:00.625 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: kBZip2Compression supported: 0 2024-09-21T12:11:00.625 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T12:11:00.625 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: kLZ4Compression supported: 1 2024-09-21T12:11:00.625 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: kZlibCompression supported: 1 2024-09-21T12:11:00.625 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T12:11:00.625 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: kSnappyCompression supported: 1 2024-09-21T12:11:00.625 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T12:11:00.625 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T12:11:00.625 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi003/store.db/MANIFEST-000010 2024-09-21T12:11:00.625 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T12:11:00.625 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T12:11:00.625 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.merge_operator: 2024-09-21T12:11:00.625 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.compaction_filter: None 2024-09-21T12:11:00.626 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T12:11:00.626 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T12:11:00.626 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T12:11:00.626 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T12:11:00.626 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x561ecf385520) 2024-09-21T12:11:00.626 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: cache_index_and_filter_blocks: 1 2024-09-21T12:11:00.626 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T12:11:00.626 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T12:11:00.626 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: pin_top_level_index_and_filter: 1 2024-09-21T12:11:00.626 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: index_type: 0 2024-09-21T12:11:00.626 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: data_block_index_type: 0 2024-09-21T12:11:00.626 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: index_shortening: 1 2024-09-21T12:11:00.626 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T12:11:00.626 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: checksum: 4 2024-09-21T12:11:00.626 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: no_block_cache: 0 2024-09-21T12:11:00.627 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: block_cache: 0x561ecf3791f0 2024-09-21T12:11:00.627 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: block_cache_name: BinnedLRUCache 2024-09-21T12:11:00.627 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: block_cache_options: 2024-09-21T12:11:00.627 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: capacity : 536870912 2024-09-21T12:11:00.627 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: num_shard_bits : 4 2024-09-21T12:11:00.627 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: strict_capacity_limit : 0 2024-09-21T12:11:00.627 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: high_pri_pool_ratio: 0.000 2024-09-21T12:11:00.627 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: block_cache_compressed: (nil) 2024-09-21T12:11:00.627 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: persistent_cache: (nil) 2024-09-21T12:11:00.627 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: block_size: 4096 2024-09-21T12:11:00.627 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: block_size_deviation: 10 2024-09-21T12:11:00.627 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: block_restart_interval: 16 2024-09-21T12:11:00.627 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: index_block_restart_interval: 1 2024-09-21T12:11:00.627 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: metadata_block_size: 4096 2024-09-21T12:11:00.627 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: partition_filters: 0 2024-09-21T12:11:00.628 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: use_delta_encoding: 1 2024-09-21T12:11:00.628 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: filter_policy: bloomfilter 2024-09-21T12:11:00.628 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: whole_key_filtering: 1 2024-09-21T12:11:00.628 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: verify_compression: 0 2024-09-21T12:11:00.628 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: read_amp_bytes_per_bit: 0 2024-09-21T12:11:00.628 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: format_version: 5 2024-09-21T12:11:00.628 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: enable_index_compression: 1 2024-09-21T12:11:00.628 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: block_align: 0 2024-09-21T12:11:00.628 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: max_auto_readahead_size: 262144 2024-09-21T12:11:00.628 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: prepopulate_block_cache: 0 2024-09-21T12:11:00.628 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: initial_auto_readahead_size: 8192 2024-09-21T12:11:00.628 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T12:11:00.628 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T12:11:00.628 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T12:11:00.628 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.compression: NoCompression 2024-09-21T12:11:00.628 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T12:11:00.628 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T12:11:00.629 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T12:11:00.629 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.num_levels: 7 2024-09-21T12:11:00.629 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T12:11:00.629 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T12:11:00.629 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T12:11:00.629 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T12:11:00.629 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T12:11:00.629 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T12:11:00.629 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T12:11:00.629 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T12:11:00.629 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T12:11:00.629 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T12:11:00.629 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T12:11:00.629 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T12:11:00.629 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T12:11:00.629 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T12:11:00.630 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T12:11:00.630 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T12:11:00.630 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T12:11:00.630 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T12:11:00.630 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T12:11:00.630 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T12:11:00.630 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T12:11:00.630 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T12:11:00.630 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T12:11:00.630 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T12:11:00.630 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T12:11:00.630 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T12:11:00.630 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T12:11:00.630 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T12:11:00.631 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T12:11:00.631 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T12:11:00.631 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T12:11:00.631 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T12:11:00.631 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T12:11:00.631 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T12:11:00.631 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T12:11:00.631 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T12:11:00.631 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T12:11:00.631 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T12:11:00.631 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T12:11:00.631 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T12:11:00.631 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T12:11:00.631 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T12:11:00.631 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T12:11:00.631 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T12:11:00.632 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T12:11:00.632 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T12:11:00.632 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T12:11:00.632 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T12:11:00.632 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T12:11:00.632 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T12:11:00.632 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T12:11:00.632 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T12:11:00.632 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T12:11:00.632 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T12:11:00.632 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.inplace_update_support: 0 2024-09-21T12:11:00.632 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T12:11:00.632 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T12:11:00.632 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T12:11:00.632 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T12:11:00.632 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.bloom_locality: 0 2024-09-21T12:11:00.633 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.max_successive_merges: 0 2024-09-21T12:11:00.633 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T12:11:00.633 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T12:11:00.633 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T12:11:00.633 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T12:11:00.633 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.ttl: 2592000 2024-09-21T12:11:00.634 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T12:11:00.634 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T12:11:00.634 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T12:11:00.634 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.enable_blob_files: false 2024-09-21T12:11:00.634 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.min_blob_size: 0 2024-09-21T12:11:00.634 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T12:11:00.634 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T12:11:00.634 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T12:11:00.634 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T12:11:00.634 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T12:11:00.634 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T12:11:00.634 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T12:11:00.634 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T12:11:00.634 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi003/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-21T12:11:00.634 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-21T12:11:00.635 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: ec369571-99e7-4e17-9471-686f26b91b98 2024-09-21T12:11:00.635 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726920660571567, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-21T12:11:00.635 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-21T12:11:00.635 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726920660572514, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 91806, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 288, "table_properties": {"data_size": 89847, "index_size": 279, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 11912, "raw_average_key_size": 48, "raw_value_size": 83215, "raw_average_value_size": 336, "num_data_blocks": 12, "num_entries": 247, "num_filter_entries": 247, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726920660, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "ec369571-99e7-4e17-9471-686f26b91b98", "db_session_id": "4YJQ73V01RM4517VZIX4", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-21T12:11:00.635 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726920660572612, "job": 1, "event": "recovery_finished"} 2024-09-21T12:11:00.635 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-21T12:11:00.635 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi003/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T12:11:00.635 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x561ecf3a6e00 2024-09-21T12:11:00.635 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: DB pointer 0x561ecf4a2000 2024-09-21T12:11:00.635 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T12:11:00.635 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T12:11:00.635 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: ** DB Stats ** 2024-09-21T12:11:00.635 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T12:11:00.635 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T12:11:00.635 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T12:11:00.635 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T12:11:00.636 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T12:11:00.636 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T12:11:00.636 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T12:11:00.636 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: 2024-09-21T12:11:00.636 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: ** Compaction Stats [default] ** 2024-09-21T12:11:00.636 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T12:11:00.636 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T12:11:00.636 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: L0 2/0 91.55 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 149.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T12:11:00.636 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: Sum 2/0 91.55 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 149.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T12:11:00.636 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 149.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T12:11:00.636 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: 2024-09-21T12:11:00.636 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: ** Compaction Stats [default] ** 2024-09-21T12:11:00.636 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T12:11:00.636 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T12:11:00.636 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 149.7 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T12:11:00.636 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: 2024-09-21T12:11:00.637 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T12:11:00.637 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: 2024-09-21T12:11:00.637 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T12:11:00.637 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-21T12:11:00.637 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T12:11:00.637 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T12:11:00.637 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T12:11:00.637 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T12:11:00.637 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: Cumulative compaction: 0.00 GB write, 27.98 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T12:11:00.637 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: Interval compaction: 0.00 GB write, 27.98 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T12:11:00.637 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T12:11:00.637 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: Block cache BinnedLRUCache@0x561ecf3791f0#2 capacity: 512.00 MB usage: 1.30 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-21T12:11:00.637 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.83 KB,0.000157952%) IndexBlock(2,0.47 KB,8.9407e-05%) Misc(1,0.00 KB,0%) 2024-09-21T12:11:00.637 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: 2024-09-21T12:11:00.637 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T12:11:00.638 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: starting mon.smithi003 rank 0 at public addrs [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] at bind addrs [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi003 fsid 641beec0-7812-11ef-baf6-efdc52797490 2024-09-21T12:11:00.638 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: mon.smithi003@-1(???) e1 preinit fsid 641beec0-7812-11ef-baf6-efdc52797490 2024-09-21T12:11:00.638 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: mon.smithi003@-1(???).mds e1 new map 2024-09-21T12:11:00.638 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: mon.smithi003@-1(???).mds e1 print_map 2024-09-21T12:11:00.638 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: e1 2024-09-21T12:11:00.638 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: btime 2024-09-21T12:10:46:519886+0000 2024-09-21T12:11:00.638 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T12:11:00.638 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:11:00.638 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: legacy client fscid: -1 2024-09-21T12:11:00.638 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: 2024-09-21T12:11:00.638 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: No filesystems configured 2024-09-21T12:11:00.638 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: mon.smithi003@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-21T12:11:00.638 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: mon.smithi003@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T12:11:00.638 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: mon.smithi003@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T12:11:00.639 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: mon.smithi003@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T12:11:00.639 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: mon.smithi003@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-21T12:11:00.639 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 bash[28035]: 16bccf2c750392e6587a98d2400bb78eb3896ce56a2f0e9a141b9697643aafd2 2024-09-21T12:11:00.639 INFO:teuthology.orchestra.run.smithi003.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-21T12:11:00.867 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 systemd[1]: Started Ceph mon.smithi003 for 641beec0-7812-11ef-baf6-efdc52797490. 2024-09-21T12:11:00.867 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: mon.smithi003 is new leader, mons smithi003 in quorum (ranks 0) 2024-09-21T12:11:00.868 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: monmap epoch 1 2024-09-21T12:11:00.868 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: fsid 641beec0-7812-11ef-baf6-efdc52797490 2024-09-21T12:11:00.868 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: last_changed 2024-09-21T12:10:43.597094+0000 2024-09-21T12:11:00.868 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: created 2024-09-21T12:10:43.597094+0000 2024-09-21T12:11:00.868 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: min_mon_release 19 (squid) 2024-09-21T12:11:00.868 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: election_strategy: 1 2024-09-21T12:11:00.868 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: 0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.smithi003 2024-09-21T12:11:00.868 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: fsmap 2024-09-21T12:11:00.868 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: osdmap e1: 0 total, 0 up, 0 in 2024-09-21T12:11:00.868 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:00 smithi003 ceph-mon[28057]: mgrmap e1: no daemons active 2024-09-21T12:11:01.818 INFO:teuthology.orchestra.run.smithi003.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-21T12:11:01.839 INFO:teuthology.orchestra.run.smithi003.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-21T12:11:01.839 INFO:teuthology.orchestra.run.smithi003.stdout:Creating mgr... 2024-09-21T12:11:01.839 INFO:teuthology.orchestra.run.smithi003.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-21T12:11:01.840 INFO:teuthology.orchestra.run.smithi003.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-21T12:11:01.840 INFO:teuthology.orchestra.run.smithi003.stdout:Verifying port 0.0.0.0:8443 ... 2024-09-21T12:11:02.094 INFO:teuthology.orchestra.run.smithi003.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-641beec0-7812-11ef-baf6-efdc52797490@mgr.smithi003.wztftl 2024-09-21T12:11:02.094 INFO:teuthology.orchestra.run.smithi003.stdout:systemctl: stderr Failed to reset failed state of unit ceph-641beec0-7812-11ef-baf6-efdc52797490@mgr.smithi003.wztftl.service: Unit ceph-641beec0-7812-11ef-baf6-efdc52797490@mgr.smithi003.wztftl.service not loaded. 2024-09-21T12:11:02.244 INFO:teuthology.orchestra.run.smithi003.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-641beec0-7812-11ef-baf6-efdc52797490.target.wants/ceph-641beec0-7812-11ef-baf6-efdc52797490@mgr.smithi003.wztftl.service → /etc/systemd/system/ceph-641beec0-7812-11ef-baf6-efdc52797490@.service. 2024-09-21T12:11:02.476 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:02 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/722684634' entity='client.admin' 2024-09-21T12:11:02.788 INFO:teuthology.orchestra.run.smithi003.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T12:11:02.788 INFO:teuthology.orchestra.run.smithi003.stdout:systemctl: stdout disabled 2024-09-21T12:11:02.797 INFO:teuthology.orchestra.run.smithi003.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T12:11:02.797 INFO:teuthology.orchestra.run.smithi003.stdout:systemctl: stdout inactive 2024-09-21T12:11:02.797 INFO:teuthology.orchestra.run.smithi003.stdout:firewalld.service is not enabled 2024-09-21T12:11:02.797 INFO:teuthology.orchestra.run.smithi003.stdout:Not possible to enable service . firewalld.service is not available 2024-09-21T12:11:02.808 INFO:teuthology.orchestra.run.smithi003.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T12:11:02.808 INFO:teuthology.orchestra.run.smithi003.stdout:systemctl: stdout disabled 2024-09-21T12:11:02.817 INFO:teuthology.orchestra.run.smithi003.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T12:11:02.817 INFO:teuthology.orchestra.run.smithi003.stdout:systemctl: stdout inactive 2024-09-21T12:11:02.817 INFO:teuthology.orchestra.run.smithi003.stdout:firewalld.service is not enabled 2024-09-21T12:11:02.817 INFO:teuthology.orchestra.run.smithi003.stdout:Not possible to open ports <[9283, 8765, 8443]>. firewalld.service is not available 2024-09-21T12:11:02.817 INFO:teuthology.orchestra.run.smithi003.stdout:Waiting for mgr to start... 2024-09-21T12:11:02.817 INFO:teuthology.orchestra.run.smithi003.stdout:Waiting for mgr... 2024-09-21T12:11:03.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:03 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/421454083' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-21T12:11:05.339 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout 2024-09-21T12:11:05.339 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout { 2024-09-21T12:11:05.339 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "fsid": "641beec0-7812-11ef-baf6-efdc52797490", 2024-09-21T12:11:05.339 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T12:11:05.339 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T12:11:05.339 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T12:11:05.339 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T12:11:05.339 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout }, 2024-09-21T12:11:05.339 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T12:11:05.339 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T12:11:05.339 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout 0 2024-09-21T12:11:05.340 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout ], 2024-09-21T12:11:05.340 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T12:11:05.340 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "smithi003" 2024-09-21T12:11:05.340 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout ], 2024-09-21T12:11:05.340 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-21T12:11:05.340 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T12:11:05.340 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T12:11:05.340 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T12:11:05.340 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T12:11:05.340 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout }, 2024-09-21T12:11:05.340 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T12:11:05.340 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T12:11:05.340 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T12:11:05.340 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T12:11:05.341 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T12:11:05.341 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T12:11:05.341 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T12:11:05.341 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T12:11:05.344 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout }, 2024-09-21T12:11:05.344 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T12:11:05.344 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T12:11:05.344 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T12:11:05.344 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T12:11:05.344 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T12:11:05.344 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T12:11:05.344 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T12:11:05.344 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T12:11:05.344 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T12:11:05.344 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout }, 2024-09-21T12:11:05.344 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T12:11:05.345 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T12:11:05.345 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T12:10:46:519886+0000", 2024-09-21T12:11:05.345 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T12:11:05.345 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T12:11:05.345 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout }, 2024-09-21T12:11:05.345 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T12:11:05.345 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-21T12:11:05.345 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T12:11:05.345 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T12:11:05.345 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T12:11:05.345 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T12:11:05.345 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T12:11:05.345 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout ], 2024-09-21T12:11:05.345 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T12:11:05.345 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout }, 2024-09-21T12:11:05.345 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T12:11:05.346 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T12:11:05.346 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T12:10:46.520538+0000", 2024-09-21T12:11:05.346 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T12:11:05.346 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout }, 2024-09-21T12:11:05.346 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T12:11:05.346 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout } 2024-09-21T12:11:05.346 INFO:teuthology.orchestra.run.smithi003.stdout:mgr not available, waiting (1/15)... 2024-09-21T12:11:08.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:07 smithi003 ceph-mon[28057]: Activating manager daemon smithi003.wztftl 2024-09-21T12:11:08.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:07 smithi003 ceph-mon[28057]: mgrmap e2: smithi003.wztftl(active, starting, since 0.00370182s) 2024-09-21T12:11:08.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:07 smithi003 ceph-mon[28057]: from='mgr.14100 172.21.15.3:0/2275166989' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-21T12:11:08.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:07 smithi003 ceph-mon[28057]: from='mgr.14100 172.21.15.3:0/2275166989' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-21T12:11:08.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:07 smithi003 ceph-mon[28057]: from='mgr.14100 172.21.15.3:0/2275166989' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-21T12:11:08.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:07 smithi003 ceph-mon[28057]: from='mgr.14100 172.21.15.3:0/2275166989' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mon metadata", "id": "smithi003"}]: dispatch 2024-09-21T12:11:08.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:07 smithi003 ceph-mon[28057]: from='mgr.14100 172.21.15.3:0/2275166989' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mgr metadata", "who": "smithi003.wztftl", "id": "smithi003.wztftl"}]: dispatch 2024-09-21T12:11:08.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:07 smithi003 ceph-mon[28057]: Manager daemon smithi003.wztftl is now available 2024-09-21T12:11:08.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:07 smithi003 ceph-mon[28057]: from='mgr.14100 172.21.15.3:0/2275166989' entity='mgr.smithi003.wztftl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi003.wztftl/mirror_snapshot_schedule"}]: dispatch 2024-09-21T12:11:08.081 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:07 smithi003 ceph-mon[28057]: from='mgr.14100 172.21.15.3:0/2275166989' entity='mgr.smithi003.wztftl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi003.wztftl/trash_purge_schedule"}]: dispatch 2024-09-21T12:11:08.081 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:07 smithi003 ceph-mon[28057]: from='mgr.14100 172.21.15.3:0/2275166989' entity='mgr.smithi003.wztftl' 2024-09-21T12:11:08.081 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:07 smithi003 ceph-mon[28057]: from='mgr.14100 172.21.15.3:0/2275166989' entity='mgr.smithi003.wztftl' 2024-09-21T12:11:08.081 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:07 smithi003 ceph-mon[28057]: from='mgr.14100 172.21.15.3:0/2275166989' entity='mgr.smithi003.wztftl' 2024-09-21T12:11:08.445 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout 2024-09-21T12:11:08.445 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout { 2024-09-21T12:11:08.445 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "fsid": "641beec0-7812-11ef-baf6-efdc52797490", 2024-09-21T12:11:08.446 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T12:11:08.446 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T12:11:08.446 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T12:11:08.446 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T12:11:08.446 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout }, 2024-09-21T12:11:08.446 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T12:11:08.446 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T12:11:08.446 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout 0 2024-09-21T12:11:08.446 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout ], 2024-09-21T12:11:08.446 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T12:11:08.446 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "smithi003" 2024-09-21T12:11:08.446 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout ], 2024-09-21T12:11:08.446 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "quorum_age": 7, 2024-09-21T12:11:08.446 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T12:11:08.446 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T12:11:08.447 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T12:11:08.447 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T12:11:08.447 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout }, 2024-09-21T12:11:08.447 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T12:11:08.447 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T12:11:08.447 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T12:11:08.447 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T12:11:08.447 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T12:11:08.447 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T12:11:08.447 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T12:11:08.447 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T12:11:08.450 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout }, 2024-09-21T12:11:08.450 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T12:11:08.450 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T12:11:08.450 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T12:11:08.451 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T12:11:08.451 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T12:11:08.451 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T12:11:08.451 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T12:11:08.451 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T12:11:08.451 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T12:11:08.451 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout }, 2024-09-21T12:11:08.451 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T12:11:08.451 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T12:11:08.451 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T12:10:46:519886+0000", 2024-09-21T12:11:08.451 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T12:11:08.451 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T12:11:08.451 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout }, 2024-09-21T12:11:08.451 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T12:11:08.451 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-21T12:11:08.452 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T12:11:08.452 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T12:11:08.452 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T12:11:08.452 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T12:11:08.452 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T12:11:08.452 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout ], 2024-09-21T12:11:08.452 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T12:11:08.452 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout }, 2024-09-21T12:11:08.452 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T12:11:08.452 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T12:11:08.452 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T12:10:46.520538+0000", 2024-09-21T12:11:08.452 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T12:11:08.452 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout }, 2024-09-21T12:11:08.452 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T12:11:08.452 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout } 2024-09-21T12:11:08.452 INFO:teuthology.orchestra.run.smithi003.stdout:mgr not available, waiting (2/15)... 2024-09-21T12:11:09.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:08 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/2173395028' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-21T12:11:09.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:08 smithi003 ceph-mon[28057]: mgrmap e3: smithi003.wztftl(active, since 1.00779s) 2024-09-21T12:11:11.267 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:10 smithi003 ceph-mon[28057]: mgrmap e4: smithi003.wztftl(active, since 2s) 2024-09-21T12:11:11.751 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout 2024-09-21T12:11:11.751 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout { 2024-09-21T12:11:11.751 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "fsid": "641beec0-7812-11ef-baf6-efdc52797490", 2024-09-21T12:11:11.751 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "health": { 2024-09-21T12:11:11.751 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-21T12:11:11.751 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-21T12:11:11.751 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-21T12:11:11.751 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout }, 2024-09-21T12:11:11.751 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-21T12:11:11.751 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-21T12:11:11.751 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout 0 2024-09-21T12:11:11.751 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout ], 2024-09-21T12:11:11.752 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-21T12:11:11.752 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "smithi003" 2024-09-21T12:11:11.752 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout ], 2024-09-21T12:11:11.752 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "quorum_age": 10, 2024-09-21T12:11:11.752 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-21T12:11:11.752 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T12:11:11.752 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-21T12:11:11.752 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-21T12:11:11.752 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout }, 2024-09-21T12:11:11.752 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-21T12:11:11.752 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T12:11:11.752 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-21T12:11:11.752 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-21T12:11:11.752 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-21T12:11:11.752 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-21T12:11:11.753 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-21T12:11:11.753 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-21T12:11:11.756 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout }, 2024-09-21T12:11:11.756 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-21T12:11:11.756 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-21T12:11:11.756 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-21T12:11:11.756 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-21T12:11:11.756 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-21T12:11:11.756 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-21T12:11:11.756 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-21T12:11:11.756 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-21T12:11:11.756 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-21T12:11:11.756 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout }, 2024-09-21T12:11:11.756 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-21T12:11:11.757 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T12:11:11.757 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "btime": "2024-09-21T12:10:46:519886+0000", 2024-09-21T12:11:11.757 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-21T12:11:11.757 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-21T12:11:11.757 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout }, 2024-09-21T12:11:11.757 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-21T12:11:11.757 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T12:11:11.757 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-21T12:11:11.757 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-21T12:11:11.757 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-21T12:11:11.757 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-21T12:11:11.757 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "restful" 2024-09-21T12:11:11.757 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout ], 2024-09-21T12:11:11.757 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T12:11:11.757 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout }, 2024-09-21T12:11:11.758 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-21T12:11:11.758 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-21T12:11:11.758 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "modified": "2024-09-21T12:10:46.520538+0000", 2024-09-21T12:11:11.758 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-21T12:11:11.758 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout }, 2024-09-21T12:11:11.758 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-21T12:11:11.758 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout } 2024-09-21T12:11:11.758 INFO:teuthology.orchestra.run.smithi003.stdout:mgr is available 2024-09-21T12:11:11.972 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:11 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/2132281084' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-21T12:11:12.881 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout 2024-09-21T12:11:12.882 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout [global] 2024-09-21T12:11:12.882 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout fsid = 641beec0-7812-11ef-baf6-efdc52797490 2024-09-21T12:11:12.882 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.3:3300,v1:172.21.15.3:6789] 2024-09-21T12:11:12.882 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-21T12:11:12.882 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-21T12:11:12.882 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-21T12:11:12.882 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-21T12:11:12.882 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout 2024-09-21T12:11:12.882 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-21T12:11:12.882 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-21T12:11:12.882 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout 2024-09-21T12:11:12.882 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout [osd] 2024-09-21T12:11:12.882 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-21T12:11:12.883 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-21T12:11:12.883 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-21T12:11:12.883 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-21T12:11:12.883 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-21T12:11:12.883 INFO:teuthology.orchestra.run.smithi003.stdout:Enabling cephadm module... 2024-09-21T12:11:12.995 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:12 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/2418114036' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-21T12:11:14.166 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:13 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/3693179387' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-21T12:11:15.067 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:14 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/3693179387' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-21T12:11:15.068 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:14 smithi003 ceph-mon[28057]: mgrmap e5: smithi003.wztftl(active, since 6s) 2024-09-21T12:11:15.560 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout { 2024-09-21T12:11:15.560 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-21T12:11:15.560 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T12:11:15.560 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "active_name": "smithi003.wztftl", 2024-09-21T12:11:15.560 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-21T12:11:15.560 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout } 2024-09-21T12:11:15.561 INFO:teuthology.orchestra.run.smithi003.stdout:Waiting for the mgr to restart... 2024-09-21T12:11:15.561 INFO:teuthology.orchestra.run.smithi003.stdout:Waiting for mgr epoch 5... 2024-09-21T12:11:16.130 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:15 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/3897629777' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-21T12:11:19.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:18 smithi003 ceph-mon[28057]: Active manager daemon smithi003.wztftl restarted 2024-09-21T12:11:19.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:18 smithi003 ceph-mon[28057]: Activating manager daemon smithi003.wztftl 2024-09-21T12:11:19.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:18 smithi003 ceph-mon[28057]: osdmap e2: 0 total, 0 up, 0 in 2024-09-21T12:11:19.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:18 smithi003 ceph-mon[28057]: mgrmap e6: smithi003.wztftl(active, starting, since 0.00362745s) 2024-09-21T12:11:19.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:18 smithi003 ceph-mon[28057]: from='mgr.14118 172.21.15.3:0/394555530' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mon metadata", "id": "smithi003"}]: dispatch 2024-09-21T12:11:19.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:18 smithi003 ceph-mon[28057]: from='mgr.14118 172.21.15.3:0/394555530' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mgr metadata", "who": "smithi003.wztftl", "id": "smithi003.wztftl"}]: dispatch 2024-09-21T12:11:19.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:18 smithi003 ceph-mon[28057]: from='mgr.14118 172.21.15.3:0/394555530' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-21T12:11:19.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:18 smithi003 ceph-mon[28057]: from='mgr.14118 172.21.15.3:0/394555530' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-21T12:11:19.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:18 smithi003 ceph-mon[28057]: from='mgr.14118 172.21.15.3:0/394555530' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-21T12:11:19.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:18 smithi003 ceph-mon[28057]: Manager daemon smithi003.wztftl is now available 2024-09-21T12:11:19.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:18 smithi003 ceph-mon[28057]: from='mgr.14118 172.21.15.3:0/394555530' entity='mgr.smithi003.wztftl' 2024-09-21T12:11:19.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:18 smithi003 ceph-mon[28057]: from='mgr.14118 172.21.15.3:0/394555530' entity='mgr.smithi003.wztftl' 2024-09-21T12:11:19.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:18 smithi003 ceph-mon[28057]: from='mgr.14118 172.21.15.3:0/394555530' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:11:19.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:18 smithi003 ceph-mon[28057]: from='mgr.14118 172.21.15.3:0/394555530' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:11:19.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:18 smithi003 ceph-mon[28057]: from='mgr.14118 172.21.15.3:0/394555530' entity='mgr.smithi003.wztftl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi003.wztftl/mirror_snapshot_schedule"}]: dispatch 2024-09-21T12:11:19.331 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:18 smithi003 ceph-mon[28057]: from='mgr.14118 172.21.15.3:0/394555530' entity='mgr.smithi003.wztftl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi003.wztftl/trash_purge_schedule"}]: dispatch 2024-09-21T12:11:20.440 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout { 2024-09-21T12:11:20.440 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-21T12:11:20.440 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-21T12:11:20.440 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout } 2024-09-21T12:11:20.440 INFO:teuthology.orchestra.run.smithi003.stdout:mgr epoch 5 is available 2024-09-21T12:11:20.440 INFO:teuthology.orchestra.run.smithi003.stdout:Setting orchestrator backend to cephadm... 2024-09-21T12:11:20.756 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:20 smithi003 ceph-mon[28057]: from='mgr.14118 172.21.15.3:0/394555530' entity='mgr.smithi003.wztftl' 2024-09-21T12:11:20.756 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:20 smithi003 ceph-mon[28057]: from='mgr.14118 172.21.15.3:0/394555530' entity='mgr.smithi003.wztftl' 2024-09-21T12:11:20.757 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:20 smithi003 ceph-mon[28057]: mgrmap e7: smithi003.wztftl(active, since 1.00708s) 2024-09-21T12:11:21.652 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:21 smithi003 ceph-mon[28057]: from='mgr.14118 172.21.15.3:0/394555530' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:11:21.652 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:21 smithi003 ceph-mon[28057]: from='mgr.14118 172.21.15.3:0/394555530' entity='mgr.smithi003.wztftl' 2024-09-21T12:11:21.652 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:21 smithi003 ceph-mon[28057]: from='mgr.14118 172.21.15.3:0/394555530' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:11:22.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:22 smithi003 ceph-mon[28057]: mgrmap e8: smithi003.wztftl(active, since 2s) 2024-09-21T12:11:22.852 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-21T12:11:22.852 INFO:teuthology.orchestra.run.smithi003.stdout:Generating ssh key... 2024-09-21T12:11:24.722 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:24 smithi003 ceph-mon[28057]: from='mgr.14118 172.21.15.3:0/394555530' entity='mgr.smithi003.wztftl' 2024-09-21T12:11:24.722 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:24 smithi003 ceph-mon[28057]: from='mgr.14118 172.21.15.3:0/394555530' entity='mgr.smithi003.wztftl' 2024-09-21T12:11:25.289 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCzOdmRgBhdWXfpZhcljhjz9So7MXp4Vuy3G5dQHXlQ1gfnEh/P4CZ3sXtZnHcfkfL0S7taDkv3SFvBq8AoHnGIcmGdz07afG5t964ozih7D78BtBblO7pKVDD87/6hoaUufb7tonMbIgJqW1pI/IKfWliYi5C11be8tt3zIayA1mtuv9/GKVrE8lnPlyVGZW/bpc7+syqy8IiWcB0JXXI15wKNWBfkMZw6xai/MNzbYAKG8onwnC4nfT2EWZmh1m1s5P6WX7g9Tcp62Re6X5Ql2UbXiEfSkHKnneeCke7SHDnW7Ktg2tWu8Qd4iHCjK1MDf+MBr5kx0ZeTgZOXxYkTqYeONmrU18alvRkj87osPCg6e6AwnUTD22JWeW/4tcqJ7OVbo/4Vv3XZkBTX7VgWzN+9i3QwEtyRQxUhJaADZ16GAh1ebpY7mww3sVs5cTzOs4fa+RXhrdp5zm2/5e7kTmwuRzGbPPTM9HYVPdPRCakAc7zTJJOAbiEh1/Rbaqs= ceph-641beec0-7812-11ef-baf6-efdc52797490 2024-09-21T12:11:25.290 INFO:teuthology.orchestra.run.smithi003.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-21T12:11:25.290 INFO:teuthology.orchestra.run.smithi003.stdout:Adding key to root@localhost authorized_keys... 2024-09-21T12:11:25.302 INFO:teuthology.orchestra.run.smithi003.stdout:Adding host smithi003... 2024-09-21T12:11:25.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:25 smithi003 ceph-mon[28057]: Found migration_current of "None". Setting to last migration. 2024-09-21T12:11:25.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:25 smithi003 ceph-mon[28057]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-21T12:11:25.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:25 smithi003 ceph-mon[28057]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-21T12:11:25.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:25 smithi003 ceph-mon[28057]: [21/Sep/2024:12:11:20] ENGINE Bus STARTING 2024-09-21T12:11:25.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:25 smithi003 ceph-mon[28057]: [21/Sep/2024:12:11:20] ENGINE Serving on http://172.21.15.3:8765 2024-09-21T12:11:25.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:25 smithi003 ceph-mon[28057]: [21/Sep/2024:12:11:20] ENGINE Serving on https://172.21.15.3:7150 2024-09-21T12:11:25.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:25 smithi003 ceph-mon[28057]: [21/Sep/2024:12:11:20] ENGINE Bus STARTED 2024-09-21T12:11:25.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:25 smithi003 ceph-mon[28057]: [21/Sep/2024:12:11:20] ENGINE Error in HTTPServer.serve 2024-09-21T12:11:25.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: Traceback (most recent call last): 2024-09-21T12:11:25.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T12:11:25.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: self._connections.run(self.expiration_interval) 2024-09-21T12:11:25.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T12:11:25.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: self._run(expiration_interval) 2024-09-21T12:11:25.831 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T12:11:25.831 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T12:11:25.831 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T12:11:25.831 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T12:11:25.831 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T12:11:25.831 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: s = self.context.wrap_socket( 2024-09-21T12:11:25.831 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T12:11:25.831 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: return self.sslsocket_class._create( 2024-09-21T12:11:25.831 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T12:11:25.831 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: self.do_handshake() 2024-09-21T12:11:25.831 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T12:11:25.831 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: self._sslobj.do_handshake() 2024-09-21T12:11:25.831 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T12:11:25.831 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:25 smithi003 ceph-mon[28057]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:11:25.831 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:25 smithi003 ceph-mon[28057]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:11:25.832 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:25 smithi003 ceph-mon[28057]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:11:25.832 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:25 smithi003 ceph-mon[28057]: Generating ssh key... 2024-09-21T12:11:25.832 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:25 smithi003 ceph-mon[28057]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:11:26.914 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:26 smithi003 ceph-mon[28057]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi003", "addr": "172.21.15.3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:11:27.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:27 smithi003 ceph-mon[28057]: Deploying cephadm binary to smithi003 2024-09-21T12:11:30.355 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout Added host 'smithi003' with addr '172.21.15.3' 2024-09-21T12:11:30.355 INFO:teuthology.orchestra.run.smithi003.stdout:Deploying mon service with default placement... 2024-09-21T12:11:30.958 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:30 smithi003 ceph-mon[28057]: from='mgr.14118 172.21.15.3:0/394555530' entity='mgr.smithi003.wztftl' 2024-09-21T12:11:30.958 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:30 smithi003 ceph-mon[28057]: Added host smithi003 2024-09-21T12:11:30.958 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:30 smithi003 ceph-mon[28057]: from='mgr.14118 172.21.15.3:0/394555530' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:11:31.731 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-21T12:11:31.731 INFO:teuthology.orchestra.run.smithi003.stdout:Deploying mgr service with default placement... 2024-09-21T12:11:32.023 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:31 smithi003 ceph-mon[28057]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:11:32.024 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:31 smithi003 ceph-mon[28057]: Saving service mon spec with placement count:5 2024-09-21T12:11:32.024 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:31 smithi003 ceph-mon[28057]: from='mgr.14118 172.21.15.3:0/394555530' entity='mgr.smithi003.wztftl' 2024-09-21T12:11:33.300 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-21T12:11:33.300 INFO:teuthology.orchestra.run.smithi003.stdout:Deploying crash service with default placement... 2024-09-21T12:11:33.944 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:33 smithi003 ceph-mon[28057]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:11:33.944 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:33 smithi003 ceph-mon[28057]: Saving service mgr spec with placement count:2 2024-09-21T12:11:33.944 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:33 smithi003 ceph-mon[28057]: from='mgr.14118 172.21.15.3:0/394555530' entity='mgr.smithi003.wztftl' 2024-09-21T12:11:34.781 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:34 smithi003 ceph-mon[28057]: from='mgr.14118 172.21.15.3:0/394555530' entity='mgr.smithi003.wztftl' 2024-09-21T12:11:34.782 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:34 smithi003 ceph-mon[28057]: from='mgr.14118 172.21.15.3:0/394555530' entity='mgr.smithi003.wztftl' 2024-09-21T12:11:34.782 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:34 smithi003 ceph-mon[28057]: from='mgr.14118 172.21.15.3:0/394555530' entity='mgr.smithi003.wztftl' 2024-09-21T12:11:34.783 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2024-09-21T12:11:34.783 INFO:teuthology.orchestra.run.smithi003.stdout:Deploying ceph-exporter service with default placement... 2024-09-21T12:11:36.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:35 smithi003 ceph-mon[28057]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:11:36.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:35 smithi003 ceph-mon[28057]: Saving service crash spec with placement * 2024-09-21T12:11:36.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:35 smithi003 ceph-mon[28057]: from='mgr.14118 172.21.15.3:0/394555530' entity='mgr.smithi003.wztftl' 2024-09-21T12:11:36.109 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout Scheduled ceph-exporter update... 2024-09-21T12:11:36.109 INFO:teuthology.orchestra.run.smithi003.stdout:Deploying prometheus service with default placement... 2024-09-21T12:11:36.727 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:36 smithi003 ceph-mon[28057]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "ceph-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:11:36.727 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:36 smithi003 ceph-mon[28057]: Saving service ceph-exporter spec with placement * 2024-09-21T12:11:37.465 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2024-09-21T12:11:37.466 INFO:teuthology.orchestra.run.smithi003.stdout:Deploying grafana service with default placement... 2024-09-21T12:11:38.043 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:37 smithi003 ceph-mon[28057]: from='mgr.14118 172.21.15.3:0/394555530' entity='mgr.smithi003.wztftl' 2024-09-21T12:11:38.043 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:37 smithi003 ceph-mon[28057]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:11:38.043 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:37 smithi003 ceph-mon[28057]: Saving service prometheus spec with placement count:1 2024-09-21T12:11:38.043 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:37 smithi003 ceph-mon[28057]: from='mgr.14118 172.21.15.3:0/394555530' entity='mgr.smithi003.wztftl' 2024-09-21T12:11:38.705 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2024-09-21T12:11:38.706 INFO:teuthology.orchestra.run.smithi003.stdout:Deploying node-exporter service with default placement... 2024-09-21T12:11:39.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:39 smithi003 ceph-mon[28057]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:11:39.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:39 smithi003 ceph-mon[28057]: Saving service grafana spec with placement count:1 2024-09-21T12:11:39.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:39 smithi003 ceph-mon[28057]: from='mgr.14118 172.21.15.3:0/394555530' entity='mgr.smithi003.wztftl' 2024-09-21T12:11:39.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:39 smithi003 ceph-mon[28057]: from='mgr.14118 172.21.15.3:0/394555530' entity='mgr.smithi003.wztftl' 2024-09-21T12:11:40.463 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:40 smithi003 ceph-mon[28057]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:11:40.463 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:40 smithi003 ceph-mon[28057]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:11:40.463 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:40 smithi003 ceph-mon[28057]: Saving service node-exporter spec with placement * 2024-09-21T12:11:40.463 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:40 smithi003 ceph-mon[28057]: from='mgr.14118 172.21.15.3:0/394555530' entity='mgr.smithi003.wztftl' 2024-09-21T12:11:41.026 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2024-09-21T12:11:41.027 INFO:teuthology.orchestra.run.smithi003.stdout:Deploying alertmanager service with default placement... 2024-09-21T12:11:42.199 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2024-09-21T12:11:42.774 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:42 smithi003 ceph-mon[28057]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:11:42.775 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:42 smithi003 ceph-mon[28057]: from='client.14154 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:11:42.775 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:42 smithi003 ceph-mon[28057]: Saving service alertmanager spec with placement count:1 2024-09-21T12:11:42.775 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:42 smithi003 ceph-mon[28057]: from='mgr.14118 172.21.15.3:0/394555530' entity='mgr.smithi003.wztftl' 2024-09-21T12:11:44.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:43 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/158262307' entity='client.admin' 2024-09-21T12:11:44.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:43 smithi003 ceph-mon[28057]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:11:44.452 INFO:teuthology.orchestra.run.smithi003.stdout:Enabling the dashboard module... 2024-09-21T12:11:45.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:44 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/2805853589' entity='client.admin' 2024-09-21T12:11:46.257 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:45 smithi003 ceph-mon[28057]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:11:46.257 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:45 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/2539227253' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-21T12:11:47.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:46 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/2539227253' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-21T12:11:47.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:46 smithi003 ceph-mon[28057]: mgrmap e9: smithi003.wztftl(active, since 27s) 2024-09-21T12:11:47.791 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout { 2024-09-21T12:11:47.791 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-21T12:11:47.791 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-21T12:11:47.791 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "active_name": "smithi003.wztftl", 2024-09-21T12:11:47.791 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-21T12:11:47.791 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout } 2024-09-21T12:11:47.791 INFO:teuthology.orchestra.run.smithi003.stdout:Waiting for the mgr to restart... 2024-09-21T12:11:47.791 INFO:teuthology.orchestra.run.smithi003.stdout:Waiting for mgr epoch 9... 2024-09-21T12:11:48.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:47 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/2291254901' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-21T12:11:51.250 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:51 smithi003 ceph-mon[28057]: Active manager daemon smithi003.wztftl restarted 2024-09-21T12:11:51.251 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:51 smithi003 ceph-mon[28057]: Activating manager daemon smithi003.wztftl 2024-09-21T12:11:51.251 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:51 smithi003 ceph-mon[28057]: osdmap e3: 0 total, 0 up, 0 in 2024-09-21T12:11:51.251 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:51 smithi003 ceph-mon[28057]: mgrmap e10: smithi003.wztftl(active, starting, since 0.00316317s) 2024-09-21T12:11:51.251 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:51 smithi003 ceph-mon[28057]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mon metadata", "id": "smithi003"}]: dispatch 2024-09-21T12:11:51.251 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:51 smithi003 ceph-mon[28057]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mgr metadata", "who": "smithi003.wztftl", "id": "smithi003.wztftl"}]: dispatch 2024-09-21T12:11:51.251 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:51 smithi003 ceph-mon[28057]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-21T12:11:51.251 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:51 smithi003 ceph-mon[28057]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-21T12:11:51.251 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:51 smithi003 ceph-mon[28057]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-21T12:11:51.251 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:51 smithi003 ceph-mon[28057]: Manager daemon smithi003.wztftl is now available 2024-09-21T12:11:51.251 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:51 smithi003 ceph-mon[28057]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:11:51.251 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:51 smithi003 ceph-mon[28057]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi003.wztftl/mirror_snapshot_schedule"}]: dispatch 2024-09-21T12:11:51.251 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:51 smithi003 ceph-mon[28057]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi003.wztftl/trash_purge_schedule"}]: dispatch 2024-09-21T12:11:52.750 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout { 2024-09-21T12:11:52.750 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-21T12:11:52.750 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-21T12:11:52.750 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout } 2024-09-21T12:11:52.750 INFO:teuthology.orchestra.run.smithi003.stdout:mgr epoch 9 is available 2024-09-21T12:11:52.750 INFO:teuthology.orchestra.run.smithi003.stdout:Generating a dashboard self-signed certificate... 2024-09-21T12:11:53.183 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:53 smithi003 ceph-mon[28057]: mgrmap e11: smithi003.wztftl(active, since 1.00566s) 2024-09-21T12:11:53.183 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:53 smithi003 ceph-mon[28057]: [21/Sep/2024:12:11:52] ENGINE Bus STARTING 2024-09-21T12:11:53.183 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:53 smithi003 ceph-mon[28057]: [21/Sep/2024:12:11:52] ENGINE Serving on https://172.21.15.3:7150 2024-09-21T12:11:53.183 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:53 smithi003 ceph-mon[28057]: [21/Sep/2024:12:11:52] ENGINE Error in HTTPServer.serve 2024-09-21T12:11:53.183 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: Traceback (most recent call last): 2024-09-21T12:11:53.183 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T12:11:53.183 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: self._connections.run(self.expiration_interval) 2024-09-21T12:11:53.183 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T12:11:53.184 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: self._run(expiration_interval) 2024-09-21T12:11:53.184 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T12:11:53.184 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T12:11:53.184 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T12:11:53.184 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T12:11:53.184 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T12:11:53.184 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: s = self.context.wrap_socket( 2024-09-21T12:11:53.184 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T12:11:53.184 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: return self.sslsocket_class._create( 2024-09-21T12:11:53.184 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T12:11:53.184 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: self.do_handshake() 2024-09-21T12:11:53.184 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T12:11:53.184 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: self._sslobj.do_handshake() 2024-09-21T12:11:53.184 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T12:11:53.185 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:53 smithi003 ceph-mon[28057]: [21/Sep/2024:12:11:52] ENGINE Serving on http://172.21.15.3:8765 2024-09-21T12:11:53.185 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:53 smithi003 ceph-mon[28057]: [21/Sep/2024:12:11:52] ENGINE Bus STARTED 2024-09-21T12:11:54.047 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-21T12:11:54.047 INFO:teuthology.orchestra.run.smithi003.stdout:Creating initial admin user... 2024-09-21T12:11:54.162 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:54 smithi003 ceph-mon[28057]: mgrmap e12: smithi003.wztftl(active, since 2s) 2024-09-21T12:11:54.162 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:54 smithi003 ceph-mon[28057]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:11:54.163 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:54 smithi003 ceph-mon[28057]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:11:54.163 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:54 smithi003 ceph-mon[28057]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:11:54.163 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:54 smithi003 ceph-mon[28057]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:11:55.404 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$cM1fz34gdZzbMfXxFU0hz.j95sx0rFHydsOoKYgSsuOujZjAFTXnC", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726920714, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-21T12:11:55.404 INFO:teuthology.orchestra.run.smithi003.stdout:Fetching dashboard port number... 2024-09-21T12:11:55.954 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:55 smithi003 ceph-mon[28057]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:11:55.954 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:55 smithi003 ceph-mon[28057]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:11:55.954 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:55 smithi003 ceph-mon[28057]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:11:56.704 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stdout 8443 2024-09-21T12:11:56.714 INFO:teuthology.orchestra.run.smithi003.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-21T12:11:56.714 INFO:teuthology.orchestra.run.smithi003.stdout:systemctl: stdout disabled 2024-09-21T12:11:56.722 INFO:teuthology.orchestra.run.smithi003.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-21T12:11:56.722 INFO:teuthology.orchestra.run.smithi003.stdout:systemctl: stdout inactive 2024-09-21T12:11:56.722 INFO:teuthology.orchestra.run.smithi003.stdout:firewalld.service is not enabled 2024-09-21T12:11:56.722 INFO:teuthology.orchestra.run.smithi003.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-21T12:11:56.724 INFO:teuthology.orchestra.run.smithi003.stdout:Ceph Dashboard is now available at: 2024-09-21T12:11:56.724 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:11:56.724 INFO:teuthology.orchestra.run.smithi003.stdout: URL: https://smithi003.front.sepia.ceph.com:8443/ 2024-09-21T12:11:56.725 INFO:teuthology.orchestra.run.smithi003.stdout: User: admin 2024-09-21T12:11:56.725 INFO:teuthology.orchestra.run.smithi003.stdout: Password: 96dekz345k 2024-09-21T12:11:56.725 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:11:56.725 INFO:teuthology.orchestra.run.smithi003.stdout:Saving cluster configuration to /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/config directory 2024-09-21T12:11:57.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:56 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/3188439499' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-21T12:11:58.740 INFO:teuthology.orchestra.run.smithi003.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-21T12:11:58.741 INFO:teuthology.orchestra.run.smithi003.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-21T12:11:58.741 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:11:58.741 INFO:teuthology.orchestra.run.smithi003.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 641beec0-7812-11ef-baf6-efdc52797490 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-21T12:11:58.741 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:11:58.741 INFO:teuthology.orchestra.run.smithi003.stdout:Or, if you are only running a single cluster on this host: 2024-09-21T12:11:58.741 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:11:58.741 INFO:teuthology.orchestra.run.smithi003.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-21T12:11:58.741 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:11:58.741 INFO:teuthology.orchestra.run.smithi003.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-21T12:11:58.741 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:11:58.742 INFO:teuthology.orchestra.run.smithi003.stdout: ceph telemetry on 2024-09-21T12:11:58.742 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:11:58.742 INFO:teuthology.orchestra.run.smithi003.stdout:For more information see: 2024-09-21T12:11:58.742 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:11:58.742 INFO:teuthology.orchestra.run.smithi003.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-21T12:11:58.742 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:11:58.742 INFO:teuthology.orchestra.run.smithi003.stdout:Bootstrap complete. 2024-09-21T12:11:58.787 INFO:tasks.cephadm:Fetching config... 2024-09-21T12:11:58.787 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-09-21T12:11:58.788 DEBUG:teuthology.orchestra.run.smithi003:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-21T12:11:58.805 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-21T12:11:58.805 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-09-21T12:11:58.805 DEBUG:teuthology.orchestra.run.smithi003:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-21T12:11:58.863 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-21T12:11:58.863 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-09-21T12:11:58.863 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/keyring of=/dev/stdout 2024-09-21T12:11:58.929 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-21T12:11:58.929 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-09-21T12:11:58.929 DEBUG:teuthology.orchestra.run.smithi003:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-21T12:11:58.985 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-21T12:11:58.986 DEBUG:teuthology.orchestra.run.smithi003:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCzOdmRgBhdWXfpZhcljhjz9So7MXp4Vuy3G5dQHXlQ1gfnEh/P4CZ3sXtZnHcfkfL0S7taDkv3SFvBq8AoHnGIcmGdz07afG5t964ozih7D78BtBblO7pKVDD87/6hoaUufb7tonMbIgJqW1pI/IKfWliYi5C11be8tt3zIayA1mtuv9/GKVrE8lnPlyVGZW/bpc7+syqy8IiWcB0JXXI15wKNWBfkMZw6xai/MNzbYAKG8onwnC4nfT2EWZmh1m1s5P6WX7g9Tcp62Re6X5Ql2UbXiEfSkHKnneeCke7SHDnW7Ktg2tWu8Qd4iHCjK1MDf+MBr5kx0ZeTgZOXxYkTqYeONmrU18alvRkj87osPCg6e6AwnUTD22JWeW/4tcqJ7OVbo/4Vv3XZkBTX7VgWzN+9i3QwEtyRQxUhJaADZ16GAh1ebpY7mww3sVs5cTzOs4fa+RXhrdp5zm2/5e7kTmwuRzGbPPTM9HYVPdPRCakAc7zTJJOAbiEh1/Rbaqs= ceph-641beec0-7812-11ef-baf6-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T12:11:59.046 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:58 smithi003 ceph-mon[28057]: mgrmap e13: smithi003.wztftl(active, since 6s) 2024-09-21T12:11:59.047 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:11:58 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/4276012094' entity='client.admin' 2024-09-21T12:11:59.065 INFO:teuthology.orchestra.run.smithi003.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCzOdmRgBhdWXfpZhcljhjz9So7MXp4Vuy3G5dQHXlQ1gfnEh/P4CZ3sXtZnHcfkfL0S7taDkv3SFvBq8AoHnGIcmGdz07afG5t964ozih7D78BtBblO7pKVDD87/6hoaUufb7tonMbIgJqW1pI/IKfWliYi5C11be8tt3zIayA1mtuv9/GKVrE8lnPlyVGZW/bpc7+syqy8IiWcB0JXXI15wKNWBfkMZw6xai/MNzbYAKG8onwnC4nfT2EWZmh1m1s5P6WX7g9Tcp62Re6X5Ql2UbXiEfSkHKnneeCke7SHDnW7Ktg2tWu8Qd4iHCjK1MDf+MBr5kx0ZeTgZOXxYkTqYeONmrU18alvRkj87osPCg6e6AwnUTD22JWeW/4tcqJ7OVbo/4Vv3XZkBTX7VgWzN+9i3QwEtyRQxUhJaADZ16GAh1ebpY7mww3sVs5cTzOs4fa+RXhrdp5zm2/5e7kTmwuRzGbPPTM9HYVPdPRCakAc7zTJJOAbiEh1/Rbaqs= ceph-641beec0-7812-11ef-baf6-efdc52797490 2024-09-21T12:11:59.076 DEBUG:teuthology.orchestra.run.smithi192:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCzOdmRgBhdWXfpZhcljhjz9So7MXp4Vuy3G5dQHXlQ1gfnEh/P4CZ3sXtZnHcfkfL0S7taDkv3SFvBq8AoHnGIcmGdz07afG5t964ozih7D78BtBblO7pKVDD87/6hoaUufb7tonMbIgJqW1pI/IKfWliYi5C11be8tt3zIayA1mtuv9/GKVrE8lnPlyVGZW/bpc7+syqy8IiWcB0JXXI15wKNWBfkMZw6xai/MNzbYAKG8onwnC4nfT2EWZmh1m1s5P6WX7g9Tcp62Re6X5Ql2UbXiEfSkHKnneeCke7SHDnW7Ktg2tWu8Qd4iHCjK1MDf+MBr5kx0ZeTgZOXxYkTqYeONmrU18alvRkj87osPCg6e6AwnUTD22JWeW/4tcqJ7OVbo/4Vv3XZkBTX7VgWzN+9i3QwEtyRQxUhJaADZ16GAh1ebpY7mww3sVs5cTzOs4fa+RXhrdp5zm2/5e7kTmwuRzGbPPTM9HYVPdPRCakAc7zTJJOAbiEh1/Rbaqs= ceph-641beec0-7812-11ef-baf6-efdc52797490' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-21T12:11:59.203 INFO:teuthology.orchestra.run.smithi192.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCzOdmRgBhdWXfpZhcljhjz9So7MXp4Vuy3G5dQHXlQ1gfnEh/P4CZ3sXtZnHcfkfL0S7taDkv3SFvBq8AoHnGIcmGdz07afG5t964ozih7D78BtBblO7pKVDD87/6hoaUufb7tonMbIgJqW1pI/IKfWliYi5C11be8tt3zIayA1mtuv9/GKVrE8lnPlyVGZW/bpc7+syqy8IiWcB0JXXI15wKNWBfkMZw6xai/MNzbYAKG8onwnC4nfT2EWZmh1m1s5P6WX7g9Tcp62Re6X5Ql2UbXiEfSkHKnneeCke7SHDnW7Ktg2tWu8Qd4iHCjK1MDf+MBr5kx0ZeTgZOXxYkTqYeONmrU18alvRkj87osPCg6e6AwnUTD22JWeW/4tcqJ7OVbo/4Vv3XZkBTX7VgWzN+9i3QwEtyRQxUhJaADZ16GAh1ebpY7mww3sVs5cTzOs4fa+RXhrdp5zm2/5e7kTmwuRzGbPPTM9HYVPdPRCakAc7zTJJOAbiEh1/Rbaqs= ceph-641beec0-7812-11ef-baf6-efdc52797490 2024-09-21T12:11:59.216 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-21T12:11:59.470 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:12:01.072 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-21T12:12:01.072 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-21T12:12:01.185 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:01 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/1913726243' entity='client.admin' 2024-09-21T12:12:01.546 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:12:03.322 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi192 2024-09-21T12:12:03.322 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-21T12:12:03.323 DEBUG:teuthology.orchestra.run.smithi192:> dd of=/etc/ceph/ceph.conf 2024-09-21T12:12:03.341 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-21T12:12:03.341 DEBUG:teuthology.orchestra.run.smithi192:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T12:12:03.400 INFO:tasks.cephadm:Adding host smithi192 to orchestrator... 2024-09-21T12:12:03.400 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph orch host add smithi192 2024-09-21T12:12:03.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:03 smithi003 ceph-mon[28057]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:12:03.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:03 smithi003 ceph-mon[28057]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:12:03.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:03 smithi003 ceph-mon[28057]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:12:03.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:03 smithi003 ceph-mon[28057]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:12:03.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:03 smithi003 ceph-mon[28057]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "who": "osd/host:smithi003", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:12:03.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:03 smithi003 ceph-mon[28057]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:12:03.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:03 smithi003 ceph-mon[28057]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:12:03.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:03 smithi003 ceph-mon[28057]: Updating smithi003:/etc/ceph/ceph.conf 2024-09-21T12:12:03.674 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:12:05.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:04 smithi003 ceph-mon[28057]: Updating smithi003:/var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T12:12:05.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:04 smithi003 ceph-mon[28057]: Updating smithi003:/etc/ceph/ceph.client.admin.keyring 2024-09-21T12:12:05.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:04 smithi003 ceph-mon[28057]: Updating smithi003:/var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T12:12:05.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:04 smithi003 ceph-mon[28057]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:12:05.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:04 smithi003 ceph-mon[28057]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:12:05.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:04 smithi003 ceph-mon[28057]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:12:05.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:04 smithi003 ceph-mon[28057]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi003", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-21T12:12:05.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:04 smithi003 ceph-mon[28057]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi003", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-21T12:12:05.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:04 smithi003 ceph-mon[28057]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:12:05.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:04 smithi003 ceph-mon[28057]: Deploying daemon ceph-exporter.smithi003 on smithi003 2024-09-21T12:12:06.066 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:05 smithi003 ceph-mon[28057]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi192", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:12:07.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:06 smithi003 ceph-mon[28057]: Deploying cephadm binary to smithi192 2024-09-21T12:12:07.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:06 smithi003 ceph-mon[28057]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:12:07.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:06 smithi003 ceph-mon[28057]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:12:07.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:06 smithi003 ceph-mon[28057]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:12:07.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:06 smithi003 ceph-mon[28057]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:12:07.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:06 smithi003 ceph-mon[28057]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi003", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-21T12:12:07.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:06 smithi003 ceph-mon[28057]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi003", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-21T12:12:07.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:06 smithi003 ceph-mon[28057]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:12:07.864 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:07 smithi003 ceph-mon[28057]: Deploying daemon crash.smithi003 on smithi003 2024-09-21T12:12:08.324 INFO:teuthology.orchestra.run.smithi003.stdout:Added host 'smithi192' with addr '172.21.15.192' 2024-09-21T12:12:09.170 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph orch host ls --format=json 2024-09-21T12:12:09.442 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:12:09.481 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:09 smithi003 ceph-mon[28057]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:12:09.481 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:09 smithi003 ceph-mon[28057]: Added host smithi192 2024-09-21T12:12:09.481 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:09 smithi003 ceph-mon[28057]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:12:09.481 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:09 smithi003 ceph-mon[28057]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:12:09.481 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:09 smithi003 ceph-mon[28057]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:12:09.481 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:09 smithi003 ceph-mon[28057]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:12:09.481 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:09 smithi003 ceph-mon[28057]: Deploying daemon node-exporter.smithi003 on smithi003 2024-09-21T12:12:10.060 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:12:10.060 INFO:teuthology.orchestra.run.smithi003.stdout:[{"addr": "172.21.15.3", "hostname": "smithi003", "labels": [], "status": ""}, {"addr": "172.21.15.192", "hostname": "smithi192", "labels": [], "status": ""}] 2024-09-21T12:12:10.624 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-21T12:12:10.624 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph osd crush tunables default 2024-09-21T12:12:10.898 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:12:11.320 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:11 smithi003 ceph-mon[28057]: from='client.14189 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T12:12:11.320 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:11 smithi003 ceph-mon[28057]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:12:12.062 INFO:teuthology.orchestra.run.smithi003.stderr:adjusted tunables profile to default 2024-09-21T12:12:12.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:12 smithi003 ceph-mon[28057]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:12:12.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:12 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/2563641140' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-21T12:12:12.857 INFO:tasks.cephadm:Adding mon.smithi003 on smithi003 2024-09-21T12:12:12.858 INFO:tasks.cephadm:Adding mon.smithi192 on smithi192 2024-09-21T12:12:12.858 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph orch apply mon '2;smithi003:172.21.15.3=smithi003;smithi192:172.21.15.192=smithi192' 2024-09-21T12:12:13.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:13 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/2563641140' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-21T12:12:13.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:13 smithi003 ceph-mon[28057]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T12:12:13.100 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T12:12:13.144 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T12:12:13.721 INFO:teuthology.orchestra.run.smithi192.stdout:Scheduled mon update... 2024-09-21T12:12:14.274 DEBUG:teuthology.orchestra.run.smithi192:mon.smithi192> sudo journalctl -f -n 0 -u ceph-641beec0-7812-11ef-baf6-efdc52797490@mon.smithi192.service 2024-09-21T12:12:14.276 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T12:12:14.276 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T12:12:14.546 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T12:12:14.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:14 smithi003 ceph-mon[28057]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:12:14.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:14 smithi003 ceph-mon[28057]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:12:14.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:14 smithi003 ceph-mon[28057]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:12:14.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:14 smithi003 ceph-mon[28057]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:12:14.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:14 smithi003 ceph-mon[28057]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:12:14.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:14 smithi003 ceph-mon[28057]: Deploying daemon alertmanager.smithi003 on smithi003 2024-09-21T12:12:14.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:14 smithi003 ceph-mon[28057]: from='client.14193 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi003:172.21.15.3=smithi003;smithi192:172.21.15.192=smithi192", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:12:14.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:14 smithi003 ceph-mon[28057]: Saving service mon spec with placement smithi003:172.21.15.3=smithi003;smithi192:172.21.15.192=smithi192;count:2 2024-09-21T12:12:14.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:14 smithi003 ceph-mon[28057]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:12:14.591 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T12:12:15.232 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:12:15.233 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":1,"fsid":"641beec0-7812-11ef-baf6-efdc52797490","modified":"2024-09-21T12:10:43.597094Z","created":"2024-09-21T12:10:43.597094Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi003","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:3300","nonce":0},{"type":"v1","addr":"172.21.15.3:6789","nonce":0}]},"addr":"172.21.15.3:6789/0","public_addr":"172.21.15.3:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T12:12:15.233 INFO:teuthology.orchestra.run.smithi192.stderr:dumped monmap epoch 1 2024-09-21T12:12:15.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:15 smithi003 ceph-mon[28057]: from='client.? 172.21.15.192:0/523440861' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:12:16.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:16 smithi003 ceph-mon[28057]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:12:16.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:16 smithi003 ceph-mon[28057]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:12:16.790 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T12:12:16.790 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T12:12:17.035 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T12:12:17.080 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T12:12:17.853 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:12:17.854 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":1,"fsid":"641beec0-7812-11ef-baf6-efdc52797490","modified":"2024-09-21T12:10:43.597094Z","created":"2024-09-21T12:10:43.597094Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi003","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:3300","nonce":0},{"type":"v1","addr":"172.21.15.3:6789","nonce":0}]},"addr":"172.21.15.3:6789/0","public_addr":"172.21.15.3:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T12:12:17.854 INFO:teuthology.orchestra.run.smithi192.stderr:dumped monmap epoch 1 2024-09-21T12:12:18.516 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:18 smithi003 ceph-mon[28057]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:12:18.516 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:18 smithi003 ceph-mon[28057]: from='client.? 172.21.15.192:0/3419372985' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:12:19.461 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T12:12:19.462 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T12:12:19.705 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T12:12:19.749 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T12:12:20.375 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:12:20.375 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":1,"fsid":"641beec0-7812-11ef-baf6-efdc52797490","modified":"2024-09-21T12:10:43.597094Z","created":"2024-09-21T12:10:43.597094Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi003","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:3300","nonce":0},{"type":"v1","addr":"172.21.15.3:6789","nonce":0}]},"addr":"172.21.15.3:6789/0","public_addr":"172.21.15.3:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T12:12:20.376 INFO:teuthology.orchestra.run.smithi192.stderr:dumped monmap epoch 1 2024-09-21T12:12:20.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:20 smithi003 ceph-mon[28057]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:12:21.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:21 smithi003 ceph-mon[28057]: from='client.? 172.21.15.192:0/4230133225' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:12:21.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:21 smithi003 ceph-mon[28057]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:12:21.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:21 smithi003 ceph-mon[28057]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:12:21.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:21 smithi003 ceph-mon[28057]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:12:21.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:21 smithi003 ceph-mon[28057]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:12:21.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:21 smithi003 ceph-mon[28057]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:12:21.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:21 smithi003 ceph-mon[28057]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:12:21.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:21 smithi003 ceph-mon[28057]: Regenerating cephadm self-signed grafana TLS certificates 2024-09-21T12:12:21.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:21 smithi003 ceph-mon[28057]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:12:21.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:21 smithi003 ceph-mon[28057]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:12:21.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:21 smithi003 ceph-mon[28057]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-21T12:12:21.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:21 smithi003 ceph-mon[28057]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-21T12:12:21.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:21 smithi003 ceph-mon[28057]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:12:21.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:21 smithi003 ceph-mon[28057]: Deploying daemon grafana.smithi003 on smithi003 2024-09-21T12:12:21.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:21 smithi003 ceph-mon[28057]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:12:21.959 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T12:12:21.960 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T12:12:22.201 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T12:12:22.246 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T12:12:22.893 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:12:22.894 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":1,"fsid":"641beec0-7812-11ef-baf6-efdc52797490","modified":"2024-09-21T12:10:43.597094Z","created":"2024-09-21T12:10:43.597094Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi003","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:3300","nonce":0},{"type":"v1","addr":"172.21.15.3:6789","nonce":0}]},"addr":"172.21.15.3:6789/0","public_addr":"172.21.15.3:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T12:12:22.894 INFO:teuthology.orchestra.run.smithi192.stderr:dumped monmap epoch 1 2024-09-21T12:12:23.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:22 smithi003 ceph-mon[28057]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:12:23.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:22 smithi003 ceph-mon[28057]: from='client.? 172.21.15.192:0/4242925929' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:12:24.475 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T12:12:24.476 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T12:12:24.719 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T12:12:24.763 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T12:12:25.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:24 smithi003 ceph-mon[28057]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:12:25.393 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:12:25.393 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":1,"fsid":"641beec0-7812-11ef-baf6-efdc52797490","modified":"2024-09-21T12:10:43.597094Z","created":"2024-09-21T12:10:43.597094Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi003","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:3300","nonce":0},{"type":"v1","addr":"172.21.15.3:6789","nonce":0}]},"addr":"172.21.15.3:6789/0","public_addr":"172.21.15.3:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T12:12:25.394 INFO:teuthology.orchestra.run.smithi192.stderr:dumped monmap epoch 1 2024-09-21T12:12:26.244 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:25 smithi003 ceph-mon[28057]: from='client.? 172.21.15.192:0/3778532137' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:12:26.972 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T12:12:26.972 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T12:12:27.214 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T12:12:27.258 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T12:12:27.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:26 smithi003 ceph-mon[28057]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:12:27.951 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:12:27.951 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":1,"fsid":"641beec0-7812-11ef-baf6-efdc52797490","modified":"2024-09-21T12:10:43.597094Z","created":"2024-09-21T12:10:43.597094Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi003","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:3300","nonce":0},{"type":"v1","addr":"172.21.15.3:6789","nonce":0}]},"addr":"172.21.15.3:6789/0","public_addr":"172.21.15.3:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T12:12:27.952 INFO:teuthology.orchestra.run.smithi192.stderr:dumped monmap epoch 1 2024-09-21T12:12:29.290 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:28 smithi003 ceph-mon[28057]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:12:29.290 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:28 smithi003 ceph-mon[28057]: from='client.? 172.21.15.192:0/239805742' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:12:29.522 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T12:12:29.522 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T12:12:29.770 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T12:12:29.817 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T12:12:30.499 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:12:30.499 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":1,"fsid":"641beec0-7812-11ef-baf6-efdc52797490","modified":"2024-09-21T12:10:43.597094Z","created":"2024-09-21T12:10:43.597094Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi003","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:3300","nonce":0},{"type":"v1","addr":"172.21.15.3:6789","nonce":0}]},"addr":"172.21.15.3:6789/0","public_addr":"172.21.15.3:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T12:12:30.499 INFO:teuthology.orchestra.run.smithi192.stderr:dumped monmap epoch 1 2024-09-21T12:12:31.046 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:30 smithi003 ceph-mon[28057]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:12:31.046 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:30 smithi003 ceph-mon[28057]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:12:31.046 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:30 smithi003 ceph-mon[28057]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:12:31.046 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:30 smithi003 ceph-mon[28057]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:12:31.046 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:30 smithi003 ceph-mon[28057]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:12:31.046 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:30 smithi003 ceph-mon[28057]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:12:31.046 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:30 smithi003 ceph-mon[28057]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:12:31.047 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:30 smithi003 ceph-mon[28057]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:12:31.047 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:30 smithi003 ceph-mon[28057]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:12:31.047 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:30 smithi003 ceph-mon[28057]: from='client.? 172.21.15.192:0/2044550379' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:12:31.958 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:31 smithi003 ceph-mon[28057]: Deploying daemon prometheus.smithi003 on smithi003 2024-09-21T12:12:31.958 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:31 smithi003 ceph-mon[28057]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:12:32.035 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T12:12:32.035 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T12:12:32.283 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T12:12:32.326 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T12:12:32.962 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:12:32.962 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":1,"fsid":"641beec0-7812-11ef-baf6-efdc52797490","modified":"2024-09-21T12:10:43.597094Z","created":"2024-09-21T12:10:43.597094Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi003","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:3300","nonce":0},{"type":"v1","addr":"172.21.15.3:6789","nonce":0}]},"addr":"172.21.15.3:6789/0","public_addr":"172.21.15.3:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T12:12:32.962 INFO:teuthology.orchestra.run.smithi192.stderr:dumped monmap epoch 1 2024-09-21T12:12:33.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:32 smithi003 ceph-mon[28057]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:12:34.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:33 smithi003 ceph-mon[28057]: from='client.? 172.21.15.192:0/980307458' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:12:34.593 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T12:12:34.593 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T12:12:34.831 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T12:12:34.875 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T12:12:35.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:34 smithi003 ceph-mon[28057]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:12:35.583 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:12:35.583 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":1,"fsid":"641beec0-7812-11ef-baf6-efdc52797490","modified":"2024-09-21T12:10:43.597094Z","created":"2024-09-21T12:10:43.597094Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi003","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:3300","nonce":0},{"type":"v1","addr":"172.21.15.3:6789","nonce":0}]},"addr":"172.21.15.3:6789/0","public_addr":"172.21.15.3:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T12:12:35.583 INFO:teuthology.orchestra.run.smithi192.stderr:dumped monmap epoch 1 2024-09-21T12:12:36.264 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:35 smithi003 ceph-mon[28057]: from='client.? 172.21.15.192:0/4159481583' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:12:37.190 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T12:12:37.190 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T12:12:37.208 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:36 smithi003 ceph-mon[28057]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:12:37.434 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T12:12:37.478 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T12:12:38.094 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:12:38.094 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":1,"fsid":"641beec0-7812-11ef-baf6-efdc52797490","modified":"2024-09-21T12:10:43.597094Z","created":"2024-09-21T12:10:43.597094Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi003","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:3300","nonce":0},{"type":"v1","addr":"172.21.15.3:6789","nonce":0}]},"addr":"172.21.15.3:6789/0","public_addr":"172.21.15.3:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T12:12:38.094 INFO:teuthology.orchestra.run.smithi192.stderr:dumped monmap epoch 1 2024-09-21T12:12:39.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:38 smithi003 ceph-mon[28057]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:12:39.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:38 smithi003 ceph-mon[28057]: from='client.? 172.21.15.192:0/2519058767' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:12:39.691 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T12:12:39.692 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T12:12:39.936 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T12:12:39.981 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T12:12:40.621 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:12:40.621 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":1,"fsid":"641beec0-7812-11ef-baf6-efdc52797490","modified":"2024-09-21T12:10:43.597094Z","created":"2024-09-21T12:10:43.597094Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi003","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:3300","nonce":0},{"type":"v1","addr":"172.21.15.3:6789","nonce":0}]},"addr":"172.21.15.3:6789/0","public_addr":"172.21.15.3:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T12:12:40.621 INFO:teuthology.orchestra.run.smithi192.stderr:dumped monmap epoch 1 2024-09-21T12:12:41.274 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:40 smithi003 ceph-mon[28057]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:12:41.274 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:40 smithi003 ceph-mon[28057]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:12:41.274 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:40 smithi003 ceph-mon[28057]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:12:41.274 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:40 smithi003 ceph-mon[28057]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:12:41.274 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:40 smithi003 ceph-mon[28057]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-21T12:12:41.274 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:40 smithi003 ceph-mon[28057]: from='client.? 172.21.15.192:0/695098604' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:12:42.184 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:42 smithi003 ceph-mon[28057]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:12:42.184 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:42 smithi003 ceph-mon[28057]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-21T12:12:42.184 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:42 smithi003 ceph-mon[28057]: mgrmap e14: smithi003.wztftl(active, since 50s) 2024-09-21T12:12:42.220 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T12:12:42.221 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T12:12:42.466 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T12:12:42.510 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T12:12:43.217 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:12:43.217 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":1,"fsid":"641beec0-7812-11ef-baf6-efdc52797490","modified":"2024-09-21T12:10:43.597094Z","created":"2024-09-21T12:10:43.597094Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi003","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:3300","nonce":0},{"type":"v1","addr":"172.21.15.3:6789","nonce":0}]},"addr":"172.21.15.3:6789/0","public_addr":"172.21.15.3:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T12:12:43.217 INFO:teuthology.orchestra.run.smithi192.stderr:dumped monmap epoch 1 2024-09-21T12:12:43.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:43 smithi003 ceph-mon[28057]: from='client.? 172.21.15.192:0/4280872110' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:12:44.812 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T12:12:44.812 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T12:12:45.055 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T12:12:45.099 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T12:12:45.744 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:12:45.744 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":1,"fsid":"641beec0-7812-11ef-baf6-efdc52797490","modified":"2024-09-21T12:10:43.597094Z","created":"2024-09-21T12:10:43.597094Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi003","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:3300","nonce":0},{"type":"v1","addr":"172.21.15.3:6789","nonce":0}]},"addr":"172.21.15.3:6789/0","public_addr":"172.21.15.3:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T12:12:45.744 INFO:teuthology.orchestra.run.smithi192.stderr:dumped monmap epoch 1 2024-09-21T12:12:46.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:45 smithi003 ceph-mon[28057]: from='client.? 172.21.15.192:0/2920857771' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:12:46.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:46 smithi003 ceph-mon[28057]: Active manager daemon smithi003.wztftl restarted 2024-09-21T12:12:46.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:46 smithi003 ceph-mon[28057]: Activating manager daemon smithi003.wztftl 2024-09-21T12:12:46.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:46 smithi003 ceph-mon[28057]: osdmap e5: 0 total, 0 up, 0 in 2024-09-21T12:12:46.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:46 smithi003 ceph-mon[28057]: mgrmap e15: smithi003.wztftl(active, starting, since 0.00546569s) 2024-09-21T12:12:46.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:46 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mon metadata", "id": "smithi003"}]: dispatch 2024-09-21T12:12:46.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:46 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mgr metadata", "who": "smithi003.wztftl", "id": "smithi003.wztftl"}]: dispatch 2024-09-21T12:12:46.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:46 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-21T12:12:46.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:46 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-21T12:12:46.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:46 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-21T12:12:46.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:46 smithi003 ceph-mon[28057]: Manager daemon smithi003.wztftl is now available 2024-09-21T12:12:46.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:46 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:12:46.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:46 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:12:46.831 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:46 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:12:46.831 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:46 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi003.wztftl/mirror_snapshot_schedule"}]: dispatch 2024-09-21T12:12:46.831 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:46 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi003.wztftl/trash_purge_schedule"}]: dispatch 2024-09-21T12:12:47.340 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T12:12:47.341 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T12:12:47.589 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T12:12:47.634 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T12:12:48.397 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:12:48.397 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":1,"fsid":"641beec0-7812-11ef-baf6-efdc52797490","modified":"2024-09-21T12:10:43.597094Z","created":"2024-09-21T12:10:43.597094Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi003","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:3300","nonce":0},{"type":"v1","addr":"172.21.15.3:6789","nonce":0}]},"addr":"172.21.15.3:6789/0","public_addr":"172.21.15.3:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T12:12:48.398 INFO:teuthology.orchestra.run.smithi192.stderr:dumped monmap epoch 1 2024-09-21T12:12:48.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:48 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:12:48.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:48 smithi003 ceph-mon[28057]: mgrmap e16: smithi003.wztftl(active, since 1.00621s) 2024-09-21T12:12:48.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:48 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:12:49.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:49 smithi003 ceph-mon[28057]: from='client.? 172.21.15.192:0/3694558303' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:12:49.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:49 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:12:49.996 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T12:12:49.997 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T12:12:50.561 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T12:12:50.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:50 smithi003 ceph-mon[28057]: mgrmap e17: smithi003.wztftl(active, since 2s) 2024-09-21T12:12:50.616 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-21T12:12:51.333 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:12:51.333 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":1,"fsid":"641beec0-7812-11ef-baf6-efdc52797490","modified":"2024-09-21T12:10:43.597094Z","created":"2024-09-21T12:10:43.597094Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi003","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:3300","nonce":0},{"type":"v1","addr":"172.21.15.3:6789","nonce":0}]},"addr":"172.21.15.3:6789/0","public_addr":"172.21.15.3:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T12:12:51.333 INFO:teuthology.orchestra.run.smithi192.stderr:dumped monmap epoch 1 2024-09-21T12:12:51.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:51 smithi003 ceph-mon[28057]: [21/Sep/2024:12:12:49] ENGINE Bus STARTING 2024-09-21T12:12:51.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:51 smithi003 ceph-mon[28057]: [21/Sep/2024:12:12:49] ENGINE Serving on https://172.21.15.3:7150 2024-09-21T12:12:51.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:51 smithi003 ceph-mon[28057]: [21/Sep/2024:12:12:49] ENGINE Error in HTTPServer.serve 2024-09-21T12:12:51.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: Traceback (most recent call last): 2024-09-21T12:12:51.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T12:12:51.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: self._connections.run(self.expiration_interval) 2024-09-21T12:12:51.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T12:12:51.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: self._run(expiration_interval) 2024-09-21T12:12:51.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T12:12:51.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T12:12:51.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T12:12:51.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T12:12:51.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T12:12:51.581 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: s = self.context.wrap_socket( 2024-09-21T12:12:51.581 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T12:12:51.581 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: return self.sslsocket_class._create( 2024-09-21T12:12:51.581 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T12:12:51.581 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: self.do_handshake() 2024-09-21T12:12:51.581 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T12:12:51.581 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: self._sslobj.do_handshake() 2024-09-21T12:12:51.581 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T12:12:51.581 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:51 smithi003 ceph-mon[28057]: [21/Sep/2024:12:12:49] ENGINE Serving on http://172.21.15.3:8765 2024-09-21T12:12:51.581 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:51 smithi003 ceph-mon[28057]: [21/Sep/2024:12:12:49] ENGINE Bus STARTED 2024-09-21T12:12:51.581 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:51 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:12:51.581 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:51 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:12:51.581 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:51 smithi003 ceph-mon[28057]: from='client.? 172.21.15.192:0/2386561246' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:12:51.581 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:51 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:12:51.581 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:51 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:12:51.581 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:51 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "who": "osd/host:smithi003", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:12:53.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:52 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:12:53.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:52 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:12:53.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:52 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:12:53.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:52 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:12:53.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:52 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "who": "osd/host:smithi192", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:12:53.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:52 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:12:53.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:52 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:12:53.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:52 smithi003 ceph-mon[28057]: Updating smithi003:/etc/ceph/ceph.conf 2024-09-21T12:12:53.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:52 smithi003 ceph-mon[28057]: Updating smithi192:/etc/ceph/ceph.conf 2024-09-21T12:12:53.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:52 smithi003 ceph-mon[28057]: Updating smithi192:/var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T12:12:53.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:52 smithi003 ceph-mon[28057]: Updating smithi003:/var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T12:12:53.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:52 smithi003 ceph-mon[28057]: Updating smithi192:/etc/ceph/ceph.client.admin.keyring 2024-09-21T12:12:53.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:52 smithi003 ceph-mon[28057]: Updating smithi003:/etc/ceph/ceph.client.admin.keyring 2024-09-21T12:12:53.081 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:52 smithi003 ceph-mon[28057]: Updating smithi192:/var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T12:12:53.081 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:52 smithi003 ceph-mon[28057]: Updating smithi003:/var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T12:12:53.081 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:52 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:12:53.081 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:52 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:12:53.081 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:52 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:12:53.081 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:52 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:12:53.081 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:52 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:12:53.081 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:52 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi192", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-21T12:12:53.081 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:52 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi192", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-21T12:12:53.081 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:52 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:12:53.356 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T12:12:53.356 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T12:12:54.031 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T12:12:54.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:53 smithi003 ceph-mon[28057]: Deploying daemon ceph-exporter.smithi192 on smithi192 2024-09-21T12:12:54.780 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:12:54.780 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":1,"fsid":"641beec0-7812-11ef-baf6-efdc52797490","modified":"2024-09-21T12:10:43.597094Z","created":"2024-09-21T12:10:43.597094Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi003","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:3300","nonce":0},{"type":"v1","addr":"172.21.15.3:6789","nonce":0}]},"addr":"172.21.15.3:6789/0","public_addr":"172.21.15.3:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T12:12:54.780 INFO:teuthology.orchestra.run.smithi192.stderr:dumped monmap epoch 1 2024-09-21T12:12:55.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:54 smithi003 ceph-mon[28057]: from='client.? 172.21.15.192:0/2986358795' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:12:56.350 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T12:12:56.350 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T12:12:57.274 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T12:12:57.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:56 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:12:57.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:56 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:12:57.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:56 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:12:57.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:56 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:12:57.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:56 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi192", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-21T12:12:57.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:56 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi192", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-21T12:12:57.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:56 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:12:57.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:56 smithi003 ceph-mon[28057]: Deploying daemon crash.smithi192 on smithi192 2024-09-21T12:12:57.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:56 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:12:58.102 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:12:58.102 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":1,"fsid":"641beec0-7812-11ef-baf6-efdc52797490","modified":"2024-09-21T12:10:43.597094Z","created":"2024-09-21T12:10:43.597094Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi003","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:3300","nonce":0},{"type":"v1","addr":"172.21.15.3:6789","nonce":0}]},"addr":"172.21.15.3:6789/0","public_addr":"172.21.15.3:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T12:12:58.103 INFO:teuthology.orchestra.run.smithi192.stderr:dumped monmap epoch 1 2024-09-21T12:12:58.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:12:58 smithi003 ceph-mon[28057]: from='client.? 172.21.15.192:0/4065284500' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:12:59.869 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T12:12:59.870 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T12:13:00.127 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T12:13:00.382 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:00 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:00.382 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:00 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:00.382 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:00 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:00.382 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:00 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:00.382 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:00 smithi003 ceph-mon[28057]: Deploying daemon node-exporter.smithi192 on smithi192 2024-09-21T12:13:00.928 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:13:00.929 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":1,"fsid":"641beec0-7812-11ef-baf6-efdc52797490","modified":"2024-09-21T12:10:43.597094Z","created":"2024-09-21T12:10:43.597094Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi003","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:3300","nonce":0},{"type":"v1","addr":"172.21.15.3:6789","nonce":0}]},"addr":"172.21.15.3:6789/0","public_addr":"172.21.15.3:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T12:13:00.929 INFO:teuthology.orchestra.run.smithi192.stderr:dumped monmap epoch 1 2024-09-21T12:13:01.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:01 smithi003 ceph-mon[28057]: from='client.? 172.21.15.192:0/907303843' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:13:02.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:02 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:02.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:02 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:13:03.209 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T12:13:03.210 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T12:13:03.476 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T12:13:04.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:04 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:04.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:04 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:04.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:04 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:04.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:04 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:04.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:04 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi192.qsaprd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T12:13:04.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:04 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi192.qsaprd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T12:13:04.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:04 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T12:13:04.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:04 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:13:04.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:04 smithi003 ceph-mon[28057]: Deploying daemon mgr.smithi192.qsaprd on smithi192 2024-09-21T12:13:04.817 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:13:04.817 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":1,"fsid":"641beec0-7812-11ef-baf6-efdc52797490","modified":"2024-09-21T12:10:43.597094Z","created":"2024-09-21T12:10:43.597094Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi003","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:3300","nonce":0},{"type":"v1","addr":"172.21.15.3:6789","nonce":0}]},"addr":"172.21.15.3:6789/0","public_addr":"172.21.15.3:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T12:13:04.818 INFO:teuthology.orchestra.run.smithi192.stderr:dumped monmap epoch 1 2024-09-21T12:13:05.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:05 smithi003 ceph-mon[28057]: from='client.? 172.21.15.192:0/3607333180' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:13:06.879 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T12:13:06.880 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T12:13:07.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:07 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:07.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:07 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:07.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:07 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:07.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:07 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:07.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:07 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-21T12:13:07.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:07 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:13:07.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:07 smithi003 ceph-mon[28057]: Deploying daemon mon.smithi192 on smithi192 2024-09-21T12:13:07.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:07 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:08.565 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T12:13:08.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:08 smithi003 ceph-mon[28057]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:13:09.551 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:09 smithi192 systemd[1]: Starting Ceph mon.smithi192 for 641beec0-7812-11ef-baf6-efdc52797490... 2024-09-21T12:13:09.771 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:13:09.772 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":1,"fsid":"641beec0-7812-11ef-baf6-efdc52797490","modified":"2024-09-21T12:10:43.597094Z","created":"2024-09-21T12:10:43.597094Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi003","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:3300","nonce":0},{"type":"v1","addr":"172.21.15.3:6789","nonce":0}]},"addr":"172.21.15.3:6789/0","public_addr":"172.21.15.3:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-21T12:13:09.772 INFO:teuthology.orchestra.run.smithi192.stderr:dumped monmap epoch 1 2024-09-21T12:13:09.845 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:09 smithi192 podman[35606]: 2024-09-21 12:13:09.6619768 +0000 UTC m=+0.021914675 image pull 164465d2334a36ec69b5e540adc75ef73c92a8a0546664850c2173107383597c quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64 2024-09-21T12:13:09.845 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:09 smithi192 podman[35606]: 2024-09-21 12:13:09.783960396 +0000 UTC m=+0.143898270 container create 4fe4c4b3dc5dca17a48d8360507baedb5913f7ff9b10cfe68cf53d1887f1530d (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-mon-smithi192, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-4e45e6b, maintainer=Guillaume Abrioux ) 2024-09-21T12:13:10.683 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 podman[35606]: 2024-09-21 12:13:10.657323052 +0000 UTC m=+1.017260932 container init 4fe4c4b3dc5dca17a48d8360507baedb5913f7ff9b10cfe68cf53d1887f1530d (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-mon-smithi192, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-4e45e6b, maintainer=Guillaume Abrioux ) 2024-09-21T12:13:10.683 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 podman[35606]: 2024-09-21 12:13:10.660800625 +0000 UTC m=+1.020738510 container start 4fe4c4b3dc5dca17a48d8360507baedb5913f7ff9b10cfe68cf53d1887f1530d (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-mon-smithi192, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-4e45e6b, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-21T12:13:10.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:10 smithi003 ceph-mon[28057]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:13:10.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:10 smithi003 ceph-mon[28057]: from='client.? 172.21.15.192:0/2255653971' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:13:11.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: set uid:gid to 167:167 (ceph:ceph) 2024-09-21T12:13:11.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable), process ceph-mon, pid 2 2024-09-21T12:13:11.009 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: pidfile_write: ignore empty --pid-file 2024-09-21T12:13:11.009 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: load: jerasure load: lrc 2024-09-21T12:13:11.009 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: RocksDB version: 7.9.2 2024-09-21T12:13:11.009 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Git sha 0 2024-09-21T12:13:11.009 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Compile date 2024-09-20 20:39:57 2024-09-21T12:13:11.009 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: DB SUMMARY 2024-09-21T12:13:11.009 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: DB Session ID: PBBLSIXB2561MUQ1ULSX 2024-09-21T12:13:11.009 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: CURRENT file: CURRENT 2024-09-21T12:13:11.009 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: IDENTITY file: IDENTITY 2024-09-21T12:13:11.009 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-21T12:13:11.009 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi192/store.db dir, Total Num: 0, files: 2024-09-21T12:13:11.009 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi192/store.db: 000004.log size: 511 ; 2024-09-21T12:13:11.009 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.error_if_exists: 0 2024-09-21T12:13:11.009 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.create_if_missing: 0 2024-09-21T12:13:11.010 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.paranoid_checks: 1 2024-09-21T12:13:11.010 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T12:13:11.010 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T12:13:11.010 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T12:13:11.010 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.env: 0x55f9acdeb940 2024-09-21T12:13:11.010 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.fs: PosixFileSystem 2024-09-21T12:13:11.010 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.info_log: 0x55f9ae5df8c0 2024-09-21T12:13:11.010 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.max_file_opening_threads: 16 2024-09-21T12:13:11.010 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.statistics: (nil) 2024-09-21T12:13:11.010 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.use_fsync: 0 2024-09-21T12:13:11.010 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.max_log_file_size: 0 2024-09-21T12:13:11.010 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T12:13:11.010 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T12:13:11.011 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T12:13:11.011 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T12:13:11.011 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.allow_fallocate: 1 2024-09-21T12:13:11.011 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T12:13:11.011 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T12:13:11.011 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.use_direct_reads: 0 2024-09-21T12:13:11.011 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T12:13:11.011 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T12:13:11.011 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.db_log_dir: 2024-09-21T12:13:11.012 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.wal_dir: 2024-09-21T12:13:11.012 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T12:13:11.013 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T12:13:11.014 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T12:13:11.014 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T12:13:11.014 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T12:13:11.014 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T12:13:11.014 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T12:13:11.014 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T12:13:11.014 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.write_buffer_manager: 0x55f9ae5eedc0 2024-09-21T12:13:11.014 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T12:13:11.014 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T12:13:11.014 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T12:13:11.014 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T12:13:11.014 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T12:13:11.014 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T12:13:11.015 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T12:13:11.015 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T12:13:11.015 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.unordered_write: 0 2024-09-21T12:13:11.015 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T12:13:11.015 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T12:13:11.015 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T12:13:11.015 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T12:13:11.015 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.row_cache: None 2024-09-21T12:13:11.015 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.wal_filter: None 2024-09-21T12:13:11.015 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T12:13:11.015 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T12:13:11.015 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.two_write_queues: 0 2024-09-21T12:13:11.015 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T12:13:11.015 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.wal_compression: 0 2024-09-21T12:13:11.016 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.atomic_flush: 0 2024-09-21T12:13:11.016 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T12:13:11.016 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T12:13:11.016 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T12:13:11.016 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.log_readahead_size: 0 2024-09-21T12:13:11.016 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T12:13:11.016 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T12:13:11.016 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T12:13:11.016 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T12:13:11.016 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T12:13:11.016 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T12:13:11.016 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T12:13:11.016 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.max_background_jobs: 2 2024-09-21T12:13:11.016 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.max_background_compactions: -1 2024-09-21T12:13:11.016 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.max_subcompactions: 1 2024-09-21T12:13:11.017 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T12:13:11.017 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T12:13:11.017 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T12:13:11.017 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T12:13:11.017 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T12:13:11.017 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T12:13:11.017 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T12:13:11.017 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T12:13:11.017 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.max_open_files: -1 2024-09-21T12:13:11.017 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T12:13:11.017 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T12:13:11.017 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T12:13:11.017 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T12:13:11.017 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.max_background_flushes: -1 2024-09-21T12:13:11.017 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Compression algorithms supported: 2024-09-21T12:13:11.018 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: kZSTD supported: 0 2024-09-21T12:13:11.018 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: kXpressCompression supported: 0 2024-09-21T12:13:11.018 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: kBZip2Compression supported: 0 2024-09-21T12:13:11.018 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T12:13:11.018 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: kLZ4Compression supported: 1 2024-09-21T12:13:11.018 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: kZlibCompression supported: 1 2024-09-21T12:13:11.018 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T12:13:11.018 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: kSnappyCompression supported: 1 2024-09-21T12:13:11.018 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T12:13:11.018 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T12:13:11.018 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi192/store.db/MANIFEST-000005 2024-09-21T12:13:11.019 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T12:13:11.019 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T12:13:11.019 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.merge_operator: 2024-09-21T12:13:11.019 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.compaction_filter: None 2024-09-21T12:13:11.019 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T12:13:11.019 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T12:13:11.019 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T12:13:11.019 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T12:13:11.019 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55f9ae5df520) 2024-09-21T12:13:11.019 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: cache_index_and_filter_blocks: 1 2024-09-21T12:13:11.019 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T12:13:11.019 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T12:13:11.019 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: pin_top_level_index_and_filter: 1 2024-09-21T12:13:11.020 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: index_type: 0 2024-09-21T12:13:11.020 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: data_block_index_type: 0 2024-09-21T12:13:11.020 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: index_shortening: 1 2024-09-21T12:13:11.020 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T12:13:11.020 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: checksum: 4 2024-09-21T12:13:11.020 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: no_block_cache: 0 2024-09-21T12:13:11.020 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: block_cache: 0x55f9ae5d31f0 2024-09-21T12:13:11.020 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: block_cache_name: BinnedLRUCache 2024-09-21T12:13:11.020 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: block_cache_options: 2024-09-21T12:13:11.020 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: capacity : 536870912 2024-09-21T12:13:11.020 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: num_shard_bits : 4 2024-09-21T12:13:11.021 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: strict_capacity_limit : 0 2024-09-21T12:13:11.021 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: high_pri_pool_ratio: 0.000 2024-09-21T12:13:11.021 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: block_cache_compressed: (nil) 2024-09-21T12:13:11.021 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: persistent_cache: (nil) 2024-09-21T12:13:11.021 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: block_size: 4096 2024-09-21T12:13:11.021 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: block_size_deviation: 10 2024-09-21T12:13:11.021 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: block_restart_interval: 16 2024-09-21T12:13:11.022 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: index_block_restart_interval: 1 2024-09-21T12:13:11.022 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: metadata_block_size: 4096 2024-09-21T12:13:11.022 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: partition_filters: 0 2024-09-21T12:13:11.022 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: use_delta_encoding: 1 2024-09-21T12:13:11.022 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: filter_policy: bloomfilter 2024-09-21T12:13:11.022 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: whole_key_filtering: 1 2024-09-21T12:13:11.022 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: verify_compression: 0 2024-09-21T12:13:11.023 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: read_amp_bytes_per_bit: 0 2024-09-21T12:13:11.023 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: format_version: 5 2024-09-21T12:13:11.023 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: enable_index_compression: 1 2024-09-21T12:13:11.023 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: block_align: 0 2024-09-21T12:13:11.023 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: max_auto_readahead_size: 262144 2024-09-21T12:13:11.023 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: prepopulate_block_cache: 0 2024-09-21T12:13:11.023 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: initial_auto_readahead_size: 8192 2024-09-21T12:13:11.023 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T12:13:11.024 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T12:13:11.024 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T12:13:11.024 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.compression: NoCompression 2024-09-21T12:13:11.024 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T12:13:11.024 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T12:13:11.024 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T12:13:11.024 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.num_levels: 7 2024-09-21T12:13:11.024 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T12:13:11.025 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T12:13:11.025 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T12:13:11.025 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T12:13:11.025 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T12:13:11.025 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T12:13:11.025 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T12:13:11.025 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T12:13:11.025 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T12:13:11.026 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T12:13:11.026 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T12:13:11.026 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T12:13:11.026 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T12:13:11.026 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T12:13:11.026 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T12:13:11.027 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T12:13:11.027 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T12:13:11.027 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T12:13:11.027 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T12:13:11.027 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T12:13:11.027 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T12:13:11.027 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T12:13:11.028 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T12:13:11.028 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T12:13:11.028 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T12:13:11.028 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T12:13:11.028 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T12:13:11.028 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T12:13:11.028 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T12:13:11.028 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T12:13:11.029 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T12:13:11.029 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T12:13:11.029 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T12:13:11.029 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T12:13:11.029 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T12:13:11.029 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T12:13:11.029 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T12:13:11.029 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T12:13:11.029 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T12:13:11.029 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T12:13:11.029 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T12:13:11.029 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T12:13:11.029 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T12:13:11.029 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T12:13:11.030 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T12:13:11.030 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T12:13:11.030 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T12:13:11.030 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T12:13:11.030 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T12:13:11.030 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T12:13:11.030 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T12:13:11.030 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T12:13:11.030 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T12:13:11.030 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T12:13:11.030 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.inplace_update_support: 0 2024-09-21T12:13:11.030 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T12:13:11.030 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T12:13:11.031 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T12:13:11.031 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T12:13:11.031 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.bloom_locality: 0 2024-09-21T12:13:11.031 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.max_successive_merges: 0 2024-09-21T12:13:11.031 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T12:13:11.031 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T12:13:11.031 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T12:13:11.031 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T12:13:11.031 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.ttl: 2592000 2024-09-21T12:13:11.031 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T12:13:11.031 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T12:13:11.031 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T12:13:11.031 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.enable_blob_files: false 2024-09-21T12:13:11.031 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.min_blob_size: 0 2024-09-21T12:13:11.031 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T12:13:11.032 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T12:13:11.032 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T12:13:11.032 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T12:13:11.032 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T12:13:11.032 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T12:13:11.032 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T12:13:11.032 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T12:13:11.032 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi192/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-21T12:13:11.032 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-21T12:13:11.032 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: a95e49ac-a27b-45ff-96eb-bed58e187fb4 2024-09-21T12:13:11.032 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726920790688174, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-21T12:13:11.032 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-21T12:13:11.032 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726920790688738, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726920790, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "a95e49ac-a27b-45ff-96eb-bed58e187fb4", "db_session_id": "PBBLSIXB2561MUQ1ULSX", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-21T12:13:11.032 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726920790688870, "job": 1, "event": "recovery_finished"} 2024-09-21T12:13:11.033 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-21T12:13:11.033 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi192/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T12:13:11.033 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55f9ae600e00 2024-09-21T12:13:11.033 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: DB pointer 0x55f9ae6fc000 2024-09-21T12:13:11.033 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T12:13:11.033 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T12:13:11.033 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: ** DB Stats ** 2024-09-21T12:13:11.033 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T12:13:11.033 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T12:13:11.033 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T12:13:11.033 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T12:13:11.033 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T12:13:11.034 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T12:13:11.034 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T12:13:11.034 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: 2024-09-21T12:13:11.034 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: ** Compaction Stats [default] ** 2024-09-21T12:13:11.034 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T12:13:11.034 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T12:13:11.034 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T12:13:11.034 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T12:13:11.034 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T12:13:11.034 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: 2024-09-21T12:13:11.034 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: ** Compaction Stats [default] ** 2024-09-21T12:13:11.034 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T12:13:11.034 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T12:13:11.034 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.9 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-21T12:13:11.035 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: 2024-09-21T12:13:11.035 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T12:13:11.035 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: 2024-09-21T12:13:11.035 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T12:13:11.035 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-21T12:13:11.035 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T12:13:11.035 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T12:13:11.035 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T12:13:11.035 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T12:13:11.035 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: Cumulative compaction: 0.00 GB write, 0.44 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T12:13:11.035 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: Interval compaction: 0.00 GB write, 0.44 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T12:13:11.035 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T12:13:11.035 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: Block cache BinnedLRUCache@0x55f9ae5d31f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-21T12:13:11.035 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-21T12:13:11.036 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: 2024-09-21T12:13:11.036 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T12:13:11.036 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: mon.smithi192 does not exist in monmap, will attempt to join an existing cluster 2024-09-21T12:13:11.036 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: using public_addr v2:172.21.15.192:0/0 -> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] 2024-09-21T12:13:11.036 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: starting mon.smithi192 rank -1 at public addrs [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] at bind addrs [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi192 fsid 641beec0-7812-11ef-baf6-efdc52797490 2024-09-21T12:13:11.036 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: mon.smithi192@-1(???) e0 preinit fsid 641beec0-7812-11ef-baf6-efdc52797490 2024-09-21T12:13:11.036 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: mon.smithi192@-1(synchronizing).mds e1 new map 2024-09-21T12:13:11.036 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: mon.smithi192@-1(synchronizing).mds e1 print_map 2024-09-21T12:13:11.036 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: e1 2024-09-21T12:13:11.036 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: btime 2024-09-21T12:10:46:519886+0000 2024-09-21T12:13:11.036 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T12:13:11.036 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:13:11.036 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: legacy client fscid: -1 2024-09-21T12:13:11.036 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: 2024-09-21T12:13:11.037 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: No filesystems configured 2024-09-21T12:13:11.037 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: mon.smithi192@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-21T12:13:11.037 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: mon.smithi192@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-21T12:13:11.037 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: mon.smithi192@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-21T12:13:11.037 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: mon.smithi192@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-21T12:13:11.037 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: mon.smithi192@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-21T12:13:11.037 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: mon.smithi192@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-21T12:13:11.037 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: mon.smithi192@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2024-09-21T12:13:11.037 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: mon.smithi192@-1(synchronizing).osd e5 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-21T12:13:11.037 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: mon.smithi192@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T12:13:11.037 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: mon.smithi192@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T12:13:11.037 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: mon.smithi192@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-09-21T12:13:11.037 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:11.037 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: Added host smithi192 2024-09-21T12:13:11.037 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:11.038 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:11.038 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:11.038 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:11.038 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: Deploying daemon node-exporter.smithi003 on smithi003 2024-09-21T12:13:11.038 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='client.14189 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T12:13:11.038 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:11.038 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:13:11.038 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='client.? 172.21.15.3:0/2563641140' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-21T12:13:11.038 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='client.? 172.21.15.3:0/2563641140' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-21T12:13:11.038 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: osdmap e4: 0 total, 0 up, 0 in 2024-09-21T12:13:11.038 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:13:11.038 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:11.038 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:11.038 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:11.039 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:11.039 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: Deploying daemon alertmanager.smithi003 on smithi003 2024-09-21T12:13:11.039 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='client.14193 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi003:172.21.15.3=smithi003;smithi192:172.21.15.192=smithi192", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:13:11.039 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: Saving service mon spec with placement smithi003:172.21.15.3=smithi003;smithi192:172.21.15.192=smithi192;count:2 2024-09-21T12:13:11.039 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:11.039 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='client.? 172.21.15.192:0/523440861' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:13:11.039 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:13:11.039 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:11.039 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:13:11.039 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='client.? 172.21.15.192:0/3419372985' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:13:11.039 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:13:11.039 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='client.? 172.21.15.192:0/4230133225' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:13:11.039 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:11.039 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:11.039 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:11.040 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:11.040 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:11.040 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:11.040 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: Regenerating cephadm self-signed grafana TLS certificates 2024-09-21T12:13:11.040 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:11.040 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:11.040 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-21T12:13:11.040 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-21T12:13:11.040 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:11.040 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: Deploying daemon grafana.smithi003 on smithi003 2024-09-21T12:13:11.040 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:11.040 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:13:11.040 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='client.? 172.21.15.192:0/4242925929' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:13:11.040 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:13:11.041 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='client.? 172.21.15.192:0/3778532137' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:13:11.041 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:13:11.041 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:13:11.041 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='client.? 172.21.15.192:0/239805742' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:13:11.041 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:13:11.041 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:11.041 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:11.041 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:11.041 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:11.041 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:11.041 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:11.041 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:11.041 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:11.041 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='client.? 172.21.15.192:0/2044550379' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:13:11.042 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: Deploying daemon prometheus.smithi003 on smithi003 2024-09-21T12:13:11.042 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:11.042 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:13:11.042 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='client.? 172.21.15.192:0/980307458' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:13:11.042 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:13:11.042 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='client.? 172.21.15.192:0/4159481583' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:13:11.042 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:13:11.042 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:13:11.042 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='client.? 172.21.15.192:0/2519058767' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:13:11.042 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:13:11.042 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:11.042 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:11.042 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:11.043 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-21T12:13:11.043 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='client.? 172.21.15.192:0/695098604' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:13:11.043 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:11.043 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14162 172.21.15.3:0/2030347724' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-21T12:13:11.043 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: mgrmap e14: smithi003.wztftl(active, since 50s) 2024-09-21T12:13:11.043 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='client.? 172.21.15.192:0/4280872110' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:13:11.043 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='client.? 172.21.15.192:0/2920857771' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:13:11.043 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: Active manager daemon smithi003.wztftl restarted 2024-09-21T12:13:11.043 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: Activating manager daemon smithi003.wztftl 2024-09-21T12:13:11.043 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: osdmap e5: 0 total, 0 up, 0 in 2024-09-21T12:13:11.043 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: mgrmap e15: smithi003.wztftl(active, starting, since 0.00546569s) 2024-09-21T12:13:11.044 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mon metadata", "id": "smithi003"}]: dispatch 2024-09-21T12:13:11.044 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mgr metadata", "who": "smithi003.wztftl", "id": "smithi003.wztftl"}]: dispatch 2024-09-21T12:13:11.044 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-21T12:13:11.044 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-21T12:13:11.044 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-21T12:13:11.044 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: Manager daemon smithi003.wztftl is now available 2024-09-21T12:13:11.044 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:13:11.044 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:11.044 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:13:11.044 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi003.wztftl/mirror_snapshot_schedule"}]: dispatch 2024-09-21T12:13:11.044 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi003.wztftl/trash_purge_schedule"}]: dispatch 2024-09-21T12:13:11.044 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:11.044 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: mgrmap e16: smithi003.wztftl(active, since 1.00621s) 2024-09-21T12:13:11.044 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:11.044 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='client.? 172.21.15.192:0/3694558303' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:13:11.045 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:11.045 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: mgrmap e17: smithi003.wztftl(active, since 2s) 2024-09-21T12:13:11.045 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: [21/Sep/2024:12:12:49] ENGINE Bus STARTING 2024-09-21T12:13:11.045 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: [21/Sep/2024:12:12:49] ENGINE Serving on https://172.21.15.3:7150 2024-09-21T12:13:11.045 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: [21/Sep/2024:12:12:49] ENGINE Error in HTTPServer.serve 2024-09-21T12:13:11.045 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: Traceback (most recent call last): 2024-09-21T12:13:11.045 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T12:13:11.045 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: self._connections.run(self.expiration_interval) 2024-09-21T12:13:11.045 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T12:13:11.045 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: self._run(expiration_interval) 2024-09-21T12:13:11.045 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T12:13:11.046 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T12:13:11.046 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T12:13:11.046 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T12:13:11.046 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T12:13:11.046 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: s = self.context.wrap_socket( 2024-09-21T12:13:11.046 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T12:13:11.047 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: return self.sslsocket_class._create( 2024-09-21T12:13:11.047 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T12:13:11.047 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: self.do_handshake() 2024-09-21T12:13:11.047 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T12:13:11.047 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: self._sslobj.do_handshake() 2024-09-21T12:13:11.047 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T12:13:11.047 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: [21/Sep/2024:12:12:49] ENGINE Serving on http://172.21.15.3:8765 2024-09-21T12:13:11.047 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: [21/Sep/2024:12:12:49] ENGINE Bus STARTED 2024-09-21T12:13:11.047 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:11.047 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:11.047 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='client.? 172.21.15.192:0/2386561246' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:13:11.047 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:11.047 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:11.047 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "who": "osd/host:smithi003", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:13:11.047 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:11.048 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:11.048 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:11.048 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:11.048 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "who": "osd/host:smithi192", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:13:11.048 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:13:11.048 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:13:11.048 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: Updating smithi003:/etc/ceph/ceph.conf 2024-09-21T12:13:11.048 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: Updating smithi192:/etc/ceph/ceph.conf 2024-09-21T12:13:11.048 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: Updating smithi192:/var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T12:13:11.048 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: Updating smithi003:/var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T12:13:11.048 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: Updating smithi192:/etc/ceph/ceph.client.admin.keyring 2024-09-21T12:13:11.048 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: Updating smithi003:/etc/ceph/ceph.client.admin.keyring 2024-09-21T12:13:11.048 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: Updating smithi192:/var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T12:13:11.048 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: Updating smithi003:/var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T12:13:11.049 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:11.049 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:11.049 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:11.049 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:11.049 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:11.049 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi192", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-21T12:13:11.049 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi192", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]': finished 2024-09-21T12:13:11.049 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:13:11.049 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: Deploying daemon ceph-exporter.smithi192 on smithi192 2024-09-21T12:13:11.049 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='client.? 172.21.15.192:0/2986358795' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:13:11.049 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:11.049 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:11.049 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:11.049 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:11.050 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi192", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-21T12:13:11.050 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi192", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-21T12:13:11.050 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:13:11.050 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: Deploying daemon crash.smithi192 on smithi192 2024-09-21T12:13:11.050 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:11.050 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='client.? 172.21.15.192:0/4065284500' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:13:11.050 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:11.050 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:11.050 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:11.050 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:11.050 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: Deploying daemon node-exporter.smithi192 on smithi192 2024-09-21T12:13:11.050 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='client.? 172.21.15.192:0/907303843' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:13:11.050 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:11.051 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:13:11.051 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:11.051 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:11.051 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:11.051 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:11.051 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi192.qsaprd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T12:13:11.051 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi192.qsaprd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-21T12:13:11.051 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T12:13:11.051 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:13:11.051 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: Deploying daemon mgr.smithi192.qsaprd on smithi192 2024-09-21T12:13:11.051 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='client.? 172.21.15.192:0/3607333180' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:13:11.051 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:11.051 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:11.051 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:11.052 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:11.052 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-21T12:13:11.052 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:13:11.052 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: Deploying daemon mon.smithi192 on smithi192 2024-09-21T12:13:11.052 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:11.052 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:13:11.052 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:13:11.052 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: from='client.? 172.21.15.192:0/2255653971' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:13:11.052 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 ceph-mon[35641]: mon.smithi192@-1(synchronizing).paxosservice(auth 1..8) refresh upgraded, format 0 -> 3 2024-09-21T12:13:11.052 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 bash[35606]: 4fe4c4b3dc5dca17a48d8360507baedb5913f7ff9b10cfe68cf53d1887f1530d 2024-09-21T12:13:11.052 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:10 smithi192 systemd[1]: Started Ceph mon.smithi192 for 641beec0-7812-11ef-baf6-efdc52797490. 2024-09-21T12:13:11.386 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-21T12:13:11.386 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph mon dump -f json 2024-09-21T12:13:11.629 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi192/config 2024-09-21T12:13:16.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:15 smithi003 ceph-mon[28057]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:13:16.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:15 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mon metadata", "id": "smithi003"}]: dispatch 2024-09-21T12:13:16.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:15 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mon metadata", "id": "smithi192"}]: dispatch 2024-09-21T12:13:16.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:15 smithi003 ceph-mon[28057]: mon.smithi003 calling monitor election 2024-09-21T12:13:16.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:15 smithi003 ceph-mon[28057]: from='mgr.? 172.21.15.192:0/362570780' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi192.qsaprd/crt"}]: dispatch 2024-09-21T12:13:16.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:15 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mon metadata", "id": "smithi192"}]: dispatch 2024-09-21T12:13:16.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:15 smithi003 ceph-mon[28057]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:13:16.081 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:15 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mon metadata", "id": "smithi192"}]: dispatch 2024-09-21T12:13:16.081 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:15 smithi003 ceph-mon[28057]: mon.smithi192 calling monitor election 2024-09-21T12:13:16.081 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:15 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mon metadata", "id": "smithi192"}]: dispatch 2024-09-21T12:13:16.081 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:15 smithi003 ceph-mon[28057]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:13:16.081 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:15 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mon metadata", "id": "smithi192"}]: dispatch 2024-09-21T12:13:16.081 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:15 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mon metadata", "id": "smithi192"}]: dispatch 2024-09-21T12:13:16.081 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:15 smithi003 ceph-mon[28057]: mon.smithi003 is new leader, mons smithi003,smithi192 in quorum (ranks 0,1) 2024-09-21T12:13:16.081 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:15 smithi003 ceph-mon[28057]: monmap epoch 2 2024-09-21T12:13:16.081 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:15 smithi003 ceph-mon[28057]: fsid 641beec0-7812-11ef-baf6-efdc52797490 2024-09-21T12:13:16.081 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:15 smithi003 ceph-mon[28057]: last_changed 2024-09-21T12:13:10.719146+0000 2024-09-21T12:13:16.081 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:15 smithi003 ceph-mon[28057]: created 2024-09-21T12:10:43.597094+0000 2024-09-21T12:13:16.081 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:15 smithi003 ceph-mon[28057]: min_mon_release 19 (squid) 2024-09-21T12:13:16.081 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:15 smithi003 ceph-mon[28057]: election_strategy: 1 2024-09-21T12:13:16.081 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:15 smithi003 ceph-mon[28057]: 0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.smithi003 2024-09-21T12:13:16.082 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:15 smithi003 ceph-mon[28057]: 1: [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] mon.smithi192 2024-09-21T12:13:16.082 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:15 smithi003 ceph-mon[28057]: fsmap 2024-09-21T12:13:16.082 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:15 smithi003 ceph-mon[28057]: osdmap e5: 0 total, 0 up, 0 in 2024-09-21T12:13:16.082 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:15 smithi003 ceph-mon[28057]: mgrmap e17: smithi003.wztftl(active, since 29s) 2024-09-21T12:13:16.082 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:15 smithi003 ceph-mon[28057]: overall HEALTH_OK 2024-09-21T12:13:16.082 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:15 smithi003 ceph-mon[28057]: Standby manager daemon smithi192.qsaprd started 2024-09-21T12:13:16.082 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:15 smithi003 ceph-mon[28057]: from='mgr.? 172.21.15.192:0/362570780' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T12:13:16.082 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:15 smithi003 ceph-mon[28057]: from='mgr.? 172.21.15.192:0/362570780' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi192.qsaprd/key"}]: dispatch 2024-09-21T12:13:16.082 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:15 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:16.082 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:15 smithi003 ceph-mon[28057]: from='mgr.? 172.21.15.192:0/362570780' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T12:13:16.082 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:15 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:16.082 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:15 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:16.082 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:15 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:16.083 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:15 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:16.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:15 smithi192 ceph-mon[35641]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:13:16.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:15 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mon metadata", "id": "smithi003"}]: dispatch 2024-09-21T12:13:16.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:15 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mon metadata", "id": "smithi192"}]: dispatch 2024-09-21T12:13:16.259 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:15 smithi192 ceph-mon[35641]: mon.smithi003 calling monitor election 2024-09-21T12:13:16.259 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:15 smithi192 ceph-mon[35641]: from='mgr.? 172.21.15.192:0/362570780' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi192.qsaprd/crt"}]: dispatch 2024-09-21T12:13:16.259 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:15 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mon metadata", "id": "smithi192"}]: dispatch 2024-09-21T12:13:16.259 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:15 smithi192 ceph-mon[35641]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:13:16.259 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:15 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mon metadata", "id": "smithi192"}]: dispatch 2024-09-21T12:13:16.259 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:15 smithi192 ceph-mon[35641]: mon.smithi192 calling monitor election 2024-09-21T12:13:16.259 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:15 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mon metadata", "id": "smithi192"}]: dispatch 2024-09-21T12:13:16.260 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:15 smithi192 ceph-mon[35641]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:13:16.260 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:15 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mon metadata", "id": "smithi192"}]: dispatch 2024-09-21T12:13:16.260 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:15 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mon metadata", "id": "smithi192"}]: dispatch 2024-09-21T12:13:16.260 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:15 smithi192 ceph-mon[35641]: mon.smithi003 is new leader, mons smithi003,smithi192 in quorum (ranks 0,1) 2024-09-21T12:13:16.260 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:15 smithi192 ceph-mon[35641]: monmap epoch 2 2024-09-21T12:13:16.260 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:15 smithi192 ceph-mon[35641]: fsid 641beec0-7812-11ef-baf6-efdc52797490 2024-09-21T12:13:16.260 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:15 smithi192 ceph-mon[35641]: last_changed 2024-09-21T12:13:10.719146+0000 2024-09-21T12:13:16.260 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:15 smithi192 ceph-mon[35641]: created 2024-09-21T12:10:43.597094+0000 2024-09-21T12:13:16.261 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:15 smithi192 ceph-mon[35641]: min_mon_release 19 (squid) 2024-09-21T12:13:16.261 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:15 smithi192 ceph-mon[35641]: election_strategy: 1 2024-09-21T12:13:16.261 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:15 smithi192 ceph-mon[35641]: 0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.smithi003 2024-09-21T12:13:16.261 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:15 smithi192 ceph-mon[35641]: 1: [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] mon.smithi192 2024-09-21T12:13:16.261 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:15 smithi192 ceph-mon[35641]: fsmap 2024-09-21T12:13:16.261 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:15 smithi192 ceph-mon[35641]: osdmap e5: 0 total, 0 up, 0 in 2024-09-21T12:13:16.261 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:15 smithi192 ceph-mon[35641]: mgrmap e17: smithi003.wztftl(active, since 29s) 2024-09-21T12:13:16.261 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:15 smithi192 ceph-mon[35641]: overall HEALTH_OK 2024-09-21T12:13:16.262 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:15 smithi192 ceph-mon[35641]: Standby manager daemon smithi192.qsaprd started 2024-09-21T12:13:16.262 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:15 smithi192 ceph-mon[35641]: from='mgr.? 172.21.15.192:0/362570780' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T12:13:16.262 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:15 smithi192 ceph-mon[35641]: from='mgr.? 172.21.15.192:0/362570780' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi192.qsaprd/key"}]: dispatch 2024-09-21T12:13:16.262 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:15 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:16.262 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:15 smithi192 ceph-mon[35641]: from='mgr.? 172.21.15.192:0/362570780' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T12:13:16.262 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:15 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:16.262 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:15 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:16.262 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:15 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:16.263 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:15 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:16.746 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:13:16.746 INFO:teuthology.orchestra.run.smithi192.stdout:{"epoch":2,"fsid":"641beec0-7812-11ef-baf6-efdc52797490","modified":"2024-09-21T12:13:10.719146Z","created":"2024-09-21T12:10:43.597094Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"smithi003","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:3300","nonce":0},{"type":"v1","addr":"172.21.15.3:6789","nonce":0}]},"addr":"172.21.15.3:6789/0","public_addr":"172.21.15.3:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi192","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:3300","nonce":0},{"type":"v1","addr":"172.21.15.192:6789","nonce":0}]},"addr":"172.21.15.192:6789/0","public_addr":"172.21.15.192:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-21T12:13:16.746 INFO:teuthology.orchestra.run.smithi192.stderr:dumped monmap epoch 2 2024-09-21T12:13:17.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:16 smithi192 ceph-mon[35641]: mgrmap e18: smithi003.wztftl(active, since 29s), standbys: smithi192.qsaprd 2024-09-21T12:13:17.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:16 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mgr metadata", "who": "smithi192.qsaprd", "id": "smithi192.qsaprd"}]: dispatch 2024-09-21T12:13:17.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:16 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:13:17.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:16 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:13:17.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:16 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:17.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:16 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mon metadata", "id": "smithi192"}]: dispatch 2024-09-21T12:13:17.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:16 smithi192 ceph-mon[35641]: from='client.? 172.21.15.192:0/436559181' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:13:17.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:16 smithi003 ceph-mon[28057]: mgrmap e18: smithi003.wztftl(active, since 29s), standbys: smithi192.qsaprd 2024-09-21T12:13:17.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:16 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mgr metadata", "who": "smithi192.qsaprd", "id": "smithi192.qsaprd"}]: dispatch 2024-09-21T12:13:17.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:16 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:13:17.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:16 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:13:17.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:16 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:17.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:16 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mon metadata", "id": "smithi192"}]: dispatch 2024-09-21T12:13:17.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:16 smithi003 ceph-mon[28057]: from='client.? 172.21.15.192:0/436559181' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-21T12:13:17.361 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-21T12:13:17.361 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph config generate-minimal-conf 2024-09-21T12:13:17.633 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:13:17.979 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:17 smithi003 ceph-mon[28057]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:13:18.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:17 smithi192 ceph-mon[35641]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:13:18.280 INFO:teuthology.orchestra.run.smithi003.stdout:# minimal ceph.conf for 641beec0-7812-11ef-baf6-efdc52797490 2024-09-21T12:13:18.280 INFO:teuthology.orchestra.run.smithi003.stdout:[global] 2024-09-21T12:13:18.280 INFO:teuthology.orchestra.run.smithi003.stdout: fsid = 641beec0-7812-11ef-baf6-efdc52797490 2024-09-21T12:13:18.280 INFO:teuthology.orchestra.run.smithi003.stdout: mon_host = [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] 2024-09-21T12:13:19.015 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-21T12:13:19.015 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-09-21T12:13:19.015 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T12:13:19.044 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-09-21T12:13:19.044 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T12:13:19.111 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-21T12:13:19.111 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/etc/ceph/ceph.conf 2024-09-21T12:13:19.139 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-21T12:13:19.140 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-21T12:13:19.205 INFO:tasks.cephadm:setting config [client] client_mount_timeout = 600 2024-09-21T12:13:19.205 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph config set client client_mount_timeout 600 2024-09-21T12:13:19.208 INFO:tasks.cephadm:setting config [client] debug_client = 20 2024-09-21T12:13:19.208 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph config set client debug_client 20 2024-09-21T12:13:19.251 INFO:tasks.cephadm:setting config [client] debug_ms = 1 2024-09-21T12:13:19.251 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph config set client debug_ms 1 2024-09-21T12:13:19.271 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:19 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:19.271 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:19 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:19.271 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:19 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:13:19.271 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:19 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:13:19.271 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:19 smithi003 ceph-mon[28057]: Updating smithi003:/etc/ceph/ceph.conf 2024-09-21T12:13:19.271 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:19 smithi003 ceph-mon[28057]: Updating smithi192:/etc/ceph/ceph.conf 2024-09-21T12:13:19.271 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:19 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/2738606364' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:13:19.272 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:19 smithi003 ceph-mon[28057]: Updating smithi192:/var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T12:13:19.272 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:19 smithi003 ceph-mon[28057]: Updating smithi003:/var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T12:13:19.272 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:19 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:19.272 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:19 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:19.272 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:19 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:19.272 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:19 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:19.272 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:19 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:19.272 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:19 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-21T12:13:19.272 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:19 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-21T12:13:19.272 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:19 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:13:19.273 INFO:tasks.cephadm:setting config [client] rados_mon_op_timeout = 900 2024-09-21T12:13:19.273 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph config set client rados_mon_op_timeout 900 2024-09-21T12:13:19.316 INFO:tasks.cephadm:setting config [client] rados_osd_op_timeout = 900 2024-09-21T12:13:19.317 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph config set client rados_osd_op_timeout 900 2024-09-21T12:13:19.361 INFO:tasks.cephadm:setting config [mds] debug_mds = 20 2024-09-21T12:13:19.361 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph config set mds debug_mds 20 2024-09-21T12:13:19.404 INFO:tasks.cephadm:setting config [mds] debug_mds_balancer = 20 2024-09-21T12:13:19.405 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph config set mds debug_mds_balancer 20 2024-09-21T12:13:19.448 INFO:tasks.cephadm:setting config [mds] debug_ms = 2 2024-09-21T12:13:19.449 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph config set mds debug_ms 2 2024-09-21T12:13:19.492 INFO:tasks.cephadm:setting config [mds] mds_debug_frag = True 2024-09-21T12:13:19.492 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph config set mds mds_debug_frag True 2024-09-21T12:13:19.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:19 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:19.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:19 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:19.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:19 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:13:19.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:19 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:13:19.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:19 smithi192 ceph-mon[35641]: Updating smithi003:/etc/ceph/ceph.conf 2024-09-21T12:13:19.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:19 smithi192 ceph-mon[35641]: Updating smithi192:/etc/ceph/ceph.conf 2024-09-21T12:13:19.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:19 smithi192 ceph-mon[35641]: from='client.? 172.21.15.3:0/2738606364' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:13:19.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:19 smithi192 ceph-mon[35641]: Updating smithi192:/var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T12:13:19.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:19 smithi192 ceph-mon[35641]: Updating smithi003:/var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T12:13:19.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:19 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:19.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:19 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:19.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:19 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:19.509 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:19 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:19.509 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:19 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:19.509 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:19 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-21T12:13:19.509 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:19 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-21T12:13:19.509 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:19 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:13:19.540 INFO:tasks.cephadm:setting config [mds] mds_debug_scatterstat = True 2024-09-21T12:13:19.541 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph config set mds mds_debug_scatterstat True 2024-09-21T12:13:19.584 INFO:tasks.cephadm:setting config [mds] mds_op_complaint_time = 180 2024-09-21T12:13:19.584 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph config set mds mds_op_complaint_time 180 2024-09-21T12:13:19.627 INFO:tasks.cephadm:setting config [mds] mds_verify_scatter = True 2024-09-21T12:13:19.628 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph config set mds mds_verify_scatter True 2024-09-21T12:13:19.670 INFO:tasks.cephadm:setting config [mds] osd_op_complaint_time = 180 2024-09-21T12:13:19.671 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph config set mds osd_op_complaint_time 180 2024-09-21T12:13:19.713 INFO:tasks.cephadm:setting config [mds] rados_mon_op_timeout = 900 2024-09-21T12:13:19.714 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph config set mds rados_mon_op_timeout 900 2024-09-21T12:13:19.756 INFO:tasks.cephadm:setting config [mds] rados_osd_op_timeout = 900 2024-09-21T12:13:19.757 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph config set mds rados_osd_op_timeout 900 2024-09-21T12:13:19.800 INFO:tasks.cephadm:setting config [mon] mon_op_complaint_time = 120 2024-09-21T12:13:19.800 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph config set mon mon_op_complaint_time 120 2024-09-21T12:13:19.853 INFO:tasks.cephadm:setting config [mon] mon_warn_on_pool_no_app = False 2024-09-21T12:13:19.853 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph config set mon mon_warn_on_pool_no_app False 2024-09-21T12:13:19.905 INFO:tasks.cephadm:setting config [osd] osd_op_complaint_time = 180 2024-09-21T12:13:19.905 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph config set osd osd_op_complaint_time 180 2024-09-21T12:13:19.949 DEBUG:tasks.cephadm:set 18 configs 2024-09-21T12:13:19.949 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '641beec0-7812-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi003') 2024-09-21T12:13:20.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:20 smithi192 ceph-mon[35641]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:13:20.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:20 smithi192 ceph-mon[35641]: Reconfiguring mon.smithi003 (unknown last config time)... 2024-09-21T12:13:20.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:20 smithi192 ceph-mon[35641]: Reconfiguring daemon mon.smithi003 on smithi003 2024-09-21T12:13:20.534 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:13:20.537 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:13:20.537 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:13:20.537 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:13:20.546 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:13:20.555 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:13:20.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:20 smithi003 ceph-mon[28057]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:13:20.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:20 smithi003 ceph-mon[28057]: Reconfiguring mon.smithi003 (unknown last config time)... 2024-09-21T12:13:20.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:20 smithi003 ceph-mon[28057]: Reconfiguring daemon mon.smithi003 on smithi003 2024-09-21T12:13:20.591 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:13:20.643 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:13:20.655 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:13:21.536 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:21 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:21.536 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:21 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:21.536 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:21 smithi003 ceph-mon[28057]: Reconfiguring mgr.smithi003.wztftl (unknown last config time)... 2024-09-21T12:13:21.536 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:21 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi003.wztftl", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T12:13:21.536 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:21 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T12:13:21.536 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:21 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:13:21.537 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:21 smithi003 ceph-mon[28057]: Reconfiguring daemon mgr.smithi003.wztftl on smithi003 2024-09-21T12:13:21.537 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:21 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/720182812' entity='client.admin' 2024-09-21T12:13:21.718 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:13:21.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:21 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:21.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:21 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:21.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:21 smithi192 ceph-mon[35641]: Reconfiguring mgr.smithi003.wztftl (unknown last config time)... 2024-09-21T12:13:21.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:21 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi003.wztftl", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T12:13:21.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:21 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T12:13:21.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:21 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:13:21.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:21 smithi192 ceph-mon[35641]: Reconfiguring daemon mgr.smithi003.wztftl on smithi003 2024-09-21T12:13:21.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:21 smithi192 ceph-mon[35641]: from='client.? 172.21.15.3:0/720182812' entity='client.admin' 2024-09-21T12:13:22.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:22 smithi192 ceph-mon[35641]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:13:22.781 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:22 smithi003 ceph-mon[28057]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:13:22.950 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '641beec0-7812-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi003') 2024-09-21T12:13:24.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:24 smithi192 ceph-mon[35641]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:13:24.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:24 smithi192 ceph-mon[35641]: from='client.? 172.21.15.3:0/3368538302' entity='client.admin' 2024-09-21T12:13:24.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:24 smithi192 ceph-mon[35641]: from='client.? 172.21.15.3:0/4205353937' entity='client.admin' 2024-09-21T12:13:24.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:24 smithi192 ceph-mon[35641]: from='client.? 172.21.15.3:0/2371906684' entity='client.admin' 2024-09-21T12:13:24.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:24 smithi192 ceph-mon[35641]: from='client.? 172.21.15.3:0/3653551682' entity='client.admin' 2024-09-21T12:13:24.768 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:24.764+0000 7fdf3a3b0640 1 -- 172.21.15.3:0/3989163045 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fdf2006e280 msgr2=0x7fdf20070740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:24.768 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:24.764+0000 7fdf3a3b0640 1 --2- 172.21.15.3:0/3989163045 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fdf2006e280 0x7fdf20070740 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fdf24000c00 tx=0x7fdf24004d60 comp rx=0 tx=0).stop 2024-09-21T12:13:24.768 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:24.764+0000 7fdf3a3b0640 1 -- 172.21.15.3:0/3989163045 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf34101a60 msgr2=0x7fdf341977f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:24.768 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:24.764+0000 7fdf3a3b0640 1 --2- 172.21.15.3:0/3989163045 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf34101a60 0x7fdf341977f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c00d6f0 tx=0x7fdf1c00dbb0 comp rx=0 tx=0).stop 2024-09-21T12:13:24.768 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:24.765+0000 7fdf3a3b0640 1 -- 172.21.15.3:0/3989163045 shutdown_connections 2024-09-21T12:13:24.768 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:24.765+0000 7fdf3a3b0640 1 --2- 172.21.15.3:0/3989163045 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fdf2006e280 0x7fdf20070740 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:24.768 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:24.765+0000 7fdf3a3b0640 1 --2- 172.21.15.3:0/3989163045 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf34101a60 0x7fdf341977f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:24.768 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:24.765+0000 7fdf3a3b0640 1 --2- 172.21.15.3:0/3989163045 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf34100860 0x7fdf341972b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:24.768 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:24.765+0000 7fdf3a3b0640 1 -- 172.21.15.3:0/3989163045 >> 172.21.15.3:0/3989163045 conn(0x7fdf340fc010 msgr2=0x7fdf34069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:13:24.768 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:24.765+0000 7fdf3a3b0640 1 -- 172.21.15.3:0/3989163045 shutdown_connections 2024-09-21T12:13:24.769 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:24 smithi003 ceph-mon[28057]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:13:24.769 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:24 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/3368538302' entity='client.admin' 2024-09-21T12:13:24.769 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:24 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/4205353937' entity='client.admin' 2024-09-21T12:13:24.769 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:24 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/2371906684' entity='client.admin' 2024-09-21T12:13:24.769 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:24 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/3653551682' entity='client.admin' 2024-09-21T12:13:24.769 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:24.765+0000 7fdf3a3b0640 1 -- 172.21.15.3:0/3989163045 wait complete. 2024-09-21T12:13:25.388 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:25.351+0000 7f8e15887640 1 -- 172.21.15.3:0/2026271508 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8e10100b20 msgr2=0x7f8e10100f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:25.388 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:25.351+0000 7f8e15887640 1 --2- 172.21.15.3:0/2026271508 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8e10100b20 0x7f8e10100f80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8df8009880 tx=0x7f8df802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:13:25.388 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:25.351+0000 7f8e15887640 1 -- 172.21.15.3:0/2026271508 shutdown_connections 2024-09-21T12:13:25.388 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:25.351+0000 7f8e15887640 1 --2- 172.21.15.3:0/2026271508 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8e10100b20 0x7f8e10100f80 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:25.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:25.351+0000 7f8e15887640 1 --2- 172.21.15.3:0/2026271508 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8e101001e0 0x7f8e101005e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:25.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:25.351+0000 7f8e15887640 1 -- 172.21.15.3:0/2026271508 >> 172.21.15.3:0/2026271508 conn(0x7f8e100fc010 msgr2=0x7f8e100fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:13:25.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:25.351+0000 7f8e15887640 1 -- 172.21.15.3:0/2026271508 shutdown_connections 2024-09-21T12:13:25.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:25.351+0000 7f8e15887640 1 -- 172.21.15.3:0/2026271508 wait complete. 2024-09-21T12:13:25.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:25.352+0000 7f8e15887640 1 Processor -- start 2024-09-21T12:13:25.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:25.352+0000 7f8e15887640 1 -- start start 2024-09-21T12:13:25.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:25.352+0000 7f8e15887640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8e101001e0 0x7f8e10199500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:25.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:25.352+0000 7f8e15887640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8e10100b20 0x7f8e10199a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:25.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:25.352+0000 7f8e15887640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f8e1010c780 con 0x7f8e101001e0 2024-09-21T12:13:25.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:25.352+0000 7f8e15887640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8e1010c600 con 0x7f8e10100b20 2024-09-21T12:13:25.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:25.352+0000 7f8e0effd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8e101001e0 0x7f8e10199500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:25.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:25.352+0000 7f8e0effd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8e101001e0 0x7f8e10199500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50642/0 (socket says 172.21.15.3:50642) 2024-09-21T12:13:25.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:25.352+0000 7f8e0effd640 1 -- 172.21.15.3:0/789669678 learned_addr learned my addr 172.21.15.3:0/789669678 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:13:25.390 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:25.352+0000 7f8e07fff640 1 --2- 172.21.15.3:0/789669678 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8e10100b20 0x7f8e10199a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:25.390 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:25.352+0000 7f8e0effd640 1 -- 172.21.15.3:0/789669678 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8e10100b20 msgr2=0x7f8e10199a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:25.390 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:25.352+0000 7f8e0effd640 1 --2- 172.21.15.3:0/789669678 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8e10100b20 0x7f8e10199a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:25.390 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:25.352+0000 7f8e0effd640 1 -- 172.21.15.3:0/789669678 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e1019a0c0 con 0x7f8e101001e0 2024-09-21T12:13:25.390 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:25.353+0000 7f8e0effd640 1 --2- 172.21.15.3:0/789669678 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8e101001e0 0x7f8e10199500 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8e0000d6f0 tx=0x7f8e0000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:13:25.390 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:25.353+0000 7f8e14885640 1 -- 172.21.15.3:0/789669678 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8e00017070 con 0x7f8e101001e0 2024-09-21T12:13:25.390 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:25.353+0000 7f8e14885640 1 -- 172.21.15.3:0/789669678 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1053+0+0 (secure 0 0 0) 0x7f8e0000de00 con 0x7f8e101001e0 2024-09-21T12:13:25.390 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:25.353+0000 7f8e15887640 1 -- 172.21.15.3:0/789669678 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e1019eb00 con 0x7f8e101001e0 2024-09-21T12:13:25.390 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:25.353+0000 7f8e14885640 1 -- 172.21.15.3:0/789669678 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8e00004a80 con 0x7f8e101001e0 2024-09-21T12:13:25.390 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:25.353+0000 7f8e15887640 1 -- 172.21.15.3:0/789669678 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e1019f090 con 0x7f8e101001e0 2024-09-21T12:13:25.390 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:25.354+0000 7f8e15887640 1 -- 172.21.15.3:0/789669678 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e1010cf60 con 0x7f8e101001e0 2024-09-21T12:13:25.390 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:25.354+0000 7f8e14885640 1 -- 172.21.15.3:0/789669678 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 18) ==== 92493+0+0 (secure 0 0 0) 0x7f8e00009a30 con 0x7f8e101001e0 2024-09-21T12:13:25.390 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:25.355+0000 7f8e14885640 1 --2- 172.21.15.3:0/789669678 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f8dfc06e280 0x7f8dfc070740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:25.390 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:25.355+0000 7f8e14885640 1 -- 172.21.15.3:0/789669678 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f8e0008cc60 con 0x7f8e101001e0 2024-09-21T12:13:25.391 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:25.355+0000 7f8e07fff640 1 --2- 172.21.15.3:0/789669678 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f8dfc06e280 0x7f8dfc070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:25.391 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:25.356+0000 7f8e07fff640 1 --2- 172.21.15.3:0/789669678 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f8dfc06e280 0x7f8dfc070740 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8df80096c0 tx=0x7f8df8004e10 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:13:25.391 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:25.359+0000 7f8e14885640 1 -- 172.21.15.3:0/789669678 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8e0005b720 con 0x7f8e101001e0 2024-09-21T12:13:25.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:25.536+0000 7f8e15887640 1 -- 172.21.15.3:0/789669678 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command([{prefix=config set, name=debug_client}] v 0) -- 0x7f8e1002da30 con 0x7f8e101001e0 2024-09-21T12:13:25.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:25.539+0000 7f8e14885640 1 -- 172.21.15.3:0/789669678 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_client}]=0 v18)=0 v18) ==== 114+0+0 (secure 0 0 0) 0x7f8e0005f3d0 con 0x7f8e101001e0 2024-09-21T12:13:25.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:25.540+0000 7f8e14885640 1 -- 172.21.15.3:0/789669678 <== mon.0 v2:172.21.15.3:3300/0 8 ==== config(26 keys) ==== 1078+0+0 (secure 0 0 0) 0x7f8e00063c00 con 0x7f8e101001e0 2024-09-21T12:13:25.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:25.541+0000 7f8e15887640 1 -- 172.21.15.3:0/789669678 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f8dfc06e280 msgr2=0x7f8dfc070740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:25.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:25.541+0000 7f8e15887640 1 --2- 172.21.15.3:0/789669678 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f8dfc06e280 0x7f8dfc070740 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f8df80096c0 tx=0x7f8df8004e10 comp rx=0 tx=0).stop 2024-09-21T12:13:25.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:25.541+0000 7f8e15887640 1 -- 172.21.15.3:0/789669678 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8e101001e0 msgr2=0x7f8e10199500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:25.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:25.541+0000 7f8e15887640 1 --2- 172.21.15.3:0/789669678 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8e101001e0 0x7f8e10199500 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8e0000d6f0 tx=0x7f8e0000dbb0 comp rx=0 tx=0).stop 2024-09-21T12:13:25.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:25.541+0000 7f8e15887640 1 -- 172.21.15.3:0/789669678 shutdown_connections 2024-09-21T12:13:25.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:25.541+0000 7f8e15887640 1 --2- 172.21.15.3:0/789669678 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f8dfc06e280 0x7f8dfc070740 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:25.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:25.541+0000 7f8e15887640 1 --2- 172.21.15.3:0/789669678 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8e10100b20 0x7f8e10199a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:25.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:25.541+0000 7f8e15887640 1 --2- 172.21.15.3:0/789669678 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8e101001e0 0x7f8e10199500 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:25.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:25.541+0000 7f8e15887640 1 -- 172.21.15.3:0/789669678 >> 172.21.15.3:0/789669678 conn(0x7f8e100fc010 msgr2=0x7f8e10108af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:13:25.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:25.541+0000 7f8e15887640 1 -- 172.21.15.3:0/789669678 shutdown_connections 2024-09-21T12:13:25.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:25.541+0000 7f8e15887640 1 -- 172.21.15.3:0/789669678 wait complete. 2024-09-21T12:13:25.822 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:24.973+0000 7f1020938640 1 -- 172.21.15.3:0/3854322124 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f101c101960 msgr2=0x7f101c101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:25.822 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:24.973+0000 7f1020938640 1 --2- 172.21.15.3:0/3854322124 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f101c101960 0x7f101c101d60 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f100c009880 tx=0x7f100c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:13:25.822 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:24.973+0000 7f1020938640 1 -- 172.21.15.3:0/3854322124 shutdown_connections 2024-09-21T12:13:25.822 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:24.973+0000 7f1020938640 1 --2- 172.21.15.3:0/3854322124 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f101c102b60 0x7f101c102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:25.822 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:24.973+0000 7f1020938640 1 --2- 172.21.15.3:0/3854322124 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f101c101960 0x7f101c101d60 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:25.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:24.973+0000 7f1020938640 1 -- 172.21.15.3:0/3854322124 >> 172.21.15.3:0/3854322124 conn(0x7f101c0fd0f0 msgr2=0x7f101c0ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:13:25.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:24.973+0000 7f1020938640 1 -- 172.21.15.3:0/3854322124 shutdown_connections 2024-09-21T12:13:25.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:24.973+0000 7f1020938640 1 -- 172.21.15.3:0/3854322124 wait complete. 2024-09-21T12:13:25.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:24.974+0000 7f1020938640 1 Processor -- start 2024-09-21T12:13:25.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:24.974+0000 7f1020938640 1 -- start start 2024-09-21T12:13:25.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:24.974+0000 7f1020938640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f101c101960 0x7f101c1973f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:25.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:24.974+0000 7f1020938640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f101c102b60 0x7f101c197930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:25.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:24.974+0000 7f1020938640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f101c10a5f0 con 0x7f101c102b60 2024-09-21T12:13:25.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:24.974+0000 7f1020938640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f101c10a470 con 0x7f101c101960 2024-09-21T12:13:25.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:24.974+0000 7f1011d9b640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f101c102b60 0x7f101c197930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:25.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:24.974+0000 7f1011d9b640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f101c102b60 0x7f101c197930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50632/0 (socket says 172.21.15.3:50632) 2024-09-21T12:13:25.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:24.974+0000 7f1011d9b640 1 -- 172.21.15.3:0/127190220 learned_addr learned my addr 172.21.15.3:0/127190220 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:13:25.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:24.974+0000 7f1011d9b640 1 -- 172.21.15.3:0/127190220 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f101c101960 msgr2=0x7f101c1973f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:25.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:24.974+0000 7f101a59c640 1 --2- 172.21.15.3:0/127190220 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f101c101960 0x7f101c1973f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:25.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:24.974+0000 7f1011d9b640 1 --2- 172.21.15.3:0/127190220 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f101c101960 0x7f101c1973f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:25.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:24.974+0000 7f1011d9b640 1 -- 172.21.15.3:0/127190220 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f101c197fb0 con 0x7f101c102b60 2024-09-21T12:13:25.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:24.975+0000 7f1011d9b640 1 --2- 172.21.15.3:0/127190220 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f101c102b60 0x7f101c197930 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f100400b420 tx=0x7f100400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:13:25.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:24.975+0000 7f1013fff640 1 -- 172.21.15.3:0/127190220 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1004011630 con 0x7f101c102b60 2024-09-21T12:13:25.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:24.975+0000 7f1013fff640 1 -- 172.21.15.3:0/127190220 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(25 keys) ==== 1053+0+0 (secure 0 0 0) 0x7f1004016070 con 0x7f101c102b60 2024-09-21T12:13:25.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:24.975+0000 7f1020938640 1 -- 172.21.15.3:0/127190220 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f101c19c9f0 con 0x7f101c102b60 2024-09-21T12:13:25.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:24.975+0000 7f1013fff640 1 -- 172.21.15.3:0/127190220 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1004010c00 con 0x7f101c102b60 2024-09-21T12:13:25.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:24.975+0000 7f1020938640 1 -- 172.21.15.3:0/127190220 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f101c19d000 con 0x7f101c102b60 2024-09-21T12:13:25.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:24.976+0000 7f1020938640 1 -- 172.21.15.3:0/127190220 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f101c10add0 con 0x7f101c102b60 2024-09-21T12:13:25.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:24.976+0000 7f1013fff640 1 -- 172.21.15.3:0/127190220 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 18) ==== 92493+0+0 (secure 0 0 0) 0x7f10040117d0 con 0x7f101c102b60 2024-09-21T12:13:25.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:24.977+0000 7f1013fff640 1 --2- 172.21.15.3:0/127190220 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f100806e280 0x7f1008070740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:25.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:24.977+0000 7f101a59c640 1 --2- 172.21.15.3:0/127190220 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f100806e280 0x7f1008070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:25.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:24.977+0000 7f1013fff640 1 -- 172.21.15.3:0/127190220 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f100408c880 con 0x7f101c102b60 2024-09-21T12:13:25.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:24.977+0000 7f101a59c640 1 --2- 172.21.15.3:0/127190220 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f100806e280 0x7f1008070740 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f100c0096c0 tx=0x7f100c004e10 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:13:25.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:24.981+0000 7f1013fff640 1 -- 172.21.15.3:0/127190220 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f100405b340 con 0x7f101c102b60 2024-09-21T12:13:25.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:25.165+0000 7f1020938640 1 -- 172.21.15.3:0/127190220 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f101c191400 con 0x7f101c102b60 2024-09-21T12:13:25.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:25.169+0000 7f1013fff640 1 -- 172.21.15.3:0/127190220 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v17)=0 v17) ==== 121+0+0 (secure 0 0 0) 0x7f100405eff0 con 0x7f101c102b60 2024-09-21T12:13:25.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:25.171+0000 7f1020938640 1 -- 172.21.15.3:0/127190220 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f100806e280 msgr2=0x7f1008070740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:25.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:25.171+0000 7f1020938640 1 --2- 172.21.15.3:0/127190220 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f100806e280 0x7f1008070740 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f100c0096c0 tx=0x7f100c004e10 comp rx=0 tx=0).stop 2024-09-21T12:13:25.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:25.171+0000 7f1020938640 1 -- 172.21.15.3:0/127190220 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f101c102b60 msgr2=0x7f101c197930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:25.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:25.171+0000 7f1020938640 1 --2- 172.21.15.3:0/127190220 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f101c102b60 0x7f101c197930 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f100400b420 tx=0x7f100400b8e0 comp rx=0 tx=0).stop 2024-09-21T12:13:25.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:25.171+0000 7f1020938640 1 -- 172.21.15.3:0/127190220 shutdown_connections 2024-09-21T12:13:25.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:25.171+0000 7f1020938640 1 --2- 172.21.15.3:0/127190220 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f100806e280 0x7f1008070740 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:25.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:25.171+0000 7f1020938640 1 --2- 172.21.15.3:0/127190220 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f101c102b60 0x7f101c197930 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:25.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:25.171+0000 7f1020938640 1 --2- 172.21.15.3:0/127190220 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f101c101960 0x7f101c1973f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:25.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:25.171+0000 7f1020938640 1 -- 172.21.15.3:0/127190220 >> 172.21.15.3:0/127190220 conn(0x7f101c0fd0f0 msgr2=0x7f101c106110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:13:25.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:25.171+0000 7f1020938640 1 -- 172.21.15.3:0/127190220 shutdown_connections 2024-09-21T12:13:25.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:25.171+0000 7f1020938640 1 -- 172.21.15.3:0/127190220 wait complete. 2024-09-21T12:13:25.983 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:25 smithi003 ceph-mon[28057]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:13:25.983 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:25 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/3989163045' entity='client.admin' 2024-09-21T12:13:25.983 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:25 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/127190220' entity='client.admin' 2024-09-21T12:13:25.983 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:25 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/789669678' entity='client.admin' 2024-09-21T12:13:26.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:25 smithi192 ceph-mon[35641]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:13:26.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:25 smithi192 ceph-mon[35641]: from='client.? 172.21.15.3:0/3989163045' entity='client.admin' 2024-09-21T12:13:26.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:25 smithi192 ceph-mon[35641]: from='client.? 172.21.15.3:0/127190220' entity='client.admin' 2024-09-21T12:13:26.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:25 smithi192 ceph-mon[35641]: from='client.? 172.21.15.3:0/789669678' entity='client.admin' 2024-09-21T12:13:27.373 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:27.367+0000 7f5e72db2640 1 -- 172.21.15.3:0/3465713575 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5e6c104de0 msgr2=0x7f5e6c1071d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:27.373 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:27.367+0000 7f5e72db2640 1 --2- 172.21.15.3:0/3465713575 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5e6c104de0 0x7f5e6c1071d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5e60009880 tx=0x7f5e6002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:13:27.373 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:27.367+0000 7f5e72db2640 1 -- 172.21.15.3:0/3465713575 shutdown_connections 2024-09-21T12:13:27.373 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:27.367+0000 7f5e72db2640 1 --2- 172.21.15.3:0/3465713575 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5e6c104de0 0x7f5e6c1071d0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:27.373 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:27.367+0000 7f5e72db2640 1 --2- 172.21.15.3:0/3465713575 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e6c1024b0 0x7f5e6c1048a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:27.373 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:27.367+0000 7f5e72db2640 1 -- 172.21.15.3:0/3465713575 >> 172.21.15.3:0/3465713575 conn(0x7f5e6c0fc010 msgr2=0x7f5e6c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:13:27.373 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:27.367+0000 7f5e72db2640 1 -- 172.21.15.3:0/3465713575 shutdown_connections 2024-09-21T12:13:27.373 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:27.367+0000 7f5e72db2640 1 -- 172.21.15.3:0/3465713575 wait complete. 2024-09-21T12:13:27.374 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:27.367+0000 7f5e72db2640 1 Processor -- start 2024-09-21T12:13:27.374 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:27.367+0000 7f5e72db2640 1 -- start start 2024-09-21T12:13:27.374 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:27.367+0000 7f5e72db2640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e6c1024b0 0x7f5e6c101da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:27.374 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:27.367+0000 7f5e72db2640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5e6c104de0 0x7f5e6c100460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:27.374 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:27.368+0000 7f5e72db2640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f5e6c10a640 con 0x7f5e6c104de0 2024-09-21T12:13:27.374 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:27.368+0000 7f5e72db2640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5e6c10a4c0 con 0x7f5e6c1024b0 2024-09-21T12:13:27.374 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:27.368+0000 7f5e6bfff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5e6c104de0 0x7f5e6c100460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:27.374 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:27.368+0000 7f5e6bfff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5e6c104de0 0x7f5e6c100460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50654/0 (socket says 172.21.15.3:50654) 2024-09-21T12:13:27.374 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:27.368+0000 7f5e6bfff640 1 -- 172.21.15.3:0/2971881791 learned_addr learned my addr 172.21.15.3:0/2971881791 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:13:27.374 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:27.368+0000 7f5e70b4e640 1 --2- 172.21.15.3:0/2971881791 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e6c1024b0 0x7f5e6c101da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:27.374 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:27.368+0000 7f5e6bfff640 1 -- 172.21.15.3:0/2971881791 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e6c1024b0 msgr2=0x7f5e6c101da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:27.375 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:27.368+0000 7f5e6bfff640 1 --2- 172.21.15.3:0/2971881791 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e6c1024b0 0x7f5e6c101da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:27.375 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:27.368+0000 7f5e6bfff640 1 -- 172.21.15.3:0/2971881791 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e6c1009a0 con 0x7f5e6c104de0 2024-09-21T12:13:27.375 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:27.368+0000 7f5e6bfff640 1 --2- 172.21.15.3:0/2971881791 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5e6c104de0 0x7f5e6c100460 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5e60006010 tx=0x7f5e600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:13:27.375 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:27.368+0000 7f5e69ffb640 1 -- 172.21.15.3:0/2971881791 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5e6003f070 con 0x7f5e6c104de0 2024-09-21T12:13:27.375 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:27.368+0000 7f5e69ffb640 1 -- 172.21.15.3:0/2971881791 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(26 keys) ==== 1078+0+0 (secure 0 0 0) 0x7f5e60004a70 con 0x7f5e6c104de0 2024-09-21T12:13:27.375 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:27.368+0000 7f5e72db2640 1 -- 172.21.15.3:0/2971881791 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e6c100c30 con 0x7f5e6c104de0 2024-09-21T12:13:27.375 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:27.368+0000 7f5e69ffb640 1 -- 172.21.15.3:0/2971881791 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5e60035030 con 0x7f5e6c104de0 2024-09-21T12:13:27.375 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:27.369+0000 7f5e72db2640 1 -- 172.21.15.3:0/2971881791 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e6c1011e0 con 0x7f5e6c104de0 2024-09-21T12:13:27.375 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:27.370+0000 7f5e72db2640 1 -- 172.21.15.3:0/2971881791 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e6c10ae20 con 0x7f5e6c104de0 2024-09-21T12:13:27.376 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:27.370+0000 7f5e69ffb640 1 -- 172.21.15.3:0/2971881791 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 18) ==== 92493+0+0 (secure 0 0 0) 0x7f5e60042070 con 0x7f5e6c104de0 2024-09-21T12:13:27.376 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:27.371+0000 7f5e69ffb640 1 --2- 172.21.15.3:0/2971881791 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f5e5406e230 0x7f5e540706f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:27.376 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:27.371+0000 7f5e69ffb640 1 -- 172.21.15.3:0/2971881791 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f5e600adb30 con 0x7f5e6c104de0 2024-09-21T12:13:27.376 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:27.371+0000 7f5e70b4e640 1 --2- 172.21.15.3:0/2971881791 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f5e5406e230 0x7f5e540706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:27.376 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:27.372+0000 7f5e70b4e640 1 --2- 172.21.15.3:0/2971881791 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f5e5406e230 0x7f5e540706f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c005fd0 tx=0x7f5e5c005850 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:13:27.378 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:27.375+0000 7f5e69ffb640 1 -- 172.21.15.3:0/2971881791 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5e6007c570 con 0x7f5e6c104de0 2024-09-21T12:13:27.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:27.555+0000 7f5e72db2640 1 -- 172.21.15.3:0/2971881791 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f5e6c19f4e0 con 0x7f5e6c104de0 2024-09-21T12:13:27.561 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:27.558+0000 7f5e69ffb640 1 -- 172.21.15.3:0/2971881791 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v19)=0 v19) ==== 120+0+0 (secure 0 0 0) 0x7f5e60080220 con 0x7f5e6c104de0 2024-09-21T12:13:27.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:27.561+0000 7f5e72db2640 1 -- 172.21.15.3:0/2971881791 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f5e5406e230 msgr2=0x7f5e540706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:27.564 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:27.561+0000 7f5e72db2640 1 --2- 172.21.15.3:0/2971881791 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f5e5406e230 0x7f5e540706f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c005fd0 tx=0x7f5e5c005850 comp rx=0 tx=0).stop 2024-09-21T12:13:27.564 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:27.561+0000 7f5e72db2640 1 -- 172.21.15.3:0/2971881791 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5e6c104de0 msgr2=0x7f5e6c100460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:27.564 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:27.561+0000 7f5e72db2640 1 --2- 172.21.15.3:0/2971881791 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5e6c104de0 0x7f5e6c100460 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f5e60006010 tx=0x7f5e600046c0 comp rx=0 tx=0).stop 2024-09-21T12:13:27.564 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:27.561+0000 7f5e72db2640 1 -- 172.21.15.3:0/2971881791 shutdown_connections 2024-09-21T12:13:27.564 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:27.561+0000 7f5e72db2640 1 --2- 172.21.15.3:0/2971881791 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f5e5406e230 0x7f5e540706f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:27.564 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:27.561+0000 7f5e72db2640 1 --2- 172.21.15.3:0/2971881791 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5e6c104de0 0x7f5e6c100460 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:27.564 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:27.561+0000 7f5e72db2640 1 --2- 172.21.15.3:0/2971881791 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5e6c1024b0 0x7f5e6c101da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:27.564 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:27.561+0000 7f5e72db2640 1 -- 172.21.15.3:0/2971881791 >> 172.21.15.3:0/2971881791 conn(0x7f5e6c0fc010 msgr2=0x7f5e6c0fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:13:27.564 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:27.561+0000 7f5e72db2640 1 -- 172.21.15.3:0/2971881791 shutdown_connections 2024-09-21T12:13:27.564 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:27.561+0000 7f5e72db2640 1 -- 172.21.15.3:0/2971881791 wait complete. 2024-09-21T12:13:28.043 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:27 smithi003 ceph-mon[28057]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:13:28.043 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:27 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/2971881791' entity='client.admin' 2024-09-21T12:13:28.052 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:13:28.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:27 smithi192 ceph-mon[35641]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:13:28.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:27 smithi192 ceph-mon[35641]: from='client.? 172.21.15.3:0/2971881791' entity='client.admin' 2024-09-21T12:13:28.672 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:28.665+0000 7fdd41336640 1 -- 172.21.15.3:0/1021965975 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdd3c100860 msgr2=0x7fdd3c100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:28.672 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:28.665+0000 7fdd41336640 1 --2- 172.21.15.3:0/1021965975 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdd3c100860 0x7fdd3c100c60 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c009c20 tx=0x7fdd2c02a970 comp rx=0 tx=0).stop 2024-09-21T12:13:28.672 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:28.665+0000 7fdd41336640 1 -- 172.21.15.3:0/1021965975 shutdown_connections 2024-09-21T12:13:28.672 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:28.665+0000 7fdd41336640 1 --2- 172.21.15.3:0/1021965975 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdd3c101a60 0x7fdd3c101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:28.673 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:28.665+0000 7fdd41336640 1 --2- 172.21.15.3:0/1021965975 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdd3c100860 0x7fdd3c100c60 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:28.673 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:28.665+0000 7fdd41336640 1 -- 172.21.15.3:0/1021965975 >> 172.21.15.3:0/1021965975 conn(0x7fdd3c0fc010 msgr2=0x7fdd3c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:13:28.673 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:28.665+0000 7fdd41336640 1 -- 172.21.15.3:0/1021965975 shutdown_connections 2024-09-21T12:13:28.673 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:28.665+0000 7fdd41336640 1 -- 172.21.15.3:0/1021965975 wait complete. 2024-09-21T12:13:28.673 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:28.666+0000 7fdd41336640 1 Processor -- start 2024-09-21T12:13:28.673 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:28.666+0000 7fdd41336640 1 -- start start 2024-09-21T12:13:28.673 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:28.666+0000 7fdd41336640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdd3c100860 0x7fdd3c1962f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:28.673 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:28.666+0000 7fdd41336640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdd3c101a60 0x7fdd3c196830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:28.673 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:28.666+0000 7fdd41336640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fdd3c109560 con 0x7fdd3c100860 2024-09-21T12:13:28.673 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:28.666+0000 7fdd41336640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fdd3c1093e0 con 0x7fdd3c101a60 2024-09-21T12:13:28.673 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:28.666+0000 7fdd3affd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdd3c100860 0x7fdd3c1962f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:28.673 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:28.667+0000 7fdd3affd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdd3c100860 0x7fdd3c1962f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50682/0 (socket says 172.21.15.3:50682) 2024-09-21T12:13:28.673 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:28.667+0000 7fdd3affd640 1 -- 172.21.15.3:0/2745781924 learned_addr learned my addr 172.21.15.3:0/2745781924 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:13:28.673 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:28.667+0000 7fdd3a7fc640 1 --2- 172.21.15.3:0/2745781924 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdd3c101a60 0x7fdd3c196830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:28.673 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:28.667+0000 7fdd3affd640 1 -- 172.21.15.3:0/2745781924 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdd3c101a60 msgr2=0x7fdd3c196830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:28.674 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:28.667+0000 7fdd3affd640 1 --2- 172.21.15.3:0/2745781924 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdd3c101a60 0x7fdd3c196830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:28.674 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:28.667+0000 7fdd3affd640 1 -- 172.21.15.3:0/2745781924 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd3c196eb0 con 0x7fdd3c100860 2024-09-21T12:13:28.674 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:28.667+0000 7fdd3affd640 1 --2- 172.21.15.3:0/2745781924 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdd3c100860 0x7fdd3c1962f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c0309e0 tx=0x7fdd2c030a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:13:28.674 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:28.667+0000 7fdd23fff640 1 -- 172.21.15.3:0/2745781924 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdd2c047070 con 0x7fdd3c100860 2024-09-21T12:13:28.674 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:28.667+0000 7fdd41336640 1 -- 172.21.15.3:0/2745781924 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd3c19b890 con 0x7fdd3c100860 2024-09-21T12:13:28.674 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:28.667+0000 7fdd23fff640 1 -- 172.21.15.3:0/2745781924 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(26 keys) ==== 1078+0+0 (secure 0 0 0) 0x7fdd2c003e10 con 0x7fdd3c100860 2024-09-21T12:13:28.674 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:28.667+0000 7fdd23fff640 1 -- 172.21.15.3:0/2745781924 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdd2c034070 con 0x7fdd3c100860 2024-09-21T12:13:28.674 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:28.667+0000 7fdd41336640 1 -- 172.21.15.3:0/2745781924 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd3c19bea0 con 0x7fdd3c100860 2024-09-21T12:13:28.674 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:28.668+0000 7fdd41336640 1 -- 172.21.15.3:0/2745781924 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd3c109d40 con 0x7fdd3c100860 2024-09-21T12:13:28.674 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:28.669+0000 7fdd23fff640 1 -- 172.21.15.3:0/2745781924 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 18) ==== 92493+0+0 (secure 0 0 0) 0x7fdd2c04a070 con 0x7fdd3c100860 2024-09-21T12:13:28.674 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:28.669+0000 7fdd23fff640 1 --2- 172.21.15.3:0/2745781924 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fdd2406e230 0x7fdd240706f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:28.674 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:28.669+0000 7fdd23fff640 1 -- 172.21.15.3:0/2745781924 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7fdd2c0adce0 con 0x7fdd3c100860 2024-09-21T12:13:28.674 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:28.669+0000 7fdd3a7fc640 1 --2- 172.21.15.3:0/2745781924 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fdd2406e230 0x7fdd240706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:28.675 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:28.670+0000 7fdd3a7fc640 1 --2- 172.21.15.3:0/2745781924 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fdd2406e230 0x7fdd240706f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c1977a0 tx=0x7fdd3000b390 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:13:28.676 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:28.674+0000 7fdd23fff640 1 -- 172.21.15.3:0/2745781924 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdd2c03f070 con 0x7fdd3c100860 2024-09-21T12:13:28.856 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:28.853+0000 7fdd41336640 1 -- 172.21.15.3:0/2745781924 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7fdd3c190370 con 0x7fdd3c100860 2024-09-21T12:13:28.861 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:28.858+0000 7fdd23fff640 1 -- 172.21.15.3:0/2745781924 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v20)=0 v20) ==== 106+0+0 (secure 0 0 0) 0x7fdd2c0098b0 con 0x7fdd3c100860 2024-09-21T12:13:28.863 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:28.861+0000 7fdd41336640 1 -- 172.21.15.3:0/2745781924 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fdd2406e230 msgr2=0x7fdd240706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:28.864 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:28.861+0000 7fdd41336640 1 --2- 172.21.15.3:0/2745781924 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fdd2406e230 0x7fdd240706f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fdd3c1977a0 tx=0x7fdd3000b390 comp rx=0 tx=0).stop 2024-09-21T12:13:28.864 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:28.861+0000 7fdd41336640 1 -- 172.21.15.3:0/2745781924 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdd3c100860 msgr2=0x7fdd3c1962f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:28.864 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:28.861+0000 7fdd41336640 1 --2- 172.21.15.3:0/2745781924 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdd3c100860 0x7fdd3c1962f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c0309e0 tx=0x7fdd2c030a10 comp rx=0 tx=0).stop 2024-09-21T12:13:28.864 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:28.861+0000 7fdd41336640 1 -- 172.21.15.3:0/2745781924 shutdown_connections 2024-09-21T12:13:28.864 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:28.861+0000 7fdd41336640 1 --2- 172.21.15.3:0/2745781924 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fdd2406e230 0x7fdd240706f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:28.864 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:28.861+0000 7fdd41336640 1 --2- 172.21.15.3:0/2745781924 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdd3c101a60 0x7fdd3c196830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:28.864 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:28.861+0000 7fdd41336640 1 --2- 172.21.15.3:0/2745781924 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdd3c100860 0x7fdd3c1962f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:28.864 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:28.861+0000 7fdd41336640 1 -- 172.21.15.3:0/2745781924 >> 172.21.15.3:0/2745781924 conn(0x7fdd3c0fc010 msgr2=0x7fdd3c104fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:13:28.864 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:28.861+0000 7fdd41336640 1 -- 172.21.15.3:0/2745781924 shutdown_connections 2024-09-21T12:13:28.864 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:28.861+0000 7fdd41336640 1 -- 172.21.15.3:0/2745781924 wait complete. 2024-09-21T12:13:30.180 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:29 smithi003 ceph-mon[28057]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:13:30.180 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:29 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/2745781924' entity='client.admin' 2024-09-21T12:13:30.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:29 smithi192 ceph-mon[35641]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:13:30.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:29 smithi192 ceph-mon[35641]: from='client.? 172.21.15.3:0/2745781924' entity='client.admin' 2024-09-21T12:13:31.170 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:31.152+0000 7f92c7867640 1 -- 172.21.15.3:0/641393781 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f92c0102470 msgr2=0x7f92c0104860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:31.170 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:31.152+0000 7f92c7867640 1 --2- 172.21.15.3:0/641393781 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f92c0102470 0x7f92c0104860 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f92b8009880 tx=0x7f92b802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:13:31.170 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:31.152+0000 7f92c7867640 1 -- 172.21.15.3:0/641393781 shutdown_connections 2024-09-21T12:13:31.170 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:31.152+0000 7f92c7867640 1 --2- 172.21.15.3:0/641393781 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92c0104da0 0x7f92c0107190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:31.170 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:31.152+0000 7f92c7867640 1 --2- 172.21.15.3:0/641393781 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f92c0102470 0x7f92c0104860 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:31.170 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:31.152+0000 7f92c7867640 1 -- 172.21.15.3:0/641393781 >> 172.21.15.3:0/641393781 conn(0x7f92c00fc010 msgr2=0x7f92c00fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:13:31.170 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:31.152+0000 7f92c7867640 1 -- 172.21.15.3:0/641393781 shutdown_connections 2024-09-21T12:13:31.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:31.152+0000 7f92c7867640 1 -- 172.21.15.3:0/641393781 wait complete. 2024-09-21T12:13:31.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:31.153+0000 7f92c7867640 1 Processor -- start 2024-09-21T12:13:31.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:31.153+0000 7f92c7867640 1 -- start start 2024-09-21T12:13:31.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:31.153+0000 7f92c7867640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92c0102470 0x7f92c0197400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:31.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:31.153+0000 7f92c7867640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f92c0104da0 0x7f92c0197940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:31.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:31.153+0000 7f92c7867640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f92c010a670 con 0x7f92c0104da0 2024-09-21T12:13:31.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:31.153+0000 7f92c7867640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f92c010a4f0 con 0x7f92c0102470 2024-09-21T12:13:31.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:31.153+0000 7f92c4e02640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f92c0104da0 0x7f92c0197940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:31.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:31.153+0000 7f92c4e02640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f92c0104da0 0x7f92c0197940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57802/0 (socket says 172.21.15.3:57802) 2024-09-21T12:13:31.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:31.153+0000 7f92c4e02640 1 -- 172.21.15.3:0/2126744035 learned_addr learned my addr 172.21.15.3:0/2126744035 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:13:31.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:31.153+0000 7f92c5603640 1 --2- 172.21.15.3:0/2126744035 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92c0102470 0x7f92c0197400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:31.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:31.154+0000 7f92c4e02640 1 -- 172.21.15.3:0/2126744035 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92c0102470 msgr2=0x7f92c0197400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:31.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:31.154+0000 7f92c4e02640 1 --2- 172.21.15.3:0/2126744035 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92c0102470 0x7f92c0197400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:31.172 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:31.154+0000 7f92c4e02640 1 -- 172.21.15.3:0/2126744035 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92c0197fc0 con 0x7f92c0104da0 2024-09-21T12:13:31.172 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:31.154+0000 7f92c5603640 1 --2- 172.21.15.3:0/2126744035 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92c0102470 0x7f92c0197400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T12:13:31.172 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:31.154+0000 7f92c4e02640 1 --2- 172.21.15.3:0/2126744035 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f92c0104da0 0x7f92c0197940 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f92b4005fd0 tx=0x7f92b400dd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:13:31.172 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:31.154+0000 7f92be7fc640 1 -- 172.21.15.3:0/2126744035 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f92b4017070 con 0x7f92c0104da0 2024-09-21T12:13:31.172 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:31.154+0000 7f92be7fc640 1 -- 172.21.15.3:0/2126744035 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(26 keys) ==== 1078+0+0 (secure 0 0 0) 0x7f92b4004020 con 0x7f92c0104da0 2024-09-21T12:13:31.172 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:31.154+0000 7f92c7867640 1 -- 172.21.15.3:0/2126744035 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92c019ca00 con 0x7f92c0104da0 2024-09-21T12:13:31.172 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:31.154+0000 7f92be7fc640 1 -- 172.21.15.3:0/2126744035 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f92b4003b90 con 0x7f92c0104da0 2024-09-21T12:13:31.172 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:31.154+0000 7f92c7867640 1 -- 172.21.15.3:0/2126744035 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92c019cf90 con 0x7f92c0104da0 2024-09-21T12:13:31.172 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:31.155+0000 7f92c7867640 1 -- 172.21.15.3:0/2126744035 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92c010ae50 con 0x7f92c0104da0 2024-09-21T12:13:31.172 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:31.156+0000 7f92be7fc640 1 -- 172.21.15.3:0/2126744035 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 18) ==== 92493+0+0 (secure 0 0 0) 0x7f92b4009a30 con 0x7f92c0104da0 2024-09-21T12:13:31.172 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:31.156+0000 7f92be7fc640 1 --2- 172.21.15.3:0/2126744035 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f92a806e280 0x7f92a8070740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:31.172 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:31.156+0000 7f92be7fc640 1 -- 172.21.15.3:0/2126744035 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f92b408ce40 con 0x7f92c0104da0 2024-09-21T12:13:31.172 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:31.156+0000 7f92c5603640 1 --2- 172.21.15.3:0/2126744035 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f92a806e280 0x7f92a8070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:31.173 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:31.157+0000 7f92c5603640 1 --2- 172.21.15.3:0/2126744035 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f92a806e280 0x7f92a8070740 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f92b8000c00 tx=0x7f92b8005d50 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:13:31.173 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:31.165+0000 7f92be7fc640 1 -- 172.21.15.3:0/2126744035 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f92b4020030 con 0x7f92c0104da0 2024-09-21T12:13:31.357 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:13:31.360 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:31.358+0000 7f92c7867640 1 -- 172.21.15.3:0/2126744035 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7f92c019d280 con 0x7f92c0104da0 2024-09-21T12:13:31.366 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:31.363+0000 7f92be7fc640 1 -- 172.21.15.3:0/2126744035 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v21)=0 v21) ==== 115+0+0 (secure 0 0 0) 0x7f92b405b900 con 0x7f92c0104da0 2024-09-21T12:13:31.369 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:31.366+0000 7f92c7867640 1 -- 172.21.15.3:0/2126744035 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f92a806e280 msgr2=0x7f92a8070740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:31.369 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:31.366+0000 7f92c7867640 1 --2- 172.21.15.3:0/2126744035 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f92a806e280 0x7f92a8070740 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f92b8000c00 tx=0x7f92b8005d50 comp rx=0 tx=0).stop 2024-09-21T12:13:31.369 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:31.366+0000 7f92c7867640 1 -- 172.21.15.3:0/2126744035 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f92c0104da0 msgr2=0x7f92c0197940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:31.369 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:31.366+0000 7f92c7867640 1 --2- 172.21.15.3:0/2126744035 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f92c0104da0 0x7f92c0197940 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f92b4005fd0 tx=0x7f92b400dd60 comp rx=0 tx=0).stop 2024-09-21T12:13:31.369 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:31.366+0000 7f92c7867640 1 -- 172.21.15.3:0/2126744035 shutdown_connections 2024-09-21T12:13:31.369 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:31.366+0000 7f92c7867640 1 --2- 172.21.15.3:0/2126744035 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f92a806e280 0x7f92a8070740 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:31.369 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:31.366+0000 7f92c7867640 1 --2- 172.21.15.3:0/2126744035 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f92c0104da0 0x7f92c0197940 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:31.369 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:31.366+0000 7f92c7867640 1 --2- 172.21.15.3:0/2126744035 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92c0102470 0x7f92c0197400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:31.369 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:31.366+0000 7f92c7867640 1 -- 172.21.15.3:0/2126744035 >> 172.21.15.3:0/2126744035 conn(0x7f92c00fc010 msgr2=0x7f92c00fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:13:31.369 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:31.366+0000 7f92c7867640 1 -- 172.21.15.3:0/2126744035 shutdown_connections 2024-09-21T12:13:31.370 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:31.366+0000 7f92c7867640 1 -- 172.21.15.3:0/2126744035 wait complete. 2024-09-21T12:13:31.894 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '641beec0-7812-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi003') 2024-09-21T12:13:31.894 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '641beec0-7812-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi003') 2024-09-21T12:13:32.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:31 smithi003 ceph-mon[28057]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:13:32.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:31 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:32.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:31 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:32.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:31 smithi003 ceph-mon[28057]: Reconfiguring ceph-exporter.smithi003 (monmap changed)... 2024-09-21T12:13:32.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:31 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi003", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-21T12:13:32.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:31 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:13:32.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:31 smithi003 ceph-mon[28057]: Reconfiguring daemon ceph-exporter.smithi003 on smithi003 2024-09-21T12:13:32.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:31 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/2126744035' entity='client.admin' 2024-09-21T12:13:32.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:31 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:13:32.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:31 smithi192 ceph-mon[35641]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:13:32.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:31 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:32.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:31 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:32.259 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:31 smithi192 ceph-mon[35641]: Reconfiguring ceph-exporter.smithi003 (monmap changed)... 2024-09-21T12:13:32.259 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:31 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi003", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-21T12:13:32.259 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:31 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:13:32.259 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:31 smithi192 ceph-mon[35641]: Reconfiguring daemon ceph-exporter.smithi003 on smithi003 2024-09-21T12:13:32.259 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:31 smithi192 ceph-mon[35641]: from='client.? 172.21.15.3:0/2126744035' entity='client.admin' 2024-09-21T12:13:32.259 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:31 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:13:33.348 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:13:34.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:33 smithi192 ceph-mon[35641]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:13:34.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:33 smithi003 ceph-mon[28057]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:13:34.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:33.811+0000 7f19edeee640 1 -- 172.21.15.3:0/4025518287 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19e8101960 msgr2=0x7f19e8101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:34.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:33.811+0000 7f19edeee640 1 --2- 172.21.15.3:0/4025518287 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19e8101960 0x7f19e8101d60 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f19d8009880 tx=0x7f19d802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:13:34.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:33.811+0000 7f19edeee640 1 -- 172.21.15.3:0/4025518287 shutdown_connections 2024-09-21T12:13:34.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:33.811+0000 7f19edeee640 1 --2- 172.21.15.3:0/4025518287 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19e8102b60 0x7f19e8102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:34.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:33.811+0000 7f19edeee640 1 --2- 172.21.15.3:0/4025518287 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19e8101960 0x7f19e8101d60 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:34.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:33.811+0000 7f19edeee640 1 -- 172.21.15.3:0/4025518287 >> 172.21.15.3:0/4025518287 conn(0x7f19e80fd0f0 msgr2=0x7f19e80ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:13:34.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:33.811+0000 7f19edeee640 1 -- 172.21.15.3:0/4025518287 shutdown_connections 2024-09-21T12:13:34.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:33.811+0000 7f19edeee640 1 -- 172.21.15.3:0/4025518287 wait complete. 2024-09-21T12:13:34.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:33.811+0000 7f19edeee640 1 Processor -- start 2024-09-21T12:13:34.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:33.812+0000 7f19edeee640 1 -- start start 2024-09-21T12:13:34.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:33.812+0000 7f19edeee640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19e8101960 0x7f19e81973e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:34.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:33.812+0000 7f19edeee640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19e8102b60 0x7f19e8197920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:34.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:33.812+0000 7f19edeee640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f19e810a660 con 0x7f19e8101960 2024-09-21T12:13:34.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:33.812+0000 7f19edeee640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f19e810a4e0 con 0x7f19e8102b60 2024-09-21T12:13:34.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:33.812+0000 7f19e77fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19e8101960 0x7f19e81973e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:34.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:33.812+0000 7f19e77fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19e8101960 0x7f19e81973e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57818/0 (socket says 172.21.15.3:57818) 2024-09-21T12:13:34.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:33.812+0000 7f19e77fe640 1 -- 172.21.15.3:0/2541266378 learned_addr learned my addr 172.21.15.3:0/2541266378 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:13:34.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:33.812+0000 7f19e6ffd640 1 --2- 172.21.15.3:0/2541266378 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19e8102b60 0x7f19e8197920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:34.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:33.812+0000 7f19e77fe640 1 -- 172.21.15.3:0/2541266378 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19e8102b60 msgr2=0x7f19e8197920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:34.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:33.812+0000 7f19e77fe640 1 --2- 172.21.15.3:0/2541266378 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19e8102b60 0x7f19e8197920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:34.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:33.812+0000 7f19e77fe640 1 -- 172.21.15.3:0/2541266378 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19e8197fa0 con 0x7f19e8101960 2024-09-21T12:13:34.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:33.813+0000 7f19e77fe640 1 --2- 172.21.15.3:0/2541266378 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19e8101960 0x7f19e81973e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f19d802a9c0 tx=0x7f19d80045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:13:34.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:33.813+0000 7f19e4ff9640 1 -- 172.21.15.3:0/2541266378 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f19d803f070 con 0x7f19e8101960 2024-09-21T12:13:34.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:33.813+0000 7f19e4ff9640 1 -- 172.21.15.3:0/2541266378 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(26 keys) ==== 1078+0+0 (secure 0 0 0) 0x7f19d8004a50 con 0x7f19e8101960 2024-09-21T12:13:34.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:33.813+0000 7f19edeee640 1 -- 172.21.15.3:0/2541266378 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19e819c980 con 0x7f19e8101960 2024-09-21T12:13:34.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:33.813+0000 7f19e4ff9640 1 -- 172.21.15.3:0/2541266378 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f19d8035030 con 0x7f19e8101960 2024-09-21T12:13:34.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:33.813+0000 7f19edeee640 1 -- 172.21.15.3:0/2541266378 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19e819cf90 con 0x7f19e8101960 2024-09-21T12:13:34.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:33.814+0000 7f19edeee640 1 -- 172.21.15.3:0/2541266378 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19e810ae40 con 0x7f19e8101960 2024-09-21T12:13:34.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:33.815+0000 7f19e4ff9640 1 -- 172.21.15.3:0/2541266378 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 18) ==== 92493+0+0 (secure 0 0 0) 0x7f19d8042070 con 0x7f19e8101960 2024-09-21T12:13:34.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:33.815+0000 7f19e4ff9640 1 --2- 172.21.15.3:0/2541266378 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f19d006e280 0x7f19d0070740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:34.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:33.815+0000 7f19e4ff9640 1 -- 172.21.15.3:0/2541266378 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f19d80ad990 con 0x7f19e8101960 2024-09-21T12:13:34.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:33.815+0000 7f19e6ffd640 1 --2- 172.21.15.3:0/2541266378 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f19d006e280 0x7f19d0070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:34.729 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:33.816+0000 7f19e6ffd640 1 --2- 172.21.15.3:0/2541266378 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f19d006e280 0x7f19d0070740 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f19e8198890 tx=0x7f19dc00b390 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:13:34.729 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:33.821+0000 7f19e4ff9640 1 -- 172.21.15.3:0/2541266378 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f19d8003e00 con 0x7f19e8101960 2024-09-21T12:13:34.729 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:34.003+0000 7f19edeee640 1 -- 172.21.15.3:0/2541266378 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7f19e819d1f0 con 0x7f19e8101960 2024-09-21T12:13:34.729 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:34.007+0000 7f19e4ff9640 1 -- 172.21.15.3:0/2541266378 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v22)=0 v22) ==== 119+0+0 (secure 0 0 0) 0x7f19d8080100 con 0x7f19e8101960 2024-09-21T12:13:34.729 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:34.009+0000 7f19edeee640 1 -- 172.21.15.3:0/2541266378 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f19d006e280 msgr2=0x7f19d0070740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:34.729 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:34.009+0000 7f19edeee640 1 --2- 172.21.15.3:0/2541266378 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f19d006e280 0x7f19d0070740 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f19e8198890 tx=0x7f19dc00b390 comp rx=0 tx=0).stop 2024-09-21T12:13:34.729 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:34.009+0000 7f19edeee640 1 -- 172.21.15.3:0/2541266378 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19e8101960 msgr2=0x7f19e81973e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:34.729 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:34.009+0000 7f19edeee640 1 --2- 172.21.15.3:0/2541266378 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19e8101960 0x7f19e81973e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f19d802a9c0 tx=0x7f19d80045e0 comp rx=0 tx=0).stop 2024-09-21T12:13:34.729 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:34.009+0000 7f19edeee640 1 -- 172.21.15.3:0/2541266378 shutdown_connections 2024-09-21T12:13:34.729 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:34.009+0000 7f19edeee640 1 --2- 172.21.15.3:0/2541266378 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f19d006e280 0x7f19d0070740 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:34.729 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:34.009+0000 7f19edeee640 1 --2- 172.21.15.3:0/2541266378 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19e8102b60 0x7f19e8197920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:34.729 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:34.009+0000 7f19edeee640 1 --2- 172.21.15.3:0/2541266378 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19e8101960 0x7f19e81973e0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:34.729 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:34.009+0000 7f19edeee640 1 -- 172.21.15.3:0/2541266378 >> 172.21.15.3:0/2541266378 conn(0x7f19e80fd0f0 msgr2=0x7f19e80ff360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:13:34.729 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:34.009+0000 7f19edeee640 1 -- 172.21.15.3:0/2541266378 shutdown_connections 2024-09-21T12:13:34.729 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:34.009+0000 7f19edeee640 1 -- 172.21.15.3:0/2541266378 wait complete. 2024-09-21T12:13:35.286 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:35 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/2541266378' entity='client.admin' 2024-09-21T12:13:35.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:35 smithi192 ceph-mon[35641]: from='client.? 172.21.15.3:0/2541266378' entity='client.admin' 2024-09-21T12:13:36.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:36.441+0000 7f6811f71640 1 -- 172.21.15.3:0/2885470831 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f680c102b60 msgr2=0x7f680c102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:36.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:36.441+0000 7f6811f71640 1 --2- 172.21.15.3:0/2885470831 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f680c102b60 0x7f680c102fe0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6800009880 tx=0x7f680002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:13:36.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:36.441+0000 7f6811f71640 1 -- 172.21.15.3:0/2885470831 shutdown_connections 2024-09-21T12:13:36.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:36.441+0000 7f6811f71640 1 --2- 172.21.15.3:0/2885470831 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f680c102b60 0x7f680c102fe0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:36.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:36.441+0000 7f6811f71640 1 --2- 172.21.15.3:0/2885470831 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f680c101960 0x7f680c101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:36.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:36.441+0000 7f6811f71640 1 -- 172.21.15.3:0/2885470831 >> 172.21.15.3:0/2885470831 conn(0x7f680c0fd0f0 msgr2=0x7f680c0ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:13:36.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:36.441+0000 7f6811f71640 1 -- 172.21.15.3:0/2885470831 shutdown_connections 2024-09-21T12:13:36.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:36.441+0000 7f6811f71640 1 -- 172.21.15.3:0/2885470831 wait complete. 2024-09-21T12:13:36.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:36.442+0000 7f6811f71640 1 Processor -- start 2024-09-21T12:13:36.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:36.442+0000 7f6811f71640 1 -- start start 2024-09-21T12:13:36.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:36.442+0000 7f6811f71640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f680c101960 0x7f680c1973d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:36.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:36.442+0000 7f6811f71640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f680c102b60 0x7f680c197910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:36.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:36.442+0000 7f6811f71640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f680c10a660 con 0x7f680c102b60 2024-09-21T12:13:36.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:36.442+0000 7f6811f71640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f680c10a4e0 con 0x7f680c101960 2024-09-21T12:13:36.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:36.442+0000 7f680affd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f680c102b60 0x7f680c197910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:36.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:36.443+0000 7f680affd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f680c102b60 0x7f680c197910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57844/0 (socket says 172.21.15.3:57844) 2024-09-21T12:13:36.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:36.443+0000 7f680affd640 1 -- 172.21.15.3:0/3978084869 learned_addr learned my addr 172.21.15.3:0/3978084869 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:13:36.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:36.443+0000 7f680b7fe640 1 --2- 172.21.15.3:0/3978084869 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f680c101960 0x7f680c1973d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:36.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:36.443+0000 7f680affd640 1 -- 172.21.15.3:0/3978084869 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f680c101960 msgr2=0x7f680c1973d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:36.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:36.443+0000 7f680affd640 1 --2- 172.21.15.3:0/3978084869 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f680c101960 0x7f680c1973d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:36.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:36.443+0000 7f680affd640 1 -- 172.21.15.3:0/3978084869 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f680c197f90 con 0x7f680c102b60 2024-09-21T12:13:36.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:36.443+0000 7f680affd640 1 --2- 172.21.15.3:0/3978084869 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f680c102b60 0x7f680c197910 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f68000048f0 tx=0x7f6800004920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:13:36.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:36.443+0000 7f6808ff9640 1 -- 172.21.15.3:0/3978084869 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f680003f070 con 0x7f680c102b60 2024-09-21T12:13:36.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:36.443+0000 7f6808ff9640 1 -- 172.21.15.3:0/3978084869 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(26 keys) ==== 1078+0+0 (secure 0 0 0) 0x7f6800003a90 con 0x7f680c102b60 2024-09-21T12:13:36.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:36.443+0000 7f6811f71640 1 -- 172.21.15.3:0/3978084869 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f680c19c970 con 0x7f680c102b60 2024-09-21T12:13:36.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:36.443+0000 7f6808ff9640 1 -- 172.21.15.3:0/3978084869 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6800035030 con 0x7f680c102b60 2024-09-21T12:13:36.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:36.443+0000 7f6811f71640 1 -- 172.21.15.3:0/3978084869 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f680c19cf80 con 0x7f680c102b60 2024-09-21T12:13:36.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:36.444+0000 7f6811f71640 1 -- 172.21.15.3:0/3978084869 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f680c10ae40 con 0x7f680c102b60 2024-09-21T12:13:36.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:36.445+0000 7f6808ff9640 1 -- 172.21.15.3:0/3978084869 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 18) ==== 92493+0+0 (secure 0 0 0) 0x7f6800042070 con 0x7f680c102b60 2024-09-21T12:13:36.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:36.445+0000 7f6808ff9640 1 --2- 172.21.15.3:0/3978084869 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f67f406e240 0x7f67f4070700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:36.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:36.446+0000 7f6808ff9640 1 -- 172.21.15.3:0/3978084869 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f68000adb60 con 0x7f680c102b60 2024-09-21T12:13:36.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:36.446+0000 7f680b7fe640 1 --2- 172.21.15.3:0/3978084869 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f67f406e240 0x7f67f4070700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:36.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:36.446+0000 7f680b7fe640 1 --2- 172.21.15.3:0/3978084869 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f67f406e240 0x7f67f4070700 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f67fc0058c0 tx=0x7f67fc00a2d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:13:36.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:36.450+0000 7f6808ff9640 1 -- 172.21.15.3:0/3978084869 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6800080250 con 0x7f680c102b60 2024-09-21T12:13:36.492 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:13:36.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:36 smithi003 ceph-mon[28057]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:13:36.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:36 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:36.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:36 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:36.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:36 smithi003 ceph-mon[28057]: Reconfiguring crash.smithi003 (monmap changed)... 2024-09-21T12:13:36.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:36 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi003", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-21T12:13:36.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:36 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:13:36.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:36 smithi003 ceph-mon[28057]: Reconfiguring daemon crash.smithi003 on smithi003 2024-09-21T12:13:36.619 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:13:36.645 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:13:36.649 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:13:36.652 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:13:36.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:36.656+0000 7f6811f71640 1 -- 172.21.15.3:0/3978084869 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f680c02d9b0 con 0x7f680c102b60 2024-09-21T12:13:36.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:36.661+0000 7f6808ff9640 1 -- 172.21.15.3:0/3978084869 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v23)=0 v23) ==== 125+0+0 (secure 0 0 0) 0x7f6800084a80 con 0x7f680c102b60 2024-09-21T12:13:36.667 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:36.663+0000 7f6811f71640 1 -- 172.21.15.3:0/3978084869 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f67f406e240 msgr2=0x7f67f4070700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:36.667 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:36.663+0000 7f6811f71640 1 --2- 172.21.15.3:0/3978084869 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f67f406e240 0x7f67f4070700 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f67fc0058c0 tx=0x7f67fc00a2d0 comp rx=0 tx=0).stop 2024-09-21T12:13:36.667 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:36.663+0000 7f6811f71640 1 -- 172.21.15.3:0/3978084869 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f680c102b60 msgr2=0x7f680c197910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:36.668 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:36.663+0000 7f6811f71640 1 --2- 172.21.15.3:0/3978084869 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f680c102b60 0x7f680c197910 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f68000048f0 tx=0x7f6800004920 comp rx=0 tx=0).stop 2024-09-21T12:13:36.668 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:36.664+0000 7f6811f71640 1 -- 172.21.15.3:0/3978084869 shutdown_connections 2024-09-21T12:13:36.668 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:36.664+0000 7f6811f71640 1 --2- 172.21.15.3:0/3978084869 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f67f406e240 0x7f67f4070700 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:36.668 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:36.664+0000 7f6811f71640 1 --2- 172.21.15.3:0/3978084869 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f680c102b60 0x7f680c197910 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:36.668 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:36.664+0000 7f6811f71640 1 --2- 172.21.15.3:0/3978084869 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f680c101960 0x7f680c1973d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:36.668 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:36.664+0000 7f6811f71640 1 -- 172.21.15.3:0/3978084869 >> 172.21.15.3:0/3978084869 conn(0x7f680c0fd0f0 msgr2=0x7f680c106060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:13:36.668 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:36.664+0000 7f6811f71640 1 -- 172.21.15.3:0/3978084869 shutdown_connections 2024-09-21T12:13:36.668 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:36.664+0000 7f6811f71640 1 -- 172.21.15.3:0/3978084869 wait complete. 2024-09-21T12:13:36.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:36 smithi192 ceph-mon[35641]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:13:36.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:36 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:36.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:36 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:36.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:36 smithi192 ceph-mon[35641]: Reconfiguring crash.smithi003 (monmap changed)... 2024-09-21T12:13:36.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:36 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi003", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-21T12:13:36.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:36 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:13:36.759 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:36 smithi192 ceph-mon[35641]: Reconfiguring daemon crash.smithi003 on smithi003 2024-09-21T12:13:37.762 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.728+0000 7f54e74cb640 1 -- 172.21.15.3:0/894787557 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f54e0102b60 msgr2=0x7f54e0102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:37.762 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.728+0000 7f54e74cb640 1 --2- 172.21.15.3:0/894787557 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f54e0102b60 0x7f54e0102fe0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f54d0009880 tx=0x7f54d002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:13:37.762 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.729+0000 7f54e74cb640 1 -- 172.21.15.3:0/894787557 shutdown_connections 2024-09-21T12:13:37.762 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.729+0000 7f54e74cb640 1 --2- 172.21.15.3:0/894787557 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f54e0102b60 0x7f54e0102fe0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:37.762 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.729+0000 7f54e74cb640 1 --2- 172.21.15.3:0/894787557 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54e0101960 0x7f54e0101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:37.762 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.729+0000 7f54e74cb640 1 -- 172.21.15.3:0/894787557 >> 172.21.15.3:0/894787557 conn(0x7f54e00fd0f0 msgr2=0x7f54e00ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:13:37.762 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.729+0000 7f54e74cb640 1 -- 172.21.15.3:0/894787557 shutdown_connections 2024-09-21T12:13:37.763 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.729+0000 7f54e74cb640 1 -- 172.21.15.3:0/894787557 wait complete. 2024-09-21T12:13:37.763 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.729+0000 7f54e74cb640 1 Processor -- start 2024-09-21T12:13:37.763 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.729+0000 7f54e74cb640 1 -- start start 2024-09-21T12:13:37.763 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.729+0000 7f54e74cb640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54e0101960 0x7f54e01973d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:37.763 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.729+0000 7f54e74cb640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f54e0102b60 0x7f54e0197910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:37.763 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.729+0000 7f54e74cb640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f54e010a660 con 0x7f54e0102b60 2024-09-21T12:13:37.763 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.729+0000 7f54e74cb640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f54e010a4e0 con 0x7f54e0101960 2024-09-21T12:13:37.763 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.730+0000 7f54e4a66640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f54e0102b60 0x7f54e0197910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:37.763 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.730+0000 7f54e4a66640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f54e0102b60 0x7f54e0197910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57864/0 (socket says 172.21.15.3:57864) 2024-09-21T12:13:37.763 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.730+0000 7f54e4a66640 1 -- 172.21.15.3:0/1127568617 learned_addr learned my addr 172.21.15.3:0/1127568617 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:13:37.763 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.730+0000 7f54e5267640 1 --2- 172.21.15.3:0/1127568617 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54e0101960 0x7f54e01973d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:37.763 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.730+0000 7f54e4a66640 1 -- 172.21.15.3:0/1127568617 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54e0101960 msgr2=0x7f54e01973d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:37.763 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.730+0000 7f54e4a66640 1 --2- 172.21.15.3:0/1127568617 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54e0101960 0x7f54e01973d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:37.764 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.730+0000 7f54e4a66640 1 -- 172.21.15.3:0/1127568617 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54e0197f90 con 0x7f54e0102b60 2024-09-21T12:13:37.764 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.730+0000 7f54e4a66640 1 --2- 172.21.15.3:0/1127568617 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f54e0102b60 0x7f54e0197910 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f54d0009230 tx=0x7f54d00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:13:37.764 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.730+0000 7f54d67fc640 1 -- 172.21.15.3:0/1127568617 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f54d003f070 con 0x7f54e0102b60 2024-09-21T12:13:37.764 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.730+0000 7f54d67fc640 1 -- 172.21.15.3:0/1127568617 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(26 keys) ==== 1078+0+0 (secure 0 0 0) 0x7f54d0003a90 con 0x7f54e0102b60 2024-09-21T12:13:37.764 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.730+0000 7f54e74cb640 1 -- 172.21.15.3:0/1127568617 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54e019c970 con 0x7f54e0102b60 2024-09-21T12:13:37.764 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.730+0000 7f54d67fc640 1 -- 172.21.15.3:0/1127568617 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f54d0035030 con 0x7f54e0102b60 2024-09-21T12:13:37.764 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.730+0000 7f54e74cb640 1 -- 172.21.15.3:0/1127568617 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54e019cf80 con 0x7f54e0102b60 2024-09-21T12:13:37.764 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.731+0000 7f54e74cb640 1 -- 172.21.15.3:0/1127568617 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54e010ae40 con 0x7f54e0102b60 2024-09-21T12:13:37.764 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.732+0000 7f54d67fc640 1 -- 172.21.15.3:0/1127568617 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 18) ==== 92493+0+0 (secure 0 0 0) 0x7f54d0042070 con 0x7f54e0102b60 2024-09-21T12:13:37.764 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.732+0000 7f54d67fc640 1 --2- 172.21.15.3:0/1127568617 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f54cc06e280 0x7f54cc070740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:37.764 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.732+0000 7f54d67fc640 1 -- 172.21.15.3:0/1127568617 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f54d00ada70 con 0x7f54e0102b60 2024-09-21T12:13:37.764 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.732+0000 7f54e5267640 1 --2- 172.21.15.3:0/1127568617 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f54cc06e280 0x7f54cc070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:37.764 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.733+0000 7f54e5267640 1 --2- 172.21.15.3:0/1127568617 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f54cc06e280 0x7f54cc070740 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f54dc005fd0 tx=0x7f54dc00b390 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:13:37.764 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.737+0000 7f54d67fc640 1 -- 172.21.15.3:0/1127568617 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f54d00801e0 con 0x7f54e0102b60 2024-09-21T12:13:37.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:37 smithi003 ceph-mon[28057]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:13:37.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:37 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/3978084869' entity='client.admin' 2024-09-21T12:13:37.917 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.916+0000 7f54e74cb640 1 -- 172.21.15.3:0/1127568617 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f54e0191470 con 0x7f54e0102b60 2024-09-21T12:13:37.920 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.919+0000 7f54d67fc640 1 -- 172.21.15.3:0/1127568617 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v24)=0 v24) ==== 121+0+0 (secure 0 0 0) 0x7f54d0084a10 con 0x7f54e0102b60 2024-09-21T12:13:37.923 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.921+0000 7f54e74cb640 1 -- 172.21.15.3:0/1127568617 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f54cc06e280 msgr2=0x7f54cc070740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:37.923 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.921+0000 7f54e74cb640 1 --2- 172.21.15.3:0/1127568617 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f54cc06e280 0x7f54cc070740 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f54dc005fd0 tx=0x7f54dc00b390 comp rx=0 tx=0).stop 2024-09-21T12:13:37.923 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.921+0000 7f54e74cb640 1 -- 172.21.15.3:0/1127568617 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f54e0102b60 msgr2=0x7f54e0197910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:37.923 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.921+0000 7f54e74cb640 1 --2- 172.21.15.3:0/1127568617 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f54e0102b60 0x7f54e0197910 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f54d0009230 tx=0x7f54d00048f0 comp rx=0 tx=0).stop 2024-09-21T12:13:37.923 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.921+0000 7f54e74cb640 1 -- 172.21.15.3:0/1127568617 shutdown_connections 2024-09-21T12:13:37.923 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.921+0000 7f54e74cb640 1 --2- 172.21.15.3:0/1127568617 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f54cc06e280 0x7f54cc070740 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:37.923 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.921+0000 7f54e74cb640 1 --2- 172.21.15.3:0/1127568617 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f54e0102b60 0x7f54e0197910 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:37.923 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.921+0000 7f54e74cb640 1 --2- 172.21.15.3:0/1127568617 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f54e0101960 0x7f54e01973d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:37.923 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.921+0000 7f54e74cb640 1 -- 172.21.15.3:0/1127568617 >> 172.21.15.3:0/1127568617 conn(0x7f54e00fd0f0 msgr2=0x7f54e0106060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:13:37.923 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.921+0000 7f54e74cb640 1 -- 172.21.15.3:0/1127568617 shutdown_connections 2024-09-21T12:13:37.923 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.921+0000 7f54e74cb640 1 -- 172.21.15.3:0/1127568617 wait complete. 2024-09-21T12:13:37.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.939+0000 7f3dff6f9640 1 -- 172.21.15.3:0/1034227461 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3df8100860 msgr2=0x7f3df8100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:37.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.939+0000 7f3dff6f9640 1 --2- 172.21.15.3:0/1034227461 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3df8100860 0x7f3df8100c60 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3df4009880 tx=0x7f3df402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:13:37.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.939+0000 7f3dff6f9640 1 -- 172.21.15.3:0/1034227461 shutdown_connections 2024-09-21T12:13:37.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.939+0000 7f3dff6f9640 1 --2- 172.21.15.3:0/1034227461 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3df8101a60 0x7f3df8101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:37.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.939+0000 7f3dff6f9640 1 --2- 172.21.15.3:0/1034227461 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3df8100860 0x7f3df8100c60 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:37.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.939+0000 7f3dff6f9640 1 -- 172.21.15.3:0/1034227461 >> 172.21.15.3:0/1034227461 conn(0x7f3df80fc010 msgr2=0x7f3df80fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:13:37.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.939+0000 7f3dff6f9640 1 -- 172.21.15.3:0/1034227461 shutdown_connections 2024-09-21T12:13:37.947 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.939+0000 7f3dff6f9640 1 -- 172.21.15.3:0/1034227461 wait complete. 2024-09-21T12:13:37.947 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.939+0000 7f3dff6f9640 1 Processor -- start 2024-09-21T12:13:37.947 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.940+0000 7f3dff6f9640 1 -- start start 2024-09-21T12:13:37.947 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.940+0000 7f3dff6f9640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3df8100860 0x7f3df8197410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:37.947 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.940+0000 7f3dff6f9640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3df8101a60 0x7f3df8197950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:37.947 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.940+0000 7f3dff6f9640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f3df8109560 con 0x7f3df8101a60 2024-09-21T12:13:37.947 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.940+0000 7f3dff6f9640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3df81093e0 con 0x7f3df8100860 2024-09-21T12:13:37.947 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.940+0000 7f3dfcc94640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3df8101a60 0x7f3df8197950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:37.947 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.940+0000 7f3dfcc94640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3df8101a60 0x7f3df8197950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57870/0 (socket says 172.21.15.3:57870) 2024-09-21T12:13:37.947 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.940+0000 7f3dfcc94640 1 -- 172.21.15.3:0/3345299198 learned_addr learned my addr 172.21.15.3:0/3345299198 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:13:37.947 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.940+0000 7f3dfd495640 1 --2- 172.21.15.3:0/3345299198 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3df8100860 0x7f3df8197410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:37.947 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.940+0000 7f3dfcc94640 1 -- 172.21.15.3:0/3345299198 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3df8100860 msgr2=0x7f3df8197410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:37.947 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.940+0000 7f3dfcc94640 1 --2- 172.21.15.3:0/3345299198 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3df8100860 0x7f3df8197410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:37.947 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.940+0000 7f3dfcc94640 1 -- 172.21.15.3:0/3345299198 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3df8197fd0 con 0x7f3df8101a60 2024-09-21T12:13:37.948 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.940+0000 7f3dfcc94640 1 --2- 172.21.15.3:0/3345299198 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3df8101a60 0x7f3df8197950 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3de800e970 tx=0x7f3de800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:13:37.948 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.941+0000 7f3dee7fc640 1 -- 172.21.15.3:0/3345299198 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3de800cac0 con 0x7f3df8101a60 2024-09-21T12:13:37.948 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.941+0000 7f3dee7fc640 1 -- 172.21.15.3:0/3345299198 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(26 keys) ==== 1078+0+0 (secure 0 0 0) 0x7f3de80054c0 con 0x7f3df8101a60 2024-09-21T12:13:37.948 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.941+0000 7f3dff6f9640 1 -- 172.21.15.3:0/3345299198 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3df819ca10 con 0x7f3df8101a60 2024-09-21T12:13:37.948 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.941+0000 7f3dee7fc640 1 -- 172.21.15.3:0/3345299198 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3de8004dc0 con 0x7f3df8101a60 2024-09-21T12:13:37.948 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.941+0000 7f3dff6f9640 1 -- 172.21.15.3:0/3345299198 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3df819d020 con 0x7f3df8101a60 2024-09-21T12:13:37.948 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.942+0000 7f3dff6f9640 1 -- 172.21.15.3:0/3345299198 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3df8109d40 con 0x7f3df8101a60 2024-09-21T12:13:37.948 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.942+0000 7f3dee7fc640 1 -- 172.21.15.3:0/3345299198 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 18) ==== 92493+0+0 (secure 0 0 0) 0x7f3de8005020 con 0x7f3df8101a60 2024-09-21T12:13:37.948 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.943+0000 7f3dee7fc640 1 --2- 172.21.15.3:0/3345299198 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f3de406e1c0 0x7f3de4070680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:37.948 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.943+0000 7f3dee7fc640 1 -- 172.21.15.3:0/3345299198 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f3de808d750 con 0x7f3df8101a60 2024-09-21T12:13:37.948 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.943+0000 7f3dfd495640 1 --2- 172.21.15.3:0/3345299198 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f3de406e1c0 0x7f3de4070680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:37.948 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.944+0000 7f3dfd495640 1 --2- 172.21.15.3:0/3345299198 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f3de406e1c0 0x7f3de4070680 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3df4006010 tx=0x7f3df4005d50 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:13:37.949 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:37.948+0000 7f3dee7fc640 1 -- 172.21.15.3:0/3345299198 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3de805c0f0 con 0x7f3df8101a60 2024-09-21T12:13:38.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:37 smithi192 ceph-mon[35641]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:13:38.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:37 smithi192 ceph-mon[35641]: from='client.? 172.21.15.3:0/3978084869' entity='client.admin' 2024-09-21T12:13:38.129 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:38.127+0000 7f3dff6f9640 1 -- 172.21.15.3:0/3345299198 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f3df819d6f0 con 0x7f3df8101a60 2024-09-21T12:13:38.133 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:38.131+0000 7f3dee7fc640 1 -- 172.21.15.3:0/3345299198 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v25)=0 v25) ==== 123+0+0 (secure 0 0 0) 0x7f3de8005670 con 0x7f3df8101a60 2024-09-21T12:13:38.134 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:38.133+0000 7f3dee7fc640 1 -- 172.21.15.3:0/3345299198 <== mon.0 v2:172.21.15.3:3300/0 8 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3de800ce80 con 0x7f3df8101a60 2024-09-21T12:13:38.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:38.134+0000 7f3dff6f9640 1 -- 172.21.15.3:0/3345299198 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f3de406e1c0 msgr2=0x7f3de4070680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:38.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:38.134+0000 7f3dff6f9640 1 --2- 172.21.15.3:0/3345299198 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f3de406e1c0 0x7f3de4070680 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3df4006010 tx=0x7f3df4005d50 comp rx=0 tx=0).stop 2024-09-21T12:13:38.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:38.134+0000 7f3dff6f9640 1 -- 172.21.15.3:0/3345299198 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3df8101a60 msgr2=0x7f3df8197950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:38.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:38.134+0000 7f3dff6f9640 1 --2- 172.21.15.3:0/3345299198 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3df8101a60 0x7f3df8197950 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3de800e970 tx=0x7f3de800ed70 comp rx=0 tx=0).stop 2024-09-21T12:13:38.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:38.134+0000 7f3dff6f9640 1 -- 172.21.15.3:0/3345299198 shutdown_connections 2024-09-21T12:13:38.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:38.134+0000 7f3dff6f9640 1 --2- 172.21.15.3:0/3345299198 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f3de406e1c0 0x7f3de4070680 secure :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3df4006010 tx=0x7f3df4005d50 comp rx=0 tx=0).stop 2024-09-21T12:13:38.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:38.134+0000 7f3dff6f9640 1 --2- 172.21.15.3:0/3345299198 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3df8101a60 0x7f3df8197950 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:38.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:38.134+0000 7f3dff6f9640 1 --2- 172.21.15.3:0/3345299198 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3df8100860 0x7f3df8197410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:38.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:38.134+0000 7f3dff6f9640 1 -- 172.21.15.3:0/3345299198 >> 172.21.15.3:0/3345299198 conn(0x7f3df80fc010 msgr2=0x7f3df8069cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:13:38.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:38.135+0000 7f3dff6f9640 1 -- 172.21.15.3:0/3345299198 shutdown_connections 2024-09-21T12:13:38.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:38.135+0000 7f3dff6f9640 1 -- 172.21.15.3:0/3345299198 wait complete. 2024-09-21T12:13:38.731 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:38.729+0000 7f07fa1f4640 1 -- 172.21.15.3:0/3679251908 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f07f4104d20 msgr2=0x7f07f4107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:38.731 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:38.729+0000 7f07fa1f4640 1 --2- 172.21.15.3:0/3679251908 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f07f4104d20 0x7f07f4107110 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f07e80098b0 tx=0x7f07e802a4d0 comp rx=0 tx=0).stop 2024-09-21T12:13:38.731 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:38.729+0000 7f07fa1f4640 1 -- 172.21.15.3:0/3679251908 shutdown_connections 2024-09-21T12:13:38.731 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:38.729+0000 7f07fa1f4640 1 --2- 172.21.15.3:0/3679251908 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f07f4104d20 0x7f07f4107110 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:38.731 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:38.729+0000 7f07fa1f4640 1 --2- 172.21.15.3:0/3679251908 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07f41023f0 0x7f07f41047e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:38.732 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:38.729+0000 7f07fa1f4640 1 -- 172.21.15.3:0/3679251908 >> 172.21.15.3:0/3679251908 conn(0x7f07f40fc010 msgr2=0x7f07f40fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:13:38.732 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:38.729+0000 7f07fa1f4640 1 -- 172.21.15.3:0/3679251908 shutdown_connections 2024-09-21T12:13:38.732 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:38.729+0000 7f07fa1f4640 1 -- 172.21.15.3:0/3679251908 wait complete. 2024-09-21T12:13:38.733 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:38.730+0000 7f07fa1f4640 1 Processor -- start 2024-09-21T12:13:38.733 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:38.730+0000 7f07fa1f4640 1 -- start start 2024-09-21T12:13:38.733 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:38.731+0000 7f07fa1f4640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f07f41023f0 0x7f07f4197620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:38.733 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:38.731+0000 7f07fa1f4640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07f4104d20 0x7f07f4197b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:38.734 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:38.731+0000 7f07fa1f4640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f07f410a810 con 0x7f07f41023f0 2024-09-21T12:13:38.734 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:38.731+0000 7f07fa1f4640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f07f410a690 con 0x7f07f4104d20 2024-09-21T12:13:38.734 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:38.731+0000 7f07f37fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f07f41023f0 0x7f07f4197620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:38.734 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:38.731+0000 7f07f37fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f07f41023f0 0x7f07f4197620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:57890/0 (socket says 172.21.15.3:57890) 2024-09-21T12:13:38.734 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:38.731+0000 7f07f37fe640 1 -- 172.21.15.3:0/2392758040 learned_addr learned my addr 172.21.15.3:0/2392758040 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:13:38.734 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:38.731+0000 7f07f2ffd640 1 --2- 172.21.15.3:0/2392758040 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07f4104d20 0x7f07f4197b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:38.734 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:38.731+0000 7f07f37fe640 1 -- 172.21.15.3:0/2392758040 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07f4104d20 msgr2=0x7f07f4197b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:38.734 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:38.731+0000 7f07f37fe640 1 --2- 172.21.15.3:0/2392758040 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07f4104d20 0x7f07f4197b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:38.734 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:38.731+0000 7f07f37fe640 1 -- 172.21.15.3:0/2392758040 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07f41981e0 con 0x7f07f41023f0 2024-09-21T12:13:38.734 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:38.731+0000 7f07f37fe640 1 --2- 172.21.15.3:0/2392758040 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f07f41023f0 0x7f07f4197620 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f07e400b420 tx=0x7f07e400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:13:38.734 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:38.731+0000 7f07f0ff9640 1 -- 172.21.15.3:0/2392758040 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f07e4011630 con 0x7f07f41023f0 2024-09-21T12:13:38.734 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:38.731+0000 7f07f0ff9640 1 -- 172.21.15.3:0/2392758040 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f07e4016070 con 0x7f07f41023f0 2024-09-21T12:13:38.734 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:38.731+0000 7f07fa1f4640 1 -- 172.21.15.3:0/2392758040 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07f419cc20 con 0x7f07f41023f0 2024-09-21T12:13:38.735 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:38.731+0000 7f07f0ff9640 1 -- 172.21.15.3:0/2392758040 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f07e4010d40 con 0x7f07f41023f0 2024-09-21T12:13:38.735 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:38.732+0000 7f07fa1f4640 1 -- 172.21.15.3:0/2392758040 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07f419d180 con 0x7f07f41023f0 2024-09-21T12:13:38.735 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:38.733+0000 7f07fa1f4640 1 -- 172.21.15.3:0/2392758040 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07f410aff0 con 0x7f07f41023f0 2024-09-21T12:13:38.736 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:38.733+0000 7f07f0ff9640 1 -- 172.21.15.3:0/2392758040 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 18) ==== 92493+0+0 (secure 0 0 0) 0x7f07e40117d0 con 0x7f07f41023f0 2024-09-21T12:13:38.736 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:38.733+0000 7f07f0ff9640 1 --2- 172.21.15.3:0/2392758040 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f07dc06e230 0x7f07dc0706f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:38.736 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:38.734+0000 7f07f0ff9640 1 -- 172.21.15.3:0/2392758040 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f07e408c890 con 0x7f07f41023f0 2024-09-21T12:13:38.736 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:38.734+0000 7f07f2ffd640 1 --2- 172.21.15.3:0/2392758040 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f07dc06e230 0x7f07dc0706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:38.736 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:38.734+0000 7f07f2ffd640 1 --2- 172.21.15.3:0/2392758040 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f07dc06e230 0x7f07dc0706f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f07e8009880 tx=0x7f07e80058d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:13:38.739 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:38.738+0000 7f07f0ff9640 1 -- 172.21.15.3:0/2392758040 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f07e405b2d0 con 0x7f07f41023f0 2024-09-21T12:13:38.916 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:38.914+0000 7f07fa1f4640 1 -- 172.21.15.3:0/2392758040 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7f07f419daa0 con 0x7f07f41023f0 2024-09-21T12:13:38.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:38.918+0000 7f07f0ff9640 1 -- 172.21.15.3:0/2392758040 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v26)=0 v26) ==== 121+0+0 (secure 0 0 0) 0x7f07e405ef80 con 0x7f07f41023f0 2024-09-21T12:13:38.922 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:38.920+0000 7f07fa1f4640 1 -- 172.21.15.3:0/2392758040 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f07dc06e230 msgr2=0x7f07dc0706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:38.922 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:38.920+0000 7f07fa1f4640 1 --2- 172.21.15.3:0/2392758040 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f07dc06e230 0x7f07dc0706f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f07e8009880 tx=0x7f07e80058d0 comp rx=0 tx=0).stop 2024-09-21T12:13:38.922 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:38.920+0000 7f07fa1f4640 1 -- 172.21.15.3:0/2392758040 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f07f41023f0 msgr2=0x7f07f4197620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:38.922 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:38.920+0000 7f07fa1f4640 1 --2- 172.21.15.3:0/2392758040 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f07f41023f0 0x7f07f4197620 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f07e400b420 tx=0x7f07e400b8e0 comp rx=0 tx=0).stop 2024-09-21T12:13:38.922 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:38.920+0000 7f07fa1f4640 1 -- 172.21.15.3:0/2392758040 shutdown_connections 2024-09-21T12:13:38.922 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:38.920+0000 7f07fa1f4640 1 --2- 172.21.15.3:0/2392758040 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f07dc06e230 0x7f07dc0706f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:38.922 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:38.920+0000 7f07fa1f4640 1 --2- 172.21.15.3:0/2392758040 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f07f4104d20 0x7f07f4197b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:38.922 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:38.920+0000 7f07fa1f4640 1 --2- 172.21.15.3:0/2392758040 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f07f41023f0 0x7f07f4197620 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:38.922 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:38.920+0000 7f07fa1f4640 1 -- 172.21.15.3:0/2392758040 >> 172.21.15.3:0/2392758040 conn(0x7f07f40fc010 msgr2=0x7f07f40fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:13:38.922 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:38.920+0000 7f07fa1f4640 1 -- 172.21.15.3:0/2392758040 shutdown_connections 2024-09-21T12:13:38.922 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:38.920+0000 7f07fa1f4640 1 -- 172.21.15.3:0/2392758040 wait complete. 2024-09-21T12:13:39.153 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:38 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/1127568617' entity='client.admin' 2024-09-21T12:13:39.153 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:38 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/3345299198' entity='client.admin' 2024-09-21T12:13:39.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:38 smithi192 ceph-mon[35641]: from='client.? 172.21.15.3:0/1127568617' entity='client.admin' 2024-09-21T12:13:39.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:38 smithi192 ceph-mon[35641]: from='client.? 172.21.15.3:0/3345299198' entity='client.admin' 2024-09-21T12:13:40.001 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '641beec0-7812-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi003') 2024-09-21T12:13:40.002 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '641beec0-7812-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi003') 2024-09-21T12:13:40.002 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '641beec0-7812-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi003') 2024-09-21T12:13:40.002 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '641beec0-7812-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi003') 2024-09-21T12:13:40.002 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '641beec0-7812-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi003') 2024-09-21T12:13:40.002 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '641beec0-7812-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi003') 2024-09-21T12:13:40.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:39 smithi003 ceph-mon[28057]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:13:40.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:39 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/2392758040' entity='client.admin' 2024-09-21T12:13:40.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:39 smithi192 ceph-mon[35641]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:13:40.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:39 smithi192 ceph-mon[35641]: from='client.? 172.21.15.3:0/2392758040' entity='client.admin' 2024-09-21T12:13:40.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:40.942+0000 7f0671460640 1 -- 172.21.15.3:0/2431819829 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f066c102b70 msgr2=0x7f066c102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:40.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:40.942+0000 7f0671460640 1 --2- 172.21.15.3:0/2431819829 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f066c102b70 0x7f066c102ff0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0660009880 tx=0x7f066002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:13:40.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:40.942+0000 7f0671460640 1 -- 172.21.15.3:0/2431819829 shutdown_connections 2024-09-21T12:13:40.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:40.942+0000 7f0671460640 1 --2- 172.21.15.3:0/2431819829 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f066c102b70 0x7f066c102ff0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:40.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:40.942+0000 7f0671460640 1 --2- 172.21.15.3:0/2431819829 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f066c101970 0x7f066c101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:40.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:40.943+0000 7f0671460640 1 -- 172.21.15.3:0/2431819829 >> 172.21.15.3:0/2431819829 conn(0x7f066c0fd100 msgr2=0x7f066c0ff540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:13:40.958 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:40.943+0000 7f0671460640 1 -- 172.21.15.3:0/2431819829 shutdown_connections 2024-09-21T12:13:40.958 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:40.943+0000 7f0671460640 1 -- 172.21.15.3:0/2431819829 wait complete. 2024-09-21T12:13:40.958 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:40.943+0000 7f0671460640 1 Processor -- start 2024-09-21T12:13:40.958 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:40.943+0000 7f0671460640 1 -- start start 2024-09-21T12:13:40.958 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:40.944+0000 7f0671460640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f066c101970 0x7f066c199690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:40.958 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:40.944+0000 7f0671460640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f066c102b70 0x7f066c199bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:40.958 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:40.944+0000 7f0671460640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f066c10a7b0 con 0x7f066c101970 2024-09-21T12:13:40.958 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:40.944+0000 7f0671460640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f066c10a630 con 0x7f066c102b70 2024-09-21T12:13:40.958 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:40.944+0000 7f066affd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f066c101970 0x7f066c199690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:40.958 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:40.944+0000 7f066a7fc640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f066c102b70 0x7f066c199bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:40.958 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:40.944+0000 7f066affd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f066c101970 0x7f066c199690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:54382/0 (socket says 172.21.15.3:54382) 2024-09-21T12:13:40.958 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:40.944+0000 7f066affd640 1 -- 172.21.15.3:0/215085664 learned_addr learned my addr 172.21.15.3:0/215085664 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:13:40.958 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:40.944+0000 7f066a7fc640 1 -- 172.21.15.3:0/215085664 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f066c101970 msgr2=0x7f066c199690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:40.959 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:40.944+0000 7f066a7fc640 1 --2- 172.21.15.3:0/215085664 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f066c101970 0x7f066c199690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:40.959 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:40.944+0000 7f066a7fc640 1 -- 172.21.15.3:0/215085664 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f066c19a250 con 0x7f066c102b70 2024-09-21T12:13:40.959 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:40.944+0000 7f066affd640 1 --2- 172.21.15.3:0/215085664 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f066c101970 0x7f066c199690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T12:13:40.959 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:40.944+0000 7f066a7fc640 1 --2- 172.21.15.3:0/215085664 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f066c102b70 0x7f066c199bd0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f0660006010 tx=0x7f06600045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:13:40.959 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:40.945+0000 7f0653fff640 1 -- 172.21.15.3:0/215085664 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f066003f070 con 0x7f066c102b70 2024-09-21T12:13:40.959 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:40.945+0000 7f0653fff640 1 -- 172.21.15.3:0/215085664 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0660004a50 con 0x7f066c102b70 2024-09-21T12:13:40.959 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:40.945+0000 7f0671460640 1 -- 172.21.15.3:0/215085664 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f066c19ec30 con 0x7f066c102b70 2024-09-21T12:13:40.959 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:40.945+0000 7f0653fff640 1 -- 172.21.15.3:0/215085664 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0660035030 con 0x7f066c102b70 2024-09-21T12:13:40.959 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:40.945+0000 7f0671460640 1 -- 172.21.15.3:0/215085664 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f066c19f1c0 con 0x7f066c102b70 2024-09-21T12:13:40.959 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:40.946+0000 7f0653fff640 1 -- 172.21.15.3:0/215085664 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 18) ==== 92493+0+0 (secure 0 0 0) 0x7f0660042070 con 0x7f066c102b70 2024-09-21T12:13:40.959 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:40.946+0000 7f0671460640 1 -- 172.21.15.3:0/215085664 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f066c101d70 con 0x7f066c102b70 2024-09-21T12:13:40.959 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:40.947+0000 7f0653fff640 1 --2- 172.21.15.3:0/215085664 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f065406e280 0x7f0654070740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:40.959 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:40.947+0000 7f0653fff640 1 -- 172.21.15.3:0/215085664 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f06600ad9e0 con 0x7f066c102b70 2024-09-21T12:13:40.959 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:40.947+0000 7f066affd640 1 --2- 172.21.15.3:0/215085664 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f065406e280 0x7f0654070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:40.960 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:40.947+0000 7f066affd640 1 --2- 172.21.15.3:0/215085664 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f065406e280 0x7f0654070740 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f065c009fd0 tx=0x7f065c009700 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:13:40.960 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:40.952+0000 7f0653fff640 1 -- 172.21.15.3:0/215085664 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0660080150 con 0x7f066c102b70 2024-09-21T12:13:41.144 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:41.143+0000 7f0671460640 1 -- 172.21.15.3:0/215085664 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7f066c106e50 con 0x7f066c102b70 2024-09-21T12:13:41.149 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:41.148+0000 7f0653fff640 1 -- 172.21.15.3:0/215085664 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v28)=0 v28) ==== 122+0+0 (secure 0 0 0) 0x7f0660084980 con 0x7f066c102b70 2024-09-21T12:13:41.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:41.150+0000 7f0671460640 1 -- 172.21.15.3:0/215085664 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f065406e280 msgr2=0x7f0654070740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:41.152 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:41.150+0000 7f0671460640 1 --2- 172.21.15.3:0/215085664 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f065406e280 0x7f0654070740 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f065c009fd0 tx=0x7f065c009700 comp rx=0 tx=0).stop 2024-09-21T12:13:41.152 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:41.150+0000 7f0671460640 1 -- 172.21.15.3:0/215085664 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f066c102b70 msgr2=0x7f066c199bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:41.152 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:41.150+0000 7f0671460640 1 --2- 172.21.15.3:0/215085664 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f066c102b70 0x7f066c199bd0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f0660006010 tx=0x7f06600045e0 comp rx=0 tx=0).stop 2024-09-21T12:13:41.152 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:41.150+0000 7f0671460640 1 -- 172.21.15.3:0/215085664 shutdown_connections 2024-09-21T12:13:41.152 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:41.150+0000 7f0671460640 1 --2- 172.21.15.3:0/215085664 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f065406e280 0x7f0654070740 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:41.152 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:41.150+0000 7f0671460640 1 --2- 172.21.15.3:0/215085664 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f066c102b70 0x7f066c199bd0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:41.152 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:41.150+0000 7f0671460640 1 --2- 172.21.15.3:0/215085664 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f066c101970 0x7f066c199690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:41.152 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:41.150+0000 7f0671460640 1 -- 172.21.15.3:0/215085664 >> 172.21.15.3:0/215085664 conn(0x7f066c0fd100 msgr2=0x7f066c104020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:13:41.152 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:41.150+0000 7f0671460640 1 -- 172.21.15.3:0/215085664 shutdown_connections 2024-09-21T12:13:41.152 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:41.150+0000 7f0671460640 1 -- 172.21.15.3:0/215085664 wait complete. 2024-09-21T12:13:41.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:40.856+0000 7f7c35914640 1 -- 172.21.15.3:0/330561641 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c30101a60 msgr2=0x7f7c30101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:41.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:40.856+0000 7f7c35914640 1 --2- 172.21.15.3:0/330561641 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c30101a60 0x7f7c30101ee0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f7c28009c20 tx=0x7f7c2802a980 comp rx=0 tx=0).stop 2024-09-21T12:13:41.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:40.856+0000 7f7c35914640 1 -- 172.21.15.3:0/330561641 shutdown_connections 2024-09-21T12:13:41.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:40.856+0000 7f7c35914640 1 --2- 172.21.15.3:0/330561641 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c30101a60 0x7f7c30101ee0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:41.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:40.856+0000 7f7c35914640 1 --2- 172.21.15.3:0/330561641 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7c30100860 0x7f7c30100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:41.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:40.856+0000 7f7c35914640 1 -- 172.21.15.3:0/330561641 >> 172.21.15.3:0/330561641 conn(0x7f7c300fc010 msgr2=0x7f7c300fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:13:41.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:40.856+0000 7f7c35914640 1 -- 172.21.15.3:0/330561641 shutdown_connections 2024-09-21T12:13:41.661 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:40.856+0000 7f7c35914640 1 -- 172.21.15.3:0/330561641 wait complete. 2024-09-21T12:13:41.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:40.856+0000 7f7c35914640 1 Processor -- start 2024-09-21T12:13:41.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:40.857+0000 7f7c35914640 1 -- start start 2024-09-21T12:13:41.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:40.857+0000 7f7c35914640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c30100860 0x7f7c301996d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:41.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:40.857+0000 7f7c35914640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7c30101a60 0x7f7c30199c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:41.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:40.857+0000 7f7c35914640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f7c30109680 con 0x7f7c30101a60 2024-09-21T12:13:41.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:40.857+0000 7f7c35914640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7c30109500 con 0x7f7c30100860 2024-09-21T12:13:41.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:40.857+0000 7f7c2e7fc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7c30101a60 0x7f7c30199c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:41.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:40.857+0000 7f7c2e7fc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7c30101a60 0x7f7c30199c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:54356/0 (socket says 172.21.15.3:54356) 2024-09-21T12:13:41.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:40.857+0000 7f7c2e7fc640 1 -- 172.21.15.3:0/1020263673 learned_addr learned my addr 172.21.15.3:0/1020263673 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:13:41.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:40.857+0000 7f7c2effd640 1 --2- 172.21.15.3:0/1020263673 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c30100860 0x7f7c301996d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:41.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:40.858+0000 7f7c2e7fc640 1 -- 172.21.15.3:0/1020263673 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c30100860 msgr2=0x7f7c301996d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:41.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:40.858+0000 7f7c2e7fc640 1 --2- 172.21.15.3:0/1020263673 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c30100860 0x7f7c301996d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:41.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:40.858+0000 7f7c2e7fc640 1 -- 172.21.15.3:0/1020263673 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c3019a290 con 0x7f7c30101a60 2024-09-21T12:13:41.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:40.858+0000 7f7c2e7fc640 1 --2- 172.21.15.3:0/1020263673 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7c30101a60 0x7f7c30199c10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7c2802f930 tx=0x7f7c2802f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:13:41.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:40.858+0000 7f7c34912640 1 -- 172.21.15.3:0/1020263673 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7c28034040 con 0x7f7c30101a60 2024-09-21T12:13:41.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:40.858+0000 7f7c35914640 1 -- 172.21.15.3:0/1020263673 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c3019ec70 con 0x7f7c30101a60 2024-09-21T12:13:41.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:40.858+0000 7f7c34912640 1 -- 172.21.15.3:0/1020263673 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7c28003e30 con 0x7f7c30101a60 2024-09-21T12:13:41.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:40.858+0000 7f7c34912640 1 -- 172.21.15.3:0/1020263673 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7c280047d0 con 0x7f7c30101a60 2024-09-21T12:13:41.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:40.858+0000 7f7c35914640 1 -- 172.21.15.3:0/1020263673 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c3019f230 con 0x7f7c30101a60 2024-09-21T12:13:41.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:40.859+0000 7f7c35914640 1 -- 172.21.15.3:0/1020263673 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c30100c60 con 0x7f7c30101a60 2024-09-21T12:13:41.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:40.860+0000 7f7c34912640 1 -- 172.21.15.3:0/1020263673 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 18) ==== 92493+0+0 (secure 0 0 0) 0x7f7c28037020 con 0x7f7c30101a60 2024-09-21T12:13:41.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:40.860+0000 7f7c34912640 1 --2- 172.21.15.3:0/1020263673 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f7c1806e240 0x7f7c18070700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:41.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:40.860+0000 7f7c34912640 1 -- 172.21.15.3:0/1020263673 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f7c280ae1e0 con 0x7f7c30101a60 2024-09-21T12:13:41.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:40.860+0000 7f7c2effd640 1 --2- 172.21.15.3:0/1020263673 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f7c1806e240 0x7f7c18070700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:41.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:40.861+0000 7f7c2effd640 1 --2- 172.21.15.3:0/1020263673 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f7c1806e240 0x7f7c18070700 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7c200095f0 tx=0x7f7c20005f90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:13:41.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:40.869+0000 7f7c34912640 1 -- 172.21.15.3:0/1020263673 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7c2807cc20 con 0x7f7c30101a60 2024-09-21T12:13:41.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:41.050+0000 7f7c35914640 1 -- 172.21.15.3:0/1020263673 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7f7c3019f620 con 0x7f7c30101a60 2024-09-21T12:13:41.664 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:41.053+0000 7f7c34912640 1 -- 172.21.15.3:0/1020263673 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v27)=0 v27) ==== 120+0+0 (secure 0 0 0) 0x7f7c2802c030 con 0x7f7c30101a60 2024-09-21T12:13:41.664 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:41.055+0000 7f7c35914640 1 -- 172.21.15.3:0/1020263673 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f7c1806e240 msgr2=0x7f7c18070700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:41.664 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:41.055+0000 7f7c35914640 1 --2- 172.21.15.3:0/1020263673 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f7c1806e240 0x7f7c18070700 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f7c200095f0 tx=0x7f7c20005f90 comp rx=0 tx=0).stop 2024-09-21T12:13:41.664 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:41.056+0000 7f7c35914640 1 -- 172.21.15.3:0/1020263673 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7c30101a60 msgr2=0x7f7c30199c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:41.664 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:41.056+0000 7f7c35914640 1 --2- 172.21.15.3:0/1020263673 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7c30101a60 0x7f7c30199c10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f7c2802f930 tx=0x7f7c2802f670 comp rx=0 tx=0).stop 2024-09-21T12:13:41.664 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:41.056+0000 7f7c35914640 1 -- 172.21.15.3:0/1020263673 shutdown_connections 2024-09-21T12:13:41.664 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:41.056+0000 7f7c35914640 1 --2- 172.21.15.3:0/1020263673 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f7c1806e240 0x7f7c18070700 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:41.664 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:41.056+0000 7f7c35914640 1 --2- 172.21.15.3:0/1020263673 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7c30101a60 0x7f7c30199c10 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:41.664 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:41.056+0000 7f7c35914640 1 --2- 172.21.15.3:0/1020263673 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c30100860 0x7f7c301996d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:41.664 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:41.056+0000 7f7c35914640 1 -- 172.21.15.3:0/1020263673 >> 172.21.15.3:0/1020263673 conn(0x7f7c300fc010 msgr2=0x7f7c30069cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:13:41.664 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:41.056+0000 7f7c35914640 1 -- 172.21.15.3:0/1020263673 shutdown_connections 2024-09-21T12:13:41.664 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:41.056+0000 7f7c35914640 1 -- 172.21.15.3:0/1020263673 wait complete. 2024-09-21T12:13:42.256 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:42 smithi003 ceph-mon[28057]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:13:42.256 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:42 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/1020263673' entity='client.admin' 2024-09-21T12:13:42.256 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:42 smithi003 ceph-mon[28057]: from='client.? ' entity='client.admin' 2024-09-21T12:13:42.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:42 smithi192 ceph-mon[35641]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:13:42.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:42 smithi192 ceph-mon[35641]: from='client.? 172.21.15.3:0/1020263673' entity='client.admin' 2024-09-21T12:13:42.509 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:42 smithi192 ceph-mon[35641]: from='client.? ' entity='client.admin' 2024-09-21T12:13:42.749 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '641beec0-7812-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi003') 2024-09-21T12:13:43.105 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '641beec0-7812-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi003') 2024-09-21T12:13:43.105 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '641beec0-7812-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi003') 2024-09-21T12:13:43.106 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '641beec0-7812-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi003') 2024-09-21T12:13:43.106 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '641beec0-7812-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi003') 2024-09-21T12:13:43.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:43 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:43.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:43 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:43.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:43 smithi003 ceph-mon[28057]: Reconfiguring alertmanager.smithi003 (dependencies changed)... 2024-09-21T12:13:43.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:43 smithi003 ceph-mon[28057]: Reconfiguring daemon alertmanager.smithi003 on smithi003 2024-09-21T12:13:43.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:43 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:43.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:43 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:43.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:43 smithi192 ceph-mon[35641]: Reconfiguring alertmanager.smithi003 (dependencies changed)... 2024-09-21T12:13:43.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:43 smithi192 ceph-mon[35641]: Reconfiguring daemon alertmanager.smithi003 on smithi003 2024-09-21T12:13:44.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:44 smithi003 ceph-mon[28057]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:13:44.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:44 smithi192 ceph-mon[35641]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:13:44.772 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '641beec0-7812-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi003') 2024-09-21T12:13:44.772 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '641beec0-7812-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'mon', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi003') 2024-09-21T12:13:44.772 DEBUG:tasks.cephadm:waiting for RemoteProcess(client=, args=['sudo', '/home/ubuntu/cephtest/cephadm', '--image', 'quay.ceph.io/ceph-ci/ceph:squid', 'shell', '-c', '/etc/ceph/ceph.conf', '-k', '/etc/ceph/ceph.client.admin.keyring', '--fsid', '641beec0-7812-11ef-baf6-efdc52797490', '--', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi003') 2024-09-21T12:13:44.772 INFO:tasks.cephadm:Deploying OSDs... 2024-09-21T12:13:44.773 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-09-21T12:13:44.773 DEBUG:teuthology.orchestra.run.smithi003:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T12:13:44.792 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T12:13:44.792 DEBUG:teuthology.orchestra.run.smithi003:> stat /dev/vg_nvme/lv_1 2024-09-21T12:13:44.851 INFO:teuthology.orchestra.run.smithi003.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T12:13:44.851 INFO:teuthology.orchestra.run.smithi003.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T12:13:44.851 INFO:teuthology.orchestra.run.smithi003.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-21T12:13:44.851 INFO:teuthology.orchestra.run.smithi003.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T12:13:44.851 INFO:teuthology.orchestra.run.smithi003.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T12:13:44.851 INFO:teuthology.orchestra.run.smithi003.stdout:Access: 2024-09-21 12:12:39.800474501 +0000 2024-09-21T12:13:44.851 INFO:teuthology.orchestra.run.smithi003.stdout:Modify: 2024-09-21 12:07:15.549830039 +0000 2024-09-21T12:13:44.852 INFO:teuthology.orchestra.run.smithi003.stdout:Change: 2024-09-21 12:07:15.549830039 +0000 2024-09-21T12:13:44.852 INFO:teuthology.orchestra.run.smithi003.stdout: Birth: 2024-09-21 12:07:15.549830039 +0000 2024-09-21T12:13:44.852 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T12:13:44.920 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records in 2024-09-21T12:13:44.920 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records out 2024-09-21T12:13:44.920 INFO:teuthology.orchestra.run.smithi003.stderr:512 bytes copied, 0.000273698 s, 1.9 MB/s 2024-09-21T12:13:44.922 DEBUG:teuthology.orchestra.run.smithi003:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T12:13:44.980 DEBUG:teuthology.orchestra.run.smithi003:> stat /dev/vg_nvme/lv_2 2024-09-21T12:13:45.037 INFO:teuthology.orchestra.run.smithi003.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T12:13:45.037 INFO:teuthology.orchestra.run.smithi003.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T12:13:45.037 INFO:teuthology.orchestra.run.smithi003.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-21T12:13:45.038 INFO:teuthology.orchestra.run.smithi003.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T12:13:45.038 INFO:teuthology.orchestra.run.smithi003.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T12:13:45.038 INFO:teuthology.orchestra.run.smithi003.stdout:Access: 2024-09-21 12:12:39.801474489 +0000 2024-09-21T12:13:45.038 INFO:teuthology.orchestra.run.smithi003.stdout:Modify: 2024-09-21 12:07:15.875825896 +0000 2024-09-21T12:13:45.038 INFO:teuthology.orchestra.run.smithi003.stdout:Change: 2024-09-21 12:07:15.875825896 +0000 2024-09-21T12:13:45.038 INFO:teuthology.orchestra.run.smithi003.stdout: Birth: 2024-09-21 12:07:15.875825896 +0000 2024-09-21T12:13:45.038 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T12:13:45.103 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records in 2024-09-21T12:13:45.103 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records out 2024-09-21T12:13:45.103 INFO:teuthology.orchestra.run.smithi003.stderr:512 bytes copied, 0.000211693 s, 2.4 MB/s 2024-09-21T12:13:45.104 DEBUG:teuthology.orchestra.run.smithi003:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T12:13:45.162 DEBUG:teuthology.orchestra.run.smithi003:> stat /dev/vg_nvme/lv_3 2024-09-21T12:13:45.220 INFO:teuthology.orchestra.run.smithi003.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T12:13:45.220 INFO:teuthology.orchestra.run.smithi003.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T12:13:45.220 INFO:teuthology.orchestra.run.smithi003.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-21T12:13:45.220 INFO:teuthology.orchestra.run.smithi003.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T12:13:45.220 INFO:teuthology.orchestra.run.smithi003.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T12:13:45.220 INFO:teuthology.orchestra.run.smithi003.stdout:Access: 2024-09-21 12:12:39.801474489 +0000 2024-09-21T12:13:45.220 INFO:teuthology.orchestra.run.smithi003.stdout:Modify: 2024-09-21 12:07:16.220821511 +0000 2024-09-21T12:13:45.220 INFO:teuthology.orchestra.run.smithi003.stdout:Change: 2024-09-21 12:07:16.220821511 +0000 2024-09-21T12:13:45.221 INFO:teuthology.orchestra.run.smithi003.stdout: Birth: 2024-09-21 12:07:16.220821511 +0000 2024-09-21T12:13:45.221 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T12:13:45.286 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records in 2024-09-21T12:13:45.286 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records out 2024-09-21T12:13:45.286 INFO:teuthology.orchestra.run.smithi003.stderr:512 bytes copied, 0.000219596 s, 2.3 MB/s 2024-09-21T12:13:45.287 DEBUG:teuthology.orchestra.run.smithi003:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T12:13:45.344 DEBUG:teuthology.orchestra.run.smithi003:> stat /dev/vg_nvme/lv_4 2024-09-21T12:13:45.402 INFO:teuthology.orchestra.run.smithi003.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T12:13:45.402 INFO:teuthology.orchestra.run.smithi003.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T12:13:45.402 INFO:teuthology.orchestra.run.smithi003.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-21T12:13:45.402 INFO:teuthology.orchestra.run.smithi003.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T12:13:45.402 INFO:teuthology.orchestra.run.smithi003.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T12:13:45.402 INFO:teuthology.orchestra.run.smithi003.stdout:Access: 2024-09-21 12:12:39.801474489 +0000 2024-09-21T12:13:45.403 INFO:teuthology.orchestra.run.smithi003.stdout:Modify: 2024-09-21 12:07:16.555817254 +0000 2024-09-21T12:13:45.403 INFO:teuthology.orchestra.run.smithi003.stdout:Change: 2024-09-21 12:07:16.555817254 +0000 2024-09-21T12:13:45.403 INFO:teuthology.orchestra.run.smithi003.stdout: Birth: 2024-09-21 12:07:16.555817254 +0000 2024-09-21T12:13:45.403 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T12:13:45.467 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records in 2024-09-21T12:13:45.467 INFO:teuthology.orchestra.run.smithi003.stderr:1+0 records out 2024-09-21T12:13:45.467 INFO:teuthology.orchestra.run.smithi003.stderr:512 bytes copied, 0.000232758 s, 2.2 MB/s 2024-09-21T12:13:45.468 DEBUG:teuthology.orchestra.run.smithi003:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T12:13:45.525 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-21T12:13:45.525 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/scratch_devs of=/dev/stdout 2024-09-21T12:13:45.546 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-21T12:13:45.546 DEBUG:teuthology.orchestra.run.smithi192:> stat /dev/vg_nvme/lv_1 2024-09-21T12:13:45.606 INFO:teuthology.orchestra.run.smithi192.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-21T12:13:45.606 INFO:teuthology.orchestra.run.smithi192.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T12:13:45.606 INFO:teuthology.orchestra.run.smithi192.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-21T12:13:45.607 INFO:teuthology.orchestra.run.smithi192.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T12:13:45.607 INFO:teuthology.orchestra.run.smithi192.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T12:13:45.607 INFO:teuthology.orchestra.run.smithi192.stdout:Access: 2024-09-21 12:13:09.426610814 +0000 2024-09-21T12:13:45.607 INFO:teuthology.orchestra.run.smithi192.stdout:Modify: 2024-09-21 12:07:07.348183634 +0000 2024-09-21T12:13:45.607 INFO:teuthology.orchestra.run.smithi192.stdout:Change: 2024-09-21 12:07:07.348183634 +0000 2024-09-21T12:13:45.607 INFO:teuthology.orchestra.run.smithi192.stdout: Birth: 2024-09-21 12:07:07.348183634 +0000 2024-09-21T12:13:45.607 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-21T12:13:45.676 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records in 2024-09-21T12:13:45.676 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records out 2024-09-21T12:13:45.676 INFO:teuthology.orchestra.run.smithi192.stderr:512 bytes copied, 0.000241189 s, 2.1 MB/s 2024-09-21T12:13:45.678 DEBUG:teuthology.orchestra.run.smithi192:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-21T12:13:45.737 DEBUG:teuthology.orchestra.run.smithi192:> stat /dev/vg_nvme/lv_2 2024-09-21T12:13:45.795 INFO:teuthology.orchestra.run.smithi192.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-21T12:13:45.795 INFO:teuthology.orchestra.run.smithi192.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T12:13:45.795 INFO:teuthology.orchestra.run.smithi192.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-21T12:13:45.795 INFO:teuthology.orchestra.run.smithi192.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T12:13:45.795 INFO:teuthology.orchestra.run.smithi192.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T12:13:45.795 INFO:teuthology.orchestra.run.smithi192.stdout:Access: 2024-09-21 12:13:09.426610814 +0000 2024-09-21T12:13:45.795 INFO:teuthology.orchestra.run.smithi192.stdout:Modify: 2024-09-21 12:07:07.672177232 +0000 2024-09-21T12:13:45.795 INFO:teuthology.orchestra.run.smithi192.stdout:Change: 2024-09-21 12:07:07.672177232 +0000 2024-09-21T12:13:45.796 INFO:teuthology.orchestra.run.smithi192.stdout: Birth: 2024-09-21 12:07:07.672177232 +0000 2024-09-21T12:13:45.796 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-21T12:13:45.862 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records in 2024-09-21T12:13:45.862 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records out 2024-09-21T12:13:45.862 INFO:teuthology.orchestra.run.smithi192.stderr:512 bytes copied, 0.000248127 s, 2.1 MB/s 2024-09-21T12:13:45.864 DEBUG:teuthology.orchestra.run.smithi192:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-21T12:13:45.921 DEBUG:teuthology.orchestra.run.smithi192:> stat /dev/vg_nvme/lv_3 2024-09-21T12:13:45.978 INFO:teuthology.orchestra.run.smithi192.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-21T12:13:45.978 INFO:teuthology.orchestra.run.smithi192.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T12:13:45.978 INFO:teuthology.orchestra.run.smithi192.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-21T12:13:45.978 INFO:teuthology.orchestra.run.smithi192.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T12:13:45.978 INFO:teuthology.orchestra.run.smithi192.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T12:13:45.979 INFO:teuthology.orchestra.run.smithi192.stdout:Access: 2024-09-21 12:13:09.427610795 +0000 2024-09-21T12:13:45.979 INFO:teuthology.orchestra.run.smithi192.stdout:Modify: 2024-09-21 12:07:07.997170810 +0000 2024-09-21T12:13:45.979 INFO:teuthology.orchestra.run.smithi192.stdout:Change: 2024-09-21 12:07:07.997170810 +0000 2024-09-21T12:13:45.979 INFO:teuthology.orchestra.run.smithi192.stdout: Birth: 2024-09-21 12:07:07.997170810 +0000 2024-09-21T12:13:45.979 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-21T12:13:46.043 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records in 2024-09-21T12:13:46.043 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records out 2024-09-21T12:13:46.043 INFO:teuthology.orchestra.run.smithi192.stderr:512 bytes copied, 0.000221053 s, 2.3 MB/s 2024-09-21T12:13:46.044 DEBUG:teuthology.orchestra.run.smithi192:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-21T12:13:46.101 DEBUG:teuthology.orchestra.run.smithi192:> stat /dev/vg_nvme/lv_4 2024-09-21T12:13:46.157 INFO:teuthology.orchestra.run.smithi192.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-21T12:13:46.157 INFO:teuthology.orchestra.run.smithi192.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-21T12:13:46.158 INFO:teuthology.orchestra.run.smithi192.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-21T12:13:46.158 INFO:teuthology.orchestra.run.smithi192.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T12:13:46.158 INFO:teuthology.orchestra.run.smithi192.stdout:Context: system_u:object_r:device_t:s0 2024-09-21T12:13:46.158 INFO:teuthology.orchestra.run.smithi192.stdout:Access: 2024-09-21 12:13:09.427610795 +0000 2024-09-21T12:13:46.158 INFO:teuthology.orchestra.run.smithi192.stdout:Modify: 2024-09-21 12:07:08.301164803 +0000 2024-09-21T12:13:46.158 INFO:teuthology.orchestra.run.smithi192.stdout:Change: 2024-09-21 12:07:08.301164803 +0000 2024-09-21T12:13:46.158 INFO:teuthology.orchestra.run.smithi192.stdout: Birth: 2024-09-21 12:07:08.301164803 +0000 2024-09-21T12:13:46.158 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-21T12:13:46.222 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records in 2024-09-21T12:13:46.222 INFO:teuthology.orchestra.run.smithi192.stderr:1+0 records out 2024-09-21T12:13:46.222 INFO:teuthology.orchestra.run.smithi192.stderr:512 bytes copied, 0.000202424 s, 2.5 MB/s 2024-09-21T12:13:46.223 DEBUG:teuthology.orchestra.run.smithi192:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-21T12:13:46.280 INFO:tasks.cephadm:Deploying osd.0 on smithi003 with /dev/vg_nvme/lv_4... 2024-09-21T12:13:46.280 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T12:13:46.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:46 smithi003 ceph-mon[28057]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:13:46.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:46 smithi192 ceph-mon[35641]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:13:47.277 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:13:47.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:47 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:13:47.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:47 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:13:48.557 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:48 smithi003 ceph-mon[28057]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:13:48.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:48 smithi192 ceph-mon[35641]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:13:50.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:50 smithi003 ceph-mon[28057]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:13:50.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:50 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:50.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:50 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:50.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:50 smithi003 ceph-mon[28057]: Reconfiguring grafana.smithi003 (dependencies changed)... 2024-09-21T12:13:50.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:50 smithi003 ceph-mon[28057]: Reconfiguring daemon grafana.smithi003 on smithi003 2024-09-21T12:13:50.497 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:13:50.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:50 smithi192 ceph-mon[35641]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:13:50.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:50 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:50.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:50 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:50.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:50 smithi192 ceph-mon[35641]: Reconfiguring grafana.smithi003 (dependencies changed)... 2024-09-21T12:13:50.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:50 smithi192 ceph-mon[35641]: Reconfiguring daemon grafana.smithi003 on smithi003 2024-09-21T12:13:50.525 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph orch daemon add osd smithi003:vg_nvme/lv_4 2024-09-21T12:13:51.250 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:13:52.288 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:52 smithi003 ceph-mon[28057]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:13:52.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:52 smithi192 ceph-mon[35641]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:13:53.158 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:53.141+0000 7f9d1c139640 1 -- 172.21.15.3:0/2211629307 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9d141001e0 msgr2=0x7f9d141005e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:53.158 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:53.141+0000 7f9d1c139640 1 --2- 172.21.15.3:0/2211629307 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9d141001e0 0x7f9d141005e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9d10009880 tx=0x7f9d1002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:13:53.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:53.142+0000 7f9d1c139640 1 -- 172.21.15.3:0/2211629307 shutdown_connections 2024-09-21T12:13:53.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:53.142+0000 7f9d1c139640 1 --2- 172.21.15.3:0/2211629307 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9d14100b20 0x7f9d14100f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:53.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:53.142+0000 7f9d1c139640 1 --2- 172.21.15.3:0/2211629307 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9d141001e0 0x7f9d141005e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:53.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:53.142+0000 7f9d1c139640 1 -- 172.21.15.3:0/2211629307 >> 172.21.15.3:0/2211629307 conn(0x7f9d140fc010 msgr2=0x7f9d140fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:13:53.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:53.142+0000 7f9d1c139640 1 -- 172.21.15.3:0/2211629307 shutdown_connections 2024-09-21T12:13:53.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:53.142+0000 7f9d1c139640 1 -- 172.21.15.3:0/2211629307 wait complete. 2024-09-21T12:13:53.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:53.142+0000 7f9d1c139640 1 Processor -- start 2024-09-21T12:13:53.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:53.142+0000 7f9d1c139640 1 -- start start 2024-09-21T12:13:53.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:53.143+0000 7f9d1c139640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9d141001e0 0x7f9d141996b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:53.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:53.143+0000 7f9d1c139640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9d14100b20 0x7f9d14199bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:53.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:53.143+0000 7f9d1c139640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f9d1410c990 con 0x7f9d141001e0 2024-09-21T12:13:53.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:53.143+0000 7f9d1c139640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9d1410c810 con 0x7f9d14100b20 2024-09-21T12:13:53.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:53.143+0000 7f9d19ed5640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9d141001e0 0x7f9d141996b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:53.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:53.143+0000 7f9d19ed5640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9d141001e0 0x7f9d141996b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:49300/0 (socket says 172.21.15.3:49300) 2024-09-21T12:13:53.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:53.143+0000 7f9d19ed5640 1 -- 172.21.15.3:0/1627004958 learned_addr learned my addr 172.21.15.3:0/1627004958 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:13:53.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:53.143+0000 7f9d196d4640 1 --2- 172.21.15.3:0/1627004958 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9d14100b20 0x7f9d14199bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:53.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:53.143+0000 7f9d19ed5640 1 -- 172.21.15.3:0/1627004958 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9d14100b20 msgr2=0x7f9d14199bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:13:53.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:53.143+0000 7f9d19ed5640 1 --2- 172.21.15.3:0/1627004958 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9d14100b20 0x7f9d14199bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:13:53.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:53.143+0000 7f9d19ed5640 1 -- 172.21.15.3:0/1627004958 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d1419a270 con 0x7f9d141001e0 2024-09-21T12:13:53.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:53.143+0000 7f9d19ed5640 1 --2- 172.21.15.3:0/1627004958 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9d141001e0 0x7f9d141996b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9d10006010 tx=0x7f9d100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:13:53.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:53.143+0000 7f9d0affd640 1 -- 172.21.15.3:0/1627004958 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9d1003f070 con 0x7f9d141001e0 2024-09-21T12:13:53.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:53.143+0000 7f9d1c139640 1 -- 172.21.15.3:0/1627004958 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d1419ec50 con 0x7f9d141001e0 2024-09-21T12:13:53.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:53.143+0000 7f9d0affd640 1 -- 172.21.15.3:0/1627004958 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9d10004ac0 con 0x7f9d141001e0 2024-09-21T12:13:53.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:53.143+0000 7f9d0affd640 1 -- 172.21.15.3:0/1627004958 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9d10035030 con 0x7f9d141001e0 2024-09-21T12:13:53.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:53.144+0000 7f9d1c139640 1 -- 172.21.15.3:0/1627004958 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d1419f190 con 0x7f9d141001e0 2024-09-21T12:13:53.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:53.144+0000 7f9d1c139640 1 -- 172.21.15.3:0/1627004958 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d141005e0 con 0x7f9d141001e0 2024-09-21T12:13:53.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:53.145+0000 7f9d0affd640 1 -- 172.21.15.3:0/1627004958 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 18) ==== 92493+0+0 (secure 0 0 0) 0x7f9d10042070 con 0x7f9d141001e0 2024-09-21T12:13:53.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:53.145+0000 7f9d0affd640 1 --2- 172.21.15.3:0/1627004958 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f9d0006e280 0x7f9d00070740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:13:53.161 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:53.145+0000 7f9d0affd640 1 -- 172.21.15.3:0/1627004958 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1370+0+0 (secure 0 0 0) 0x7f9d100add50 con 0x7f9d141001e0 2024-09-21T12:13:53.161 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:53.146+0000 7f9d196d4640 1 --2- 172.21.15.3:0/1627004958 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f9d0006e280 0x7f9d00070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:13:53.161 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:53.146+0000 7f9d196d4640 1 --2- 172.21.15.3:0/1627004958 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f9d0006e280 0x7f9d00070740 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9d04005fd0 tx=0x7f9d04005850 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:13:53.161 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:53.150+0000 7f9d0affd640 1 -- 172.21.15.3:0/1627004958 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9d1007c6f0 con 0x7f9d141001e0 2024-09-21T12:13:53.355 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:13:53.354+0000 7f9d1c139640 1 -- 172.21.15.3:0/1627004958 --> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi003:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f9d14062630 con 0x7f9d0006e280 2024-09-21T12:13:54.238 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:54 smithi003 ceph-mon[28057]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:13:54.239 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:54 smithi003 ceph-mon[28057]: from='client.14328 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi003:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:13:54.239 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:54 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T12:13:54.239 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:54 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T12:13:54.239 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:54 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:13:54.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:54 smithi192 ceph-mon[35641]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:13:54.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:54 smithi192 ceph-mon[35641]: from='client.14328 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi003:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:13:54.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:54 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T12:13:54.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:54 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T12:13:54.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:54 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:13:56.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:56 smithi003 ceph-mon[28057]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:13:56.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:56 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:56.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:56 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:56.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:56 smithi192 ceph-mon[35641]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:13:56.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:56 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:56.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:56 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:13:57.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:57 smithi003 ceph-mon[28057]: Reconfiguring prometheus.smithi003 (dependencies changed)... 2024-09-21T12:13:57.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:57 smithi003 ceph-mon[28057]: Reconfiguring daemon prometheus.smithi003 on smithi003 2024-09-21T12:13:57.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:57 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/3740411591' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d992d4d6-4292-4a47-9556-262dc7915d07"}]: dispatch 2024-09-21T12:13:57.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:57 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/3740411591' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d992d4d6-4292-4a47-9556-262dc7915d07"}]': finished 2024-09-21T12:13:57.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:57 smithi003 ceph-mon[28057]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T12:13:57.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:57 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T12:13:57.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:57 smithi192 ceph-mon[35641]: Reconfiguring prometheus.smithi003 (dependencies changed)... 2024-09-21T12:13:57.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:57 smithi192 ceph-mon[35641]: Reconfiguring daemon prometheus.smithi003 on smithi003 2024-09-21T12:13:57.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:57 smithi192 ceph-mon[35641]: from='client.? 172.21.15.3:0/3740411591' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d992d4d6-4292-4a47-9556-262dc7915d07"}]: dispatch 2024-09-21T12:13:57.509 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:57 smithi192 ceph-mon[35641]: from='client.? 172.21.15.3:0/3740411591' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d992d4d6-4292-4a47-9556-262dc7915d07"}]': finished 2024-09-21T12:13:57.509 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:57 smithi192 ceph-mon[35641]: osdmap e6: 1 total, 0 up, 1 in 2024-09-21T12:13:57.509 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:57 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T12:13:58.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:58 smithi192 ceph-mon[35641]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:13:58.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:13:58 smithi192 ceph-mon[35641]: from='client.? 172.21.15.3:0/3492387325' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T12:13:58.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:58 smithi003 ceph-mon[28057]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:13:58.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:13:58 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/3492387325' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T12:14:00.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:00 smithi192 ceph-mon[35641]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:14:00.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:00 smithi003 ceph-mon[28057]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:14:02.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:02 smithi192 ceph-mon[35641]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:14:02.541 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:02 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:14:02.551 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:02 smithi003 ceph-mon[28057]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:14:02.552 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:02 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:14:04.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:04 smithi003 ceph-mon[28057]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:14:04.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:04 smithi192 ceph-mon[35641]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:14:06.276 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:06 smithi003 ceph-mon[28057]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:14:06.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:06 smithi192 ceph-mon[35641]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:14:08.372 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:08 smithi003 ceph-mon[28057]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:14:08.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:08 smithi192 ceph-mon[35641]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:14:09.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:09 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:09.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:09 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:09.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:09 smithi192 ceph-mon[35641]: Reconfiguring ceph-exporter.smithi192 (monmap changed)... 2024-09-21T12:14:09.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:09 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi192", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-21T12:14:09.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:09 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:14:09.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:09 smithi192 ceph-mon[35641]: Reconfiguring daemon ceph-exporter.smithi192 on smithi192 2024-09-21T12:14:09.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:09 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:09.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:09 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:09.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:09 smithi003 ceph-mon[28057]: Reconfiguring ceph-exporter.smithi192 (monmap changed)... 2024-09-21T12:14:09.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:09 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi192", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-21T12:14:09.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:09 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:14:09.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:09 smithi003 ceph-mon[28057]: Reconfiguring daemon ceph-exporter.smithi192 on smithi192 2024-09-21T12:14:10.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:10 smithi192 ceph-mon[35641]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:14:10.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:10 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-21T12:14:10.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:10 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:14:10.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:10 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:10.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:10 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:10.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:10 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi192", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-21T12:14:10.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:10 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:14:10.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:10 smithi003 ceph-mon[28057]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:14:10.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:10 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-21T12:14:10.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:10 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:14:10.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:10 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:10.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:10 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:10.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:10 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi192", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-21T12:14:10.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:10 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:14:11.718 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:11 smithi003 ceph-mon[28057]: Deploying daemon osd.0 on smithi003 2024-09-21T12:14:11.719 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:11 smithi003 ceph-mon[28057]: Reconfiguring crash.smithi192 (monmap changed)... 2024-09-21T12:14:11.719 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:11 smithi003 ceph-mon[28057]: Reconfiguring daemon crash.smithi192 on smithi192 2024-09-21T12:14:11.719 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:11 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:11.719 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:11 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:11.719 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:11 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi192.qsaprd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T12:14:11.719 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:11 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T12:14:11.719 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:11 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:14:11.742 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:11 smithi192 ceph-mon[35641]: Deploying daemon osd.0 on smithi003 2024-09-21T12:14:11.742 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:11 smithi192 ceph-mon[35641]: Reconfiguring crash.smithi192 (monmap changed)... 2024-09-21T12:14:11.742 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:11 smithi192 ceph-mon[35641]: Reconfiguring daemon crash.smithi192 on smithi192 2024-09-21T12:14:11.742 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:11 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:11.742 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:11 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:11.742 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:11 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi192.qsaprd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T12:14:11.742 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:11 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T12:14:11.742 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:11 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:14:12.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:12 smithi003 ceph-mon[28057]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:14:12.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:12 smithi003 ceph-mon[28057]: Reconfiguring mgr.smithi192.qsaprd (monmap changed)... 2024-09-21T12:14:12.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:12 smithi003 ceph-mon[28057]: Reconfiguring daemon mgr.smithi192.qsaprd on smithi192 2024-09-21T12:14:12.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:12 smithi192 ceph-mon[35641]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:14:12.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:12 smithi192 ceph-mon[35641]: Reconfiguring mgr.smithi192.qsaprd (monmap changed)... 2024-09-21T12:14:12.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:12 smithi192 ceph-mon[35641]: Reconfiguring daemon mgr.smithi192.qsaprd on smithi192 2024-09-21T12:14:13.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:13 smithi192 ceph-mon[35641]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:14:13.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:13 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:13.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:13 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:13.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:13 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-21T12:14:13.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:13 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-21T12:14:13.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:13 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:14:13.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:13 smithi003 ceph-mon[28057]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:14:13.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:13 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:13.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:13 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:13.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:13 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-21T12:14:13.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:13 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-21T12:14:13.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:13 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:14:14.737 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:14 smithi003 ceph-mon[28057]: Reconfiguring mon.smithi192 (monmap changed)... 2024-09-21T12:14:14.737 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:14 smithi003 ceph-mon[28057]: Reconfiguring daemon mon.smithi192 on smithi192 2024-09-21T12:14:14.738 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:14 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:14.738 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:14 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:14.738 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:14 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-21T12:14:14.738 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:14 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi003.front.sepia.ceph.com:9093"}]: dispatch 2024-09-21T12:14:14.738 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:14 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:14.738 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:14 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-21T12:14:14.738 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:14 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi003.front.sepia.ceph.com:3000"}]: dispatch 2024-09-21T12:14:14.738 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:14 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:14.738 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:14 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T12:14:14.738 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:14 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi003.front.sepia.ceph.com:9095"}]: dispatch 2024-09-21T12:14:14.739 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:14 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:14.739 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:14 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:14:14.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:14 smithi192 ceph-mon[35641]: Reconfiguring mon.smithi192 (monmap changed)... 2024-09-21T12:14:14.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:14 smithi192 ceph-mon[35641]: Reconfiguring daemon mon.smithi192 on smithi192 2024-09-21T12:14:14.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:14 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:14.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:14 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:14.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:14 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-21T12:14:14.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:14 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi003.front.sepia.ceph.com:9093"}]: dispatch 2024-09-21T12:14:14.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:14 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:14.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:14 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-21T12:14:14.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:14 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi003.front.sepia.ceph.com:3000"}]: dispatch 2024-09-21T12:14:14.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:14 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:14.759 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:14 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T12:14:14.759 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:14 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi003.front.sepia.ceph.com:9095"}]: dispatch 2024-09-21T12:14:14.759 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:14 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:14.759 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:14 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:14:15.708 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:15 smithi003 ceph-mon[28057]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-21T12:14:15.708 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:15 smithi003 ceph-mon[28057]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi003.front.sepia.ceph.com:9093"}]: dispatch 2024-09-21T12:14:15.708 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:15 smithi003 ceph-mon[28057]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-21T12:14:15.708 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:15 smithi003 ceph-mon[28057]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi003.front.sepia.ceph.com:3000"}]: dispatch 2024-09-21T12:14:15.708 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:15 smithi003 ceph-mon[28057]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T12:14:15.708 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:15 smithi003 ceph-mon[28057]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi003.front.sepia.ceph.com:9095"}]: dispatch 2024-09-21T12:14:15.708 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:15 smithi003 ceph-mon[28057]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:14:15.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:15 smithi192 ceph-mon[35641]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-21T12:14:15.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:15 smithi192 ceph-mon[35641]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi003.front.sepia.ceph.com:9093"}]: dispatch 2024-09-21T12:14:15.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:15 smithi192 ceph-mon[35641]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-21T12:14:15.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:15 smithi192 ceph-mon[35641]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi003.front.sepia.ceph.com:3000"}]: dispatch 2024-09-21T12:14:15.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:15 smithi192 ceph-mon[35641]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T12:14:15.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:15 smithi192 ceph-mon[35641]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi003.front.sepia.ceph.com:9095"}]: dispatch 2024-09-21T12:14:15.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:15 smithi192 ceph-mon[35641]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:14:17.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:16 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:17.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:16 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:17.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:16 smithi003 ceph-mon[28057]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:14:17.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:16 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:14:17.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:16 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:17.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:16 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:17.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:16 smithi192 ceph-mon[35641]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:14:17.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:16 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:14:17.937 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:17 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:17.938 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:17 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:18.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:17 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:18.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:17 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:19.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:18 smithi192 ceph-mon[35641]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:14:19.302 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:18 smithi003 ceph-mon[28057]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:14:21.706 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:21 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:21.706 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:21 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:21.706 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:21 smithi003 ceph-mon[28057]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:14:21.706 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:21 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:14:21.706 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:21 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:14:21.706 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:21 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:21.706 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:21 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:14:21.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:21 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:21.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:21 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:21.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:21 smithi192 ceph-mon[35641]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:14:21.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:21 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:14:21.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:21 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:14:21.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:21 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:21.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:21 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:14:22.633 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:22 smithi003 ceph-mon[28057]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:14:22.672 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:22.670+0000 7f9d0affd640 1 -- 172.21.15.3:0/1627004958 <== mgr.14217 v2:172.21.15.3:6800/2480880781 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f9d14062630 con 0x7f9d0006e280 2024-09-21T12:14:22.673 INFO:teuthology.orchestra.run.smithi003.stdout:Created osd(s) 0 on host 'smithi003' 2024-09-21T12:14:22.674 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:22.673+0000 7f9d1c139640 1 -- 172.21.15.3:0/1627004958 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f9d0006e280 msgr2=0x7f9d00070740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:14:22.674 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:22.673+0000 7f9d1c139640 1 --2- 172.21.15.3:0/1627004958 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f9d0006e280 0x7f9d00070740 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f9d04005fd0 tx=0x7f9d04005850 comp rx=0 tx=0).stop 2024-09-21T12:14:22.674 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:22.673+0000 7f9d1c139640 1 -- 172.21.15.3:0/1627004958 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9d141001e0 msgr2=0x7f9d141996b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:14:22.674 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:22.673+0000 7f9d1c139640 1 --2- 172.21.15.3:0/1627004958 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9d141001e0 0x7f9d141996b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9d10006010 tx=0x7f9d100046c0 comp rx=0 tx=0).stop 2024-09-21T12:14:22.675 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:22.673+0000 7f9d1c139640 1 -- 172.21.15.3:0/1627004958 shutdown_connections 2024-09-21T12:14:22.675 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:22.673+0000 7f9d1c139640 1 --2- 172.21.15.3:0/1627004958 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f9d0006e280 0x7f9d00070740 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:22.675 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:22.673+0000 7f9d1c139640 1 --2- 172.21.15.3:0/1627004958 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9d14100b20 0x7f9d14199bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:22.675 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:22.673+0000 7f9d1c139640 1 --2- 172.21.15.3:0/1627004958 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9d141001e0 0x7f9d141996b0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:22.675 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:22.673+0000 7f9d1c139640 1 -- 172.21.15.3:0/1627004958 >> 172.21.15.3:0/1627004958 conn(0x7f9d140fc010 msgr2=0x7f9d14108a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:14:22.675 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:22.673+0000 7f9d1c139640 1 -- 172.21.15.3:0/1627004958 shutdown_connections 2024-09-21T12:14:22.675 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:22.673+0000 7f9d1c139640 1 -- 172.21.15.3:0/1627004958 wait complete. 2024-09-21T12:14:23.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:22 smithi192 ceph-mon[35641]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:14:23.347 DEBUG:teuthology.orchestra.run.smithi003:osd.0> sudo journalctl -f -n 0 -u ceph-641beec0-7812-11ef-baf6-efdc52797490@osd.0.service 2024-09-21T12:14:23.354 INFO:tasks.cephadm:Deploying osd.1 on smithi003 with /dev/vg_nvme/lv_3... 2024-09-21T12:14:23.354 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T12:14:23.953 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:23 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:23.953 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:23 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:23.953 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:23 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:23.953 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:23 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:23.953 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:23 smithi003 ceph-mon[28057]: from='osd.0 [v2:172.21.15.3:6802/974168994,v1:172.21.15.3:6803/974168994]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-21T12:14:24.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:23 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:24.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:23 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:24.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:23 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:24.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:23 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:24.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:23 smithi192 ceph-mon[35641]: from='osd.0 [v2:172.21.15.3:6802/974168994,v1:172.21.15.3:6803/974168994]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-21T12:14:24.225 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:14:25.102 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:24 smithi003 ceph-mon[28057]: from='osd.0 [v2:172.21.15.3:6802/974168994,v1:172.21.15.3:6803/974168994]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T12:14:25.102 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:24 smithi003 ceph-mon[28057]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T12:14:25.102 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:24 smithi003 ceph-mon[28057]: from='osd.0 [v2:172.21.15.3:6802/974168994,v1:172.21.15.3:6803/974168994]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi003", "root=default"]}]: dispatch 2024-09-21T12:14:25.102 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:24 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T12:14:25.102 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:24 smithi003 ceph-mon[28057]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:14:25.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:24 smithi192 ceph-mon[35641]: from='osd.0 [v2:172.21.15.3:6802/974168994,v1:172.21.15.3:6803/974168994]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T12:14:25.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:24 smithi192 ceph-mon[35641]: osdmap e7: 1 total, 0 up, 1 in 2024-09-21T12:14:25.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:24 smithi192 ceph-mon[35641]: from='osd.0 [v2:172.21.15.3:6802/974168994,v1:172.21.15.3:6803/974168994]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi003", "root=default"]}]: dispatch 2024-09-21T12:14:25.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:24 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T12:14:25.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:24 smithi192 ceph-mon[35641]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:14:25.994 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:25 smithi003 ceph-mon[28057]: from='osd.0 [v2:172.21.15.3:6802/974168994,v1:172.21.15.3:6803/974168994]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi003", "root=default"]}]': finished 2024-09-21T12:14:25.994 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:25 smithi003 ceph-mon[28057]: osdmap e8: 1 total, 0 up, 1 in 2024-09-21T12:14:25.994 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:25 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T12:14:25.994 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:25 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T12:14:25.994 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:25 smithi003 ceph-mon[28057]: from='osd.0 [v2:172.21.15.3:6802/974168994,v1:172.21.15.3:6803/974168994]' entity='osd.0' 2024-09-21T12:14:25.994 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:25 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T12:14:25.994 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:14:25 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-0[49420]: 2024-09-21T12:14:25.625+0000 7f4435b5d640 -1 osd.0 0 waiting for initial osdmap 2024-09-21T12:14:25.994 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:14:25 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-0[49420]: 2024-09-21T12:14:25.637+0000 7f442e18f640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T12:14:26.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:25 smithi192 ceph-mon[35641]: from='osd.0 [v2:172.21.15.3:6802/974168994,v1:172.21.15.3:6803/974168994]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi003", "root=default"]}]': finished 2024-09-21T12:14:26.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:25 smithi192 ceph-mon[35641]: osdmap e8: 1 total, 0 up, 1 in 2024-09-21T12:14:26.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:25 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T12:14:26.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:25 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T12:14:26.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:25 smithi192 ceph-mon[35641]: from='osd.0 [v2:172.21.15.3:6802/974168994,v1:172.21.15.3:6803/974168994]' entity='osd.0' 2024-09-21T12:14:26.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:25 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T12:14:26.981 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:26 smithi003 ceph-mon[28057]: purged_snaps scrub starts 2024-09-21T12:14:26.981 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:26 smithi003 ceph-mon[28057]: purged_snaps scrub ok 2024-09-21T12:14:26.981 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:26 smithi003 ceph-mon[28057]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:14:26.981 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:26 smithi003 ceph-mon[28057]: osd.0 [v2:172.21.15.3:6802/974168994,v1:172.21.15.3:6803/974168994] boot 2024-09-21T12:14:26.981 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:26 smithi003 ceph-mon[28057]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T12:14:26.981 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:26 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T12:14:27.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:26 smithi192 ceph-mon[35641]: purged_snaps scrub starts 2024-09-21T12:14:27.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:26 smithi192 ceph-mon[35641]: purged_snaps scrub ok 2024-09-21T12:14:27.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:26 smithi192 ceph-mon[35641]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-21T12:14:27.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:26 smithi192 ceph-mon[35641]: osd.0 [v2:172.21.15.3:6802/974168994,v1:172.21.15.3:6803/974168994] boot 2024-09-21T12:14:27.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:26 smithi192 ceph-mon[35641]: osdmap e9: 1 total, 1 up, 1 in 2024-09-21T12:14:27.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:26 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T12:14:28.040 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:14:28.070 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph orch daemon add osd smithi003:vg_nvme/lv_3 2024-09-21T12:14:28.467 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:14:28.966 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:28.963+0000 7fbbf7215640 1 -- 172.21.15.3:0/1301325104 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbbf0104d20 msgr2=0x7fbbf0107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:14:28.967 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:28.963+0000 7fbbf7215640 1 --2- 172.21.15.3:0/1301325104 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbbf0104d20 0x7fbbf0107110 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fbbe40098b0 tx=0x7fbbe402a4d0 comp rx=0 tx=0).stop 2024-09-21T12:14:28.967 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:28.963+0000 7fbbf7215640 1 -- 172.21.15.3:0/1301325104 shutdown_connections 2024-09-21T12:14:28.967 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:28.963+0000 7fbbf7215640 1 --2- 172.21.15.3:0/1301325104 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbbf0104d20 0x7fbbf0107110 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:28.967 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:28.963+0000 7fbbf7215640 1 --2- 172.21.15.3:0/1301325104 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbbf01023f0 0x7fbbf01047e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:28.967 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:28.963+0000 7fbbf7215640 1 -- 172.21.15.3:0/1301325104 >> 172.21.15.3:0/1301325104 conn(0x7fbbf00fc010 msgr2=0x7fbbf00fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:14:28.967 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:28.963+0000 7fbbf7215640 1 -- 172.21.15.3:0/1301325104 shutdown_connections 2024-09-21T12:14:28.967 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:28.963+0000 7fbbf7215640 1 -- 172.21.15.3:0/1301325104 wait complete. 2024-09-21T12:14:28.967 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:28.963+0000 7fbbf7215640 1 Processor -- start 2024-09-21T12:14:28.967 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:28.963+0000 7fbbf7215640 1 -- start start 2024-09-21T12:14:28.967 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:28.963+0000 7fbbf7215640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbbf01023f0 0x7fbbf0197510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:14:28.967 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:28.963+0000 7fbbf7215640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbbf0104d20 0x7fbbf0197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:14:28.967 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:28.963+0000 7fbbf7215640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf010a790 con 0x7fbbf0104d20 2024-09-21T12:14:28.967 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:28.963+0000 7fbbf7215640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fbbf010a610 con 0x7fbbf01023f0 2024-09-21T12:14:28.968 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:28.964+0000 7fbbeffff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbbf0104d20 0x7fbbf0197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:14:28.968 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:28.964+0000 7fbbeffff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbbf0104d20 0x7fbbf0197a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:55506/0 (socket says 172.21.15.3:55506) 2024-09-21T12:14:28.968 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:28.964+0000 7fbbeffff640 1 -- 172.21.15.3:0/2002210474 learned_addr learned my addr 172.21.15.3:0/2002210474 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:14:28.968 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:28.964+0000 7fbbf4fb1640 1 --2- 172.21.15.3:0/2002210474 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbbf01023f0 0x7fbbf0197510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:14:28.968 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:28.964+0000 7fbbeffff640 1 -- 172.21.15.3:0/2002210474 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbbf01023f0 msgr2=0x7fbbf0197510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:14:28.968 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:28.964+0000 7fbbeffff640 1 --2- 172.21.15.3:0/2002210474 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbbf01023f0 0x7fbbf0197510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:28.968 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:28.964+0000 7fbbeffff640 1 -- 172.21.15.3:0/2002210474 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbf01980d0 con 0x7fbbf0104d20 2024-09-21T12:14:28.968 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:28.964+0000 7fbbeffff640 1 --2- 172.21.15.3:0/2002210474 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbbf0104d20 0x7fbbf0197a50 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fbbe4009230 tx=0x7fbbe40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:14:28.968 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:28.964+0000 7fbbedffb640 1 -- 172.21.15.3:0/2002210474 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbbe403f070 con 0x7fbbf0104d20 2024-09-21T12:14:28.968 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:28.964+0000 7fbbedffb640 1 -- 172.21.15.3:0/2002210474 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbbe4004a50 con 0x7fbbf0104d20 2024-09-21T12:14:28.968 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:28.964+0000 7fbbedffb640 1 -- 172.21.15.3:0/2002210474 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbbe4035030 con 0x7fbbf0104d20 2024-09-21T12:14:28.968 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:28.964+0000 7fbbf7215640 1 -- 172.21.15.3:0/2002210474 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbf019cab0 con 0x7fbbf0104d20 2024-09-21T12:14:28.968 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:28.965+0000 7fbbf7215640 1 -- 172.21.15.3:0/2002210474 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbf019d040 con 0x7fbbf0104d20 2024-09-21T12:14:28.969 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:28.966+0000 7fbbf7215640 1 -- 172.21.15.3:0/2002210474 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbf01027d0 con 0x7fbbf0104d20 2024-09-21T12:14:28.969 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:28.966+0000 7fbbedffb640 1 -- 172.21.15.3:0/2002210474 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 18) ==== 92493+0+0 (secure 0 0 0) 0x7fbbe4042070 con 0x7fbbf0104d20 2024-09-21T12:14:28.969 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:28.967+0000 7fbbedffb640 1 --2- 172.21.15.3:0/2002210474 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fbbd806e280 0x7fbbd8070740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:14:28.969 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:28.967+0000 7fbbedffb640 1 -- 172.21.15.3:0/2002210474 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1982+0+0 (secure 0 0 0) 0x7fbbe40add90 con 0x7fbbf0104d20 2024-09-21T12:14:28.970 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:28.967+0000 7fbbf4fb1640 1 --2- 172.21.15.3:0/2002210474 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fbbd806e280 0x7fbbd8070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:14:28.970 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:28.967+0000 7fbbf4fb1640 1 --2- 172.21.15.3:0/2002210474 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fbbd806e280 0x7fbbd8070740 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbbe0005fd0 tx=0x7fbbe0005850 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:14:28.973 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:28.972+0000 7fbbedffb640 1 -- 172.21.15.3:0/2002210474 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbbe407c5f0 con 0x7fbbf0104d20 2024-09-21T12:14:29.132 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:28 smithi003 ceph-mon[28057]: osdmap e10: 1 total, 1 up, 1 in 2024-09-21T12:14:29.132 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:28 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:29.132 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:28 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:29.132 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:28 smithi003 ceph-mon[28057]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T12:14:29.177 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:29.175+0000 7fbbf7215640 1 -- 172.21.15.3:0/2002210474 --> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi003:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fbbf0105720 con 0x7fbbd806e280 2024-09-21T12:14:29.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:28 smithi192 ceph-mon[35641]: osdmap e10: 1 total, 1 up, 1 in 2024-09-21T12:14:29.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:28 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:29.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:28 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:29.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:28 smithi192 ceph-mon[35641]: pgmap v49: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T12:14:30.050 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:29 smithi003 ceph-mon[28057]: from='client.14346 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi003:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:14:30.050 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:29 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T12:14:30.050 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:29 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T12:14:30.050 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:29 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:14:30.159 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:29 smithi192 ceph-mon[35641]: from='client.14346 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi003:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:14:30.159 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:29 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T12:14:30.159 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:29 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T12:14:30.159 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:29 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:14:30.886 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:30 smithi003 ceph-mon[28057]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T12:14:31.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:30 smithi192 ceph-mon[35641]: pgmap v50: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T12:14:32.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:31 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:14:32.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:31 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:14:33.501 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:33 smithi003 ceph-mon[28057]: Detected new or changed devices on smithi003 2024-09-21T12:14:33.634 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:33 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:33.634 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:33 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:33.634 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:33 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:14:33.634 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:33 smithi003 ceph-mon[28057]: Adjusting osd_memory_target on smithi003 to 11844M 2024-09-21T12:14:33.635 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:33 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:33.635 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:33 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:14:33.635 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:33 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:14:33.635 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:33 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:33.635 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:33 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:14:33.635 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:33 smithi003 ceph-mon[28057]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T12:14:33.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:33 smithi192 ceph-mon[35641]: Detected new or changed devices on smithi003 2024-09-21T12:14:33.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:33 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:33.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:33 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:33.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:33 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:14:33.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:33 smithi192 ceph-mon[35641]: Adjusting osd_memory_target on smithi003 to 11844M 2024-09-21T12:14:33.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:33 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:33.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:33 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:14:33.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:33 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:14:33.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:33 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:33.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:33 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:14:33.759 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:33 smithi192 ceph-mon[35641]: pgmap v51: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T12:14:34.479 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:34 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/2463529611' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e3a36979-b369-43c8-867e-d7c96c00ec5e"}]: dispatch 2024-09-21T12:14:34.479 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:34 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/2463529611' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e3a36979-b369-43c8-867e-d7c96c00ec5e"}]': finished 2024-09-21T12:14:34.479 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:34 smithi003 ceph-mon[28057]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T12:14:34.479 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:34 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T12:14:34.479 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:34 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/4259069548' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T12:14:34.479 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:34 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:34.479 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:34 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:34.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:34 smithi192 ceph-mon[35641]: from='client.? 172.21.15.3:0/2463529611' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e3a36979-b369-43c8-867e-d7c96c00ec5e"}]: dispatch 2024-09-21T12:14:34.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:34 smithi192 ceph-mon[35641]: from='client.? 172.21.15.3:0/2463529611' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e3a36979-b369-43c8-867e-d7c96c00ec5e"}]': finished 2024-09-21T12:14:34.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:34 smithi192 ceph-mon[35641]: osdmap e11: 2 total, 1 up, 2 in 2024-09-21T12:14:34.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:34 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T12:14:34.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:34 smithi192 ceph-mon[35641]: from='client.? 172.21.15.3:0/4259069548' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T12:14:34.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:34 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:34.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:34 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:35.728 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:35 smithi003 ceph-mon[28057]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T12:14:35.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:35 smithi192 ceph-mon[35641]: pgmap v53: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T12:14:36.690 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:36 smithi003 ceph-mon[28057]: pgmap v54: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T12:14:37.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:36 smithi192 ceph-mon[35641]: pgmap v54: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T12:14:38.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:37 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:38.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:37 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:38.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:37 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:14:38.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:37 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:14:38.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:37 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:38.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:37 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:38.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:37 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:38.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:37 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:14:38.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:37 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:14:38.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:37 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:39.051 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:38 smithi003 ceph-mon[28057]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T12:14:39.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:38 smithi192 ceph-mon[35641]: pgmap v55: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T12:14:40.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:40 smithi003 ceph-mon[28057]: pgmap v56: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T12:14:40.892 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:40 smithi192 ceph-mon[35641]: pgmap v56: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T12:14:42.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:42 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-21T12:14:42.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:42 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:14:42.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:42 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-21T12:14:42.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:42 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:14:43.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:43 smithi192 ceph-mon[35641]: Deploying daemon osd.1 on smithi003 2024-09-21T12:14:43.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:43 smithi192 ceph-mon[35641]: pgmap v57: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T12:14:43.798 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:43 smithi003 ceph-mon[28057]: Deploying daemon osd.1 on smithi003 2024-09-21T12:14:43.798 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:43 smithi003 ceph-mon[28057]: pgmap v57: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T12:14:44.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:44 smithi003 ceph-mon[28057]: pgmap v58: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T12:14:45.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:44 smithi192 ceph-mon[35641]: pgmap v58: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T12:14:47.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:46 smithi192 ceph-mon[35641]: pgmap v59: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T12:14:47.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:46 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:14:47.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:46 smithi003 ceph-mon[28057]: pgmap v59: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T12:14:47.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:46 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:14:48.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:48 smithi003 ceph-mon[28057]: pgmap v60: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T12:14:49.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:48 smithi192 ceph-mon[35641]: pgmap v60: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T12:14:49.719 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:49 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:14:49.719 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:49 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:49.719 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:49 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:50.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:49 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:14:50.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:49 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:50.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:49 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:50.717 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:50 smithi003 ceph-mon[28057]: pgmap v61: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T12:14:50.717 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:50 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:50.717 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:50 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:51.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:50 smithi192 ceph-mon[35641]: pgmap v61: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T12:14:51.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:50 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:51.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:50 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:52.272 INFO:teuthology.orchestra.run.smithi003.stdout:Created osd(s) 1 on host 'smithi003' 2024-09-21T12:14:52.272 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:52.268+0000 7fbbedffb640 1 -- 172.21.15.3:0/2002210474 <== mgr.14217 v2:172.21.15.3:6800/2480880781 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fbbf0105720 con 0x7fbbd806e280 2024-09-21T12:14:52.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:52.271+0000 7fbbf7215640 1 -- 172.21.15.3:0/2002210474 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fbbd806e280 msgr2=0x7fbbd8070740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:14:52.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:52.271+0000 7fbbf7215640 1 --2- 172.21.15.3:0/2002210474 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fbbd806e280 0x7fbbd8070740 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fbbe0005fd0 tx=0x7fbbe0005850 comp rx=0 tx=0).stop 2024-09-21T12:14:52.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:52.271+0000 7fbbf7215640 1 -- 172.21.15.3:0/2002210474 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbbf0104d20 msgr2=0x7fbbf0197a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:14:52.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:52.271+0000 7fbbf7215640 1 --2- 172.21.15.3:0/2002210474 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbbf0104d20 0x7fbbf0197a50 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fbbe4009230 tx=0x7fbbe40045e0 comp rx=0 tx=0).stop 2024-09-21T12:14:52.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:52.272+0000 7fbbf7215640 1 -- 172.21.15.3:0/2002210474 shutdown_connections 2024-09-21T12:14:52.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:52.272+0000 7fbbf7215640 1 --2- 172.21.15.3:0/2002210474 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fbbd806e280 0x7fbbd8070740 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:52.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:52.272+0000 7fbbf7215640 1 --2- 172.21.15.3:0/2002210474 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbbf0104d20 0x7fbbf0197a50 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:52.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:52.272+0000 7fbbf7215640 1 --2- 172.21.15.3:0/2002210474 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbbf01023f0 0x7fbbf0197510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:52.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:52.272+0000 7fbbf7215640 1 -- 172.21.15.3:0/2002210474 >> 172.21.15.3:0/2002210474 conn(0x7fbbf00fc010 msgr2=0x7fbbf00fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:14:52.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:52.272+0000 7fbbf7215640 1 -- 172.21.15.3:0/2002210474 shutdown_connections 2024-09-21T12:14:52.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:52.272+0000 7fbbf7215640 1 -- 172.21.15.3:0/2002210474 wait complete. 2024-09-21T12:14:53.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:53 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:53.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:53 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:53.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:53 smithi003 ceph-mon[28057]: pgmap v62: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T12:14:53.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:53 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:53.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:53 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:53.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:53 smithi192 ceph-mon[35641]: pgmap v62: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T12:14:53.927 DEBUG:teuthology.orchestra.run.smithi003:osd.1> sudo journalctl -f -n 0 -u ceph-641beec0-7812-11ef-baf6-efdc52797490@osd.1.service 2024-09-21T12:14:53.930 INFO:tasks.cephadm:Deploying osd.2 on smithi003 with /dev/vg_nvme/lv_2... 2024-09-21T12:14:53.930 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T12:14:54.278 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:14:54.758 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:54 smithi003 ceph-mon[28057]: pgmap v63: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T12:14:55.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:54 smithi192 ceph-mon[35641]: pgmap v63: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T12:14:55.080 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:14:54 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-1[57084]: 2024-09-21T12:14:54.995+0000 7f50de0c9640 -1 osd.1 0 log_to_monitors true 2024-09-21T12:14:55.752 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:55 smithi003 ceph-mon[28057]: from='osd.1 [v2:172.21.15.3:6810/3334119815,v1:172.21.15.3:6811/3334119815]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-21T12:14:56.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:55 smithi192 ceph-mon[35641]: from='osd.1 [v2:172.21.15.3:6810/3334119815,v1:172.21.15.3:6811/3334119815]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-21T12:14:56.844 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:14:56 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-1[57084]: 2024-09-21T12:14:56.591+0000 7f50d9829640 -1 osd.1 0 waiting for initial osdmap 2024-09-21T12:14:56.844 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:14:56 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-1[57084]: 2024-09-21T12:14:56.596+0000 7f50d5e63640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T12:14:56.845 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:56 smithi003 ceph-mon[28057]: from='osd.1 [v2:172.21.15.3:6810/3334119815,v1:172.21.15.3:6811/3334119815]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T12:14:56.845 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:56 smithi003 ceph-mon[28057]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T12:14:56.845 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:56 smithi003 ceph-mon[28057]: from='osd.1 [v2:172.21.15.3:6810/3334119815,v1:172.21.15.3:6811/3334119815]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi003", "root=default"]}]: dispatch 2024-09-21T12:14:56.845 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:56 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T12:14:56.845 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:56 smithi003 ceph-mon[28057]: pgmap v65: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T12:14:57.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:56 smithi192 ceph-mon[35641]: from='osd.1 [v2:172.21.15.3:6810/3334119815,v1:172.21.15.3:6811/3334119815]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T12:14:57.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:56 smithi192 ceph-mon[35641]: osdmap e12: 2 total, 1 up, 2 in 2024-09-21T12:14:57.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:56 smithi192 ceph-mon[35641]: from='osd.1 [v2:172.21.15.3:6810/3334119815,v1:172.21.15.3:6811/3334119815]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi003", "root=default"]}]: dispatch 2024-09-21T12:14:57.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:56 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T12:14:57.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:56 smithi192 ceph-mon[35641]: pgmap v65: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T12:14:57.787 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:57 smithi003 ceph-mon[28057]: from='osd.1 [v2:172.21.15.3:6810/3334119815,v1:172.21.15.3:6811/3334119815]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi003", "root=default"]}]': finished 2024-09-21T12:14:57.787 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:57 smithi003 ceph-mon[28057]: osdmap e13: 2 total, 1 up, 2 in 2024-09-21T12:14:57.787 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:57 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T12:14:57.787 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:57 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T12:14:57.787 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:57 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T12:14:58.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:57 smithi192 ceph-mon[35641]: from='osd.1 [v2:172.21.15.3:6810/3334119815,v1:172.21.15.3:6811/3334119815]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi003", "root=default"]}]': finished 2024-09-21T12:14:58.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:57 smithi192 ceph-mon[35641]: osdmap e13: 2 total, 1 up, 2 in 2024-09-21T12:14:58.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:57 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T12:14:58.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:57 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T12:14:58.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:57 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T12:14:58.108 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:14:58.143 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph orch daemon add osd smithi003:vg_nvme/lv_2 2024-09-21T12:14:58.453 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:14:58.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:58 smithi003 ceph-mon[28057]: purged_snaps scrub starts 2024-09-21T12:14:58.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:58 smithi003 ceph-mon[28057]: purged_snaps scrub ok 2024-09-21T12:14:58.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:58 smithi003 ceph-mon[28057]: osd.1 [v2:172.21.15.3:6810/3334119815,v1:172.21.15.3:6811/3334119815] boot 2024-09-21T12:14:58.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:58 smithi003 ceph-mon[28057]: osdmap e14: 2 total, 2 up, 2 in 2024-09-21T12:14:58.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:58 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T12:14:58.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:58 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:58.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:58 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:58.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:58 smithi003 ceph-mon[28057]: pgmap v68: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T12:14:59.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:58 smithi192 ceph-mon[35641]: purged_snaps scrub starts 2024-09-21T12:14:59.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:58 smithi192 ceph-mon[35641]: purged_snaps scrub ok 2024-09-21T12:14:59.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:58 smithi192 ceph-mon[35641]: osd.1 [v2:172.21.15.3:6810/3334119815,v1:172.21.15.3:6811/3334119815] boot 2024-09-21T12:14:59.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:58 smithi192 ceph-mon[35641]: osdmap e14: 2 total, 2 up, 2 in 2024-09-21T12:14:59.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:58 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T12:14:59.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:58 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:59.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:58 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:14:59.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:58 smithi192 ceph-mon[35641]: pgmap v68: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-09-21T12:14:59.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:59.558+0000 7f115a353640 1 -- 172.21.15.3:0/500489031 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f11540ffc40 msgr2=0x7f1154100040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:14:59.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:59.558+0000 7f115a353640 1 --2- 172.21.15.3:0/500489031 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f11540ffc40 0x7f1154100040 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1144009880 tx=0x7f114402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:14:59.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:59.558+0000 7f115a353640 1 -- 172.21.15.3:0/500489031 shutdown_connections 2024-09-21T12:14:59.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:59.558+0000 7f115a353640 1 --2- 172.21.15.3:0/500489031 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1154102cc0 0x7f1154103140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:59.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:59.558+0000 7f115a353640 1 --2- 172.21.15.3:0/500489031 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f11540ffc40 0x7f1154100040 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:59.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:59.558+0000 7f115a353640 1 -- 172.21.15.3:0/500489031 >> 172.21.15.3:0/500489031 conn(0x7f11540fb770 msgr2=0x7f11540fdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:14:59.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:59.558+0000 7f115a353640 1 -- 172.21.15.3:0/500489031 shutdown_connections 2024-09-21T12:14:59.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:59.558+0000 7f115a353640 1 -- 172.21.15.3:0/500489031 wait complete. 2024-09-21T12:14:59.561 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:59.559+0000 7f115a353640 1 Processor -- start 2024-09-21T12:14:59.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:59.559+0000 7f115a353640 1 -- start start 2024-09-21T12:14:59.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:59.559+0000 7f115a353640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f11540ffc40 0x7f11541025b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:14:59.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:59.559+0000 7f115a353640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1154102cc0 0x7f1154100c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:14:59.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:59.559+0000 7f115a353640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f115410a7b0 con 0x7f1154102cc0 2024-09-21T12:14:59.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:59.559+0000 7f115a353640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f115410a630 con 0x7f11540ffc40 2024-09-21T12:14:59.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:59.559+0000 7f11537fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1154102cc0 0x7f1154100c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:14:59.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:59.559+0000 7f11537fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1154102cc0 0x7f1154100c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:52032/0 (socket says 172.21.15.3:52032) 2024-09-21T12:14:59.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:59.559+0000 7f11537fe640 1 -- 172.21.15.3:0/157391552 learned_addr learned my addr 172.21.15.3:0/157391552 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:14:59.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:59.559+0000 7f1153fff640 1 --2- 172.21.15.3:0/157391552 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f11540ffc40 0x7f11541025b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:14:59.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:59.559+0000 7f11537fe640 1 -- 172.21.15.3:0/157391552 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f11540ffc40 msgr2=0x7f11541025b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:14:59.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:59.559+0000 7f11537fe640 1 --2- 172.21.15.3:0/157391552 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f11540ffc40 0x7f11541025b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:14:59.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:59.559+0000 7f11537fe640 1 -- 172.21.15.3:0/157391552 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11541011b0 con 0x7f1154102cc0 2024-09-21T12:14:59.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:59.560+0000 7f11537fe640 1 --2- 172.21.15.3:0/157391552 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1154102cc0 0x7f1154100c70 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f114800d6f0 tx=0x7f114800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:14:59.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:59.560+0000 7f11517fa640 1 -- 172.21.15.3:0/157391552 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1148017070 con 0x7f1154102cc0 2024-09-21T12:14:59.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:59.560+0000 7f11517fa640 1 -- 172.21.15.3:0/157391552 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f114800de00 con 0x7f1154102cc0 2024-09-21T12:14:59.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:59.560+0000 7f115a353640 1 -- 172.21.15.3:0/157391552 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11541014a0 con 0x7f1154102cc0 2024-09-21T12:14:59.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:59.560+0000 7f11517fa640 1 -- 172.21.15.3:0/157391552 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1148004bb0 con 0x7f1154102cc0 2024-09-21T12:14:59.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:59.560+0000 7f115a353640 1 -- 172.21.15.3:0/157391552 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1154101a30 con 0x7f1154102cc0 2024-09-21T12:14:59.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:59.561+0000 7f115a353640 1 -- 172.21.15.3:0/157391552 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1154100040 con 0x7f1154102cc0 2024-09-21T12:14:59.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:59.562+0000 7f11517fa640 1 -- 172.21.15.3:0/157391552 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 18) ==== 92493+0+0 (secure 0 0 0) 0x7f1148009a30 con 0x7f1154102cc0 2024-09-21T12:14:59.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:59.562+0000 7f11517fa640 1 --2- 172.21.15.3:0/157391552 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f113c06e280 0x7f113c070740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:14:59.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:59.562+0000 7f11517fa640 1 -- 172.21.15.3:0/157391552 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 2414+0+0 (secure 0 0 0) 0x7f114808cfb0 con 0x7f1154102cc0 2024-09-21T12:14:59.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:59.562+0000 7f1153fff640 1 --2- 172.21.15.3:0/157391552 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f113c06e280 0x7f113c070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:14:59.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:59.563+0000 7f1153fff640 1 --2- 172.21.15.3:0/157391552 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f113c06e280 0x7f113c070740 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1144000c00 tx=0x7f1144005a20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:14:59.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:59.567+0000 7f11517fa640 1 -- 172.21.15.3:0/157391552 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f114805b660 con 0x7f1154102cc0 2024-09-21T12:14:59.760 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:14:59.758+0000 7f115a353640 1 -- 172.21.15.3:0/157391552 --> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi003:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f1154062630 con 0x7f113c06e280 2024-09-21T12:14:59.760 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:14:59 smithi003 ceph-mon[28057]: osdmap e15: 2 total, 2 up, 2 in 2024-09-21T12:15:00.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:14:59 smithi192 ceph-mon[35641]: osdmap e15: 2 total, 2 up, 2 in 2024-09-21T12:15:00.727 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:00 smithi003 ceph-mon[28057]: from='client.14364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi003:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:15:00.727 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:00 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T12:15:00.727 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:00 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T12:15:00.728 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:00 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:15:00.728 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:00 smithi003 ceph-mon[28057]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T12:15:00.909 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:00 smithi192 ceph-mon[35641]: from='client.14364 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi003:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:15:00.909 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:00 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T12:15:00.909 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:00 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T12:15:00.909 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:00 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:15:00.909 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:00 smithi192 ceph-mon[35641]: pgmap v70: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T12:15:02.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:01 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:15:02.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:01 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:15:03.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:03 smithi192 ceph-mon[35641]: Detected new or changed devices on smithi003 2024-09-21T12:15:03.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:03 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:15:03.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:03 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:15:03.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:03 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:15:03.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:03 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:15:03.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:03 smithi192 ceph-mon[35641]: Adjusting osd_memory_target on smithi003 to 5922M 2024-09-21T12:15:03.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:03 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:15:03.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:03 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:15:03.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:03 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:15:03.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:03 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:15:03.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:03 smithi192 ceph-mon[35641]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T12:15:03.759 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:03 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:15:03.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:03 smithi003 ceph-mon[28057]: Detected new or changed devices on smithi003 2024-09-21T12:15:03.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:03 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:15:03.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:03 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:15:03.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:03 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:15:03.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:03 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:15:03.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:03 smithi003 ceph-mon[28057]: Adjusting osd_memory_target on smithi003 to 5922M 2024-09-21T12:15:03.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:03 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:15:03.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:03 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:15:03.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:03 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:15:03.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:03 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:15:03.831 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:03 smithi003 ceph-mon[28057]: pgmap v71: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T12:15:03.831 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:03 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:15:04.555 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:04 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/3072375456' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1ba0899a-76f5-415f-b0d6-09df23128032"}]: dispatch 2024-09-21T12:15:04.555 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:04 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/3072375456' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1ba0899a-76f5-415f-b0d6-09df23128032"}]': finished 2024-09-21T12:15:04.555 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:04 smithi003 ceph-mon[28057]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T12:15:04.555 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:04 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T12:15:04.556 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:04 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/3787165080' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T12:15:04.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:04 smithi192 ceph-mon[35641]: from='client.? 172.21.15.3:0/3072375456' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "1ba0899a-76f5-415f-b0d6-09df23128032"}]: dispatch 2024-09-21T12:15:04.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:04 smithi192 ceph-mon[35641]: from='client.? 172.21.15.3:0/3072375456' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "1ba0899a-76f5-415f-b0d6-09df23128032"}]': finished 2024-09-21T12:15:04.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:04 smithi192 ceph-mon[35641]: osdmap e16: 3 total, 2 up, 3 in 2024-09-21T12:15:04.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:04 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T12:15:04.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:04 smithi192 ceph-mon[35641]: from='client.? 172.21.15.3:0/3787165080' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T12:15:05.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:05 smithi192 ceph-mon[35641]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T12:15:05.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:05 smithi003 ceph-mon[28057]: pgmap v73: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T12:15:06.683 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:06 smithi003 ceph-mon[28057]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T12:15:07.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:06 smithi192 ceph-mon[35641]: pgmap v74: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T12:15:08.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:07 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:15:08.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:07 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:15:08.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:07 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:15:08.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:07 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:15:08.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:07 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:15:08.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:07 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:15:08.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:07 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:15:08.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:07 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:15:08.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:07 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:15:08.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:07 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:15:09.175 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:08 smithi003 ceph-mon[28057]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T12:15:09.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:08 smithi192 ceph-mon[35641]: pgmap v75: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T12:15:10.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:10 smithi003 ceph-mon[28057]: pgmap v76: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T12:15:11.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:10 smithi192 ceph-mon[35641]: pgmap v76: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T12:15:12.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:12 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-21T12:15:12.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:12 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:15:13.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:12 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-21T12:15:13.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:12 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:15:13.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:13 smithi003 ceph-mon[28057]: Deploying daemon osd.2 on smithi003 2024-09-21T12:15:13.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:13 smithi003 ceph-mon[28057]: pgmap v77: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T12:15:14.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:13 smithi192 ceph-mon[35641]: Deploying daemon osd.2 on smithi003 2024-09-21T12:15:14.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:13 smithi192 ceph-mon[35641]: pgmap v77: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T12:15:14.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:14 smithi003 ceph-mon[28057]: pgmap v78: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T12:15:15.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:14 smithi192 ceph-mon[35641]: pgmap v78: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T12:15:16.970 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:16 smithi003 ceph-mon[28057]: pgmap v79: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T12:15:16.970 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:16 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:15:17.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:16 smithi192 ceph-mon[35641]: pgmap v79: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T12:15:17.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:16 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:15:18.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:18 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:15:18.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:18 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:15:18.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:18 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:15:18.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:18 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:15:18.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:18 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:15:18.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:18 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:15:19.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:19 smithi192 ceph-mon[35641]: pgmap v80: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T12:15:19.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:19 smithi003 ceph-mon[28057]: pgmap v80: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T12:15:20.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:20 smithi003 ceph-mon[28057]: pgmap v81: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T12:15:21.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:20 smithi192 ceph-mon[35641]: pgmap v81: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T12:15:22.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:15:22.524+0000 7f11517fa640 1 -- 172.21.15.3:0/157391552 <== mgr.14217 v2:172.21.15.3:6800/2480880781 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f1154062630 con 0x7f113c06e280 2024-09-21T12:15:22.526 INFO:teuthology.orchestra.run.smithi003.stdout:Created osd(s) 2 on host 'smithi003' 2024-09-21T12:15:22.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:15:22.526+0000 7f115a353640 1 -- 172.21.15.3:0/157391552 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f113c06e280 msgr2=0x7f113c070740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:15:22.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:15:22.526+0000 7f115a353640 1 --2- 172.21.15.3:0/157391552 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f113c06e280 0x7f113c070740 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f1144000c00 tx=0x7f1144005a20 comp rx=0 tx=0).stop 2024-09-21T12:15:22.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:15:22.526+0000 7f115a353640 1 -- 172.21.15.3:0/157391552 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1154102cc0 msgr2=0x7f1154100c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:15:22.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:15:22.526+0000 7f115a353640 1 --2- 172.21.15.3:0/157391552 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1154102cc0 0x7f1154100c70 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f114800d6f0 tx=0x7f114800dbb0 comp rx=0 tx=0).stop 2024-09-21T12:15:22.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:15:22.526+0000 7f115a353640 1 -- 172.21.15.3:0/157391552 shutdown_connections 2024-09-21T12:15:22.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:15:22.526+0000 7f115a353640 1 --2- 172.21.15.3:0/157391552 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f113c06e280 0x7f113c070740 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:15:22.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:15:22.526+0000 7f115a353640 1 --2- 172.21.15.3:0/157391552 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1154102cc0 0x7f1154100c70 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:15:22.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:15:22.526+0000 7f115a353640 1 --2- 172.21.15.3:0/157391552 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f11540ffc40 0x7f11541025b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:15:22.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:15:22.526+0000 7f115a353640 1 -- 172.21.15.3:0/157391552 >> 172.21.15.3:0/157391552 conn(0x7f11540fb770 msgr2=0x7f11541061d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:15:22.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:15:22.526+0000 7f115a353640 1 -- 172.21.15.3:0/157391552 shutdown_connections 2024-09-21T12:15:22.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:15:22.526+0000 7f115a353640 1 -- 172.21.15.3:0/157391552 wait complete. 2024-09-21T12:15:23.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:23 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:15:23.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:23 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:15:24.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:23 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:15:24.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:23 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:15:24.201 DEBUG:teuthology.orchestra.run.smithi003:osd.2> sudo journalctl -f -n 0 -u ceph-641beec0-7812-11ef-baf6-efdc52797490@osd.2.service 2024-09-21T12:15:24.203 INFO:tasks.cephadm:Deploying osd.3 on smithi192 with /dev/vg_nvme/lv_4... 2024-09-21T12:15:24.204 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- lvm zap /dev/vg_nvme/lv_4 2024-09-21T12:15:24.459 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi192/config 2024-09-21T12:15:24.790 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:24 smithi003 ceph-mon[28057]: pgmap v82: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T12:15:24.791 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:15:24 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-2[64593]: 2024-09-21T12:15:24.737+0000 7f58968e7640 -1 osd.2 0 log_to_monitors true 2024-09-21T12:15:24.791 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:24 smithi192 ceph-mon[35641]: pgmap v82: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T12:15:25.822 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:25 smithi192 ceph-mon[35641]: from='osd.2 [v2:172.21.15.3:6818/1433580301,v1:172.21.15.3:6819/1433580301]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-21T12:15:25.823 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:25 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:15:25.823 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:25 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:15:25.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:25 smithi003 ceph-mon[28057]: from='osd.2 [v2:172.21.15.3:6818/1433580301,v1:172.21.15.3:6819/1433580301]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-21T12:15:25.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:25 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:15:25.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:25 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:15:26.787 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:26 smithi192 ceph-mon[35641]: pgmap v83: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T12:15:26.787 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:26 smithi192 ceph-mon[35641]: from='osd.2 [v2:172.21.15.3:6818/1433580301,v1:172.21.15.3:6819/1433580301]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T12:15:26.787 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:26 smithi192 ceph-mon[35641]: osdmap e17: 3 total, 2 up, 3 in 2024-09-21T12:15:26.787 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:26 smithi192 ceph-mon[35641]: from='osd.2 [v2:172.21.15.3:6818/1433580301,v1:172.21.15.3:6819/1433580301]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi003", "root=default"]}]: dispatch 2024-09-21T12:15:26.787 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:26 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T12:15:26.829 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:15:26 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-2[64593]: 2024-09-21T12:15:26.541+0000 7f5892047640 -1 osd.2 0 waiting for initial osdmap 2024-09-21T12:15:26.829 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:15:26 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-2[64593]: 2024-09-21T12:15:26.546+0000 7f588e681640 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T12:15:26.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:26 smithi003 ceph-mon[28057]: pgmap v83: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T12:15:26.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:26 smithi003 ceph-mon[28057]: from='osd.2 [v2:172.21.15.3:6818/1433580301,v1:172.21.15.3:6819/1433580301]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T12:15:26.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:26 smithi003 ceph-mon[28057]: osdmap e17: 3 total, 2 up, 3 in 2024-09-21T12:15:26.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:26 smithi003 ceph-mon[28057]: from='osd.2 [v2:172.21.15.3:6818/1433580301,v1:172.21.15.3:6819/1433580301]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi003", "root=default"]}]: dispatch 2024-09-21T12:15:26.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:26 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T12:15:26.906 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:15:26.931 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph orch daemon add osd smithi192:vg_nvme/lv_4 2024-09-21T12:15:27.185 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi192/config 2024-09-21T12:15:27.562 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:27 smithi192 ceph-mon[35641]: pgmap v85: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T12:15:27.562 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:27 smithi192 ceph-mon[35641]: from='osd.2 [v2:172.21.15.3:6818/1433580301,v1:172.21.15.3:6819/1433580301]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi003", "root=default"]}]': finished 2024-09-21T12:15:27.562 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:27 smithi192 ceph-mon[35641]: osdmap e18: 3 total, 2 up, 3 in 2024-09-21T12:15:27.562 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:27 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T12:15:27.563 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:27 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T12:15:27.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:27.645+0000 7f824ec8d640 1 -- 172.21.15.192:0/3321816504 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8248104d80 msgr2=0x7f8248107170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:15:27.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:27.645+0000 7f824ec8d640 1 --2- 172.21.15.192:0/3321816504 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8248104d80 0x7f8248107170 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f8234009880 tx=0x7f823402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:15:27.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:27.645+0000 7f824ec8d640 1 -- 172.21.15.192:0/3321816504 shutdown_connections 2024-09-21T12:15:27.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:27.645+0000 7f824ec8d640 1 --2- 172.21.15.192:0/3321816504 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8248104d80 0x7f8248107170 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:15:27.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:27.645+0000 7f824ec8d640 1 --2- 172.21.15.192:0/3321816504 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8248102450 0x7f8248104840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:15:27.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:27.645+0000 7f824ec8d640 1 -- 172.21.15.192:0/3321816504 >> 172.21.15.192:0/3321816504 conn(0x7f82480fc010 msgr2=0x7f82480fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:15:27.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:27.645+0000 7f824ec8d640 1 -- 172.21.15.192:0/3321816504 shutdown_connections 2024-09-21T12:15:27.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:27.645+0000 7f824ec8d640 1 -- 172.21.15.192:0/3321816504 wait complete. 2024-09-21T12:15:27.664 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:27.645+0000 7f824ec8d640 1 Processor -- start 2024-09-21T12:15:27.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:27.645+0000 7f824ec8d640 1 -- start start 2024-09-21T12:15:27.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:27.646+0000 7f824ec8d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8248102450 0x7f82481974e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:15:27.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:27.646+0000 7f824ec8d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8248104d80 0x7f8248197a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:15:27.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:27.646+0000 7f824ec8d640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f824810a720 con 0x7f8248102450 2024-09-21T12:15:27.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:27.646+0000 7f824ec8d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f824810a5a0 con 0x7f8248104d80 2024-09-21T12:15:27.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:27.646+0000 7f8247fff640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8248104d80 0x7f8248197a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:15:27.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:27.646+0000 7f824ca29640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8248102450 0x7f82481974e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:15:27.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:27.646+0000 7f8247fff640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8248104d80 0x7f8248197a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:46496/0 (socket says 172.21.15.192:46496) 2024-09-21T12:15:27.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:27.646+0000 7f8247fff640 1 -- 172.21.15.192:0/3244596366 learned_addr learned my addr 172.21.15.192:0/3244596366 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-21T12:15:27.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:27.646+0000 7f8247fff640 1 -- 172.21.15.192:0/3244596366 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8248102450 msgr2=0x7f82481974e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:15:27.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:27.646+0000 7f8247fff640 1 --2- 172.21.15.192:0/3244596366 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8248102450 0x7f82481974e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:15:27.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:27.646+0000 7f8247fff640 1 -- 172.21.15.192:0/3244596366 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82481980a0 con 0x7f8248104d80 2024-09-21T12:15:27.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:27.646+0000 7f8247fff640 1 --2- 172.21.15.192:0/3244596366 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8248104d80 0x7f8248197a20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f8234009230 tx=0x7f82340045c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:15:27.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:27.646+0000 7f8245ffb640 1 -- 172.21.15.192:0/3244596366 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f823403f070 con 0x7f8248104d80 2024-09-21T12:15:27.665 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:27.646+0000 7f8245ffb640 1 -- 172.21.15.192:0/3244596366 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8234004a50 con 0x7f8248104d80 2024-09-21T12:15:27.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:27.646+0000 7f824ec8d640 1 -- 172.21.15.192:0/3244596366 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f824819cae0 con 0x7f8248104d80 2024-09-21T12:15:27.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:27.646+0000 7f8245ffb640 1 -- 172.21.15.192:0/3244596366 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8234035030 con 0x7f8248104d80 2024-09-21T12:15:27.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:27.647+0000 7f824ec8d640 1 -- 172.21.15.192:0/3244596366 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f824819d070 con 0x7f8248104d80 2024-09-21T12:15:27.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:27.648+0000 7f824ec8d640 1 -- 172.21.15.192:0/3244596366 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8248102830 con 0x7f8248104d80 2024-09-21T12:15:27.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:27.648+0000 7f8245ffb640 1 -- 172.21.15.192:0/3244596366 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 18) ==== 92493+0+0 (secure 0 0 0) 0x7f8234042070 con 0x7f8248104d80 2024-09-21T12:15:27.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:27.649+0000 7f8245ffb640 1 --2- 172.21.15.192:0/3244596366 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f823806e280 0x7f8238070740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:15:27.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:27.649+0000 7f8245ffb640 1 -- 172.21.15.192:0/3244596366 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 2846+0+0 (secure 0 0 0) 0x7f82340ae080 con 0x7f8248104d80 2024-09-21T12:15:27.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:27.649+0000 7f824ca29640 1 --2- 172.21.15.192:0/3244596366 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f823806e280 0x7f8238070740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:15:27.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:27.649+0000 7f824ca29640 1 --2- 172.21.15.192:0/3244596366 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f823806e280 0x7f8238070740 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f823c00bbe0 tx=0x7f823c00b390 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:15:27.666 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:27.653+0000 7f8245ffb640 1 -- 172.21.15.192:0/3244596366 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8234080230 con 0x7f8248104d80 2024-09-21T12:15:27.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:27 smithi003 ceph-mon[28057]: pgmap v85: 0 pgs: ; 0 B data, 57 MiB used, 179 GiB / 179 GiB avail 2024-09-21T12:15:27.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:27 smithi003 ceph-mon[28057]: from='osd.2 [v2:172.21.15.3:6818/1433580301,v1:172.21.15.3:6819/1433580301]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi003", "root=default"]}]': finished 2024-09-21T12:15:27.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:27 smithi003 ceph-mon[28057]: osdmap e18: 3 total, 2 up, 3 in 2024-09-21T12:15:27.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:27 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T12:15:27.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:27 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T12:15:27.834 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:27.832+0000 7f824ec8d640 1 -- 172.21.15.192:0/3244596366 --> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f82481057c0 con 0x7f823806e280 2024-09-21T12:15:28.817 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:28 smithi003 ceph-mon[28057]: purged_snaps scrub starts 2024-09-21T12:15:28.817 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:28 smithi003 ceph-mon[28057]: purged_snaps scrub ok 2024-09-21T12:15:28.818 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:28 smithi003 ceph-mon[28057]: osd.2 [v2:172.21.15.3:6818/1433580301,v1:172.21.15.3:6819/1433580301] boot 2024-09-21T12:15:28.818 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:28 smithi003 ceph-mon[28057]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T12:15:28.818 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:28 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T12:15:28.818 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:28 smithi003 ceph-mon[28057]: from='client.24181 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:15:28.818 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:28 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T12:15:28.818 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:28 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T12:15:28.818 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:28 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:15:28.886 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:28 smithi192 ceph-mon[35641]: purged_snaps scrub starts 2024-09-21T12:15:28.886 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:28 smithi192 ceph-mon[35641]: purged_snaps scrub ok 2024-09-21T12:15:28.886 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:28 smithi192 ceph-mon[35641]: osd.2 [v2:172.21.15.3:6818/1433580301,v1:172.21.15.3:6819/1433580301] boot 2024-09-21T12:15:28.886 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:28 smithi192 ceph-mon[35641]: osdmap e19: 3 total, 3 up, 3 in 2024-09-21T12:15:28.886 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:28 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T12:15:28.886 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:28 smithi192 ceph-mon[35641]: from='client.24181 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:15:28.887 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:28 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T12:15:28.887 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:28 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T12:15:28.887 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:28 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:15:29.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:29 smithi192 ceph-mon[35641]: pgmap v88: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T12:15:29.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:29 smithi192 ceph-mon[35641]: osdmap e20: 3 total, 3 up, 3 in 2024-09-21T12:15:29.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:29 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-21T12:15:29.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:29 smithi192 ceph-mon[35641]: Detected new or changed devices on smithi003 2024-09-21T12:15:29.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:29 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:15:29.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:29 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:15:29.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:29 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:15:29.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:29 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:15:29.759 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:29 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:15:29.759 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:29 smithi192 ceph-mon[35641]: Adjusting osd_memory_target on smithi003 to 3948M 2024-09-21T12:15:29.759 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:29 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:15:29.759 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:29 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:15:29.759 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:29 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:15:29.759 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:29 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:15:29.759 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:29 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:15:29.759 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:29 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:15:29.759 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:29 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:15:29.759 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:29 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:15:29.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:29 smithi003 ceph-mon[28057]: pgmap v88: 0 pgs: ; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T12:15:29.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:29 smithi003 ceph-mon[28057]: osdmap e20: 3 total, 3 up, 3 in 2024-09-21T12:15:29.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:29 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-21T12:15:29.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:29 smithi003 ceph-mon[28057]: Detected new or changed devices on smithi003 2024-09-21T12:15:29.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:29 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:15:29.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:29 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:15:29.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:29 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:15:29.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:29 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:15:29.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:29 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:15:29.831 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:29 smithi003 ceph-mon[28057]: Adjusting osd_memory_target on smithi003 to 3948M 2024-09-21T12:15:29.831 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:29 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:15:29.831 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:29 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:15:29.831 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:29 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:15:29.831 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:29 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:15:29.831 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:29 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:15:29.831 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:29 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:15:29.831 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:29 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:15:29.831 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:29 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:15:30.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:30 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T12:15:30.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:30 smithi003 ceph-mon[28057]: osdmap e21: 3 total, 3 up, 3 in 2024-09-21T12:15:30.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:30 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-21T12:15:30.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:30 smithi003 ceph-mon[28057]: from='client.? 172.21.15.192:0/1102670879' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dfb038d6-4ca3-4f2b-b8ab-c0f0a1ca353f"}]: dispatch 2024-09-21T12:15:30.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:30 smithi003 ceph-mon[28057]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dfb038d6-4ca3-4f2b-b8ab-c0f0a1ca353f"}]: dispatch 2024-09-21T12:15:30.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:30 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T12:15:30.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:30 smithi003 ceph-mon[28057]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dfb038d6-4ca3-4f2b-b8ab-c0f0a1ca353f"}]': finished 2024-09-21T12:15:30.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:30 smithi003 ceph-mon[28057]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T12:15:30.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:30 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T12:15:31.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:30 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-21T12:15:31.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:30 smithi192 ceph-mon[35641]: osdmap e21: 3 total, 3 up, 3 in 2024-09-21T12:15:31.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:30 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-21T12:15:31.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:30 smithi192 ceph-mon[35641]: from='client.? 172.21.15.192:0/1102670879' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dfb038d6-4ca3-4f2b-b8ab-c0f0a1ca353f"}]: dispatch 2024-09-21T12:15:31.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:30 smithi192 ceph-mon[35641]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dfb038d6-4ca3-4f2b-b8ab-c0f0a1ca353f"}]: dispatch 2024-09-21T12:15:31.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:30 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-21T12:15:31.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:30 smithi192 ceph-mon[35641]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dfb038d6-4ca3-4f2b-b8ab-c0f0a1ca353f"}]': finished 2024-09-21T12:15:31.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:30 smithi192 ceph-mon[35641]: osdmap e22: 4 total, 3 up, 4 in 2024-09-21T12:15:31.009 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:30 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T12:15:31.813 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:15:31 smithi003 sudo[68924]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T12:15:31.813 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:15:31 smithi003 sudo[68924]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T12:15:31.813 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:15:31 smithi003 sudo[68924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T12:15:31.813 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:15:31 smithi003 sudo[68924]: pam_unix(sudo:session): session closed for user root 2024-09-21T12:15:31.814 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:31 smithi003 ceph-mon[28057]: pgmap v92: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T12:15:31.814 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:31 smithi003 ceph-mon[28057]: from='client.? 172.21.15.192:0/1310701905' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T12:15:31.814 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:31 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:15:32.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:31 smithi192 ceph-mon[35641]: pgmap v92: 1 pgs: 1 unknown; 0 B data, 84 MiB used, 268 GiB / 268 GiB avail 2024-09-21T12:15:32.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:31 smithi192 ceph-mon[35641]: from='client.? 172.21.15.192:0/1310701905' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T12:15:32.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:31 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:15:32.079 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:15:31 smithi003 sudo[68927]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T12:15:32.080 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:15:31 smithi003 sudo[68927]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T12:15:32.080 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:15:31 smithi003 sudo[68927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T12:15:32.080 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:15:31 smithi003 sudo[68927]: pam_unix(sudo:session): session closed for user root 2024-09-21T12:15:32.573 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:15:32 smithi003 sudo[68930]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T12:15:32.573 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:15:32 smithi003 sudo[68930]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T12:15:32.573 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:15:32 smithi003 sudo[68930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T12:15:32.573 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:15:32 smithi003 sudo[68930]: pam_unix(sudo:session): session closed for user root 2024-09-21T12:15:32.829 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:15:32 smithi003 sudo[68933]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T12:15:32.829 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:15:32 smithi003 sudo[68933]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T12:15:32.830 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:15:32 smithi003 sudo[68933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T12:15:32.830 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:15:32 smithi003 sudo[68933]: pam_unix(sudo:session): session closed for user root 2024-09-21T12:15:32.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:32 smithi003 ceph-mon[28057]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T12:15:32.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:32 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T12:15:32.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:32 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:15:32.857 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:32 smithi192 ceph-mon[35641]: osdmap e23: 4 total, 3 up, 4 in 2024-09-21T12:15:32.857 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:32 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T12:15:32.857 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:32 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:15:32.857 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:32.854+0000 7f8245ffb640 1 -- 172.21.15.192:0/3244596366 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mgrmap(e 19) ==== 92549+0+0 (secure 0 0 0) 0x7f82340785a0 con 0x7f8248104d80 2024-09-21T12:15:33.579 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:15:33 smithi003 sudo[68936]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T12:15:33.579 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:15:33 smithi003 sudo[68936]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T12:15:33.580 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:15:33 smithi003 sudo[68936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T12:15:33.580 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:15:33 smithi003 sudo[68936]: pam_unix(sudo:session): session closed for user root 2024-09-21T12:15:34.079 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:15:33 smithi003 sudo[68939]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T12:15:34.079 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:15:33 smithi003 sudo[68939]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T12:15:34.079 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:15:33 smithi003 sudo[68939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T12:15:34.080 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:15:33 smithi003 sudo[68939]: pam_unix(sudo:session): session closed for user root 2024-09-21T12:15:34.551 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:34 smithi003 sudo[68942]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T12:15:34.551 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:34 smithi003 sudo[68942]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T12:15:34.551 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:34 smithi003 sudo[68942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T12:15:34.552 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:34 smithi003 sudo[68942]: pam_unix(sudo:session): session closed for user root 2024-09-21T12:15:34.817 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:34 smithi192 ceph-mon[35641]: pgmap v94: 1 pgs: 1 unknown; 0 B data, 85 MiB used, 268 GiB / 268 GiB avail 2024-09-21T12:15:34.817 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:34 smithi192 ceph-mon[35641]: mgrmap e19: smithi003.wztftl(active, since 2m), standbys: smithi192.qsaprd 2024-09-21T12:15:34.818 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:34 smithi192 ceph-mon[35641]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T12:15:34.818 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:34 smithi192 sudo[40747]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-21T12:15:34.818 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:34 smithi192 sudo[40747]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T12:15:34.818 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:34 smithi192 sudo[40747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T12:15:34.818 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:34 smithi192 sudo[40747]: pam_unix(sudo:session): session closed for user root 2024-09-21T12:15:34.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:34 smithi003 sudo[68945]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T12:15:34.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:34 smithi003 sudo[68945]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T12:15:34.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:34 smithi003 sudo[68945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T12:15:34.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:34 smithi003 sudo[68945]: pam_unix(sudo:session): session closed for user root 2024-09-21T12:15:34.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:34 smithi003 ceph-mon[28057]: pgmap v94: 1 pgs: 1 unknown; 0 B data, 85 MiB used, 268 GiB / 268 GiB avail 2024-09-21T12:15:34.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:34 smithi003 ceph-mon[28057]: mgrmap e19: smithi003.wztftl(active, since 2m), standbys: smithi192.qsaprd 2024-09-21T12:15:34.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:34 smithi003 ceph-mon[28057]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T12:15:35.207 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:35 smithi192 sudo[40752]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-21T12:15:35.207 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:35 smithi192 sudo[40752]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-21T12:15:35.207 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:35 smithi192 sudo[40752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-21T12:15:35.207 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:35 smithi192 sudo[40752]: pam_unix(sudo:session): session closed for user root 2024-09-21T12:15:35.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:35 smithi003 ceph-mon[28057]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T12:15:35.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:35 smithi003 ceph-mon[28057]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T12:15:35.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:35 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mon metadata", "id": "smithi003"}]: dispatch 2024-09-21T12:15:35.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:35 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mon metadata", "id": "smithi192"}]: dispatch 2024-09-21T12:15:35.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:35 smithi003 ceph-mon[28057]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T12:15:35.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:35 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mon metadata", "id": "smithi003"}]: dispatch 2024-09-21T12:15:35.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:35 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mon metadata", "id": "smithi192"}]: dispatch 2024-09-21T12:15:35.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:35 smithi003 ceph-mon[28057]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T12:15:35.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:35 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:15:35.897 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:35 smithi192 ceph-mon[35641]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T12:15:35.897 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:35 smithi192 ceph-mon[35641]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T12:15:35.897 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:35 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mon metadata", "id": "smithi003"}]: dispatch 2024-09-21T12:15:35.897 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:35 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mon metadata", "id": "smithi192"}]: dispatch 2024-09-21T12:15:35.897 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:35 smithi192 ceph-mon[35641]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-21T12:15:35.897 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:35 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mon metadata", "id": "smithi003"}]: dispatch 2024-09-21T12:15:35.897 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:35 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mon metadata", "id": "smithi192"}]: dispatch 2024-09-21T12:15:35.897 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:35 smithi192 ceph-mon[35641]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-21T12:15:35.898 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:35 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:15:37.687 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:37 smithi192 ceph-mon[35641]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T12:15:37.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:37 smithi003 ceph-mon[28057]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T12:15:39.672 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:39 smithi192 ceph-mon[35641]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T12:15:39.672 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:39 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-21T12:15:39.672 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:39 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:15:39.672 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:39 smithi192 ceph-mon[35641]: Deploying daemon osd.3 on smithi192 2024-09-21T12:15:39.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:39 smithi003 ceph-mon[28057]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T12:15:39.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:39 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-21T12:15:39.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:39 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:15:39.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:39 smithi003 ceph-mon[28057]: Deploying daemon osd.3 on smithi192 2024-09-21T12:15:41.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:41 smithi003 ceph-mon[28057]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-09-21T12:15:41.870 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:41 smithi192 ceph-mon[35641]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 3.0 KiB/s rd, 131 KiB/s wr, 9 op/s 2024-09-21T12:15:43.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:43 smithi003 ceph-mon[28057]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-09-21T12:15:43.875 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:43 smithi192 ceph-mon[35641]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 2.2 KiB/s rd, 98 KiB/s wr, 6 op/s 2024-09-21T12:15:45.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:45 smithi003 ceph-mon[28057]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-09-21T12:15:45.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:45 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:15:45.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:45 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:15:45.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:45 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:15:45.887 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:45 smithi192 ceph-mon[35641]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 1.8 KiB/s rd, 78 KiB/s wr, 5 op/s 2024-09-21T12:15:45.887 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:45 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:15:45.888 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:45 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:15:45.888 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:45 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:15:46.892 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:46 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:15:47.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:46 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:15:47.735 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:47 smithi192 ceph-mon[35641]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-21T12:15:48.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:47 smithi003 ceph-mon[28057]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-21T12:15:49.564 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:49.562+0000 7f8245ffb640 1 -- 172.21.15.192:0/3244596366 <== mgr.14217 v2:172.21.15.3:6800/2480880781 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f82481057c0 con 0x7f823806e280 2024-09-21T12:15:49.564 INFO:teuthology.orchestra.run.smithi192.stdout:Created osd(s) 3 on host 'smithi192' 2024-09-21T12:15:49.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:49.565+0000 7f824ec8d640 1 -- 172.21.15.192:0/3244596366 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f823806e280 msgr2=0x7f8238070740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:15:49.566 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:49.565+0000 7f824ec8d640 1 --2- 172.21.15.192:0/3244596366 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f823806e280 0x7f8238070740 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f823c00bbe0 tx=0x7f823c00b390 comp rx=0 tx=0).stop 2024-09-21T12:15:49.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:49.565+0000 7f824ec8d640 1 -- 172.21.15.192:0/3244596366 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8248104d80 msgr2=0x7f8248197a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:15:49.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:49.565+0000 7f824ec8d640 1 --2- 172.21.15.192:0/3244596366 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8248104d80 0x7f8248197a20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f8234009230 tx=0x7f82340045c0 comp rx=0 tx=0).stop 2024-09-21T12:15:49.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:49.565+0000 7f824ec8d640 1 -- 172.21.15.192:0/3244596366 shutdown_connections 2024-09-21T12:15:49.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:49.565+0000 7f824ec8d640 1 --2- 172.21.15.192:0/3244596366 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f823806e280 0x7f8238070740 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:15:49.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:49.565+0000 7f824ec8d640 1 --2- 172.21.15.192:0/3244596366 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8248104d80 0x7f8248197a20 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:15:49.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:49.565+0000 7f824ec8d640 1 --2- 172.21.15.192:0/3244596366 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8248102450 0x7f82481974e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:15:49.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:49.565+0000 7f824ec8d640 1 -- 172.21.15.192:0/3244596366 >> 172.21.15.192:0/3244596366 conn(0x7f82480fc010 msgr2=0x7f82480fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:15:49.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:49.565+0000 7f824ec8d640 1 -- 172.21.15.192:0/3244596366 shutdown_connections 2024-09-21T12:15:49.567 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:49.565+0000 7f824ec8d640 1 -- 172.21.15.192:0/3244596366 wait complete. 2024-09-21T12:15:50.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:49 smithi003 ceph-mon[28057]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-21T12:15:50.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:49 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:15:50.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:49 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:15:50.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:49 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:15:50.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:49 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:15:50.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:49 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:15:50.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:49 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:15:50.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:49 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:15:50.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:49 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:15:50.151 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:49 smithi192 ceph-mon[35641]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-21T12:15:50.151 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:49 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:15:50.151 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:49 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:15:50.151 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:49 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:15:50.151 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:49 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:15:50.151 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:49 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:15:50.151 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:49 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:15:50.152 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:49 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:15:50.152 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:49 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:15:50.178 DEBUG:teuthology.orchestra.run.smithi192:osd.3> sudo journalctl -f -n 0 -u ceph-641beec0-7812-11ef-baf6-efdc52797490@osd.3.service 2024-09-21T12:15:50.180 INFO:tasks.cephadm:Deploying osd.4 on smithi192 with /dev/vg_nvme/lv_3... 2024-09-21T12:15:50.180 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- lvm zap /dev/vg_nvme/lv_3 2024-09-21T12:15:50.920 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi192/config 2024-09-21T12:15:51.712 INFO:journalctl@ceph.osd.3.smithi192.stdout:Sep 21 12:15:51 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-3[41613]: 2024-09-21T12:15:51.440+0000 7fc168836640 -1 osd.3 0 log_to_monitors true 2024-09-21T12:15:52.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:51 smithi192 ceph-mon[35641]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-21T12:15:52.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:51 smithi192 ceph-mon[35641]: from='osd.3 [v2:172.21.15.192:6800/2737855393,v1:172.21.15.192:6801/2737855393]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-21T12:15:52.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:51 smithi192 ceph-mon[35641]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-21T12:15:52.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:51 smithi003 ceph-mon[28057]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail; 1.5 KiB/s rd, 65 KiB/s wr, 4 op/s 2024-09-21T12:15:52.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:51 smithi003 ceph-mon[28057]: from='osd.3 [v2:172.21.15.192:6800/2737855393,v1:172.21.15.192:6801/2737855393]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-21T12:15:52.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:51 smithi003 ceph-mon[28057]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-21T12:15:53.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:52 smithi003 ceph-mon[28057]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T12:15:53.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:52 smithi003 ceph-mon[28057]: osdmap e24: 4 total, 3 up, 4 in 2024-09-21T12:15:53.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:52 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T12:15:53.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:52 smithi003 ceph-mon[28057]: from='osd.3 [v2:172.21.15.192:6800/2737855393,v1:172.21.15.192:6801/2737855393]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-09-21T12:15:53.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:52 smithi003 ceph-mon[28057]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-09-21T12:15:53.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:52 smithi192 ceph-mon[35641]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T12:15:53.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:52 smithi192 ceph-mon[35641]: osdmap e24: 4 total, 3 up, 4 in 2024-09-21T12:15:53.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:52 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T12:15:53.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:52 smithi192 ceph-mon[35641]: from='osd.3 [v2:172.21.15.192:6800/2737855393,v1:172.21.15.192:6801/2737855393]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-09-21T12:15:53.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:52 smithi192 ceph-mon[35641]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-09-21T12:15:53.258 INFO:journalctl@ceph.osd.3.smithi192.stdout:Sep 21 12:15:52 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-3[41613]: 2024-09-21T12:15:52.801+0000 7fc163f96640 -1 osd.3 0 waiting for initial osdmap 2024-09-21T12:15:53.259 INFO:journalctl@ceph.osd.3.smithi192.stdout:Sep 21 12:15:52 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-3[41613]: 2024-09-21T12:15:52.806+0000 7fc1605d0640 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T12:15:53.978 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:53 smithi192 ceph-mon[35641]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T12:15:53.978 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:53 smithi192 ceph-mon[35641]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]': finished 2024-09-21T12:15:53.978 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:53 smithi192 ceph-mon[35641]: osdmap e25: 4 total, 3 up, 4 in 2024-09-21T12:15:53.978 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:53 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T12:15:53.979 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:53 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T12:15:53.979 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:53 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:15:53.979 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:53 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:15:53.979 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:53 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:15:53.979 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:53 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:15:53.979 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:53 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:15:53.979 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:53 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:15:53.979 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:53 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:15:54.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:53 smithi003 ceph-mon[28057]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T12:15:54.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:53 smithi003 ceph-mon[28057]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]': finished 2024-09-21T12:15:54.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:53 smithi003 ceph-mon[28057]: osdmap e25: 4 total, 3 up, 4 in 2024-09-21T12:15:54.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:53 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T12:15:54.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:53 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T12:15:54.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:53 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:15:54.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:53 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:15:54.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:53 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:15:54.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:53 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:15:54.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:53 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:15:54.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:53 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:15:54.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:53 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:15:54.948 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:15:54.973 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph orch daemon add osd smithi192:vg_nvme/lv_3 2024-09-21T12:15:55.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:54 smithi192 ceph-mon[35641]: purged_snaps scrub starts 2024-09-21T12:15:55.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:54 smithi192 ceph-mon[35641]: purged_snaps scrub ok 2024-09-21T12:15:55.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:54 smithi192 ceph-mon[35641]: Detected new or changed devices on smithi192 2024-09-21T12:15:55.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:54 smithi192 ceph-mon[35641]: Adjusting osd_memory_target on smithi192 to 14912M 2024-09-21T12:15:55.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:54 smithi192 ceph-mon[35641]: osd.3 [v2:172.21.15.192:6800/2737855393,v1:172.21.15.192:6801/2737855393] boot 2024-09-21T12:15:55.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:54 smithi192 ceph-mon[35641]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T12:15:55.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:54 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T12:15:55.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:54 smithi003 ceph-mon[28057]: purged_snaps scrub starts 2024-09-21T12:15:55.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:54 smithi003 ceph-mon[28057]: purged_snaps scrub ok 2024-09-21T12:15:55.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:54 smithi003 ceph-mon[28057]: Detected new or changed devices on smithi192 2024-09-21T12:15:55.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:54 smithi003 ceph-mon[28057]: Adjusting osd_memory_target on smithi192 to 14912M 2024-09-21T12:15:55.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:54 smithi003 ceph-mon[28057]: osd.3 [v2:172.21.15.192:6800/2737855393,v1:172.21.15.192:6801/2737855393] boot 2024-09-21T12:15:55.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:54 smithi003 ceph-mon[28057]: osdmap e26: 4 total, 4 up, 4 in 2024-09-21T12:15:55.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:54 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T12:15:55.217 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi192/config 2024-09-21T12:15:55.698 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:55.686+0000 7ff2e8de5640 1 -- 172.21.15.192:0/356937074 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2e4100860 msgr2=0x7ff2e4100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:15:55.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:55.686+0000 7ff2e8de5640 1 --2- 172.21.15.192:0/356937074 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2e4100860 0x7ff2e4100c60 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4009880 tx=0x7ff2d402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:15:55.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:55.686+0000 7ff2e8de5640 1 -- 172.21.15.192:0/356937074 shutdown_connections 2024-09-21T12:15:55.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:55.686+0000 7ff2e8de5640 1 --2- 172.21.15.192:0/356937074 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff2e4101a60 0x7ff2e4101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:15:55.731 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:55.686+0000 7ff2e8de5640 1 --2- 172.21.15.192:0/356937074 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2e4100860 0x7ff2e4100c60 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:15:55.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:55.686+0000 7ff2e8de5640 1 -- 172.21.15.192:0/356937074 >> 172.21.15.192:0/356937074 conn(0x7ff2e40fc010 msgr2=0x7ff2e40fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:15:55.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:55.686+0000 7ff2e8de5640 1 -- 172.21.15.192:0/356937074 shutdown_connections 2024-09-21T12:15:55.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:55.686+0000 7ff2e8de5640 1 -- 172.21.15.192:0/356937074 wait complete. 2024-09-21T12:15:55.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:55.687+0000 7ff2e8de5640 1 Processor -- start 2024-09-21T12:15:55.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:55.687+0000 7ff2e8de5640 1 -- start start 2024-09-21T12:15:55.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:55.687+0000 7ff2e8de5640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2e4100860 0x7ff2e406a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:15:55.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:55.687+0000 7ff2e8de5640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff2e4101a60 0x7ff2e419c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:15:55.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:55.687+0000 7ff2e8de5640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7ff2e4109700 con 0x7ff2e4101a60 2024-09-21T12:15:55.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:55.687+0000 7ff2e8de5640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff2e4109580 con 0x7ff2e4100860 2024-09-21T12:15:55.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:55.687+0000 7ff2e259c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2e4100860 0x7ff2e406a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:15:55.732 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:55.687+0000 7ff2e259c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2e4100860 0x7ff2e406a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:52380/0 (socket says 172.21.15.192:52380) 2024-09-21T12:15:55.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:55.687+0000 7ff2e259c640 1 -- 172.21.15.192:0/829404773 learned_addr learned my addr 172.21.15.192:0/829404773 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-21T12:15:55.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:55.687+0000 7ff2e259c640 1 -- 172.21.15.192:0/829404773 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff2e4101a60 msgr2=0x7ff2e419c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:15:55.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:55.687+0000 7ff2e259c640 1 --2- 172.21.15.192:0/829404773 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff2e4101a60 0x7ff2e419c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:15:55.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:55.687+0000 7ff2e259c640 1 -- 172.21.15.192:0/829404773 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2e419c840 con 0x7ff2e4100860 2024-09-21T12:15:55.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:55.688+0000 7ff2e259c640 1 --2- 172.21.15.192:0/829404773 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2e4100860 0x7ff2e406a7d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4006010 tx=0x7ff2d40048f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:15:55.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:55.688+0000 7ff2d37fe640 1 -- 172.21.15.192:0/829404773 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff2d403f070 con 0x7ff2e4100860 2024-09-21T12:15:55.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:55.688+0000 7ff2e8de5640 1 -- 172.21.15.192:0/829404773 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2e419cad0 con 0x7ff2e4100860 2024-09-21T12:15:55.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:55.688+0000 7ff2d37fe640 1 -- 172.21.15.192:0/829404773 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff2d40044d0 con 0x7ff2e4100860 2024-09-21T12:15:55.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:55.688+0000 7ff2d37fe640 1 -- 172.21.15.192:0/829404773 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff2d4035030 con 0x7ff2e4100860 2024-09-21T12:15:55.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:55.688+0000 7ff2e8de5640 1 -- 172.21.15.192:0/829404773 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2e419d080 con 0x7ff2e4100860 2024-09-21T12:15:55.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:55.689+0000 7ff2e8de5640 1 -- 172.21.15.192:0/829404773 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2e4100c60 con 0x7ff2e4100860 2024-09-21T12:15:55.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:55.689+0000 7ff2d37fe640 1 -- 172.21.15.192:0/829404773 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 19) ==== 92549+0+0 (secure 0 0 0) 0x7ff2d4042070 con 0x7ff2e4100860 2024-09-21T12:15:55.733 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:55.690+0000 7ff2d37fe640 1 --2- 172.21.15.192:0/829404773 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7ff2cc06e2b0 0x7ff2cc070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:15:55.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:55.690+0000 7ff2d37fe640 1 -- 172.21.15.192:0/829404773 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 3803+0+0 (secure 0 0 0) 0x7ff2d40ae800 con 0x7ff2e4100860 2024-09-21T12:15:55.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:55.690+0000 7ff2e1d9b640 1 --2- 172.21.15.192:0/829404773 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7ff2cc06e2b0 0x7ff2cc070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:15:55.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:55.690+0000 7ff2e1d9b640 1 --2- 172.21.15.192:0/829404773 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7ff2cc06e2b0 0x7ff2cc070770 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff2e406a550 tx=0x7ff2d8006c90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:15:55.734 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:55.694+0000 7ff2d37fe640 1 -- 172.21.15.192:0/829404773 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff2d407c750 con 0x7ff2e4100860 2024-09-21T12:15:55.874 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:15:55.872+0000 7ff2e8de5640 1 -- 172.21.15.192:0/829404773 --> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7ff2e4106030 con 0x7ff2cc06e2b0 2024-09-21T12:15:55.874 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:55 smithi192 ceph-mon[35641]: pgmap v108: 1 pgs: 1 peering; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T12:15:55.875 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:55 smithi192 ceph-mon[35641]: osdmap e27: 4 total, 4 up, 4 in 2024-09-21T12:15:55.875 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:55 smithi192 ceph-mon[35641]: osdmap e28: 4 total, 4 up, 4 in 2024-09-21T12:15:56.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:55 smithi003 ceph-mon[28057]: pgmap v108: 1 pgs: 1 peering; 577 KiB data, 86 MiB used, 268 GiB / 268 GiB avail 2024-09-21T12:15:56.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:55 smithi003 ceph-mon[28057]: osdmap e27: 4 total, 4 up, 4 in 2024-09-21T12:15:56.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:55 smithi003 ceph-mon[28057]: osdmap e28: 4 total, 4 up, 4 in 2024-09-21T12:15:57.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:56 smithi192 ceph-mon[35641]: from='client.24201 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:15:57.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:56 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T12:15:57.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:56 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T12:15:57.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:56 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:15:57.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:56 smithi003 ceph-mon[28057]: from='client.24201 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:15:57.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:56 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T12:15:57.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:56 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T12:15:57.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:56 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:15:58.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:57 smithi003 ceph-mon[28057]: pgmap v111: 1 pgs: 1 peering; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T12:15:58.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:57 smithi003 ceph-mon[28057]: osdmap e29: 4 total, 4 up, 4 in 2024-09-21T12:15:58.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:57 smithi192 ceph-mon[35641]: pgmap v111: 1 pgs: 1 peering; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T12:15:58.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:57 smithi192 ceph-mon[35641]: osdmap e29: 4 total, 4 up, 4 in 2024-09-21T12:15:59.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:58 smithi192 ceph-mon[35641]: osdmap e30: 4 total, 4 up, 4 in 2024-09-21T12:15:59.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:58 smithi192 ceph-mon[35641]: from='client.? 172.21.15.192:0/1139621212' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b612cc2a-e417-481d-93fd-f527865f19be"}]: dispatch 2024-09-21T12:15:59.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:58 smithi192 ceph-mon[35641]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b612cc2a-e417-481d-93fd-f527865f19be"}]: dispatch 2024-09-21T12:15:59.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:58 smithi192 ceph-mon[35641]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b612cc2a-e417-481d-93fd-f527865f19be"}]': finished 2024-09-21T12:15:59.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:58 smithi192 ceph-mon[35641]: osdmap e31: 5 total, 4 up, 5 in 2024-09-21T12:15:59.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:58 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T12:15:59.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:15:58 smithi192 ceph-mon[35641]: from='client.? 172.21.15.192:0/3449508966' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T12:15:59.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:58 smithi003 ceph-mon[28057]: osdmap e30: 4 total, 4 up, 4 in 2024-09-21T12:15:59.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:58 smithi003 ceph-mon[28057]: from='client.? 172.21.15.192:0/1139621212' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b612cc2a-e417-481d-93fd-f527865f19be"}]: dispatch 2024-09-21T12:15:59.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:58 smithi003 ceph-mon[28057]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b612cc2a-e417-481d-93fd-f527865f19be"}]: dispatch 2024-09-21T12:15:59.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:58 smithi003 ceph-mon[28057]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b612cc2a-e417-481d-93fd-f527865f19be"}]': finished 2024-09-21T12:15:59.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:58 smithi003 ceph-mon[28057]: osdmap e31: 5 total, 4 up, 5 in 2024-09-21T12:15:59.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:58 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T12:15:59.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:15:58 smithi003 ceph-mon[28057]: from='client.? 172.21.15.192:0/3449508966' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T12:16:00.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:00 smithi192 ceph-mon[35641]: pgmap v115: 1 pgs: 1 peering; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T12:16:00.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:00 smithi003 ceph-mon[28057]: pgmap v115: 1 pgs: 1 peering; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T12:16:02.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:02 smithi192 ceph-mon[35641]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 113 MiB used, 357 GiB / 358 GiB avail; 122 KiB/s, 0 objects/s recovering 2024-09-21T12:16:02.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:02 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:16:02.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:02 smithi003 ceph-mon[28057]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 113 MiB used, 357 GiB / 358 GiB avail; 122 KiB/s, 0 objects/s recovering 2024-09-21T12:16:02.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:02 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:16:04.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:04 smithi003 ceph-mon[28057]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 113 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T12:16:04.482 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:04 smithi192 ceph-mon[35641]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 113 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-21T12:16:06.453 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:06 smithi192 ceph-mon[35641]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-09-21T12:16:06.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:06 smithi003 ceph-mon[28057]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-09-21T12:16:07.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:07 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-21T12:16:07.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:07 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:16:07.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:07 smithi192 ceph-mon[35641]: Deploying daemon osd.4 on smithi192 2024-09-21T12:16:07.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:07 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-21T12:16:07.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:07 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:16:07.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:07 smithi003 ceph-mon[28057]: Deploying daemon osd.4 on smithi192 2024-09-21T12:16:08.343 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:08 smithi192 ceph-mon[35641]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-21T12:16:08.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:08 smithi003 ceph-mon[28057]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-21T12:16:10.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:10 smithi192 ceph-mon[35641]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-21T12:16:10.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:10 smithi003 ceph-mon[28057]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-09-21T12:16:12.445 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:12 smithi192 ceph-mon[35641]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T12:16:12.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:12 smithi003 ceph-mon[28057]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-21T12:16:13.303 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:13 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:16:13.304 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:13 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:16:13.304 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:13 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:16:13.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:13 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:16:13.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:13 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:16:13.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:13 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:16:14.326 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:14 smithi192 ceph-mon[35641]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T12:16:14.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:14 smithi003 ceph-mon[28057]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T12:16:16.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:16 smithi192 ceph-mon[35641]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T12:16:16.575 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:16.572+0000 7ff2d37fe640 1 -- 172.21.15.192:0/829404773 <== mgr.14217 v2:172.21.15.3:6800/2480880781 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7ff2e4106030 con 0x7ff2cc06e2b0 2024-09-21T12:16:16.576 INFO:teuthology.orchestra.run.smithi192.stdout:Created osd(s) 4 on host 'smithi192' 2024-09-21T12:16:16.578 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:16.575+0000 7ff2e8de5640 1 -- 172.21.15.192:0/829404773 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7ff2cc06e2b0 msgr2=0x7ff2cc070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:16.578 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:16.575+0000 7ff2e8de5640 1 --2- 172.21.15.192:0/829404773 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7ff2cc06e2b0 0x7ff2cc070770 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ff2e406a550 tx=0x7ff2d8006c90 comp rx=0 tx=0).stop 2024-09-21T12:16:16.578 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:16.575+0000 7ff2e8de5640 1 -- 172.21.15.192:0/829404773 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2e4100860 msgr2=0x7ff2e406a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:16.578 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:16.575+0000 7ff2e8de5640 1 --2- 172.21.15.192:0/829404773 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2e4100860 0x7ff2e406a7d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff2d4006010 tx=0x7ff2d40048f0 comp rx=0 tx=0).stop 2024-09-21T12:16:16.578 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:16.575+0000 7ff2e8de5640 1 -- 172.21.15.192:0/829404773 shutdown_connections 2024-09-21T12:16:16.578 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:16.575+0000 7ff2e8de5640 1 --2- 172.21.15.192:0/829404773 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7ff2cc06e2b0 0x7ff2cc070770 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:16.578 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:16.575+0000 7ff2e8de5640 1 --2- 172.21.15.192:0/829404773 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff2e4101a60 0x7ff2e419c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:16.578 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:16.575+0000 7ff2e8de5640 1 --2- 172.21.15.192:0/829404773 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff2e4100860 0x7ff2e406a7d0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:16.578 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:16.575+0000 7ff2e8de5640 1 -- 172.21.15.192:0/829404773 >> 172.21.15.192:0/829404773 conn(0x7ff2e40fc010 msgr2=0x7ff2e40fe210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:16:16.578 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:16.575+0000 7ff2e8de5640 1 -- 172.21.15.192:0/829404773 shutdown_connections 2024-09-21T12:16:16.579 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:16.575+0000 7ff2e8de5640 1 -- 172.21.15.192:0/829404773 wait complete. 2024-09-21T12:16:16.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:16 smithi003 ceph-mon[28057]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T12:16:17.268 DEBUG:teuthology.orchestra.run.smithi192:osd.4> sudo journalctl -f -n 0 -u ceph-641beec0-7812-11ef-baf6-efdc52797490@osd.4.service 2024-09-21T12:16:17.311 INFO:tasks.cephadm:Deploying osd.5 on smithi192 with /dev/vg_nvme/lv_2... 2024-09-21T12:16:17.311 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- lvm zap /dev/vg_nvme/lv_2 2024-09-21T12:16:17.462 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:17 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:16:17.462 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:17 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:16:17.462 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:17 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:16:17.462 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:17 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:16:17.462 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:17 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:16:17.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:17 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:16:17.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:17 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:16:17.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:17 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:16:17.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:17 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:16:17.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:17 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:16:18.494 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:18 smithi192 ceph-mon[35641]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T12:16:18.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:18 smithi003 ceph-mon[28057]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T12:16:18.984 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi192/config 2024-09-21T12:16:19.107 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:16:18 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-4[48348]: 2024-09-21T12:16:18.863+0000 7f40cf93f640 -1 osd.4 0 log_to_monitors true 2024-09-21T12:16:19.441 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:19 smithi192 ceph-mon[35641]: from='osd.4 [v2:172.21.15.192:6808/1341504680,v1:172.21.15.192:6809/1341504680]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-21T12:16:19.441 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:19 smithi192 ceph-mon[35641]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-21T12:16:19.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:19 smithi003 ceph-mon[28057]: from='osd.4 [v2:172.21.15.192:6808/1341504680,v1:172.21.15.192:6809/1341504680]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-21T12:16:19.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:19 smithi003 ceph-mon[28057]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-21T12:16:20.292 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:16:20 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-4[48348]: 2024-09-21T12:16:20.216+0000 7f40cb09f640 -1 osd.4 0 waiting for initial osdmap 2024-09-21T12:16:20.292 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:16:20 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-4[48348]: 2024-09-21T12:16:20.223+0000 7f40c76d9640 -1 osd.4 33 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T12:16:20.293 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:20 smithi192 ceph-mon[35641]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T12:16:20.293 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:20 smithi192 ceph-mon[35641]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T12:16:20.293 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:20 smithi192 ceph-mon[35641]: from='osd.4 [v2:172.21.15.192:6808/1341504680,v1:172.21.15.192:6809/1341504680]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-09-21T12:16:20.293 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:20 smithi192 ceph-mon[35641]: osdmap e32: 5 total, 4 up, 5 in 2024-09-21T12:16:20.293 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:20 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T12:16:20.293 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:20 smithi192 ceph-mon[35641]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-09-21T12:16:20.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:20 smithi003 ceph-mon[28057]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T12:16:20.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:20 smithi003 ceph-mon[28057]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T12:16:20.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:20 smithi003 ceph-mon[28057]: from='osd.4 [v2:172.21.15.192:6808/1341504680,v1:172.21.15.192:6809/1341504680]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-09-21T12:16:20.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:20 smithi003 ceph-mon[28057]: osdmap e32: 5 total, 4 up, 5 in 2024-09-21T12:16:20.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:20 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T12:16:20.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:20 smithi003 ceph-mon[28057]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-09-21T12:16:21.433 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:21 smithi192 ceph-mon[35641]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]': finished 2024-09-21T12:16:21.433 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:21 smithi192 ceph-mon[35641]: osdmap e33: 5 total, 4 up, 5 in 2024-09-21T12:16:21.433 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:21 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T12:16:21.433 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:21 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T12:16:21.433 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:21 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:16:21.433 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:21 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:16:21.433 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:21 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:16:21.433 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:21 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:16:21.433 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:21 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:16:21.434 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:21 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:16:21.434 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:21 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:16:21.434 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:21 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:16:21.434 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:21 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:16:21.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:21 smithi003 ceph-mon[28057]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]': finished 2024-09-21T12:16:21.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:21 smithi003 ceph-mon[28057]: osdmap e33: 5 total, 4 up, 5 in 2024-09-21T12:16:21.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:21 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T12:16:21.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:21 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T12:16:21.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:21 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:16:21.581 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:21 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:16:21.581 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:21 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:16:21.581 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:21 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:16:21.581 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:21 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:16:21.581 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:21 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:16:21.581 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:21 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:16:21.582 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:21 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:16:21.582 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:21 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:16:22.189 INFO:teuthology.orchestra.run.smithi192.stdout: 2024-09-21T12:16:22.214 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph orch daemon add osd smithi192:vg_nvme/lv_2 2024-09-21T12:16:22.463 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi192/config 2024-09-21T12:16:22.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:22 smithi192 ceph-mon[35641]: purged_snaps scrub starts 2024-09-21T12:16:22.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:22 smithi192 ceph-mon[35641]: purged_snaps scrub ok 2024-09-21T12:16:22.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:22 smithi192 ceph-mon[35641]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T12:16:22.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:22 smithi192 ceph-mon[35641]: Detected new or changed devices on smithi192 2024-09-21T12:16:22.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:22 smithi192 ceph-mon[35641]: Adjusting osd_memory_target on smithi192 to 7456M 2024-09-21T12:16:22.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:22 smithi192 ceph-mon[35641]: osd.4 [v2:172.21.15.192:6808/1341504680,v1:172.21.15.192:6809/1341504680] boot 2024-09-21T12:16:22.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:22 smithi192 ceph-mon[35641]: osdmap e34: 5 total, 5 up, 5 in 2024-09-21T12:16:22.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:22 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T12:16:22.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:22 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:16:22.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:22 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:16:22.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:22 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:16:22.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:22 smithi003 ceph-mon[28057]: purged_snaps scrub starts 2024-09-21T12:16:22.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:22 smithi003 ceph-mon[28057]: purged_snaps scrub ok 2024-09-21T12:16:22.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:22 smithi003 ceph-mon[28057]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 112 MiB used, 357 GiB / 358 GiB avail 2024-09-21T12:16:22.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:22 smithi003 ceph-mon[28057]: Detected new or changed devices on smithi192 2024-09-21T12:16:22.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:22 smithi003 ceph-mon[28057]: Adjusting osd_memory_target on smithi192 to 7456M 2024-09-21T12:16:22.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:22 smithi003 ceph-mon[28057]: osd.4 [v2:172.21.15.192:6808/1341504680,v1:172.21.15.192:6809/1341504680] boot 2024-09-21T12:16:22.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:22 smithi003 ceph-mon[28057]: osdmap e34: 5 total, 5 up, 5 in 2024-09-21T12:16:22.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:22 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T12:16:22.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:22 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:16:22.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:22 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:16:22.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:22 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:16:22.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:22.935+0000 7f1b78a85640 1 -- 172.21.15.192:0/1312225485 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b74101960 msgr2=0x7f1b74101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:22.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:22.935+0000 7f1b78a85640 1 --2- 172.21.15.192:0/1312225485 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b74101960 0x7f1b74101d60 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1b64009880 tx=0x7f1b6402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:16:22.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:22.936+0000 7f1b78a85640 1 -- 172.21.15.192:0/1312225485 shutdown_connections 2024-09-21T12:16:22.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:22.936+0000 7f1b78a85640 1 --2- 172.21.15.192:0/1312225485 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1b74102b60 0x7f1b74102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:22.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:22.936+0000 7f1b78a85640 1 --2- 172.21.15.192:0/1312225485 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b74101960 0x7f1b74101d60 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:22.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:22.936+0000 7f1b78a85640 1 -- 172.21.15.192:0/1312225485 >> 172.21.15.192:0/1312225485 conn(0x7f1b740fd0f0 msgr2=0x7f1b740ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:16:22.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:22.936+0000 7f1b78a85640 1 -- 172.21.15.192:0/1312225485 shutdown_connections 2024-09-21T12:16:22.972 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:22.936+0000 7f1b78a85640 1 -- 172.21.15.192:0/1312225485 wait complete. 2024-09-21T12:16:22.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:22.936+0000 7f1b78a85640 1 Processor -- start 2024-09-21T12:16:22.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:22.936+0000 7f1b78a85640 1 -- start start 2024-09-21T12:16:22.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:22.936+0000 7f1b78a85640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1b74101960 0x7f1b74197530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:16:22.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:22.936+0000 7f1b78a85640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b74102b60 0x7f1b74197a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:16:22.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:22.936+0000 7f1b78a85640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f1b7410a800 con 0x7f1b74101960 2024-09-21T12:16:22.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:22.936+0000 7f1b78a85640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f1b7410a680 con 0x7f1b74102b60 2024-09-21T12:16:22.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:22.937+0000 7f1b71d9b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b74102b60 0x7f1b74197a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:16:22.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:22.937+0000 7f1b71d9b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b74102b60 0x7f1b74197a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:53942/0 (socket says 172.21.15.192:53942) 2024-09-21T12:16:22.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:22.937+0000 7f1b71d9b640 1 -- 172.21.15.192:0/2403340810 learned_addr learned my addr 172.21.15.192:0/2403340810 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-21T12:16:22.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:22.937+0000 7f1b7259c640 1 --2- 172.21.15.192:0/2403340810 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1b74101960 0x7f1b74197530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:16:22.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:22.937+0000 7f1b71d9b640 1 -- 172.21.15.192:0/2403340810 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1b74101960 msgr2=0x7f1b74197530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:22.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:22.937+0000 7f1b71d9b640 1 --2- 172.21.15.192:0/2403340810 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1b74101960 0x7f1b74197530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:22.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:22.937+0000 7f1b71d9b640 1 -- 172.21.15.192:0/2403340810 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b741980f0 con 0x7f1b74102b60 2024-09-21T12:16:22.973 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:22.937+0000 7f1b7259c640 1 --2- 172.21.15.192:0/2403340810 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1b74101960 0x7f1b74197530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:16:22.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:22.937+0000 7f1b71d9b640 1 --2- 172.21.15.192:0/2403340810 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b74102b60 0x7f1b74197a70 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1b6800b420 tx=0x7f1b6800b8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:16:22.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:22.937+0000 7f1b637fe640 1 -- 172.21.15.192:0/2403340810 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1b68011630 con 0x7f1b74102b60 2024-09-21T12:16:22.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:22.937+0000 7f1b637fe640 1 -- 172.21.15.192:0/2403340810 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1b68016070 con 0x7f1b74102b60 2024-09-21T12:16:22.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:22.937+0000 7f1b78a85640 1 -- 172.21.15.192:0/2403340810 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b7419cb30 con 0x7f1b74102b60 2024-09-21T12:16:22.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:22.937+0000 7f1b637fe640 1 -- 172.21.15.192:0/2403340810 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1b68010d40 con 0x7f1b74102b60 2024-09-21T12:16:22.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:22.937+0000 7f1b78a85640 1 -- 172.21.15.192:0/2403340810 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b7419d140 con 0x7f1b74102b60 2024-09-21T12:16:22.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:22.938+0000 7f1b78a85640 1 -- 172.21.15.192:0/2403340810 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b74101d60 con 0x7f1b74102b60 2024-09-21T12:16:22.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:22.939+0000 7f1b637fe640 1 -- 172.21.15.192:0/2403340810 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 19) ==== 92549+0+0 (secure 0 0 0) 0x7f1b6801b460 con 0x7f1b74102b60 2024-09-21T12:16:22.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:22.939+0000 7f1b637fe640 1 --2- 172.21.15.192:0/2403340810 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f1b5c06e2b0 0x7f1b5c070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:16:22.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:22.939+0000 7f1b637fe640 1 -- 172.21.15.192:0/2403340810 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 4206+0+0 (secure 0 0 0) 0x7f1b6808d590 con 0x7f1b74102b60 2024-09-21T12:16:22.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:22.939+0000 7f1b7259c640 1 --2- 172.21.15.192:0/2403340810 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f1b5c06e2b0 0x7f1b5c070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:16:22.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:22.940+0000 7f1b7259c640 1 --2- 172.21.15.192:0/2403340810 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f1b5c06e2b0 0x7f1b5c070770 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1b64000c00 tx=0x7f1b64005a20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:16:22.974 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:22.943+0000 7f1b637fe640 1 -- 172.21.15.192:0/2403340810 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1b6805b3e0 con 0x7f1b74102b60 2024-09-21T12:16:23.119 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:23.118+0000 7f1b78a85640 1 -- 172.21.15.192:0/2403340810 --> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f1b74062630 con 0x7f1b5c06e2b0 2024-09-21T12:16:23.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:23 smithi192 ceph-mon[35641]: osdmap e35: 5 total, 5 up, 5 in 2024-09-21T12:16:23.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:23 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T12:16:23.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:23 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T12:16:23.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:23 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:16:23.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:23 smithi003 ceph-mon[28057]: osdmap e35: 5 total, 5 up, 5 in 2024-09-21T12:16:23.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:23 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-21T12:16:23.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:23 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-21T12:16:23.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:23 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:16:24.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:24 smithi003 ceph-mon[28057]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-21T12:16:24.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:24 smithi003 ceph-mon[28057]: from='client.24219 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:16:24.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:24 smithi192 ceph-mon[35641]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-21T12:16:24.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:24 smithi192 ceph-mon[35641]: from='client.24219 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi192:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:16:26.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:26 smithi192 ceph-mon[35641]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-21T12:16:26.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:26 smithi192 ceph-mon[35641]: from='client.? 172.21.15.192:0/123819676' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "667455e4-320f-4f4e-8277-6941f9164fd5"}]: dispatch 2024-09-21T12:16:26.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:26 smithi192 ceph-mon[35641]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "667455e4-320f-4f4e-8277-6941f9164fd5"}]: dispatch 2024-09-21T12:16:26.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:26 smithi192 ceph-mon[35641]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "667455e4-320f-4f4e-8277-6941f9164fd5"}]': finished 2024-09-21T12:16:26.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:26 smithi192 ceph-mon[35641]: osdmap e36: 6 total, 5 up, 6 in 2024-09-21T12:16:26.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:26 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T12:16:26.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:26 smithi192 ceph-mon[35641]: from='client.? 172.21.15.192:0/2045266460' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T12:16:26.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:26 smithi003 ceph-mon[28057]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-21T12:16:26.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:26 smithi003 ceph-mon[28057]: from='client.? 172.21.15.192:0/123819676' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "667455e4-320f-4f4e-8277-6941f9164fd5"}]: dispatch 2024-09-21T12:16:26.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:26 smithi003 ceph-mon[28057]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "667455e4-320f-4f4e-8277-6941f9164fd5"}]: dispatch 2024-09-21T12:16:26.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:26 smithi003 ceph-mon[28057]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "667455e4-320f-4f4e-8277-6941f9164fd5"}]': finished 2024-09-21T12:16:26.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:26 smithi003 ceph-mon[28057]: osdmap e36: 6 total, 5 up, 6 in 2024-09-21T12:16:26.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:26 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T12:16:26.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:26 smithi003 ceph-mon[28057]: from='client.? 172.21.15.192:0/2045266460' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-21T12:16:28.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:28 smithi192 ceph-mon[35641]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-21T12:16:28.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:28 smithi003 ceph-mon[28057]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-21T12:16:30.731 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:30 smithi003 ceph-mon[28057]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-21T12:16:30.736 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:30 smithi192 ceph-mon[35641]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-21T12:16:32.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:32 smithi192 ceph-mon[35641]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-21T12:16:32.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:32 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:16:32.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:32 smithi003 ceph-mon[28057]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-21T12:16:32.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:32 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:16:34.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:34 smithi192 ceph-mon[35641]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-21T12:16:34.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:34 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-21T12:16:34.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:34 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:16:34.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:34 smithi003 ceph-mon[28057]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-21T12:16:34.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:34 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-21T12:16:34.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:34 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:16:35.749 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:35 smithi192 ceph-mon[35641]: Deploying daemon osd.5 on smithi192 2024-09-21T12:16:35.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:35 smithi003 ceph-mon[28057]: Deploying daemon osd.5 on smithi192 2024-09-21T12:16:36.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:36 smithi192 ceph-mon[35641]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-21T12:16:36.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:36 smithi003 ceph-mon[28057]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-21T12:16:38.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:38 smithi192 ceph-mon[35641]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-21T12:16:38.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:38 smithi003 ceph-mon[28057]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-21T12:16:40.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:40 smithi192 ceph-mon[35641]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-21T12:16:40.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:40 smithi003 ceph-mon[28057]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-21T12:16:41.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:41 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:16:41.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:41 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:16:41.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:41 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:16:41.813 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:41 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:16:41.813 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:41 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:16:41.813 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:41 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:16:42.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:42 smithi003 ceph-mon[28057]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-21T12:16:42.857 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:42 smithi192 ceph-mon[35641]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-21T12:16:44.330 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:44.328+0000 7f1b637fe640 1 -- 172.21.15.192:0/2403340810 <== mgr.14217 v2:172.21.15.3:6800/2480880781 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f1b74062630 con 0x7f1b5c06e2b0 2024-09-21T12:16:44.331 INFO:teuthology.orchestra.run.smithi192.stdout:Created osd(s) 5 on host 'smithi192' 2024-09-21T12:16:44.333 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:44.331+0000 7f1b78a85640 1 -- 172.21.15.192:0/2403340810 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f1b5c06e2b0 msgr2=0x7f1b5c070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:44.333 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:44.331+0000 7f1b78a85640 1 --2- 172.21.15.192:0/2403340810 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f1b5c06e2b0 0x7f1b5c070770 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1b64000c00 tx=0x7f1b64005a20 comp rx=0 tx=0).stop 2024-09-21T12:16:44.333 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:44.331+0000 7f1b78a85640 1 -- 172.21.15.192:0/2403340810 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b74102b60 msgr2=0x7f1b74197a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:44.333 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:44.331+0000 7f1b78a85640 1 --2- 172.21.15.192:0/2403340810 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b74102b60 0x7f1b74197a70 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1b6800b420 tx=0x7f1b6800b8e0 comp rx=0 tx=0).stop 2024-09-21T12:16:44.333 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:44.331+0000 7f1b78a85640 1 -- 172.21.15.192:0/2403340810 shutdown_connections 2024-09-21T12:16:44.333 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:44.331+0000 7f1b78a85640 1 --2- 172.21.15.192:0/2403340810 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f1b5c06e2b0 0x7f1b5c070770 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:44.333 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:44.331+0000 7f1b78a85640 1 --2- 172.21.15.192:0/2403340810 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b74102b60 0x7f1b74197a70 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:44.333 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:44.331+0000 7f1b78a85640 1 --2- 172.21.15.192:0/2403340810 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1b74101960 0x7f1b74197530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:44.333 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:44.331+0000 7f1b78a85640 1 -- 172.21.15.192:0/2403340810 >> 172.21.15.192:0/2403340810 conn(0x7f1b740fd0f0 msgr2=0x7f1b741060c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:16:44.333 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:44.331+0000 7f1b78a85640 1 -- 172.21.15.192:0/2403340810 shutdown_connections 2024-09-21T12:16:44.333 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:44.331+0000 7f1b78a85640 1 -- 172.21.15.192:0/2403340810 wait complete. 2024-09-21T12:16:44.661 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:44 smithi192 ceph-mon[35641]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-21T12:16:44.661 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:44 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:16:44.661 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:44 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:16:44.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:44 smithi003 ceph-mon[28057]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-21T12:16:44.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:44 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:16:44.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:44 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:16:45.038 DEBUG:teuthology.orchestra.run.smithi192:osd.5> sudo journalctl -f -n 0 -u ceph-641beec0-7812-11ef-baf6-efdc52797490@osd.5.service 2024-09-21T12:16:45.041 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-09-21T12:16:45.041 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph osd stat -f json 2024-09-21T12:16:45.330 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:16:45.944 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:45.942+0000 7f5645fe2640 1 -- 172.21.15.3:0/3138511835 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5640101960 msgr2=0x7f5640101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:45.945 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:45.942+0000 7f5645fe2640 1 --2- 172.21.15.3:0/3138511835 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5640101960 0x7f5640101d60 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f5630009880 tx=0x7f563002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:16:45.945 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:45.942+0000 7f5645fe2640 1 -- 172.21.15.3:0/3138511835 shutdown_connections 2024-09-21T12:16:45.945 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:45.942+0000 7f5645fe2640 1 --2- 172.21.15.3:0/3138511835 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5640102b60 0x7f5640102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:45.945 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:45.942+0000 7f5645fe2640 1 --2- 172.21.15.3:0/3138511835 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5640101960 0x7f5640101d60 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:45.945 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:45.942+0000 7f5645fe2640 1 -- 172.21.15.3:0/3138511835 >> 172.21.15.3:0/3138511835 conn(0x7f56400fd0f0 msgr2=0x7f56400ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:16:45.945 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:45.942+0000 7f5645fe2640 1 -- 172.21.15.3:0/3138511835 shutdown_connections 2024-09-21T12:16:45.945 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:45.942+0000 7f5645fe2640 1 -- 172.21.15.3:0/3138511835 wait complete. 2024-09-21T12:16:45.945 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:45.943+0000 7f5645fe2640 1 Processor -- start 2024-09-21T12:16:45.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:45.943+0000 7f5645fe2640 1 -- start start 2024-09-21T12:16:45.947 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:45.943+0000 7f5645fe2640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5640101960 0x7f5640075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:16:45.947 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:45.943+0000 7f5645fe2640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5640102b60 0x7f56400745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:16:45.947 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:45.944+0000 7f5645fe2640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f564010a780 con 0x7f5640102b60 2024-09-21T12:16:45.947 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:45.944+0000 7f5645fe2640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f564010a600 con 0x7f5640101960 2024-09-21T12:16:45.947 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:45.944+0000 7f563effd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5640102b60 0x7f56400745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:16:45.947 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:45.944+0000 7f563effd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5640102b60 0x7f56400745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:46274/0 (socket says 172.21.15.3:46274) 2024-09-21T12:16:45.947 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:45.944+0000 7f563effd640 1 -- 172.21.15.3:0/543866096 learned_addr learned my addr 172.21.15.3:0/543866096 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:16:45.947 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:45.944+0000 7f563f7fe640 1 --2- 172.21.15.3:0/543866096 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5640101960 0x7f5640075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:16:45.947 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:45.944+0000 7f563effd640 1 -- 172.21.15.3:0/543866096 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5640101960 msgr2=0x7f5640075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:45.947 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:45.944+0000 7f563effd640 1 --2- 172.21.15.3:0/543866096 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5640101960 0x7f5640075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:45.947 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:45.944+0000 7f563effd640 1 -- 172.21.15.3:0/543866096 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5640074b20 con 0x7f5640102b60 2024-09-21T12:16:45.947 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:45.944+0000 7f563effd640 1 --2- 172.21.15.3:0/543866096 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5640102b60 0x7f56400745e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f563400d8d0 tx=0x7f563400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:16:45.947 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:45.944+0000 7f563cff9640 1 -- 172.21.15.3:0/543866096 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5634017070 con 0x7f5640102b60 2024-09-21T12:16:45.948 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:45.944+0000 7f563cff9640 1 -- 172.21.15.3:0/543866096 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5634010460 con 0x7f5640102b60 2024-09-21T12:16:45.948 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:45.944+0000 7f5645fe2640 1 -- 172.21.15.3:0/543866096 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5640074e10 con 0x7f5640102b60 2024-09-21T12:16:45.948 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:45.944+0000 7f563cff9640 1 -- 172.21.15.3:0/543866096 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f563400f5f0 con 0x7f5640102b60 2024-09-21T12:16:45.948 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:45.944+0000 7f5645fe2640 1 -- 172.21.15.3:0/543866096 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56400753a0 con 0x7f5640102b60 2024-09-21T12:16:45.949 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:45.946+0000 7f5645fe2640 1 -- 172.21.15.3:0/543866096 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5640101d60 con 0x7f5640102b60 2024-09-21T12:16:45.949 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:45.946+0000 7f563cff9640 1 -- 172.21.15.3:0/543866096 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 19) ==== 92549+0+0 (secure 0 0 0) 0x7f5634009a30 con 0x7f5640102b60 2024-09-21T12:16:45.949 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:45.947+0000 7f563cff9640 1 --2- 172.21.15.3:0/543866096 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f562806e2b0 0x7f5628070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:16:45.949 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:45.947+0000 7f563f7fe640 1 --2- 172.21.15.3:0/543866096 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f562806e2b0 0x7f5628070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:16:45.949 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:45.947+0000 7f563cff9640 1 -- 172.21.15.3:0/543866096 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 4321+0+0 (secure 0 0 0) 0x7f563408dbf0 con 0x7f5640102b60 2024-09-21T12:16:45.949 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:45.947+0000 7f563f7fe640 1 --2- 172.21.15.3:0/543866096 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f562806e2b0 0x7f5628070770 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5630009230 tx=0x7f56300058d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:16:45.953 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:45.951+0000 7f563cff9640 1 -- 172.21.15.3:0/543866096 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f563405f5d0 con 0x7f5640102b60 2024-09-21T12:16:46.133 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:46.130+0000 7f5645fe2640 1 -- 172.21.15.3:0/543866096 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f5640062df0 con 0x7f5640102b60 2024-09-21T12:16:46.133 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:46.131+0000 7f563cff9640 1 -- 172.21.15.3:0/543866096 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v36) ==== 74+0+130 (secure 0 0 0) 0x7f5634063e00 con 0x7f5640102b60 2024-09-21T12:16:46.133 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:16:46.135 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:46.133+0000 7f5645fe2640 1 -- 172.21.15.3:0/543866096 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f562806e2b0 msgr2=0x7f5628070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:46.135 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:46.133+0000 7f5645fe2640 1 --2- 172.21.15.3:0/543866096 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f562806e2b0 0x7f5628070770 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5630009230 tx=0x7f56300058d0 comp rx=0 tx=0).stop 2024-09-21T12:16:46.135 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:46.133+0000 7f5645fe2640 1 -- 172.21.15.3:0/543866096 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5640102b60 msgr2=0x7f56400745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:46.135 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:46.133+0000 7f5645fe2640 1 --2- 172.21.15.3:0/543866096 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5640102b60 0x7f56400745e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f563400d8d0 tx=0x7f563400dd90 comp rx=0 tx=0).stop 2024-09-21T12:16:46.135 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:46.133+0000 7f5645fe2640 1 -- 172.21.15.3:0/543866096 shutdown_connections 2024-09-21T12:16:46.135 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:46.133+0000 7f5645fe2640 1 --2- 172.21.15.3:0/543866096 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f562806e2b0 0x7f5628070770 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:46.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:46.133+0000 7f5645fe2640 1 --2- 172.21.15.3:0/543866096 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5640102b60 0x7f56400745e0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:46.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:46.133+0000 7f5645fe2640 1 --2- 172.21.15.3:0/543866096 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5640101960 0x7f5640075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:46.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:46.133+0000 7f5645fe2640 1 -- 172.21.15.3:0/543866096 >> 172.21.15.3:0/543866096 conn(0x7f56400fd0f0 msgr2=0x7f5640105fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:16:46.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:46.133+0000 7f5645fe2640 1 -- 172.21.15.3:0/543866096 shutdown_connections 2024-09-21T12:16:46.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:46.133+0000 7f5645fe2640 1 -- 172.21.15.3:0/543866096 wait complete. 2024-09-21T12:16:46.347 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:46 smithi003 ceph-mon[28057]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-21T12:16:46.348 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:46 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:16:46.348 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:46 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:16:46.486 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:46 smithi192 ceph-mon[35641]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-21T12:16:46.486 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:46 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:16:46.486 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:46 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:16:47.011 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":36,"num_osds":6,"num_up_osds":5,"osd_up_since":1726920981,"num_in_osds":6,"osd_in_since":1726920985,"num_remapped_pgs":0} 2024-09-21T12:16:47.133 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:16:46 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-5[55064]: 2024-09-21T12:16:46.836+0000 7fe2342ea640 -1 osd.5 0 log_to_monitors true 2024-09-21T12:16:47.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:47 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/543866096' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-21T12:16:47.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:47 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:16:47.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:47 smithi003 ceph-mon[28057]: from='osd.5 [v2:172.21.15.192:6816/1770474426,v1:172.21.15.192:6817/1770474426]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-21T12:16:47.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:47 smithi003 ceph-mon[28057]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-21T12:16:47.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:47 smithi192 ceph-mon[35641]: from='client.? 172.21.15.3:0/543866096' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-21T12:16:47.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:47 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:16:47.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:47 smithi192 ceph-mon[35641]: from='osd.5 [v2:172.21.15.192:6816/1770474426,v1:172.21.15.192:6817/1770474426]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-21T12:16:47.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:47 smithi192 ceph-mon[35641]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-21T12:16:48.013 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph osd stat -f json 2024-09-21T12:16:48.297 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:16:48.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:48 smithi003 ceph-mon[28057]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-21T12:16:48.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:48 smithi003 ceph-mon[28057]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T12:16:48.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:48 smithi003 ceph-mon[28057]: osdmap e37: 6 total, 5 up, 6 in 2024-09-21T12:16:48.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:48 smithi003 ceph-mon[28057]: from='osd.5 [v2:172.21.15.192:6816/1770474426,v1:172.21.15.192:6817/1770474426]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-09-21T12:16:48.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:48 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T12:16:48.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:48 smithi003 ceph-mon[28057]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-09-21T12:16:48.508 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:16:48 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-5[55064]: 2024-09-21T12:16:48.138+0000 7fe22fa4a640 -1 osd.5 0 waiting for initial osdmap 2024-09-21T12:16:48.508 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:16:48 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-5[55064]: 2024-09-21T12:16:48.145+0000 7fe22c084640 -1 osd.5 38 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T12:16:48.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:48 smithi192 ceph-mon[35641]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-21T12:16:48.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:48 smithi192 ceph-mon[35641]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T12:16:48.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:48 smithi192 ceph-mon[35641]: osdmap e37: 6 total, 5 up, 6 in 2024-09-21T12:16:48.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:48 smithi192 ceph-mon[35641]: from='osd.5 [v2:172.21.15.192:6816/1770474426,v1:172.21.15.192:6817/1770474426]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-09-21T12:16:48.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:48 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T12:16:48.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:48 smithi192 ceph-mon[35641]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]: dispatch 2024-09-21T12:16:48.927 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:48.783+0000 7fc35ce4d640 1 -- 172.21.15.3:0/2678599434 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc358102b60 msgr2=0x7fc358102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:48.927 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:48.783+0000 7fc35ce4d640 1 --2- 172.21.15.3:0/2678599434 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc358102b60 0x7fc358102fe0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc340009880 tx=0x7fc34002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:16:48.927 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:48.783+0000 7fc35ce4d640 1 -- 172.21.15.3:0/2678599434 shutdown_connections 2024-09-21T12:16:48.927 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:48.783+0000 7fc35ce4d640 1 --2- 172.21.15.3:0/2678599434 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc358102b60 0x7fc358102fe0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:48.927 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:48.783+0000 7fc35ce4d640 1 --2- 172.21.15.3:0/2678599434 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc358101960 0x7fc358101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:48.927 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:48.783+0000 7fc35ce4d640 1 -- 172.21.15.3:0/2678599434 >> 172.21.15.3:0/2678599434 conn(0x7fc3580fd0f0 msgr2=0x7fc3580ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:16:48.927 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:48.783+0000 7fc35ce4d640 1 -- 172.21.15.3:0/2678599434 shutdown_connections 2024-09-21T12:16:48.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:48.783+0000 7fc35ce4d640 1 -- 172.21.15.3:0/2678599434 wait complete. 2024-09-21T12:16:48.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:48.784+0000 7fc35ce4d640 1 Processor -- start 2024-09-21T12:16:48.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:48.784+0000 7fc35ce4d640 1 -- start start 2024-09-21T12:16:48.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:48.784+0000 7fc35ce4d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc358101960 0x7fc358197510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:16:48.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:48.784+0000 7fc35ce4d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc358102b60 0x7fc358197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:16:48.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:48.784+0000 7fc35ce4d640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fc35810a820 con 0x7fc358102b60 2024-09-21T12:16:48.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:48.784+0000 7fc35ce4d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc35810a6a0 con 0x7fc358101960 2024-09-21T12:16:48.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:48.785+0000 7fc34ffff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc358102b60 0x7fc358197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:16:48.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:48.785+0000 7fc34ffff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc358102b60 0x7fc358197a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:46282/0 (socket says 172.21.15.3:46282) 2024-09-21T12:16:48.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:48.785+0000 7fc34ffff640 1 -- 172.21.15.3:0/2297305824 learned_addr learned my addr 172.21.15.3:0/2297305824 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:16:48.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:48.785+0000 7fc35659c640 1 --2- 172.21.15.3:0/2297305824 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc358101960 0x7fc358197510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:16:48.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:48.785+0000 7fc34ffff640 1 -- 172.21.15.3:0/2297305824 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc358101960 msgr2=0x7fc358197510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:48.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:48.785+0000 7fc34ffff640 1 --2- 172.21.15.3:0/2297305824 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc358101960 0x7fc358197510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:48.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:48.785+0000 7fc34ffff640 1 -- 172.21.15.3:0/2297305824 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3581980d0 con 0x7fc358102b60 2024-09-21T12:16:48.929 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:48.785+0000 7fc34ffff640 1 --2- 172.21.15.3:0/2297305824 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc358102b60 0x7fc358197a50 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc340006010 tx=0x7fc3400048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:16:48.929 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:48.785+0000 7fc34f7fe640 1 -- 172.21.15.3:0/2297305824 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc34003f070 con 0x7fc358102b60 2024-09-21T12:16:48.929 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:48.785+0000 7fc34f7fe640 1 -- 172.21.15.3:0/2297305824 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc3400044d0 con 0x7fc358102b60 2024-09-21T12:16:48.929 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:48.785+0000 7fc35ce4d640 1 -- 172.21.15.3:0/2297305824 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc35819cab0 con 0x7fc358102b60 2024-09-21T12:16:48.929 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:48.785+0000 7fc34f7fe640 1 -- 172.21.15.3:0/2297305824 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc340035030 con 0x7fc358102b60 2024-09-21T12:16:48.929 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:48.785+0000 7fc35ce4d640 1 -- 172.21.15.3:0/2297305824 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc35819d0c0 con 0x7fc358102b60 2024-09-21T12:16:48.929 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:48.786+0000 7fc35ce4d640 1 -- 172.21.15.3:0/2297305824 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc358101d40 con 0x7fc358102b60 2024-09-21T12:16:48.929 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:48.787+0000 7fc34f7fe640 1 -- 172.21.15.3:0/2297305824 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 19) ==== 92549+0+0 (secure 0 0 0) 0x7fc340042070 con 0x7fc358102b60 2024-09-21T12:16:48.929 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:48.787+0000 7fc34f7fe640 1 --2- 172.21.15.3:0/2297305824 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fc34406e2b0 0x7fc344070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:16:48.929 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:48.788+0000 7fc34f7fe640 1 -- 172.21.15.3:0/2297305824 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4358+0+0 (secure 0 0 0) 0x7fc3400aeb30 con 0x7fc358102b60 2024-09-21T12:16:48.929 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:48.788+0000 7fc35659c640 1 --2- 172.21.15.3:0/2297305824 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fc34406e2b0 0x7fc344070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:16:48.929 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:48.788+0000 7fc35659c640 1 --2- 172.21.15.3:0/2297305824 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fc34406e2b0 0x7fc344070770 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc3581029c0 tx=0x7fc348008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:16:48.929 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:48.792+0000 7fc34f7fe640 1 -- 172.21.15.3:0/2297305824 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc34007c840 con 0x7fc358102b60 2024-09-21T12:16:48.970 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:48.969+0000 7fc35ce4d640 1 -- 172.21.15.3:0/2297305824 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fc358062df0 con 0x7fc358102b60 2024-09-21T12:16:48.971 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:48.969+0000 7fc34f7fe640 1 -- 172.21.15.3:0/2297305824 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v38) ==== 74+0+130 (secure 0 0 0) 0x7fc3400804f0 con 0x7fc358102b60 2024-09-21T12:16:48.971 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:16:48.973 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:48.971+0000 7fc35ce4d640 1 -- 172.21.15.3:0/2297305824 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fc34406e2b0 msgr2=0x7fc344070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:48.973 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:48.971+0000 7fc35ce4d640 1 --2- 172.21.15.3:0/2297305824 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fc34406e2b0 0x7fc344070770 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc3581029c0 tx=0x7fc348008040 comp rx=0 tx=0).stop 2024-09-21T12:16:48.973 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:48.971+0000 7fc35ce4d640 1 -- 172.21.15.3:0/2297305824 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc358102b60 msgr2=0x7fc358197a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:48.973 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:48.971+0000 7fc35ce4d640 1 --2- 172.21.15.3:0/2297305824 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc358102b60 0x7fc358197a50 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fc340006010 tx=0x7fc3400048f0 comp rx=0 tx=0).stop 2024-09-21T12:16:48.973 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:48.971+0000 7fc35ce4d640 1 -- 172.21.15.3:0/2297305824 shutdown_connections 2024-09-21T12:16:48.973 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:48.971+0000 7fc35ce4d640 1 --2- 172.21.15.3:0/2297305824 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fc34406e2b0 0x7fc344070770 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:48.973 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:48.971+0000 7fc35ce4d640 1 --2- 172.21.15.3:0/2297305824 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc358102b60 0x7fc358197a50 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:48.973 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:48.971+0000 7fc35ce4d640 1 --2- 172.21.15.3:0/2297305824 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc358101960 0x7fc358197510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:48.973 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:48.971+0000 7fc35ce4d640 1 -- 172.21.15.3:0/2297305824 >> 172.21.15.3:0/2297305824 conn(0x7fc3580fd0f0 msgr2=0x7fc358106020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:16:48.973 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:48.971+0000 7fc35ce4d640 1 -- 172.21.15.3:0/2297305824 shutdown_connections 2024-09-21T12:16:48.973 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:48.971+0000 7fc35ce4d640 1 -- 172.21.15.3:0/2297305824 wait complete. 2024-09-21T12:16:49.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:49 smithi003 ceph-mon[28057]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]': finished 2024-09-21T12:16:49.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:49 smithi003 ceph-mon[28057]: osdmap e38: 6 total, 5 up, 6 in 2024-09-21T12:16:49.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:49 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T12:16:49.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:49 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T12:16:49.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:49 smithi003 ceph-mon[28057]: Detected new or changed devices on smithi192 2024-09-21T12:16:49.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:49 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:16:49.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:49 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:16:49.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:49 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:16:49.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:49 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:16:49.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:49 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:16:49.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:49 smithi003 ceph-mon[28057]: Adjusting osd_memory_target on smithi192 to 4970M 2024-09-21T12:16:49.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:49 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:16:49.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:49 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:16:49.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:49 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:16:49.331 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:49 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:16:49.331 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:49 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:16:49.331 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:49 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:16:49.331 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:49 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:16:49.331 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:49 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:16:49.331 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:49 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/2297305824' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-21T12:16:49.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:49 smithi192 ceph-mon[35641]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi192", "root=default"]}]': finished 2024-09-21T12:16:49.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:49 smithi192 ceph-mon[35641]: osdmap e38: 6 total, 5 up, 6 in 2024-09-21T12:16:49.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:49 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T12:16:49.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:49 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T12:16:49.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:49 smithi192 ceph-mon[35641]: Detected new or changed devices on smithi192 2024-09-21T12:16:49.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:49 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:16:49.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:49 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:16:49.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:49 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:16:49.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:49 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:16:49.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:49 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:16:49.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:49 smithi192 ceph-mon[35641]: Adjusting osd_memory_target on smithi192 to 4970M 2024-09-21T12:16:49.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:49 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:16:49.509 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:49 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:16:49.509 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:49 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:16:49.509 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:49 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:16:49.509 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:49 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:16:49.509 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:49 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:16:49.509 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:49 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:16:49.509 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:49 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:16:49.509 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:49 smithi192 ceph-mon[35641]: from='client.? 172.21.15.3:0/2297305824' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-21T12:16:49.707 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":38,"num_osds":6,"num_up_osds":5,"osd_up_since":1726920981,"num_in_osds":6,"osd_in_since":1726920985,"num_remapped_pgs":0} 2024-09-21T12:16:50.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:50 smithi192 ceph-mon[35641]: purged_snaps scrub starts 2024-09-21T12:16:50.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:50 smithi192 ceph-mon[35641]: purged_snaps scrub ok 2024-09-21T12:16:50.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:50 smithi192 ceph-mon[35641]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-21T12:16:50.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:50 smithi192 ceph-mon[35641]: osd.5 [v2:172.21.15.192:6816/1770474426,v1:172.21.15.192:6817/1770474426] boot 2024-09-21T12:16:50.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:50 smithi192 ceph-mon[35641]: osdmap e39: 6 total, 6 up, 6 in 2024-09-21T12:16:50.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:50 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T12:16:50.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:50 smithi003 ceph-mon[28057]: purged_snaps scrub starts 2024-09-21T12:16:50.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:50 smithi003 ceph-mon[28057]: purged_snaps scrub ok 2024-09-21T12:16:50.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:50 smithi003 ceph-mon[28057]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 139 MiB used, 447 GiB / 447 GiB avail 2024-09-21T12:16:50.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:50 smithi003 ceph-mon[28057]: osd.5 [v2:172.21.15.192:6816/1770474426,v1:172.21.15.192:6817/1770474426] boot 2024-09-21T12:16:50.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:50 smithi003 ceph-mon[28057]: osdmap e39: 6 total, 6 up, 6 in 2024-09-21T12:16:50.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:50 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T12:16:50.709 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph osd stat -f json 2024-09-21T12:16:50.983 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:16:51.358 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:51 smithi003 ceph-mon[28057]: osdmap e40: 6 total, 6 up, 6 in 2024-09-21T12:16:51.568 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:51.559+0000 7f1380a47640 1 -- 172.21.15.3:0/1818597881 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f137c102450 msgr2=0x7f137c104840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:51.568 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:51.559+0000 7f1380a47640 1 --2- 172.21.15.3:0/1818597881 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f137c102450 0x7f137c104840 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f136c009880 tx=0x7f136c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:16:51.568 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:51.559+0000 7f1380a47640 1 -- 172.21.15.3:0/1818597881 shutdown_connections 2024-09-21T12:16:51.568 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:51.559+0000 7f1380a47640 1 --2- 172.21.15.3:0/1818597881 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f137c104d80 0x7f137c107170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:51.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:51.559+0000 7f1380a47640 1 --2- 172.21.15.3:0/1818597881 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f137c102450 0x7f137c104840 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:51.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:51.559+0000 7f1380a47640 1 -- 172.21.15.3:0/1818597881 >> 172.21.15.3:0/1818597881 conn(0x7f137c0fc010 msgr2=0x7f137c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:16:51.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:51.559+0000 7f1380a47640 1 -- 172.21.15.3:0/1818597881 shutdown_connections 2024-09-21T12:16:51.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:51.559+0000 7f1380a47640 1 -- 172.21.15.3:0/1818597881 wait complete. 2024-09-21T12:16:51.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:51.560+0000 7f1380a47640 1 Processor -- start 2024-09-21T12:16:51.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:51.560+0000 7f1380a47640 1 -- start start 2024-09-21T12:16:51.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:51.560+0000 7f1380a47640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f137c102450 0x7f137c1996f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:16:51.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:51.560+0000 7f1380a47640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f137c104d80 0x7f137c199c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:16:51.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:51.560+0000 7f1380a47640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f137c10a7c0 con 0x7f137c104d80 2024-09-21T12:16:51.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:51.560+0000 7f1380a47640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f137c10a640 con 0x7f137c102450 2024-09-21T12:16:51.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:51.560+0000 7f1379d9b640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f137c104d80 0x7f137c199c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:16:51.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:51.560+0000 7f1379d9b640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f137c104d80 0x7f137c199c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56656/0 (socket says 172.21.15.3:56656) 2024-09-21T12:16:51.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:51.560+0000 7f1379d9b640 1 -- 172.21.15.3:0/606831135 learned_addr learned my addr 172.21.15.3:0/606831135 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:16:51.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:51.561+0000 7f137a59c640 1 --2- 172.21.15.3:0/606831135 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f137c102450 0x7f137c1996f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:16:51.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:51.561+0000 7f1379d9b640 1 -- 172.21.15.3:0/606831135 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f137c102450 msgr2=0x7f137c1996f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:51.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:51.561+0000 7f1379d9b640 1 --2- 172.21.15.3:0/606831135 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f137c102450 0x7f137c1996f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:51.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:51.561+0000 7f1379d9b640 1 -- 172.21.15.3:0/606831135 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f137c19a2b0 con 0x7f137c104d80 2024-09-21T12:16:51.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:51.561+0000 7f137a59c640 1 --2- 172.21.15.3:0/606831135 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f137c102450 0x7f137c1996f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T12:16:51.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:51.561+0000 7f1379d9b640 1 --2- 172.21.15.3:0/606831135 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f137c104d80 0x7f137c199c30 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f137000b3d0 tx=0x7f137000b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:16:51.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:51.561+0000 7f136b7fe640 1 -- 172.21.15.3:0/606831135 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1370015020 con 0x7f137c104d80 2024-09-21T12:16:51.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:51.561+0000 7f136b7fe640 1 -- 172.21.15.3:0/606831135 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1370011af0 con 0x7f137c104d80 2024-09-21T12:16:51.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:51.561+0000 7f136b7fe640 1 -- 172.21.15.3:0/606831135 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1370010d30 con 0x7f137c104d80 2024-09-21T12:16:51.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:51.561+0000 7f1380a47640 1 -- 172.21.15.3:0/606831135 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f137c19ecf0 con 0x7f137c104d80 2024-09-21T12:16:51.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:51.561+0000 7f1380a47640 1 -- 172.21.15.3:0/606831135 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f137c19f2a0 con 0x7f137c104d80 2024-09-21T12:16:51.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:51.562+0000 7f1380a47640 1 -- 172.21.15.3:0/606831135 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f137c102830 con 0x7f137c104d80 2024-09-21T12:16:51.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:51.563+0000 7f136b7fe640 1 -- 172.21.15.3:0/606831135 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 19) ==== 92549+0+0 (secure 0 0 0) 0x7f1370018020 con 0x7f137c104d80 2024-09-21T12:16:51.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:51.563+0000 7f136b7fe640 1 --2- 172.21.15.3:0/606831135 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f136406e2b0 0x7f1364070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:16:51.571 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:51.563+0000 7f136b7fe640 1 -- 172.21.15.3:0/606831135 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7f137008d900 con 0x7f137c104d80 2024-09-21T12:16:51.571 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:51.563+0000 7f137a59c640 1 --2- 172.21.15.3:0/606831135 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f136406e2b0 0x7f1364070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:16:51.571 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:51.564+0000 7f137a59c640 1 --2- 172.21.15.3:0/606831135 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f136406e2b0 0x7f1364070770 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f136c0096c0 tx=0x7f136c009650 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:16:51.571 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:51.568+0000 7f136b7fe640 1 -- 172.21.15.3:0/606831135 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f137001f020 con 0x7f137c104d80 2024-09-21T12:16:51.744 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:51.742+0000 7f1380a47640 1 -- 172.21.15.3:0/606831135 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f137c062df0 con 0x7f137c104d80 2024-09-21T12:16:51.744 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:51.743+0000 7f136b7fe640 1 -- 172.21.15.3:0/606831135 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v40) ==== 74+0+130 (secure 0 0 0) 0x7f137005b5a0 con 0x7f137c104d80 2024-09-21T12:16:51.744 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:16:51.746 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:51.745+0000 7f1380a47640 1 -- 172.21.15.3:0/606831135 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f136406e2b0 msgr2=0x7f1364070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:51.747 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:51.745+0000 7f1380a47640 1 --2- 172.21.15.3:0/606831135 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f136406e2b0 0x7f1364070770 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f136c0096c0 tx=0x7f136c009650 comp rx=0 tx=0).stop 2024-09-21T12:16:51.747 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:51.745+0000 7f1380a47640 1 -- 172.21.15.3:0/606831135 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f137c104d80 msgr2=0x7f137c199c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:51.747 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:51.745+0000 7f1380a47640 1 --2- 172.21.15.3:0/606831135 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f137c104d80 0x7f137c199c30 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f137000b3d0 tx=0x7f137000b890 comp rx=0 tx=0).stop 2024-09-21T12:16:51.747 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:51.745+0000 7f1380a47640 1 -- 172.21.15.3:0/606831135 shutdown_connections 2024-09-21T12:16:51.747 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:51.745+0000 7f1380a47640 1 --2- 172.21.15.3:0/606831135 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f136406e2b0 0x7f1364070770 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:51.747 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:51.745+0000 7f1380a47640 1 --2- 172.21.15.3:0/606831135 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f137c104d80 0x7f137c199c30 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:51.747 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:51.745+0000 7f1380a47640 1 --2- 172.21.15.3:0/606831135 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f137c102450 0x7f137c1996f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:51.747 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:51.745+0000 7f1380a47640 1 -- 172.21.15.3:0/606831135 >> 172.21.15.3:0/606831135 conn(0x7f137c0fc010 msgr2=0x7f137c101a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:16:51.747 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:51.745+0000 7f1380a47640 1 -- 172.21.15.3:0/606831135 shutdown_connections 2024-09-21T12:16:51.747 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:51.745+0000 7f1380a47640 1 -- 172.21.15.3:0/606831135 wait complete. 2024-09-21T12:16:51.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:51 smithi192 ceph-mon[35641]: osdmap e40: 6 total, 6 up, 6 in 2024-09-21T12:16:52.417 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:52 smithi003 ceph-mon[28057]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:16:52.418 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:52 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/606831135' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-21T12:16:52.451 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":40,"num_osds":6,"num_up_osds":6,"osd_up_since":1726921009,"num_in_osds":6,"osd_in_since":1726920985,"num_remapped_pgs":0} 2024-09-21T12:16:52.451 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph osd dump --format=json 2024-09-21T12:16:52.715 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:16:52.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:52 smithi192 ceph-mon[35641]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:16:52.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:52 smithi192 ceph-mon[35641]: from='client.? 172.21.15.3:0/606831135' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-21T12:16:53.350 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:53.290+0000 7efcbf506640 1 -- 172.21.15.3:0/3264564088 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efcb81033e0 msgr2=0x7efcb810b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:53.351 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:53.290+0000 7efcbf506640 1 --2- 172.21.15.3:0/3264564088 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efcb81033e0 0x7efcb810b8d0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7efca8009880 tx=0x7efca802a530 comp rx=0 tx=0).stop 2024-09-21T12:16:53.351 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:53.290+0000 7efcbf506640 1 -- 172.21.15.3:0/3264564088 shutdown_connections 2024-09-21T12:16:53.351 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:53.290+0000 7efcbf506640 1 --2- 172.21.15.3:0/3264564088 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efcb81033e0 0x7efcb810b8d0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:53.351 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:53.290+0000 7efcbf506640 1 --2- 172.21.15.3:0/3264564088 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efcb8102ac0 0x7efcb8102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:53.351 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:53.290+0000 7efcbf506640 1 -- 172.21.15.3:0/3264564088 >> 172.21.15.3:0/3264564088 conn(0x7efcb80fc520 msgr2=0x7efcb80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:16:53.351 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:53.290+0000 7efcbf506640 1 -- 172.21.15.3:0/3264564088 shutdown_connections 2024-09-21T12:16:53.351 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:53.290+0000 7efcbf506640 1 -- 172.21.15.3:0/3264564088 wait complete. 2024-09-21T12:16:53.351 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:53.290+0000 7efcbf506640 1 Processor -- start 2024-09-21T12:16:53.351 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:53.291+0000 7efcbf506640 1 -- start start 2024-09-21T12:16:53.351 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:53.291+0000 7efcbf506640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efcb8102ac0 0x7efcb819d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:16:53.351 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:53.291+0000 7efcbf506640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efcb81033e0 0x7efcb819dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:16:53.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:53.291+0000 7efcbf506640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7efcb810edf0 con 0x7efcb81033e0 2024-09-21T12:16:53.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:53.291+0000 7efcbf506640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7efcb810ec70 con 0x7efcb8102ac0 2024-09-21T12:16:53.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:53.291+0000 7efcbcaa1640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efcb81033e0 0x7efcb819dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:16:53.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:53.291+0000 7efcbcaa1640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efcb81033e0 0x7efcb819dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56678/0 (socket says 172.21.15.3:56678) 2024-09-21T12:16:53.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:53.291+0000 7efcbcaa1640 1 -- 172.21.15.3:0/2733228808 learned_addr learned my addr 172.21.15.3:0/2733228808 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:16:53.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:53.291+0000 7efcbd2a2640 1 --2- 172.21.15.3:0/2733228808 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efcb8102ac0 0x7efcb819d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:16:53.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:53.291+0000 7efcbcaa1640 1 -- 172.21.15.3:0/2733228808 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efcb8102ac0 msgr2=0x7efcb819d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:53.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:53.291+0000 7efcbcaa1640 1 --2- 172.21.15.3:0/2733228808 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efcb8102ac0 0x7efcb819d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:53.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:53.291+0000 7efcbcaa1640 1 -- 172.21.15.3:0/2733228808 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcb8197800 con 0x7efcb81033e0 2024-09-21T12:16:53.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:53.291+0000 7efcbcaa1640 1 --2- 172.21.15.3:0/2733228808 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efcb81033e0 0x7efcb819dbc0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7efca8031460 tx=0x7efca8004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:16:53.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:53.291+0000 7efcae7fc640 1 -- 172.21.15.3:0/2733228808 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efca803f070 con 0x7efcb81033e0 2024-09-21T12:16:53.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:53.291+0000 7efcae7fc640 1 -- 172.21.15.3:0/2733228808 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7efca80035f0 con 0x7efcb81033e0 2024-09-21T12:16:53.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:53.292+0000 7efcae7fc640 1 -- 172.21.15.3:0/2733228808 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7efca8035030 con 0x7efcb81033e0 2024-09-21T12:16:53.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:53.292+0000 7efcbf506640 1 -- 172.21.15.3:0/2733228808 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcb8197a90 con 0x7efcb81033e0 2024-09-21T12:16:53.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:53.292+0000 7efcbf506640 1 -- 172.21.15.3:0/2733228808 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcb8197fc0 con 0x7efcb81033e0 2024-09-21T12:16:53.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:53.293+0000 7efcbf506640 1 -- 172.21.15.3:0/2733228808 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcb806aa90 con 0x7efcb81033e0 2024-09-21T12:16:53.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:53.293+0000 7efcae7fc640 1 -- 172.21.15.3:0/2733228808 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 19) ==== 92549+0+0 (secure 0 0 0) 0x7efca8042070 con 0x7efcb81033e0 2024-09-21T12:16:53.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:53.294+0000 7efcae7fc640 1 --2- 172.21.15.3:0/2733228808 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7efca406e310 0x7efca40707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:16:53.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:53.294+0000 7efcbd2a2640 1 --2- 172.21.15.3:0/2733228808 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7efca406e310 0x7efca40707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:16:53.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:53.294+0000 7efcae7fc640 1 -- 172.21.15.3:0/2733228808 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7efca80ae6e0 con 0x7efcb81033e0 2024-09-21T12:16:53.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:53.294+0000 7efcbd2a2640 1 --2- 172.21.15.3:0/2733228808 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7efca406e310 0x7efca40707d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7efcb4005fd0 tx=0x7efcb4005850 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:16:53.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:53.298+0000 7efcae7fc640 1 -- 172.21.15.3:0/2733228808 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7efca807c400 con 0x7efcb81033e0 2024-09-21T12:16:53.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:53.475+0000 7efcbf506640 1 -- 172.21.15.3:0/2733228808 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efcb8198d30 con 0x7efcb81033e0 2024-09-21T12:16:53.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:53.476+0000 7efcae7fc640 1 -- 172.21.15.3:0/2733228808 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+11339 (secure 0 0 0) 0x7efca80800b0 con 0x7efcb81033e0 2024-09-21T12:16:53.477 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:16:53.478 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":40,"fsid":"641beec0-7812-11ef-baf6-efdc52797490","created":"2024-09-21T12:10:46.520078+0000","modified":"2024-09-21T12:16:50.313605+0000","last_up_change":"2024-09-21T12:16:49.136035+0000","last_in_change":"2024-09-21T12:16:25.609767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T12:15:29.009114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d992d4d6-4292-4a47-9556-262dc7915d07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":974168994},{"type":"v1","addr":"172.21.15.3:6803","nonce":974168994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":974168994},{"type":"v1","addr":"172.21.15.3:6805","nonce":974168994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":974168994},{"type":"v1","addr":"172.21.15.3:6809","nonce":974168994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":974168994},{"type":"v1","addr":"172.21.15.3:6807","nonce":974168994}]},"public_addr":"172.21.15.3:6803/974168994","cluster_addr":"172.21.15.3:6805/974168994","heartbeat_back_addr":"172.21.15.3:6809/974168994","heartbeat_front_addr":"172.21.15.3:6807/974168994","state":["exists","up"]},{"osd":1,"uuid":"e3a36979-b369-43c8-867e-d7c96c00ec5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":3334119815},{"type":"v1","addr":"172.21.15.3:6811","nonce":3334119815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":3334119815},{"type":"v1","addr":"172.21.15.3:6813","nonce":3334119815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":3334119815},{"type":"v1","addr":"172.21.15.3:6817","nonce":3334119815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":3334119815},{"type":"v1","addr":"172.21.15.3:6815","nonce":3334119815}]},"public_addr":"172.21.15.3:6811/3334119815","cluster_addr":"172.21.15.3:6813/3334119815","heartbeat_back_addr":"172.21.15.3:6817/3334119815","heartbeat_front_addr":"172.21.15.3:6815/3334119815","state":["exists","up"]},{"osd":2,"uuid":"1ba0899a-76f5-415f-b0d6-09df23128032","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":1433580301},{"type":"v1","addr":"172.21.15.3:6819","nonce":1433580301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":1433580301},{"type":"v1","addr":"172.21.15.3:6821","nonce":1433580301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":1433580301},{"type":"v1","addr":"172.21.15.3:6825","nonce":1433580301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":1433580301},{"type":"v1","addr":"172.21.15.3:6823","nonce":1433580301}]},"public_addr":"172.21.15.3:6819/1433580301","cluster_addr":"172.21.15.3:6821/1433580301","heartbeat_back_addr":"172.21.15.3:6825/1433580301","heartbeat_front_addr":"172.21.15.3:6823/1433580301","state":["exists","up"]},{"osd":3,"uuid":"dfb038d6-4ca3-4f2b-b8ab-c0f0a1ca353f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2737855393},{"type":"v1","addr":"172.21.15.192:6801","nonce":2737855393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2737855393},{"type":"v1","addr":"172.21.15.192:6803","nonce":2737855393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2737855393},{"type":"v1","addr":"172.21.15.192:6807","nonce":2737855393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2737855393},{"type":"v1","addr":"172.21.15.192:6805","nonce":2737855393}]},"public_addr":"172.21.15.192:6801/2737855393","cluster_addr":"172.21.15.192:6803/2737855393","heartbeat_back_addr":"172.21.15.192:6807/2737855393","heartbeat_front_addr":"172.21.15.192:6805/2737855393","state":["exists","up"]},{"osd":4,"uuid":"b612cc2a-e417-481d-93fd-f527865f19be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1341504680},{"type":"v1","addr":"172.21.15.192:6809","nonce":1341504680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1341504680},{"type":"v1","addr":"172.21.15.192:6811","nonce":1341504680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1341504680},{"type":"v1","addr":"172.21.15.192:6815","nonce":1341504680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1341504680},{"type":"v1","addr":"172.21.15.192:6813","nonce":1341504680}]},"public_addr":"172.21.15.192:6809/1341504680","cluster_addr":"172.21.15.192:6811/1341504680","heartbeat_back_addr":"172.21.15.192:6815/1341504680","heartbeat_front_addr":"172.21.15.192:6813/1341504680","state":["exists","up"]},{"osd":5,"uuid":"667455e4-320f-4f4e-8277-6941f9164fd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1770474426},{"type":"v1","addr":"172.21.15.192:6817","nonce":1770474426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1770474426},{"type":"v1","addr":"172.21.15.192:6819","nonce":1770474426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1770474426},{"type":"v1","addr":"172.21.15.192:6823","nonce":1770474426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1770474426},{"type":"v1","addr":"172.21.15.192:6821","nonce":1770474426}]},"public_addr":"172.21.15.192:6817/1770474426","cluster_addr":"172.21.15.192:6819/1770474426","heartbeat_back_addr":"172.21.15.192:6823/1770474426","heartbeat_front_addr":"172.21.15.192:6821/1770474426","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T12:14:24.179679+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T12:14:56.023373+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T12:15:25.786760+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T12:15:52.402341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T12:16:19.828125+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T12:16:47.859739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.3:0/942012167":"2024-09-22T12:11:18.903614+0000","172.21.15.3:0/2241193596":"2024-09-22T12:12:46.501201+0000","172.21.15.3:0/533261896":"2024-09-22T12:11:18.903614+0000","172.21.15.3:6801/3011223684":"2024-09-22T12:12:46.501201+0000","172.21.15.3:0/814089744":"2024-09-22T12:11:50.998065+0000","172.21.15.3:0/4271646487":"2024-09-22T12:11:50.998065+0000","172.21.15.3:0/299469671":"2024-09-22T12:11:18.903614+0000","172.21.15.3:6801/2568399820":"2024-09-22T12:11:18.903614+0000","172.21.15.3:6800/2568399820":"2024-09-22T12:11:18.903614+0000","172.21.15.3:6800/3011223684":"2024-09-22T12:12:46.501201+0000","172.21.15.3:6800/219393181":"2024-09-22T12:11:50.998065+0000","172.21.15.3:0/897407664":"2024-09-22T12:11:50.998065+0000","172.21.15.3:6801/219393181":"2024-09-22T12:11:50.998065+0000","172.21.15.3:0/4128411278":"2024-09-22T12:12:46.501201+0000","172.21.15.3:0/1985406757":"2024-09-22T12:12:46.501201+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T12:16:53.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:53.478+0000 7efcbf506640 1 -- 172.21.15.3:0/2733228808 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7efca406e310 msgr2=0x7efca40707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:53.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:53.478+0000 7efcbf506640 1 --2- 172.21.15.3:0/2733228808 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7efca406e310 0x7efca40707d0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7efcb4005fd0 tx=0x7efcb4005850 comp rx=0 tx=0).stop 2024-09-21T12:16:53.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:53.478+0000 7efcbf506640 1 -- 172.21.15.3:0/2733228808 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efcb81033e0 msgr2=0x7efcb819dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:53.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:53.478+0000 7efcbf506640 1 --2- 172.21.15.3:0/2733228808 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efcb81033e0 0x7efcb819dbc0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7efca8031460 tx=0x7efca8004530 comp rx=0 tx=0).stop 2024-09-21T12:16:53.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:53.478+0000 7efcbf506640 1 -- 172.21.15.3:0/2733228808 shutdown_connections 2024-09-21T12:16:53.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:53.478+0000 7efcbf506640 1 --2- 172.21.15.3:0/2733228808 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7efca406e310 0x7efca40707d0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:53.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:53.478+0000 7efcbf506640 1 --2- 172.21.15.3:0/2733228808 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7efcb81033e0 0x7efcb819dbc0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:53.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:53.478+0000 7efcbf506640 1 --2- 172.21.15.3:0/2733228808 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7efcb8102ac0 0x7efcb819d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:53.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:53.478+0000 7efcbf506640 1 -- 172.21.15.3:0/2733228808 >> 172.21.15.3:0/2733228808 conn(0x7efcb80fc520 msgr2=0x7efcb8108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:16:53.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:53.478+0000 7efcbf506640 1 -- 172.21.15.3:0/2733228808 shutdown_connections 2024-09-21T12:16:53.481 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:53.479+0000 7efcbf506640 1 -- 172.21.15.3:0/2733228808 wait complete. 2024-09-21T12:16:54.160 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-21T12:15:29.009114+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-21T12:16:54.160 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph osd pool get .mgr pg_num 2024-09-21T12:16:54.418 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:16:54.540 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:54 smithi003 ceph-mon[28057]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:16:54.540 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:54 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/2733228808' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-21T12:16:54.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:54 smithi192 ceph-mon[35641]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:16:54.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:54 smithi192 ceph-mon[35641]: from='client.? 172.21.15.3:0/2733228808' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-21T12:16:54.925 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:54.889+0000 7f6e6f303640 1 -- 172.21.15.3:0/2030308882 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6e68102b50 msgr2=0x7f6e68102f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:54.925 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:54.889+0000 7f6e6f303640 1 --2- 172.21.15.3:0/2030308882 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6e68102b50 0x7f6e68102f30 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f6e58009c20 tx=0x7f6e5802aa00 comp rx=0 tx=0).stop 2024-09-21T12:16:54.925 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:54.890+0000 7f6e6f303640 1 -- 172.21.15.3:0/2030308882 shutdown_connections 2024-09-21T12:16:54.925 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:54.890+0000 7f6e6f303640 1 --2- 172.21.15.3:0/2030308882 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e68103470 0x7f6e6810b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:54.925 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:54.890+0000 7f6e6f303640 1 --2- 172.21.15.3:0/2030308882 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6e68102b50 0x7f6e68102f30 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:54.926 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:54.890+0000 7f6e6f303640 1 -- 172.21.15.3:0/2030308882 >> 172.21.15.3:0/2030308882 conn(0x7f6e680fc550 msgr2=0x7f6e680fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:16:54.926 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:54.890+0000 7f6e6f303640 1 -- 172.21.15.3:0/2030308882 shutdown_connections 2024-09-21T12:16:54.926 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:54.890+0000 7f6e6f303640 1 -- 172.21.15.3:0/2030308882 wait complete. 2024-09-21T12:16:54.926 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:54.890+0000 7f6e6f303640 1 Processor -- start 2024-09-21T12:16:54.926 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:54.890+0000 7f6e6f303640 1 -- start start 2024-09-21T12:16:54.926 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:54.890+0000 7f6e6f303640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e68102b50 0x7f6e6819f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:16:54.926 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:54.891+0000 7f6e6f303640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6e68103470 0x7f6e6819fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:16:54.926 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:54.891+0000 7f6e6f303640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f6e6810edc0 con 0x7f6e68103470 2024-09-21T12:16:54.926 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:54.891+0000 7f6e6f303640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6e6810ec40 con 0x7f6e68102b50 2024-09-21T12:16:54.926 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:54.891+0000 7f6e6c89e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6e68103470 0x7f6e6819fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:16:54.926 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:54.891+0000 7f6e6c89e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6e68103470 0x7f6e6819fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56698/0 (socket says 172.21.15.3:56698) 2024-09-21T12:16:54.926 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:54.891+0000 7f6e6c89e640 1 -- 172.21.15.3:0/3066256732 learned_addr learned my addr 172.21.15.3:0/3066256732 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:16:54.927 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:54.891+0000 7f6e6d09f640 1 --2- 172.21.15.3:0/3066256732 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e68102b50 0x7f6e6819f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:16:54.927 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:54.891+0000 7f6e6c89e640 1 -- 172.21.15.3:0/3066256732 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e68102b50 msgr2=0x7f6e6819f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:54.927 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:54.891+0000 7f6e6c89e640 1 --2- 172.21.15.3:0/3066256732 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e68102b50 0x7f6e6819f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:54.927 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:54.891+0000 7f6e6c89e640 1 -- 172.21.15.3:0/3066256732 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e681999a0 con 0x7f6e68103470 2024-09-21T12:16:54.927 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:54.891+0000 7f6e6c89e640 1 --2- 172.21.15.3:0/3066256732 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6e68103470 0x7f6e6819fd20 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c00c810 tx=0x7f6e5c00ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:16:54.927 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:54.891+0000 7f6e667fc640 1 -- 172.21.15.3:0/3066256732 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6e5c004020 con 0x7f6e68103470 2024-09-21T12:16:54.927 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:54.891+0000 7f6e667fc640 1 -- 172.21.15.3:0/3066256732 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6e5c0041c0 con 0x7f6e68103470 2024-09-21T12:16:54.927 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:54.891+0000 7f6e6f303640 1 -- 172.21.15.3:0/3066256732 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e68199c90 con 0x7f6e68103470 2024-09-21T12:16:54.927 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:54.891+0000 7f6e667fc640 1 -- 172.21.15.3:0/3066256732 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6e5c0047a0 con 0x7f6e68103470 2024-09-21T12:16:54.927 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:54.891+0000 7f6e6f303640 1 -- 172.21.15.3:0/3066256732 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e6819a220 con 0x7f6e68103470 2024-09-21T12:16:54.927 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:54.892+0000 7f6e6f303640 1 -- 172.21.15.3:0/3066256732 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e6806a4e0 con 0x7f6e68103470 2024-09-21T12:16:54.927 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:54.893+0000 7f6e667fc640 1 -- 172.21.15.3:0/3066256732 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 19) ==== 92549+0+0 (secure 0 0 0) 0x7f6e5c0079b0 con 0x7f6e68103470 2024-09-21T12:16:54.927 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:54.893+0000 7f6e667fc640 1 --2- 172.21.15.3:0/3066256732 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f6e5006e2b0 0x7f6e50070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:16:54.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:54.893+0000 7f6e667fc640 1 -- 172.21.15.3:0/3066256732 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7f6e5c08dc60 con 0x7f6e68103470 2024-09-21T12:16:54.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:54.893+0000 7f6e6d09f640 1 --2- 172.21.15.3:0/3066256732 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f6e5006e2b0 0x7f6e50070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:16:54.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:54.894+0000 7f6e6d09f640 1 --2- 172.21.15.3:0/3066256732 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f6e5006e2b0 0x7f6e50070770 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6e58009430 tx=0x7f6e5803a040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:16:54.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:54.898+0000 7f6e667fc640 1 -- 172.21.15.3:0/3066256732 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6e5c014030 con 0x7f6e68103470 2024-09-21T12:16:55.076 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:55.075+0000 7f6e6f303640 1 -- 172.21.15.3:0/3066256732 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f6e6819aed0 con 0x7f6e68103470 2024-09-21T12:16:55.077 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:55.075+0000 7f6e667fc640 1 -- 172.21.15.3:0/3066256732 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) ==== 93+0+10 (secure 0 0 0) 0x7f6e5c055e20 con 0x7f6e68103470 2024-09-21T12:16:55.077 INFO:teuthology.orchestra.run.smithi003.stdout:pg_num: 1 2024-09-21T12:16:55.079 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:55.077+0000 7f6e6f303640 1 -- 172.21.15.3:0/3066256732 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f6e5006e2b0 msgr2=0x7f6e50070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:55.079 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:55.077+0000 7f6e6f303640 1 --2- 172.21.15.3:0/3066256732 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f6e5006e2b0 0x7f6e50070770 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6e58009430 tx=0x7f6e5803a040 comp rx=0 tx=0).stop 2024-09-21T12:16:55.079 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:55.077+0000 7f6e6f303640 1 -- 172.21.15.3:0/3066256732 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6e68103470 msgr2=0x7f6e6819fd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:55.079 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:55.077+0000 7f6e6f303640 1 --2- 172.21.15.3:0/3066256732 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6e68103470 0x7f6e6819fd20 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f6e5c00c810 tx=0x7f6e5c00ccd0 comp rx=0 tx=0).stop 2024-09-21T12:16:55.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:55.078+0000 7f6e6f303640 1 -- 172.21.15.3:0/3066256732 shutdown_connections 2024-09-21T12:16:55.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:55.078+0000 7f6e6f303640 1 --2- 172.21.15.3:0/3066256732 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f6e5006e2b0 0x7f6e50070770 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:55.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:55.078+0000 7f6e6f303640 1 --2- 172.21.15.3:0/3066256732 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6e68103470 0x7f6e6819fd20 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:55.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:55.078+0000 7f6e6f303640 1 --2- 172.21.15.3:0/3066256732 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6e68102b50 0x7f6e6819f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:55.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:55.078+0000 7f6e6f303640 1 -- 172.21.15.3:0/3066256732 >> 172.21.15.3:0/3066256732 conn(0x7f6e680fc550 msgr2=0x7f6e68100be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:16:55.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:55.078+0000 7f6e6f303640 1 -- 172.21.15.3:0/3066256732 shutdown_connections 2024-09-21T12:16:55.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:55.078+0000 7f6e6f303640 1 -- 172.21.15.3:0/3066256732 wait complete. 2024-09-21T12:16:55.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:55 smithi192 ceph-mon[35641]: from='client.? 172.21.15.3:0/3066256732' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-21T12:16:55.821 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:55 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/3066256732' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-21T12:16:55.854 INFO:tasks.cephadm:Setting up client nodes... 2024-09-21T12:16:55.854 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-21T12:16:56.115 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:16:56.558 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:56 smithi003 ceph-mon[28057]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:16:56.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:56.564+0000 7f8758878640 1 -- 172.21.15.3:0/253296865 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8754104dc0 msgr2=0x7f87541071b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:56.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:56.564+0000 7f8758878640 1 --2- 172.21.15.3:0/253296865 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8754104dc0 0x7f87541071b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f8748009880 tx=0x7f874802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:16:56.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:56.564+0000 7f8758878640 1 -- 172.21.15.3:0/253296865 shutdown_connections 2024-09-21T12:16:56.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:56.564+0000 7f8758878640 1 --2- 172.21.15.3:0/253296865 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8754104dc0 0x7f87541071b0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:56.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:56.564+0000 7f8758878640 1 --2- 172.21.15.3:0/253296865 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8754102490 0x7f8754104880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:56.566 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:56.564+0000 7f8758878640 1 -- 172.21.15.3:0/253296865 >> 172.21.15.3:0/253296865 conn(0x7f87540fc010 msgr2=0x7f87540fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:16:56.567 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:56.564+0000 7f8758878640 1 -- 172.21.15.3:0/253296865 shutdown_connections 2024-09-21T12:16:56.567 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:56.564+0000 7f8758878640 1 -- 172.21.15.3:0/253296865 wait complete. 2024-09-21T12:16:56.568 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:56.565+0000 7f8758878640 1 Processor -- start 2024-09-21T12:16:56.568 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:56.565+0000 7f8758878640 1 -- start start 2024-09-21T12:16:56.568 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:56.565+0000 7f8758878640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8754102490 0x7f8754197520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:16:56.568 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:56.565+0000 7f8758878640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8754104dc0 0x7f8754197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:16:56.568 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:56.565+0000 7f8758878640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f875410a7a0 con 0x7f8754104dc0 2024-09-21T12:16:56.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:56.565+0000 7f8758878640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f875410a620 con 0x7f8754102490 2024-09-21T12:16:56.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:56.566+0000 7f8751d9b640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8754104dc0 0x7f8754197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:16:56.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:56.566+0000 7f8751d9b640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8754104dc0 0x7f8754197a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56714/0 (socket says 172.21.15.3:56714) 2024-09-21T12:16:56.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:56.566+0000 7f8751d9b640 1 -- 172.21.15.3:0/3197321702 learned_addr learned my addr 172.21.15.3:0/3197321702 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:16:56.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:56.566+0000 7f875259c640 1 --2- 172.21.15.3:0/3197321702 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8754102490 0x7f8754197520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:16:56.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:56.566+0000 7f8751d9b640 1 -- 172.21.15.3:0/3197321702 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8754102490 msgr2=0x7f8754197520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:56.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:56.566+0000 7f8751d9b640 1 --2- 172.21.15.3:0/3197321702 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8754102490 0x7f8754197520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:56.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:56.566+0000 7f8751d9b640 1 -- 172.21.15.3:0/3197321702 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87541980e0 con 0x7f8754104dc0 2024-09-21T12:16:56.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:56.566+0000 7f8751d9b640 1 --2- 172.21.15.3:0/3197321702 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8754104dc0 0x7f8754197a60 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8748006010 tx=0x7f87480045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:16:56.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:56.566+0000 7f87437fe640 1 -- 172.21.15.3:0/3197321702 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f874803f070 con 0x7f8754104dc0 2024-09-21T12:16:56.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:56.566+0000 7f8758878640 1 -- 172.21.15.3:0/3197321702 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f875419cac0 con 0x7f8754104dc0 2024-09-21T12:16:56.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:56.566+0000 7f87437fe640 1 -- 172.21.15.3:0/3197321702 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8748004a50 con 0x7f8754104dc0 2024-09-21T12:16:56.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:56.566+0000 7f87437fe640 1 -- 172.21.15.3:0/3197321702 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8748035030 con 0x7f8754104dc0 2024-09-21T12:16:56.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:56.566+0000 7f8758878640 1 -- 172.21.15.3:0/3197321702 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f875419d050 con 0x7f8754104dc0 2024-09-21T12:16:56.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:56.568+0000 7f8758878640 1 -- 172.21.15.3:0/3197321702 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8754102870 con 0x7f8754104dc0 2024-09-21T12:16:56.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:56.568+0000 7f87437fe640 1 -- 172.21.15.3:0/3197321702 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 19) ==== 92549+0+0 (secure 0 0 0) 0x7f8748042070 con 0x7f8754104dc0 2024-09-21T12:16:56.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:56.569+0000 7f87437fe640 1 --2- 172.21.15.3:0/3197321702 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f873c06e2b0 0x7f873c070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:16:56.571 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:56.569+0000 7f87437fe640 1 -- 172.21.15.3:0/3197321702 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7f87480ae970 con 0x7f8754104dc0 2024-09-21T12:16:56.571 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:56.569+0000 7f875259c640 1 --2- 172.21.15.3:0/3197321702 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f873c06e2b0 0x7f873c070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:16:56.571 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:56.569+0000 7f875259c640 1 --2- 172.21.15.3:0/3197321702 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f873c06e2b0 0x7f873c070770 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8744005fd0 tx=0x7f874400b390 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:16:56.575 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:56.573+0000 7f87437fe640 1 -- 172.21.15.3:0/3197321702 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f87480b0e20 con 0x7f8754104dc0 2024-09-21T12:16:56.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:56 smithi192 ceph-mon[35641]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:16:56.817 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:56.815+0000 7f8758878640 1 -- 172.21.15.3:0/3197321702 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f875419d900 con 0x7f8754104dc0 2024-09-21T12:16:56.819 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:56.818+0000 7f87437fe640 1 -- 172.21.15.3:0/3197321702 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v16) ==== 170+0+59 (secure 0 0 0) 0x7f8748004c00 con 0x7f8754104dc0 2024-09-21T12:16:56.819 INFO:teuthology.orchestra.run.smithi003.stdout:[client.0] 2024-09-21T12:16:56.819 INFO:teuthology.orchestra.run.smithi003.stdout: key = AQA4ue5mXFy0MBAAle5dHOvKTm6M6M8GFnyCiA== 2024-09-21T12:16:56.822 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:56.820+0000 7f8758878640 1 -- 172.21.15.3:0/3197321702 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f873c06e2b0 msgr2=0x7f873c070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:56.822 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:56.820+0000 7f8758878640 1 --2- 172.21.15.3:0/3197321702 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f873c06e2b0 0x7f873c070770 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8744005fd0 tx=0x7f874400b390 comp rx=0 tx=0).stop 2024-09-21T12:16:56.822 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:56.820+0000 7f8758878640 1 -- 172.21.15.3:0/3197321702 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8754104dc0 msgr2=0x7f8754197a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:56.822 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:56.820+0000 7f8758878640 1 --2- 172.21.15.3:0/3197321702 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8754104dc0 0x7f8754197a60 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f8748006010 tx=0x7f87480045e0 comp rx=0 tx=0).stop 2024-09-21T12:16:56.822 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:56.820+0000 7f8758878640 1 -- 172.21.15.3:0/3197321702 shutdown_connections 2024-09-21T12:16:56.822 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:56.820+0000 7f8758878640 1 --2- 172.21.15.3:0/3197321702 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f873c06e2b0 0x7f873c070770 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:56.822 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:56.820+0000 7f8758878640 1 --2- 172.21.15.3:0/3197321702 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8754104dc0 0x7f8754197a60 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:56.822 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:56.820+0000 7f8758878640 1 --2- 172.21.15.3:0/3197321702 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8754102490 0x7f8754197520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:56.822 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:56.820+0000 7f8758878640 1 -- 172.21.15.3:0/3197321702 >> 172.21.15.3:0/3197321702 conn(0x7f87540fc010 msgr2=0x7f87540fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:16:56.822 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:56.820+0000 7f8758878640 1 -- 172.21.15.3:0/3197321702 shutdown_connections 2024-09-21T12:16:56.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:16:56.820+0000 7f8758878640 1 -- 172.21.15.3:0/3197321702 wait complete. 2024-09-21T12:16:57.561 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:57 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/3197321702' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-21T12:16:57.562 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:57 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/3197321702' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T12:16:57.590 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-09-21T12:16:57.591 DEBUG:teuthology.orchestra.run.smithi003:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-21T12:16:57.591 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-21T12:16:57.629 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-21T12:16:57.658 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:57 smithi192 ceph-mon[35641]: from='client.? 172.21.15.3:0/3197321702' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-21T12:16:57.658 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:57 smithi192 ceph-mon[35641]: from='client.? 172.21.15.3:0/3197321702' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T12:16:57.890 INFO:teuthology.orchestra.run.smithi192.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi192/config 2024-09-21T12:16:58.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:58.353+0000 7fa10ffbd640 1 -- 172.21.15.192:0/694069415 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa108101a30 msgr2=0x7fa108101eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:58.356 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:58.353+0000 7fa10ffbd640 1 --2- 172.21.15.192:0/694069415 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa108101a30 0x7fa108101eb0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa0f8009880 tx=0x7fa0f802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:16:58.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:58.353+0000 7fa10ffbd640 1 -- 172.21.15.192:0/694069415 shutdown_connections 2024-09-21T12:16:58.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:58.353+0000 7fa10ffbd640 1 --2- 172.21.15.192:0/694069415 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa108101a30 0x7fa108101eb0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:58.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:58.353+0000 7fa10ffbd640 1 --2- 172.21.15.192:0/694069415 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa108100830 0x7fa108100c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:58.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:58.353+0000 7fa10ffbd640 1 -- 172.21.15.192:0/694069415 >> 172.21.15.192:0/694069415 conn(0x7fa1080fbfa0 msgr2=0x7fa1080fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:16:58.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:58.353+0000 7fa10ffbd640 1 -- 172.21.15.192:0/694069415 shutdown_connections 2024-09-21T12:16:58.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:58.353+0000 7fa10ffbd640 1 -- 172.21.15.192:0/694069415 wait complete. 2024-09-21T12:16:58.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:58.354+0000 7fa10ffbd640 1 Processor -- start 2024-09-21T12:16:58.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:58.354+0000 7fa10ffbd640 1 -- start start 2024-09-21T12:16:58.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:58.354+0000 7fa10ffbd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa108100830 0x7fa1081046e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:16:58.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:58.354+0000 7fa10ffbd640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa108101a30 0x7fa108102e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:16:58.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:58.354+0000 7fa10ffbd640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fa108109670 con 0x7fa108100830 2024-09-21T12:16:58.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:58.354+0000 7fa10ffbd640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa1081094f0 con 0x7fa108101a30 2024-09-21T12:16:58.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:58.354+0000 7fa10d558640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa108101a30 0x7fa108102e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:16:58.357 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:58.354+0000 7fa10d558640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa108101a30 0x7fa108102e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.192:48500/0 (socket says 172.21.15.192:48500) 2024-09-21T12:16:58.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:58.354+0000 7fa10d558640 1 -- 172.21.15.192:0/266124858 learned_addr learned my addr 172.21.15.192:0/266124858 (peer_addr_for_me v2:172.21.15.192:0/0) 2024-09-21T12:16:58.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:58.354+0000 7fa10dd59640 1 --2- 172.21.15.192:0/266124858 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa108100830 0x7fa1081046e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:16:58.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:58.354+0000 7fa10d558640 1 -- 172.21.15.192:0/266124858 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa108100830 msgr2=0x7fa1081046e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:58.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:58.354+0000 7fa10d558640 1 --2- 172.21.15.192:0/266124858 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa108100830 0x7fa1081046e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:58.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:58.354+0000 7fa10d558640 1 -- 172.21.15.192:0/266124858 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa108103350 con 0x7fa108101a30 2024-09-21T12:16:58.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:58.354+0000 7fa10dd59640 1 --2- 172.21.15.192:0/266124858 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa108100830 0x7fa1081046e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T12:16:58.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:58.355+0000 7fa10d558640 1 --2- 172.21.15.192:0/266124858 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa108101a30 0x7fa108102e10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa0f8006010 tx=0x7fa0f80048f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:16:58.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:58.355+0000 7fa0feffd640 1 -- 172.21.15.192:0/266124858 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa0f803f070 con 0x7fa108101a30 2024-09-21T12:16:58.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:58.355+0000 7fa0feffd640 1 -- 172.21.15.192:0/266124858 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa0f80044d0 con 0x7fa108101a30 2024-09-21T12:16:58.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:58.355+0000 7fa0feffd640 1 -- 172.21.15.192:0/266124858 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa0f8035030 con 0x7fa108101a30 2024-09-21T12:16:58.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:58.355+0000 7fa10ffbd640 1 -- 172.21.15.192:0/266124858 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1081035e0 con 0x7fa108101a30 2024-09-21T12:16:58.358 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:58.355+0000 7fa10ffbd640 1 -- 172.21.15.192:0/266124858 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa108103b10 con 0x7fa108101a30 2024-09-21T12:16:58.359 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:58.356+0000 7fa10ffbd640 1 -- 172.21.15.192:0/266124858 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa108109e50 con 0x7fa108101a30 2024-09-21T12:16:58.359 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:58.356+0000 7fa0feffd640 1 -- 172.21.15.192:0/266124858 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 19) ==== 92549+0+0 (secure 0 0 0) 0x7fa0f8042070 con 0x7fa108101a30 2024-09-21T12:16:58.359 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:58.357+0000 7fa0feffd640 1 --2- 172.21.15.192:0/266124858 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fa0f406e2b0 0x7fa0f4070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:16:58.359 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:58.357+0000 7fa0feffd640 1 -- 172.21.15.192:0/266124858 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7fa0f80aeb80 con 0x7fa108101a30 2024-09-21T12:16:58.359 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:58.357+0000 7fa10dd59640 1 --2- 172.21.15.192:0/266124858 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fa0f406e2b0 0x7fa0f4070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:16:58.359 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:58.357+0000 7fa10dd59640 1 --2- 172.21.15.192:0/266124858 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fa0f406e2b0 0x7fa0f4070770 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa1040058c0 tx=0x7fa104005d50 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:16:58.362 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:58.361+0000 7fa0feffd640 1 -- 172.21.15.192:0/266124858 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa0f807c820 con 0x7fa108101a30 2024-09-21T12:16:58.590 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:58.588+0000 7fa10ffbd640 1 -- 172.21.15.192:0/266124858 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7fa10819fa30 con 0x7fa108101a30 2024-09-21T12:16:58.590 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:58 smithi192 ceph-mon[35641]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:16:58.594 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:58.593+0000 7fa0feffd640 1 -- 172.21.15.192:0/266124858 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v17) ==== 170+0+59 (secure 0 0 0) 0x7fa0f80804d0 con 0x7fa108101a30 2024-09-21T12:16:58.595 INFO:teuthology.orchestra.run.smithi192.stdout:[client.1] 2024-09-21T12:16:58.595 INFO:teuthology.orchestra.run.smithi192.stdout: key = AQA6ue5mU3ouIxAAvDeBwaHVJtfZQL9WaKw0wg== 2024-09-21T12:16:58.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:58.595+0000 7fa10ffbd640 1 -- 172.21.15.192:0/266124858 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fa0f406e2b0 msgr2=0x7fa0f4070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:58.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:58.595+0000 7fa10ffbd640 1 --2- 172.21.15.192:0/266124858 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fa0f406e2b0 0x7fa0f4070770 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fa1040058c0 tx=0x7fa104005d50 comp rx=0 tx=0).stop 2024-09-21T12:16:58.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:58.595+0000 7fa10ffbd640 1 -- 172.21.15.192:0/266124858 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa108101a30 msgr2=0x7fa108102e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:16:58.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:58.595+0000 7fa10ffbd640 1 --2- 172.21.15.192:0/266124858 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa108101a30 0x7fa108102e10 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fa0f8006010 tx=0x7fa0f80048f0 comp rx=0 tx=0).stop 2024-09-21T12:16:58.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:58.595+0000 7fa10ffbd640 1 -- 172.21.15.192:0/266124858 shutdown_connections 2024-09-21T12:16:58.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:58.595+0000 7fa10ffbd640 1 --2- 172.21.15.192:0/266124858 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fa0f406e2b0 0x7fa0f4070770 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:58.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:58.595+0000 7fa10ffbd640 1 --2- 172.21.15.192:0/266124858 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa108101a30 0x7fa108102e10 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:58.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:58.595+0000 7fa10ffbd640 1 --2- 172.21.15.192:0/266124858 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa108100830 0x7fa1081046e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:16:58.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:58.595+0000 7fa10ffbd640 1 -- 172.21.15.192:0/266124858 >> 172.21.15.192:0/266124858 conn(0x7fa1080fbfa0 msgr2=0x7fa1080fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:16:58.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:58.595+0000 7fa10ffbd640 1 -- 172.21.15.192:0/266124858 shutdown_connections 2024-09-21T12:16:58.597 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:16:58.595+0000 7fa10ffbd640 1 -- 172.21.15.192:0/266124858 wait complete. 2024-09-21T12:16:58.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:58 smithi003 ceph-mon[28057]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:16:59.381 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-21T12:16:59.381 DEBUG:teuthology.orchestra.run.smithi192:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-09-21T12:16:59.381 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-21T12:16:59.459 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph config log 1 --format=json 2024-09-21T12:16:59.731 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:16:59.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:59 smithi192 ceph-mon[35641]: from='client.? 172.21.15.192:0/266124858' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-21T12:16:59.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:59 smithi192 ceph-mon[35641]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-21T12:16:59.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:16:59 smithi192 ceph-mon[35641]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T12:16:59.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:59 smithi003 ceph-mon[28057]: from='client.? 172.21.15.192:0/266124858' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-21T12:16:59.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:59 smithi003 ceph-mon[28057]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-21T12:16:59.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:16:59 smithi003 ceph-mon[28057]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-21T12:17:00.273 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:00.223+0000 7f6ec42af640 1 -- 172.21.15.3:0/2670780650 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6ebc100250 msgr2=0x7f6ebc100630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:00.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:00.223+0000 7f6ec42af640 1 --2- 172.21.15.3:0/2670780650 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6ebc100250 0x7f6ebc100630 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f6eb8009880 tx=0x7f6eb802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:17:00.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:00.223+0000 7f6ec42af640 1 -- 172.21.15.3:0/2670780650 shutdown_connections 2024-09-21T12:17:00.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:00.223+0000 7f6ec42af640 1 --2- 172.21.15.3:0/2670780650 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ebc100c00 0x7f6ebc104c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:00.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:00.223+0000 7f6ec42af640 1 --2- 172.21.15.3:0/2670780650 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6ebc100250 0x7f6ebc100630 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:00.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:00.223+0000 7f6ec42af640 1 -- 172.21.15.3:0/2670780650 >> 172.21.15.3:0/2670780650 conn(0x7f6ebc0fbc90 msgr2=0x7f6ebc0fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:00.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:00.223+0000 7f6ec42af640 1 -- 172.21.15.3:0/2670780650 shutdown_connections 2024-09-21T12:17:00.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:00.223+0000 7f6ec42af640 1 -- 172.21.15.3:0/2670780650 wait complete. 2024-09-21T12:17:00.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:00.223+0000 7f6ec42af640 1 Processor -- start 2024-09-21T12:17:00.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:00.223+0000 7f6ec42af640 1 -- start start 2024-09-21T12:17:00.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:00.224+0000 7f6ec42af640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6ebc100250 0x7f6ebc19d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:00.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:00.224+0000 7f6ec42af640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ebc100c00 0x7f6ebc19dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:00.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:00.224+0000 7f6ec42af640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f6ebc10d4d0 con 0x7f6ebc100250 2024-09-21T12:17:00.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:00.224+0000 7f6ec42af640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6ebc10d350 con 0x7f6ebc100c00 2024-09-21T12:17:00.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:00.224+0000 7f6ec204b640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6ebc100250 0x7f6ebc19d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:00.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:00.224+0000 7f6ec204b640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6ebc100250 0x7f6ebc19d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56720/0 (socket says 172.21.15.3:56720) 2024-09-21T12:17:00.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:00.224+0000 7f6ec204b640 1 -- 172.21.15.3:0/3369065022 learned_addr learned my addr 172.21.15.3:0/3369065022 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:17:00.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:00.224+0000 7f6ec184a640 1 --2- 172.21.15.3:0/3369065022 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ebc100c00 0x7f6ebc19dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:00.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:00.224+0000 7f6ec204b640 1 -- 172.21.15.3:0/3369065022 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ebc100c00 msgr2=0x7f6ebc19dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:00.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:00.224+0000 7f6ec204b640 1 --2- 172.21.15.3:0/3369065022 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ebc100c00 0x7f6ebc19dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:00.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:00.224+0000 7f6ec204b640 1 -- 172.21.15.3:0/3369065022 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ebc197880 con 0x7f6ebc100250 2024-09-21T12:17:00.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:00.224+0000 7f6ec204b640 1 --2- 172.21.15.3:0/3369065022 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6ebc100250 0x7f6ebc19d6c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6eb8031460 tx=0x7f6eb80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:00.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:00.224+0000 7f6eaf7fe640 1 -- 172.21.15.3:0/3369065022 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6eb803f070 con 0x7f6ebc100250 2024-09-21T12:17:00.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:00.224+0000 7f6eaf7fe640 1 -- 172.21.15.3:0/3369065022 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6eb8004cf0 con 0x7f6ebc100250 2024-09-21T12:17:00.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:00.224+0000 7f6eaf7fe640 1 -- 172.21.15.3:0/3369065022 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6eb8035030 con 0x7f6ebc100250 2024-09-21T12:17:00.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:00.224+0000 7f6ec42af640 1 -- 172.21.15.3:0/3369065022 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ebc197b10 con 0x7f6ebc100250 2024-09-21T12:17:00.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:00.225+0000 7f6ec42af640 1 -- 172.21.15.3:0/3369065022 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ebc198040 con 0x7f6ebc100250 2024-09-21T12:17:00.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:00.226+0000 7f6ec42af640 1 -- 172.21.15.3:0/3369065022 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ebc101730 con 0x7f6ebc100250 2024-09-21T12:17:00.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:00.226+0000 7f6eaf7fe640 1 -- 172.21.15.3:0/3369065022 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 19) ==== 92549+0+0 (secure 0 0 0) 0x7f6eb8042070 con 0x7f6ebc100250 2024-09-21T12:17:00.276 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:00.226+0000 7f6eaf7fe640 1 --2- 172.21.15.3:0/3369065022 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f6ea806e310 0x7f6ea80707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:00.276 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:00.226+0000 7f6eaf7fe640 1 -- 172.21.15.3:0/3369065022 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7f6eb80ae7e0 con 0x7f6ebc100250 2024-09-21T12:17:00.276 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:00.227+0000 7f6ec184a640 1 --2- 172.21.15.3:0/3369065022 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f6ea806e310 0x7f6ea80707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:00.276 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:00.227+0000 7f6ec184a640 1 --2- 172.21.15.3:0/3369065022 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f6ea806e310 0x7f6ea80707d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc0fc120 tx=0x7f6eb000a390 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:00.276 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:00.231+0000 7f6eaf7fe640 1 -- 172.21.15.3:0/3369065022 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6eb807c500 con 0x7f6ebc100250 2024-09-21T12:17:00.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:00.409+0000 7f6ec42af640 1 -- 172.21.15.3:0/3369065022 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f6ebc198db0 con 0x7f6ebc100250 2024-09-21T12:17:00.411 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:00 smithi003 ceph-mon[28057]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:17:00.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:00.409+0000 7f6eaf7fe640 1 -- 172.21.15.3:0/3369065022 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v38) ==== 86+0+187 (secure 0 0 0) 0x7f6eb80801b0 con 0x7f6ebc100250 2024-09-21T12:17:00.411 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:17:00.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:00.412+0000 7f6ec42af640 1 -- 172.21.15.3:0/3369065022 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f6ea806e310 msgr2=0x7f6ea80707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:00.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:00.412+0000 7f6ec42af640 1 --2- 172.21.15.3:0/3369065022 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f6ea806e310 0x7f6ea80707d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6ebc0fc120 tx=0x7f6eb000a390 comp rx=0 tx=0).stop 2024-09-21T12:17:00.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:00.412+0000 7f6ec42af640 1 -- 172.21.15.3:0/3369065022 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6ebc100250 msgr2=0x7f6ebc19d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:00.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:00.412+0000 7f6ec42af640 1 --2- 172.21.15.3:0/3369065022 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6ebc100250 0x7f6ebc19d6c0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6eb8031460 tx=0x7f6eb80048f0 comp rx=0 tx=0).stop 2024-09-21T12:17:00.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:00.412+0000 7f6ec42af640 1 -- 172.21.15.3:0/3369065022 shutdown_connections 2024-09-21T12:17:00.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:00.412+0000 7f6ec42af640 1 --2- 172.21.15.3:0/3369065022 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f6ea806e310 0x7f6ea80707d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:00.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:00.412+0000 7f6ec42af640 1 --2- 172.21.15.3:0/3369065022 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6ebc100c00 0x7f6ebc19dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:00.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:00.412+0000 7f6ec42af640 1 --2- 172.21.15.3:0/3369065022 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6ebc100250 0x7f6ebc19d6c0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:00.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:00.412+0000 7f6ec42af640 1 -- 172.21.15.3:0/3369065022 >> 172.21.15.3:0/3369065022 conn(0x7f6ebc0fbc90 msgr2=0x7f6ebc0fc8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:00.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:00.412+0000 7f6ec42af640 1 -- 172.21.15.3:0/3369065022 shutdown_connections 2024-09-21T12:17:00.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:00.412+0000 7f6ec42af640 1 -- 172.21.15.3:0/3369065022 wait complete. 2024-09-21T12:17:00.660 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:00 smithi192 ceph-mon[35641]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:17:01.115 INFO:teuthology.orchestra.run.smithi003.stdout:[{"version":38,"timestamp":"2024-09-21T12:16:48.172316+0000","name":"","changes":[{"name":"osd/host:smithi192/osd_memory_target","previous_value":"7818210099","new_value":"5212140066"}]}] 2024-09-21T12:17:01.116 INFO:tasks.ceph_manager:config epoch is 38 2024-09-21T12:17:01.116 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-21T12:17:01.116 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-21T12:17:01.116 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph mgr dump --format=json 2024-09-21T12:17:01.396 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:17:01.652 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:01 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/3369065022' entity='client.admin' cmd=[{"prefix": "config log", "num": 1, "format": "json"}]: dispatch 2024-09-21T12:17:01.674 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:01 smithi192 ceph-mon[35641]: from='client.? 172.21.15.3:0/3369065022' entity='client.admin' cmd=[{"prefix": "config log", "num": 1, "format": "json"}]: dispatch 2024-09-21T12:17:01.867 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:01.863+0000 7f2a55eef640 1 -- 172.21.15.3:0/2308513114 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2a501033e0 msgr2=0x7f2a5010b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:01.867 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:01.863+0000 7f2a55eef640 1 --2- 172.21.15.3:0/2308513114 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2a501033e0 0x7f2a5010b8d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2a44009880 tx=0x7f2a4402a530 comp rx=0 tx=0).stop 2024-09-21T12:17:01.867 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:01.864+0000 7f2a55eef640 1 -- 172.21.15.3:0/2308513114 shutdown_connections 2024-09-21T12:17:01.867 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:01.864+0000 7f2a55eef640 1 --2- 172.21.15.3:0/2308513114 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2a501033e0 0x7f2a5010b8d0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:01.867 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:01.864+0000 7f2a55eef640 1 --2- 172.21.15.3:0/2308513114 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a50102ac0 0x7f2a50102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:01.867 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:01.864+0000 7f2a55eef640 1 -- 172.21.15.3:0/2308513114 >> 172.21.15.3:0/2308513114 conn(0x7f2a500fc520 msgr2=0x7f2a500fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:01.867 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:01.864+0000 7f2a55eef640 1 -- 172.21.15.3:0/2308513114 shutdown_connections 2024-09-21T12:17:01.867 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:01.864+0000 7f2a55eef640 1 -- 172.21.15.3:0/2308513114 wait complete. 2024-09-21T12:17:01.867 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:01.864+0000 7f2a55eef640 1 Processor -- start 2024-09-21T12:17:01.867 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:01.864+0000 7f2a55eef640 1 -- start start 2024-09-21T12:17:01.868 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:01.865+0000 7f2a55eef640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2a50102ac0 0x7f2a50100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:01.868 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:01.865+0000 7f2a55eef640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a501033e0 0x7f2a50100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:01.868 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:01.865+0000 7f2a55eef640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f2a5010edf0 con 0x7f2a50102ac0 2024-09-21T12:17:01.868 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:01.865+0000 7f2a55eef640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2a5010ec70 con 0x7f2a501033e0 2024-09-21T12:17:01.868 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:01.865+0000 7f2a4f7fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2a50102ac0 0x7f2a50100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:01.868 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:01.865+0000 7f2a4f7fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2a50102ac0 0x7f2a50100720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:49024/0 (socket says 172.21.15.3:49024) 2024-09-21T12:17:01.868 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:01.865+0000 7f2a4f7fe640 1 -- 172.21.15.3:0/169523757 learned_addr learned my addr 172.21.15.3:0/169523757 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:17:01.868 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:01.865+0000 7f2a4effd640 1 --2- 172.21.15.3:0/169523757 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a501033e0 0x7f2a50100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:01.868 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:01.865+0000 7f2a4f7fe640 1 -- 172.21.15.3:0/169523757 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a501033e0 msgr2=0x7f2a50100c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:01.868 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:01.865+0000 7f2a4f7fe640 1 --2- 172.21.15.3:0/169523757 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a501033e0 0x7f2a50100c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:01.868 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:01.865+0000 7f2a4f7fe640 1 -- 172.21.15.3:0/169523757 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a501011a0 con 0x7f2a50102ac0 2024-09-21T12:17:01.868 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:01.865+0000 7f2a4f7fe640 1 --2- 172.21.15.3:0/169523757 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2a50102ac0 0x7f2a50100720 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2a4000d6f0 tx=0x7f2a4000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:01.869 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:01.866+0000 7f2a4cff9640 1 -- 172.21.15.3:0/169523757 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2a40017070 con 0x7f2a50102ac0 2024-09-21T12:17:01.869 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:01.866+0000 7f2a4cff9640 1 -- 172.21.15.3:0/169523757 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2a4000de00 con 0x7f2a50102ac0 2024-09-21T12:17:01.869 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:01.866+0000 7f2a55eef640 1 -- 172.21.15.3:0/169523757 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a50101490 con 0x7f2a50102ac0 2024-09-21T12:17:01.870 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:01.866+0000 7f2a4cff9640 1 -- 172.21.15.3:0/169523757 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2a40004bb0 con 0x7f2a50102ac0 2024-09-21T12:17:01.870 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:01.866+0000 7f2a55eef640 1 -- 172.21.15.3:0/169523757 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a501a3e80 con 0x7f2a50102ac0 2024-09-21T12:17:01.870 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:01.867+0000 7f2a55eef640 1 -- 172.21.15.3:0/169523757 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a5006aa90 con 0x7f2a50102ac0 2024-09-21T12:17:01.870 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:01.867+0000 7f2a4cff9640 1 -- 172.21.15.3:0/169523757 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 19) ==== 92549+0+0 (secure 0 0 0) 0x7f2a40004e60 con 0x7f2a50102ac0 2024-09-21T12:17:01.870 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:01.868+0000 7f2a4cff9640 1 --2- 172.21.15.3:0/169523757 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f2a3806e2b0 0x7f2a38070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:01.870 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:01.868+0000 7f2a4effd640 1 --2- 172.21.15.3:0/169523757 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f2a3806e2b0 0x7f2a38070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:01.870 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:01.868+0000 7f2a4cff9640 1 -- 172.21.15.3:0/169523757 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7f2a4008d9e0 con 0x7f2a50102ac0 2024-09-21T12:17:01.870 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:01.868+0000 7f2a4effd640 1 --2- 172.21.15.3:0/169523757 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f2a3806e2b0 0x7f2a38070770 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2a501021b0 tx=0x7f2a44031400 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:01.874 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:01.873+0000 7f2a4cff9640 1 -- 172.21.15.3:0/169523757 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2a4005f330 con 0x7f2a50102ac0 2024-09-21T12:17:02.098 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:02.097+0000 7f2a55eef640 1 -- 172.21.15.3:0/169523757 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f2a50102ea0 con 0x7f2a50102ac0 2024-09-21T12:17:02.101 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:02.100+0000 7f2a4cff9640 1 -- 172.21.15.3:0/169523757 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) ==== 74+0+176557 (secure 0 0 0) 0x7f2a40063b60 con 0x7f2a50102ac0 2024-09-21T12:17:02.104 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:17:02.105 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:02.102+0000 7f2a55eef640 1 -- 172.21.15.3:0/169523757 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f2a3806e2b0 msgr2=0x7f2a38070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:02.105 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:02.102+0000 7f2a55eef640 1 --2- 172.21.15.3:0/169523757 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f2a3806e2b0 0x7f2a38070770 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2a501021b0 tx=0x7f2a44031400 comp rx=0 tx=0).stop 2024-09-21T12:17:02.105 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:02.102+0000 7f2a55eef640 1 -- 172.21.15.3:0/169523757 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2a50102ac0 msgr2=0x7f2a50100720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:02.105 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:02.102+0000 7f2a55eef640 1 --2- 172.21.15.3:0/169523757 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2a50102ac0 0x7f2a50100720 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2a4000d6f0 tx=0x7f2a4000dbb0 comp rx=0 tx=0).stop 2024-09-21T12:17:02.105 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:02.102+0000 7f2a55eef640 1 -- 172.21.15.3:0/169523757 shutdown_connections 2024-09-21T12:17:02.105 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:02.102+0000 7f2a55eef640 1 --2- 172.21.15.3:0/169523757 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f2a3806e2b0 0x7f2a38070770 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:02.106 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:02.102+0000 7f2a55eef640 1 --2- 172.21.15.3:0/169523757 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2a501033e0 0x7f2a50100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:02.106 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:02.102+0000 7f2a55eef640 1 --2- 172.21.15.3:0/169523757 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2a50102ac0 0x7f2a50100720 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:02.106 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:02.102+0000 7f2a55eef640 1 -- 172.21.15.3:0/169523757 >> 172.21.15.3:0/169523757 conn(0x7f2a500fc520 msgr2=0x7f2a50108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:02.106 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:02.103+0000 7f2a55eef640 1 -- 172.21.15.3:0/169523757 shutdown_connections 2024-09-21T12:17:02.106 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:02.103+0000 7f2a55eef640 1 -- 172.21.15.3:0/169523757 wait complete. 2024-09-21T12:17:02.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:02 smithi192 ceph-mon[35641]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:17:02.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:02 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:17:02.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:02 smithi192 ceph-mon[35641]: from='client.? 172.21.15.3:0/169523757' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-21T12:17:02.786 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:02 smithi003 ceph-mon[28057]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:17:02.786 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:02 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:17:02.786 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:02 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/169523757' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-21T12:17:02.817 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":19,"flags":0,"active_gid":14217,"active_name":"smithi003.wztftl","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6800","nonce":2480880781},{"type":"v1","addr":"172.21.15.3:6801","nonce":2480880781}]},"active_addr":"172.21.15.3:6801/2480880781","active_change":"2024-09-21T12:12:46.501311+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":14242,"name":"smithi192.qsaprd","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.3:8443/","prometheus":"http://172.21.15.3:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.3:0","nonce":1113697961}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.3:0","nonce":3077524060}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.3:0","nonce":3532186966}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.3:0","nonce":2487235713}]}]} 2024-09-21T12:17:02.823 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-21T12:17:02.823 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-21T12:17:02.823 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph osd dump --format=json 2024-09-21T12:17:03.084 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:17:03.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:03.531+0000 7f2ac0af5640 1 -- 172.21.15.3:0/1388816302 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2abc100650 msgr2=0x7f2abc100a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:03.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:03.531+0000 7f2ac0af5640 1 --2- 172.21.15.3:0/1388816302 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2abc100650 0x7f2abc100a30 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f2aac009880 tx=0x7f2aac02a490 comp rx=0 tx=0).stop 2024-09-21T12:17:03.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:03.531+0000 7f2ac0af5640 1 -- 172.21.15.3:0/1388816302 shutdown_connections 2024-09-21T12:17:03.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:03.531+0000 7f2ac0af5640 1 --2- 172.21.15.3:0/1388816302 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2abc101000 0x7f2abc10dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:03.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:03.531+0000 7f2ac0af5640 1 --2- 172.21.15.3:0/1388816302 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2abc100650 0x7f2abc100a30 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:03.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:03.531+0000 7f2ac0af5640 1 -- 172.21.15.3:0/1388816302 >> 172.21.15.3:0/1388816302 conn(0x7f2abc0fc520 msgr2=0x7f2abc0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:03.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:03.531+0000 7f2ac0af5640 1 -- 172.21.15.3:0/1388816302 shutdown_connections 2024-09-21T12:17:03.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:03.531+0000 7f2ac0af5640 1 -- 172.21.15.3:0/1388816302 wait complete. 2024-09-21T12:17:03.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:03.532+0000 7f2ac0af5640 1 Processor -- start 2024-09-21T12:17:03.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:03.532+0000 7f2ac0af5640 1 -- start start 2024-09-21T12:17:03.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:03.532+0000 7f2ac0af5640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2abc100650 0x7f2abc19f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:03.536 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:03.532+0000 7f2ac0af5640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2abc101000 0x7f2abc19fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:03.536 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:03.532+0000 7f2ac0af5640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f2abc110ff0 con 0x7f2abc100650 2024-09-21T12:17:03.536 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:03.532+0000 7f2ac0af5640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2abc110e70 con 0x7f2abc101000 2024-09-21T12:17:03.536 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:03.532+0000 7f2aba59c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2abc100650 0x7f2abc19f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:03.536 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:03.532+0000 7f2aba59c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2abc100650 0x7f2abc19f8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:49056/0 (socket says 172.21.15.3:49056) 2024-09-21T12:17:03.536 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:03.532+0000 7f2aba59c640 1 -- 172.21.15.3:0/1640570272 learned_addr learned my addr 172.21.15.3:0/1640570272 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:17:03.536 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:03.532+0000 7f2ab9d9b640 1 --2- 172.21.15.3:0/1640570272 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2abc101000 0x7f2abc19fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:03.536 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:03.532+0000 7f2aba59c640 1 -- 172.21.15.3:0/1640570272 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2abc101000 msgr2=0x7f2abc19fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:03.536 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:03.532+0000 7f2aba59c640 1 --2- 172.21.15.3:0/1640570272 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2abc101000 0x7f2abc19fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:03.536 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:03.532+0000 7f2aba59c640 1 -- 172.21.15.3:0/1640570272 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2abc199a80 con 0x7f2abc100650 2024-09-21T12:17:03.536 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:03.532+0000 7f2ab9d9b640 1 --2- 172.21.15.3:0/1640570272 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2abc101000 0x7f2abc19fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:17:03.536 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:03.533+0000 7f2aba59c640 1 --2- 172.21.15.3:0/1640570272 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2abc100650 0x7f2abc19f8c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2aac031460 tx=0x7f2aac0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:03.537 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:03.533+0000 7f2aab7fe640 1 -- 172.21.15.3:0/1640570272 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2aac03f070 con 0x7f2abc100650 2024-09-21T12:17:03.537 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:03.533+0000 7f2ac0af5640 1 -- 172.21.15.3:0/1640570272 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2abc199d10 con 0x7f2abc100650 2024-09-21T12:17:03.537 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:03.533+0000 7f2aab7fe640 1 -- 172.21.15.3:0/1640570272 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2aac004cf0 con 0x7f2abc100650 2024-09-21T12:17:03.537 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:03.533+0000 7f2aab7fe640 1 -- 172.21.15.3:0/1640570272 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2aac035030 con 0x7f2abc100650 2024-09-21T12:17:03.537 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:03.533+0000 7f2ac0af5640 1 -- 172.21.15.3:0/1640570272 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2abc19a2a0 con 0x7f2abc100650 2024-09-21T12:17:03.537 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:03.534+0000 7f2ac0af5640 1 -- 172.21.15.3:0/1640570272 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2abc06aa90 con 0x7f2abc100650 2024-09-21T12:17:03.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:03.534+0000 7f2aab7fe640 1 -- 172.21.15.3:0/1640570272 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 19) ==== 92549+0+0 (secure 0 0 0) 0x7f2aac042070 con 0x7f2abc100650 2024-09-21T12:17:03.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:03.535+0000 7f2aab7fe640 1 --2- 172.21.15.3:0/1640570272 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f2aa406e2b0 0x7f2aa4070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:03.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:03.535+0000 7f2aab7fe640 1 -- 172.21.15.3:0/1640570272 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7f2aac0ae910 con 0x7f2abc100650 2024-09-21T12:17:03.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:03.535+0000 7f2ab9d9b640 1 --2- 172.21.15.3:0/1640570272 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f2aa406e2b0 0x7f2aa4070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:03.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:03.535+0000 7f2ab9d9b640 1 --2- 172.21.15.3:0/1640570272 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f2aa406e2b0 0x7f2aa4070770 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2abc102520 tx=0x7f2ab0008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:03.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:03.539+0000 7f2aab7fe640 1 -- 172.21.15.3:0/1640570272 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2aac07c5b0 con 0x7f2abc100650 2024-09-21T12:17:03.722 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:03.720+0000 7f2ac0af5640 1 -- 172.21.15.3:0/1640570272 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2abc10b3a0 con 0x7f2abc100650 2024-09-21T12:17:03.722 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:03.721+0000 7f2aab7fe640 1 -- 172.21.15.3:0/1640570272 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+11339 (secure 0 0 0) 0x7f2aac080260 con 0x7f2abc100650 2024-09-21T12:17:03.723 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:17:03.723 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":40,"fsid":"641beec0-7812-11ef-baf6-efdc52797490","created":"2024-09-21T12:10:46.520078+0000","modified":"2024-09-21T12:16:50.313605+0000","last_up_change":"2024-09-21T12:16:49.136035+0000","last_in_change":"2024-09-21T12:16:25.609767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T12:15:29.009114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d992d4d6-4292-4a47-9556-262dc7915d07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":974168994},{"type":"v1","addr":"172.21.15.3:6803","nonce":974168994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":974168994},{"type":"v1","addr":"172.21.15.3:6805","nonce":974168994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":974168994},{"type":"v1","addr":"172.21.15.3:6809","nonce":974168994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":974168994},{"type":"v1","addr":"172.21.15.3:6807","nonce":974168994}]},"public_addr":"172.21.15.3:6803/974168994","cluster_addr":"172.21.15.3:6805/974168994","heartbeat_back_addr":"172.21.15.3:6809/974168994","heartbeat_front_addr":"172.21.15.3:6807/974168994","state":["exists","up"]},{"osd":1,"uuid":"e3a36979-b369-43c8-867e-d7c96c00ec5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":3334119815},{"type":"v1","addr":"172.21.15.3:6811","nonce":3334119815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":3334119815},{"type":"v1","addr":"172.21.15.3:6813","nonce":3334119815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":3334119815},{"type":"v1","addr":"172.21.15.3:6817","nonce":3334119815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":3334119815},{"type":"v1","addr":"172.21.15.3:6815","nonce":3334119815}]},"public_addr":"172.21.15.3:6811/3334119815","cluster_addr":"172.21.15.3:6813/3334119815","heartbeat_back_addr":"172.21.15.3:6817/3334119815","heartbeat_front_addr":"172.21.15.3:6815/3334119815","state":["exists","up"]},{"osd":2,"uuid":"1ba0899a-76f5-415f-b0d6-09df23128032","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":1433580301},{"type":"v1","addr":"172.21.15.3:6819","nonce":1433580301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":1433580301},{"type":"v1","addr":"172.21.15.3:6821","nonce":1433580301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":1433580301},{"type":"v1","addr":"172.21.15.3:6825","nonce":1433580301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":1433580301},{"type":"v1","addr":"172.21.15.3:6823","nonce":1433580301}]},"public_addr":"172.21.15.3:6819/1433580301","cluster_addr":"172.21.15.3:6821/1433580301","heartbeat_back_addr":"172.21.15.3:6825/1433580301","heartbeat_front_addr":"172.21.15.3:6823/1433580301","state":["exists","up"]},{"osd":3,"uuid":"dfb038d6-4ca3-4f2b-b8ab-c0f0a1ca353f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2737855393},{"type":"v1","addr":"172.21.15.192:6801","nonce":2737855393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2737855393},{"type":"v1","addr":"172.21.15.192:6803","nonce":2737855393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2737855393},{"type":"v1","addr":"172.21.15.192:6807","nonce":2737855393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2737855393},{"type":"v1","addr":"172.21.15.192:6805","nonce":2737855393}]},"public_addr":"172.21.15.192:6801/2737855393","cluster_addr":"172.21.15.192:6803/2737855393","heartbeat_back_addr":"172.21.15.192:6807/2737855393","heartbeat_front_addr":"172.21.15.192:6805/2737855393","state":["exists","up"]},{"osd":4,"uuid":"b612cc2a-e417-481d-93fd-f527865f19be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1341504680},{"type":"v1","addr":"172.21.15.192:6809","nonce":1341504680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1341504680},{"type":"v1","addr":"172.21.15.192:6811","nonce":1341504680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1341504680},{"type":"v1","addr":"172.21.15.192:6815","nonce":1341504680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1341504680},{"type":"v1","addr":"172.21.15.192:6813","nonce":1341504680}]},"public_addr":"172.21.15.192:6809/1341504680","cluster_addr":"172.21.15.192:6811/1341504680","heartbeat_back_addr":"172.21.15.192:6815/1341504680","heartbeat_front_addr":"172.21.15.192:6813/1341504680","state":["exists","up"]},{"osd":5,"uuid":"667455e4-320f-4f4e-8277-6941f9164fd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1770474426},{"type":"v1","addr":"172.21.15.192:6817","nonce":1770474426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1770474426},{"type":"v1","addr":"172.21.15.192:6819","nonce":1770474426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1770474426},{"type":"v1","addr":"172.21.15.192:6823","nonce":1770474426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1770474426},{"type":"v1","addr":"172.21.15.192:6821","nonce":1770474426}]},"public_addr":"172.21.15.192:6817/1770474426","cluster_addr":"172.21.15.192:6819/1770474426","heartbeat_back_addr":"172.21.15.192:6823/1770474426","heartbeat_front_addr":"172.21.15.192:6821/1770474426","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T12:14:24.179679+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T12:14:56.023373+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T12:15:25.786760+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T12:15:52.402341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T12:16:19.828125+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T12:16:47.859739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.3:0/942012167":"2024-09-22T12:11:18.903614+0000","172.21.15.3:0/2241193596":"2024-09-22T12:12:46.501201+0000","172.21.15.3:0/533261896":"2024-09-22T12:11:18.903614+0000","172.21.15.3:6801/3011223684":"2024-09-22T12:12:46.501201+0000","172.21.15.3:0/814089744":"2024-09-22T12:11:50.998065+0000","172.21.15.3:0/4271646487":"2024-09-22T12:11:50.998065+0000","172.21.15.3:0/299469671":"2024-09-22T12:11:18.903614+0000","172.21.15.3:6801/2568399820":"2024-09-22T12:11:18.903614+0000","172.21.15.3:6800/2568399820":"2024-09-22T12:11:18.903614+0000","172.21.15.3:6800/3011223684":"2024-09-22T12:12:46.501201+0000","172.21.15.3:6800/219393181":"2024-09-22T12:11:50.998065+0000","172.21.15.3:0/897407664":"2024-09-22T12:11:50.998065+0000","172.21.15.3:6801/219393181":"2024-09-22T12:11:50.998065+0000","172.21.15.3:0/4128411278":"2024-09-22T12:12:46.501201+0000","172.21.15.3:0/1985406757":"2024-09-22T12:12:46.501201+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T12:17:03.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:03.723+0000 7f2ac0af5640 1 -- 172.21.15.3:0/1640570272 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f2aa406e2b0 msgr2=0x7f2aa4070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:03.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:03.723+0000 7f2ac0af5640 1 --2- 172.21.15.3:0/1640570272 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f2aa406e2b0 0x7f2aa4070770 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2abc102520 tx=0x7f2ab0008040 comp rx=0 tx=0).stop 2024-09-21T12:17:03.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:03.723+0000 7f2ac0af5640 1 -- 172.21.15.3:0/1640570272 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2abc100650 msgr2=0x7f2abc19f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:03.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:03.723+0000 7f2ac0af5640 1 --2- 172.21.15.3:0/1640570272 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2abc100650 0x7f2abc19f8c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2aac031460 tx=0x7f2aac0048f0 comp rx=0 tx=0).stop 2024-09-21T12:17:03.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:03.723+0000 7f2ac0af5640 1 -- 172.21.15.3:0/1640570272 shutdown_connections 2024-09-21T12:17:03.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:03.723+0000 7f2ac0af5640 1 --2- 172.21.15.3:0/1640570272 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f2aa406e2b0 0x7f2aa4070770 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:03.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:03.723+0000 7f2ac0af5640 1 --2- 172.21.15.3:0/1640570272 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2abc101000 0x7f2abc19fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:03.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:03.723+0000 7f2ac0af5640 1 --2- 172.21.15.3:0/1640570272 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2abc100650 0x7f2abc19f8c0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:03.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:03.723+0000 7f2ac0af5640 1 -- 172.21.15.3:0/1640570272 >> 172.21.15.3:0/1640570272 conn(0x7f2abc0fc520 msgr2=0x7f2abc0fd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:03.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:03.723+0000 7f2ac0af5640 1 -- 172.21.15.3:0/1640570272 shutdown_connections 2024-09-21T12:17:03.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:03.723+0000 7f2ac0af5640 1 -- 172.21.15.3:0/1640570272 wait complete. 2024-09-21T12:17:04.488 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-21T12:17:04.488 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph osd dump --format=json 2024-09-21T12:17:04.751 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:17:04.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:04 smithi192 ceph-mon[35641]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:17:04.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:04 smithi192 ceph-mon[35641]: from='client.? 172.21.15.3:0/1640570272' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-21T12:17:04.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:04 smithi003 ceph-mon[28057]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:17:04.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:04 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/1640570272' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-21T12:17:05.206 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:05.168+0000 7fa4ff794640 1 -- 172.21.15.3:0/1166837015 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa4f8100800 msgr2=0x7fa4f8100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:05.206 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:05.168+0000 7fa4ff794640 1 --2- 172.21.15.3:0/1166837015 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa4f8100800 0x7fa4f8100c60 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fa4e8009880 tx=0x7fa4e802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:17:05.206 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:05.169+0000 7fa4ff794640 1 -- 172.21.15.3:0/1166837015 shutdown_connections 2024-09-21T12:17:05.206 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:05.169+0000 7fa4ff794640 1 --2- 172.21.15.3:0/1166837015 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa4f8100800 0x7fa4f8100c60 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:05.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:05.169+0000 7fa4ff794640 1 --2- 172.21.15.3:0/1166837015 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa4f8106800 0x7fa4f8106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:05.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:05.169+0000 7fa4ff794640 1 -- 172.21.15.3:0/1166837015 >> 172.21.15.3:0/1166837015 conn(0x7fa4f80fc520 msgr2=0x7fa4f80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:05.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:05.169+0000 7fa4ff794640 1 -- 172.21.15.3:0/1166837015 shutdown_connections 2024-09-21T12:17:05.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:05.169+0000 7fa4ff794640 1 -- 172.21.15.3:0/1166837015 wait complete. 2024-09-21T12:17:05.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:05.169+0000 7fa4ff794640 1 Processor -- start 2024-09-21T12:17:05.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:05.169+0000 7fa4ff794640 1 -- start start 2024-09-21T12:17:05.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:05.169+0000 7fa4ff794640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa4f8100800 0x7fa4f819c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:05.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:05.170+0000 7fa4ff794640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa4f8106800 0x7fa4f819cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:05.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:05.170+0000 7fa4ff794640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f810dcb0 con 0x7fa4f8106800 2024-09-21T12:17:05.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:05.170+0000 7fa4ff794640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa4f810db30 con 0x7fa4f8100800 2024-09-21T12:17:05.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:05.170+0000 7fa4fcd2f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa4f8106800 0x7fa4f819cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:05.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:05.170+0000 7fa4fcd2f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa4f8106800 0x7fa4f819cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:49080/0 (socket says 172.21.15.3:49080) 2024-09-21T12:17:05.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:05.170+0000 7fa4fcd2f640 1 -- 172.21.15.3:0/288909325 learned_addr learned my addr 172.21.15.3:0/288909325 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:17:05.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:05.170+0000 7fa4fd530640 1 --2- 172.21.15.3:0/288909325 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa4f8100800 0x7fa4f819c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:05.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:05.170+0000 7fa4fcd2f640 1 -- 172.21.15.3:0/288909325 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa4f8100800 msgr2=0x7fa4f819c5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:05.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:05.170+0000 7fa4fcd2f640 1 --2- 172.21.15.3:0/288909325 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa4f8100800 0x7fa4f819c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:05.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:05.170+0000 7fa4fcd2f640 1 -- 172.21.15.3:0/288909325 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4f81966c0 con 0x7fa4f8106800 2024-09-21T12:17:05.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:05.170+0000 7fa4fcd2f640 1 --2- 172.21.15.3:0/288909325 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa4f8106800 0x7fa4f819cb30 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa4e8031460 tx=0x7fa4e80045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:05.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:05.170+0000 7fa4ee7fc640 1 -- 172.21.15.3:0/288909325 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa4e803f070 con 0x7fa4f8106800 2024-09-21T12:17:05.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:05.170+0000 7fa4ee7fc640 1 -- 172.21.15.3:0/288909325 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa4e80035f0 con 0x7fa4f8106800 2024-09-21T12:17:05.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:05.170+0000 7fa4ff794640 1 -- 172.21.15.3:0/288909325 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4f8196950 con 0x7fa4f8106800 2024-09-21T12:17:05.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:05.170+0000 7fa4ee7fc640 1 -- 172.21.15.3:0/288909325 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa4e8035030 con 0x7fa4f8106800 2024-09-21T12:17:05.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:05.170+0000 7fa4ff794640 1 -- 172.21.15.3:0/288909325 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4f8196e50 con 0x7fa4f8106800 2024-09-21T12:17:05.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:05.171+0000 7fa4ff794640 1 -- 172.21.15.3:0/288909325 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4f8101f40 con 0x7fa4f8106800 2024-09-21T12:17:05.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:05.172+0000 7fa4ee7fc640 1 -- 172.21.15.3:0/288909325 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 19) ==== 92549+0+0 (secure 0 0 0) 0x7fa4e8042070 con 0x7fa4f8106800 2024-09-21T12:17:05.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:05.172+0000 7fa4ee7fc640 1 --2- 172.21.15.3:0/288909325 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fa4e406e310 0x7fa4e40707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:05.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:05.173+0000 7fa4fd530640 1 --2- 172.21.15.3:0/288909325 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fa4e406e310 0x7fa4e40707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:05.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:05.173+0000 7fa4ee7fc640 1 -- 172.21.15.3:0/288909325 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7fa4e80ae720 con 0x7fa4f8106800 2024-09-21T12:17:05.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:05.173+0000 7fa4fd530640 1 --2- 172.21.15.3:0/288909325 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fa4e406e310 0x7fa4e40707d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa4f4005fd0 tx=0x7fa4f4005850 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:05.209 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:05.177+0000 7fa4ee7fc640 1 -- 172.21.15.3:0/288909325 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa4e807c440 con 0x7fa4f8106800 2024-09-21T12:17:05.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:05.353+0000 7fa4ff794640 1 -- 172.21.15.3:0/288909325 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa4f8197bf0 con 0x7fa4f8106800 2024-09-21T12:17:05.355 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:05.353+0000 7fa4ee7fc640 1 -- 172.21.15.3:0/288909325 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) ==== 74+0+11339 (secure 0 0 0) 0x7fa4e80800f0 con 0x7fa4f8106800 2024-09-21T12:17:05.355 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:17:05.355 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":40,"fsid":"641beec0-7812-11ef-baf6-efdc52797490","created":"2024-09-21T12:10:46.520078+0000","modified":"2024-09-21T12:16:50.313605+0000","last_up_change":"2024-09-21T12:16:49.136035+0000","last_in_change":"2024-09-21T12:16:25.609767+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-21T12:15:29.009114+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d992d4d6-4292-4a47-9556-262dc7915d07","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6802","nonce":974168994},{"type":"v1","addr":"172.21.15.3:6803","nonce":974168994}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6804","nonce":974168994},{"type":"v1","addr":"172.21.15.3:6805","nonce":974168994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6808","nonce":974168994},{"type":"v1","addr":"172.21.15.3:6809","nonce":974168994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6806","nonce":974168994},{"type":"v1","addr":"172.21.15.3:6807","nonce":974168994}]},"public_addr":"172.21.15.3:6803/974168994","cluster_addr":"172.21.15.3:6805/974168994","heartbeat_back_addr":"172.21.15.3:6809/974168994","heartbeat_front_addr":"172.21.15.3:6807/974168994","state":["exists","up"]},{"osd":1,"uuid":"e3a36979-b369-43c8-867e-d7c96c00ec5e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":29,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6810","nonce":3334119815},{"type":"v1","addr":"172.21.15.3:6811","nonce":3334119815}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6812","nonce":3334119815},{"type":"v1","addr":"172.21.15.3:6813","nonce":3334119815}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6816","nonce":3334119815},{"type":"v1","addr":"172.21.15.3:6817","nonce":3334119815}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6814","nonce":3334119815},{"type":"v1","addr":"172.21.15.3:6815","nonce":3334119815}]},"public_addr":"172.21.15.3:6811/3334119815","cluster_addr":"172.21.15.3:6813/3334119815","heartbeat_back_addr":"172.21.15.3:6817/3334119815","heartbeat_front_addr":"172.21.15.3:6815/3334119815","state":["exists","up"]},{"osd":2,"uuid":"1ba0899a-76f5-415f-b0d6-09df23128032","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6818","nonce":1433580301},{"type":"v1","addr":"172.21.15.3:6819","nonce":1433580301}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6820","nonce":1433580301},{"type":"v1","addr":"172.21.15.3:6821","nonce":1433580301}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6824","nonce":1433580301},{"type":"v1","addr":"172.21.15.3:6825","nonce":1433580301}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6822","nonce":1433580301},{"type":"v1","addr":"172.21.15.3:6823","nonce":1433580301}]},"public_addr":"172.21.15.3:6819/1433580301","cluster_addr":"172.21.15.3:6821/1433580301","heartbeat_back_addr":"172.21.15.3:6825/1433580301","heartbeat_front_addr":"172.21.15.3:6823/1433580301","state":["exists","up"]},{"osd":3,"uuid":"dfb038d6-4ca3-4f2b-b8ab-c0f0a1ca353f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6800","nonce":2737855393},{"type":"v1","addr":"172.21.15.192:6801","nonce":2737855393}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6802","nonce":2737855393},{"type":"v1","addr":"172.21.15.192:6803","nonce":2737855393}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6806","nonce":2737855393},{"type":"v1","addr":"172.21.15.192:6807","nonce":2737855393}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6804","nonce":2737855393},{"type":"v1","addr":"172.21.15.192:6805","nonce":2737855393}]},"public_addr":"172.21.15.192:6801/2737855393","cluster_addr":"172.21.15.192:6803/2737855393","heartbeat_back_addr":"172.21.15.192:6807/2737855393","heartbeat_front_addr":"172.21.15.192:6805/2737855393","state":["exists","up"]},{"osd":4,"uuid":"b612cc2a-e417-481d-93fd-f527865f19be","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":34,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6808","nonce":1341504680},{"type":"v1","addr":"172.21.15.192:6809","nonce":1341504680}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6810","nonce":1341504680},{"type":"v1","addr":"172.21.15.192:6811","nonce":1341504680}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6814","nonce":1341504680},{"type":"v1","addr":"172.21.15.192:6815","nonce":1341504680}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6812","nonce":1341504680},{"type":"v1","addr":"172.21.15.192:6813","nonce":1341504680}]},"public_addr":"172.21.15.192:6809/1341504680","cluster_addr":"172.21.15.192:6811/1341504680","heartbeat_back_addr":"172.21.15.192:6815/1341504680","heartbeat_front_addr":"172.21.15.192:6813/1341504680","state":["exists","up"]},{"osd":5,"uuid":"667455e4-320f-4f4e-8277-6941f9164fd5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6816","nonce":1770474426},{"type":"v1","addr":"172.21.15.192:6817","nonce":1770474426}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6818","nonce":1770474426},{"type":"v1","addr":"172.21.15.192:6819","nonce":1770474426}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6822","nonce":1770474426},{"type":"v1","addr":"172.21.15.192:6823","nonce":1770474426}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6820","nonce":1770474426},{"type":"v1","addr":"172.21.15.192:6821","nonce":1770474426}]},"public_addr":"172.21.15.192:6817/1770474426","cluster_addr":"172.21.15.192:6819/1770474426","heartbeat_back_addr":"172.21.15.192:6823/1770474426","heartbeat_front_addr":"172.21.15.192:6821/1770474426","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T12:14:24.179679+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T12:14:56.023373+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T12:15:25.786760+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T12:15:52.402341+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T12:16:19.828125+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-21T12:16:47.859739+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.3:0/942012167":"2024-09-22T12:11:18.903614+0000","172.21.15.3:0/2241193596":"2024-09-22T12:12:46.501201+0000","172.21.15.3:0/533261896":"2024-09-22T12:11:18.903614+0000","172.21.15.3:6801/3011223684":"2024-09-22T12:12:46.501201+0000","172.21.15.3:0/814089744":"2024-09-22T12:11:50.998065+0000","172.21.15.3:0/4271646487":"2024-09-22T12:11:50.998065+0000","172.21.15.3:0/299469671":"2024-09-22T12:11:18.903614+0000","172.21.15.3:6801/2568399820":"2024-09-22T12:11:18.903614+0000","172.21.15.3:6800/2568399820":"2024-09-22T12:11:18.903614+0000","172.21.15.3:6800/3011223684":"2024-09-22T12:12:46.501201+0000","172.21.15.3:6800/219393181":"2024-09-22T12:11:50.998065+0000","172.21.15.3:0/897407664":"2024-09-22T12:11:50.998065+0000","172.21.15.3:6801/219393181":"2024-09-22T12:11:50.998065+0000","172.21.15.3:0/4128411278":"2024-09-22T12:12:46.501201+0000","172.21.15.3:0/1985406757":"2024-09-22T12:12:46.501201+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-21T12:17:05.357 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:05.355+0000 7fa4ff794640 1 -- 172.21.15.3:0/288909325 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fa4e406e310 msgr2=0x7fa4e40707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:05.357 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:05.355+0000 7fa4ff794640 1 --2- 172.21.15.3:0/288909325 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fa4e406e310 0x7fa4e40707d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa4f4005fd0 tx=0x7fa4f4005850 comp rx=0 tx=0).stop 2024-09-21T12:17:05.357 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:05.355+0000 7fa4ff794640 1 -- 172.21.15.3:0/288909325 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa4f8106800 msgr2=0x7fa4f819cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:05.357 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:05.355+0000 7fa4ff794640 1 --2- 172.21.15.3:0/288909325 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa4f8106800 0x7fa4f819cb30 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fa4e8031460 tx=0x7fa4e80045e0 comp rx=0 tx=0).stop 2024-09-21T12:17:05.357 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:05.355+0000 7fa4ff794640 1 -- 172.21.15.3:0/288909325 shutdown_connections 2024-09-21T12:17:05.357 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:05.355+0000 7fa4ff794640 1 --2- 172.21.15.3:0/288909325 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fa4e406e310 0x7fa4e40707d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:05.358 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:05.355+0000 7fa4ff794640 1 --2- 172.21.15.3:0/288909325 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa4f8106800 0x7fa4f819cb30 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:05.358 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:05.355+0000 7fa4ff794640 1 --2- 172.21.15.3:0/288909325 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa4f8100800 0x7fa4f819c5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:05.358 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:05.355+0000 7fa4ff794640 1 -- 172.21.15.3:0/288909325 >> 172.21.15.3:0/288909325 conn(0x7fa4f80fc520 msgr2=0x7fa4f80fcdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:05.358 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:05.356+0000 7fa4ff794640 1 -- 172.21.15.3:0/288909325 shutdown_connections 2024-09-21T12:17:05.358 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:05.356+0000 7fa4ff794640 1 -- 172.21.15.3:0/288909325 wait complete. 2024-09-21T12:17:05.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:05 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/288909325' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-21T12:17:05.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:05 smithi192 ceph-mon[35641]: from='client.? 172.21.15.3:0/288909325' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-21T12:17:05.984 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph tell osd.0 flush_pg_stats 2024-09-21T12:17:05.985 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph tell osd.1 flush_pg_stats 2024-09-21T12:17:05.985 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph tell osd.2 flush_pg_stats 2024-09-21T12:17:05.986 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph tell osd.3 flush_pg_stats 2024-09-21T12:17:05.986 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph tell osd.4 flush_pg_stats 2024-09-21T12:17:05.987 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph tell osd.5 flush_pg_stats 2024-09-21T12:17:06.291 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:17:06.292 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:17:06.696 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:06 smithi003 ceph-mon[28057]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:17:06.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:06 smithi192 ceph-mon[35641]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:17:07.024 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.022+0000 7fdcf9285640 1 -- 172.21.15.3:0/4204546439 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdcf40ffdc0 msgr2=0x7fdcf4100220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:07.024 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.022+0000 7fdcf9285640 1 --2- 172.21.15.3:0/4204546439 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdcf40ffdc0 0x7fdcf4100220 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fdcdc009880 tx=0x7fdcdc02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:17:07.025 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.022+0000 7fdcf9285640 1 -- 172.21.15.3:0/4204546439 shutdown_connections 2024-09-21T12:17:07.025 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.022+0000 7fdcf9285640 1 --2- 172.21.15.3:0/4204546439 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdcf40ffdc0 0x7fdcf4100220 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:07.025 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.022+0000 7fdcf9285640 1 --2- 172.21.15.3:0/4204546439 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdcf41069a0 0x7fdcf4106d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:07.025 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.022+0000 7fdcf9285640 1 -- 172.21.15.3:0/4204546439 >> 172.21.15.3:0/4204546439 conn(0x7fdcf40fbc90 msgr2=0x7fdcf40fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:07.025 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.022+0000 7fdcf9285640 1 -- 172.21.15.3:0/4204546439 shutdown_connections 2024-09-21T12:17:07.025 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.023+0000 7fdcf9285640 1 -- 172.21.15.3:0/4204546439 wait complete. 2024-09-21T12:17:07.026 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.023+0000 7fdcf9285640 1 Processor -- start 2024-09-21T12:17:07.026 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.023+0000 7fdcf9285640 1 -- start start 2024-09-21T12:17:07.026 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.024+0000 7fdcf9285640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdcf40ffdc0 0x7fdcf419d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:07.026 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.024+0000 7fdcf9285640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdcf41069a0 0x7fdcf419dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:07.027 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.024+0000 7fdcf9285640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fdcf410ef40 con 0x7fdcf40ffdc0 2024-09-21T12:17:07.027 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.024+0000 7fdcf9285640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fdcf410edc0 con 0x7fdcf41069a0 2024-09-21T12:17:07.027 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.024+0000 7fdcf2ffd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdcf40ffdc0 0x7fdcf419d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:07.027 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.024+0000 7fdcf2ffd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdcf40ffdc0 0x7fdcf419d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:49098/0 (socket says 172.21.15.3:49098) 2024-09-21T12:17:07.027 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.024+0000 7fdcf2ffd640 1 -- 172.21.15.3:0/1363414754 learned_addr learned my addr 172.21.15.3:0/1363414754 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:17:07.027 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.024+0000 7fdcebfff640 1 --2- 172.21.15.3:0/1363414754 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdcf41069a0 0x7fdcf419dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:07.027 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.024+0000 7fdcf2ffd640 1 -- 172.21.15.3:0/1363414754 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdcf41069a0 msgr2=0x7fdcf419dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:07.027 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.024+0000 7fdcf2ffd640 1 --2- 172.21.15.3:0/1363414754 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdcf41069a0 0x7fdcf419dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:07.027 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.024+0000 7fdcf2ffd640 1 -- 172.21.15.3:0/1363414754 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcf41978f0 con 0x7fdcf40ffdc0 2024-09-21T12:17:07.027 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.024+0000 7fdcf2ffd640 1 --2- 172.21.15.3:0/1363414754 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdcf40ffdc0 0x7fdcf419d730 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fdce400d6f0 tx=0x7fdce400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:07.027 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.024+0000 7fdcf0ff9640 1 -- 172.21.15.3:0/1363414754 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdce4017070 con 0x7fdcf40ffdc0 2024-09-21T12:17:07.027 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.025+0000 7fdcf9285640 1 -- 172.21.15.3:0/1363414754 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcf4197be0 con 0x7fdcf40ffdc0 2024-09-21T12:17:07.027 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.025+0000 7fdcf0ff9640 1 -- 172.21.15.3:0/1363414754 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdce400de00 con 0x7fdcf40ffdc0 2024-09-21T12:17:07.028 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.025+0000 7fdcf0ff9640 1 -- 172.21.15.3:0/1363414754 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdce4004bb0 con 0x7fdcf40ffdc0 2024-09-21T12:17:07.028 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.025+0000 7fdcf9285640 1 -- 172.21.15.3:0/1363414754 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcf4198140 con 0x7fdcf40ffdc0 2024-09-21T12:17:07.028 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.026+0000 7fdcf9285640 1 -- 172.21.15.3:0/1363414754 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdcf4198640 con 0x7fdcf40ffdc0 2024-09-21T12:17:07.028 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.026+0000 7fdcf0ff9640 1 -- 172.21.15.3:0/1363414754 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 19) ==== 92549+0+0 (secure 0 0 0) 0x7fdce4004e60 con 0x7fdcf40ffdc0 2024-09-21T12:17:07.029 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.027+0000 7fdcf0ff9640 1 --2- 172.21.15.3:0/1363414754 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fdce006e2b0 0x7fdce0070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:07.029 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.027+0000 7fdcf0ff9640 1 -- 172.21.15.3:0/1363414754 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7fdce408da10 con 0x7fdcf40ffdc0 2024-09-21T12:17:07.029 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.027+0000 7fdcebfff640 1 --2- 172.21.15.3:0/1363414754 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fdce006e2b0 0x7fdce0070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:07.029 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.027+0000 7fdcf0ff9640 1 --2- 172.21.15.3:0/1363414754 >> [v2:172.21.15.3:6802/974168994,v1:172.21.15.3:6803/974168994] conn(0x7fdce00740a0 0x7fdce00764c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:07.029 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.027+0000 7fdcf0ff9640 1 -- 172.21.15.3:0/1363414754 --> [v2:172.21.15.3:6802/974168994,v1:172.21.15.3:6803/974168994] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdce0076b70 con 0x7fdce00740a0 2024-09-21T12:17:07.029 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.027+0000 7fdcf0ff9640 1 -- 172.21.15.3:0/1363414754 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7fdce40922a0 con 0x7fdcf40ffdc0 2024-09-21T12:17:07.029 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.027+0000 7fdcf37fe640 1 --2- 172.21.15.3:0/1363414754 >> [v2:172.21.15.3:6802/974168994,v1:172.21.15.3:6803/974168994] conn(0x7fdce00740a0 0x7fdce00764c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:07.029 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.027+0000 7fdcebfff640 1 --2- 172.21.15.3:0/1363414754 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fdce006e2b0 0x7fdce0070770 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fdcf41990e0 tx=0x7fdcdc031400 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:07.030 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.027+0000 7fdcf37fe640 1 --2- 172.21.15.3:0/1363414754 >> [v2:172.21.15.3:6802/974168994,v1:172.21.15.3:6803/974168994] conn(0x7fdce00740a0 0x7fdce00764c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:07.030 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.028+0000 7fdcf0ff9640 1 -- 172.21.15.3:0/1363414754 <== osd.0 v2:172.21.15.3:6802/974168994 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdce0076b70 con 0x7fdce00740a0 2024-09-21T12:17:07.043 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.042+0000 7fdcf9285640 1 -- 172.21.15.3:0/1363414754 --> [v2:172.21.15.3:6802/974168994,v1:172.21.15.3:6803/974168994] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdcf40628b0 con 0x7fdce00740a0 2024-09-21T12:17:07.043 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.042+0000 7fdcf0ff9640 1 -- 172.21.15.3:0/1363414754 <== osd.0 v2:172.21.15.3:6802/974168994 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fdcf40628b0 con 0x7fdce00740a0 2024-09-21T12:17:07.044 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.042+0000 7fdcf9285640 1 -- 172.21.15.3:0/1363414754 >> [v2:172.21.15.3:6802/974168994,v1:172.21.15.3:6803/974168994] conn(0x7fdce00740a0 msgr2=0x7fdce00764c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:07.044 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.042+0000 7fdcf9285640 1 --2- 172.21.15.3:0/1363414754 >> [v2:172.21.15.3:6802/974168994,v1:172.21.15.3:6803/974168994] conn(0x7fdce00740a0 0x7fdce00764c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:07.044 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.042+0000 7fdcf9285640 1 -- 172.21.15.3:0/1363414754 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fdce006e2b0 msgr2=0x7fdce0070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:07.044 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.042+0000 7fdcf9285640 1 --2- 172.21.15.3:0/1363414754 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fdce006e2b0 0x7fdce0070770 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fdcf41990e0 tx=0x7fdcdc031400 comp rx=0 tx=0).stop 2024-09-21T12:17:07.044 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.042+0000 7fdcf9285640 1 -- 172.21.15.3:0/1363414754 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdcf40ffdc0 msgr2=0x7fdcf419d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:07.044 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.042+0000 7fdcf9285640 1 --2- 172.21.15.3:0/1363414754 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdcf40ffdc0 0x7fdcf419d730 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fdce400d6f0 tx=0x7fdce400dbb0 comp rx=0 tx=0).stop 2024-09-21T12:17:07.045 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.042+0000 7fdcf9285640 1 -- 172.21.15.3:0/1363414754 shutdown_connections 2024-09-21T12:17:07.045 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.042+0000 7fdcf9285640 1 --2- 172.21.15.3:0/1363414754 >> [v2:172.21.15.3:6802/974168994,v1:172.21.15.3:6803/974168994] conn(0x7fdce00740a0 0x7fdce00764c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:07.045 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.042+0000 7fdcf9285640 1 --2- 172.21.15.3:0/1363414754 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fdce006e2b0 0x7fdce0070770 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:07.045 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.042+0000 7fdcf9285640 1 --2- 172.21.15.3:0/1363414754 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdcf41069a0 0x7fdcf419dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:07.045 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.042+0000 7fdcf9285640 1 --2- 172.21.15.3:0/1363414754 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdcf40ffdc0 0x7fdcf419d730 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:07.045 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.042+0000 7fdcf9285640 1 -- 172.21.15.3:0/1363414754 >> 172.21.15.3:0/1363414754 conn(0x7fdcf40fbc90 msgr2=0x7fdcf40fc590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:07.045 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.042+0000 7fdcf9285640 1 -- 172.21.15.3:0/1363414754 shutdown_connections 2024-09-21T12:17:07.045 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.042+0000 7fdcf9285640 1 -- 172.21.15.3:0/1363414754 wait complete. 2024-09-21T12:17:07.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.595+0000 7faf3db6a640 1 -- 172.21.15.3:0/3959204160 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faf38107900 msgr2=0x7faf38107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:07.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.595+0000 7faf3db6a640 1 --2- 172.21.15.3:0/3959204160 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faf38107900 0x7faf38107ce0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7faf28009880 tx=0x7faf2802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:17:07.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.595+0000 7faf3db6a640 1 -- 172.21.15.3:0/3959204160 shutdown_connections 2024-09-21T12:17:07.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.595+0000 7faf3db6a640 1 --2- 172.21.15.3:0/3959204160 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf38101900 0x7faf38101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:07.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.595+0000 7faf3db6a640 1 --2- 172.21.15.3:0/3959204160 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faf38107900 0x7faf38107ce0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:07.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.595+0000 7faf3db6a640 1 -- 172.21.15.3:0/3959204160 >> 172.21.15.3:0/3959204160 conn(0x7faf380fd600 msgr2=0x7faf380ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:07.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.595+0000 7faf3db6a640 1 -- 172.21.15.3:0/3959204160 shutdown_connections 2024-09-21T12:17:07.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.595+0000 7faf3db6a640 1 -- 172.21.15.3:0/3959204160 wait complete. 2024-09-21T12:17:07.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.596+0000 7faf3db6a640 1 Processor -- start 2024-09-21T12:17:07.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.596+0000 7faf3db6a640 1 -- start start 2024-09-21T12:17:07.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.596+0000 7faf3db6a640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faf38101900 0x7faf3819d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:07.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.596+0000 7faf3db6a640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf38107900 0x7faf3819db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:07.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.596+0000 7faf3db6a640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7faf3810edd0 con 0x7faf38101900 2024-09-21T12:17:07.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.596+0000 7faf3db6a640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7faf3810ec50 con 0x7faf38107900 2024-09-21T12:17:07.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.596+0000 7faf377fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faf38101900 0x7faf3819d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:07.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.596+0000 7faf377fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faf38101900 0x7faf3819d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:49116/0 (socket says 172.21.15.3:49116) 2024-09-21T12:17:07.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.596+0000 7faf377fe640 1 -- 172.21.15.3:0/4000828040 learned_addr learned my addr 172.21.15.3:0/4000828040 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:17:07.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.596+0000 7faf377fe640 1 -- 172.21.15.3:0/4000828040 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf38107900 msgr2=0x7faf3819db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:07.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.596+0000 7faf377fe640 1 --2- 172.21.15.3:0/4000828040 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf38107900 0x7faf3819db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:07.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.596+0000 7faf377fe640 1 -- 172.21.15.3:0/4000828040 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf381977c0 con 0x7faf38101900 2024-09-21T12:17:07.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.597+0000 7faf377fe640 1 --2- 172.21.15.3:0/4000828040 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faf38101900 0x7faf3819d640 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7faf28031460 tx=0x7faf280048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:07.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.597+0000 7faf34ff9640 1 -- 172.21.15.3:0/4000828040 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faf2803f070 con 0x7faf38101900 2024-09-21T12:17:07.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.597+0000 7faf34ff9640 1 -- 172.21.15.3:0/4000828040 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7faf280044d0 con 0x7faf38101900 2024-09-21T12:17:07.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.597+0000 7faf3db6a640 1 -- 172.21.15.3:0/4000828040 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf38197a50 con 0x7faf38101900 2024-09-21T12:17:07.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.597+0000 7faf34ff9640 1 -- 172.21.15.3:0/4000828040 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faf28035030 con 0x7faf38101900 2024-09-21T12:17:07.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.597+0000 7faf3db6a640 1 -- 172.21.15.3:0/4000828040 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf38197f80 con 0x7faf38101900 2024-09-21T12:17:07.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.598+0000 7faf3db6a640 1 -- 172.21.15.3:0/4000828040 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7faf38198600 con 0x7faf38101900 2024-09-21T12:17:07.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.598+0000 7faf34ff9640 1 -- 172.21.15.3:0/4000828040 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 19) ==== 92549+0+0 (secure 0 0 0) 0x7faf28042070 con 0x7faf38101900 2024-09-21T12:17:07.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.599+0000 7faf34ff9640 1 --2- 172.21.15.3:0/4000828040 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7faf2006e300 0x7faf200707c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:07.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.599+0000 7faf34ff9640 1 -- 172.21.15.3:0/4000828040 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7faf280ae860 con 0x7faf38101900 2024-09-21T12:17:07.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.599+0000 7faf36ffd640 1 --2- 172.21.15.3:0/4000828040 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7faf2006e300 0x7faf200707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:07.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.599+0000 7faf34ff9640 1 --2- 172.21.15.3:0/4000828040 >> [v2:172.21.15.3:6818/1433580301,v1:172.21.15.3:6819/1433580301] conn(0x7faf200740f0 0x7faf20076510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:07.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.599+0000 7faf34ff9640 1 -- 172.21.15.3:0/4000828040 --> [v2:172.21.15.3:6818/1433580301,v1:172.21.15.3:6819/1433580301] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faf280054e0 con 0x7faf200740f0 2024-09-21T12:17:07.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.599+0000 7faf34ff9640 1 -- 172.21.15.3:0/4000828040 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7faf280b32a0 con 0x7faf38101900 2024-09-21T12:17:07.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.599+0000 7faf37fff640 1 --2- 172.21.15.3:0/4000828040 >> [v2:172.21.15.3:6818/1433580301,v1:172.21.15.3:6819/1433580301] conn(0x7faf200740f0 0x7faf20076510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:07.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.599+0000 7faf36ffd640 1 --2- 172.21.15.3:0/4000828040 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7faf2006e300 0x7faf200707c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7faf380ffbf0 tx=0x7faf2c005f70 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:07.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.600+0000 7faf37fff640 1 --2- 172.21.15.3:0/4000828040 >> [v2:172.21.15.3:6818/1433580301,v1:172.21.15.3:6819/1433580301] conn(0x7faf200740f0 0x7faf20076510 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:07.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.600+0000 7faf34ff9640 1 -- 172.21.15.3:0/4000828040 <== osd.2 v2:172.21.15.3:6818/1433580301 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7faf280054e0 con 0x7faf200740f0 2024-09-21T12:17:07.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.614+0000 7faf3db6a640 1 -- 172.21.15.3:0/4000828040 --> [v2:172.21.15.3:6818/1433580301,v1:172.21.15.3:6819/1433580301] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7faf380628b0 con 0x7faf200740f0 2024-09-21T12:17:07.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.615+0000 7faf34ff9640 1 -- 172.21.15.3:0/4000828040 <== osd.2 v2:172.21.15.3:6818/1433580301 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7faf380628b0 con 0x7faf200740f0 2024-09-21T12:17:07.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.615+0000 7faf3db6a640 1 -- 172.21.15.3:0/4000828040 >> [v2:172.21.15.3:6818/1433580301,v1:172.21.15.3:6819/1433580301] conn(0x7faf200740f0 msgr2=0x7faf20076510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:07.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.615+0000 7faf3db6a640 1 --2- 172.21.15.3:0/4000828040 >> [v2:172.21.15.3:6818/1433580301,v1:172.21.15.3:6819/1433580301] conn(0x7faf200740f0 0x7faf20076510 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:07.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.615+0000 7faf3db6a640 1 -- 172.21.15.3:0/4000828040 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7faf2006e300 msgr2=0x7faf200707c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:07.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.615+0000 7faf3db6a640 1 --2- 172.21.15.3:0/4000828040 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7faf2006e300 0x7faf200707c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7faf380ffbf0 tx=0x7faf2c005f70 comp rx=0 tx=0).stop 2024-09-21T12:17:07.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.615+0000 7faf3db6a640 1 -- 172.21.15.3:0/4000828040 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faf38101900 msgr2=0x7faf3819d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:07.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.615+0000 7faf3db6a640 1 --2- 172.21.15.3:0/4000828040 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faf38101900 0x7faf3819d640 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7faf28031460 tx=0x7faf280048f0 comp rx=0 tx=0).stop 2024-09-21T12:17:07.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.615+0000 7faf3db6a640 1 -- 172.21.15.3:0/4000828040 shutdown_connections 2024-09-21T12:17:07.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.615+0000 7faf3db6a640 1 --2- 172.21.15.3:0/4000828040 >> [v2:172.21.15.3:6818/1433580301,v1:172.21.15.3:6819/1433580301] conn(0x7faf200740f0 0x7faf20076510 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:07.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.615+0000 7faf3db6a640 1 --2- 172.21.15.3:0/4000828040 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7faf2006e300 0x7faf200707c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:07.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.615+0000 7faf3db6a640 1 --2- 172.21.15.3:0/4000828040 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faf38107900 0x7faf3819db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:07.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.615+0000 7faf3db6a640 1 --2- 172.21.15.3:0/4000828040 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faf38101900 0x7faf3819d640 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:07.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.615+0000 7faf3db6a640 1 -- 172.21.15.3:0/4000828040 >> 172.21.15.3:0/4000828040 conn(0x7faf380fd600 msgr2=0x7faf380fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:07.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.615+0000 7faf3db6a640 1 -- 172.21.15.3:0/4000828040 shutdown_connections 2024-09-21T12:17:07.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:07.615+0000 7faf3db6a640 1 -- 172.21.15.3:0/4000828040 wait complete. 2024-09-21T12:17:08.312 INFO:teuthology.orchestra.run.smithi003.stdout:38654705700 2024-09-21T12:17:08.313 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph osd last-stat-seq osd.0 2024-09-21T12:17:08.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:08 smithi003 ceph-mon[28057]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:17:08.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:08 smithi192 ceph-mon[35641]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:17:08.793 INFO:teuthology.orchestra.run.smithi003.stdout:81604378647 2024-09-21T12:17:08.793 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph osd last-stat-seq osd.2 2024-09-21T12:17:08.837 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:17:08.837 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:17:08.839 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:17:08.840 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:17:09.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.671+0000 7f17c14d1640 1 -- 172.21.15.3:0/3899408685 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f17bc1033d0 msgr2=0x7f17bc10b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:09.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.671+0000 7f17c14d1640 1 --2- 172.21.15.3:0/3899408685 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f17bc1033d0 0x7f17bc10b8c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f17a4009880 tx=0x7f17a402a530 comp rx=0 tx=0).stop 2024-09-21T12:17:09.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.671+0000 7f17c14d1640 1 -- 172.21.15.3:0/3899408685 shutdown_connections 2024-09-21T12:17:09.682 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.671+0000 7f17c14d1640 1 --2- 172.21.15.3:0/3899408685 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f17bc1033d0 0x7f17bc10b8c0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:09.683 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.671+0000 7f17c14d1640 1 --2- 172.21.15.3:0/3899408685 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17bc102ab0 0x7f17bc102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:09.683 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.671+0000 7f17c14d1640 1 -- 172.21.15.3:0/3899408685 >> 172.21.15.3:0/3899408685 conn(0x7f17bc0fc550 msgr2=0x7f17bc0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:09.683 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.671+0000 7f17c14d1640 1 -- 172.21.15.3:0/3899408685 shutdown_connections 2024-09-21T12:17:09.683 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.671+0000 7f17c14d1640 1 -- 172.21.15.3:0/3899408685 wait complete. 2024-09-21T12:17:09.683 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.671+0000 7f17c14d1640 1 Processor -- start 2024-09-21T12:17:09.683 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.672+0000 7f17c14d1640 1 -- start start 2024-09-21T12:17:09.683 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.672+0000 7f17c14d1640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f17bc102ab0 0x7f17bc100710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:09.683 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.672+0000 7f17c14d1640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17bc1033d0 0x7f17bc100c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:09.683 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.672+0000 7f17c14d1640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f17bc10ee40 con 0x7f17bc102ab0 2024-09-21T12:17:09.683 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.672+0000 7f17c14d1640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f17bc10ecc0 con 0x7f17bc1033d0 2024-09-21T12:17:09.683 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.672+0000 7f17baffd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f17bc102ab0 0x7f17bc100710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:09.683 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.672+0000 7f17baffd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f17bc102ab0 0x7f17bc100710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:49128/0 (socket says 172.21.15.3:49128) 2024-09-21T12:17:09.683 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.672+0000 7f17baffd640 1 -- 172.21.15.3:0/3816324427 learned_addr learned my addr 172.21.15.3:0/3816324427 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:17:09.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.672+0000 7f17ba7fc640 1 --2- 172.21.15.3:0/3816324427 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17bc1033d0 0x7f17bc100c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:09.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.672+0000 7f17baffd640 1 -- 172.21.15.3:0/3816324427 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17bc1033d0 msgr2=0x7f17bc100c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:09.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.672+0000 7f17baffd640 1 --2- 172.21.15.3:0/3816324427 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17bc1033d0 0x7f17bc100c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:09.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.672+0000 7f17baffd640 1 -- 172.21.15.3:0/3816324427 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17bc101190 con 0x7f17bc102ab0 2024-09-21T12:17:09.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.673+0000 7f17baffd640 1 --2- 172.21.15.3:0/3816324427 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f17bc102ab0 0x7f17bc100710 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f17b400ba50 tx=0x7f17b400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:09.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.673+0000 7f17b3fff640 1 -- 172.21.15.3:0/3816324427 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f17b4019070 con 0x7f17bc102ab0 2024-09-21T12:17:09.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.673+0000 7f17c14d1640 1 -- 172.21.15.3:0/3816324427 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17bc101480 con 0x7f17bc102ab0 2024-09-21T12:17:09.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.673+0000 7f17b3fff640 1 -- 172.21.15.3:0/3816324427 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f17b400ce20 con 0x7f17bc102ab0 2024-09-21T12:17:09.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.673+0000 7f17b3fff640 1 -- 172.21.15.3:0/3816324427 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f17b40075a0 con 0x7f17bc102ab0 2024-09-21T12:17:09.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.673+0000 7f17c14d1640 1 -- 172.21.15.3:0/3816324427 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17bc1a3eb0 con 0x7f17bc102ab0 2024-09-21T12:17:09.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.674+0000 7f17c14d1640 1 -- 172.21.15.3:0/3816324427 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f17bc0628c0 con 0x7f17bc102ab0 2024-09-21T12:17:09.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.674+0000 7f17b3fff640 1 -- 172.21.15.3:0/3816324427 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 19) ==== 92549+0+0 (secure 0 0 0) 0x7f17b401c070 con 0x7f17bc102ab0 2024-09-21T12:17:09.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.675+0000 7f17b3fff640 1 --2- 172.21.15.3:0/3816324427 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f17a806e2b0 0x7f17a8070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:09.685 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.675+0000 7f17b3fff640 1 -- 172.21.15.3:0/3816324427 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7f17b408d8b0 con 0x7f17bc102ab0 2024-09-21T12:17:09.685 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.675+0000 7f17ba7fc640 1 --2- 172.21.15.3:0/3816324427 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f17a806e2b0 0x7f17a8070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:09.685 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.675+0000 7f17b3fff640 1 --2- 172.21.15.3:0/3816324427 >> [v2:172.21.15.192:6816/1770474426,v1:172.21.15.192:6817/1770474426] conn(0x7f17a80740a0 0x7f17a80764c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:09.685 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.675+0000 7f17b3fff640 1 -- 172.21.15.3:0/3816324427 --> [v2:172.21.15.192:6816/1770474426,v1:172.21.15.192:6817/1770474426] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f17b4015e80 con 0x7f17a80740a0 2024-09-21T12:17:09.685 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.675+0000 7f17b3fff640 1 -- 172.21.15.3:0/3816324427 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f17b40922a0 con 0x7f17bc102ab0 2024-09-21T12:17:09.685 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.675+0000 7f17ba7fc640 1 --2- 172.21.15.3:0/3816324427 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f17a806e2b0 0x7f17a8070770 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f17bc1021a0 tx=0x7f17a4031400 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:09.685 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.675+0000 7f17bb7fe640 1 --2- 172.21.15.3:0/3816324427 >> [v2:172.21.15.192:6816/1770474426,v1:172.21.15.192:6817/1770474426] conn(0x7f17a80740a0 0x7f17a80764c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:09.685 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.676+0000 7f17bb7fe640 1 --2- 172.21.15.3:0/3816324427 >> [v2:172.21.15.192:6816/1770474426,v1:172.21.15.192:6817/1770474426] conn(0x7f17a80740a0 0x7f17a80764c0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:09.685 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.677+0000 7f17b3fff640 1 -- 172.21.15.3:0/3816324427 <== osd.5 v2:172.21.15.192:6816/1770474426 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f17b4015e80 con 0x7f17a80740a0 2024-09-21T12:17:09.692 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.691+0000 7f17c14d1640 1 -- 172.21.15.3:0/3816324427 --> [v2:172.21.15.192:6816/1770474426,v1:172.21.15.192:6817/1770474426] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f17bc062d10 con 0x7f17a80740a0 2024-09-21T12:17:09.693 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.691+0000 7f17b3fff640 1 -- 172.21.15.3:0/3816324427 <== osd.5 v2:172.21.15.192:6816/1770474426 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f17bc062d10 con 0x7f17a80740a0 2024-09-21T12:17:09.693 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.692+0000 7f17c14d1640 1 -- 172.21.15.3:0/3816324427 >> [v2:172.21.15.192:6816/1770474426,v1:172.21.15.192:6817/1770474426] conn(0x7f17a80740a0 msgr2=0x7f17a80764c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:09.693 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.692+0000 7f17c14d1640 1 --2- 172.21.15.3:0/3816324427 >> [v2:172.21.15.192:6816/1770474426,v1:172.21.15.192:6817/1770474426] conn(0x7f17a80740a0 0x7f17a80764c0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:09.694 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.692+0000 7f17c14d1640 1 -- 172.21.15.3:0/3816324427 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f17a806e2b0 msgr2=0x7f17a8070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:09.694 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.692+0000 7f17c14d1640 1 --2- 172.21.15.3:0/3816324427 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f17a806e2b0 0x7f17a8070770 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f17bc1021a0 tx=0x7f17a4031400 comp rx=0 tx=0).stop 2024-09-21T12:17:09.694 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.692+0000 7f17c14d1640 1 -- 172.21.15.3:0/3816324427 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f17bc102ab0 msgr2=0x7f17bc100710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:09.694 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.692+0000 7f17c14d1640 1 --2- 172.21.15.3:0/3816324427 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f17bc102ab0 0x7f17bc100710 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f17b400ba50 tx=0x7f17b400bf10 comp rx=0 tx=0).stop 2024-09-21T12:17:09.694 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.692+0000 7f17c14d1640 1 -- 172.21.15.3:0/3816324427 shutdown_connections 2024-09-21T12:17:09.694 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.692+0000 7f17c14d1640 1 --2- 172.21.15.3:0/3816324427 >> [v2:172.21.15.192:6816/1770474426,v1:172.21.15.192:6817/1770474426] conn(0x7f17a80740a0 0x7f17a80764c0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:09.694 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.692+0000 7f17c14d1640 1 --2- 172.21.15.3:0/3816324427 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f17a806e2b0 0x7f17a8070770 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:09.694 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.692+0000 7f17c14d1640 1 --2- 172.21.15.3:0/3816324427 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17bc1033d0 0x7f17bc100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:09.694 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.692+0000 7f17c14d1640 1 --2- 172.21.15.3:0/3816324427 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f17bc102ab0 0x7f17bc100710 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:09.694 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.692+0000 7f17c14d1640 1 -- 172.21.15.3:0/3816324427 >> 172.21.15.3:0/3816324427 conn(0x7f17bc0fc550 msgr2=0x7f17bc108e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:09.694 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.692+0000 7f17c14d1640 1 -- 172.21.15.3:0/3816324427 shutdown_connections 2024-09-21T12:17:09.694 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.692+0000 7f17c14d1640 1 -- 172.21.15.3:0/3816324427 wait complete. 2024-09-21T12:17:10.236 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.897+0000 7fc641ad7640 1 -- 172.21.15.3:0/2720820589 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc63c101900 msgr2=0x7fc63c101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:10.236 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.897+0000 7fc641ad7640 1 --2- 172.21.15.3:0/2720820589 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc63c101900 0x7fc63c101d60 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fc630009880 tx=0x7fc63002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:17:10.236 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.897+0000 7fc641ad7640 1 -- 172.21.15.3:0/2720820589 shutdown_connections 2024-09-21T12:17:10.236 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.897+0000 7fc641ad7640 1 --2- 172.21.15.3:0/2720820589 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc63c101900 0x7fc63c101d60 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:10.236 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.897+0000 7fc641ad7640 1 --2- 172.21.15.3:0/2720820589 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc63c107900 0x7fc63c107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:10.236 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.897+0000 7fc641ad7640 1 -- 172.21.15.3:0/2720820589 >> 172.21.15.3:0/2720820589 conn(0x7fc63c0fd600 msgr2=0x7fc63c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:10.236 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.897+0000 7fc641ad7640 1 -- 172.21.15.3:0/2720820589 shutdown_connections 2024-09-21T12:17:10.237 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.897+0000 7fc641ad7640 1 -- 172.21.15.3:0/2720820589 wait complete. 2024-09-21T12:17:10.237 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.898+0000 7fc641ad7640 1 Processor -- start 2024-09-21T12:17:10.237 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.898+0000 7fc641ad7640 1 -- start start 2024-09-21T12:17:10.237 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.898+0000 7fc641ad7640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc63c101900 0x7fc63c19d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:10.237 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.898+0000 7fc641ad7640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc63c107900 0x7fc63c19dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:10.237 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.898+0000 7fc641ad7640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fc63c10ee30 con 0x7fc63c107900 2024-09-21T12:17:10.237 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.898+0000 7fc641ad7640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc63c10ecb0 con 0x7fc63c101900 2024-09-21T12:17:10.237 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.898+0000 7fc63affd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc63c107900 0x7fc63c19dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:10.237 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.898+0000 7fc63affd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc63c107900 0x7fc63c19dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:49146/0 (socket says 172.21.15.3:49146) 2024-09-21T12:17:10.237 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.898+0000 7fc63affd640 1 -- 172.21.15.3:0/3219244788 learned_addr learned my addr 172.21.15.3:0/3219244788 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:17:10.237 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.899+0000 7fc63b7fe640 1 --2- 172.21.15.3:0/3219244788 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc63c101900 0x7fc63c19d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:10.237 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.899+0000 7fc63affd640 1 -- 172.21.15.3:0/3219244788 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc63c101900 msgr2=0x7fc63c19d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:10.237 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.899+0000 7fc63affd640 1 --2- 172.21.15.3:0/3219244788 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc63c101900 0x7fc63c19d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:10.237 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.899+0000 7fc63affd640 1 -- 172.21.15.3:0/3219244788 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc63c197840 con 0x7fc63c107900 2024-09-21T12:17:10.237 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.899+0000 7fc63affd640 1 --2- 172.21.15.3:0/3219244788 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc63c107900 0x7fc63c19dc00 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc630031460 tx=0x7fc6300048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:10.237 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.899+0000 7fc638ff9640 1 -- 172.21.15.3:0/3219244788 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc63003f070 con 0x7fc63c107900 2024-09-21T12:17:10.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.899+0000 7fc638ff9640 1 -- 172.21.15.3:0/3219244788 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc630004cf0 con 0x7fc63c107900 2024-09-21T12:17:10.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.899+0000 7fc641ad7640 1 -- 172.21.15.3:0/3219244788 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc63c197ad0 con 0x7fc63c107900 2024-09-21T12:17:10.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.899+0000 7fc638ff9640 1 -- 172.21.15.3:0/3219244788 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc630035030 con 0x7fc63c107900 2024-09-21T12:17:10.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.899+0000 7fc641ad7640 1 -- 172.21.15.3:0/3219244788 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc63c198000 con 0x7fc63c107900 2024-09-21T12:17:10.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.900+0000 7fc641ad7640 1 -- 172.21.15.3:0/3219244788 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc63c1985c0 con 0x7fc63c107900 2024-09-21T12:17:10.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.900+0000 7fc638ff9640 1 -- 172.21.15.3:0/3219244788 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 19) ==== 92549+0+0 (secure 0 0 0) 0x7fc630042070 con 0x7fc63c107900 2024-09-21T12:17:10.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.901+0000 7fc638ff9640 1 --2- 172.21.15.3:0/3219244788 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fc62406e310 0x7fc6240707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:10.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.901+0000 7fc638ff9640 1 -- 172.21.15.3:0/3219244788 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7fc6300ae840 con 0x7fc63c107900 2024-09-21T12:17:10.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.901+0000 7fc63b7fe640 1 --2- 172.21.15.3:0/3219244788 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fc62406e310 0x7fc6240707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:10.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.901+0000 7fc638ff9640 1 --2- 172.21.15.3:0/3219244788 >> [v2:172.21.15.192:6800/2737855393,v1:172.21.15.192:6801/2737855393] conn(0x7fc624074100 0x7fc624076520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:10.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.901+0000 7fc638ff9640 1 -- 172.21.15.3:0/3219244788 --> [v2:172.21.15.192:6800/2737855393,v1:172.21.15.192:6801/2737855393] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc630039e50 con 0x7fc624074100 2024-09-21T12:17:10.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.901+0000 7fc638ff9640 1 -- 172.21.15.3:0/3219244788 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7fc6300b32a0 con 0x7fc63c107900 2024-09-21T12:17:10.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.902+0000 7fc63b7fe640 1 --2- 172.21.15.3:0/3219244788 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fc62406e310 0x7fc6240707d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc62c007dc0 tx=0x7fc62c0072f0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:10.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.902+0000 7fc63bfff640 1 --2- 172.21.15.3:0/3219244788 >> [v2:172.21.15.192:6800/2737855393,v1:172.21.15.192:6801/2737855393] conn(0x7fc624074100 0x7fc624076520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:10.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.902+0000 7fc63bfff640 1 --2- 172.21.15.3:0/3219244788 >> [v2:172.21.15.192:6800/2737855393,v1:172.21.15.192:6801/2737855393] conn(0x7fc624074100 0x7fc624076520 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:10.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.903+0000 7fc638ff9640 1 -- 172.21.15.3:0/3219244788 <== osd.3 v2:172.21.15.192:6800/2737855393 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc630039e50 con 0x7fc624074100 2024-09-21T12:17:10.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.917+0000 7fc641ad7640 1 -- 172.21.15.3:0/3219244788 --> [v2:172.21.15.192:6800/2737855393,v1:172.21.15.192:6801/2737855393] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc63c0628b0 con 0x7fc624074100 2024-09-21T12:17:10.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.918+0000 7fc638ff9640 1 -- 172.21.15.3:0/3219244788 <== osd.3 v2:172.21.15.192:6800/2737855393 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fc63c0628b0 con 0x7fc624074100 2024-09-21T12:17:10.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.918+0000 7fc641ad7640 1 -- 172.21.15.3:0/3219244788 >> [v2:172.21.15.192:6800/2737855393,v1:172.21.15.192:6801/2737855393] conn(0x7fc624074100 msgr2=0x7fc624076520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:10.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.918+0000 7fc641ad7640 1 --2- 172.21.15.3:0/3219244788 >> [v2:172.21.15.192:6800/2737855393,v1:172.21.15.192:6801/2737855393] conn(0x7fc624074100 0x7fc624076520 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:10.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.918+0000 7fc641ad7640 1 -- 172.21.15.3:0/3219244788 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fc62406e310 msgr2=0x7fc6240707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:10.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.918+0000 7fc641ad7640 1 --2- 172.21.15.3:0/3219244788 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fc62406e310 0x7fc6240707d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc62c007dc0 tx=0x7fc62c0072f0 comp rx=0 tx=0).stop 2024-09-21T12:17:10.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.918+0000 7fc641ad7640 1 -- 172.21.15.3:0/3219244788 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc63c107900 msgr2=0x7fc63c19dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:10.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.918+0000 7fc641ad7640 1 --2- 172.21.15.3:0/3219244788 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc63c107900 0x7fc63c19dc00 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fc630031460 tx=0x7fc6300048f0 comp rx=0 tx=0).stop 2024-09-21T12:17:10.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.918+0000 7fc641ad7640 1 -- 172.21.15.3:0/3219244788 shutdown_connections 2024-09-21T12:17:10.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.918+0000 7fc641ad7640 1 --2- 172.21.15.3:0/3219244788 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fc62406e310 0x7fc6240707d0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:10.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.918+0000 7fc641ad7640 1 --2- 172.21.15.3:0/3219244788 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc63c107900 0x7fc63c19dc00 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:10.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.919+0000 7fc641ad7640 1 --2- 172.21.15.3:0/3219244788 >> [v2:172.21.15.192:6800/2737855393,v1:172.21.15.192:6801/2737855393] conn(0x7fc624074100 0x7fc624076520 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:10.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.919+0000 7fc641ad7640 1 --2- 172.21.15.3:0/3219244788 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc63c101900 0x7fc63c19d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:10.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.919+0000 7fc641ad7640 1 -- 172.21.15.3:0/3219244788 >> 172.21.15.3:0/3219244788 conn(0x7fc63c0fd600 msgr2=0x7fc63c0fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:10.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.919+0000 7fc641ad7640 1 -- 172.21.15.3:0/3219244788 shutdown_connections 2024-09-21T12:17:10.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:09.919+0000 7fc641ad7640 1 -- 172.21.15.3:0/3219244788 wait complete. 2024-09-21T12:17:10.574 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:10 smithi003 ceph-mon[28057]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:17:10.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:10 smithi192 ceph-mon[35641]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:17:10.789 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:10.781+0000 7f1107c15640 1 -- 172.21.15.3:0/2780423547 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f11001033d0 msgr2=0x7f110010b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:10.789 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:10.781+0000 7f1107c15640 1 --2- 172.21.15.3:0/2780423547 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f11001033d0 0x7f110010b8c0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f10f8009c20 tx=0x7f10f802aa00 comp rx=0 tx=0).stop 2024-09-21T12:17:10.789 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:10.781+0000 7f1107c15640 1 -- 172.21.15.3:0/2780423547 shutdown_connections 2024-09-21T12:17:10.789 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:10.781+0000 7f1107c15640 1 --2- 172.21.15.3:0/2780423547 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f11001033d0 0x7f110010b8c0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:10.789 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:10.781+0000 7f1107c15640 1 --2- 172.21.15.3:0/2780423547 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1100102ab0 0x7f1100102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:10.789 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:10.781+0000 7f1107c15640 1 -- 172.21.15.3:0/2780423547 >> 172.21.15.3:0/2780423547 conn(0x7f11000fc550 msgr2=0x7f11000fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:10.789 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:10.781+0000 7f1107c15640 1 -- 172.21.15.3:0/2780423547 shutdown_connections 2024-09-21T12:17:10.789 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:10.781+0000 7f1107c15640 1 -- 172.21.15.3:0/2780423547 wait complete. 2024-09-21T12:17:10.789 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:10.781+0000 7f1107c15640 1 Processor -- start 2024-09-21T12:17:10.790 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:10.781+0000 7f1107c15640 1 -- start start 2024-09-21T12:17:10.790 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:10.782+0000 7f1107c15640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1100102ab0 0x7f110019d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:10.790 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:10.782+0000 7f1107c15640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f11001033d0 0x7f110019dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:10.790 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:10.782+0000 7f1107c15640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f110010ede0 con 0x7f11001033d0 2024-09-21T12:17:10.790 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:10.782+0000 7f1107c15640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f110010ec60 con 0x7f1100102ab0 2024-09-21T12:17:10.790 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:10.782+0000 7f11051b0640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f11001033d0 0x7f110019dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:10.790 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:10.782+0000 7f11051b0640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f11001033d0 0x7f110019dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44702/0 (socket says 172.21.15.3:44702) 2024-09-21T12:17:10.790 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:10.782+0000 7f11051b0640 1 -- 172.21.15.3:0/3823282953 learned_addr learned my addr 172.21.15.3:0/3823282953 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:17:10.790 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:10.782+0000 7f11059b1640 1 --2- 172.21.15.3:0/3823282953 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1100102ab0 0x7f110019d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:10.790 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:10.782+0000 7f11051b0640 1 -- 172.21.15.3:0/3823282953 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1100102ab0 msgr2=0x7f110019d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:10.790 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:10.782+0000 7f11051b0640 1 --2- 172.21.15.3:0/3823282953 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1100102ab0 0x7f110019d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:10.790 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:10.782+0000 7f11051b0640 1 -- 172.21.15.3:0/3823282953 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1100197810 con 0x7f11001033d0 2024-09-21T12:17:10.791 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:10.782+0000 7f11051b0640 1 --2- 172.21.15.3:0/3823282953 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f11001033d0 0x7f110019dbd0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f10f802af20 tx=0x7f10f802ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:10.791 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:10.783+0000 7f10f6ffd640 1 -- 172.21.15.3:0/3823282953 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f10f8047070 con 0x7f11001033d0 2024-09-21T12:17:10.791 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:10.783+0000 7f1107c15640 1 -- 172.21.15.3:0/3823282953 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1100197aa0 con 0x7f11001033d0 2024-09-21T12:17:10.791 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:10.783+0000 7f10f6ffd640 1 -- 172.21.15.3:0/3823282953 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f10f802eeb0 con 0x7f11001033d0 2024-09-21T12:17:10.791 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:10.783+0000 7f10f6ffd640 1 -- 172.21.15.3:0/3823282953 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f10f8033050 con 0x7f11001033d0 2024-09-21T12:17:10.791 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:10.783+0000 7f1107c15640 1 -- 172.21.15.3:0/3823282953 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1100197fd0 con 0x7f11001033d0 2024-09-21T12:17:10.791 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:10.783+0000 7f1107c15640 1 -- 172.21.15.3:0/3823282953 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1100198650 con 0x7f11001033d0 2024-09-21T12:17:10.791 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:10.784+0000 7f10f6ffd640 1 -- 172.21.15.3:0/3823282953 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 19) ==== 92549+0+0 (secure 0 0 0) 0x7f10f804a070 con 0x7f11001033d0 2024-09-21T12:17:10.791 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:10.785+0000 7f10f6ffd640 1 --2- 172.21.15.3:0/3823282953 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f10ec06e2b0 0x7f10ec070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:10.791 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:10.785+0000 7f11059b1640 1 --2- 172.21.15.3:0/3823282953 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f10ec06e2b0 0x7f10ec070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:10.791 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:10.785+0000 7f10f6ffd640 1 -- 172.21.15.3:0/3823282953 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7f10f803e030 con 0x7f11001033d0 2024-09-21T12:17:10.791 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:10.785+0000 7f10f6ffd640 1 --2- 172.21.15.3:0/3823282953 >> [v2:172.21.15.3:6810/3334119815,v1:172.21.15.3:6811/3334119815] conn(0x7f10ec0740a0 0x7f10ec0764c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:10.791 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:10.785+0000 7f10f6ffd640 1 -- 172.21.15.3:0/3823282953 --> [v2:172.21.15.3:6810/3334119815,v1:172.21.15.3:6811/3334119815] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f10f80020b0 con 0x7f10ec0740a0 2024-09-21T12:17:10.791 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:10.785+0000 7f10f6ffd640 1 -- 172.21.15.3:0/3823282953 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f10f80af6c0 con 0x7f11001033d0 2024-09-21T12:17:10.791 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:10.785+0000 7f11061b2640 1 --2- 172.21.15.3:0/3823282953 >> [v2:172.21.15.3:6810/3334119815,v1:172.21.15.3:6811/3334119815] conn(0x7f10ec0740a0 0x7f10ec0764c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:10.792 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:10.785+0000 7f11059b1640 1 --2- 172.21.15.3:0/3823282953 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f10ec06e2b0 0x7f10ec070770 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f10fc005fd0 tx=0x7f10fc00b390 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:10.792 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:10.785+0000 7f11061b2640 1 --2- 172.21.15.3:0/3823282953 >> [v2:172.21.15.3:6810/3334119815,v1:172.21.15.3:6811/3334119815] conn(0x7f10ec0740a0 0x7f10ec0764c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:10.792 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:10.786+0000 7f10f6ffd640 1 -- 172.21.15.3:0/3823282953 <== osd.1 v2:172.21.15.3:6810/3334119815 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f10f80020b0 con 0x7f10ec0740a0 2024-09-21T12:17:10.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:10.800+0000 7f1107c15640 1 -- 172.21.15.3:0/3823282953 --> [v2:172.21.15.3:6810/3334119815,v1:172.21.15.3:6811/3334119815] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1100062880 con 0x7f10ec0740a0 2024-09-21T12:17:10.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:10.800+0000 7f10f6ffd640 1 -- 172.21.15.3:0/3823282953 <== osd.1 v2:172.21.15.3:6810/3334119815 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1100062880 con 0x7f10ec0740a0 2024-09-21T12:17:10.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:10.800+0000 7f1107c15640 1 -- 172.21.15.3:0/3823282953 >> [v2:172.21.15.3:6810/3334119815,v1:172.21.15.3:6811/3334119815] conn(0x7f10ec0740a0 msgr2=0x7f10ec0764c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:10.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:10.800+0000 7f1107c15640 1 --2- 172.21.15.3:0/3823282953 >> [v2:172.21.15.3:6810/3334119815,v1:172.21.15.3:6811/3334119815] conn(0x7f10ec0740a0 0x7f10ec0764c0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:10.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:10.800+0000 7f1107c15640 1 -- 172.21.15.3:0/3823282953 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f10ec06e2b0 msgr2=0x7f10ec070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:10.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:10.800+0000 7f1107c15640 1 --2- 172.21.15.3:0/3823282953 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f10ec06e2b0 0x7f10ec070770 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f10fc005fd0 tx=0x7f10fc00b390 comp rx=0 tx=0).stop 2024-09-21T12:17:10.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:10.800+0000 7f1107c15640 1 -- 172.21.15.3:0/3823282953 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f11001033d0 msgr2=0x7f110019dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:10.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:10.800+0000 7f1107c15640 1 --2- 172.21.15.3:0/3823282953 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f11001033d0 0x7f110019dbd0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f10f802af20 tx=0x7f10f802ed40 comp rx=0 tx=0).stop 2024-09-21T12:17:10.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:10.800+0000 7f1107c15640 1 -- 172.21.15.3:0/3823282953 shutdown_connections 2024-09-21T12:17:10.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:10.800+0000 7f1107c15640 1 --2- 172.21.15.3:0/3823282953 >> [v2:172.21.15.3:6810/3334119815,v1:172.21.15.3:6811/3334119815] conn(0x7f10ec0740a0 0x7f10ec0764c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:10.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:10.800+0000 7f1107c15640 1 --2- 172.21.15.3:0/3823282953 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f10ec06e2b0 0x7f10ec070770 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:10.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:10.800+0000 7f1107c15640 1 --2- 172.21.15.3:0/3823282953 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f11001033d0 0x7f110019dbd0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:10.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:10.800+0000 7f1107c15640 1 --2- 172.21.15.3:0/3823282953 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1100102ab0 0x7f110019d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:10.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:10.800+0000 7f1107c15640 1 -- 172.21.15.3:0/3823282953 >> 172.21.15.3:0/3823282953 conn(0x7f11000fc550 msgr2=0x7f1100108ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:10.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:10.800+0000 7f1107c15640 1 -- 172.21.15.3:0/3823282953 shutdown_connections 2024-09-21T12:17:10.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:10.801+0000 7f1107c15640 1 -- 172.21.15.3:0/3823282953 wait complete. 2024-09-21T12:17:11.699 INFO:teuthology.orchestra.run.smithi003.stdout:167503724550 2024-09-21T12:17:11.699 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph osd last-stat-seq osd.5 2024-09-21T12:17:12.120 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:12.112+0000 7f227ede0640 1 -- 172.21.15.3:0/1364440601 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f22781033d0 msgr2=0x7f227810b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:12.121 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:12.112+0000 7f227ede0640 1 --2- 172.21.15.3:0/1364440601 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f22781033d0 0x7f227810b8c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f2260009880 tx=0x7f226002a530 comp rx=0 tx=0).stop 2024-09-21T12:17:12.121 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:12.113+0000 7f227ede0640 1 -- 172.21.15.3:0/1364440601 shutdown_connections 2024-09-21T12:17:12.121 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:12.113+0000 7f227ede0640 1 --2- 172.21.15.3:0/1364440601 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f22781033d0 0x7f227810b8c0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:12.121 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:12.113+0000 7f227ede0640 1 --2- 172.21.15.3:0/1364440601 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2278102ab0 0x7f2278102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:12.121 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:12.113+0000 7f227ede0640 1 -- 172.21.15.3:0/1364440601 >> 172.21.15.3:0/1364440601 conn(0x7f22780fc550 msgr2=0x7f22780fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:12.121 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:12.113+0000 7f227ede0640 1 -- 172.21.15.3:0/1364440601 shutdown_connections 2024-09-21T12:17:12.121 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:12.113+0000 7f227ede0640 1 -- 172.21.15.3:0/1364440601 wait complete. 2024-09-21T12:17:12.121 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:12.113+0000 7f227ede0640 1 Processor -- start 2024-09-21T12:17:12.121 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:12.113+0000 7f227ede0640 1 -- start start 2024-09-21T12:17:12.121 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:12.113+0000 7f227ede0640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2278102ab0 0x7f2278100710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:12.121 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:12.113+0000 7f227ede0640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f22781033d0 0x7f2278100c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:12.121 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:12.113+0000 7f227ede0640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f227810edc0 con 0x7f2278102ab0 2024-09-21T12:17:12.122 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:12.113+0000 7f227ede0640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f227810ec40 con 0x7f22781033d0 2024-09-21T12:17:12.122 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:12.114+0000 7f227cb7c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2278102ab0 0x7f2278100710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:12.122 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:12.114+0000 7f227cb7c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2278102ab0 0x7f2278100710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44714/0 (socket says 172.21.15.3:44714) 2024-09-21T12:17:12.122 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:12.114+0000 7f227cb7c640 1 -- 172.21.15.3:0/3056683411 learned_addr learned my addr 172.21.15.3:0/3056683411 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:17:12.122 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:12.114+0000 7f2277fff640 1 --2- 172.21.15.3:0/3056683411 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f22781033d0 0x7f2278100c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:12.122 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:12.114+0000 7f227cb7c640 1 -- 172.21.15.3:0/3056683411 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f22781033d0 msgr2=0x7f2278100c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:12.122 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:12.114+0000 7f227cb7c640 1 --2- 172.21.15.3:0/3056683411 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f22781033d0 0x7f2278100c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:12.122 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:12.114+0000 7f227cb7c640 1 -- 172.21.15.3:0/3056683411 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2278101190 con 0x7f2278102ab0 2024-09-21T12:17:12.122 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:12.114+0000 7f227cb7c640 1 --2- 172.21.15.3:0/3056683411 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2278102ab0 0x7f2278100710 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f226800ea30 tx=0x7f226800eef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:12.122 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:12.114+0000 7f2275ffb640 1 -- 172.21.15.3:0/3056683411 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f226800cbe0 con 0x7f2278102ab0 2024-09-21T12:17:12.122 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:12.114+0000 7f2275ffb640 1 -- 172.21.15.3:0/3056683411 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f226800cd80 con 0x7f2278102ab0 2024-09-21T12:17:12.122 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:12.114+0000 7f227ede0640 1 -- 172.21.15.3:0/3056683411 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2278101480 con 0x7f2278102ab0 2024-09-21T12:17:12.123 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:12.114+0000 7f2275ffb640 1 -- 172.21.15.3:0/3056683411 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f226801a920 con 0x7f2278102ab0 2024-09-21T12:17:12.123 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:12.114+0000 7f227ede0640 1 -- 172.21.15.3:0/3056683411 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22781a3e10 con 0x7f2278102ab0 2024-09-21T12:17:12.123 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:12.115+0000 7f227ede0640 1 -- 172.21.15.3:0/3056683411 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f227810b850 con 0x7f2278102ab0 2024-09-21T12:17:12.123 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:12.116+0000 7f2275ffb640 1 -- 172.21.15.3:0/3056683411 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 19) ==== 92549+0+0 (secure 0 0 0) 0x7f226801abd0 con 0x7f2278102ab0 2024-09-21T12:17:12.123 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:12.116+0000 7f2275ffb640 1 --2- 172.21.15.3:0/3056683411 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f226406e2b0 0x7f2264070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:12.123 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:12.116+0000 7f2275ffb640 1 -- 172.21.15.3:0/3056683411 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7f226808e550 con 0x7f2278102ab0 2024-09-21T12:17:12.123 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:12.116+0000 7f2277fff640 1 --2- 172.21.15.3:0/3056683411 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f226406e2b0 0x7f2264070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:12.123 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:12.116+0000 7f2275ffb640 1 --2- 172.21.15.3:0/3056683411 >> [v2:172.21.15.192:6808/1341504680,v1:172.21.15.192:6809/1341504680] conn(0x7f22640740a0 0x7f22640764c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:12.123 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:12.116+0000 7f2275ffb640 1 -- 172.21.15.3:0/3056683411 --> [v2:172.21.15.192:6808/1341504680,v1:172.21.15.192:6809/1341504680] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2268014ec0 con 0x7f22640740a0 2024-09-21T12:17:12.123 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:12.116+0000 7f2275ffb640 1 -- 172.21.15.3:0/3056683411 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) ==== 24+0+0 (secure 0 0 0) 0x7f2268095050 con 0x7f2278102ab0 2024-09-21T12:17:12.123 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:12.117+0000 7f227d37d640 1 --2- 172.21.15.3:0/3056683411 >> [v2:172.21.15.192:6808/1341504680,v1:172.21.15.192:6809/1341504680] conn(0x7f22640740a0 0x7f22640764c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:12.123 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:12.117+0000 7f2277fff640 1 --2- 172.21.15.3:0/3056683411 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f226406e2b0 0x7f2264070770 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f22781021a0 tx=0x7f2260031400 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:12.123 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:12.117+0000 7f227d37d640 1 --2- 172.21.15.3:0/3056683411 >> [v2:172.21.15.192:6808/1341504680,v1:172.21.15.192:6809/1341504680] conn(0x7f22640740a0 0x7f22640764c0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:12.123 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:12.118+0000 7f2275ffb640 1 -- 172.21.15.3:0/3056683411 <== osd.4 v2:172.21.15.192:6808/1341504680 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2268014ec0 con 0x7f22640740a0 2024-09-21T12:17:12.134 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:12.132+0000 7f227ede0640 1 -- 172.21.15.3:0/3056683411 --> [v2:172.21.15.192:6808/1341504680,v1:172.21.15.192:6809/1341504680] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f227806a580 con 0x7f22640740a0 2024-09-21T12:17:12.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:12.133+0000 7f2275ffb640 1 -- 172.21.15.3:0/3056683411 <== osd.4 v2:172.21.15.192:6808/1341504680 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f227806a580 con 0x7f22640740a0 2024-09-21T12:17:12.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:12.133+0000 7f227ede0640 1 -- 172.21.15.3:0/3056683411 >> [v2:172.21.15.192:6808/1341504680,v1:172.21.15.192:6809/1341504680] conn(0x7f22640740a0 msgr2=0x7f22640764c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:12.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:12.133+0000 7f227ede0640 1 --2- 172.21.15.3:0/3056683411 >> [v2:172.21.15.192:6808/1341504680,v1:172.21.15.192:6809/1341504680] conn(0x7f22640740a0 0x7f22640764c0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:12.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:12.133+0000 7f227ede0640 1 -- 172.21.15.3:0/3056683411 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f226406e2b0 msgr2=0x7f2264070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:12.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:12.133+0000 7f227ede0640 1 --2- 172.21.15.3:0/3056683411 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f226406e2b0 0x7f2264070770 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f22781021a0 tx=0x7f2260031400 comp rx=0 tx=0).stop 2024-09-21T12:17:12.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:12.133+0000 7f227ede0640 1 -- 172.21.15.3:0/3056683411 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2278102ab0 msgr2=0x7f2278100710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:12.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:12.133+0000 7f227ede0640 1 --2- 172.21.15.3:0/3056683411 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2278102ab0 0x7f2278100710 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f226800ea30 tx=0x7f226800eef0 comp rx=0 tx=0).stop 2024-09-21T12:17:12.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:12.134+0000 7f227ede0640 1 -- 172.21.15.3:0/3056683411 shutdown_connections 2024-09-21T12:17:12.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:12.134+0000 7f227ede0640 1 --2- 172.21.15.3:0/3056683411 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f226406e2b0 0x7f2264070770 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:12.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:12.134+0000 7f227ede0640 1 --2- 172.21.15.3:0/3056683411 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f22781033d0 0x7f2278100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:12.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:12.134+0000 7f227ede0640 1 --2- 172.21.15.3:0/3056683411 >> [v2:172.21.15.192:6808/1341504680,v1:172.21.15.192:6809/1341504680] conn(0x7f22640740a0 0x7f22640764c0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:12.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:12.134+0000 7f227ede0640 1 --2- 172.21.15.3:0/3056683411 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2278102ab0 0x7f2278100710 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:12.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:12.134+0000 7f227ede0640 1 -- 172.21.15.3:0/3056683411 >> 172.21.15.3:0/3056683411 conn(0x7f22780fc550 msgr2=0x7f227810aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:12.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:12.134+0000 7f227ede0640 1 -- 172.21.15.3:0/3056683411 shutdown_connections 2024-09-21T12:17:12.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:12.134+0000 7f227ede0640 1 -- 172.21.15.3:0/3056683411 wait complete. 2024-09-21T12:17:12.724 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:12 smithi003 ceph-mon[28057]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:17:12.756 INFO:teuthology.orchestra.run.smithi003.stdout:111669149715 2024-09-21T12:17:12.757 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph osd last-stat-seq osd.3 2024-09-21T12:17:12.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:12 smithi192 ceph-mon[35641]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:17:13.448 INFO:teuthology.orchestra.run.smithi003.stdout:60129542173 2024-09-21T12:17:13.449 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph osd last-stat-seq osd.1 2024-09-21T12:17:13.848 INFO:teuthology.orchestra.run.smithi003.stdout:146028888077 2024-09-21T12:17:13.848 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph osd last-stat-seq osd.4 2024-09-21T12:17:13.906 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:17:13.906 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:17:13.907 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:17:13.908 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:17:13.958 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:17:14.656 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:14 smithi003 ceph-mon[28057]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:17:14.675 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:14.653+0000 7f446e5a0640 1 -- 172.21.15.3:0/140763027 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4468074620 msgr2=0x7f4468074a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:14.675 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:14.653+0000 7f446e5a0640 1 --2- 172.21.15.3:0/140763027 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4468074620 0x7f4468074a00 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f4464009880 tx=0x7f446402a530 comp rx=0 tx=0).stop 2024-09-21T12:17:14.675 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:14.653+0000 7f446e5a0640 1 -- 172.21.15.3:0/140763027 shutdown_connections 2024-09-21T12:17:14.675 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:14.653+0000 7f446e5a0640 1 --2- 172.21.15.3:0/140763027 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4468074f40 0x7f446810da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:14.675 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:14.653+0000 7f446e5a0640 1 --2- 172.21.15.3:0/140763027 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4468074620 0x7f4468074a00 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:14.675 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:14.653+0000 7f446e5a0640 1 -- 172.21.15.3:0/140763027 >> 172.21.15.3:0/140763027 conn(0x7f44680fd470 msgr2=0x7f44680ff890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:14.675 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:14.653+0000 7f446e5a0640 1 -- 172.21.15.3:0/140763027 shutdown_connections 2024-09-21T12:17:14.675 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:14.653+0000 7f446e5a0640 1 -- 172.21.15.3:0/140763027 wait complete. 2024-09-21T12:17:14.676 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:14.654+0000 7f446e5a0640 1 Processor -- start 2024-09-21T12:17:14.676 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:14.654+0000 7f446e5a0640 1 -- start start 2024-09-21T12:17:14.676 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:14.654+0000 7f446e5a0640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4468074620 0x7f446819f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:14.676 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:14.654+0000 7f446e5a0640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4468074f40 0x7f446819fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:14.676 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:14.654+0000 7f446e5a0640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f4468110ea0 con 0x7f4468074620 2024-09-21T12:17:14.676 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:14.654+0000 7f446e5a0640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f4468110d20 con 0x7f4468074f40 2024-09-21T12:17:14.676 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:14.654+0000 7f446d59e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4468074620 0x7f446819f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:14.676 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:14.654+0000 7f446d59e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4468074620 0x7f446819f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44728/0 (socket says 172.21.15.3:44728) 2024-09-21T12:17:14.676 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:14.654+0000 7f446d59e640 1 -- 172.21.15.3:0/1746827500 learned_addr learned my addr 172.21.15.3:0/1746827500 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:17:14.676 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:14.655+0000 7f446cd9d640 1 --2- 172.21.15.3:0/1746827500 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4468074f40 0x7f446819fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:14.676 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:14.655+0000 7f446d59e640 1 -- 172.21.15.3:0/1746827500 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4468074f40 msgr2=0x7f446819fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:14.676 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:14.655+0000 7f446d59e640 1 --2- 172.21.15.3:0/1746827500 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4468074f40 0x7f446819fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:14.676 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:14.655+0000 7f446d59e640 1 -- 172.21.15.3:0/1746827500 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44681998b0 con 0x7f4468074620 2024-09-21T12:17:14.676 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:14.655+0000 7f446d59e640 1 --2- 172.21.15.3:0/1746827500 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4468074620 0x7f446819f6f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4464031460 tx=0x7f44640048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:14.677 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:14.655+0000 7f445e7fc640 1 -- 172.21.15.3:0/1746827500 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f446403f070 con 0x7f4468074620 2024-09-21T12:17:14.677 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:14.655+0000 7f445e7fc640 1 -- 172.21.15.3:0/1746827500 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4464004cf0 con 0x7f4468074620 2024-09-21T12:17:14.677 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:14.655+0000 7f446e5a0640 1 -- 172.21.15.3:0/1746827500 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4468199b40 con 0x7f4468074620 2024-09-21T12:17:14.677 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:14.655+0000 7f445e7fc640 1 -- 172.21.15.3:0/1746827500 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4464035030 con 0x7f4468074620 2024-09-21T12:17:14.677 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:14.655+0000 7f446e5a0640 1 -- 172.21.15.3:0/1746827500 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f446819a070 con 0x7f4468074620 2024-09-21T12:17:14.677 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:14.656+0000 7f446e5a0640 1 -- 172.21.15.3:0/1746827500 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4468075cd0 con 0x7f4468074620 2024-09-21T12:17:14.677 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:14.657+0000 7f445e7fc640 1 -- 172.21.15.3:0/1746827500 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 19) ==== 92549+0+0 (secure 0 0 0) 0x7f4464042070 con 0x7f4468074620 2024-09-21T12:17:14.677 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:14.657+0000 7f445e7fc640 1 --2- 172.21.15.3:0/1746827500 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f445406e310 0x7f44540707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:14.677 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:14.657+0000 7f445e7fc640 1 -- 172.21.15.3:0/1746827500 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7f44640ae840 con 0x7f4468074620 2024-09-21T12:17:14.677 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:14.657+0000 7f446cd9d640 1 --2- 172.21.15.3:0/1746827500 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f445406e310 0x7f44540707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:14.677 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:14.658+0000 7f446cd9d640 1 --2- 172.21.15.3:0/1746827500 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f445406e310 0x7f44540707d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f446810aa80 tx=0x7f4458008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:14.677 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:14.662+0000 7f445e7fc640 1 -- 172.21.15.3:0/1746827500 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f446407c560 con 0x7f4468074620 2024-09-21T12:17:14.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:14 smithi192 ceph-mon[35641]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:17:14.842 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:14.840+0000 7f446e5a0640 1 -- 172.21.15.3:0/1746827500 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f446819ade0 con 0x7f4468074620 2024-09-21T12:17:14.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:14.840+0000 7f445e7fc640 1 -- 172.21.15.3:0/1746827500 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f4464080210 con 0x7f4468074620 2024-09-21T12:17:14.843 INFO:teuthology.orchestra.run.smithi003.stdout:167503724551 2024-09-21T12:17:14.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:14.842+0000 7f446e5a0640 1 -- 172.21.15.3:0/1746827500 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f445406e310 msgr2=0x7f44540707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:14.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:14.842+0000 7f446e5a0640 1 --2- 172.21.15.3:0/1746827500 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f445406e310 0x7f44540707d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f446810aa80 tx=0x7f4458008040 comp rx=0 tx=0).stop 2024-09-21T12:17:14.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:14.842+0000 7f446e5a0640 1 -- 172.21.15.3:0/1746827500 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4468074620 msgr2=0x7f446819f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:14.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:14.842+0000 7f446e5a0640 1 --2- 172.21.15.3:0/1746827500 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4468074620 0x7f446819f6f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4464031460 tx=0x7f44640048f0 comp rx=0 tx=0).stop 2024-09-21T12:17:14.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:14.842+0000 7f446e5a0640 1 -- 172.21.15.3:0/1746827500 shutdown_connections 2024-09-21T12:17:14.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:14.842+0000 7f446e5a0640 1 --2- 172.21.15.3:0/1746827500 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f445406e310 0x7f44540707d0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:14.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:14.842+0000 7f446e5a0640 1 --2- 172.21.15.3:0/1746827500 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4468074f40 0x7f446819fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:14.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:14.842+0000 7f446e5a0640 1 --2- 172.21.15.3:0/1746827500 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4468074620 0x7f446819f6f0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:14.846 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:14.842+0000 7f446e5a0640 1 -- 172.21.15.3:0/1746827500 >> 172.21.15.3:0/1746827500 conn(0x7f44680fd470 msgr2=0x7f446810b0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:14.846 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:14.842+0000 7f446e5a0640 1 -- 172.21.15.3:0/1746827500 shutdown_connections 2024-09-21T12:17:14.846 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:14.842+0000 7f446e5a0640 1 -- 172.21.15.3:0/1746827500 wait complete. 2024-09-21T12:17:15.174 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.159+0000 7f42e1f82640 1 -- 172.21.15.3:0/3906195699 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f42dc103490 msgr2=0x7f42dc10b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:15.175 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.159+0000 7f42e1f82640 1 --2- 172.21.15.3:0/3906195699 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f42dc103490 0x7f42dc10b980 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f42d0009880 tx=0x7f42d002a530 comp rx=0 tx=0).stop 2024-09-21T12:17:15.175 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.159+0000 7f42e1f82640 1 -- 172.21.15.3:0/3906195699 shutdown_connections 2024-09-21T12:17:15.175 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.159+0000 7f42e1f82640 1 --2- 172.21.15.3:0/3906195699 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f42dc103490 0x7f42dc10b980 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:15.175 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.159+0000 7f42e1f82640 1 --2- 172.21.15.3:0/3906195699 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42dc102b70 0x7f42dc102f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:15.175 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.159+0000 7f42e1f82640 1 -- 172.21.15.3:0/3906195699 >> 172.21.15.3:0/3906195699 conn(0x7f42dc0fc550 msgr2=0x7f42dc0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:15.175 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.159+0000 7f42e1f82640 1 -- 172.21.15.3:0/3906195699 shutdown_connections 2024-09-21T12:17:15.175 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.159+0000 7f42e1f82640 1 -- 172.21.15.3:0/3906195699 wait complete. 2024-09-21T12:17:15.175 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.160+0000 7f42e1f82640 1 Processor -- start 2024-09-21T12:17:15.175 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.160+0000 7f42e1f82640 1 -- start start 2024-09-21T12:17:15.175 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.160+0000 7f42e1f82640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42dc102b70 0x7f42dc1007d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:15.175 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.160+0000 7f42e1f82640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f42dc103490 0x7f42dc100d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:15.175 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.160+0000 7f42e1f82640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f42dc10ede0 con 0x7f42dc103490 2024-09-21T12:17:15.175 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.160+0000 7f42e1f82640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f42dc10ec60 con 0x7f42dc102b70 2024-09-21T12:17:15.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.160+0000 7f42daffd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f42dc103490 0x7f42dc100d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:15.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.160+0000 7f42daffd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f42dc103490 0x7f42dc100d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44774/0 (socket says 172.21.15.3:44774) 2024-09-21T12:17:15.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.160+0000 7f42daffd640 1 -- 172.21.15.3:0/1406398767 learned_addr learned my addr 172.21.15.3:0/1406398767 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:17:15.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.161+0000 7f42daffd640 1 -- 172.21.15.3:0/1406398767 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42dc102b70 msgr2=0x7f42dc1007d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:15.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.161+0000 7f42daffd640 1 --2- 172.21.15.3:0/1406398767 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42dc102b70 0x7f42dc1007d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:15.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.161+0000 7f42daffd640 1 -- 172.21.15.3:0/1406398767 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42dc101250 con 0x7f42dc103490 2024-09-21T12:17:15.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.161+0000 7f42daffd640 1 --2- 172.21.15.3:0/1406398767 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f42dc103490 0x7f42dc100d10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f42d0004f90 tx=0x7f42d00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:15.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.161+0000 7f42d8ff9640 1 -- 172.21.15.3:0/1406398767 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f42d003f070 con 0x7f42dc103490 2024-09-21T12:17:15.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.161+0000 7f42e1f82640 1 -- 172.21.15.3:0/1406398767 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42dc1014e0 con 0x7f42dc103490 2024-09-21T12:17:15.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.161+0000 7f42d8ff9640 1 -- 172.21.15.3:0/1406398767 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f42d0004cf0 con 0x7f42dc103490 2024-09-21T12:17:15.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.161+0000 7f42d8ff9640 1 -- 172.21.15.3:0/1406398767 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f42d0035030 con 0x7f42dc103490 2024-09-21T12:17:15.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.161+0000 7f42e1f82640 1 -- 172.21.15.3:0/1406398767 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42dc1a3d90 con 0x7f42dc103490 2024-09-21T12:17:15.177 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.162+0000 7f42e1f82640 1 -- 172.21.15.3:0/1406398767 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42dc06a4c0 con 0x7f42dc103490 2024-09-21T12:17:15.177 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.163+0000 7f42d8ff9640 1 -- 172.21.15.3:0/1406398767 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 19) ==== 92549+0+0 (secure 0 0 0) 0x7f42d0042070 con 0x7f42dc103490 2024-09-21T12:17:15.177 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.163+0000 7f42d8ff9640 1 --2- 172.21.15.3:0/1406398767 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f42c406e2b0 0x7f42c4070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:15.177 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.163+0000 7f42d8ff9640 1 -- 172.21.15.3:0/1406398767 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7f42d00ae8b0 con 0x7f42dc103490 2024-09-21T12:17:15.177 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.163+0000 7f42db7fe640 1 --2- 172.21.15.3:0/1406398767 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f42c406e2b0 0x7f42c4070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:15.177 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.164+0000 7f42db7fe640 1 --2- 172.21.15.3:0/1406398767 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f42c406e2b0 0x7f42c4070770 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f42cc00a8f0 tx=0x7f42cc005bf0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:15.177 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.172+0000 7f42d8ff9640 1 -- 172.21.15.3:0/1406398767 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f42d007c550 con 0x7f42dc103490 2024-09-21T12:17:15.359 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.356+0000 7f42e1f82640 1 -- 172.21.15.3:0/1406398767 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f42dc106000 con 0x7f42dc103490 2024-09-21T12:17:15.359 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.357+0000 7f42d8ff9640 1 -- 172.21.15.3:0/1406398767 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f42d0080200 con 0x7f42dc103490 2024-09-21T12:17:15.360 INFO:teuthology.orchestra.run.smithi003.stdout:81604378647 2024-09-21T12:17:15.362 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.359+0000 7f42e1f82640 1 -- 172.21.15.3:0/1406398767 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f42c406e2b0 msgr2=0x7f42c4070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:15.362 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.359+0000 7f42e1f82640 1 --2- 172.21.15.3:0/1406398767 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f42c406e2b0 0x7f42c4070770 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f42cc00a8f0 tx=0x7f42cc005bf0 comp rx=0 tx=0).stop 2024-09-21T12:17:15.362 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.359+0000 7f42e1f82640 1 -- 172.21.15.3:0/1406398767 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f42dc103490 msgr2=0x7f42dc100d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:15.362 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.359+0000 7f42e1f82640 1 --2- 172.21.15.3:0/1406398767 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f42dc103490 0x7f42dc100d10 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f42d0004f90 tx=0x7f42d00048f0 comp rx=0 tx=0).stop 2024-09-21T12:17:15.362 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.359+0000 7f42e1f82640 1 -- 172.21.15.3:0/1406398767 shutdown_connections 2024-09-21T12:17:15.362 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.359+0000 7f42e1f82640 1 --2- 172.21.15.3:0/1406398767 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f42c406e2b0 0x7f42c4070770 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:15.362 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.359+0000 7f42e1f82640 1 --2- 172.21.15.3:0/1406398767 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f42dc103490 0x7f42dc100d10 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:15.363 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.359+0000 7f42e1f82640 1 --2- 172.21.15.3:0/1406398767 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f42dc102b70 0x7f42dc1007d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:15.363 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.359+0000 7f42e1f82640 1 -- 172.21.15.3:0/1406398767 >> 172.21.15.3:0/1406398767 conn(0x7f42dc0fc550 msgr2=0x7f42dc103db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:15.363 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.359+0000 7f42e1f82640 1 -- 172.21.15.3:0/1406398767 shutdown_connections 2024-09-21T12:17:15.363 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.359+0000 7f42e1f82640 1 -- 172.21.15.3:0/1406398767 wait complete. 2024-09-21T12:17:15.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.070+0000 7f83e54e9640 1 -- 172.21.15.3:0/958508538 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f83e0107900 msgr2=0x7f83e0107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:15.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.070+0000 7f83e54e9640 1 --2- 172.21.15.3:0/958508538 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f83e0107900 0x7f83e0107ce0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f83d0009880 tx=0x7f83d002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:17:15.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.070+0000 7f83e54e9640 1 -- 172.21.15.3:0/958508538 shutdown_connections 2024-09-21T12:17:15.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.070+0000 7f83e54e9640 1 --2- 172.21.15.3:0/958508538 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83e0101900 0x7f83e0101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:15.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.070+0000 7f83e54e9640 1 --2- 172.21.15.3:0/958508538 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f83e0107900 0x7f83e0107ce0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:15.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.070+0000 7f83e54e9640 1 -- 172.21.15.3:0/958508538 >> 172.21.15.3:0/958508538 conn(0x7f83e00fd5e0 msgr2=0x7f83e00ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:15.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.070+0000 7f83e54e9640 1 -- 172.21.15.3:0/958508538 shutdown_connections 2024-09-21T12:17:15.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.070+0000 7f83e54e9640 1 -- 172.21.15.3:0/958508538 wait complete. 2024-09-21T12:17:15.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.070+0000 7f83e54e9640 1 Processor -- start 2024-09-21T12:17:15.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.071+0000 7f83e54e9640 1 -- start start 2024-09-21T12:17:15.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.071+0000 7f83e54e9640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83e0101900 0x7f83e00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:15.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.071+0000 7f83e54e9640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f83e0107900 0x7f83e0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:15.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.071+0000 7f83e54e9640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f83e010edd0 con 0x7f83e0107900 2024-09-21T12:17:15.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.071+0000 7f83e54e9640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f83e010ec50 con 0x7f83e0101900 2024-09-21T12:17:15.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.071+0000 7f83de7fc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f83e0107900 0x7f83e0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:15.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.071+0000 7f83de7fc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f83e0107900 0x7f83e0074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44754/0 (socket says 172.21.15.3:44754) 2024-09-21T12:17:15.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.071+0000 7f83de7fc640 1 -- 172.21.15.3:0/747539958 learned_addr learned my addr 172.21.15.3:0/747539958 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:17:15.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.071+0000 7f83deffd640 1 --2- 172.21.15.3:0/747539958 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83e0101900 0x7f83e00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:15.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.072+0000 7f83de7fc640 1 -- 172.21.15.3:0/747539958 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83e0101900 msgr2=0x7f83e00744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:15.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.072+0000 7f83de7fc640 1 --2- 172.21.15.3:0/747539958 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83e0101900 0x7f83e00744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:15.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.072+0000 7f83de7fc640 1 -- 172.21.15.3:0/747539958 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83e0074f70 con 0x7f83e0107900 2024-09-21T12:17:15.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.072+0000 7f83de7fc640 1 --2- 172.21.15.3:0/747539958 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f83e0107900 0x7f83e0074a30 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f83d400e970 tx=0x7f83d400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:15.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.072+0000 7f83c7fff640 1 -- 172.21.15.3:0/747539958 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f83d400cac0 con 0x7f83e0107900 2024-09-21T12:17:15.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.072+0000 7f83c7fff640 1 -- 172.21.15.3:0/747539958 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f83d40054e0 con 0x7f83e0107900 2024-09-21T12:17:15.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.072+0000 7f83e54e9640 1 -- 172.21.15.3:0/747539958 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83e0075260 con 0x7f83e0107900 2024-09-21T12:17:15.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.072+0000 7f83c7fff640 1 -- 172.21.15.3:0/747539958 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f83d4010430 con 0x7f83e0107900 2024-09-21T12:17:15.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.073+0000 7f83e54e9640 1 -- 172.21.15.3:0/747539958 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83e01a3e40 con 0x7f83e0107900 2024-09-21T12:17:15.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.074+0000 7f83c7fff640 1 -- 172.21.15.3:0/747539958 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 19) ==== 92549+0+0 (secure 0 0 0) 0x7f83d4004f00 con 0x7f83e0107900 2024-09-21T12:17:15.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.074+0000 7f83e54e9640 1 -- 172.21.15.3:0/747539958 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83e0103040 con 0x7f83e0107900 2024-09-21T12:17:15.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.074+0000 7f83c7fff640 1 --2- 172.21.15.3:0/747539958 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f83c806e2b0 0x7f83c8070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:15.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.074+0000 7f83c7fff640 1 -- 172.21.15.3:0/747539958 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7f83d408e460 con 0x7f83e0107900 2024-09-21T12:17:15.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.074+0000 7f83deffd640 1 --2- 172.21.15.3:0/747539958 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f83c806e2b0 0x7f83c8070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:15.529 INFO:teuthology.orchestra.run.smithi003.stdout:38654705701 2024-09-21T12:17:15.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.075+0000 7f83deffd640 1 --2- 172.21.15.3:0/747539958 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f83c806e2b0 0x7f83c8070770 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f83d00096c0 tx=0x7f83d0031400 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:15.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.079+0000 7f83c7fff640 1 -- 172.21.15.3:0/747539958 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f83d405c100 con 0x7f83e0107900 2024-09-21T12:17:15.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.266+0000 7f83e54e9640 1 -- 172.21.15.3:0/747539958 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f83e0109e70 con 0x7f83e0107900 2024-09-21T12:17:15.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.266+0000 7f83c7fff640 1 -- 172.21.15.3:0/747539958 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f83d405fdb0 con 0x7f83e0107900 2024-09-21T12:17:15.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.269+0000 7f83e54e9640 1 -- 172.21.15.3:0/747539958 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f83c806e2b0 msgr2=0x7f83c8070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:15.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.269+0000 7f83e54e9640 1 --2- 172.21.15.3:0/747539958 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f83c806e2b0 0x7f83c8070770 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f83d00096c0 tx=0x7f83d0031400 comp rx=0 tx=0).stop 2024-09-21T12:17:15.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.269+0000 7f83e54e9640 1 -- 172.21.15.3:0/747539958 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f83e0107900 msgr2=0x7f83e0074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:15.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.269+0000 7f83e54e9640 1 --2- 172.21.15.3:0/747539958 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f83e0107900 0x7f83e0074a30 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f83d400e970 tx=0x7f83d400ed70 comp rx=0 tx=0).stop 2024-09-21T12:17:15.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.269+0000 7f83e54e9640 1 -- 172.21.15.3:0/747539958 shutdown_connections 2024-09-21T12:17:15.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.269+0000 7f83e54e9640 1 --2- 172.21.15.3:0/747539958 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f83c806e2b0 0x7f83c8070770 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:15.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.269+0000 7f83e54e9640 1 --2- 172.21.15.3:0/747539958 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f83e0107900 0x7f83e0074a30 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:15.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.269+0000 7f83e54e9640 1 --2- 172.21.15.3:0/747539958 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83e0101900 0x7f83e00744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:15.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.269+0000 7f83e54e9640 1 -- 172.21.15.3:0/747539958 >> 172.21.15.3:0/747539958 conn(0x7f83e00fd5e0 msgr2=0x7f83e00fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:15.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.269+0000 7f83e54e9640 1 -- 172.21.15.3:0/747539958 shutdown_connections 2024-09-21T12:17:15.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:15.269+0000 7f83e54e9640 1 -- 172.21.15.3:0/747539958 wait complete. 2024-09-21T12:17:15.531 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:15 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/1746827500' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-21T12:17:15.531 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:15 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/747539958' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-21T12:17:15.531 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:15 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/1406398767' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-21T12:17:15.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:15 smithi192 ceph-mon[35641]: from='client.? 172.21.15.3:0/1746827500' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-21T12:17:15.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:15 smithi192 ceph-mon[35641]: from='client.? 172.21.15.3:0/747539958' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-21T12:17:15.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:15 smithi192 ceph-mon[35641]: from='client.? 172.21.15.3:0/1406398767' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-21T12:17:16.535 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:16 smithi003 ceph-mon[28057]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:17:16.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:16.618+0000 7fd488abc640 1 -- 172.21.15.3:0/976082941 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd4841067f0 msgr2=0x7fd484106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:16.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:16.618+0000 7fd488abc640 1 --2- 172.21.15.3:0/976082941 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd4841067f0 0x7fd484106bd0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fd474009880 tx=0x7fd47402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:17:16.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:16.618+0000 7fd488abc640 1 -- 172.21.15.3:0/976082941 shutdown_connections 2024-09-21T12:17:16.644 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:16.618+0000 7fd488abc640 1 --2- 172.21.15.3:0/976082941 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4841007f0 0x7fd484100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:16.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:16.618+0000 7fd488abc640 1 --2- 172.21.15.3:0/976082941 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd4841067f0 0x7fd484106bd0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:16.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:16.618+0000 7fd488abc640 1 -- 172.21.15.3:0/976082941 >> 172.21.15.3:0/976082941 conn(0x7fd4840fc550 msgr2=0x7fd4840fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:16.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:16.618+0000 7fd488abc640 1 -- 172.21.15.3:0/976082941 shutdown_connections 2024-09-21T12:17:16.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:16.618+0000 7fd488abc640 1 -- 172.21.15.3:0/976082941 wait complete. 2024-09-21T12:17:16.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:16.619+0000 7fd488abc640 1 Processor -- start 2024-09-21T12:17:16.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:16.619+0000 7fd488abc640 1 -- start start 2024-09-21T12:17:16.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:16.619+0000 7fd488abc640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4841007f0 0x7fd4840fcd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:16.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:16.619+0000 7fd488abc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd4841067f0 0x7fd4840fd260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:16.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:16.619+0000 7fd488abc640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fd48410dd20 con 0x7fd4841067f0 2024-09-21T12:17:16.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:16.619+0000 7fd488abc640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd48410dba0 con 0x7fd4841007f0 2024-09-21T12:17:16.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:16.620+0000 7fd481d9b640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd4841067f0 0x7fd4840fd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:16.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:16.620+0000 7fd481d9b640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd4841067f0 0x7fd4840fd260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44800/0 (socket says 172.21.15.3:44800) 2024-09-21T12:17:16.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:16.620+0000 7fd481d9b640 1 -- 172.21.15.3:0/3938792868 learned_addr learned my addr 172.21.15.3:0/3938792868 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:17:16.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:16.620+0000 7fd48259c640 1 --2- 172.21.15.3:0/3938792868 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4841007f0 0x7fd4840fcd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:16.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:16.620+0000 7fd481d9b640 1 -- 172.21.15.3:0/3938792868 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4841007f0 msgr2=0x7fd4840fcd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:16.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:16.620+0000 7fd481d9b640 1 --2- 172.21.15.3:0/3938792868 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4841007f0 0x7fd4840fcd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:16.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:16.620+0000 7fd481d9b640 1 -- 172.21.15.3:0/3938792868 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4840fd7a0 con 0x7fd4841067f0 2024-09-21T12:17:16.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:16.620+0000 7fd481d9b640 1 --2- 172.21.15.3:0/3938792868 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd4841067f0 0x7fd4840fd260 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd47800b420 tx=0x7fd47800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:16.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:16.620+0000 7fd4737fe640 1 -- 172.21.15.3:0/3938792868 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd478011630 con 0x7fd4841067f0 2024-09-21T12:17:16.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:16.620+0000 7fd488abc640 1 -- 172.21.15.3:0/3938792868 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4840fda90 con 0x7fd4841067f0 2024-09-21T12:17:16.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:16.620+0000 7fd4737fe640 1 -- 172.21.15.3:0/3938792868 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd478016070 con 0x7fd4841067f0 2024-09-21T12:17:16.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:16.620+0000 7fd4737fe640 1 -- 172.21.15.3:0/3938792868 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd478010d40 con 0x7fd4841067f0 2024-09-21T12:17:16.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:16.620+0000 7fd488abc640 1 -- 172.21.15.3:0/3938792868 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4841a3e80 con 0x7fd4841067f0 2024-09-21T12:17:16.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:16.621+0000 7fd488abc640 1 -- 172.21.15.3:0/3938792868 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd484101f30 con 0x7fd4841067f0 2024-09-21T12:17:16.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:16.622+0000 7fd4737fe640 1 -- 172.21.15.3:0/3938792868 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 19) ==== 92549+0+0 (secure 0 0 0) 0x7fd47801b460 con 0x7fd4841067f0 2024-09-21T12:17:16.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:16.622+0000 7fd4737fe640 1 --2- 172.21.15.3:0/3938792868 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fd46c06e2b0 0x7fd46c070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:16.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:16.622+0000 7fd4737fe640 1 -- 172.21.15.3:0/3938792868 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7fd47808d6e0 con 0x7fd4841067f0 2024-09-21T12:17:16.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:16.622+0000 7fd48259c640 1 --2- 172.21.15.3:0/3938792868 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fd46c06e2b0 0x7fd46c070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:16.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:16.623+0000 7fd48259c640 1 --2- 172.21.15.3:0/3938792868 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fd46c06e2b0 0x7fd46c070770 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd4740096c0 tx=0x7fd474031400 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:16.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:16.627+0000 7fd4737fe640 1 -- 172.21.15.3:0/3938792868 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd47805b380 con 0x7fd4841067f0 2024-09-21T12:17:16.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:16 smithi192 ceph-mon[35641]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:17:16.807 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:16.804+0000 7fd488abc640 1 -- 172.21.15.3:0/3938792868 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fd484109d70 con 0x7fd4841067f0 2024-09-21T12:17:16.807 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:16.805+0000 7fd4737fe640 1 -- 172.21.15.3:0/3938792868 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd47805f030 con 0x7fd4841067f0 2024-09-21T12:17:16.808 INFO:teuthology.orchestra.run.smithi003.stdout:60129542174 2024-09-21T12:17:16.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:16.807+0000 7fd488abc640 1 -- 172.21.15.3:0/3938792868 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fd46c06e2b0 msgr2=0x7fd46c070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:16.810 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:16.807+0000 7fd488abc640 1 --2- 172.21.15.3:0/3938792868 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fd46c06e2b0 0x7fd46c070770 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd4740096c0 tx=0x7fd474031400 comp rx=0 tx=0).stop 2024-09-21T12:17:16.810 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:16.807+0000 7fd488abc640 1 -- 172.21.15.3:0/3938792868 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd4841067f0 msgr2=0x7fd4840fd260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:16.810 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:16.807+0000 7fd488abc640 1 --2- 172.21.15.3:0/3938792868 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd4841067f0 0x7fd4840fd260 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd47800b420 tx=0x7fd47800b8e0 comp rx=0 tx=0).stop 2024-09-21T12:17:16.810 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:16.807+0000 7fd488abc640 1 -- 172.21.15.3:0/3938792868 shutdown_connections 2024-09-21T12:17:16.810 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:16.807+0000 7fd488abc640 1 --2- 172.21.15.3:0/3938792868 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fd46c06e2b0 0x7fd46c070770 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:16.810 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:16.807+0000 7fd488abc640 1 --2- 172.21.15.3:0/3938792868 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd4841067f0 0x7fd4840fd260 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:16.810 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:16.807+0000 7fd488abc640 1 --2- 172.21.15.3:0/3938792868 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd4841007f0 0x7fd4840fcd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:16.810 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:16.807+0000 7fd488abc640 1 -- 172.21.15.3:0/3938792868 >> 172.21.15.3:0/3938792868 conn(0x7fd4840fc550 msgr2=0x7fd484069e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:16.810 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:16.807+0000 7fd488abc640 1 -- 172.21.15.3:0/3938792868 shutdown_connections 2024-09-21T12:17:16.810 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:16.807+0000 7fd488abc640 1 -- 172.21.15.3:0/3938792868 wait complete. 2024-09-21T12:17:17.108 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705700 got 38654705701 for osd.0 2024-09-21T12:17:17.109 DEBUG:teuthology.parallel:result is None 2024-09-21T12:17:17.710 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:17 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:17:17.710 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:17 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/3938792868' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-21T12:17:17.739 INFO:tasks.cephadm.ceph_manager.ceph:need seq 167503724550 got 167503724551 for osd.5 2024-09-21T12:17:17.739 DEBUG:teuthology.parallel:result is None 2024-09-21T12:17:17.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:17 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:17:17.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:17 smithi192 ceph-mon[35641]: from='client.? 172.21.15.3:0/3938792868' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-21T12:17:17.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:17.280+0000 7f8220577640 1 -- 172.21.15.3:0/2201138227 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f82181007f0 msgr2=0x7f8218100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:17.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:17.280+0000 7f8220577640 1 --2- 172.21.15.3:0/2201138227 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f82181007f0 0x7f8218100c50 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8208009880 tx=0x7f820802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:17:17.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:17.280+0000 7f8220577640 1 -- 172.21.15.3:0/2201138227 shutdown_connections 2024-09-21T12:17:17.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:17.280+0000 7f8220577640 1 --2- 172.21.15.3:0/2201138227 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f82181007f0 0x7f8218100c50 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:17.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:17.280+0000 7f8220577640 1 --2- 172.21.15.3:0/2201138227 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82181067f0 0x7f8218106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:17.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:17.280+0000 7f8220577640 1 -- 172.21.15.3:0/2201138227 >> 172.21.15.3:0/2201138227 conn(0x7f82180fc550 msgr2=0x7f82180fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:17.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:17.280+0000 7f8220577640 1 -- 172.21.15.3:0/2201138227 shutdown_connections 2024-09-21T12:17:17.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:17.280+0000 7f8220577640 1 -- 172.21.15.3:0/2201138227 wait complete. 2024-09-21T12:17:17.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:17.280+0000 7f8220577640 1 Processor -- start 2024-09-21T12:17:17.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:17.281+0000 7f8220577640 1 -- start start 2024-09-21T12:17:17.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:17.281+0000 7f8220577640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f82181007f0 0x7f82181965e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:17.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:17.281+0000 7f8220577640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82181067f0 0x7f8218196b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:17.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:17.281+0000 7f8220577640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f821810dcc0 con 0x7f82181007f0 2024-09-21T12:17:17.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:17.281+0000 7f8220577640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f821810db40 con 0x7f82181067f0 2024-09-21T12:17:17.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:17.281+0000 7f821e313640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f82181007f0 0x7f82181965e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:17.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:17.281+0000 7f821e313640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f82181007f0 0x7f82181965e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44826/0 (socket says 172.21.15.3:44826) 2024-09-21T12:17:17.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:17.281+0000 7f821e313640 1 -- 172.21.15.3:0/1448493304 learned_addr learned my addr 172.21.15.3:0/1448493304 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:17:17.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:17.281+0000 7f821db12640 1 --2- 172.21.15.3:0/1448493304 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82181067f0 0x7f8218196b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:17.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:17.281+0000 7f821e313640 1 -- 172.21.15.3:0/1448493304 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82181067f0 msgr2=0x7f8218196b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:17.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:17.281+0000 7f821e313640 1 --2- 172.21.15.3:0/1448493304 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82181067f0 0x7f8218196b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:17.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:17.281+0000 7f821e313640 1 -- 172.21.15.3:0/1448493304 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8218197060 con 0x7f82181007f0 2024-09-21T12:17:17.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:17.281+0000 7f821e313640 1 --2- 172.21.15.3:0/1448493304 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f82181007f0 0x7f82181965e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f821400c8f0 tx=0x7f821400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:17.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:17.282+0000 7f820f7fe640 1 -- 172.21.15.3:0/1448493304 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f82140079b0 con 0x7f82181007f0 2024-09-21T12:17:17.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:17.282+0000 7f820f7fe640 1 -- 172.21.15.3:0/1448493304 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f82140054e0 con 0x7f82181007f0 2024-09-21T12:17:17.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:17.282+0000 7f820f7fe640 1 -- 172.21.15.3:0/1448493304 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8214004dd0 con 0x7f82181007f0 2024-09-21T12:17:17.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:17.282+0000 7f8220577640 1 -- 172.21.15.3:0/1448493304 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8218197350 con 0x7f82181007f0 2024-09-21T12:17:17.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:17.282+0000 7f8220577640 1 -- 172.21.15.3:0/1448493304 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82181a3e20 con 0x7f82181007f0 2024-09-21T12:17:17.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:17.283+0000 7f8220577640 1 -- 172.21.15.3:0/1448493304 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8218101f30 con 0x7f82181007f0 2024-09-21T12:17:17.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:17.284+0000 7f820f7fe640 1 -- 172.21.15.3:0/1448493304 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 19) ==== 92549+0+0 (secure 0 0 0) 0x7f8214005020 con 0x7f82181007f0 2024-09-21T12:17:17.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:17.284+0000 7f820f7fe640 1 --2- 172.21.15.3:0/1448493304 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f820406e2b0 0x7f8204070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:17.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:17.284+0000 7f820f7fe640 1 -- 172.21.15.3:0/1448493304 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7f821408dc50 con 0x7f82181007f0 2024-09-21T12:17:17.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:17.284+0000 7f821db12640 1 --2- 172.21.15.3:0/1448493304 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f820406e2b0 0x7f8204070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:17.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:17.285+0000 7f821db12640 1 --2- 172.21.15.3:0/1448493304 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f820406e2b0 0x7f8204070770 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8218198740 tx=0x7f8208031400 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:17.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:17.289+0000 7f820f7fe640 1 -- 172.21.15.3:0/1448493304 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8214014030 con 0x7f82181007f0 2024-09-21T12:17:17.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:17.469+0000 7f8220577640 1 -- 172.21.15.3:0/1448493304 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f821806a290 con 0x7f82181007f0 2024-09-21T12:17:17.829 INFO:teuthology.orchestra.run.smithi003.stdout:111669149716 2024-09-21T12:17:17.830 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:17.469+0000 7f820f7fe640 1 -- 172.21.15.3:0/1448493304 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f821405f620 con 0x7f82181007f0 2024-09-21T12:17:17.830 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:17.471+0000 7f8220577640 1 -- 172.21.15.3:0/1448493304 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f820406e2b0 msgr2=0x7f8204070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:17.830 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:17.471+0000 7f8220577640 1 --2- 172.21.15.3:0/1448493304 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f820406e2b0 0x7f8204070770 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f8218198740 tx=0x7f8208031400 comp rx=0 tx=0).stop 2024-09-21T12:17:17.830 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:17.471+0000 7f8220577640 1 -- 172.21.15.3:0/1448493304 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f82181007f0 msgr2=0x7f82181965e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:17.830 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:17.471+0000 7f8220577640 1 --2- 172.21.15.3:0/1448493304 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f82181007f0 0x7f82181965e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f821400c8f0 tx=0x7f821400cdb0 comp rx=0 tx=0).stop 2024-09-21T12:17:17.830 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:17.471+0000 7f8220577640 1 -- 172.21.15.3:0/1448493304 shutdown_connections 2024-09-21T12:17:17.830 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:17.471+0000 7f8220577640 1 --2- 172.21.15.3:0/1448493304 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f820406e2b0 0x7f8204070770 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:17.830 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:17.471+0000 7f8220577640 1 --2- 172.21.15.3:0/1448493304 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82181067f0 0x7f8218196b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:17.830 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:17.471+0000 7f8220577640 1 --2- 172.21.15.3:0/1448493304 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f82181007f0 0x7f82181965e0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:17.830 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:17.471+0000 7f8220577640 1 -- 172.21.15.3:0/1448493304 >> 172.21.15.3:0/1448493304 conn(0x7f82180fc550 msgr2=0x7f82180fcda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:17.830 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:17.471+0000 7f8220577640 1 -- 172.21.15.3:0/1448493304 shutdown_connections 2024-09-21T12:17:17.830 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:17.471+0000 7f8220577640 1 -- 172.21.15.3:0/1448493304 wait complete. 2024-09-21T12:17:18.418 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149715 got 111669149716 for osd.3 2024-09-21T12:17:18.418 DEBUG:teuthology.parallel:result is None 2024-09-21T12:17:18.449 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:18 smithi003 ceph-mon[28057]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:17:18.449 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:18 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/1448493304' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-21T12:17:18.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:18 smithi192 ceph-mon[35641]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:17:18.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:18 smithi192 ceph-mon[35641]: from='client.? 172.21.15.3:0/1448493304' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-21T12:17:19.211 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378647 got 81604378647 for osd.2 2024-09-21T12:17:19.212 DEBUG:teuthology.parallel:result is None 2024-09-21T12:17:19.787 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542173 got 60129542174 for osd.1 2024-09-21T12:17:19.787 DEBUG:teuthology.parallel:result is None 2024-09-21T12:17:19.829 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:17:20.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:20.263+0000 7f84b651f640 1 -- 172.21.15.3:0/517930025 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f84b0102ac0 msgr2=0x7f84b0102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:20.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:20.263+0000 7f84b651f640 1 --2- 172.21.15.3:0/517930025 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f84b0102ac0 0x7f84b0102ea0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f84a0009880 tx=0x7f84a002a530 comp rx=0 tx=0).stop 2024-09-21T12:17:20.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:20.263+0000 7f84b651f640 1 -- 172.21.15.3:0/517930025 shutdown_connections 2024-09-21T12:17:20.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:20.263+0000 7f84b651f640 1 --2- 172.21.15.3:0/517930025 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84b01033e0 0x7f84b010b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:20.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:20.263+0000 7f84b651f640 1 --2- 172.21.15.3:0/517930025 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f84b0102ac0 0x7f84b0102ea0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:20.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:20.263+0000 7f84b651f640 1 -- 172.21.15.3:0/517930025 >> 172.21.15.3:0/517930025 conn(0x7f84b00fc520 msgr2=0x7f84b00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:20.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:20.263+0000 7f84b651f640 1 -- 172.21.15.3:0/517930025 shutdown_connections 2024-09-21T12:17:20.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:20.263+0000 7f84b651f640 1 -- 172.21.15.3:0/517930025 wait complete. 2024-09-21T12:17:20.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:20.263+0000 7f84b651f640 1 Processor -- start 2024-09-21T12:17:20.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:20.263+0000 7f84b651f640 1 -- start start 2024-09-21T12:17:20.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:20.264+0000 7f84b651f640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84b0102ac0 0x7f84b0100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:20.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:20.264+0000 7f84b651f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f84b01033e0 0x7f84b0100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:20.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:20.264+0000 7f84b651f640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f84b010edd0 con 0x7f84b01033e0 2024-09-21T12:17:20.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:20.264+0000 7f84b651f640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f84b010ec50 con 0x7f84b0102ac0 2024-09-21T12:17:20.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:20.264+0000 7f84af7fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f84b01033e0 0x7f84b0100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:20.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:20.264+0000 7f84af7fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f84b01033e0 0x7f84b0100c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44838/0 (socket says 172.21.15.3:44838) 2024-09-21T12:17:20.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:20.264+0000 7f84af7fe640 1 -- 172.21.15.3:0/3562678157 learned_addr learned my addr 172.21.15.3:0/3562678157 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:17:20.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:20.264+0000 7f84affff640 1 --2- 172.21.15.3:0/3562678157 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84b0102ac0 0x7f84b0100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:20.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:20.264+0000 7f84af7fe640 1 -- 172.21.15.3:0/3562678157 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84b0102ac0 msgr2=0x7f84b0100720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:20.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:20.264+0000 7f84af7fe640 1 --2- 172.21.15.3:0/3562678157 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84b0102ac0 0x7f84b0100720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:20.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:20.264+0000 7f84af7fe640 1 -- 172.21.15.3:0/3562678157 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84b01011a0 con 0x7f84b01033e0 2024-09-21T12:17:20.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:20.265+0000 7f84af7fe640 1 --2- 172.21.15.3:0/3562678157 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f84b01033e0 0x7f84b0100c60 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f84a400c8f0 tx=0x7f84a400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:20.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:20.265+0000 7f84ad7fa640 1 -- 172.21.15.3:0/3562678157 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f84a40079b0 con 0x7f84b01033e0 2024-09-21T12:17:20.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:20.265+0000 7f84ad7fa640 1 -- 172.21.15.3:0/3562678157 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f84a4007b50 con 0x7f84b01033e0 2024-09-21T12:17:20.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:20.265+0000 7f84b651f640 1 -- 172.21.15.3:0/3562678157 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84b0101490 con 0x7f84b01033e0 2024-09-21T12:17:20.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:20.265+0000 7f84ad7fa640 1 -- 172.21.15.3:0/3562678157 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f84a4018610 con 0x7f84b01033e0 2024-09-21T12:17:20.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:20.265+0000 7f84b651f640 1 -- 172.21.15.3:0/3562678157 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84b01a3f00 con 0x7f84b01033e0 2024-09-21T12:17:20.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:20.266+0000 7f84b651f640 1 -- 172.21.15.3:0/3562678157 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84b006aa90 con 0x7f84b01033e0 2024-09-21T12:17:20.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:20.266+0000 7f84ad7fa640 1 -- 172.21.15.3:0/3562678157 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 19) ==== 92549+0+0 (secure 0 0 0) 0x7f84a4007d00 con 0x7f84b01033e0 2024-09-21T12:17:20.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:20.267+0000 7f84ad7fa640 1 --2- 172.21.15.3:0/3562678157 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f849806e2b0 0x7f8498070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:20.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:20.267+0000 7f84affff640 1 --2- 172.21.15.3:0/3562678157 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f849806e2b0 0x7f8498070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:20.292 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:20.267+0000 7f84ad7fa640 1 -- 172.21.15.3:0/3562678157 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7f84a408df90 con 0x7f84b01033e0 2024-09-21T12:17:20.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:20.267+0000 7f84affff640 1 --2- 172.21.15.3:0/3562678157 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f849806e2b0 0x7f8498070770 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f84a0000c00 tx=0x7f84a0031400 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:20.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:20.271+0000 7f84ad7fa640 1 -- 172.21.15.3:0/3562678157 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f84a4014030 con 0x7f84b01033e0 2024-09-21T12:17:20.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:20.448+0000 7f84b651f640 1 -- 172.21.15.3:0/3562678157 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f84b0105f90 con 0x7f84b01033e0 2024-09-21T12:17:20.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:20.448+0000 7f84ad7fa640 1 -- 172.21.15.3:0/3562678157 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f84a405bc30 con 0x7f84b01033e0 2024-09-21T12:17:20.451 INFO:teuthology.orchestra.run.smithi003.stdout:146028888078 2024-09-21T12:17:20.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:20.450+0000 7f84b651f640 1 -- 172.21.15.3:0/3562678157 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f849806e2b0 msgr2=0x7f8498070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:20.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:20.450+0000 7f84b651f640 1 --2- 172.21.15.3:0/3562678157 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f849806e2b0 0x7f8498070770 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f84a0000c00 tx=0x7f84a0031400 comp rx=0 tx=0).stop 2024-09-21T12:17:20.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:20.450+0000 7f84b651f640 1 -- 172.21.15.3:0/3562678157 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f84b01033e0 msgr2=0x7f84b0100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:20.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:20.450+0000 7f84b651f640 1 --2- 172.21.15.3:0/3562678157 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f84b01033e0 0x7f84b0100c60 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f84a400c8f0 tx=0x7f84a400cdb0 comp rx=0 tx=0).stop 2024-09-21T12:17:20.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:20.450+0000 7f84b651f640 1 -- 172.21.15.3:0/3562678157 shutdown_connections 2024-09-21T12:17:20.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:20.450+0000 7f84b651f640 1 --2- 172.21.15.3:0/3562678157 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f849806e2b0 0x7f8498070770 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:20.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:20.450+0000 7f84b651f640 1 --2- 172.21.15.3:0/3562678157 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f84b01033e0 0x7f84b0100c60 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:20.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:20.450+0000 7f84b651f640 1 --2- 172.21.15.3:0/3562678157 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f84b0102ac0 0x7f84b0100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:20.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:20.450+0000 7f84b651f640 1 -- 172.21.15.3:0/3562678157 >> 172.21.15.3:0/3562678157 conn(0x7f84b00fc520 msgr2=0x7f84b0108ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:20.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:20.450+0000 7f84b651f640 1 -- 172.21.15.3:0/3562678157 shutdown_connections 2024-09-21T12:17:20.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:20.450+0000 7f84b651f640 1 -- 172.21.15.3:0/3562678157 wait complete. 2024-09-21T12:17:20.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:20 smithi192 ceph-mon[35641]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:17:20.801 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:20 smithi003 ceph-mon[28057]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:17:21.124 INFO:tasks.cephadm.ceph_manager.ceph:need seq 146028888077 got 146028888078 for osd.4 2024-09-21T12:17:21.125 DEBUG:teuthology.parallel:result is None 2024-09-21T12:17:21.125 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-21T12:17:21.125 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph pg dump --format=json 2024-09-21T12:17:21.386 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:17:21.653 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:21 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/3562678157' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-21T12:17:21.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:21 smithi192 ceph-mon[35641]: from='client.? 172.21.15.3:0/3562678157' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-21T12:17:21.839 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:21.835+0000 7fb7ed4b1640 1 -- 172.21.15.3:0/2064929301 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb7e81067f0 msgr2=0x7fb7e8106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:21.839 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:21.835+0000 7fb7ed4b1640 1 --2- 172.21.15.3:0/2064929301 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb7e81067f0 0x7fb7e8106bd0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fb7d8009880 tx=0x7fb7d802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:17:21.839 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:21.835+0000 7fb7ed4b1640 1 -- 172.21.15.3:0/2064929301 shutdown_connections 2024-09-21T12:17:21.839 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:21.835+0000 7fb7ed4b1640 1 --2- 172.21.15.3:0/2064929301 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7e81007f0 0x7fb7e8100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:21.839 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:21.835+0000 7fb7ed4b1640 1 --2- 172.21.15.3:0/2064929301 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb7e81067f0 0x7fb7e8106bd0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:21.839 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:21.835+0000 7fb7ed4b1640 1 -- 172.21.15.3:0/2064929301 >> 172.21.15.3:0/2064929301 conn(0x7fb7e80fc550 msgr2=0x7fb7e80fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:21.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:21.835+0000 7fb7ed4b1640 1 -- 172.21.15.3:0/2064929301 shutdown_connections 2024-09-21T12:17:21.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:21.835+0000 7fb7ed4b1640 1 -- 172.21.15.3:0/2064929301 wait complete. 2024-09-21T12:17:21.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:21.836+0000 7fb7ed4b1640 1 Processor -- start 2024-09-21T12:17:21.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:21.836+0000 7fb7ed4b1640 1 -- start start 2024-09-21T12:17:21.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:21.836+0000 7fb7ed4b1640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7e81007f0 0x7fb7e819d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:21.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:21.836+0000 7fb7ed4b1640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb7e81067f0 0x7fb7e819db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:21.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:21.836+0000 7fb7ed4b1640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fb7e810dcc0 con 0x7fb7e81067f0 2024-09-21T12:17:21.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:21.836+0000 7fb7ed4b1640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb7e810db40 con 0x7fb7e81007f0 2024-09-21T12:17:21.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:21.836+0000 7fb7e67fc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb7e81067f0 0x7fb7e819db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:21.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:21.836+0000 7fb7e67fc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb7e81067f0 0x7fb7e819db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56150/0 (socket says 172.21.15.3:56150) 2024-09-21T12:17:21.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:21.836+0000 7fb7e67fc640 1 -- 172.21.15.3:0/458692284 learned_addr learned my addr 172.21.15.3:0/458692284 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:17:21.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:21.836+0000 7fb7e6ffd640 1 --2- 172.21.15.3:0/458692284 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7e81007f0 0x7fb7e819d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:21.842 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:21.837+0000 7fb7e67fc640 1 -- 172.21.15.3:0/458692284 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7e81007f0 msgr2=0x7fb7e819d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:21.842 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:21.837+0000 7fb7e67fc640 1 --2- 172.21.15.3:0/458692284 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7e81007f0 0x7fb7e819d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:21.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:21.837+0000 7fb7e67fc640 1 -- 172.21.15.3:0/458692284 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7e81977b0 con 0x7fb7e81067f0 2024-09-21T12:17:21.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:21.837+0000 7fb7e67fc640 1 --2- 172.21.15.3:0/458692284 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb7e81067f0 0x7fb7e819db70 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc00d6f0 tx=0x7fb7dc00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:21.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:21.837+0000 7fb7cffff640 1 -- 172.21.15.3:0/458692284 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb7dc017070 con 0x7fb7e81067f0 2024-09-21T12:17:21.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:21.837+0000 7fb7cffff640 1 -- 172.21.15.3:0/458692284 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb7dc00de00 con 0x7fb7e81067f0 2024-09-21T12:17:21.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:21.837+0000 7fb7ed4b1640 1 -- 172.21.15.3:0/458692284 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7e8197aa0 con 0x7fb7e81067f0 2024-09-21T12:17:21.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:21.837+0000 7fb7cffff640 1 -- 172.21.15.3:0/458692284 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb7dc004bb0 con 0x7fb7e81067f0 2024-09-21T12:17:21.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:21.837+0000 7fb7ed4b1640 1 -- 172.21.15.3:0/458692284 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7e8198030 con 0x7fb7e81067f0 2024-09-21T12:17:21.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:21.838+0000 7fb7ed4b1640 1 -- 172.21.15.3:0/458692284 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7e8101f30 con 0x7fb7e81067f0 2024-09-21T12:17:21.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:21.838+0000 7fb7cffff640 1 -- 172.21.15.3:0/458692284 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 19) ==== 92549+0+0 (secure 0 0 0) 0x7fb7dc004e60 con 0x7fb7e81067f0 2024-09-21T12:17:21.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:21.839+0000 7fb7cffff640 1 --2- 172.21.15.3:0/458692284 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fb7d006e2b0 0x7fb7d0070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:21.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:21.839+0000 7fb7cffff640 1 -- 172.21.15.3:0/458692284 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7fb7dc08d970 con 0x7fb7e81067f0 2024-09-21T12:17:21.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:21.839+0000 7fb7e6ffd640 1 --2- 172.21.15.3:0/458692284 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fb7d006e2b0 0x7fb7d0070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:21.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:21.839+0000 7fb7e6ffd640 1 --2- 172.21.15.3:0/458692284 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fb7d006e2b0 0x7fb7d0070770 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb7d80096c0 tx=0x7fb7d8031400 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:21.846 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:21.843+0000 7fb7cffff640 1 -- 172.21.15.3:0/458692284 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb7dc08fe20 con 0x7fb7e81067f0 2024-09-21T12:17:22.019 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:22.015+0000 7fb7ed4b1640 1 -- 172.21.15.3:0/458692284 --> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb7e81982e0 con 0x7fb7d006e2b0 2024-09-21T12:17:22.019 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:22.016+0000 7fb7cffff640 1 -- 172.21.15.3:0/458692284 <== mgr.14217 v2:172.21.15.3:6800/2480880781 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+12321 (secure 0 0 0) 0x7fb7e81982e0 con 0x7fb7d006e2b0 2024-09-21T12:17:22.019 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:17:22.019 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-21T12:17:22.021 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:22.018+0000 7fb7ed4b1640 1 -- 172.21.15.3:0/458692284 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fb7d006e2b0 msgr2=0x7fb7d0070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:22.021 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:22.018+0000 7fb7ed4b1640 1 --2- 172.21.15.3:0/458692284 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fb7d006e2b0 0x7fb7d0070770 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb7d80096c0 tx=0x7fb7d8031400 comp rx=0 tx=0).stop 2024-09-21T12:17:22.021 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:22.018+0000 7fb7ed4b1640 1 -- 172.21.15.3:0/458692284 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb7e81067f0 msgr2=0x7fb7e819db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:22.021 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:22.018+0000 7fb7ed4b1640 1 --2- 172.21.15.3:0/458692284 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb7e81067f0 0x7fb7e819db70 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc00d6f0 tx=0x7fb7dc00dbb0 comp rx=0 tx=0).stop 2024-09-21T12:17:22.021 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:22.018+0000 7fb7ed4b1640 1 -- 172.21.15.3:0/458692284 shutdown_connections 2024-09-21T12:17:22.021 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:22.018+0000 7fb7ed4b1640 1 --2- 172.21.15.3:0/458692284 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fb7d006e2b0 0x7fb7d0070770 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:22.021 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:22.018+0000 7fb7ed4b1640 1 --2- 172.21.15.3:0/458692284 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb7e81067f0 0x7fb7e819db70 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:22.022 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:22.018+0000 7fb7ed4b1640 1 --2- 172.21.15.3:0/458692284 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb7e81007f0 0x7fb7e819d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:22.022 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:22.018+0000 7fb7ed4b1640 1 -- 172.21.15.3:0/458692284 >> 172.21.15.3:0/458692284 conn(0x7fb7e80fc550 msgr2=0x7fb7e8069ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:22.022 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:22.019+0000 7fb7ed4b1640 1 -- 172.21.15.3:0/458692284 shutdown_connections 2024-09-21T12:17:22.022 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:22.019+0000 7fb7ed4b1640 1 -- 172.21.15.3:0/458692284 wait complete. 2024-09-21T12:17:22.651 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:22 smithi003 ceph-mon[28057]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:17:22.680 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":165,"stamp":"2024-09-21T12:17:20.548894+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":170232,"kb_used_data":3876,"kb_used_omap":9,"kb_used_meta":166198,"kb_avail":562300680,"statfs":{"total":575970213888,"available":575795896320,"internally_reserved":0,"allocated":3969024,"data_stored":2608236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9567,"internal_metadata":170187425},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001987"},"pg_stats":[{"pgid":"1.0","version":"23'117","reported_seq":191,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T12:16:50.319102+0000","last_change":"2024-09-21T12:16:21.219659+0000","last_active":"2024-09-21T12:16:50.319102+0000","last_peered":"2024-09-21T12:16:50.319102+0000","last_clean":"2024-09-21T12:16:50.319102+0000","last_became_active":"2024-09-21T12:16:21.219325+0000","last_became_peered":"2024-09-21T12:16:21.219325+0000","last_unstale":"2024-09-21T12:16:50.319102+0000","last_undegraded":"2024-09-21T12:16:50.319102+0000","last_fullsized":"2024-09-21T12:16:50.319102+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T12:15:29.552490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T12:15:29.552490+0000","last_clean_scrub_stamp":"2024-09-21T12:15:29.552490+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:59:39.261785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":39,"seq":167503724553,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27384,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717768,"statfs":{"total":95995035648,"available":95966994432,"internally_reserved":0,"allocated":364544,"data_stored":139522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888078,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27388,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717764,"statfs":{"total":95995035648,"available":95966990336,"internally_reserved":0,"allocated":364544,"data_stored":139522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149717,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":958464,"data_stored":729890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378649,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27392,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717760,"statfs":{"total":95995035648,"available":95966986240,"internally_reserved":0,"allocated":364544,"data_stored":139522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542175,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":958464,"data_stored":729890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705702,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32132,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713020,"statfs":{"total":95995035648,"available":95962132480,"internally_reserved":0,"allocated":958464,"data_stored":729890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T12:17:22.759 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph pg dump --format=json 2024-09-21T12:17:22.760 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:22 smithi192 ceph-mon[35641]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:17:23.020 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:17:23.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:23.546+0000 7f448a88e640 1 -- 172.21.15.3:0/4286638551 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f44841033e0 msgr2=0x7f448410b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:23.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:23.546+0000 7f448a88e640 1 --2- 172.21.15.3:0/4286638551 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f44841033e0 0x7f448410b8d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f4478009880 tx=0x7f447802a530 comp rx=0 tx=0).stop 2024-09-21T12:17:23.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:23.546+0000 7f448a88e640 1 -- 172.21.15.3:0/4286638551 shutdown_connections 2024-09-21T12:17:23.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:23.546+0000 7f448a88e640 1 --2- 172.21.15.3:0/4286638551 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f44841033e0 0x7f448410b8d0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:23.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:23.546+0000 7f448a88e640 1 --2- 172.21.15.3:0/4286638551 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4484102ac0 0x7f4484102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:23.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:23.546+0000 7f448a88e640 1 -- 172.21.15.3:0/4286638551 >> 172.21.15.3:0/4286638551 conn(0x7f44840fc520 msgr2=0x7f44840fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:23.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:23.546+0000 7f448a88e640 1 -- 172.21.15.3:0/4286638551 shutdown_connections 2024-09-21T12:17:23.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:23.546+0000 7f448a88e640 1 -- 172.21.15.3:0/4286638551 wait complete. 2024-09-21T12:17:23.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:23.546+0000 7f448a88e640 1 Processor -- start 2024-09-21T12:17:23.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:23.547+0000 7f448a88e640 1 -- start start 2024-09-21T12:17:23.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:23.547+0000 7f448a88e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4484102ac0 0x7f448419d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:23.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:23.547+0000 7f448a88e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f44841033e0 0x7f448419dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:23.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:23.547+0000 7f448a88e640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f448410ee50 con 0x7f44841033e0 2024-09-21T12:17:23.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:23.547+0000 7f448a88e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f448410ecd0 con 0x7f4484102ac0 2024-09-21T12:17:23.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:23.547+0000 7f44837fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f44841033e0 0x7f448419dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:23.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:23.547+0000 7f44837fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f44841033e0 0x7f448419dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56166/0 (socket says 172.21.15.3:56166) 2024-09-21T12:17:23.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:23.547+0000 7f44837fe640 1 -- 172.21.15.3:0/3156167692 learned_addr learned my addr 172.21.15.3:0/3156167692 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:17:23.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:23.547+0000 7f4483fff640 1 --2- 172.21.15.3:0/3156167692 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4484102ac0 0x7f448419d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:23.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:23.547+0000 7f44837fe640 1 -- 172.21.15.3:0/3156167692 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4484102ac0 msgr2=0x7f448419d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:23.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:23.547+0000 7f44837fe640 1 --2- 172.21.15.3:0/3156167692 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4484102ac0 0x7f448419d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:23.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:23.547+0000 7f44837fe640 1 -- 172.21.15.3:0/3156167692 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4484197840 con 0x7f44841033e0 2024-09-21T12:17:23.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:23.547+0000 7f4483fff640 1 --2- 172.21.15.3:0/3156167692 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4484102ac0 0x7f448419d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T12:17:23.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:23.548+0000 7f44837fe640 1 --2- 172.21.15.3:0/3156167692 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f44841033e0 0x7f448419dc00 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4478031460 tx=0x7f44780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:23.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:23.548+0000 7f44817fa640 1 -- 172.21.15.3:0/3156167692 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f447803f070 con 0x7f44841033e0 2024-09-21T12:17:23.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:23.548+0000 7f448a88e640 1 -- 172.21.15.3:0/3156167692 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4484197ad0 con 0x7f44841033e0 2024-09-21T12:17:23.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:23.548+0000 7f44817fa640 1 -- 172.21.15.3:0/3156167692 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4478004ac0 con 0x7f44841033e0 2024-09-21T12:17:23.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:23.548+0000 7f44817fa640 1 -- 172.21.15.3:0/3156167692 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4478035030 con 0x7f44841033e0 2024-09-21T12:17:23.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:23.548+0000 7f448a88e640 1 -- 172.21.15.3:0/3156167692 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4484198000 con 0x7f44841033e0 2024-09-21T12:17:23.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:23.549+0000 7f448a88e640 1 -- 172.21.15.3:0/3156167692 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f448406aa90 con 0x7f44841033e0 2024-09-21T12:17:23.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:23.549+0000 7f44817fa640 1 -- 172.21.15.3:0/3156167692 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 19) ==== 92549+0+0 (secure 0 0 0) 0x7f4478042070 con 0x7f44841033e0 2024-09-21T12:17:23.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:23.550+0000 7f44817fa640 1 --2- 172.21.15.3:0/3156167692 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f446c06e2b0 0x7f446c070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:23.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:23.550+0000 7f4483fff640 1 --2- 172.21.15.3:0/3156167692 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f446c06e2b0 0x7f446c070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:23.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:23.550+0000 7f44817fa640 1 -- 172.21.15.3:0/3156167692 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7f44780ae840 con 0x7f44841033e0 2024-09-21T12:17:23.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:23.550+0000 7f4483fff640 1 --2- 172.21.15.3:0/3156167692 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f446c06e2b0 0x7f446c070770 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4474006fd0 tx=0x7f4474008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:23.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:23.554+0000 7f44817fa640 1 -- 172.21.15.3:0/3156167692 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f447807c4e0 con 0x7f44841033e0 2024-09-21T12:17:23.730 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:23.727+0000 7f448a88e640 1 -- 172.21.15.3:0/3156167692 --> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f44841982b0 con 0x7f446c06e2b0 2024-09-21T12:17:23.730 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:23 smithi003 ceph-mon[28057]: from='client.14504 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T12:17:23.730 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:23.728+0000 7f44817fa640 1 -- 172.21.15.3:0/3156167692 <== mgr.14217 v2:172.21.15.3:6800/2480880781 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+12321 (secure 0 0 0) 0x7f44841982b0 con 0x7f446c06e2b0 2024-09-21T12:17:23.731 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:17:23.731 INFO:teuthology.orchestra.run.smithi003.stderr:dumped all 2024-09-21T12:17:23.733 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:23.730+0000 7f448a88e640 1 -- 172.21.15.3:0/3156167692 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f446c06e2b0 msgr2=0x7f446c070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:23.733 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:23.730+0000 7f448a88e640 1 --2- 172.21.15.3:0/3156167692 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f446c06e2b0 0x7f446c070770 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f4474006fd0 tx=0x7f4474008040 comp rx=0 tx=0).stop 2024-09-21T12:17:23.733 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:23.730+0000 7f448a88e640 1 -- 172.21.15.3:0/3156167692 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f44841033e0 msgr2=0x7f448419dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:23.733 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:23.730+0000 7f448a88e640 1 --2- 172.21.15.3:0/3156167692 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f44841033e0 0x7f448419dc00 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4478031460 tx=0x7f44780046c0 comp rx=0 tx=0).stop 2024-09-21T12:17:23.733 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:23.730+0000 7f448a88e640 1 -- 172.21.15.3:0/3156167692 shutdown_connections 2024-09-21T12:17:23.733 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:23.730+0000 7f448a88e640 1 --2- 172.21.15.3:0/3156167692 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f446c06e2b0 0x7f446c070770 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:23.733 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:23.730+0000 7f448a88e640 1 --2- 172.21.15.3:0/3156167692 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f44841033e0 0x7f448419dc00 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:23.733 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:23.730+0000 7f448a88e640 1 --2- 172.21.15.3:0/3156167692 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4484102ac0 0x7f448419d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:23.733 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:23.730+0000 7f448a88e640 1 -- 172.21.15.3:0/3156167692 >> 172.21.15.3:0/3156167692 conn(0x7f44840fc520 msgr2=0x7f4484108ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:23.733 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:23.730+0000 7f448a88e640 1 -- 172.21.15.3:0/3156167692 shutdown_connections 2024-09-21T12:17:23.733 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:23.730+0000 7f448a88e640 1 -- 172.21.15.3:0/3156167692 wait complete. 2024-09-21T12:17:23.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:23 smithi192 ceph-mon[35641]: from='client.14504 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T12:17:24.375 INFO:teuthology.orchestra.run.smithi003.stdout:{"pg_ready":true,"pg_map":{"version":166,"stamp":"2024-09-21T12:17:22.549216+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":170232,"kb_used_data":3876,"kb_used_omap":9,"kb_used_meta":166198,"kb_avail":562300680,"statfs":{"total":575970213888,"available":575795896320,"internally_reserved":0,"allocated":3969024,"data_stored":2608236,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9567,"internal_metadata":170187425},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002018"},"pg_stats":[{"pgid":"1.0","version":"23'117","reported_seq":191,"reported_epoch":40,"state":"active+clean","last_fresh":"2024-09-21T12:16:50.319102+0000","last_change":"2024-09-21T12:16:21.219659+0000","last_active":"2024-09-21T12:16:50.319102+0000","last_peered":"2024-09-21T12:16:50.319102+0000","last_clean":"2024-09-21T12:16:50.319102+0000","last_became_active":"2024-09-21T12:16:21.219325+0000","last_became_peered":"2024-09-21T12:16:21.219325+0000","last_unstale":"2024-09-21T12:16:50.319102+0000","last_undegraded":"2024-09-21T12:16:50.319102+0000","last_fullsized":"2024-09-21T12:16:50.319102+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-21T12:15:29.552490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-21T12:15:29.552490+0000","last_clean_scrub_stamp":"2024-09-21T12:15:29.552490+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-22T13:59:39.261785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2375680,"data_stored":2361472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":39,"seq":167503724553,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27384,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717768,"statfs":{"total":95995035648,"available":95966994432,"internally_reserved":0,"allocated":364544,"data_stored":139522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":34,"seq":146028888079,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27388,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717764,"statfs":{"total":95995035648,"available":95966990336,"internally_reserved":0,"allocated":364544,"data_stored":139522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":26,"seq":111669149717,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":958464,"data_stored":729890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":19,"seq":81604378649,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":27392,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717760,"statfs":{"total":95995035648,"available":95966986240,"internally_reserved":0,"allocated":364544,"data_stored":139522,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":14,"seq":60129542175,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27968,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717184,"statfs":{"total":95995035648,"available":95966396416,"internally_reserved":0,"allocated":958464,"data_stored":729890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705703,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32132,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713020,"statfs":{"total":95995035648,"available":95962132480,"internally_reserved":0,"allocated":958464,"data_stored":729890,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-21T12:17:24.376 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-21T12:17:24.376 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-21T12:17:24.376 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-21T12:17:24.376 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph health --format=json 2024-09-21T12:17:24.643 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:17:24.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:24 smithi192 ceph-mon[35641]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:17:24.764 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:24 smithi003 ceph-mon[28057]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:17:25.070 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:25.065+0000 7f678d25e640 1 -- 172.21.15.3:0/4042888917 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6788100800 msgr2=0x7f6788100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:25.070 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:25.065+0000 7f678d25e640 1 --2- 172.21.15.3:0/4042888917 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6788100800 0x7f6788100c60 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f677c009880 tx=0x7f677c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:17:25.070 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:25.065+0000 7f678d25e640 1 -- 172.21.15.3:0/4042888917 shutdown_connections 2024-09-21T12:17:25.070 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:25.065+0000 7f678d25e640 1 --2- 172.21.15.3:0/4042888917 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6788100800 0x7f6788100c60 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:25.070 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:25.065+0000 7f678d25e640 1 --2- 172.21.15.3:0/4042888917 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6788106800 0x7f6788106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:25.071 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:25.065+0000 7f678d25e640 1 -- 172.21.15.3:0/4042888917 >> 172.21.15.3:0/4042888917 conn(0x7f67880fc520 msgr2=0x7f67880fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:25.071 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:25.065+0000 7f678d25e640 1 -- 172.21.15.3:0/4042888917 shutdown_connections 2024-09-21T12:17:25.071 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:25.065+0000 7f678d25e640 1 -- 172.21.15.3:0/4042888917 wait complete. 2024-09-21T12:17:25.071 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:25.066+0000 7f678d25e640 1 Processor -- start 2024-09-21T12:17:25.071 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:25.066+0000 7f678d25e640 1 -- start start 2024-09-21T12:17:25.071 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:25.066+0000 7f678d25e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6788100800 0x7f6788198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:25.071 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:25.066+0000 7f678d25e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6788106800 0x7f6788198d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:25.071 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:25.066+0000 7f678d25e640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f678810dd30 con 0x7f6788100800 2024-09-21T12:17:25.071 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:25.066+0000 7f678d25e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f678810dbb0 con 0x7f6788106800 2024-09-21T12:17:25.071 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:25.066+0000 7f6786d9d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6788100800 0x7f6788198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:25.071 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:25.066+0000 7f6786d9d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6788100800 0x7f6788198840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56182/0 (socket says 172.21.15.3:56182) 2024-09-21T12:17:25.071 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:25.066+0000 7f6786d9d640 1 -- 172.21.15.3:0/315023674 learned_addr learned my addr 172.21.15.3:0/315023674 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:17:25.072 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:25.067+0000 7f678659c640 1 --2- 172.21.15.3:0/315023674 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6788106800 0x7f6788198d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:25.072 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:25.067+0000 7f6786d9d640 1 -- 172.21.15.3:0/315023674 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6788106800 msgr2=0x7f6788198d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:25.072 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:25.067+0000 7f6786d9d640 1 --2- 172.21.15.3:0/315023674 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6788106800 0x7f6788198d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:25.072 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:25.067+0000 7f6786d9d640 1 -- 172.21.15.3:0/315023674 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67881993d0 con 0x7f6788100800 2024-09-21T12:17:25.072 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:25.067+0000 7f6786d9d640 1 --2- 172.21.15.3:0/315023674 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6788100800 0x7f6788198840 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f677800b420 tx=0x7f677800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:25.072 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:25.067+0000 7f676ffff640 1 -- 172.21.15.3:0/315023674 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6778011630 con 0x7f6788100800 2024-09-21T12:17:25.072 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:25.067+0000 7f678d25e640 1 -- 172.21.15.3:0/315023674 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67881a18b0 con 0x7f6788100800 2024-09-21T12:17:25.072 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:25.067+0000 7f676ffff640 1 -- 172.21.15.3:0/315023674 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6778016070 con 0x7f6788100800 2024-09-21T12:17:25.072 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:25.067+0000 7f676ffff640 1 -- 172.21.15.3:0/315023674 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6778010d40 con 0x7f6788100800 2024-09-21T12:17:25.072 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:25.067+0000 7f678d25e640 1 -- 172.21.15.3:0/315023674 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67881a1cb0 con 0x7f6788100800 2024-09-21T12:17:25.073 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:25.068+0000 7f678d25e640 1 -- 172.21.15.3:0/315023674 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6788101f40 con 0x7f6788100800 2024-09-21T12:17:25.073 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:25.069+0000 7f676ffff640 1 -- 172.21.15.3:0/315023674 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 19) ==== 92549+0+0 (secure 0 0 0) 0x7f677801b460 con 0x7f6788100800 2024-09-21T12:17:25.073 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:25.069+0000 7f676ffff640 1 --2- 172.21.15.3:0/315023674 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f677006e2b0 0x7f6770070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:25.073 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:25.069+0000 7f676ffff640 1 -- 172.21.15.3:0/315023674 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7f677808d690 con 0x7f6788100800 2024-09-21T12:17:25.073 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:25.069+0000 7f678659c640 1 --2- 172.21.15.3:0/315023674 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f677006e2b0 0x7f6770070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:25.074 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:25.070+0000 7f678659c640 1 --2- 172.21.15.3:0/315023674 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f677006e2b0 0x7f6770070770 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f677c031460 tx=0x7f677c009560 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:25.076 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:25.074+0000 7f676ffff640 1 -- 172.21.15.3:0/315023674 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f677805b330 con 0x7f6788100800 2024-09-21T12:17:25.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:25.293+0000 7f678d25e640 1 -- 172.21.15.3:0/315023674 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f6788108800 con 0x7f6788100800 2024-09-21T12:17:25.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:25.293+0000 7f676ffff640 1 -- 172.21.15.3:0/315023674 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f677805efe0 con 0x7f6788100800 2024-09-21T12:17:25.296 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:17:25.296 INFO:teuthology.orchestra.run.smithi003.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-21T12:17:25.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:25.295+0000 7f678d25e640 1 -- 172.21.15.3:0/315023674 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f677006e2b0 msgr2=0x7f6770070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:25.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:25.295+0000 7f678d25e640 1 --2- 172.21.15.3:0/315023674 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f677006e2b0 0x7f6770070770 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f677c031460 tx=0x7f677c009560 comp rx=0 tx=0).stop 2024-09-21T12:17:25.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:25.296+0000 7f678d25e640 1 -- 172.21.15.3:0/315023674 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6788100800 msgr2=0x7f6788198840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:25.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:25.296+0000 7f678d25e640 1 --2- 172.21.15.3:0/315023674 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6788100800 0x7f6788198840 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f677800b420 tx=0x7f677800b8e0 comp rx=0 tx=0).stop 2024-09-21T12:17:25.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:25.296+0000 7f678d25e640 1 -- 172.21.15.3:0/315023674 shutdown_connections 2024-09-21T12:17:25.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:25.296+0000 7f678d25e640 1 --2- 172.21.15.3:0/315023674 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f677006e2b0 0x7f6770070770 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:25.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:25.296+0000 7f678d25e640 1 --2- 172.21.15.3:0/315023674 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6788106800 0x7f6788198d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:25.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:25.296+0000 7f678d25e640 1 --2- 172.21.15.3:0/315023674 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6788100800 0x7f6788198840 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:25.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:25.296+0000 7f678d25e640 1 -- 172.21.15.3:0/315023674 >> 172.21.15.3:0/315023674 conn(0x7f67880fc520 msgr2=0x7f67880fcdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:25.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:25.296+0000 7f678d25e640 1 -- 172.21.15.3:0/315023674 shutdown_connections 2024-09-21T12:17:25.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:25.296+0000 7f678d25e640 1 -- 172.21.15.3:0/315023674 wait complete. 2024-09-21T12:17:25.700 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:25 smithi003 ceph-mon[28057]: from='client.14508 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T12:17:25.700 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:25 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/315023674' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-21T12:17:25.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:25 smithi192 ceph-mon[35641]: from='client.14508 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-21T12:17:25.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:25 smithi192 ceph-mon[35641]: from='client.? 172.21.15.3:0/315023674' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-21T12:17:26.017 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-21T12:17:26.017 INFO:tasks.cephadm:Setup complete, yielding 2024-09-21T12:17:26.017 INFO:teuthology.run_tasks:Running task print... 2024-09-21T12:17:26.027 INFO:teuthology.task.print:**** done end installing squid cephadm ... 2024-09-21T12:17:26.027 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T12:17:26.059 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi003.front.sepia.ceph.com 2024-09-21T12:17:26.059 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-09-21T12:17:26.325 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:17:26.678 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:26 smithi003 ceph-mon[28057]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:17:26.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:26 smithi192 ceph-mon[35641]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:17:26.770 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:26.763+0000 7f3e44091640 1 -- 172.21.15.3:0/1972260052 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e3c102b60 msgr2=0x7f3e3c102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:26.771 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:26.763+0000 7f3e44091640 1 --2- 172.21.15.3:0/1972260052 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e3c102b60 0x7f3e3c102fe0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f3e2c009880 tx=0x7f3e2c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:17:26.771 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:26.763+0000 7f3e44091640 1 -- 172.21.15.3:0/1972260052 shutdown_connections 2024-09-21T12:17:26.771 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:26.763+0000 7f3e44091640 1 --2- 172.21.15.3:0/1972260052 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e3c102b60 0x7f3e3c102fe0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:26.771 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:26.763+0000 7f3e44091640 1 --2- 172.21.15.3:0/1972260052 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e3c101960 0x7f3e3c101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:26.771 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:26.763+0000 7f3e44091640 1 -- 172.21.15.3:0/1972260052 >> 172.21.15.3:0/1972260052 conn(0x7f3e3c0fd0f0 msgr2=0x7f3e3c0ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:26.771 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:26.763+0000 7f3e44091640 1 -- 172.21.15.3:0/1972260052 shutdown_connections 2024-09-21T12:17:26.771 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:26.763+0000 7f3e44091640 1 -- 172.21.15.3:0/1972260052 wait complete. 2024-09-21T12:17:26.771 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:26.764+0000 7f3e44091640 1 Processor -- start 2024-09-21T12:17:26.771 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:26.764+0000 7f3e44091640 1 -- start start 2024-09-21T12:17:26.771 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:26.764+0000 7f3e44091640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e3c101960 0x7f3e3c197490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:26.771 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:26.764+0000 7f3e44091640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e3c102b60 0x7f3e3c1979d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:26.771 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:26.764+0000 7f3e44091640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f3e3c10a7a0 con 0x7f3e3c101960 2024-09-21T12:17:26.772 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:26.764+0000 7f3e44091640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3e3c10a620 con 0x7f3e3c102b60 2024-09-21T12:17:26.772 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:26.764+0000 7f3e41e2d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e3c101960 0x7f3e3c197490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:26.772 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:26.764+0000 7f3e41e2d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e3c101960 0x7f3e3c197490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56198/0 (socket says 172.21.15.3:56198) 2024-09-21T12:17:26.772 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:26.764+0000 7f3e41e2d640 1 -- 172.21.15.3:0/356090990 learned_addr learned my addr 172.21.15.3:0/356090990 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:17:26.772 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:26.764+0000 7f3e4162c640 1 --2- 172.21.15.3:0/356090990 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e3c102b60 0x7f3e3c1979d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:26.772 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:26.764+0000 7f3e41e2d640 1 -- 172.21.15.3:0/356090990 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e3c102b60 msgr2=0x7f3e3c1979d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:26.772 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:26.764+0000 7f3e41e2d640 1 --2- 172.21.15.3:0/356090990 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e3c102b60 0x7f3e3c1979d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:26.772 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:26.764+0000 7f3e41e2d640 1 -- 172.21.15.3:0/356090990 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e3c198050 con 0x7f3e3c101960 2024-09-21T12:17:26.772 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:26.765+0000 7f3e41e2d640 1 --2- 172.21.15.3:0/356090990 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e3c101960 0x7f3e3c197490 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3e3800d8d0 tx=0x7f3e3800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:26.772 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:26.765+0000 7f3e32ffd640 1 -- 172.21.15.3:0/356090990 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3e38017070 con 0x7f3e3c101960 2024-09-21T12:17:26.772 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:26.765+0000 7f3e44091640 1 -- 172.21.15.3:0/356090990 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e3c19ca90 con 0x7f3e3c101960 2024-09-21T12:17:26.772 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:26.765+0000 7f3e32ffd640 1 -- 172.21.15.3:0/356090990 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3e3800be10 con 0x7f3e3c101960 2024-09-21T12:17:26.772 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:26.765+0000 7f3e32ffd640 1 -- 172.21.15.3:0/356090990 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3e3800f3c0 con 0x7f3e3c101960 2024-09-21T12:17:26.772 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:26.765+0000 7f3e44091640 1 -- 172.21.15.3:0/356090990 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e3c19d020 con 0x7f3e3c101960 2024-09-21T12:17:26.773 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:26.766+0000 7f3e44091640 1 -- 172.21.15.3:0/356090990 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e3c101d60 con 0x7f3e3c101960 2024-09-21T12:17:26.773 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:26.766+0000 7f3e32ffd640 1 -- 172.21.15.3:0/356090990 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 19) ==== 92549+0+0 (secure 0 0 0) 0x7f3e3801a070 con 0x7f3e3c101960 2024-09-21T12:17:26.773 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:26.767+0000 7f3e32ffd640 1 --2- 172.21.15.3:0/356090990 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f3e2806e2b0 0x7f3e28070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:26.773 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:26.767+0000 7f3e32ffd640 1 -- 172.21.15.3:0/356090990 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7f3e3808da60 con 0x7f3e3c101960 2024-09-21T12:17:26.773 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:26.767+0000 7f3e4162c640 1 --2- 172.21.15.3:0/356090990 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f3e2806e2b0 0x7f3e28070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:26.773 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:26.767+0000 7f3e4162c640 1 --2- 172.21.15.3:0/356090990 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f3e2806e2b0 0x7f3e28070770 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c198940 tx=0x7f3e2c005a20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:26.774 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:26.771+0000 7f3e32ffd640 1 -- 172.21.15.3:0/356090990 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3e3805b700 con 0x7f3e3c101960 2024-09-21T12:17:26.950 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:26.948+0000 7f3e44091640 1 -- 172.21.15.3:0/356090990 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) -- 0x7f3e3c1915b0 con 0x7f3e3c101960 2024-09-21T12:17:26.953 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:26.951+0000 7f3e32ffd640 1 -- 172.21.15.3:0/356090990 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v39)=0 v39) ==== 143+0+0 (secure 0 0 0) 0x7f3e3c1915b0 con 0x7f3e3c101960 2024-09-21T12:17:26.956 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:26.954+0000 7f3e44091640 1 -- 172.21.15.3:0/356090990 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f3e2806e2b0 msgr2=0x7f3e28070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:26.956 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:26.954+0000 7f3e44091640 1 --2- 172.21.15.3:0/356090990 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f3e2806e2b0 0x7f3e28070770 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c198940 tx=0x7f3e2c005a20 comp rx=0 tx=0).stop 2024-09-21T12:17:26.956 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:26.954+0000 7f3e44091640 1 -- 172.21.15.3:0/356090990 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e3c101960 msgr2=0x7f3e3c197490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:26.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:26.954+0000 7f3e44091640 1 --2- 172.21.15.3:0/356090990 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e3c101960 0x7f3e3c197490 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3e3800d8d0 tx=0x7f3e3800dd90 comp rx=0 tx=0).stop 2024-09-21T12:17:26.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:26.954+0000 7f3e44091640 1 -- 172.21.15.3:0/356090990 shutdown_connections 2024-09-21T12:17:26.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:26.954+0000 7f3e44091640 1 --2- 172.21.15.3:0/356090990 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f3e2806e2b0 0x7f3e28070770 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:26.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:26.954+0000 7f3e44091640 1 --2- 172.21.15.3:0/356090990 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e3c102b60 0x7f3e3c1979d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:26.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:26.954+0000 7f3e44091640 1 --2- 172.21.15.3:0/356090990 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e3c101960 0x7f3e3c197490 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:26.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:26.954+0000 7f3e44091640 1 -- 172.21.15.3:0/356090990 >> 172.21.15.3:0/356090990 conn(0x7f3e3c0fd0f0 msgr2=0x7f3e3c105fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:26.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:26.954+0000 7f3e44091640 1 -- 172.21.15.3:0/356090990 shutdown_connections 2024-09-21T12:17:26.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:26.954+0000 7f3e44091640 1 -- 172.21.15.3:0/356090990 wait complete. 2024-09-21T12:17:27.773 INFO:teuthology.run_tasks:Running task print... 2024-09-21T12:17:27.787 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-09-21T12:17:27.787 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T12:17:27.829 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi003.front.sepia.ceph.com 2024-09-21T12:17:27.829 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- bash -c 'ceph orch status' 2024-09-21T12:17:28.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:27 smithi003 ceph-mon[28057]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:17:28.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:27 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/356090990' entity='client.admin' 2024-09-21T12:17:28.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:27 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:17:28.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:27 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:17:28.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:27 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:17:28.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:27 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:17:28.093 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:17:28.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:27 smithi192 ceph-mon[35641]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:17:28.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:27 smithi192 ceph-mon[35641]: from='client.? 172.21.15.3:0/356090990' entity='client.admin' 2024-09-21T12:17:28.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:27 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:17:28.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:27 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:17:28.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:27 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:17:28.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:27 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:17:28.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:28.567+0000 7f7881e2e640 1 -- 172.21.15.3:0/972167635 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f787c101a60 msgr2=0x7f787c101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:28.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:28.567+0000 7f7881e2e640 1 --2- 172.21.15.3:0/972167635 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f787c101a60 0x7f787c101ee0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f7870009880 tx=0x7f787002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:17:28.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:28.567+0000 7f7881e2e640 1 -- 172.21.15.3:0/972167635 shutdown_connections 2024-09-21T12:17:28.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:28.567+0000 7f7881e2e640 1 --2- 172.21.15.3:0/972167635 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f787c101a60 0x7f787c101ee0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:28.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:28.567+0000 7f7881e2e640 1 --2- 172.21.15.3:0/972167635 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f787c100860 0x7f787c100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:28.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:28.567+0000 7f7881e2e640 1 -- 172.21.15.3:0/972167635 >> 172.21.15.3:0/972167635 conn(0x7f787c0fc010 msgr2=0x7f787c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:28.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:28.567+0000 7f7881e2e640 1 -- 172.21.15.3:0/972167635 shutdown_connections 2024-09-21T12:17:28.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:28.567+0000 7f7881e2e640 1 -- 172.21.15.3:0/972167635 wait complete. 2024-09-21T12:17:28.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:28.568+0000 7f7881e2e640 1 Processor -- start 2024-09-21T12:17:28.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:28.568+0000 7f7881e2e640 1 -- start start 2024-09-21T12:17:28.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:28.568+0000 7f7881e2e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f787c100860 0x7f787c196430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:28.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:28.568+0000 7f7881e2e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f787c101a60 0x7f787c196970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:28.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:28.568+0000 7f7881e2e640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f787c109720 con 0x7f787c100860 2024-09-21T12:17:28.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:28.568+0000 7f7881e2e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f787c1095a0 con 0x7f787c101a60 2024-09-21T12:17:28.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:28.568+0000 7f787b7fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f787c100860 0x7f787c196430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:28.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:28.568+0000 7f787b7fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f787c100860 0x7f787c196430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56204/0 (socket says 172.21.15.3:56204) 2024-09-21T12:17:28.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:28.568+0000 7f787b7fe640 1 -- 172.21.15.3:0/630784355 learned_addr learned my addr 172.21.15.3:0/630784355 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:17:28.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:28.568+0000 7f787b7fe640 1 -- 172.21.15.3:0/630784355 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f787c101a60 msgr2=0x7f787c196970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:28.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:28.568+0000 7f787b7fe640 1 --2- 172.21.15.3:0/630784355 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f787c101a60 0x7f787c196970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:28.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:28.568+0000 7f787b7fe640 1 -- 172.21.15.3:0/630784355 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f787c196ff0 con 0x7f787c100860 2024-09-21T12:17:28.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:28.569+0000 7f787b7fe640 1 --2- 172.21.15.3:0/630784355 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f787c100860 0x7f787c196430 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f786c00b3d0 tx=0x7f786c00b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:28.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:28.569+0000 7f7878ff9640 1 -- 172.21.15.3:0/630784355 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f786c015020 con 0x7f787c100860 2024-09-21T12:17:28.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:28.569+0000 7f7881e2e640 1 -- 172.21.15.3:0/630784355 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f787c19ba30 con 0x7f787c100860 2024-09-21T12:17:28.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:28.569+0000 7f7878ff9640 1 -- 172.21.15.3:0/630784355 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f786c011af0 con 0x7f787c100860 2024-09-21T12:17:28.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:28.569+0000 7f7878ff9640 1 -- 172.21.15.3:0/630784355 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f786c010da0 con 0x7f787c100860 2024-09-21T12:17:28.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:28.569+0000 7f7881e2e640 1 -- 172.21.15.3:0/630784355 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f787c19c040 con 0x7f787c100860 2024-09-21T12:17:28.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:28.570+0000 7f7881e2e640 1 -- 172.21.15.3:0/630784355 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f787c100c60 con 0x7f787c100860 2024-09-21T12:17:28.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:28.570+0000 7f7878ff9640 1 -- 172.21.15.3:0/630784355 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 19) ==== 92549+0+0 (secure 0 0 0) 0x7f786c018020 con 0x7f787c100860 2024-09-21T12:17:28.598 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:28.571+0000 7f7878ff9640 1 --2- 172.21.15.3:0/630784355 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f786406e2b0 0x7f7864070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:28.598 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:28.571+0000 7f7878ff9640 1 -- 172.21.15.3:0/630784355 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7f786c08d9c0 con 0x7f787c100860 2024-09-21T12:17:28.598 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:28.571+0000 7f787affd640 1 --2- 172.21.15.3:0/630784355 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f786406e2b0 0x7f7864070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:28.598 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:28.571+0000 7f787affd640 1 --2- 172.21.15.3:0/630784355 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f786406e2b0 0x7f7864070770 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f78700096c0 tx=0x7f7870000bc0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:28.598 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:28.575+0000 7f7878ff9640 1 -- 172.21.15.3:0/630784355 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f786c01f020 con 0x7f787c100860 2024-09-21T12:17:28.770 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:28.767+0000 7f7881e2e640 1 -- 172.21.15.3:0/630784355 --> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f787c0626f0 con 0x7f786406e2b0 2024-09-21T12:17:28.770 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:28.768+0000 7f7878ff9640 1 -- 172.21.15.3:0/630784355 <== mgr.14217 v2:172.21.15.3:6800/2480880781 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f787c0626f0 con 0x7f786406e2b0 2024-09-21T12:17:28.771 INFO:teuthology.orchestra.run.smithi003.stdout:Backend: cephadm 2024-09-21T12:17:28.771 INFO:teuthology.orchestra.run.smithi003.stdout:Available: Yes 2024-09-21T12:17:28.771 INFO:teuthology.orchestra.run.smithi003.stdout:Paused: No 2024-09-21T12:17:28.773 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:28.770+0000 7f7881e2e640 1 -- 172.21.15.3:0/630784355 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f786406e2b0 msgr2=0x7f7864070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:28.773 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:28.770+0000 7f7881e2e640 1 --2- 172.21.15.3:0/630784355 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f786406e2b0 0x7f7864070770 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f78700096c0 tx=0x7f7870000bc0 comp rx=0 tx=0).stop 2024-09-21T12:17:28.773 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:28.770+0000 7f7881e2e640 1 -- 172.21.15.3:0/630784355 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f787c100860 msgr2=0x7f787c196430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:28.773 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:28.770+0000 7f7881e2e640 1 --2- 172.21.15.3:0/630784355 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f787c100860 0x7f787c196430 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f786c00b3d0 tx=0x7f786c00b890 comp rx=0 tx=0).stop 2024-09-21T12:17:28.773 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:28.770+0000 7f7881e2e640 1 -- 172.21.15.3:0/630784355 shutdown_connections 2024-09-21T12:17:28.773 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:28.770+0000 7f7881e2e640 1 --2- 172.21.15.3:0/630784355 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f786406e2b0 0x7f7864070770 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:28.773 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:28.770+0000 7f7881e2e640 1 --2- 172.21.15.3:0/630784355 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f787c101a60 0x7f787c196970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:28.773 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:28.770+0000 7f7881e2e640 1 --2- 172.21.15.3:0/630784355 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f787c100860 0x7f787c196430 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:28.773 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:28.770+0000 7f7881e2e640 1 -- 172.21.15.3:0/630784355 >> 172.21.15.3:0/630784355 conn(0x7f787c0fc010 msgr2=0x7f787c104f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:28.774 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:28.770+0000 7f7881e2e640 1 -- 172.21.15.3:0/630784355 shutdown_connections 2024-09-21T12:17:28.774 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:28.770+0000 7f7881e2e640 1 -- 172.21.15.3:0/630784355 wait complete. 2024-09-21T12:17:29.470 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- bash -c 'ceph orch ps' 2024-09-21T12:17:29.736 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:17:30.109 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:29 smithi003 ceph-mon[28057]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:17:30.109 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:29 smithi003 ceph-mon[28057]: from='client.14520 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:17:30.221 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:30.187+0000 7fcf8e755640 1 -- 172.21.15.3:0/2039663579 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf88104d20 msgr2=0x7fcf88107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:30.221 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:30.187+0000 7fcf8e755640 1 --2- 172.21.15.3:0/2039663579 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf88104d20 0x7fcf88107110 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c0098b0 tx=0x7fcf7c02a4d0 comp rx=0 tx=0).stop 2024-09-21T12:17:30.221 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:30.187+0000 7fcf8e755640 1 -- 172.21.15.3:0/2039663579 shutdown_connections 2024-09-21T12:17:30.221 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:30.187+0000 7fcf8e755640 1 --2- 172.21.15.3:0/2039663579 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf88104d20 0x7fcf88107110 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:30.222 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:30.187+0000 7fcf8e755640 1 --2- 172.21.15.3:0/2039663579 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcf881023f0 0x7fcf881047e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:30.222 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:30.187+0000 7fcf8e755640 1 -- 172.21.15.3:0/2039663579 >> 172.21.15.3:0/2039663579 conn(0x7fcf880fc010 msgr2=0x7fcf880fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:30.222 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:30.188+0000 7fcf8e755640 1 -- 172.21.15.3:0/2039663579 shutdown_connections 2024-09-21T12:17:30.222 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:30.188+0000 7fcf8e755640 1 -- 172.21.15.3:0/2039663579 wait complete. 2024-09-21T12:17:30.222 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:30.188+0000 7fcf8e755640 1 Processor -- start 2024-09-21T12:17:30.222 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:30.188+0000 7fcf8e755640 1 -- start start 2024-09-21T12:17:30.222 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:30.189+0000 7fcf8e755640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcf881023f0 0x7fcf88197530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:30.222 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:30.189+0000 7fcf8e755640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf88104d20 0x7fcf88197a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:30.222 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:30.189+0000 7fcf8e755640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fcf8810a7b0 con 0x7fcf88104d20 2024-09-21T12:17:30.222 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:30.189+0000 7fcf8e755640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fcf8810a630 con 0x7fcf881023f0 2024-09-21T12:17:30.222 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:30.189+0000 7fcf877fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf88104d20 0x7fcf88197a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:30.222 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:30.189+0000 7fcf877fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf88104d20 0x7fcf88197a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56214/0 (socket says 172.21.15.3:56214) 2024-09-21T12:17:30.223 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:30.189+0000 7fcf877fe640 1 -- 172.21.15.3:0/3200893860 learned_addr learned my addr 172.21.15.3:0/3200893860 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:17:30.223 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:30.189+0000 7fcf87fff640 1 --2- 172.21.15.3:0/3200893860 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcf881023f0 0x7fcf88197530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:30.223 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:30.189+0000 7fcf877fe640 1 -- 172.21.15.3:0/3200893860 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcf881023f0 msgr2=0x7fcf88197530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:30.223 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:30.189+0000 7fcf877fe640 1 --2- 172.21.15.3:0/3200893860 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcf881023f0 0x7fcf88197530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:30.223 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:30.189+0000 7fcf877fe640 1 -- 172.21.15.3:0/3200893860 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf881980f0 con 0x7fcf88104d20 2024-09-21T12:17:30.223 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:30.189+0000 7fcf877fe640 1 --2- 172.21.15.3:0/3200893860 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf88104d20 0x7fcf88197a70 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c009230 tx=0x7fcf7c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:30.223 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:30.190+0000 7fcf857fa640 1 -- 172.21.15.3:0/3200893860 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcf7c03f070 con 0x7fcf88104d20 2024-09-21T12:17:30.223 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:30.190+0000 7fcf857fa640 1 -- 172.21.15.3:0/3200893860 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcf7c004a50 con 0x7fcf88104d20 2024-09-21T12:17:30.223 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:30.190+0000 7fcf8e755640 1 -- 172.21.15.3:0/3200893860 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf8819cad0 con 0x7fcf88104d20 2024-09-21T12:17:30.223 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:30.190+0000 7fcf857fa640 1 -- 172.21.15.3:0/3200893860 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcf7c035030 con 0x7fcf88104d20 2024-09-21T12:17:30.223 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:30.190+0000 7fcf8e755640 1 -- 172.21.15.3:0/3200893860 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf8819d060 con 0x7fcf88104d20 2024-09-21T12:17:30.223 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:30.191+0000 7fcf8e755640 1 -- 172.21.15.3:0/3200893860 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf881027d0 con 0x7fcf88104d20 2024-09-21T12:17:30.223 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:30.192+0000 7fcf857fa640 1 -- 172.21.15.3:0/3200893860 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 19) ==== 92549+0+0 (secure 0 0 0) 0x7fcf7c042070 con 0x7fcf88104d20 2024-09-21T12:17:30.223 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:30.192+0000 7fcf857fa640 1 --2- 172.21.15.3:0/3200893860 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fcf7006e2b0 0x7fcf70070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:30.224 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:30.192+0000 7fcf857fa640 1 -- 172.21.15.3:0/3200893860 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7fcf7c0ae9b0 con 0x7fcf88104d20 2024-09-21T12:17:30.224 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:30.192+0000 7fcf87fff640 1 --2- 172.21.15.3:0/3200893860 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fcf7006e2b0 0x7fcf70070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:30.224 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:30.193+0000 7fcf87fff640 1 --2- 172.21.15.3:0/3200893860 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fcf7006e2b0 0x7fcf70070770 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fcf78005fd0 tx=0x7fcf78005850 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:30.224 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:30.196+0000 7fcf857fa640 1 -- 172.21.15.3:0/3200893860 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcf7c07c650 con 0x7fcf88104d20 2024-09-21T12:17:30.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:29 smithi192 ceph-mon[35641]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:17:30.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:29 smithi192 ceph-mon[35641]: from='client.14520 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:17:30.387 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:30.384+0000 7fcf8e755640 1 -- 172.21.15.3:0/3200893860 --> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fcf88105780 con 0x7fcf7006e2b0 2024-09-21T12:17:30.401 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:30.398+0000 7fcf857fa640 1 -- 172.21.15.3:0/3200893860 <== mgr.14217 v2:172.21.15.3:6800/2480880781 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3120 (secure 0 0 0) 0x7fcf88105780 con 0x7fcf7006e2b0 2024-09-21T12:17:30.401 INFO:teuthology.orchestra.run.smithi003.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:17:30.401 INFO:teuthology.orchestra.run.smithi003.stdout:alertmanager.smithi003 smithi003 *:9093,9094 running (3m) 2m ago 5m 26.7M - 0.25.0 c8568f914cd2 5c03f233277e 2024-09-21T12:17:30.401 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-exporter.smithi003 smithi003 running (5m) 2m ago 5m 7680k - 19.1.1-373-g4e45e6b4 164465d2334a 38ef0e2dfcc4 2024-09-21T12:17:30.401 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-exporter.smithi192 smithi192 running (4m) 45s ago 4m 5259k - 19.1.1-373-g4e45e6b4 164465d2334a 848a2ec72db7 2024-09-21T12:17:30.402 INFO:teuthology.orchestra.run.smithi003.stdout:crash.smithi003 smithi003 running (5m) 2m ago 5m 6899k - 19.1.1-373-g4e45e6b4 164465d2334a c63f209dc1dc 2024-09-21T12:17:30.402 INFO:teuthology.orchestra.run.smithi003.stdout:crash.smithi192 smithi192 running (4m) 45s ago 4m 6895k - 19.1.1-373-g4e45e6b4 164465d2334a cc70c9a7b2f7 2024-09-21T12:17:30.402 INFO:teuthology.orchestra.run.smithi003.stdout:grafana.smithi003 smithi003 *:3000 running (3m) 2m ago 5m 75.8M - 9.4.12 2bacad6d85d8 f504f60818f0 2024-09-21T12:17:30.402 INFO:teuthology.orchestra.run.smithi003.stdout:mgr.smithi003.wztftl smithi003 *:9283,8765,8443 running (6m) 2m ago 6m 492M - 19.1.1-373-g4e45e6b4 164465d2334a 060c1f18749f 2024-09-21T12:17:30.402 INFO:teuthology.orchestra.run.smithi003.stdout:mgr.smithi192.qsaprd smithi192 *:8443,9283,8765 running (4m) 45s ago 4m 441M - 19.1.1-373-g4e45e6b4 164465d2334a 8acd4fe1e324 2024-09-21T12:17:30.402 INFO:teuthology.orchestra.run.smithi003.stdout:mon.smithi003 smithi003 running (6m) 2m ago 6m 45.2M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 16bccf2c7503 2024-09-21T12:17:30.402 INFO:teuthology.orchestra.run.smithi003.stdout:mon.smithi192 smithi192 running (4m) 45s ago 4m 41.2M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 4fe4c4b3dc5d 2024-09-21T12:17:30.402 INFO:teuthology.orchestra.run.smithi003.stdout:node-exporter.smithi003 smithi003 *:9100 running (5m) 2m ago 5m 15.7M - 1.5.0 0da6a335fe13 a1eb875faefc 2024-09-21T12:17:30.402 INFO:teuthology.orchestra.run.smithi003.stdout:node-exporter.smithi192 smithi192 *:9100 running (4m) 45s ago 4m 16.5M - 1.5.0 0da6a335fe13 10c2542c2e19 2024-09-21T12:17:30.402 INFO:teuthology.orchestra.run.smithi003.stdout:osd.0 smithi003 running (3m) 2m ago 3m 44.9M 3948M 19.1.1-373-g4e45e6b4 164465d2334a d07f1489720d 2024-09-21T12:17:30.402 INFO:teuthology.orchestra.run.smithi003.stdout:osd.1 smithi003 running (2m) 2m ago 2m 37.5M 3948M 19.1.1-373-g4e45e6b4 164465d2334a 6abd75a07645 2024-09-21T12:17:30.402 INFO:teuthology.orchestra.run.smithi003.stdout:osd.2 smithi003 running (2m) 2m ago 2m 14.4M 3948M 19.1.1-373-g4e45e6b4 164465d2334a 3265369e573b 2024-09-21T12:17:30.402 INFO:teuthology.orchestra.run.smithi003.stdout:osd.3 smithi192 running (105s) 45s ago 104s 40.1M 4970M 19.1.1-373-g4e45e6b4 164465d2334a 13efcfd71c05 2024-09-21T12:17:30.402 INFO:teuthology.orchestra.run.smithi003.stdout:osd.4 smithi192 running (78s) 45s ago 77s 39.1M 4970M 19.1.1-373-g4e45e6b4 164465d2334a f33bf453cb3e 2024-09-21T12:17:30.403 INFO:teuthology.orchestra.run.smithi003.stdout:osd.5 smithi192 running (50s) 45s ago 49s 12.1M 4970M 19.1.1-373-g4e45e6b4 164465d2334a 12d7b7c8e985 2024-09-21T12:17:30.403 INFO:teuthology.orchestra.run.smithi003.stdout:prometheus.smithi003 smithi003 *:9095 running (3m) 2m ago 4m 44.8M - 2.43.0 a07b618ecd1d 4ecd73d1b37c 2024-09-21T12:17:30.403 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:30.401+0000 7fcf8e755640 1 -- 172.21.15.3:0/3200893860 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fcf7006e2b0 msgr2=0x7fcf70070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:30.404 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:30.401+0000 7fcf8e755640 1 --2- 172.21.15.3:0/3200893860 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fcf7006e2b0 0x7fcf70070770 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fcf78005fd0 tx=0x7fcf78005850 comp rx=0 tx=0).stop 2024-09-21T12:17:30.404 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:30.401+0000 7fcf8e755640 1 -- 172.21.15.3:0/3200893860 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf88104d20 msgr2=0x7fcf88197a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:30.404 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:30.401+0000 7fcf8e755640 1 --2- 172.21.15.3:0/3200893860 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf88104d20 0x7fcf88197a70 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c009230 tx=0x7fcf7c0045e0 comp rx=0 tx=0).stop 2024-09-21T12:17:30.404 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:30.401+0000 7fcf8e755640 1 -- 172.21.15.3:0/3200893860 shutdown_connections 2024-09-21T12:17:30.404 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:30.401+0000 7fcf8e755640 1 --2- 172.21.15.3:0/3200893860 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fcf7006e2b0 0x7fcf70070770 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:30.404 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:30.401+0000 7fcf8e755640 1 --2- 172.21.15.3:0/3200893860 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf88104d20 0x7fcf88197a70 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:30.404 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:30.401+0000 7fcf8e755640 1 --2- 172.21.15.3:0/3200893860 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcf881023f0 0x7fcf88197530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:30.404 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:30.401+0000 7fcf8e755640 1 -- 172.21.15.3:0/3200893860 >> 172.21.15.3:0/3200893860 conn(0x7fcf880fc010 msgr2=0x7fcf880fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:30.404 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:30.401+0000 7fcf8e755640 1 -- 172.21.15.3:0/3200893860 shutdown_connections 2024-09-21T12:17:30.404 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:30.401+0000 7fcf8e755640 1 -- 172.21.15.3:0/3200893860 wait complete. 2024-09-21T12:17:31.079 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- bash -c 'ceph orch ls' 2024-09-21T12:17:31.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:30 smithi192 ceph-mon[35641]: from='client.14524 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:17:31.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:30 smithi003 ceph-mon[28057]: from='client.14524 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:17:31.340 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:17:31.849 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:31.845+0000 7f59cad46640 1 -- 172.21.15.3:0/3093894191 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f59c4104d20 msgr2=0x7f59c4107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:31.849 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:31.845+0000 7f59cad46640 1 --2- 172.21.15.3:0/3093894191 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f59c4104d20 0x7f59c4107110 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f59b80098b0 tx=0x7f59b802a4d0 comp rx=0 tx=0).stop 2024-09-21T12:17:31.849 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:31.845+0000 7f59cad46640 1 -- 172.21.15.3:0/3093894191 shutdown_connections 2024-09-21T12:17:31.849 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:31.845+0000 7f59cad46640 1 --2- 172.21.15.3:0/3093894191 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f59c4104d20 0x7f59c4107110 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:31.849 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:31.845+0000 7f59cad46640 1 --2- 172.21.15.3:0/3093894191 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f59c41023f0 0x7f59c41047e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:31.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:31.845+0000 7f59cad46640 1 -- 172.21.15.3:0/3093894191 >> 172.21.15.3:0/3093894191 conn(0x7f59c40fc010 msgr2=0x7f59c40fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:31.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:31.845+0000 7f59cad46640 1 -- 172.21.15.3:0/3093894191 shutdown_connections 2024-09-21T12:17:31.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:31.845+0000 7f59cad46640 1 -- 172.21.15.3:0/3093894191 wait complete. 2024-09-21T12:17:31.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:31.845+0000 7f59cad46640 1 Processor -- start 2024-09-21T12:17:31.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:31.845+0000 7f59cad46640 1 -- start start 2024-09-21T12:17:31.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:31.846+0000 7f59cad46640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f59c41023f0 0x7f59c4197510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:31.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:31.846+0000 7f59cad46640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f59c4104d20 0x7f59c4197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:31.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:31.846+0000 7f59cad46640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f59c410a790 con 0x7f59c4104d20 2024-09-21T12:17:31.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:31.846+0000 7f59cad46640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f59c410a610 con 0x7f59c41023f0 2024-09-21T12:17:31.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:31.846+0000 7f59c3fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f59c4104d20 0x7f59c4197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:31.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:31.846+0000 7f59c3fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f59c4104d20 0x7f59c4197a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47204/0 (socket says 172.21.15.3:47204) 2024-09-21T12:17:31.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:31.846+0000 7f59c3fff640 1 -- 172.21.15.3:0/1109574802 learned_addr learned my addr 172.21.15.3:0/1109574802 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:17:31.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:31.846+0000 7f59c8ae2640 1 --2- 172.21.15.3:0/1109574802 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f59c41023f0 0x7f59c4197510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:31.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:31.846+0000 7f59c3fff640 1 -- 172.21.15.3:0/1109574802 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f59c41023f0 msgr2=0x7f59c4197510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:31.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:31.846+0000 7f59c3fff640 1 --2- 172.21.15.3:0/1109574802 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f59c41023f0 0x7f59c4197510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:31.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:31.846+0000 7f59c3fff640 1 -- 172.21.15.3:0/1109574802 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59c4198040 con 0x7f59c4104d20 2024-09-21T12:17:31.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:31.846+0000 7f59c3fff640 1 --2- 172.21.15.3:0/1109574802 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f59c4104d20 0x7f59c4197a50 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f59b8009230 tx=0x7f59b80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:31.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:31.846+0000 7f59c1ffb640 1 -- 172.21.15.3:0/1109574802 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f59b803f070 con 0x7f59c4104d20 2024-09-21T12:17:31.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:31.846+0000 7f59c1ffb640 1 -- 172.21.15.3:0/1109574802 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f59b80044d0 con 0x7f59c4104d20 2024-09-21T12:17:31.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:31.846+0000 7f59cad46640 1 -- 172.21.15.3:0/1109574802 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59c419ca50 con 0x7f59c4104d20 2024-09-21T12:17:31.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:31.846+0000 7f59c1ffb640 1 -- 172.21.15.3:0/1109574802 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f59b8035030 con 0x7f59c4104d20 2024-09-21T12:17:31.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:31.847+0000 7f59cad46640 1 -- 172.21.15.3:0/1109574802 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59c419cf50 con 0x7f59c4104d20 2024-09-21T12:17:31.852 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:31.848+0000 7f59cad46640 1 -- 172.21.15.3:0/1109574802 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59c41027d0 con 0x7f59c4104d20 2024-09-21T12:17:31.852 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:31.848+0000 7f59c1ffb640 1 -- 172.21.15.3:0/1109574802 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 19) ==== 92549+0+0 (secure 0 0 0) 0x7f59b8042070 con 0x7f59c4104d20 2024-09-21T12:17:31.852 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:31.849+0000 7f59c1ffb640 1 --2- 172.21.15.3:0/1109574802 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f59ac06e310 0x7f59ac0707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:31.852 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:31.849+0000 7f59c1ffb640 1 -- 172.21.15.3:0/1109574802 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7f59b80ae9e0 con 0x7f59c4104d20 2024-09-21T12:17:31.852 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:31.849+0000 7f59c8ae2640 1 --2- 172.21.15.3:0/1109574802 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f59ac06e310 0x7f59ac0707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:31.852 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:31.849+0000 7f59c8ae2640 1 --2- 172.21.15.3:0/1109574802 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f59ac06e310 0x7f59ac0707d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f59b4005e10 tx=0x7f59b4005da0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:31.855 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:31.853+0000 7f59c1ffb640 1 -- 172.21.15.3:0/1109574802 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f59b807c700 con 0x7f59c4104d20 2024-09-21T12:17:32.044 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:32.041+0000 7f59cad46640 1 -- 172.21.15.3:0/1109574802 --> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f59c4105780 con 0x7f59ac06e310 2024-09-21T12:17:32.044 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:31 smithi003 ceph-mon[28057]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:17:32.044 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:31 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:17:32.048 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:32.046+0000 7f59c1ffb640 1 -- 172.21.15.3:0/1109574802 <== mgr.14217 v2:172.21.15.3:6800/2480880781 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+1290 (secure 0 0 0) 0x7f59c4105780 con 0x7f59ac06e310 2024-09-21T12:17:32.048 INFO:teuthology.orchestra.run.smithi003.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-21T12:17:32.048 INFO:teuthology.orchestra.run.smithi003.stdout:alertmanager ?:9093,9094 1/1 2m ago 5m count:1 2024-09-21T12:17:32.048 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-exporter 2/2 2m ago 5m * 2024-09-21T12:17:32.048 INFO:teuthology.orchestra.run.smithi003.stdout:crash 2/2 2m ago 5m * 2024-09-21T12:17:32.048 INFO:teuthology.orchestra.run.smithi003.stdout:grafana ?:3000 1/1 2m ago 5m count:1 2024-09-21T12:17:32.049 INFO:teuthology.orchestra.run.smithi003.stdout:mgr 2/2 2m ago 5m count:2 2024-09-21T12:17:32.049 INFO:teuthology.orchestra.run.smithi003.stdout:mon 2/2 2m ago 5m smithi003:172.21.15.3=smithi003;smithi192:172.21.15.192=smithi192;count:2 2024-09-21T12:17:32.049 INFO:teuthology.orchestra.run.smithi003.stdout:node-exporter ?:9100 2/2 2m ago 5m * 2024-09-21T12:17:32.049 INFO:teuthology.orchestra.run.smithi003.stdout:osd 6 2m ago - 2024-09-21T12:17:32.049 INFO:teuthology.orchestra.run.smithi003.stdout:prometheus ?:9095 1/1 2m ago 5m count:1 2024-09-21T12:17:32.051 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:32.048+0000 7f59cad46640 1 -- 172.21.15.3:0/1109574802 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f59ac06e310 msgr2=0x7f59ac0707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:32.051 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:32.048+0000 7f59cad46640 1 --2- 172.21.15.3:0/1109574802 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f59ac06e310 0x7f59ac0707d0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f59b4005e10 tx=0x7f59b4005da0 comp rx=0 tx=0).stop 2024-09-21T12:17:32.051 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:32.048+0000 7f59cad46640 1 -- 172.21.15.3:0/1109574802 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f59c4104d20 msgr2=0x7f59c4197a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:32.051 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:32.048+0000 7f59cad46640 1 --2- 172.21.15.3:0/1109574802 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f59c4104d20 0x7f59c4197a50 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f59b8009230 tx=0x7f59b80048f0 comp rx=0 tx=0).stop 2024-09-21T12:17:32.051 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:32.048+0000 7f59cad46640 1 -- 172.21.15.3:0/1109574802 shutdown_connections 2024-09-21T12:17:32.051 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:32.048+0000 7f59cad46640 1 --2- 172.21.15.3:0/1109574802 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f59ac06e310 0x7f59ac0707d0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:32.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:32.048+0000 7f59cad46640 1 --2- 172.21.15.3:0/1109574802 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f59c4104d20 0x7f59c4197a50 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:32.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:32.048+0000 7f59cad46640 1 --2- 172.21.15.3:0/1109574802 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f59c41023f0 0x7f59c4197510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:32.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:32.048+0000 7f59cad46640 1 -- 172.21.15.3:0/1109574802 >> 172.21.15.3:0/1109574802 conn(0x7f59c40fc010 msgr2=0x7f59c40fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:32.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:32.048+0000 7f59cad46640 1 -- 172.21.15.3:0/1109574802 shutdown_connections 2024-09-21T12:17:32.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:32.048+0000 7f59cad46640 1 -- 172.21.15.3:0/1109574802 wait complete. 2024-09-21T12:17:32.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:31 smithi192 ceph-mon[35641]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:17:32.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:31 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:17:32.675 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- bash -c 'ceph orch host ls' 2024-09-21T12:17:32.934 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:17:33.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:32 smithi192 ceph-mon[35641]: from='client.14528 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:17:33.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:32 smithi003 ceph-mon[28057]: from='client.14528 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:17:33.426 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:33.413+0000 7f7ba5bc7640 1 -- 172.21.15.3:0/933679444 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7ba0100860 msgr2=0x7f7ba0100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:33.426 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:33.413+0000 7f7ba5bc7640 1 --2- 172.21.15.3:0/933679444 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7ba0100860 0x7f7ba0100c60 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f7b90009880 tx=0x7f7b9002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:17:33.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:33.414+0000 7f7ba5bc7640 1 -- 172.21.15.3:0/933679444 shutdown_connections 2024-09-21T12:17:33.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:33.414+0000 7f7ba5bc7640 1 --2- 172.21.15.3:0/933679444 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ba0101a60 0x7f7ba0101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:33.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:33.414+0000 7f7ba5bc7640 1 --2- 172.21.15.3:0/933679444 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7ba0100860 0x7f7ba0100c60 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:33.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:33.414+0000 7f7ba5bc7640 1 -- 172.21.15.3:0/933679444 >> 172.21.15.3:0/933679444 conn(0x7f7ba00fc010 msgr2=0x7f7ba00fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:33.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:33.414+0000 7f7ba5bc7640 1 -- 172.21.15.3:0/933679444 shutdown_connections 2024-09-21T12:17:33.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:33.414+0000 7f7ba5bc7640 1 -- 172.21.15.3:0/933679444 wait complete. 2024-09-21T12:17:33.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:33.414+0000 7f7ba5bc7640 1 Processor -- start 2024-09-21T12:17:33.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:33.414+0000 7f7ba5bc7640 1 -- start start 2024-09-21T12:17:33.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:33.415+0000 7f7ba5bc7640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ba0100860 0x7f7ba01963d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:33.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:33.415+0000 7f7ba5bc7640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7ba0101a60 0x7f7ba0196910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:33.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:33.415+0000 7f7ba5bc7640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f7ba01096a0 con 0x7f7ba0101a60 2024-09-21T12:17:33.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:33.415+0000 7f7ba5bc7640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7ba0109520 con 0x7f7ba0100860 2024-09-21T12:17:33.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:33.415+0000 7f7b96ffd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7ba0101a60 0x7f7ba0196910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:33.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:33.415+0000 7f7b96ffd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7ba0101a60 0x7f7ba0196910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47228/0 (socket says 172.21.15.3:47228) 2024-09-21T12:17:33.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:33.415+0000 7f7b96ffd640 1 -- 172.21.15.3:0/5533493 learned_addr learned my addr 172.21.15.3:0/5533493 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:17:33.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:33.415+0000 7f7b9f7fe640 1 --2- 172.21.15.3:0/5533493 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ba0100860 0x7f7ba01963d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:33.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:33.415+0000 7f7b96ffd640 1 -- 172.21.15.3:0/5533493 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ba0100860 msgr2=0x7f7ba01963d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:33.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:33.415+0000 7f7b96ffd640 1 --2- 172.21.15.3:0/5533493 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ba0100860 0x7f7ba01963d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:33.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:33.415+0000 7f7b96ffd640 1 -- 172.21.15.3:0/5533493 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ba0196f90 con 0x7f7ba0101a60 2024-09-21T12:17:33.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:33.415+0000 7f7b96ffd640 1 --2- 172.21.15.3:0/5533493 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7ba0101a60 0x7f7ba0196910 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7b88009860 tx=0x7f7b88009d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:33.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:33.415+0000 7f7b9d7fa640 1 -- 172.21.15.3:0/5533493 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7b88005020 con 0x7f7ba0101a60 2024-09-21T12:17:33.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:33.415+0000 7f7b9d7fa640 1 -- 172.21.15.3:0/5533493 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7b880047a0 con 0x7f7ba0101a60 2024-09-21T12:17:33.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:33.415+0000 7f7ba5bc7640 1 -- 172.21.15.3:0/5533493 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ba006a210 con 0x7f7ba0101a60 2024-09-21T12:17:33.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:33.415+0000 7f7b9d7fa640 1 -- 172.21.15.3:0/5533493 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7b88007b00 con 0x7f7ba0101a60 2024-09-21T12:17:33.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:33.415+0000 7f7ba5bc7640 1 -- 172.21.15.3:0/5533493 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ba006a7a0 con 0x7f7ba0101a60 2024-09-21T12:17:33.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:33.417+0000 7f7ba5bc7640 1 -- 172.21.15.3:0/5533493 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ba0100c60 con 0x7f7ba0101a60 2024-09-21T12:17:33.429 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:33.417+0000 7f7b9d7fa640 1 -- 172.21.15.3:0/5533493 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 19) ==== 92549+0+0 (secure 0 0 0) 0x7f7b88004950 con 0x7f7ba0101a60 2024-09-21T12:17:33.429 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:33.418+0000 7f7b9d7fa640 1 --2- 172.21.15.3:0/5533493 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f7b8c06e2b0 0x7f7b8c070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:33.429 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:33.418+0000 7f7b9f7fe640 1 --2- 172.21.15.3:0/5533493 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f7b8c06e2b0 0x7f7b8c070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:33.429 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:33.418+0000 7f7b9d7fa640 1 -- 172.21.15.3:0/5533493 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7f7b88013030 con 0x7f7ba0101a60 2024-09-21T12:17:33.429 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:33.418+0000 7f7b9f7fe640 1 --2- 172.21.15.3:0/5533493 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f7b8c06e2b0 0x7f7b8c070770 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7b90009230 tx=0x7f7b900058d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:33.429 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:33.423+0000 7f7b9d7fa640 1 -- 172.21.15.3:0/5533493 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7b88060f80 con 0x7f7ba0101a60 2024-09-21T12:17:33.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:33.604+0000 7f7ba5bc7640 1 -- 172.21.15.3:0/5533493 --> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f7ba006aab0 con 0x7f7b8c06e2b0 2024-09-21T12:17:33.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:33.605+0000 7f7b9d7fa640 1 -- 172.21.15.3:0/5533493 <== mgr.14217 v2:172.21.15.3:6800/2480880781 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+148 (secure 0 0 0) 0x7f7ba006aab0 con 0x7f7b8c06e2b0 2024-09-21T12:17:33.608 INFO:teuthology.orchestra.run.smithi003.stdout:HOST ADDR LABELS STATUS 2024-09-21T12:17:33.608 INFO:teuthology.orchestra.run.smithi003.stdout:smithi003 172.21.15.3 2024-09-21T12:17:33.608 INFO:teuthology.orchestra.run.smithi003.stdout:smithi192 172.21.15.192 2024-09-21T12:17:33.608 INFO:teuthology.orchestra.run.smithi003.stdout:2 hosts in cluster 2024-09-21T12:17:33.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:33.607+0000 7f7ba5bc7640 1 -- 172.21.15.3:0/5533493 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f7b8c06e2b0 msgr2=0x7f7b8c070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:33.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:33.607+0000 7f7ba5bc7640 1 --2- 172.21.15.3:0/5533493 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f7b8c06e2b0 0x7f7b8c070770 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7b90009230 tx=0x7f7b900058d0 comp rx=0 tx=0).stop 2024-09-21T12:17:33.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:33.607+0000 7f7ba5bc7640 1 -- 172.21.15.3:0/5533493 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7ba0101a60 msgr2=0x7f7ba0196910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:33.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:33.607+0000 7f7ba5bc7640 1 --2- 172.21.15.3:0/5533493 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7ba0101a60 0x7f7ba0196910 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f7b88009860 tx=0x7f7b88009d20 comp rx=0 tx=0).stop 2024-09-21T12:17:33.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:33.607+0000 7f7ba5bc7640 1 -- 172.21.15.3:0/5533493 shutdown_connections 2024-09-21T12:17:33.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:33.607+0000 7f7ba5bc7640 1 --2- 172.21.15.3:0/5533493 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f7b8c06e2b0 0x7f7b8c070770 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:33.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:33.607+0000 7f7ba5bc7640 1 --2- 172.21.15.3:0/5533493 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7ba0101a60 0x7f7ba0196910 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:33.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:33.607+0000 7f7ba5bc7640 1 --2- 172.21.15.3:0/5533493 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ba0100860 0x7f7ba01963d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:33.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:33.607+0000 7f7ba5bc7640 1 -- 172.21.15.3:0/5533493 >> 172.21.15.3:0/5533493 conn(0x7f7ba00fc010 msgr2=0x7f7ba0104f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:33.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:33.607+0000 7f7ba5bc7640 1 -- 172.21.15.3:0/5533493 shutdown_connections 2024-09-21T12:17:33.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:33.607+0000 7f7ba5bc7640 1 -- 172.21.15.3:0/5533493 wait complete. 2024-09-21T12:17:34.210 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:33 smithi003 ceph-mon[28057]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:17:34.239 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- bash -c 'ceph orch device ls' 2024-09-21T12:17:34.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:33 smithi192 ceph-mon[35641]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:17:34.497 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:17:34.981 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:34.971+0000 7f3bd7fd6640 1 -- 172.21.15.3:0/423323451 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3bd0100860 msgr2=0x7f3bd0100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:34.981 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:34.971+0000 7f3bd7fd6640 1 --2- 172.21.15.3:0/423323451 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3bd0100860 0x7f3bd0100c60 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc009880 tx=0x7f3bcc02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:17:34.981 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:34.971+0000 7f3bd7fd6640 1 -- 172.21.15.3:0/423323451 shutdown_connections 2024-09-21T12:17:34.981 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:34.971+0000 7f3bd7fd6640 1 --2- 172.21.15.3:0/423323451 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3bd0101a60 0x7f3bd0101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:34.981 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:34.971+0000 7f3bd7fd6640 1 --2- 172.21.15.3:0/423323451 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3bd0100860 0x7f3bd0100c60 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:34.981 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:34.971+0000 7f3bd7fd6640 1 -- 172.21.15.3:0/423323451 >> 172.21.15.3:0/423323451 conn(0x7f3bd00fc010 msgr2=0x7f3bd00fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:34.981 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:34.971+0000 7f3bd7fd6640 1 -- 172.21.15.3:0/423323451 shutdown_connections 2024-09-21T12:17:34.981 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:34.971+0000 7f3bd7fd6640 1 -- 172.21.15.3:0/423323451 wait complete. 2024-09-21T12:17:34.981 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:34.971+0000 7f3bd7fd6640 1 Processor -- start 2024-09-21T12:17:34.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:34.972+0000 7f3bd7fd6640 1 -- start start 2024-09-21T12:17:34.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:34.972+0000 7f3bd7fd6640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3bd0100860 0x7f3bd01974f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:34.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:34.972+0000 7f3bd7fd6640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3bd0101a60 0x7f3bd0197a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:34.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:34.972+0000 7f3bd7fd6640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd0109680 con 0x7f3bd0101a60 2024-09-21T12:17:34.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:34.972+0000 7f3bd7fd6640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd0109500 con 0x7f3bd0100860 2024-09-21T12:17:34.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:34.972+0000 7f3bd5571640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3bd0101a60 0x7f3bd0197a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:34.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:34.972+0000 7f3bd5571640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3bd0101a60 0x7f3bd0197a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47244/0 (socket says 172.21.15.3:47244) 2024-09-21T12:17:34.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:34.972+0000 7f3bd5571640 1 -- 172.21.15.3:0/2307165637 learned_addr learned my addr 172.21.15.3:0/2307165637 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:17:34.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:34.972+0000 7f3bd5d72640 1 --2- 172.21.15.3:0/2307165637 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3bd0100860 0x7f3bd01974f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:34.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:34.972+0000 7f3bd5571640 1 -- 172.21.15.3:0/2307165637 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3bd0100860 msgr2=0x7f3bd01974f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:34.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:34.972+0000 7f3bd5571640 1 --2- 172.21.15.3:0/2307165637 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3bd0100860 0x7f3bd01974f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:34.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:34.972+0000 7f3bd5571640 1 -- 172.21.15.3:0/2307165637 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bd01980b0 con 0x7f3bd0101a60 2024-09-21T12:17:34.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:34.972+0000 7f3bd5571640 1 --2- 172.21.15.3:0/2307165637 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3bd0101a60 0x7f3bd0197a30 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f3bc000d8d0 tx=0x7f3bc000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:34.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:34.972+0000 7f3bc6ffd640 1 -- 172.21.15.3:0/2307165637 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3bc0017070 con 0x7f3bd0101a60 2024-09-21T12:17:34.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:34.972+0000 7f3bc6ffd640 1 -- 172.21.15.3:0/2307165637 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3bc0010460 con 0x7f3bd0101a60 2024-09-21T12:17:34.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:34.972+0000 7f3bd7fd6640 1 -- 172.21.15.3:0/2307165637 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bd019caf0 con 0x7f3bd0101a60 2024-09-21T12:17:34.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:34.973+0000 7f3bc6ffd640 1 -- 172.21.15.3:0/2307165637 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3bc000f5f0 con 0x7f3bd0101a60 2024-09-21T12:17:34.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:34.973+0000 7f3bd7fd6640 1 -- 172.21.15.3:0/2307165637 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bd019d080 con 0x7f3bd0101a60 2024-09-21T12:17:34.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:34.973+0000 7f3bd7fd6640 1 -- 172.21.15.3:0/2307165637 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bd0100c60 con 0x7f3bd0101a60 2024-09-21T12:17:34.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:34.974+0000 7f3bc6ffd640 1 -- 172.21.15.3:0/2307165637 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 19) ==== 92549+0+0 (secure 0 0 0) 0x7f3bc0009a30 con 0x7f3bd0101a60 2024-09-21T12:17:34.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:34.974+0000 7f3bc6ffd640 1 --2- 172.21.15.3:0/2307165637 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f3bbc06e310 0x7f3bbc0707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:34.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:34.975+0000 7f3bd5d72640 1 --2- 172.21.15.3:0/2307165637 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f3bbc06e310 0x7f3bbc0707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:34.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:34.975+0000 7f3bc6ffd640 1 -- 172.21.15.3:0/2307165637 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7f3bc008dc30 con 0x7f3bd0101a60 2024-09-21T12:17:34.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:34.975+0000 7f3bd5d72640 1 --2- 172.21.15.3:0/2307165637 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f3bbc06e310 0x7f3bbc0707d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc000c00 tx=0x7f3bcc005a20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:34.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:34.979+0000 7f3bc6ffd640 1 -- 172.21.15.3:0/2307165637 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3bc005b950 con 0x7f3bd0101a60 2024-09-21T12:17:35.164 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:35.163+0000 7f3bd7fd6640 1 -- 172.21.15.3:0/2307165637 --> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f3bd006a400 con 0x7f3bbc06e310 2024-09-21T12:17:35.165 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:34 smithi003 ceph-mon[28057]: from='client.14532 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:17:35.166 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:35.164+0000 7f3bc6ffd640 1 -- 172.21.15.3:0/2307165637 <== mgr.14217 v2:172.21.15.3:6800/2480880781 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+399 (secure 0 0 0) 0x7f3bd006a400 con 0x7f3bbc06e310 2024-09-21T12:17:35.166 INFO:teuthology.orchestra.run.smithi003.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-21T12:17:35.166 INFO:teuthology.orchestra.run.smithi003.stdout:smithi003 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT5330009Z400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-21T12:17:35.166 INFO:teuthology.orchestra.run.smithi003.stdout:smithi192 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620500NN400BGN 372G No 47s ago Has a FileSystem, LVM detected 2024-09-21T12:17:35.169 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:35.167+0000 7f3bd7fd6640 1 -- 172.21.15.3:0/2307165637 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f3bbc06e310 msgr2=0x7f3bbc0707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:35.169 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:35.167+0000 7f3bd7fd6640 1 --2- 172.21.15.3:0/2307165637 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f3bbc06e310 0x7f3bbc0707d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc000c00 tx=0x7f3bcc005a20 comp rx=0 tx=0).stop 2024-09-21T12:17:35.169 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:35.167+0000 7f3bd7fd6640 1 -- 172.21.15.3:0/2307165637 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3bd0101a60 msgr2=0x7f3bd0197a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:35.169 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:35.167+0000 7f3bd7fd6640 1 --2- 172.21.15.3:0/2307165637 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3bd0101a60 0x7f3bd0197a30 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f3bc000d8d0 tx=0x7f3bc000dd90 comp rx=0 tx=0).stop 2024-09-21T12:17:35.169 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:35.167+0000 7f3bd7fd6640 1 -- 172.21.15.3:0/2307165637 shutdown_connections 2024-09-21T12:17:35.169 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:35.167+0000 7f3bd7fd6640 1 --2- 172.21.15.3:0/2307165637 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f3bbc06e310 0x7f3bbc0707d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:35.169 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:35.167+0000 7f3bd7fd6640 1 --2- 172.21.15.3:0/2307165637 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3bd0101a60 0x7f3bd0197a30 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:35.169 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:35.167+0000 7f3bd7fd6640 1 --2- 172.21.15.3:0/2307165637 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3bd0100860 0x7f3bd01974f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:35.169 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:35.167+0000 7f3bd7fd6640 1 -- 172.21.15.3:0/2307165637 >> 172.21.15.3:0/2307165637 conn(0x7f3bd00fc010 msgr2=0x7f3bd0069cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:35.169 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:35.167+0000 7f3bd7fd6640 1 -- 172.21.15.3:0/2307165637 shutdown_connections 2024-09-21T12:17:35.169 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:35.167+0000 7f3bd7fd6640 1 -- 172.21.15.3:0/2307165637 wait complete. 2024-09-21T12:17:35.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:34 smithi192 ceph-mon[35641]: from='client.14532 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:17:35.833 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T12:17:35.845 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi003.front.sepia.ceph.com 2024-09-21T12:17:35.845 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-09-21T12:17:36.103 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:17:36.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:35 smithi192 ceph-mon[35641]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:17:36.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:35 smithi192 ceph-mon[35641]: from='client.14536 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:17:36.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:35 smithi003 ceph-mon[28057]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:17:36.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:35 smithi003 ceph-mon[28057]: from='client.14536 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:17:36.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:36.555+0000 7fa8447bb640 1 -- 172.21.15.3:0/4138036470 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa83c102b60 msgr2=0x7fa83c102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:36.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:36.555+0000 7fa8447bb640 1 --2- 172.21.15.3:0/4138036470 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa83c102b60 0x7fa83c102fe0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa82c009880 tx=0x7fa82c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:17:36.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:36.555+0000 7fa8447bb640 1 -- 172.21.15.3:0/4138036470 shutdown_connections 2024-09-21T12:17:36.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:36.555+0000 7fa8447bb640 1 --2- 172.21.15.3:0/4138036470 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa83c102b60 0x7fa83c102fe0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:36.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:36.555+0000 7fa8447bb640 1 --2- 172.21.15.3:0/4138036470 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa83c101960 0x7fa83c101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:36.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:36.555+0000 7fa8447bb640 1 -- 172.21.15.3:0/4138036470 >> 172.21.15.3:0/4138036470 conn(0x7fa83c0fd0f0 msgr2=0x7fa83c0ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:36.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:36.555+0000 7fa8447bb640 1 -- 172.21.15.3:0/4138036470 shutdown_connections 2024-09-21T12:17:36.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:36.555+0000 7fa8447bb640 1 -- 172.21.15.3:0/4138036470 wait complete. 2024-09-21T12:17:36.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:36.556+0000 7fa8447bb640 1 Processor -- start 2024-09-21T12:17:36.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:36.556+0000 7fa8447bb640 1 -- start start 2024-09-21T12:17:36.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:36.556+0000 7fa8447bb640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa83c101960 0x7fa83c197510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:36.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:36.556+0000 7fa8447bb640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa83c102b60 0x7fa83c197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:36.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:36.556+0000 7fa8447bb640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fa83c10a820 con 0x7fa83c102b60 2024-09-21T12:17:36.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:36.556+0000 7fa8447bb640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa83c10a6a0 con 0x7fa83c101960 2024-09-21T12:17:36.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:36.556+0000 7fa841d56640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa83c102b60 0x7fa83c197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:36.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:36.556+0000 7fa841d56640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa83c102b60 0x7fa83c197a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47264/0 (socket says 172.21.15.3:47264) 2024-09-21T12:17:36.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:36.556+0000 7fa841d56640 1 -- 172.21.15.3:0/1889593836 learned_addr learned my addr 172.21.15.3:0/1889593836 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:17:36.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:36.556+0000 7fa842557640 1 --2- 172.21.15.3:0/1889593836 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa83c101960 0x7fa83c197510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:36.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:36.556+0000 7fa841d56640 1 -- 172.21.15.3:0/1889593836 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa83c101960 msgr2=0x7fa83c197510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:36.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:36.556+0000 7fa841d56640 1 --2- 172.21.15.3:0/1889593836 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa83c101960 0x7fa83c197510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:36.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:36.556+0000 7fa841d56640 1 -- 172.21.15.3:0/1889593836 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa83c1980d0 con 0x7fa83c102b60 2024-09-21T12:17:36.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:36.556+0000 7fa841d56640 1 --2- 172.21.15.3:0/1889593836 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa83c102b60 0x7fa83c197a50 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa82c006010 tx=0x7fa82c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:36.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:36.557+0000 7fa8337fe640 1 -- 172.21.15.3:0/1889593836 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa82c03f070 con 0x7fa83c102b60 2024-09-21T12:17:36.560 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:36.557+0000 7fa8447bb640 1 -- 172.21.15.3:0/1889593836 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa83c19cab0 con 0x7fa83c102b60 2024-09-21T12:17:36.561 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:36.557+0000 7fa8337fe640 1 -- 172.21.15.3:0/1889593836 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa82c0044d0 con 0x7fa83c102b60 2024-09-21T12:17:36.561 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:36.557+0000 7fa8337fe640 1 -- 172.21.15.3:0/1889593836 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa82c035030 con 0x7fa83c102b60 2024-09-21T12:17:36.561 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:36.557+0000 7fa8447bb640 1 -- 172.21.15.3:0/1889593836 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa83c19d0c0 con 0x7fa83c102b60 2024-09-21T12:17:36.561 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:36.558+0000 7fa8447bb640 1 -- 172.21.15.3:0/1889593836 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa83c101d40 con 0x7fa83c102b60 2024-09-21T12:17:36.561 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:36.558+0000 7fa8337fe640 1 -- 172.21.15.3:0/1889593836 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 19) ==== 92549+0+0 (secure 0 0 0) 0x7fa82c042070 con 0x7fa83c102b60 2024-09-21T12:17:36.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:36.559+0000 7fa8337fe640 1 --2- 172.21.15.3:0/1889593836 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fa82806e310 0x7fa8280707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:36.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:36.559+0000 7fa8337fe640 1 -- 172.21.15.3:0/1889593836 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(40..40 src has 1..40) ==== 4638+0+0 (secure 0 0 0) 0x7fa82c0aeab0 con 0x7fa83c102b60 2024-09-21T12:17:36.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:36.559+0000 7fa842557640 1 --2- 172.21.15.3:0/1889593836 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fa82806e310 0x7fa8280707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:36.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:36.559+0000 7fa842557640 1 --2- 172.21.15.3:0/1889593836 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fa82806e310 0x7fa8280707d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa83c1029c0 tx=0x7fa838008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:36.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:36.563+0000 7fa8337fe640 1 -- 172.21.15.3:0/1889593836 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa82c07c7d0 con 0x7fa83c102b60 2024-09-21T12:17:36.768 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:36.767+0000 7fa8447bb640 1 -- 172.21.15.3:0/1889593836 --> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) -- 0x7fa83c062630 con 0x7fa82806e310 2024-09-21T12:17:37.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:37 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-09-21T12:17:37.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:37 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-09-21T12:17:38.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:38.284+0000 7fa8337fe640 1 -- 172.21.15.3:0/1889593836 <== mgr.14217 v2:172.21.15.3:6800/2480880781 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fa83c062630 con 0x7fa82806e310 2024-09-21T12:17:38.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:38.287+0000 7fa8447bb640 1 -- 172.21.15.3:0/1889593836 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fa82806e310 msgr2=0x7fa8280707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:38.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:38.287+0000 7fa8447bb640 1 --2- 172.21.15.3:0/1889593836 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fa82806e310 0x7fa8280707d0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa83c1029c0 tx=0x7fa838008040 comp rx=0 tx=0).stop 2024-09-21T12:17:38.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:38.287+0000 7fa8447bb640 1 -- 172.21.15.3:0/1889593836 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa83c102b60 msgr2=0x7fa83c197a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:38.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:38.287+0000 7fa8447bb640 1 --2- 172.21.15.3:0/1889593836 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa83c102b60 0x7fa83c197a50 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa82c006010 tx=0x7fa82c0048f0 comp rx=0 tx=0).stop 2024-09-21T12:17:38.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:38.287+0000 7fa8447bb640 1 -- 172.21.15.3:0/1889593836 shutdown_connections 2024-09-21T12:17:38.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:38.287+0000 7fa8447bb640 1 --2- 172.21.15.3:0/1889593836 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fa82806e310 0x7fa8280707d0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:38.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:38.287+0000 7fa8447bb640 1 --2- 172.21.15.3:0/1889593836 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa83c102b60 0x7fa83c197a50 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:38.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:38.287+0000 7fa8447bb640 1 --2- 172.21.15.3:0/1889593836 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa83c101960 0x7fa83c197510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:38.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:38.287+0000 7fa8447bb640 1 -- 172.21.15.3:0/1889593836 >> 172.21.15.3:0/1889593836 conn(0x7fa83c0fd0f0 msgr2=0x7fa83c106020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:38.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:38.287+0000 7fa8447bb640 1 -- 172.21.15.3:0/1889593836 shutdown_connections 2024-09-21T12:17:38.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:38.287+0000 7fa8447bb640 1 -- 172.21.15.3:0/1889593836 wait complete. 2024-09-21T12:17:38.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:38 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-mon-smithi003[28050]: 2024-09-21T12:17:38.259+0000 7f1cad26f640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T12:17:38.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:38 smithi003 ceph-mon[28057]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:17:38.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:38 smithi003 ceph-mon[28057]: from='client.14540 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:17:38.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:38 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-21T12:17:38.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:38 smithi003 ceph-mon[28057]: osdmap e41: 6 total, 6 up, 6 in 2024-09-21T12:17:38.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:38 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-09-21T12:17:38.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:38 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-21T12:17:38.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:38 smithi003 ceph-mon[28057]: osdmap e42: 6 total, 6 up, 6 in 2024-09-21T12:17:38.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:38 smithi192 ceph-mon[35641]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:17:38.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:38 smithi192 ceph-mon[35641]: from='client.14540 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:17:38.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:38 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-21T12:17:38.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:38 smithi192 ceph-mon[35641]: osdmap e41: 6 total, 6 up, 6 in 2024-09-21T12:17:38.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:38 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-09-21T12:17:38.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:38 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-21T12:17:38.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:38 smithi192 ceph-mon[35641]: osdmap e42: 6 total, 6 up, 6 in 2024-09-21T12:17:39.425 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- bash -c 'ceph fs dump' 2024-09-21T12:17:39.549 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:39 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-09-21T12:17:39.549 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:39 smithi003 ceph-mon[28057]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T12:17:39.549 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:39 smithi003 ceph-mon[28057]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-21T12:17:39.549 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:39 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-21T12:17:39.549 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:39 smithi003 ceph-mon[28057]: osdmap e43: 6 total, 6 up, 6 in 2024-09-21T12:17:39.549 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:39 smithi003 ceph-mon[28057]: fsmap cephfs:0 2024-09-21T12:17:39.549 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:39 smithi003 ceph-mon[28057]: Saving service mds.cephfs spec with placement count:4 2024-09-21T12:17:39.549 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:39 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:17:39.550 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:39 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:17:39.550 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:39 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:17:39.550 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:39 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:17:39.550 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:39 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:17:39.550 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:39 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi003.ebjgyl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-21T12:17:39.550 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:39 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi003.ebjgyl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T12:17:39.550 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:39 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:17:39.550 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:39 smithi003 ceph-mon[28057]: Deploying daemon mds.cephfs.smithi003.ebjgyl on smithi003 2024-09-21T12:17:39.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:39 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-09-21T12:17:39.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:39 smithi192 ceph-mon[35641]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T12:17:39.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:39 smithi192 ceph-mon[35641]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-21T12:17:39.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:39 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-21T12:17:39.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:39 smithi192 ceph-mon[35641]: osdmap e43: 6 total, 6 up, 6 in 2024-09-21T12:17:39.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:39 smithi192 ceph-mon[35641]: fsmap cephfs:0 2024-09-21T12:17:39.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:39 smithi192 ceph-mon[35641]: Saving service mds.cephfs spec with placement count:4 2024-09-21T12:17:39.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:39 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:17:39.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:39 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:17:39.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:39 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:17:39.759 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:39 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:17:39.759 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:39 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:17:39.759 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:39 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi003.ebjgyl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-21T12:17:39.759 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:39 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi003.ebjgyl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T12:17:39.759 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:39 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:17:39.759 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:39 smithi192 ceph-mon[35641]: Deploying daemon mds.cephfs.smithi003.ebjgyl on smithi003 2024-09-21T12:17:40.198 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:17:40.484 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:40 smithi003 ceph-mon[28057]: pgmap v177: 65 pgs: 5 creating+peering, 59 unknown, 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:17:40.485 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:40 smithi003 ceph-mon[28057]: osdmap e44: 6 total, 6 up, 6 in 2024-09-21T12:17:40.707 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:40.678+0000 7f0a9caea640 1 -- 172.21.15.3:0/3801996150 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0a98102b70 msgr2=0x7f0a98102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:40.708 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:40.678+0000 7f0a9caea640 1 --2- 172.21.15.3:0/3801996150 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0a98102b70 0x7f0a98102ff0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c009880 tx=0x7f0a8c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:17:40.708 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:40.678+0000 7f0a9caea640 1 -- 172.21.15.3:0/3801996150 shutdown_connections 2024-09-21T12:17:40.708 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:40.678+0000 7f0a9caea640 1 --2- 172.21.15.3:0/3801996150 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0a98102b70 0x7f0a98102ff0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:40.708 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:40.678+0000 7f0a9caea640 1 --2- 172.21.15.3:0/3801996150 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a98101970 0x7f0a98101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:40.708 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:40.678+0000 7f0a9caea640 1 -- 172.21.15.3:0/3801996150 >> 172.21.15.3:0/3801996150 conn(0x7f0a980fd140 msgr2=0x7f0a980ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:40.708 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:40.678+0000 7f0a9caea640 1 -- 172.21.15.3:0/3801996150 shutdown_connections 2024-09-21T12:17:40.708 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:40.678+0000 7f0a9caea640 1 -- 172.21.15.3:0/3801996150 wait complete. 2024-09-21T12:17:40.708 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:40.678+0000 7f0a9caea640 1 Processor -- start 2024-09-21T12:17:40.708 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:40.679+0000 7f0a9caea640 1 -- start start 2024-09-21T12:17:40.708 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:40.679+0000 7f0a9caea640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0a98101970 0x7f0a98075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:40.708 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:40.679+0000 7f0a9caea640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a98102b70 0x7f0a980745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:40.708 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:40.679+0000 7f0a9caea640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f0a9810a7b0 con 0x7f0a98101970 2024-09-21T12:17:40.708 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:40.679+0000 7f0a9caea640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0a9810a630 con 0x7f0a98102b70 2024-09-21T12:17:40.709 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:40.679+0000 7f0a9659c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0a98101970 0x7f0a98075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:40.709 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:40.679+0000 7f0a9659c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0a98101970 0x7f0a98075f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:51270/0 (socket says 172.21.15.3:51270) 2024-09-21T12:17:40.709 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:40.679+0000 7f0a9659c640 1 -- 172.21.15.3:0/1274246661 learned_addr learned my addr 172.21.15.3:0/1274246661 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:17:40.709 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:40.679+0000 7f0a95d9b640 1 --2- 172.21.15.3:0/1274246661 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a98102b70 0x7f0a980745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:40.709 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:40.679+0000 7f0a9659c640 1 -- 172.21.15.3:0/1274246661 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a98102b70 msgr2=0x7f0a980745e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:40.709 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:40.679+0000 7f0a9659c640 1 --2- 172.21.15.3:0/1274246661 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a98102b70 0x7f0a980745e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:40.709 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:40.679+0000 7f0a9659c640 1 -- 172.21.15.3:0/1274246661 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a9819b0e0 con 0x7f0a98101970 2024-09-21T12:17:40.709 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:40.679+0000 7f0a95d9b640 1 --2- 172.21.15.3:0/1274246661 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a98102b70 0x7f0a980745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T12:17:40.709 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:40.679+0000 7f0a9659c640 1 --2- 172.21.15.3:0/1274246661 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0a98101970 0x7f0a98075f20 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0a8800ea20 tx=0x7f0a8800eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:40.709 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:40.679+0000 7f0a877fe640 1 -- 172.21.15.3:0/1274246661 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0a88016070 con 0x7f0a98101970 2024-09-21T12:17:40.709 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:40.679+0000 7f0a877fe640 1 -- 172.21.15.3:0/1274246661 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0a88003e30 con 0x7f0a98101970 2024-09-21T12:17:40.710 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:40.679+0000 7f0a9caea640 1 -- 172.21.15.3:0/1274246661 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a98074b20 con 0x7f0a98101970 2024-09-21T12:17:40.710 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:40.679+0000 7f0a877fe640 1 -- 172.21.15.3:0/1274246661 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0a88011470 con 0x7f0a98101970 2024-09-21T12:17:40.710 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:40.680+0000 7f0a9caea640 1 -- 172.21.15.3:0/1274246661 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a980750b0 con 0x7f0a98101970 2024-09-21T12:17:40.710 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:40.681+0000 7f0a9caea640 1 -- 172.21.15.3:0/1274246661 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a9810af90 con 0x7f0a98101970 2024-09-21T12:17:40.710 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:40.681+0000 7f0a877fe640 1 -- 172.21.15.3:0/1274246661 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 19) ==== 92549+0+0 (secure 0 0 0) 0x7f0a88019070 con 0x7f0a98101970 2024-09-21T12:17:40.710 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:40.682+0000 7f0a877fe640 1 --2- 172.21.15.3:0/1274246661 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f0a8006e2b0 0x7f0a80070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:40.710 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:40.682+0000 7f0a877fe640 1 -- 172.21.15.3:0/1274246661 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5468+0+0 (secure 0 0 0) 0x7f0a8808e410 con 0x7f0a98101970 2024-09-21T12:17:40.710 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:40.682+0000 7f0a95d9b640 1 --2- 172.21.15.3:0/1274246661 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f0a8006e2b0 0x7f0a80070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:40.710 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:40.682+0000 7f0a95d9b640 1 --2- 172.21.15.3:0/1274246661 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f0a8006e2b0 0x7f0a80070770 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c0096c0 tx=0x7f0a8c009650 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:40.710 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:40.688+0000 7f0a877fe640 1 -- 172.21.15.3:0/1274246661 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0a8805bd70 con 0x7f0a98101970 2024-09-21T12:17:40.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:40 smithi192 ceph-mon[35641]: pgmap v177: 65 pgs: 5 creating+peering, 59 unknown, 1 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:17:40.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:40 smithi192 ceph-mon[35641]: osdmap e44: 6 total, 6 up, 6 in 2024-09-21T12:17:40.941 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:40.939+0000 7f0a9caea640 1 -- 172.21.15.3:0/1274246661 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f0a9802d7f0 con 0x7f0a98101970 2024-09-21T12:17:40.942 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:40.940+0000 7f0a877fe640 1 -- 172.21.15.3:0/1274246661 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) ==== 75+0+1272 (secure 0 0 0) 0x7f0a8805fa20 con 0x7f0a98101970 2024-09-21T12:17:40.942 INFO:teuthology.orchestra.run.smithi003.stdout:e2 2024-09-21T12:17:40.942 INFO:teuthology.orchestra.run.smithi003.stdout:btime 2024-09-21T12:17:38:260160+0000 2024-09-21T12:17:40.942 INFO:teuthology.orchestra.run.smithi003.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T12:17:40.942 INFO:teuthology.orchestra.run.smithi003.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:17:40.943 INFO:teuthology.orchestra.run.smithi003.stdout:legacy client fscid: 1 2024-09-21T12:17:40.943 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:17:40.943 INFO:teuthology.orchestra.run.smithi003.stdout:Filesystem 'cephfs' (1) 2024-09-21T12:17:40.943 INFO:teuthology.orchestra.run.smithi003.stdout:fs_name cephfs 2024-09-21T12:17:40.943 INFO:teuthology.orchestra.run.smithi003.stdout:epoch 2 2024-09-21T12:17:40.943 INFO:teuthology.orchestra.run.smithi003.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T12:17:40.943 INFO:teuthology.orchestra.run.smithi003.stdout:created 2024-09-21T12:17:38.260099+0000 2024-09-21T12:17:40.943 INFO:teuthology.orchestra.run.smithi003.stdout:modified 2024-09-21T12:17:38.260099+0000 2024-09-21T12:17:40.943 INFO:teuthology.orchestra.run.smithi003.stdout:tableserver 0 2024-09-21T12:17:40.943 INFO:teuthology.orchestra.run.smithi003.stdout:root 0 2024-09-21T12:17:40.943 INFO:teuthology.orchestra.run.smithi003.stdout:session_timeout 60 2024-09-21T12:17:40.943 INFO:teuthology.orchestra.run.smithi003.stdout:session_autoclose 300 2024-09-21T12:17:40.944 INFO:teuthology.orchestra.run.smithi003.stdout:max_file_size 1099511627776 2024-09-21T12:17:40.944 INFO:teuthology.orchestra.run.smithi003.stdout:max_xattr_size 65536 2024-09-21T12:17:40.944 INFO:teuthology.orchestra.run.smithi003.stdout:required_client_features {} 2024-09-21T12:17:40.944 INFO:teuthology.orchestra.run.smithi003.stdout:last_failure 0 2024-09-21T12:17:40.944 INFO:teuthology.orchestra.run.smithi003.stdout:last_failure_osd_epoch 0 2024-09-21T12:17:40.944 INFO:teuthology.orchestra.run.smithi003.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:17:40.944 INFO:teuthology.orchestra.run.smithi003.stdout:max_mds 1 2024-09-21T12:17:40.944 INFO:teuthology.orchestra.run.smithi003.stdout:in 2024-09-21T12:17:40.944 INFO:teuthology.orchestra.run.smithi003.stdout:up {} 2024-09-21T12:17:40.944 INFO:teuthology.orchestra.run.smithi003.stdout:failed 2024-09-21T12:17:40.944 INFO:teuthology.orchestra.run.smithi003.stdout:damaged 2024-09-21T12:17:40.944 INFO:teuthology.orchestra.run.smithi003.stdout:stopped 2024-09-21T12:17:40.945 INFO:teuthology.orchestra.run.smithi003.stdout:data_pools [3] 2024-09-21T12:17:40.945 INFO:teuthology.orchestra.run.smithi003.stdout:metadata_pool 2 2024-09-21T12:17:40.945 INFO:teuthology.orchestra.run.smithi003.stdout:inline_data disabled 2024-09-21T12:17:40.945 INFO:teuthology.orchestra.run.smithi003.stdout:balancer 2024-09-21T12:17:40.945 INFO:teuthology.orchestra.run.smithi003.stdout:bal_rank_mask -1 2024-09-21T12:17:40.945 INFO:teuthology.orchestra.run.smithi003.stdout:standby_count_wanted 0 2024-09-21T12:17:40.945 INFO:teuthology.orchestra.run.smithi003.stdout:qdb_cluster leader: 0 members: 2024-09-21T12:17:40.945 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:17:40.945 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:17:40.946 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 2 2024-09-21T12:17:40.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:40.943+0000 7f0a9caea640 1 -- 172.21.15.3:0/1274246661 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f0a8006e2b0 msgr2=0x7f0a80070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:40.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:40.943+0000 7f0a9caea640 1 --2- 172.21.15.3:0/1274246661 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f0a8006e2b0 0x7f0a80070770 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f0a8c0096c0 tx=0x7f0a8c009650 comp rx=0 tx=0).stop 2024-09-21T12:17:40.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:40.943+0000 7f0a9caea640 1 -- 172.21.15.3:0/1274246661 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0a98101970 msgr2=0x7f0a98075f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:40.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:40.943+0000 7f0a9caea640 1 --2- 172.21.15.3:0/1274246661 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0a98101970 0x7f0a98075f20 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f0a8800ea20 tx=0x7f0a8800eee0 comp rx=0 tx=0).stop 2024-09-21T12:17:40.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:40.943+0000 7f0a9caea640 1 -- 172.21.15.3:0/1274246661 shutdown_connections 2024-09-21T12:17:40.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:40.943+0000 7f0a9caea640 1 --2- 172.21.15.3:0/1274246661 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f0a8006e2b0 0x7f0a80070770 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:40.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:40.943+0000 7f0a9caea640 1 --2- 172.21.15.3:0/1274246661 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a98102b70 0x7f0a980745e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:40.947 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:40.943+0000 7f0a9caea640 1 --2- 172.21.15.3:0/1274246661 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0a98101970 0x7f0a98075f20 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:40.947 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:40.943+0000 7f0a9caea640 1 -- 172.21.15.3:0/1274246661 >> 172.21.15.3:0/1274246661 conn(0x7f0a980fd140 msgr2=0x7f0a98106030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:40.947 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:40.943+0000 7f0a9caea640 1 -- 172.21.15.3:0/1274246661 shutdown_connections 2024-09-21T12:17:40.947 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:40.943+0000 7f0a9caea640 1 -- 172.21.15.3:0/1274246661 wait complete. 2024-09-21T12:17:41.581 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:41 smithi003 ceph-mon[28057]: osdmap e45: 6 total, 6 up, 6 in 2024-09-21T12:17:41.581 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:41 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/1274246661' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-21T12:17:41.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:41 smithi192 ceph-mon[35641]: osdmap e45: 6 total, 6 up, 6 in 2024-09-21T12:17:41.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:41 smithi192 ceph-mon[35641]: from='client.? 172.21.15.3:0/1274246661' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-21T12:17:41.842 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T12:17:41.855 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi003.front.sepia.ceph.com 2024-09-21T12:17:41.856 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- bash -c 'ceph fs set cephfs max_mds 1' 2024-09-21T12:17:42.126 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:17:42.566 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:42 smithi003 ceph-mon[28057]: pgmap v180: 65 pgs: 10 creating+peering, 19 unknown, 36 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:17:42.566 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:42 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:17:42.566 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:42 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:17:42.566 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:42 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:17:42.566 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:42 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi192.ywqqxe", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-21T12:17:42.566 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:42 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi192.ywqqxe", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T12:17:42.566 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:42 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:17:42.602 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:42.563+0000 7f666bbf2640 1 -- 172.21.15.3:0/2236166871 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6664074b40 msgr2=0x7f6664074fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:42.602 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:42.563+0000 7f666bbf2640 1 --2- 172.21.15.3:0/2236166871 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6664074b40 0x7f6664074fa0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f6654009880 tx=0x7f665402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:17:42.603 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:42.563+0000 7f666bbf2640 1 -- 172.21.15.3:0/2236166871 shutdown_connections 2024-09-21T12:17:42.603 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:42.563+0000 7f666bbf2640 1 --2- 172.21.15.3:0/2236166871 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6664074b40 0x7f6664074fa0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:42.603 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:42.563+0000 7f666bbf2640 1 --2- 172.21.15.3:0/2236166871 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f66640761a0 0x7f6664074600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:42.603 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:42.563+0000 7f666bbf2640 1 -- 172.21.15.3:0/2236166871 >> 172.21.15.3:0/2236166871 conn(0x7f66640fd0f0 msgr2=0x7f66640ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:42.603 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:42.564+0000 7f666bbf2640 1 -- 172.21.15.3:0/2236166871 shutdown_connections 2024-09-21T12:17:42.603 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:42.564+0000 7f666bbf2640 1 -- 172.21.15.3:0/2236166871 wait complete. 2024-09-21T12:17:42.603 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:42.564+0000 7f666bbf2640 1 Processor -- start 2024-09-21T12:17:42.603 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:42.564+0000 7f666bbf2640 1 -- start start 2024-09-21T12:17:42.603 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:42.565+0000 7f666bbf2640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6664074b40 0x7f66641996a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:42.603 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:42.565+0000 7f666bbf2640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f66640761a0 0x7f6664199be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:42.603 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:42.565+0000 7f666bbf2640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f666410c970 con 0x7f66640761a0 2024-09-21T12:17:42.603 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:42.565+0000 7f666bbf2640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f666410c7f0 con 0x7f6664074b40 2024-09-21T12:17:42.603 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:42.565+0000 7f666918d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f66640761a0 0x7f6664199be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:42.603 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:42.565+0000 7f666918d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f66640761a0 0x7f6664199be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:51310/0 (socket says 172.21.15.3:51310) 2024-09-21T12:17:42.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:42.565+0000 7f666918d640 1 -- 172.21.15.3:0/999309605 learned_addr learned my addr 172.21.15.3:0/999309605 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:17:42.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:42.565+0000 7f666998e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6664074b40 0x7f66641996a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:42.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:42.565+0000 7f666918d640 1 -- 172.21.15.3:0/999309605 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6664074b40 msgr2=0x7f66641996a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:42.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:42.565+0000 7f666918d640 1 --2- 172.21.15.3:0/999309605 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6664074b40 0x7f66641996a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:42.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:42.565+0000 7f666918d640 1 -- 172.21.15.3:0/999309605 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f666419a1d0 con 0x7f66640761a0 2024-09-21T12:17:42.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:42.565+0000 7f666918d640 1 --2- 172.21.15.3:0/999309605 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f66640761a0 0x7f6664199be0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6654009230 tx=0x7f66540048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:42.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:42.565+0000 7f665affd640 1 -- 172.21.15.3:0/999309605 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f665403f070 con 0x7f66640761a0 2024-09-21T12:17:42.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:42.565+0000 7f665affd640 1 -- 172.21.15.3:0/999309605 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f66540044d0 con 0x7f66640761a0 2024-09-21T12:17:42.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:42.565+0000 7f666bbf2640 1 -- 172.21.15.3:0/999309605 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f666419ebe0 con 0x7f66640761a0 2024-09-21T12:17:42.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:42.565+0000 7f665affd640 1 -- 172.21.15.3:0/999309605 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6654035030 con 0x7f66640761a0 2024-09-21T12:17:42.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:42.566+0000 7f666bbf2640 1 -- 172.21.15.3:0/999309605 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f666419f0e0 con 0x7f66640761a0 2024-09-21T12:17:42.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:42.566+0000 7f666bbf2640 1 -- 172.21.15.3:0/999309605 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6664074fa0 con 0x7f66640761a0 2024-09-21T12:17:42.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:42.567+0000 7f665affd640 1 -- 172.21.15.3:0/999309605 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 19) ==== 92549+0+0 (secure 0 0 0) 0x7f6654042070 con 0x7f66640761a0 2024-09-21T12:17:42.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:42.568+0000 7f665affd640 1 --2- 172.21.15.3:0/999309605 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f665006e2b0 0x7f6650070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:42.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:42.568+0000 7f666998e640 1 --2- 172.21.15.3:0/999309605 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f665006e2b0 0x7f6650070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:42.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:42.568+0000 7f665affd640 1 -- 172.21.15.3:0/999309605 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5468+0+0 (secure 0 0 0) 0x7f66540aed80 con 0x7f66640761a0 2024-09-21T12:17:42.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:42.568+0000 7f666998e640 1 --2- 172.21.15.3:0/999309605 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f665006e2b0 0x7f6650070770 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f666000abe0 tx=0x7f666000a2d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:42.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:42.572+0000 7f665affd640 1 -- 172.21.15.3:0/999309605 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f665407c6e0 con 0x7f66640761a0 2024-09-21T12:17:42.621 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:42 smithi192 ceph-mon[35641]: pgmap v180: 65 pgs: 10 creating+peering, 19 unknown, 36 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:17:42.621 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:42 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:17:42.621 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:42 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:17:42.621 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:42 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:17:42.621 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:42 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi192.ywqqxe", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-21T12:17:42.621 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:42 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi192.ywqqxe", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T12:17:42.621 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:42 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:17:42.787 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:42.786+0000 7f666bbf2640 1 -- 172.21.15.3:0/999309605 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) -- 0x7f6664062df0 con 0x7f66640761a0 2024-09-21T12:17:43.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:43.295+0000 7f665affd640 1 -- 172.21.15.3:0/999309605 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v5) ==== 105+0+0 (secure 0 0 0) 0x7f6654080390 con 0x7f66640761a0 2024-09-21T12:17:43.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:43.299+0000 7f666bbf2640 1 -- 172.21.15.3:0/999309605 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f665006e2b0 msgr2=0x7f6650070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:43.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:43.299+0000 7f666bbf2640 1 --2- 172.21.15.3:0/999309605 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f665006e2b0 0x7f6650070770 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f666000abe0 tx=0x7f666000a2d0 comp rx=0 tx=0).stop 2024-09-21T12:17:43.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:43.299+0000 7f666bbf2640 1 -- 172.21.15.3:0/999309605 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f66640761a0 msgr2=0x7f6664199be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:43.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:43.299+0000 7f666bbf2640 1 --2- 172.21.15.3:0/999309605 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f66640761a0 0x7f6664199be0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f6654009230 tx=0x7f66540048f0 comp rx=0 tx=0).stop 2024-09-21T12:17:43.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:43.299+0000 7f666bbf2640 1 -- 172.21.15.3:0/999309605 shutdown_connections 2024-09-21T12:17:43.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:43.299+0000 7f666bbf2640 1 --2- 172.21.15.3:0/999309605 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f665006e2b0 0x7f6650070770 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:43.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:43.299+0000 7f666bbf2640 1 --2- 172.21.15.3:0/999309605 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f66640761a0 0x7f6664199be0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:43.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:43.299+0000 7f666bbf2640 1 --2- 172.21.15.3:0/999309605 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6664074b40 0x7f66641996a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:43.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:43.299+0000 7f666bbf2640 1 -- 172.21.15.3:0/999309605 >> 172.21.15.3:0/999309605 conn(0x7f66640fd0f0 msgr2=0x7f6664107a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:43.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:43.299+0000 7f666bbf2640 1 -- 172.21.15.3:0/999309605 shutdown_connections 2024-09-21T12:17:43.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:43.299+0000 7f666bbf2640 1 -- 172.21.15.3:0/999309605 wait complete. 2024-09-21T12:17:43.573 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:43 smithi192 ceph-mon[35641]: Deploying daemon mds.cephfs.smithi192.ywqqxe on smithi192 2024-09-21T12:17:43.573 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:43 smithi192 ceph-mon[35641]: mds.? [v2:172.21.15.3:6826/2374828346,v1:172.21.15.3:6827/2374828346] up:boot 2024-09-21T12:17:43.573 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:43 smithi192 ceph-mon[35641]: daemon mds.cephfs.smithi003.ebjgyl assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-21T12:17:43.573 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:43 smithi192 ceph-mon[35641]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T12:17:43.573 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:43 smithi192 ceph-mon[35641]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-21T12:17:43.574 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:43 smithi192 ceph-mon[35641]: Cluster is now healthy 2024-09-21T12:17:43.574 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:43 smithi192 ceph-mon[35641]: fsmap cephfs:0 1 up:standby 2024-09-21T12:17:43.574 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:43 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi003.ebjgyl"}]: dispatch 2024-09-21T12:17:43.574 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:43 smithi192 ceph-mon[35641]: fsmap cephfs:1 {0=cephfs.smithi003.ebjgyl=up:creating} 2024-09-21T12:17:43.574 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:43 smithi192 ceph-mon[35641]: daemon mds.cephfs.smithi003.ebjgyl is now active in filesystem cephfs as rank 0 2024-09-21T12:17:43.574 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:43 smithi192 ceph-mon[35641]: from='client.? 172.21.15.3:0/999309605' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-09-21T12:17:43.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:43 smithi003 ceph-mon[28057]: Deploying daemon mds.cephfs.smithi192.ywqqxe on smithi192 2024-09-21T12:17:43.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:43 smithi003 ceph-mon[28057]: mds.? [v2:172.21.15.3:6826/2374828346,v1:172.21.15.3:6827/2374828346] up:boot 2024-09-21T12:17:43.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:43 smithi003 ceph-mon[28057]: daemon mds.cephfs.smithi003.ebjgyl assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-21T12:17:43.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:43 smithi003 ceph-mon[28057]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T12:17:43.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:43 smithi003 ceph-mon[28057]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-21T12:17:43.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:43 smithi003 ceph-mon[28057]: Cluster is now healthy 2024-09-21T12:17:43.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:43 smithi003 ceph-mon[28057]: fsmap cephfs:0 1 up:standby 2024-09-21T12:17:43.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:43 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi003.ebjgyl"}]: dispatch 2024-09-21T12:17:43.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:43 smithi003 ceph-mon[28057]: fsmap cephfs:1 {0=cephfs.smithi003.ebjgyl=up:creating} 2024-09-21T12:17:43.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:43 smithi003 ceph-mon[28057]: daemon mds.cephfs.smithi003.ebjgyl is now active in filesystem cephfs as rank 0 2024-09-21T12:17:43.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:43 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/999309605' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-09-21T12:17:43.935 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T12:17:43.952 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi003.front.sepia.ceph.com 2024-09-21T12:17:43.952 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- bash -c 'ceph fs set cephfs allow_standby_replay false' 2024-09-21T12:17:44.217 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:17:44.562 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:44 smithi192 ceph-mon[35641]: pgmap v181: 65 pgs: 10 creating+peering, 4 unknown, 51 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:17:44.562 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:44 smithi192 ceph-mon[35641]: from='client.? 172.21.15.3:0/999309605' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-09-21T12:17:44.562 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:44 smithi192 ceph-mon[35641]: mds.? [v2:172.21.15.3:6826/2374828346,v1:172.21.15.3:6827/2374828346] up:active 2024-09-21T12:17:44.562 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:44 smithi192 ceph-mon[35641]: fsmap cephfs:1 {0=cephfs.smithi003.ebjgyl=up:active} 2024-09-21T12:17:44.577 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:44 smithi003 ceph-mon[28057]: pgmap v181: 65 pgs: 10 creating+peering, 4 unknown, 51 active+clean; 577 KiB data, 166 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:17:44.577 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:44 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/999309605' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-09-21T12:17:44.577 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:44 smithi003 ceph-mon[28057]: mds.? [v2:172.21.15.3:6826/2374828346,v1:172.21.15.3:6827/2374828346] up:active 2024-09-21T12:17:44.577 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:44 smithi003 ceph-mon[28057]: fsmap cephfs:1 {0=cephfs.smithi003.ebjgyl=up:active} 2024-09-21T12:17:44.685 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:44.662+0000 7f3130b26640 1 -- 172.21.15.3:0/2014132493 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f312c100860 msgr2=0x7f312c100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:44.685 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:44.662+0000 7f3130b26640 1 --2- 172.21.15.3:0/2014132493 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f312c100860 0x7f312c100c60 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f311c009880 tx=0x7f311c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:17:44.685 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:44.662+0000 7f3130b26640 1 -- 172.21.15.3:0/2014132493 shutdown_connections 2024-09-21T12:17:44.685 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:44.662+0000 7f3130b26640 1 --2- 172.21.15.3:0/2014132493 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f312c101a60 0x7f312c101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:44.685 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:44.662+0000 7f3130b26640 1 --2- 172.21.15.3:0/2014132493 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f312c100860 0x7f312c100c60 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:44.685 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:44.662+0000 7f3130b26640 1 -- 172.21.15.3:0/2014132493 >> 172.21.15.3:0/2014132493 conn(0x7f312c0fc010 msgr2=0x7f312c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:44.685 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:44.662+0000 7f3130b26640 1 -- 172.21.15.3:0/2014132493 shutdown_connections 2024-09-21T12:17:44.685 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:44.662+0000 7f3130b26640 1 -- 172.21.15.3:0/2014132493 wait complete. 2024-09-21T12:17:44.685 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:44.663+0000 7f3130b26640 1 Processor -- start 2024-09-21T12:17:44.686 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:44.663+0000 7f3130b26640 1 -- start start 2024-09-21T12:17:44.686 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:44.663+0000 7f3130b26640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f312c100860 0x7f312c1963d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:44.686 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:44.663+0000 7f3130b26640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f312c101a60 0x7f312c196910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:44.686 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:44.663+0000 7f3130b26640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f312c1096a0 con 0x7f312c101a60 2024-09-21T12:17:44.686 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:44.663+0000 7f3130b26640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f312c109520 con 0x7f312c100860 2024-09-21T12:17:44.686 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:44.663+0000 7f3129d9b640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f312c101a60 0x7f312c196910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:44.686 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:44.663+0000 7f3129d9b640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f312c101a60 0x7f312c196910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:51330/0 (socket says 172.21.15.3:51330) 2024-09-21T12:17:44.686 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:44.663+0000 7f3129d9b640 1 -- 172.21.15.3:0/2254717258 learned_addr learned my addr 172.21.15.3:0/2254717258 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:17:44.686 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:44.663+0000 7f312a59c640 1 --2- 172.21.15.3:0/2254717258 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f312c100860 0x7f312c1963d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:44.686 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:44.664+0000 7f3129d9b640 1 -- 172.21.15.3:0/2254717258 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f312c100860 msgr2=0x7f312c1963d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:44.686 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:44.664+0000 7f3129d9b640 1 --2- 172.21.15.3:0/2254717258 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f312c100860 0x7f312c1963d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:44.686 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:44.664+0000 7f3129d9b640 1 -- 172.21.15.3:0/2254717258 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f312c196f90 con 0x7f312c101a60 2024-09-21T12:17:44.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:44.664+0000 7f3129d9b640 1 --2- 172.21.15.3:0/2254717258 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f312c101a60 0x7f312c196910 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f312000eb00 tx=0x7f312000ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:44.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:44.664+0000 7f311b7fe640 1 -- 172.21.15.3:0/2254717258 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f312000bbb0 con 0x7f312c101a60 2024-09-21T12:17:44.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:44.664+0000 7f3130b26640 1 -- 172.21.15.3:0/2254717258 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f312c06a210 con 0x7f312c101a60 2024-09-21T12:17:44.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:44.664+0000 7f311b7fe640 1 -- 172.21.15.3:0/2254717258 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f312000bd50 con 0x7f312c101a60 2024-09-21T12:17:44.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:44.664+0000 7f311b7fe640 1 -- 172.21.15.3:0/2254717258 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3120017410 con 0x7f312c101a60 2024-09-21T12:17:44.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:44.664+0000 7f3130b26640 1 -- 172.21.15.3:0/2254717258 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f312c06a7a0 con 0x7f312c101a60 2024-09-21T12:17:44.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:44.665+0000 7f3130b26640 1 -- 172.21.15.3:0/2254717258 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f312c100c60 con 0x7f312c101a60 2024-09-21T12:17:44.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:44.665+0000 7f311b7fe640 1 -- 172.21.15.3:0/2254717258 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 19) ==== 92549+0+0 (secure 0 0 0) 0x7f31200046c0 con 0x7f312c101a60 2024-09-21T12:17:44.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:44.666+0000 7f311b7fe640 1 --2- 172.21.15.3:0/2254717258 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f311406e2b0 0x7f3114070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:44.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:44.666+0000 7f311b7fe640 1 -- 172.21.15.3:0/2254717258 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5468+0+0 (secure 0 0 0) 0x7f3120014070 con 0x7f312c101a60 2024-09-21T12:17:44.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:44.666+0000 7f312a59c640 1 --2- 172.21.15.3:0/2254717258 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f311406e2b0 0x7f3114070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:44.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:44.666+0000 7f312a59c640 1 --2- 172.21.15.3:0/2254717258 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f311406e2b0 0x7f3114070770 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f311c009230 tx=0x7f311c0058d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:44.687 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:44.670+0000 7f311b7fe640 1 -- 172.21.15.3:0/2254717258 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3120061390 con 0x7f312c101a60 2024-09-21T12:17:44.896 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:44.895+0000 7f3130b26640 1 -- 172.21.15.3:0/2254717258 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f312c06ab10 con 0x7f312c101a60 2024-09-21T12:17:45.304 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:45.302+0000 7f311b7fe640 1 -- 172.21.15.3:0/2254717258 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) ==== 122+0+0 (secure 0 0 0) 0x7f3120065bc0 con 0x7f312c101a60 2024-09-21T12:17:45.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:45.305+0000 7f3130b26640 1 -- 172.21.15.3:0/2254717258 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f311406e2b0 msgr2=0x7f3114070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:45.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:45.305+0000 7f3130b26640 1 --2- 172.21.15.3:0/2254717258 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f311406e2b0 0x7f3114070770 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f311c009230 tx=0x7f311c0058d0 comp rx=0 tx=0).stop 2024-09-21T12:17:45.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:45.305+0000 7f3130b26640 1 -- 172.21.15.3:0/2254717258 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f312c101a60 msgr2=0x7f312c196910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:45.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:45.305+0000 7f3130b26640 1 --2- 172.21.15.3:0/2254717258 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f312c101a60 0x7f312c196910 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f312000eb00 tx=0x7f312000ef00 comp rx=0 tx=0).stop 2024-09-21T12:17:45.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:45.305+0000 7f3130b26640 1 -- 172.21.15.3:0/2254717258 shutdown_connections 2024-09-21T12:17:45.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:45.305+0000 7f3130b26640 1 --2- 172.21.15.3:0/2254717258 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f311406e2b0 0x7f3114070770 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:45.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:45.305+0000 7f3130b26640 1 --2- 172.21.15.3:0/2254717258 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f312c101a60 0x7f312c196910 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:45.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:45.305+0000 7f3130b26640 1 --2- 172.21.15.3:0/2254717258 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f312c100860 0x7f312c1963d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:45.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:45.305+0000 7f3130b26640 1 -- 172.21.15.3:0/2254717258 >> 172.21.15.3:0/2254717258 conn(0x7f312c0fc010 msgr2=0x7f312c104f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:45.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:45.305+0000 7f3130b26640 1 -- 172.21.15.3:0/2254717258 shutdown_connections 2024-09-21T12:17:45.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:45.305+0000 7f3130b26640 1 -- 172.21.15.3:0/2254717258 wait complete. 2024-09-21T12:17:46.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:45 smithi192 ceph-mon[35641]: pgmap v182: 65 pgs: 65 active+clean; 577 KiB data, 167 MiB used, 536 GiB / 536 GiB avail; 326 B/s wr, 3 op/s 2024-09-21T12:17:46.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:45 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:17:46.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:45 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:17:46.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:45 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:17:46.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:45 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi003.gfkngj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-21T12:17:46.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:45 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi003.gfkngj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T12:17:46.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:45 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:17:46.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:45 smithi192 ceph-mon[35641]: Deploying daemon mds.cephfs.smithi003.gfkngj on smithi003 2024-09-21T12:17:46.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:45 smithi192 ceph-mon[35641]: from='client.? 172.21.15.3:0/2254717258' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-09-21T12:17:46.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:45 smithi192 ceph-mon[35641]: from='client.? 172.21.15.3:0/2254717258' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-09-21T12:17:46.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:45 smithi192 ceph-mon[35641]: mds.? [v2:172.21.15.192:6824/4055220871,v1:172.21.15.192:6825/4055220871] up:boot 2024-09-21T12:17:46.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:45 smithi192 ceph-mon[35641]: fsmap cephfs:1 {0=cephfs.smithi003.ebjgyl=up:active} 1 up:standby 2024-09-21T12:17:46.009 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:45 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi192.ywqqxe"}]: dispatch 2024-09-21T12:17:46.009 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:45 smithi192 ceph-mon[35641]: fsmap cephfs:1 {0=cephfs.smithi003.ebjgyl=up:active} 1 up:standby 2024-09-21T12:17:46.047 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:45 smithi003 ceph-mon[28057]: pgmap v182: 65 pgs: 65 active+clean; 577 KiB data, 167 MiB used, 536 GiB / 536 GiB avail; 326 B/s wr, 3 op/s 2024-09-21T12:17:46.047 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:45 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:17:46.047 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:45 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:17:46.047 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:45 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:17:46.047 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:45 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi003.gfkngj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-21T12:17:46.047 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:45 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi003.gfkngj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T12:17:46.047 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:45 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:17:46.047 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:45 smithi003 ceph-mon[28057]: Deploying daemon mds.cephfs.smithi003.gfkngj on smithi003 2024-09-21T12:17:46.047 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:45 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/2254717258' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-09-21T12:17:46.048 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:45 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/2254717258' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-09-21T12:17:46.048 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:45 smithi003 ceph-mon[28057]: mds.? [v2:172.21.15.192:6824/4055220871,v1:172.21.15.192:6825/4055220871] up:boot 2024-09-21T12:17:46.048 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:45 smithi003 ceph-mon[28057]: fsmap cephfs:1 {0=cephfs.smithi003.ebjgyl=up:active} 1 up:standby 2024-09-21T12:17:46.048 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:45 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi192.ywqqxe"}]: dispatch 2024-09-21T12:17:46.048 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:45 smithi003 ceph-mon[28057]: fsmap cephfs:1 {0=cephfs.smithi003.ebjgyl=up:active} 1 up:standby 2024-09-21T12:17:46.984 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:46 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:17:46.986 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:46 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:17:47.217 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T12:17:47.229 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi003.front.sepia.ceph.com 2024-09-21T12:17:47.229 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- bash -c 'ceph fs set cephfs inline_data true --yes-i-really-really-mean-it' 2024-09-21T12:17:47.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:47 smithi003 ceph-mon[28057]: pgmap v183: 65 pgs: 65 active+clean; 578 KiB data, 167 MiB used, 536 GiB / 536 GiB avail; 767 B/s wr, 4 op/s 2024-09-21T12:17:47.869 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:17:48.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:47 smithi192 ceph-mon[35641]: pgmap v183: 65 pgs: 65 active+clean; 578 KiB data, 167 MiB used, 536 GiB / 536 GiB avail; 767 B/s wr, 4 op/s 2024-09-21T12:17:48.338 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:48.317+0000 7fe252d37640 1 -- 172.21.15.3:0/3360968674 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe24c104d20 msgr2=0x7fe24c107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:48.338 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:48.317+0000 7fe252d37640 1 --2- 172.21.15.3:0/3360968674 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe24c104d20 0x7fe24c107110 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe23c0098b0 tx=0x7fe23c02a4d0 comp rx=0 tx=0).stop 2024-09-21T12:17:48.338 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:48.317+0000 7fe252d37640 1 -- 172.21.15.3:0/3360968674 shutdown_connections 2024-09-21T12:17:48.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:48.317+0000 7fe252d37640 1 --2- 172.21.15.3:0/3360968674 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe24c104d20 0x7fe24c107110 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:48.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:48.317+0000 7fe252d37640 1 --2- 172.21.15.3:0/3360968674 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe24c1023f0 0x7fe24c1047e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:48.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:48.317+0000 7fe252d37640 1 -- 172.21.15.3:0/3360968674 >> 172.21.15.3:0/3360968674 conn(0x7fe24c0fc010 msgr2=0x7fe24c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:48.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:48.318+0000 7fe252d37640 1 -- 172.21.15.3:0/3360968674 shutdown_connections 2024-09-21T12:17:48.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:48.318+0000 7fe252d37640 1 -- 172.21.15.3:0/3360968674 wait complete. 2024-09-21T12:17:48.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:48.318+0000 7fe252d37640 1 Processor -- start 2024-09-21T12:17:48.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:48.318+0000 7fe252d37640 1 -- start start 2024-09-21T12:17:48.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:48.318+0000 7fe252d37640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe24c1023f0 0x7fe24c1946f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:48.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:48.318+0000 7fe252d37640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe24c104d20 0x7fe24c194c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:48.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:48.318+0000 7fe252d37640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fe24c10a810 con 0x7fe24c104d20 2024-09-21T12:17:48.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:48.318+0000 7fe252d37640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe24c10a690 con 0x7fe24c1023f0 2024-09-21T12:17:48.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:48.318+0000 7fe24bfff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe24c104d20 0x7fe24c194c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:48.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:48.318+0000 7fe24bfff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe24c104d20 0x7fe24c194c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:51368/0 (socket says 172.21.15.3:51368) 2024-09-21T12:17:48.340 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:48.318+0000 7fe24bfff640 1 -- 172.21.15.3:0/1156135687 learned_addr learned my addr 172.21.15.3:0/1156135687 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:17:48.340 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:48.319+0000 7fe250ad3640 1 --2- 172.21.15.3:0/1156135687 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe24c1023f0 0x7fe24c1946f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:48.340 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:48.319+0000 7fe24bfff640 1 -- 172.21.15.3:0/1156135687 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe24c1023f0 msgr2=0x7fe24c1946f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:48.340 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:48.319+0000 7fe24bfff640 1 --2- 172.21.15.3:0/1156135687 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe24c1023f0 0x7fe24c1946f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:48.340 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:48.319+0000 7fe24bfff640 1 -- 172.21.15.3:0/1156135687 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe24c1952b0 con 0x7fe24c104d20 2024-09-21T12:17:48.340 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:48.319+0000 7fe250ad3640 1 --2- 172.21.15.3:0/1156135687 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe24c1023f0 0x7fe24c1946f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:17:48.340 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:48.319+0000 7fe24bfff640 1 --2- 172.21.15.3:0/1156135687 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe24c104d20 0x7fe24c194c30 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fe23c009880 tx=0x7fe23c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:48.340 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:48.319+0000 7fe249ffb640 1 -- 172.21.15.3:0/1156135687 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe23c03f070 con 0x7fe24c104d20 2024-09-21T12:17:48.340 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:48.319+0000 7fe252d37640 1 -- 172.21.15.3:0/1156135687 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe24c199c90 con 0x7fe24c104d20 2024-09-21T12:17:48.340 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:48.319+0000 7fe249ffb640 1 -- 172.21.15.3:0/1156135687 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe23c0044d0 con 0x7fe24c104d20 2024-09-21T12:17:48.340 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:48.319+0000 7fe249ffb640 1 -- 172.21.15.3:0/1156135687 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe23c035030 con 0x7fe24c104d20 2024-09-21T12:17:48.340 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:48.319+0000 7fe252d37640 1 -- 172.21.15.3:0/1156135687 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe24c19a2a0 con 0x7fe24c104d20 2024-09-21T12:17:48.340 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:48.320+0000 7fe252d37640 1 -- 172.21.15.3:0/1156135687 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe24c1027d0 con 0x7fe24c104d20 2024-09-21T12:17:48.340 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:48.321+0000 7fe249ffb640 1 -- 172.21.15.3:0/1156135687 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 19) ==== 92549+0+0 (secure 0 0 0) 0x7fe23c042070 con 0x7fe24c104d20 2024-09-21T12:17:48.340 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:48.321+0000 7fe249ffb640 1 --2- 172.21.15.3:0/1156135687 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fe23806e2b0 0x7fe238070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:48.341 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:48.322+0000 7fe249ffb640 1 -- 172.21.15.3:0/1156135687 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5468+0+0 (secure 0 0 0) 0x7fe23c0aed90 con 0x7fe24c104d20 2024-09-21T12:17:48.341 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:48.322+0000 7fe250ad3640 1 --2- 172.21.15.3:0/1156135687 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fe23806e2b0 0x7fe238070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:48.341 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:48.322+0000 7fe250ad3640 1 --2- 172.21.15.3:0/1156135687 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fe23806e2b0 0x7fe238070770 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe234009930 tx=0x7fe234008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:48.341 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:48.326+0000 7fe249ffb640 1 -- 172.21.15.3:0/1156135687 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe23c07c6f0 con 0x7fe24c104d20 2024-09-21T12:17:48.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:48.538+0000 7fe252d37640 1 -- 172.21.15.3:0/1156135687 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe24c062df0 con 0x7fe24c104d20 2024-09-21T12:17:48.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:48.719+0000 7fe249ffb640 1 -- 172.21.15.3:0/1156135687 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]=0 inline data enabled v8) ==== 168+0+0 (secure 0 0 0) 0x7fe23c0803a0 con 0x7fe24c104d20 2024-09-21T12:17:48.721 INFO:teuthology.orchestra.run.smithi003.stderr:inline data enabled 2024-09-21T12:17:48.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:48.721+0000 7fe252d37640 1 -- 172.21.15.3:0/1156135687 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fe23806e2b0 msgr2=0x7fe238070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:48.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:48.721+0000 7fe252d37640 1 --2- 172.21.15.3:0/1156135687 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fe23806e2b0 0x7fe238070770 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fe234009930 tx=0x7fe234008040 comp rx=0 tx=0).stop 2024-09-21T12:17:48.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:48.721+0000 7fe252d37640 1 -- 172.21.15.3:0/1156135687 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe24c104d20 msgr2=0x7fe24c194c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:48.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:48.721+0000 7fe252d37640 1 --2- 172.21.15.3:0/1156135687 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe24c104d20 0x7fe24c194c30 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fe23c009880 tx=0x7fe23c0048f0 comp rx=0 tx=0).stop 2024-09-21T12:17:48.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:48.722+0000 7fe252d37640 1 -- 172.21.15.3:0/1156135687 shutdown_connections 2024-09-21T12:17:48.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:48.722+0000 7fe252d37640 1 --2- 172.21.15.3:0/1156135687 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fe23806e2b0 0x7fe238070770 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:48.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:48.722+0000 7fe252d37640 1 --2- 172.21.15.3:0/1156135687 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe24c104d20 0x7fe24c194c30 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:48.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:48.722+0000 7fe252d37640 1 --2- 172.21.15.3:0/1156135687 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe24c1023f0 0x7fe24c1946f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:48.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:48.722+0000 7fe252d37640 1 -- 172.21.15.3:0/1156135687 >> 172.21.15.3:0/1156135687 conn(0x7fe24c0fc010 msgr2=0x7fe24c101920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:48.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:48.722+0000 7fe252d37640 1 -- 172.21.15.3:0/1156135687 shutdown_connections 2024-09-21T12:17:48.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:48.722+0000 7fe252d37640 1 -- 172.21.15.3:0/1156135687 wait complete. 2024-09-21T12:17:49.075 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:48 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:17:49.076 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:48 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:17:49.076 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:48 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:17:49.076 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:48 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi192.ktdqns", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-21T12:17:49.076 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:48 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi192.ktdqns", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T12:17:49.076 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:48 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:17:49.076 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:48 smithi003 ceph-mon[28057]: Deploying daemon mds.cephfs.smithi192.ktdqns on smithi192 2024-09-21T12:17:49.076 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:48 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/1156135687' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-21T12:17:49.076 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:48 smithi003 ceph-mon[28057]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2024-09-21T12:17:49.076 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:48 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/1156135687' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T12:17:49.076 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:48 smithi003 ceph-mon[28057]: mds.? [v2:172.21.15.3:6828/3710817325,v1:172.21.15.3:6829/3710817325] up:boot 2024-09-21T12:17:49.076 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:48 smithi003 ceph-mon[28057]: fsmap cephfs:1 {0=cephfs.smithi003.ebjgyl=up:active} 2 up:standby 2024-09-21T12:17:49.076 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:48 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi003.gfkngj"}]: dispatch 2024-09-21T12:17:49.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:48 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:17:49.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:48 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:17:49.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:48 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:17:49.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:48 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi192.ktdqns", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-21T12:17:49.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:48 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi192.ktdqns", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-21T12:17:49.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:48 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:17:49.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:48 smithi192 ceph-mon[35641]: Deploying daemon mds.cephfs.smithi192.ktdqns on smithi192 2024-09-21T12:17:49.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:48 smithi192 ceph-mon[35641]: from='client.? 172.21.15.3:0/1156135687' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-21T12:17:49.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:48 smithi192 ceph-mon[35641]: Health check failed: 1 filesystem with deprecated feature inline_data (FS_INLINE_DATA_DEPRECATED) 2024-09-21T12:17:49.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:48 smithi192 ceph-mon[35641]: from='client.? 172.21.15.3:0/1156135687' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]': finished 2024-09-21T12:17:49.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:48 smithi192 ceph-mon[35641]: mds.? [v2:172.21.15.3:6828/3710817325,v1:172.21.15.3:6829/3710817325] up:boot 2024-09-21T12:17:49.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:48 smithi192 ceph-mon[35641]: fsmap cephfs:1 {0=cephfs.smithi003.ebjgyl=up:active} 2 up:standby 2024-09-21T12:17:49.259 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:48 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi003.gfkngj"}]: dispatch 2024-09-21T12:17:49.434 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T12:17:49.449 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi003.front.sepia.ceph.com 2024-09-21T12:17:49.450 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- bash -c 'ceph fs dump' 2024-09-21T12:17:49.720 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:17:49.994 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:49 smithi003 ceph-mon[28057]: pgmap v184: 65 pgs: 65 active+clean; 579 KiB data, 167 MiB used, 536 GiB / 536 GiB avail; 1.5 KiB/s wr, 4 op/s 2024-09-21T12:17:50.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:49 smithi192 ceph-mon[35641]: pgmap v184: 65 pgs: 65 active+clean; 579 KiB data, 167 MiB used, 536 GiB / 536 GiB avail; 1.5 KiB/s wr, 4 op/s 2024-09-21T12:17:50.201 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:50.197+0000 7f239eb86640 1 -- 172.21.15.3:0/359589653 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f23981023f0 msgr2=0x7f23981047e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:50.201 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:50.197+0000 7f239eb86640 1 --2- 172.21.15.3:0/359589653 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f23981023f0 0x7f23981047e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f238c0098b0 tx=0x7f238c02a4d0 comp rx=0 tx=0).stop 2024-09-21T12:17:50.201 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:50.197+0000 7f239eb86640 1 -- 172.21.15.3:0/359589653 shutdown_connections 2024-09-21T12:17:50.202 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:50.197+0000 7f239eb86640 1 --2- 172.21.15.3:0/359589653 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2398104d20 0x7f2398107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:50.202 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:50.197+0000 7f239eb86640 1 --2- 172.21.15.3:0/359589653 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f23981023f0 0x7f23981047e0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:50.202 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:50.197+0000 7f239eb86640 1 -- 172.21.15.3:0/359589653 >> 172.21.15.3:0/359589653 conn(0x7f23980fc010 msgr2=0x7f23980fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:50.202 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:50.198+0000 7f239eb86640 1 -- 172.21.15.3:0/359589653 shutdown_connections 2024-09-21T12:17:50.202 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:50.198+0000 7f239eb86640 1 -- 172.21.15.3:0/359589653 wait complete. 2024-09-21T12:17:50.202 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:50.198+0000 7f239eb86640 1 Processor -- start 2024-09-21T12:17:50.202 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:50.198+0000 7f239eb86640 1 -- start start 2024-09-21T12:17:50.202 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:50.198+0000 7f239eb86640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f23981023f0 0x7f2398101ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:50.202 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:50.198+0000 7f239eb86640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2398104d20 0x7f23981003a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:50.202 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:50.198+0000 7f239eb86640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f239810a7e0 con 0x7f23981023f0 2024-09-21T12:17:50.202 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:50.198+0000 7f239eb86640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f239810a660 con 0x7f2398104d20 2024-09-21T12:17:50.202 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:50.198+0000 7f239c922640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f23981023f0 0x7f2398101ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:50.202 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:50.199+0000 7f239c922640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f23981023f0 0x7f2398101ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:51378/0 (socket says 172.21.15.3:51378) 2024-09-21T12:17:50.203 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:50.199+0000 7f239c922640 1 -- 172.21.15.3:0/743564569 learned_addr learned my addr 172.21.15.3:0/743564569 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:17:50.203 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:50.199+0000 7f2397fff640 1 --2- 172.21.15.3:0/743564569 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2398104d20 0x7f23981003a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:50.203 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:50.199+0000 7f239c922640 1 -- 172.21.15.3:0/743564569 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2398104d20 msgr2=0x7f23981003a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:50.203 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:50.199+0000 7f239c922640 1 --2- 172.21.15.3:0/743564569 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2398104d20 0x7f23981003a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:50.203 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:50.199+0000 7f239c922640 1 -- 172.21.15.3:0/743564569 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23981008e0 con 0x7f23981023f0 2024-09-21T12:17:50.203 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:50.199+0000 7f2397fff640 1 --2- 172.21.15.3:0/743564569 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2398104d20 0x7f23981003a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:17:50.203 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:50.199+0000 7f239c922640 1 --2- 172.21.15.3:0/743564569 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f23981023f0 0x7f2398101ce0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f238c0099d0 tx=0x7f238c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:50.203 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:50.199+0000 7f2395ffb640 1 -- 172.21.15.3:0/743564569 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f238c03f070 con 0x7f23981023f0 2024-09-21T12:17:50.203 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:50.199+0000 7f2395ffb640 1 -- 172.21.15.3:0/743564569 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f238c0049d0 con 0x7f23981023f0 2024-09-21T12:17:50.203 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:50.199+0000 7f239eb86640 1 -- 172.21.15.3:0/743564569 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2398100b70 con 0x7f23981023f0 2024-09-21T12:17:50.203 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:50.199+0000 7f2395ffb640 1 -- 172.21.15.3:0/743564569 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f238c035030 con 0x7f23981023f0 2024-09-21T12:17:50.203 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:50.200+0000 7f239eb86640 1 -- 172.21.15.3:0/743564569 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23981010a0 con 0x7f23981023f0 2024-09-21T12:17:50.204 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:50.200+0000 7f239eb86640 1 -- 172.21.15.3:0/743564569 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23981027d0 con 0x7f23981023f0 2024-09-21T12:17:50.204 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:50.201+0000 7f2395ffb640 1 -- 172.21.15.3:0/743564569 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 19) ==== 92549+0+0 (secure 0 0 0) 0x7f238c042070 con 0x7f23981023f0 2024-09-21T12:17:50.204 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:50.202+0000 7f2395ffb640 1 --2- 172.21.15.3:0/743564569 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f238806e2b0 0x7f2388070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:50.205 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:50.202+0000 7f2395ffb640 1 -- 172.21.15.3:0/743564569 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5468+0+0 (secure 0 0 0) 0x7f238c0aed10 con 0x7f23981023f0 2024-09-21T12:17:50.205 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:50.202+0000 7f2397fff640 1 --2- 172.21.15.3:0/743564569 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f238806e2b0 0x7f2388070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:50.205 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:50.202+0000 7f2397fff640 1 --2- 172.21.15.3:0/743564569 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f238806e2b0 0x7f2388070770 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2398101a60 tx=0x7f2384005f90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:50.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:50.206+0000 7f2395ffb640 1 -- 172.21.15.3:0/743564569 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f238c07c670 con 0x7f23981023f0 2024-09-21T12:17:50.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:50.420+0000 7f239eb86640 1 -- 172.21.15.3:0/743564569 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f239819f720 con 0x7f23981023f0 2024-09-21T12:17:50.423 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:50.421+0000 7f2395ffb640 1 -- 172.21.15.3:0/743564569 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 8 v8) ==== 75+0+1795 (secure 0 0 0) 0x7f238c080320 con 0x7f23981023f0 2024-09-21T12:17:50.423 INFO:teuthology.orchestra.run.smithi003.stdout:e8 2024-09-21T12:17:50.423 INFO:teuthology.orchestra.run.smithi003.stdout:btime 2024-09-21T12:17:48:719185+0000 2024-09-21T12:17:50.423 INFO:teuthology.orchestra.run.smithi003.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T12:17:50.423 INFO:teuthology.orchestra.run.smithi003.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:17:50.423 INFO:teuthology.orchestra.run.smithi003.stdout:legacy client fscid: 1 2024-09-21T12:17:50.423 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:17:50.423 INFO:teuthology.orchestra.run.smithi003.stdout:Filesystem 'cephfs' (1) 2024-09-21T12:17:50.423 INFO:teuthology.orchestra.run.smithi003.stdout:fs_name cephfs 2024-09-21T12:17:50.423 INFO:teuthology.orchestra.run.smithi003.stdout:epoch 8 2024-09-21T12:17:50.423 INFO:teuthology.orchestra.run.smithi003.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T12:17:50.424 INFO:teuthology.orchestra.run.smithi003.stdout:created 2024-09-21T12:17:38.260099+0000 2024-09-21T12:17:50.424 INFO:teuthology.orchestra.run.smithi003.stdout:modified 2024-09-21T12:17:48.539164+0000 2024-09-21T12:17:50.424 INFO:teuthology.orchestra.run.smithi003.stdout:tableserver 0 2024-09-21T12:17:50.424 INFO:teuthology.orchestra.run.smithi003.stdout:root 0 2024-09-21T12:17:50.424 INFO:teuthology.orchestra.run.smithi003.stdout:session_timeout 60 2024-09-21T12:17:50.424 INFO:teuthology.orchestra.run.smithi003.stdout:session_autoclose 300 2024-09-21T12:17:50.424 INFO:teuthology.orchestra.run.smithi003.stdout:max_file_size 1099511627776 2024-09-21T12:17:50.424 INFO:teuthology.orchestra.run.smithi003.stdout:max_xattr_size 65536 2024-09-21T12:17:50.424 INFO:teuthology.orchestra.run.smithi003.stdout:required_client_features {} 2024-09-21T12:17:50.424 INFO:teuthology.orchestra.run.smithi003.stdout:last_failure 0 2024-09-21T12:17:50.424 INFO:teuthology.orchestra.run.smithi003.stdout:last_failure_osd_epoch 0 2024-09-21T12:17:50.424 INFO:teuthology.orchestra.run.smithi003.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:17:50.424 INFO:teuthology.orchestra.run.smithi003.stdout:max_mds 1 2024-09-21T12:17:50.424 INFO:teuthology.orchestra.run.smithi003.stdout:in 0 2024-09-21T12:17:50.424 INFO:teuthology.orchestra.run.smithi003.stdout:up {0=14548} 2024-09-21T12:17:50.425 INFO:teuthology.orchestra.run.smithi003.stdout:failed 2024-09-21T12:17:50.425 INFO:teuthology.orchestra.run.smithi003.stdout:damaged 2024-09-21T12:17:50.425 INFO:teuthology.orchestra.run.smithi003.stdout:stopped 2024-09-21T12:17:50.425 INFO:teuthology.orchestra.run.smithi003.stdout:data_pools [3] 2024-09-21T12:17:50.425 INFO:teuthology.orchestra.run.smithi003.stdout:metadata_pool 2 2024-09-21T12:17:50.425 INFO:teuthology.orchestra.run.smithi003.stdout:inline_data enabled 2024-09-21T12:17:50.425 INFO:teuthology.orchestra.run.smithi003.stdout:balancer 2024-09-21T12:17:50.425 INFO:teuthology.orchestra.run.smithi003.stdout:bal_rank_mask -1 2024-09-21T12:17:50.425 INFO:teuthology.orchestra.run.smithi003.stdout:standby_count_wanted 1 2024-09-21T12:17:50.425 INFO:teuthology.orchestra.run.smithi003.stdout:qdb_cluster leader: 14548 members: 14548 2024-09-21T12:17:50.425 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.cephfs.smithi003.ebjgyl{0:14548} state up:active seq 2 addr [v2:172.21.15.3:6826/2374828346,v1:172.21.15.3:6827/2374828346] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:17:50.425 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:17:50.425 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:17:50.425 INFO:teuthology.orchestra.run.smithi003.stdout:Standby daemons: 2024-09-21T12:17:50.425 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:17:50.426 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.cephfs.smithi003.gfkngj{-1:14564} state up:standby seq 1 addr [v2:172.21.15.3:6828/3710817325,v1:172.21.15.3:6829/3710817325] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:17:50.426 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.cephfs.smithi192.ywqqxe{-1:24319} state up:standby seq 1 addr [v2:172.21.15.192:6824/4055220871,v1:172.21.15.192:6825/4055220871] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:17:50.426 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 8 2024-09-21T12:17:50.426 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:50.423+0000 7f239eb86640 1 -- 172.21.15.3:0/743564569 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f238806e2b0 msgr2=0x7f2388070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:50.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:50.423+0000 7f239eb86640 1 --2- 172.21.15.3:0/743564569 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f238806e2b0 0x7f2388070770 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f2398101a60 tx=0x7f2384005f90 comp rx=0 tx=0).stop 2024-09-21T12:17:50.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:50.423+0000 7f239eb86640 1 -- 172.21.15.3:0/743564569 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f23981023f0 msgr2=0x7f2398101ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:50.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:50.423+0000 7f239eb86640 1 --2- 172.21.15.3:0/743564569 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f23981023f0 0x7f2398101ce0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f238c0099d0 tx=0x7f238c0045e0 comp rx=0 tx=0).stop 2024-09-21T12:17:50.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:50.423+0000 7f239eb86640 1 -- 172.21.15.3:0/743564569 shutdown_connections 2024-09-21T12:17:50.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:50.423+0000 7f239eb86640 1 --2- 172.21.15.3:0/743564569 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f238806e2b0 0x7f2388070770 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:50.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:50.423+0000 7f239eb86640 1 --2- 172.21.15.3:0/743564569 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2398104d20 0x7f23981003a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:50.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:50.423+0000 7f239eb86640 1 --2- 172.21.15.3:0/743564569 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f23981023f0 0x7f2398101ce0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:50.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:50.423+0000 7f239eb86640 1 -- 172.21.15.3:0/743564569 >> 172.21.15.3:0/743564569 conn(0x7f23980fc010 msgr2=0x7f23980fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:50.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:50.423+0000 7f239eb86640 1 -- 172.21.15.3:0/743564569 shutdown_connections 2024-09-21T12:17:50.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:50.423+0000 7f239eb86640 1 -- 172.21.15.3:0/743564569 wait complete. 2024-09-21T12:17:51.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:50 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/743564569' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-21T12:17:51.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:50 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:17:51.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:50 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:17:51.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:50 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:17:51.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:50 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:17:51.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:50 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:17:51.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:50 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:17:51.129 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:50 smithi192 ceph-mon[35641]: from='client.? 172.21.15.3:0/743564569' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-21T12:17:51.129 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:50 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:17:51.129 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:50 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:17:51.129 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:50 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:17:51.130 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:50 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:17:51.130 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:50 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:17:51.130 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:50 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:17:51.136 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-09-21T12:17:51.990 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:17:52.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:51 smithi003 ceph-mon[28057]: pgmap v185: 65 pgs: 65 active+clean; 579 KiB data, 167 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s wr, 4 op/s 2024-09-21T12:17:52.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:51 smithi003 ceph-mon[28057]: mds.? [v2:172.21.15.192:6826/318800854,v1:172.21.15.192:6827/318800854] up:boot 2024-09-21T12:17:52.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:51 smithi003 ceph-mon[28057]: fsmap cephfs:1 {0=cephfs.smithi003.ebjgyl=up:active} 3 up:standby 2024-09-21T12:17:52.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:51 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi192.ktdqns"}]: dispatch 2024-09-21T12:17:52.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:51 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:17:52.122 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:51 smithi192 ceph-mon[35641]: pgmap v185: 65 pgs: 65 active+clean; 579 KiB data, 167 MiB used, 536 GiB / 536 GiB avail; 1.4 KiB/s wr, 4 op/s 2024-09-21T12:17:52.122 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:51 smithi192 ceph-mon[35641]: mds.? [v2:172.21.15.192:6826/318800854,v1:172.21.15.192:6827/318800854] up:boot 2024-09-21T12:17:52.122 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:51 smithi192 ceph-mon[35641]: fsmap cephfs:1 {0=cephfs.smithi003.ebjgyl=up:active} 3 up:standby 2024-09-21T12:17:52.122 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:51 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi192.ktdqns"}]: dispatch 2024-09-21T12:17:52.122 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:51 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:17:52.473 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:52.471+0000 7f7c9cc17640 1 -- 172.21.15.3:0/3804801959 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7c98100860 msgr2=0x7f7c98100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:52.474 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:52.471+0000 7f7c9cc17640 1 --2- 172.21.15.3:0/3804801959 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7c98100860 0x7f7c98100c60 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f7c88009880 tx=0x7f7c8802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:17:52.474 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:52.472+0000 7f7c9cc17640 1 -- 172.21.15.3:0/3804801959 shutdown_connections 2024-09-21T12:17:52.474 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:52.472+0000 7f7c9cc17640 1 --2- 172.21.15.3:0/3804801959 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c98101a60 0x7f7c98101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:52.474 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:52.472+0000 7f7c9cc17640 1 --2- 172.21.15.3:0/3804801959 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7c98100860 0x7f7c98100c60 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:52.474 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:52.472+0000 7f7c9cc17640 1 -- 172.21.15.3:0/3804801959 >> 172.21.15.3:0/3804801959 conn(0x7f7c980fc010 msgr2=0x7f7c980fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:52.474 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:52.472+0000 7f7c9cc17640 1 -- 172.21.15.3:0/3804801959 shutdown_connections 2024-09-21T12:17:52.474 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:52.472+0000 7f7c9cc17640 1 -- 172.21.15.3:0/3804801959 wait complete. 2024-09-21T12:17:52.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:52.472+0000 7f7c9cc17640 1 Processor -- start 2024-09-21T12:17:52.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:52.472+0000 7f7c9cc17640 1 -- start start 2024-09-21T12:17:52.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:52.473+0000 7f7c9cc17640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7c98100860 0x7f7c981974e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:52.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:52.473+0000 7f7c9cc17640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c98101a60 0x7f7c98197a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:52.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:52.473+0000 7f7c9cc17640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f7c981096a0 con 0x7f7c98100860 2024-09-21T12:17:52.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:52.473+0000 7f7c9cc17640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7c98109520 con 0x7f7c98101a60 2024-09-21T12:17:52.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:52.473+0000 7f7c9659c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7c98100860 0x7f7c981974e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:52.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:52.473+0000 7f7c9659c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7c98100860 0x7f7c981974e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35544/0 (socket says 172.21.15.3:35544) 2024-09-21T12:17:52.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:52.473+0000 7f7c9659c640 1 -- 172.21.15.3:0/155829451 learned_addr learned my addr 172.21.15.3:0/155829451 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:17:52.476 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:52.473+0000 7f7c95d9b640 1 --2- 172.21.15.3:0/155829451 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c98101a60 0x7f7c98197a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:52.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:52.473+0000 7f7c9659c640 1 -- 172.21.15.3:0/155829451 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c98101a60 msgr2=0x7f7c98197a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:52.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:52.473+0000 7f7c9659c640 1 --2- 172.21.15.3:0/155829451 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c98101a60 0x7f7c98197a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:52.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:52.473+0000 7f7c9659c640 1 -- 172.21.15.3:0/155829451 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c981980a0 con 0x7f7c98100860 2024-09-21T12:17:52.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:52.473+0000 7f7c95d9b640 1 --2- 172.21.15.3:0/155829451 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c98101a60 0x7f7c98197a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T12:17:52.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:52.473+0000 7f7c9659c640 1 --2- 172.21.15.3:0/155829451 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7c98100860 0x7f7c981974e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7c88006010 tx=0x7f7c880045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:52.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:52.474+0000 7f7c877fe640 1 -- 172.21.15.3:0/155829451 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7c8803f070 con 0x7f7c98100860 2024-09-21T12:17:52.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:52.474+0000 7f7c877fe640 1 -- 172.21.15.3:0/155829451 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7c88004a50 con 0x7f7c98100860 2024-09-21T12:17:52.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:52.474+0000 7f7c877fe640 1 -- 172.21.15.3:0/155829451 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7c88035030 con 0x7f7c98100860 2024-09-21T12:17:52.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:52.474+0000 7f7c9cc17640 1 -- 172.21.15.3:0/155829451 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c9819ca80 con 0x7f7c98100860 2024-09-21T12:17:52.477 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:52.474+0000 7f7c9cc17640 1 -- 172.21.15.3:0/155829451 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c9819d010 con 0x7f7c98100860 2024-09-21T12:17:52.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:52.475+0000 7f7c9cc17640 1 -- 172.21.15.3:0/155829451 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c98100c60 con 0x7f7c98100860 2024-09-21T12:17:52.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:52.476+0000 7f7c877fe640 1 -- 172.21.15.3:0/155829451 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 19) ==== 92549+0+0 (secure 0 0 0) 0x7f7c88042070 con 0x7f7c98100860 2024-09-21T12:17:52.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:52.476+0000 7f7c877fe640 1 --2- 172.21.15.3:0/155829451 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f7c8006e310 0x7f7c800707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:52.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:52.477+0000 7f7c877fe640 1 -- 172.21.15.3:0/155829451 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5468+0+0 (secure 0 0 0) 0x7f7c880aebb0 con 0x7f7c98100860 2024-09-21T12:17:52.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:52.477+0000 7f7c95d9b640 1 --2- 172.21.15.3:0/155829451 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f7c8006e310 0x7f7c800707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:52.479 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:52.477+0000 7f7c95d9b640 1 --2- 172.21.15.3:0/155829451 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f7c8006e310 0x7f7c800707d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7c98198990 tx=0x7f7c8c00b390 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:52.486 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:52.485+0000 7f7c877fe640 1 -- 172.21.15.3:0/155829451 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7c880b5080 con 0x7f7c98100860 2024-09-21T12:17:52.712 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:52.709+0000 7f7c9cc17640 1 -- 172.21.15.3:0/155829451 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7c9819d240 con 0x7f7c98100860 2024-09-21T12:17:52.712 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:52.710+0000 7f7c877fe640 1 -- 172.21.15.3:0/155829451 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+4460 (secure 0 0 0) 0x7f7c88080240 con 0x7f7c98100860 2024-09-21T12:17:52.712 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 11 2024-09-21T12:17:52.714 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:52.712+0000 7f7c9cc17640 1 -- 172.21.15.3:0/155829451 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f7c8006e310 msgr2=0x7f7c800707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:52.714 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:52.712+0000 7f7c9cc17640 1 --2- 172.21.15.3:0/155829451 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f7c8006e310 0x7f7c800707d0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7c98198990 tx=0x7f7c8c00b390 comp rx=0 tx=0).stop 2024-09-21T12:17:52.715 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:52.712+0000 7f7c9cc17640 1 -- 172.21.15.3:0/155829451 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7c98100860 msgr2=0x7f7c981974e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:52.715 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:52.712+0000 7f7c9cc17640 1 --2- 172.21.15.3:0/155829451 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7c98100860 0x7f7c981974e0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f7c88006010 tx=0x7f7c880045e0 comp rx=0 tx=0).stop 2024-09-21T12:17:52.715 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:52.713+0000 7f7c9cc17640 1 -- 172.21.15.3:0/155829451 shutdown_connections 2024-09-21T12:17:52.715 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:52.713+0000 7f7c9cc17640 1 --2- 172.21.15.3:0/155829451 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f7c8006e310 0x7f7c800707d0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:52.715 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:52.713+0000 7f7c9cc17640 1 --2- 172.21.15.3:0/155829451 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c98101a60 0x7f7c98197a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:52.715 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:52.713+0000 7f7c9cc17640 1 --2- 172.21.15.3:0/155829451 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7c98100860 0x7f7c981974e0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:52.715 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:52.713+0000 7f7c9cc17640 1 -- 172.21.15.3:0/155829451 >> 172.21.15.3:0/155829451 conn(0x7f7c980fc010 msgr2=0x7f7c9806a1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:52.715 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:52.713+0000 7f7c9cc17640 1 -- 172.21.15.3:0/155829451 shutdown_connections 2024-09-21T12:17:52.715 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:52.713+0000 7f7c9cc17640 1 -- 172.21.15.3:0/155829451 wait complete. 2024-09-21T12:17:52.723 INFO:teuthology.orchestra.run.smithi003.stdout:true 2024-09-21T12:17:53.608 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-09-21T12:17:53.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:53 smithi003 ceph-mon[28057]: pgmap v186: 65 pgs: 65 active+clean; 579 KiB data, 167 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 3 op/s 2024-09-21T12:17:53.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:53 smithi003 ceph-mon[28057]: mds.? [v2:172.21.15.3:6828/3710817325,v1:172.21.15.3:6829/3710817325] up:standby 2024-09-21T12:17:53.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:53 smithi003 ceph-mon[28057]: Dropping low affinity active daemon mds.cephfs.smithi003.ebjgyl in favor of higher affinity standby. 2024-09-21T12:17:53.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:53 smithi003 ceph-mon[28057]: Replacing daemon mds.cephfs.smithi003.ebjgyl as rank 0 with standby daemon mds.cephfs.smithi003.gfkngj 2024-09-21T12:17:53.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:53 smithi003 ceph-mon[28057]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T12:17:53.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:53 smithi003 ceph-mon[28057]: fsmap cephfs:1 {0=cephfs.smithi003.ebjgyl=up:active} 3 up:standby 2024-09-21T12:17:53.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:53 smithi003 ceph-mon[28057]: osdmap e46: 6 total, 6 up, 6 in 2024-09-21T12:17:53.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:53 smithi003 ceph-mon[28057]: fsmap cephfs:1/1 {0=cephfs.smithi003.gfkngj=up:replay} 2 up:standby 2024-09-21T12:17:53.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:53 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:17:53.831 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:53 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:17:53.831 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:53 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/155829451' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-21T12:17:54.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:53 smithi192 ceph-mon[35641]: pgmap v186: 65 pgs: 65 active+clean; 579 KiB data, 167 MiB used, 536 GiB / 536 GiB avail; 1.2 KiB/s wr, 3 op/s 2024-09-21T12:17:54.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:53 smithi192 ceph-mon[35641]: mds.? [v2:172.21.15.3:6828/3710817325,v1:172.21.15.3:6829/3710817325] up:standby 2024-09-21T12:17:54.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:53 smithi192 ceph-mon[35641]: Dropping low affinity active daemon mds.cephfs.smithi003.ebjgyl in favor of higher affinity standby. 2024-09-21T12:17:54.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:53 smithi192 ceph-mon[35641]: Replacing daemon mds.cephfs.smithi003.ebjgyl as rank 0 with standby daemon mds.cephfs.smithi003.gfkngj 2024-09-21T12:17:54.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:53 smithi192 ceph-mon[35641]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T12:17:54.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:53 smithi192 ceph-mon[35641]: fsmap cephfs:1 {0=cephfs.smithi003.ebjgyl=up:active} 3 up:standby 2024-09-21T12:17:54.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:53 smithi192 ceph-mon[35641]: osdmap e46: 6 total, 6 up, 6 in 2024-09-21T12:17:54.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:53 smithi192 ceph-mon[35641]: fsmap cephfs:1/1 {0=cephfs.smithi003.gfkngj=up:replay} 2 up:standby 2024-09-21T12:17:54.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:53 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:17:54.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:53 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:17:54.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:53 smithi192 ceph-mon[35641]: from='client.? 172.21.15.3:0/155829451' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-21T12:17:54.023 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:17:54.857 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:54 smithi003 ceph-mon[28057]: mds.? [v2:172.21.15.192:6824/4055220871,v1:172.21.15.192:6825/4055220871] up:standby 2024-09-21T12:17:54.857 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:54 smithi003 ceph-mon[28057]: mds.? [v2:172.21.15.3:6828/3710817325,v1:172.21.15.3:6829/3710817325] up:reconnect 2024-09-21T12:17:54.857 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:54 smithi003 ceph-mon[28057]: mds.? [v2:172.21.15.3:6826/55902996,v1:172.21.15.3:6827/55902996] up:boot 2024-09-21T12:17:54.857 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:54 smithi003 ceph-mon[28057]: fsmap cephfs:1/1 {0=cephfs.smithi003.gfkngj=up:reconnect} 3 up:standby 2024-09-21T12:17:54.857 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:54 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi003.ebjgyl"}]: dispatch 2024-09-21T12:17:55.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:54 smithi192 ceph-mon[35641]: mds.? [v2:172.21.15.192:6824/4055220871,v1:172.21.15.192:6825/4055220871] up:standby 2024-09-21T12:17:55.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:54 smithi192 ceph-mon[35641]: mds.? [v2:172.21.15.3:6828/3710817325,v1:172.21.15.3:6829/3710817325] up:reconnect 2024-09-21T12:17:55.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:54 smithi192 ceph-mon[35641]: mds.? [v2:172.21.15.3:6826/55902996,v1:172.21.15.3:6827/55902996] up:boot 2024-09-21T12:17:55.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:54 smithi192 ceph-mon[35641]: fsmap cephfs:1/1 {0=cephfs.smithi003.gfkngj=up:reconnect} 3 up:standby 2024-09-21T12:17:55.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:54 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi003.ebjgyl"}]: dispatch 2024-09-21T12:17:55.029 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:55.020+0000 7ff4ae9f9640 1 -- 172.21.15.3:0/2718316524 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff4a80ffc40 msgr2=0x7ff4a8100040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:55.029 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:55.020+0000 7ff4ae9f9640 1 --2- 172.21.15.3:0/2718316524 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff4a80ffc40 0x7ff4a8100040 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7ff498009880 tx=0x7ff49802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:17:55.029 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:55.020+0000 7ff4ae9f9640 1 -- 172.21.15.3:0/2718316524 shutdown_connections 2024-09-21T12:17:55.029 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:55.020+0000 7ff4ae9f9640 1 --2- 172.21.15.3:0/2718316524 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4a8102cc0 0x7ff4a8103140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:55.029 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:55.020+0000 7ff4ae9f9640 1 --2- 172.21.15.3:0/2718316524 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff4a80ffc40 0x7ff4a8100040 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:55.029 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:55.020+0000 7ff4ae9f9640 1 -- 172.21.15.3:0/2718316524 >> 172.21.15.3:0/2718316524 conn(0x7ff4a80fb770 msgr2=0x7ff4a80fdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:55.029 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:55.020+0000 7ff4ae9f9640 1 -- 172.21.15.3:0/2718316524 shutdown_connections 2024-09-21T12:17:55.030 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:55.020+0000 7ff4ae9f9640 1 -- 172.21.15.3:0/2718316524 wait complete. 2024-09-21T12:17:55.030 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:55.021+0000 7ff4ae9f9640 1 Processor -- start 2024-09-21T12:17:55.030 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:55.021+0000 7ff4ae9f9640 1 -- start start 2024-09-21T12:17:55.030 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:55.021+0000 7ff4ae9f9640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4a80ffc40 0x7ff4a8197510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:55.030 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:55.021+0000 7ff4ae9f9640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff4a8102cc0 0x7ff4a8197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:55.030 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:55.021+0000 7ff4ae9f9640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7ff4a810a800 con 0x7ff4a8102cc0 2024-09-21T12:17:55.030 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:55.021+0000 7ff4ae9f9640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff4a810a680 con 0x7ff4a80ffc40 2024-09-21T12:17:55.030 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:55.021+0000 7ff4a77fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff4a8102cc0 0x7ff4a8197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:55.031 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:55.021+0000 7ff4a77fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff4a8102cc0 0x7ff4a8197a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35590/0 (socket says 172.21.15.3:35590) 2024-09-21T12:17:55.031 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:55.021+0000 7ff4a77fe640 1 -- 172.21.15.3:0/3946637122 learned_addr learned my addr 172.21.15.3:0/3946637122 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:17:55.031 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:55.022+0000 7ff4a7fff640 1 --2- 172.21.15.3:0/3946637122 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4a80ffc40 0x7ff4a8197510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:55.031 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:55.022+0000 7ff4a77fe640 1 -- 172.21.15.3:0/3946637122 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4a80ffc40 msgr2=0x7ff4a8197510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:55.031 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:55.022+0000 7ff4a77fe640 1 --2- 172.21.15.3:0/3946637122 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4a80ffc40 0x7ff4a8197510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:55.031 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:55.022+0000 7ff4a77fe640 1 -- 172.21.15.3:0/3946637122 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4a81980d0 con 0x7ff4a8102cc0 2024-09-21T12:17:55.031 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:55.022+0000 7ff4a7fff640 1 --2- 172.21.15.3:0/3946637122 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4a80ffc40 0x7ff4a8197510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T12:17:55.031 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:55.022+0000 7ff4a77fe640 1 --2- 172.21.15.3:0/3946637122 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff4a8102cc0 0x7ff4a8197a50 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff49c00b420 tx=0x7ff49c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:55.032 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:55.022+0000 7ff4a57fa640 1 -- 172.21.15.3:0/3946637122 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff49c011630 con 0x7ff4a8102cc0 2024-09-21T12:17:55.032 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:55.022+0000 7ff4ae9f9640 1 -- 172.21.15.3:0/3946637122 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4a819cb10 con 0x7ff4a8102cc0 2024-09-21T12:17:55.032 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:55.022+0000 7ff4a57fa640 1 -- 172.21.15.3:0/3946637122 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff49c016070 con 0x7ff4a8102cc0 2024-09-21T12:17:55.032 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:55.022+0000 7ff4a57fa640 1 -- 172.21.15.3:0/3946637122 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff49c010d40 con 0x7ff4a8102cc0 2024-09-21T12:17:55.032 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:55.022+0000 7ff4ae9f9640 1 -- 172.21.15.3:0/3946637122 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4a819d120 con 0x7ff4a8102cc0 2024-09-21T12:17:55.032 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:55.023+0000 7ff4ae9f9640 1 -- 172.21.15.3:0/3946637122 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff4a8100040 con 0x7ff4a8102cc0 2024-09-21T12:17:55.032 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:55.024+0000 7ff4a57fa640 1 -- 172.21.15.3:0/3946637122 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 19) ==== 92549+0+0 (secure 0 0 0) 0x7ff49c01b460 con 0x7ff4a8102cc0 2024-09-21T12:17:55.032 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:55.024+0000 7ff4a57fa640 1 --2- 172.21.15.3:0/3946637122 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7ff49006e2b0 0x7ff490070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:55.032 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:55.024+0000 7ff4a57fa640 1 -- 172.21.15.3:0/3946637122 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5554+0+0 (secure 0 0 0) 0x7ff49c08dad0 con 0x7ff4a8102cc0 2024-09-21T12:17:55.032 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:55.024+0000 7ff4a7fff640 1 --2- 172.21.15.3:0/3946637122 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7ff49006e2b0 0x7ff490070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:55.033 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:55.025+0000 7ff4a7fff640 1 --2- 172.21.15.3:0/3946637122 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7ff49006e2b0 0x7ff490070770 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff4980096c0 tx=0x7ff498009650 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:55.033 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:55.029+0000 7ff4a57fa640 1 -- 172.21.15.3:0/3946637122 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff49c05b3d0 con 0x7ff4a8102cc0 2024-09-21T12:17:55.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:55.280+0000 7ff4ae9f9640 1 -- 172.21.15.3:0/3946637122 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) -- 0x7ff4a819dad0 con 0x7ff4a8102cc0 2024-09-21T12:17:55.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:55.280+0000 7ff4a57fa640 1 -- 172.21.15.3:0/3946637122 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v13) ==== 78+0+98 (secure 0 0 0) 0x7ff49c05f080 con 0x7ff4a8102cc0 2024-09-21T12:17:55.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:55.284+0000 7ff4ae9f9640 1 -- 172.21.15.3:0/3946637122 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7ff49006e2b0 msgr2=0x7ff490070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:55.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:55.284+0000 7ff4ae9f9640 1 --2- 172.21.15.3:0/3946637122 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7ff49006e2b0 0x7ff490070770 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff4980096c0 tx=0x7ff498009650 comp rx=0 tx=0).stop 2024-09-21T12:17:55.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:55.284+0000 7ff4ae9f9640 1 -- 172.21.15.3:0/3946637122 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff4a8102cc0 msgr2=0x7ff4a8197a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:55.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:55.284+0000 7ff4ae9f9640 1 --2- 172.21.15.3:0/3946637122 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff4a8102cc0 0x7ff4a8197a50 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7ff49c00b420 tx=0x7ff49c00b8e0 comp rx=0 tx=0).stop 2024-09-21T12:17:55.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:55.284+0000 7ff4ae9f9640 1 -- 172.21.15.3:0/3946637122 shutdown_connections 2024-09-21T12:17:55.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:55.284+0000 7ff4ae9f9640 1 --2- 172.21.15.3:0/3946637122 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7ff49006e2b0 0x7ff490070770 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:55.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:55.284+0000 7ff4ae9f9640 1 --2- 172.21.15.3:0/3946637122 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff4a8102cc0 0x7ff4a8197a50 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:55.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:55.284+0000 7ff4ae9f9640 1 --2- 172.21.15.3:0/3946637122 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff4a80ffc40 0x7ff4a8197510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:55.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:55.285+0000 7ff4ae9f9640 1 -- 172.21.15.3:0/3946637122 >> 172.21.15.3:0/3946637122 conn(0x7ff4a80fb770 msgr2=0x7ff4a80fd9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:55.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:55.285+0000 7ff4ae9f9640 1 -- 172.21.15.3:0/3946637122 shutdown_connections 2024-09-21T12:17:55.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:55.285+0000 7ff4ae9f9640 1 -- 172.21.15.3:0/3946637122 wait complete. 2024-09-21T12:17:55.299 INFO:teuthology.orchestra.run.smithi003.stdout:true 2024-09-21T12:17:56.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:55 smithi192 ceph-mon[35641]: pgmap v188: 65 pgs: 65 active+clean; 579 KiB data, 167 MiB used, 536 GiB / 536 GiB avail; 409 B/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-21T12:17:56.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:55 smithi192 ceph-mon[35641]: mds.? [v2:172.21.15.3:6828/3710817325,v1:172.21.15.3:6829/3710817325] up:rejoin 2024-09-21T12:17:56.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:55 smithi192 ceph-mon[35641]: mds.? [v2:172.21.15.192:6826/318800854,v1:172.21.15.192:6827/318800854] up:standby 2024-09-21T12:17:56.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:55 smithi192 ceph-mon[35641]: fsmap cephfs:1/1 {0=cephfs.smithi003.gfkngj=up:rejoin} 3 up:standby 2024-09-21T12:17:56.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:55 smithi192 ceph-mon[35641]: daemon mds.cephfs.smithi003.gfkngj is now active in filesystem cephfs as rank 0 2024-09-21T12:17:56.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:55 smithi192 ceph-mon[35641]: from='client.? 172.21.15.3:0/3946637122' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-09-21T12:17:56.052 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:55 smithi003 ceph-mon[28057]: pgmap v188: 65 pgs: 65 active+clean; 579 KiB data, 167 MiB used, 536 GiB / 536 GiB avail; 409 B/s rd, 1.2 KiB/s wr, 2 op/s 2024-09-21T12:17:56.052 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:55 smithi003 ceph-mon[28057]: mds.? [v2:172.21.15.3:6828/3710817325,v1:172.21.15.3:6829/3710817325] up:rejoin 2024-09-21T12:17:56.052 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:55 smithi003 ceph-mon[28057]: mds.? [v2:172.21.15.192:6826/318800854,v1:172.21.15.192:6827/318800854] up:standby 2024-09-21T12:17:56.052 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:55 smithi003 ceph-mon[28057]: fsmap cephfs:1/1 {0=cephfs.smithi003.gfkngj=up:rejoin} 3 up:standby 2024-09-21T12:17:56.052 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:55 smithi003 ceph-mon[28057]: daemon mds.cephfs.smithi003.gfkngj is now active in filesystem cephfs as rank 0 2024-09-21T12:17:56.052 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:55 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/3946637122' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-09-21T12:17:56.898 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:56 smithi003 ceph-mon[28057]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T12:17:56.898 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:56 smithi003 ceph-mon[28057]: mds.? [v2:172.21.15.3:6828/3710817325,v1:172.21.15.3:6829/3710817325] up:active 2024-09-21T12:17:56.898 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:56 smithi003 ceph-mon[28057]: fsmap cephfs:1 {0=cephfs.smithi003.gfkngj=up:active} 3 up:standby 2024-09-21T12:17:56.930 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-09-21T12:17:56.943 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T12:17:57.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:56 smithi192 ceph-mon[35641]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T12:17:57.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:56 smithi192 ceph-mon[35641]: mds.? [v2:172.21.15.3:6828/3710817325,v1:172.21.15.3:6829/3710817325] up:active 2024-09-21T12:17:57.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:56 smithi192 ceph-mon[35641]: fsmap cephfs:1 {0=cephfs.smithi003.gfkngj=up:active} 3 up:standby 2024-09-21T12:17:57.235 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:17:57.768 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:57.751+0000 7fd182c18640 1 -- 172.21.15.3:0/692624323 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd17c1067f0 msgr2=0x7fd17c106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:57.769 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:57.751+0000 7fd182c18640 1 --2- 172.21.15.3:0/692624323 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd17c1067f0 0x7fd17c106bd0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fd16c009880 tx=0x7fd16c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:17:57.769 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:57.751+0000 7fd182c18640 1 -- 172.21.15.3:0/692624323 shutdown_connections 2024-09-21T12:17:57.769 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:57.751+0000 7fd182c18640 1 --2- 172.21.15.3:0/692624323 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd17c1007f0 0x7fd17c100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:57.769 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:57.751+0000 7fd182c18640 1 --2- 172.21.15.3:0/692624323 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd17c1067f0 0x7fd17c106bd0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:57.769 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:57.751+0000 7fd182c18640 1 -- 172.21.15.3:0/692624323 >> 172.21.15.3:0/692624323 conn(0x7fd17c0fc550 msgr2=0x7fd17c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:57.769 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:57.751+0000 7fd182c18640 1 -- 172.21.15.3:0/692624323 shutdown_connections 2024-09-21T12:17:57.769 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:57.751+0000 7fd182c18640 1 -- 172.21.15.3:0/692624323 wait complete. 2024-09-21T12:17:57.769 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:57.751+0000 7fd182c18640 1 Processor -- start 2024-09-21T12:17:57.769 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:57.752+0000 7fd182c18640 1 -- start start 2024-09-21T12:17:57.769 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:57.752+0000 7fd182c18640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd17c1007f0 0x7fd17c196600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:57.769 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:57.752+0000 7fd182c18640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd17c1067f0 0x7fd17c196b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:57.769 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:57.752+0000 7fd182c18640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fd17c10dcc0 con 0x7fd17c1067f0 2024-09-21T12:17:57.769 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:57.752+0000 7fd182c18640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd17c10db40 con 0x7fd17c1007f0 2024-09-21T12:17:57.770 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:57.752+0000 7fd17bfff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd17c1067f0 0x7fd17c196b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:57.770 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:57.752+0000 7fd17bfff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd17c1067f0 0x7fd17c196b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35594/0 (socket says 172.21.15.3:35594) 2024-09-21T12:17:57.770 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:57.752+0000 7fd17bfff640 1 -- 172.21.15.3:0/2066964088 learned_addr learned my addr 172.21.15.3:0/2066964088 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:17:57.770 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:57.752+0000 7fd1809b4640 1 --2- 172.21.15.3:0/2066964088 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd17c1007f0 0x7fd17c196600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:57.770 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:57.752+0000 7fd17bfff640 1 -- 172.21.15.3:0/2066964088 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd17c1007f0 msgr2=0x7fd17c196600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:57.770 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:57.752+0000 7fd17bfff640 1 --2- 172.21.15.3:0/2066964088 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd17c1007f0 0x7fd17c196600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:57.770 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:57.752+0000 7fd17bfff640 1 -- 172.21.15.3:0/2066964088 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd17c197080 con 0x7fd17c1067f0 2024-09-21T12:17:57.770 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:57.752+0000 7fd17bfff640 1 --2- 172.21.15.3:0/2066964088 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd17c1067f0 0x7fd17c196b40 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fd17000d6f0 tx=0x7fd17000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:57.770 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:57.753+0000 7fd179ffb640 1 -- 172.21.15.3:0/2066964088 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd170017070 con 0x7fd17c1067f0 2024-09-21T12:17:57.770 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:57.753+0000 7fd179ffb640 1 -- 172.21.15.3:0/2066964088 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd17000de00 con 0x7fd17c1067f0 2024-09-21T12:17:57.770 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:57.753+0000 7fd182c18640 1 -- 172.21.15.3:0/2066964088 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd17c197370 con 0x7fd17c1067f0 2024-09-21T12:17:57.770 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:57.753+0000 7fd179ffb640 1 -- 172.21.15.3:0/2066964088 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd170004bb0 con 0x7fd17c1067f0 2024-09-21T12:17:57.770 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:57.753+0000 7fd182c18640 1 -- 172.21.15.3:0/2066964088 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd17c1a3e40 con 0x7fd17c1067f0 2024-09-21T12:17:57.770 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:57.754+0000 7fd182c18640 1 -- 172.21.15.3:0/2066964088 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd17c101f30 con 0x7fd17c1067f0 2024-09-21T12:17:57.771 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:57.755+0000 7fd179ffb640 1 -- 172.21.15.3:0/2066964088 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 19) ==== 92549+0+0 (secure 0 0 0) 0x7fd170004e60 con 0x7fd17c1067f0 2024-09-21T12:17:57.771 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:57.755+0000 7fd179ffb640 1 --2- 172.21.15.3:0/2066964088 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fd16406e2b0 0x7fd164070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:57.771 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:57.755+0000 7fd179ffb640 1 -- 172.21.15.3:0/2066964088 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5554+0+0 (secure 0 0 0) 0x7fd17008dd80 con 0x7fd17c1067f0 2024-09-21T12:17:57.771 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:57.755+0000 7fd1809b4640 1 --2- 172.21.15.3:0/2066964088 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fd16406e2b0 0x7fd164070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:57.771 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:57.756+0000 7fd1809b4640 1 --2- 172.21.15.3:0/2066964088 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fd16406e2b0 0x7fd164070770 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd16c0096c0 tx=0x7fd16c031400 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:57.771 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:57.760+0000 7fd179ffb640 1 -- 172.21.15.3:0/2066964088 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd17005f330 con 0x7fd17c1067f0 2024-09-21T12:17:57.978 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:57.976+0000 7fd182c18640 1 -- 172.21.15.3:0/2066964088 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd17c108dc0 con 0x7fd17c1067f0 2024-09-21T12:17:57.978 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:57.977+0000 7fd179ffb640 1 -- 172.21.15.3:0/2066964088 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5307 (secure 0 0 0) 0x7fd170063b60 con 0x7fd17c1067f0 2024-09-21T12:17:57.979 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:17:57.979 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":14,"btime":"2024-09-21T12:17:55:592931+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24319,"name":"cephfs.smithi192.ywqqxe","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.192:6825/4055220871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":4055220871},{"type":"v1","addr":"172.21.15.192:6825","nonce":4055220871}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24337,"name":"cephfs.smithi192.ktdqns","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.192:6827/318800854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":318800854},{"type":"v1","addr":"172.21.15.192:6827","nonce":318800854}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":24345,"name":"cephfs.smithi003.ebjgyl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6827/55902996","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":55902996},{"type":"v1","addr":"172.21.15.3:6827","nonce":55902996}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T12:17:38.260099+0000","modified":"2024-09-21T12:17:55.592927+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":46,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":14564},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14564":{"gid":14564,"name":"cephfs.smithi003.gfkngj","rank":0,"incarnation":11,"state":"up:active","state_seq":5,"addr":"172.21.15.3:6829/3710817325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":3710817325},{"type":"v1","addr":"172.21.15.3:6829","nonce":3710817325}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14564,"qdb_cluster":[14564]},"id":1}]} 2024-09-21T12:17:57.979 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 14 2024-09-21T12:17:57.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:57.980+0000 7fd182c18640 1 -- 172.21.15.3:0/2066964088 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fd16406e2b0 msgr2=0x7fd164070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:57.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:57.980+0000 7fd182c18640 1 --2- 172.21.15.3:0/2066964088 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fd16406e2b0 0x7fd164070770 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fd16c0096c0 tx=0x7fd16c031400 comp rx=0 tx=0).stop 2024-09-21T12:17:57.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:57.980+0000 7fd182c18640 1 -- 172.21.15.3:0/2066964088 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd17c1067f0 msgr2=0x7fd17c196b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:57.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:57.980+0000 7fd182c18640 1 --2- 172.21.15.3:0/2066964088 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd17c1067f0 0x7fd17c196b40 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fd17000d6f0 tx=0x7fd17000dbb0 comp rx=0 tx=0).stop 2024-09-21T12:17:57.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:57.980+0000 7fd182c18640 1 -- 172.21.15.3:0/2066964088 shutdown_connections 2024-09-21T12:17:57.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:57.980+0000 7fd182c18640 1 --2- 172.21.15.3:0/2066964088 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fd16406e2b0 0x7fd164070770 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:57.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:57.980+0000 7fd182c18640 1 --2- 172.21.15.3:0/2066964088 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd17c1067f0 0x7fd17c196b40 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:57.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:57.980+0000 7fd182c18640 1 --2- 172.21.15.3:0/2066964088 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd17c1007f0 0x7fd17c196600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:57.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:57.980+0000 7fd182c18640 1 -- 172.21.15.3:0/2066964088 >> 172.21.15.3:0/2066964088 conn(0x7fd17c0fc550 msgr2=0x7fd17c0fcef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:57.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:57.980+0000 7fd182c18640 1 -- 172.21.15.3:0/2066964088 shutdown_connections 2024-09-21T12:17:57.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:57.980+0000 7fd182c18640 1 -- 172.21.15.3:0/2066964088 wait complete. 2024-09-21T12:17:58.273 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:58 smithi003 ceph-mon[28057]: pgmap v189: 65 pgs: 65 active+clean; 579 KiB data, 167 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 819 B/s wr, 2 op/s 2024-09-21T12:17:58.273 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:58 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:17:58.273 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:58 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:17:58.273 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:58 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:17:58.273 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:58 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:17:58.273 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:58 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:17:58.273 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:58 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:17:58.273 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:17:58 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/2066964088' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-21T12:17:58.443 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:58 smithi192 ceph-mon[35641]: pgmap v189: 65 pgs: 65 active+clean; 579 KiB data, 167 MiB used, 536 GiB / 536 GiB avail; 1.6 KiB/s rd, 819 B/s wr, 2 op/s 2024-09-21T12:17:58.443 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:58 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:17:58.443 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:58 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:17:58.443 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:58 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:17:58.443 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:58 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:17:58.443 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:58 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:17:58.443 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:58 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:17:58.443 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:17:58 smithi192 ceph-mon[35641]: from='client.? 172.21.15.3:0/2066964088' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-21T12:17:58.533 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 14, 'max_mds': 1, 'flags': 18} 2024-09-21T12:17:58.581 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-21T12:17:58.617 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-21T12:17:58.617 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.1': {}} 2024-09-21T12:17:58.617 INFO:tasks.ceph_fuse:client.0 config is {} 2024-09-21T12:17:58.618 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T12:17:58.618 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T12:17:58.618 INFO:tasks.ceph_fuse:client.1 config is {} 2024-09-21T12:17:58.618 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-21T12:17:58.618 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-21T12:17:58.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T12:17:58.618 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2024-09-21T12:17:58.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T12:17:58.635 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link delete ceph-brx 2024-09-21T12:17:58.703 INFO:teuthology.orchestra.run.smithi192.stderr:Cannot find device "ceph-brx" 2024-09-21T12:17:58.704 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T12:17:58.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T12:17:58.705 DEBUG:teuthology.orchestra.run.smithi003:> ip netns list 2024-09-21T12:17:58.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T12:17:58.721 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip link delete ceph-brx 2024-09-21T12:17:58.790 INFO:teuthology.orchestra.run.smithi003.stderr:Cannot find device "ceph-brx" 2024-09-21T12:17:58.791 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T12:17:58.792 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-21T12:17:58.792 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-21T12:17:58.792 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph fs ls 2024-09-21T12:17:59.430 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:17:59.904 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:59.893+0000 7f5ffa447640 1 -- 172.21.15.3:0/1534945225 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5ff41007f0 msgr2=0x7f5ff4100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:59.904 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:59.893+0000 7f5ffa447640 1 --2- 172.21.15.3:0/1534945225 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5ff41007f0 0x7f5ff4100c50 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f5fdc009880 tx=0x7f5fdc02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:17:59.904 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:59.893+0000 7f5ffa447640 1 -- 172.21.15.3:0/1534945225 shutdown_connections 2024-09-21T12:17:59.904 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:59.893+0000 7f5ffa447640 1 --2- 172.21.15.3:0/1534945225 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5ff41007f0 0x7f5ff4100c50 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:59.905 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:59.893+0000 7f5ffa447640 1 --2- 172.21.15.3:0/1534945225 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ff41067f0 0x7f5ff4106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:59.905 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:59.893+0000 7f5ffa447640 1 -- 172.21.15.3:0/1534945225 >> 172.21.15.3:0/1534945225 conn(0x7f5ff40fc550 msgr2=0x7f5ff40fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:17:59.905 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:59.893+0000 7f5ffa447640 1 -- 172.21.15.3:0/1534945225 shutdown_connections 2024-09-21T12:17:59.905 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:59.893+0000 7f5ffa447640 1 -- 172.21.15.3:0/1534945225 wait complete. 2024-09-21T12:17:59.905 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:59.894+0000 7f5ffa447640 1 Processor -- start 2024-09-21T12:17:59.905 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:59.894+0000 7f5ffa447640 1 -- start start 2024-09-21T12:17:59.905 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:59.894+0000 7f5ffa447640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5ff41007f0 0x7f5ff4196560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:59.905 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:59.894+0000 7f5ffa447640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ff41067f0 0x7f5ff4196aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:59.905 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:59.894+0000 7f5ffa447640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f5ff410dca0 con 0x7f5ff41007f0 2024-09-21T12:17:59.905 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:59.894+0000 7f5ffa447640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5ff410db20 con 0x7f5ff41067f0 2024-09-21T12:17:59.905 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:59.894+0000 7f5ff3fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5ff41007f0 0x7f5ff4196560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:59.905 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:59.894+0000 7f5ff3fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5ff41007f0 0x7f5ff4196560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35608/0 (socket says 172.21.15.3:35608) 2024-09-21T12:17:59.905 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:59.894+0000 7f5ff3fff640 1 -- 172.21.15.3:0/3815309924 learned_addr learned my addr 172.21.15.3:0/3815309924 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:17:59.905 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:59.894+0000 7f5febfff640 1 --2- 172.21.15.3:0/3815309924 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ff41067f0 0x7f5ff4196aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:59.906 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:59.894+0000 7f5ff3fff640 1 -- 172.21.15.3:0/3815309924 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ff41067f0 msgr2=0x7f5ff4196aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:17:59.906 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:59.894+0000 7f5ff3fff640 1 --2- 172.21.15.3:0/3815309924 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ff41067f0 0x7f5ff4196aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:17:59.906 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:59.894+0000 7f5ff3fff640 1 -- 172.21.15.3:0/3815309924 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ff4196fe0 con 0x7f5ff41007f0 2024-09-21T12:17:59.906 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:59.894+0000 7f5febfff640 1 --2- 172.21.15.3:0/3815309924 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ff41067f0 0x7f5ff4196aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:17:59.906 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:59.895+0000 7f5ff3fff640 1 --2- 172.21.15.3:0/3815309924 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5ff41007f0 0x7f5ff4196560 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f5fe400d8d0 tx=0x7f5fe400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:59.906 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:59.895+0000 7f5ff1ffb640 1 -- 172.21.15.3:0/3815309924 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5fe4017030 con 0x7f5ff41007f0 2024-09-21T12:17:59.906 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:59.895+0000 7f5ffa447640 1 -- 172.21.15.3:0/3815309924 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ff41972d0 con 0x7f5ff41007f0 2024-09-21T12:17:59.906 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:59.895+0000 7f5ff1ffb640 1 -- 172.21.15.3:0/3815309924 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5fe4004020 con 0x7f5ff41007f0 2024-09-21T12:17:59.906 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:59.895+0000 7f5ff1ffb640 1 -- 172.21.15.3:0/3815309924 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5fe40047a0 con 0x7f5ff41007f0 2024-09-21T12:17:59.906 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:59.895+0000 7f5ffa447640 1 -- 172.21.15.3:0/3815309924 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ff41a3df0 con 0x7f5ff41007f0 2024-09-21T12:17:59.906 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:59.896+0000 7f5ffa447640 1 -- 172.21.15.3:0/3815309924 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ff4101f30 con 0x7f5ff41007f0 2024-09-21T12:17:59.906 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:59.897+0000 7f5ff1ffb640 1 -- 172.21.15.3:0/3815309924 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 19) ==== 92549+0+0 (secure 0 0 0) 0x7f5fe40041d0 con 0x7f5ff41007f0 2024-09-21T12:17:59.906 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:59.897+0000 7f5ff1ffb640 1 --2- 172.21.15.3:0/3815309924 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f5fe006e2b0 0x7f5fe0070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:17:59.906 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:59.897+0000 7f5ff1ffb640 1 -- 172.21.15.3:0/3815309924 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5554+0+0 (secure 0 0 0) 0x7f5fe4018070 con 0x7f5ff41007f0 2024-09-21T12:17:59.907 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:59.897+0000 7f5febfff640 1 --2- 172.21.15.3:0/3815309924 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f5fe006e2b0 0x7f5fe0070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:17:59.907 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:59.898+0000 7f5febfff640 1 --2- 172.21.15.3:0/3815309924 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f5fe006e2b0 0x7f5fe0070770 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5ff41986c0 tx=0x7f5fdc031400 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:17:59.907 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:17:59.901+0000 7f5ff1ffb640 1 -- 172.21.15.3:0/3815309924 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5fe405b8d0 con 0x7f5ff41007f0 2024-09-21T12:18:00.135 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:00.133+0000 7f5ffa447640 1 -- 172.21.15.3:0/3815309924 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f5ff41a4150 con 0x7f5ff41007f0 2024-09-21T12:18:00.135 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:00.133+0000 7f5ff1ffb640 1 -- 172.21.15.3:0/3815309924 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) ==== 53+0+83 (secure 0 0 0) 0x7f5fe405f580 con 0x7f5ff41007f0 2024-09-21T12:18:00.135 INFO:teuthology.orchestra.run.smithi003.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-09-21T12:18:00.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:00.136+0000 7f5ffa447640 1 -- 172.21.15.3:0/3815309924 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f5fe006e2b0 msgr2=0x7f5fe0070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:18:00.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:00.136+0000 7f5ffa447640 1 --2- 172.21.15.3:0/3815309924 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f5fe006e2b0 0x7f5fe0070770 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5ff41986c0 tx=0x7f5fdc031400 comp rx=0 tx=0).stop 2024-09-21T12:18:00.137 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:00.136+0000 7f5ffa447640 1 -- 172.21.15.3:0/3815309924 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5ff41007f0 msgr2=0x7f5ff4196560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:18:00.138 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:00.136+0000 7f5ffa447640 1 --2- 172.21.15.3:0/3815309924 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5ff41007f0 0x7f5ff4196560 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f5fe400d8d0 tx=0x7f5fe400dd90 comp rx=0 tx=0).stop 2024-09-21T12:18:00.138 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:00.136+0000 7f5ffa447640 1 -- 172.21.15.3:0/3815309924 shutdown_connections 2024-09-21T12:18:00.138 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:00.136+0000 7f5ffa447640 1 --2- 172.21.15.3:0/3815309924 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f5fe006e2b0 0x7f5fe0070770 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:00.138 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:00.136+0000 7f5ffa447640 1 --2- 172.21.15.3:0/3815309924 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ff41067f0 0x7f5ff4196aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:00.138 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:00.136+0000 7f5ffa447640 1 --2- 172.21.15.3:0/3815309924 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5ff41007f0 0x7f5ff4196560 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:00.138 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:00.136+0000 7f5ffa447640 1 -- 172.21.15.3:0/3815309924 >> 172.21.15.3:0/3815309924 conn(0x7f5ff40fc550 msgr2=0x7f5ff40fcd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:18:00.138 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:00.136+0000 7f5ffa447640 1 -- 172.21.15.3:0/3815309924 shutdown_connections 2024-09-21T12:18:00.138 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:00.136+0000 7f5ffa447640 1 -- 172.21.15.3:0/3815309924 wait complete. 2024-09-21T12:18:00.345 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:18:00 smithi003 ceph-mon[28057]: pgmap v190: 65 pgs: 65 active+clean; 579 KiB data, 167 MiB used, 536 GiB / 536 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-21T12:18:00.345 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:18:00 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:18:00.345 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:18:00 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:18:00.345 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:18:00 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/3815309924' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-21T12:18:00.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:18:00 smithi192 ceph-mon[35641]: pgmap v190: 65 pgs: 65 active+clean; 579 KiB data, 167 MiB used, 536 GiB / 536 GiB avail; 5.8 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-21T12:18:00.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:18:00 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:18:00.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:18:00 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:18:00.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:18:00 smithi192 ceph-mon[35641]: from='client.? 172.21.15.3:0/3815309924' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-21T12:18:01.310 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-21T12:18:01.310 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T12:18:01.310 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi003.front.sepia.ceph.com 2024-09-21T12:18:01.310 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-21T12:18:01.310 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-21T12:18:01.310 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-21T12:18:01.310 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T12:18:01.310 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T12:18:01.310 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-21T12:18:01.310 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T12:18:01.311 DEBUG:teuthology.orchestra.run.smithi003:> ip addr 2024-09-21T12:18:01.328 INFO:teuthology.orchestra.run.smithi003.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T12:18:01.329 INFO:teuthology.orchestra.run.smithi003.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T12:18:01.329 INFO:teuthology.orchestra.run.smithi003.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T12:18:01.329 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2024-09-21T12:18:01.329 INFO:teuthology.orchestra.run.smithi003.stdout: inet6 ::1/128 scope host 2024-09-21T12:18:01.329 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2024-09-21T12:18:01.329 INFO:teuthology.orchestra.run.smithi003.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T12:18:01.329 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether 0c:c4:7a:6b:fd:ac brd ff:ff:ff:ff:ff:ff 2024-09-21T12:18:01.329 INFO:teuthology.orchestra.run.smithi003.stdout: altname enp7s0f0 2024-09-21T12:18:01.329 INFO:teuthology.orchestra.run.smithi003.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T12:18:01.329 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether 0c:c4:7a:6b:fd:ad brd ff:ff:ff:ff:ff:ff 2024-09-21T12:18:01.329 INFO:teuthology.orchestra.run.smithi003.stdout: altname enp7s0f1 2024-09-21T12:18:01.329 INFO:teuthology.orchestra.run.smithi003.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T12:18:01.329 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether 0c:c4:7a:bd:15:dc brd ff:ff:ff:ff:ff:ff 2024-09-21T12:18:01.330 INFO:teuthology.orchestra.run.smithi003.stdout: altname enp1s0f0 2024-09-21T12:18:01.330 INFO:teuthology.orchestra.run.smithi003.stdout: inet 172.21.15.3/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-09-21T12:18:01.330 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft 42339sec preferred_lft 42339sec 2024-09-21T12:18:01.330 INFO:teuthology.orchestra.run.smithi003.stdout: inet6 fe80::ec4:7aff:febd:15dc/64 scope link 2024-09-21T12:18:01.330 INFO:teuthology.orchestra.run.smithi003.stdout: valid_lft forever preferred_lft forever 2024-09-21T12:18:01.330 INFO:teuthology.orchestra.run.smithi003.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T12:18:01.330 INFO:teuthology.orchestra.run.smithi003.stdout: link/ether 0c:c4:7a:bd:15:dd brd ff:ff:ff:ff:ff:ff 2024-09-21T12:18:01.330 INFO:teuthology.orchestra.run.smithi003.stdout: altname enp1s0f1 2024-09-21T12:18:01.330 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-21T12:18:01.331 DEBUG:teuthology.orchestra.run.smithi003:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T12:18:01.331 DEBUG:teuthology.orchestra.run.smithi003:> set -e 2024-09-21T12:18:01.331 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip link add name ceph-brx type bridge 2024-09-21T12:18:01.331 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip addr flush dev ceph-brx 2024-09-21T12:18:01.331 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip link set ceph-brx up 2024-09-21T12:18:01.331 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-21T12:18:01.331 DEBUG:teuthology.orchestra.run.smithi003:> ') 2024-09-21T12:18:01.425 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T12:18:01.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T12:18:01.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T12:18:01.602 DEBUG:teuthology.orchestra.run.smithi003:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T12:18:01.629 INFO:teuthology.orchestra.run.smithi003.stdout:1 2024-09-21T12:18:01.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T12:18:01.631 DEBUG:teuthology.orchestra.run.smithi003:> route 2024-09-21T12:18:01.750 INFO:teuthology.orchestra.run.smithi003.stdout:Kernel IP routing table 2024-09-21T12:18:01.750 INFO:teuthology.orchestra.run.smithi003.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T12:18:01.750 INFO:teuthology.orchestra.run.smithi003.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-09-21T12:18:01.751 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-09-21T12:18:01.751 INFO:teuthology.orchestra.run.smithi003.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T12:18:01.751 DEBUG:teuthology.orchestra.run.smithi003:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T12:18:01.751 DEBUG:teuthology.orchestra.run.smithi003:> set -e 2024-09-21T12:18:01.751 DEBUG:teuthology.orchestra.run.smithi003:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-09-21T12:18:01.751 DEBUG:teuthology.orchestra.run.smithi003:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-09-21T12:18:01.751 DEBUG:teuthology.orchestra.run.smithi003:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-09-21T12:18:01.751 DEBUG:teuthology.orchestra.run.smithi003:> ') 2024-09-21T12:18:01.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T12:18:02.210 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T12:18:02.217 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T12:18:02.217 DEBUG:teuthology.orchestra.run.smithi003:> ip netns list 2024-09-21T12:18:02.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T12:18:02.235 DEBUG:teuthology.orchestra.run.smithi003:> ip netns list-id 2024-09-21T12:18:02.292 DEBUG:teuthology.orchestra.run.smithi003:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T12:18:02.292 DEBUG:teuthology.orchestra.run.smithi003:> set -e 2024-09-21T12:18:02.292 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T12:18:02.292 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-21T12:18:02.292 DEBUG:teuthology.orchestra.run.smithi003:> ') 2024-09-21T12:18:02.381 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T12:18:02.406 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T12:18:02.412 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-21T12:18:02.412 DEBUG:teuthology.orchestra.run.smithi003:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T12:18:02.412 DEBUG:teuthology.orchestra.run.smithi003:> set -e 2024-09-21T12:18:02.413 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-21T12:18:02.413 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-21T12:18:02.413 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-21T12:18:02.413 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-21T12:18:02.413 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-21T12:18:02.413 DEBUG:teuthology.orchestra.run.smithi003:> ') 2024-09-21T12:18:02.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T12:18:02.471 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:18:02 smithi003 ceph-mon[28057]: pgmap v191: 65 pgs: 65 active+clean; 579 KiB data, 167 MiB used, 536 GiB / 536 GiB avail; 8.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T12:18:02.471 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:18:02 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:18:02.471 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:18:02 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:18:02.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:18:02 smithi192 ceph-mon[35641]: pgmap v191: 65 pgs: 65 active+clean; 579 KiB data, 167 MiB used, 536 GiB / 536 GiB avail; 8.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T12:18:02.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:18:02 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:18:02.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:18:02 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:18:02.568 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T12:18:02.575 DEBUG:teuthology.orchestra.run.smithi003:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T12:18:02.575 DEBUG:teuthology.orchestra.run.smithi003:> set -e 2024-09-21T12:18:02.575 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip link set brx.0 up 2024-09-21T12:18:02.575 DEBUG:teuthology.orchestra.run.smithi003:> sudo ip link set dev brx.0 master ceph-brx 2024-09-21T12:18:02.575 DEBUG:teuthology.orchestra.run.smithi003:> ') 2024-09-21T12:18:02.627 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T12:18:02.658 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T12:18:02.664 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-21T12:18:02.664 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T12:18:02.664 DEBUG:teuthology.orchestra.run.smithi003:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-21T12:18:02.680 INFO:teuthology.orchestra.run.smithi003.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-21T12:18:02.681 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T12:18:02.681 DEBUG:teuthology.orchestra.run.smithi003:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-21T12:18:02.737 DEBUG:teuthology.orchestra.run.smithi003:> sudo modprobe fuse 2024-09-21T12:18:02.804 DEBUG:teuthology.orchestra.run.smithi003:> cat /proc/self/mounts | awk '{print $2}' 2024-09-21T12:18:02.861 INFO:teuthology.orchestra.run.smithi003.stdout:/proc 2024-09-21T12:18:02.861 INFO:teuthology.orchestra.run.smithi003.stdout:/sys 2024-09-21T12:18:02.861 INFO:teuthology.orchestra.run.smithi003.stdout:/dev 2024-09-21T12:18:02.861 INFO:teuthology.orchestra.run.smithi003.stdout:/sys/kernel/security 2024-09-21T12:18:02.861 INFO:teuthology.orchestra.run.smithi003.stdout:/dev/shm 2024-09-21T12:18:02.861 INFO:teuthology.orchestra.run.smithi003.stdout:/dev/pts 2024-09-21T12:18:02.862 INFO:teuthology.orchestra.run.smithi003.stdout:/run 2024-09-21T12:18:02.862 INFO:teuthology.orchestra.run.smithi003.stdout:/sys/fs/cgroup 2024-09-21T12:18:02.862 INFO:teuthology.orchestra.run.smithi003.stdout:/sys/fs/pstore 2024-09-21T12:18:02.862 INFO:teuthology.orchestra.run.smithi003.stdout:/sys/fs/bpf 2024-09-21T12:18:02.862 INFO:teuthology.orchestra.run.smithi003.stdout:/ 2024-09-21T12:18:02.862 INFO:teuthology.orchestra.run.smithi003.stdout:/sys/fs/selinux 2024-09-21T12:18:02.862 INFO:teuthology.orchestra.run.smithi003.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T12:18:02.862 INFO:teuthology.orchestra.run.smithi003.stdout:/dev/mqueue 2024-09-21T12:18:02.862 INFO:teuthology.orchestra.run.smithi003.stdout:/dev/hugepages 2024-09-21T12:18:02.862 INFO:teuthology.orchestra.run.smithi003.stdout:/sys/kernel/debug 2024-09-21T12:18:02.862 INFO:teuthology.orchestra.run.smithi003.stdout:/sys/kernel/tracing 2024-09-21T12:18:02.862 INFO:teuthology.orchestra.run.smithi003.stdout:/sys/fs/fuse/connections 2024-09-21T12:18:02.862 INFO:teuthology.orchestra.run.smithi003.stdout:/sys/kernel/config 2024-09-21T12:18:02.863 INFO:teuthology.orchestra.run.smithi003.stdout:/run/credentials/systemd-sysctl.service 2024-09-21T12:18:02.863 INFO:teuthology.orchestra.run.smithi003.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-21T12:18:02.863 INFO:teuthology.orchestra.run.smithi003.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-21T12:18:02.863 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/nfs/rpc_pipefs 2024-09-21T12:18:02.863 INFO:teuthology.orchestra.run.smithi003.stdout:/run/user/1000 2024-09-21T12:18:02.863 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/ceph 2024-09-21T12:18:02.863 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay 2024-09-21T12:18:02.863 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/92043b1b97e0c173cbb32cec064940458e7cf2bf2b11b0af94cfeedec8b3f566/merged 2024-09-21T12:18:02.863 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/6f5ec22692f09b9e5200d7c235f672e10db6d07dd70d2fd434213b6b8a35db4f/merged 2024-09-21T12:18:02.863 INFO:teuthology.orchestra.run.smithi003.stdout:/run/user/0 2024-09-21T12:18:02.863 INFO:teuthology.orchestra.run.smithi003.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T12:18:02.863 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/4d57e5c32a2c7bfd996426ba9d30afb329cf819f35153d854e470531bb835b77/merged 2024-09-21T12:18:02.863 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/6720220f236e5848431f62ab68e3fb998838ccad373d54182e2b705c5bff8e0f/merged 2024-09-21T12:18:02.863 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/105d7e4e21e6fbf9cead15ec2235c333721c28cc5e8420d04472761125af67c1/merged 2024-09-21T12:18:02.864 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/881f193accbf102cf0ef7d5f1090e54ba0f42bbc665046fca3778f5ae0c5fc3d/merged 2024-09-21T12:18:02.864 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/0f5fe60344b4ba4db2a582edac98705ae6cd01b8c0e0fea52e07fc85ee694282/merged 2024-09-21T12:18:02.864 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/c7f38d59c01508b15b6d468d4b7e6263b409bad16b125243b04400c531ec7111/merged 2024-09-21T12:18:02.864 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/770797aa976054dfaa751a00ae864669efab899000ea888e38c5e87c687851c1/merged 2024-09-21T12:18:02.864 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/ba2149cd40ae59c5a65e5ec298e005cd31ddcd03226b9a96d51da43858de6ef5/merged 2024-09-21T12:18:02.864 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/e2b44f5b14b3fe35927c536373d8339e6ec4582b3ea2ad72d4019cd02dc30003/merged 2024-09-21T12:18:02.864 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/df7134d6be0b0919e46ebc938eab4fa587bc70c940444c91bf9d64e2b8dc12c9/merged 2024-09-21T12:18:02.864 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/06be59e4ce09dea1a720106d96311d8d40ca52de800acdee5b536ce658ca2894/merged 2024-09-21T12:18:02.864 INFO:teuthology.orchestra.run.smithi003.stdout:/run/netns 2024-09-21T12:18:02.864 INFO:teuthology.orchestra.run.smithi003.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T12:18:02.864 INFO:teuthology.orchestra.run.smithi003.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T12:18:02.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T12:18:02.865 DEBUG:teuthology.orchestra.run.smithi003:> ls /sys/fs/fuse/connections 2024-09-21T12:18:02.917 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-21T12:18:02.917 DEBUG:teuthology.orchestra.run.smithi003:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-21T12:18:02.960 DEBUG:teuthology.orchestra.run.smithi003:> sudo modprobe fuse 2024-09-21T12:18:02.986 DEBUG:teuthology.orchestra.run.smithi003:> cat /proc/self/mounts | awk '{print $2}' 2024-09-21T12:18:03.044 INFO:teuthology.orchestra.run.smithi003.stdout:/proc 2024-09-21T12:18:03.044 INFO:teuthology.orchestra.run.smithi003.stdout:/sys 2024-09-21T12:18:03.045 INFO:teuthology.orchestra.run.smithi003.stdout:/dev 2024-09-21T12:18:03.045 INFO:teuthology.orchestra.run.smithi003.stdout:/sys/kernel/security 2024-09-21T12:18:03.045 INFO:teuthology.orchestra.run.smithi003.stdout:/dev/shm 2024-09-21T12:18:03.045 INFO:teuthology.orchestra.run.smithi003.stdout:/dev/pts 2024-09-21T12:18:03.045 INFO:teuthology.orchestra.run.smithi003.stdout:/run 2024-09-21T12:18:03.045 INFO:teuthology.orchestra.run.smithi003.stdout:/sys/fs/cgroup 2024-09-21T12:18:03.045 INFO:teuthology.orchestra.run.smithi003.stdout:/sys/fs/pstore 2024-09-21T12:18:03.045 INFO:teuthology.orchestra.run.smithi003.stdout:/sys/fs/bpf 2024-09-21T12:18:03.045 INFO:teuthology.orchestra.run.smithi003.stdout:/ 2024-09-21T12:18:03.045 INFO:teuthology.orchestra.run.smithi003.stdout:/sys/fs/selinux 2024-09-21T12:18:03.045 INFO:teuthology.orchestra.run.smithi003.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T12:18:03.045 INFO:teuthology.orchestra.run.smithi003.stdout:/dev/mqueue 2024-09-21T12:18:03.045 INFO:teuthology.orchestra.run.smithi003.stdout:/dev/hugepages 2024-09-21T12:18:03.046 INFO:teuthology.orchestra.run.smithi003.stdout:/sys/kernel/debug 2024-09-21T12:18:03.046 INFO:teuthology.orchestra.run.smithi003.stdout:/sys/kernel/tracing 2024-09-21T12:18:03.046 INFO:teuthology.orchestra.run.smithi003.stdout:/sys/fs/fuse/connections 2024-09-21T12:18:03.046 INFO:teuthology.orchestra.run.smithi003.stdout:/sys/kernel/config 2024-09-21T12:18:03.046 INFO:teuthology.orchestra.run.smithi003.stdout:/run/credentials/systemd-sysctl.service 2024-09-21T12:18:03.046 INFO:teuthology.orchestra.run.smithi003.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-21T12:18:03.046 INFO:teuthology.orchestra.run.smithi003.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-21T12:18:03.046 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/nfs/rpc_pipefs 2024-09-21T12:18:03.046 INFO:teuthology.orchestra.run.smithi003.stdout:/run/user/1000 2024-09-21T12:18:03.046 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/ceph 2024-09-21T12:18:03.046 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay 2024-09-21T12:18:03.046 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/92043b1b97e0c173cbb32cec064940458e7cf2bf2b11b0af94cfeedec8b3f566/merged 2024-09-21T12:18:03.046 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/6f5ec22692f09b9e5200d7c235f672e10db6d07dd70d2fd434213b6b8a35db4f/merged 2024-09-21T12:18:03.047 INFO:teuthology.orchestra.run.smithi003.stdout:/run/user/0 2024-09-21T12:18:03.047 INFO:teuthology.orchestra.run.smithi003.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T12:18:03.047 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/4d57e5c32a2c7bfd996426ba9d30afb329cf819f35153d854e470531bb835b77/merged 2024-09-21T12:18:03.047 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/6720220f236e5848431f62ab68e3fb998838ccad373d54182e2b705c5bff8e0f/merged 2024-09-21T12:18:03.047 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/105d7e4e21e6fbf9cead15ec2235c333721c28cc5e8420d04472761125af67c1/merged 2024-09-21T12:18:03.047 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/881f193accbf102cf0ef7d5f1090e54ba0f42bbc665046fca3778f5ae0c5fc3d/merged 2024-09-21T12:18:03.047 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/0f5fe60344b4ba4db2a582edac98705ae6cd01b8c0e0fea52e07fc85ee694282/merged 2024-09-21T12:18:03.047 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/c7f38d59c01508b15b6d468d4b7e6263b409bad16b125243b04400c531ec7111/merged 2024-09-21T12:18:03.047 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/770797aa976054dfaa751a00ae864669efab899000ea888e38c5e87c687851c1/merged 2024-09-21T12:18:03.047 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/ba2149cd40ae59c5a65e5ec298e005cd31ddcd03226b9a96d51da43858de6ef5/merged 2024-09-21T12:18:03.047 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/e2b44f5b14b3fe35927c536373d8339e6ec4582b3ea2ad72d4019cd02dc30003/merged 2024-09-21T12:18:03.047 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/df7134d6be0b0919e46ebc938eab4fa587bc70c940444c91bf9d64e2b8dc12c9/merged 2024-09-21T12:18:03.047 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/06be59e4ce09dea1a720106d96311d8d40ca52de800acdee5b536ce658ca2894/merged 2024-09-21T12:18:03.048 INFO:teuthology.orchestra.run.smithi003.stdout:/run/netns 2024-09-21T12:18:03.048 INFO:teuthology.orchestra.run.smithi003.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T12:18:03.048 INFO:teuthology.orchestra.run.smithi003.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T12:18:03.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T12:18:03.049 DEBUG:teuthology.orchestra.run.smithi003:> ls /sys/fs/fuse/connections 2024-09-21T12:18:03.103 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi003.stderr:2024-09-21T12:18:03.102+0000 7f2e74b21480 -1 init, newargv = 0x561a6442e340 newargc=15 2024-09-21T12:18:03.103 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi003.stderr:ceph-fuse[76329]: starting ceph client 2024-09-21T12:18:03.109 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi003.stderr:ceph-fuse[76329]: starting fuse 2024-09-21T12:18:04.210 DEBUG:teuthology.orchestra.run.smithi003:> sudo modprobe fuse 2024-09-21T12:18:04.241 DEBUG:teuthology.orchestra.run.smithi003:> cat /proc/self/mounts | awk '{print $2}' 2024-09-21T12:18:04.298 INFO:teuthology.orchestra.run.smithi003.stdout:/proc 2024-09-21T12:18:04.298 INFO:teuthology.orchestra.run.smithi003.stdout:/sys 2024-09-21T12:18:04.298 INFO:teuthology.orchestra.run.smithi003.stdout:/dev 2024-09-21T12:18:04.299 INFO:teuthology.orchestra.run.smithi003.stdout:/sys/kernel/security 2024-09-21T12:18:04.299 INFO:teuthology.orchestra.run.smithi003.stdout:/dev/shm 2024-09-21T12:18:04.299 INFO:teuthology.orchestra.run.smithi003.stdout:/dev/pts 2024-09-21T12:18:04.299 INFO:teuthology.orchestra.run.smithi003.stdout:/run 2024-09-21T12:18:04.299 INFO:teuthology.orchestra.run.smithi003.stdout:/sys/fs/cgroup 2024-09-21T12:18:04.299 INFO:teuthology.orchestra.run.smithi003.stdout:/sys/fs/pstore 2024-09-21T12:18:04.299 INFO:teuthology.orchestra.run.smithi003.stdout:/sys/fs/bpf 2024-09-21T12:18:04.299 INFO:teuthology.orchestra.run.smithi003.stdout:/ 2024-09-21T12:18:04.299 INFO:teuthology.orchestra.run.smithi003.stdout:/sys/fs/selinux 2024-09-21T12:18:04.299 INFO:teuthology.orchestra.run.smithi003.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T12:18:04.299 INFO:teuthology.orchestra.run.smithi003.stdout:/dev/mqueue 2024-09-21T12:18:04.299 INFO:teuthology.orchestra.run.smithi003.stdout:/dev/hugepages 2024-09-21T12:18:04.299 INFO:teuthology.orchestra.run.smithi003.stdout:/sys/kernel/debug 2024-09-21T12:18:04.299 INFO:teuthology.orchestra.run.smithi003.stdout:/sys/kernel/tracing 2024-09-21T12:18:04.300 INFO:teuthology.orchestra.run.smithi003.stdout:/sys/fs/fuse/connections 2024-09-21T12:18:04.300 INFO:teuthology.orchestra.run.smithi003.stdout:/sys/kernel/config 2024-09-21T12:18:04.300 INFO:teuthology.orchestra.run.smithi003.stdout:/run/credentials/systemd-sysctl.service 2024-09-21T12:18:04.300 INFO:teuthology.orchestra.run.smithi003.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-21T12:18:04.300 INFO:teuthology.orchestra.run.smithi003.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-21T12:18:04.300 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/nfs/rpc_pipefs 2024-09-21T12:18:04.300 INFO:teuthology.orchestra.run.smithi003.stdout:/run/user/1000 2024-09-21T12:18:04.300 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/ceph 2024-09-21T12:18:04.300 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay 2024-09-21T12:18:04.300 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/92043b1b97e0c173cbb32cec064940458e7cf2bf2b11b0af94cfeedec8b3f566/merged 2024-09-21T12:18:04.300 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/6f5ec22692f09b9e5200d7c235f672e10db6d07dd70d2fd434213b6b8a35db4f/merged 2024-09-21T12:18:04.300 INFO:teuthology.orchestra.run.smithi003.stdout:/run/user/0 2024-09-21T12:18:04.300 INFO:teuthology.orchestra.run.smithi003.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T12:18:04.300 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/4d57e5c32a2c7bfd996426ba9d30afb329cf819f35153d854e470531bb835b77/merged 2024-09-21T12:18:04.300 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/6720220f236e5848431f62ab68e3fb998838ccad373d54182e2b705c5bff8e0f/merged 2024-09-21T12:18:04.301 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/105d7e4e21e6fbf9cead15ec2235c333721c28cc5e8420d04472761125af67c1/merged 2024-09-21T12:18:04.301 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/881f193accbf102cf0ef7d5f1090e54ba0f42bbc665046fca3778f5ae0c5fc3d/merged 2024-09-21T12:18:04.301 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/0f5fe60344b4ba4db2a582edac98705ae6cd01b8c0e0fea52e07fc85ee694282/merged 2024-09-21T12:18:04.301 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/c7f38d59c01508b15b6d468d4b7e6263b409bad16b125243b04400c531ec7111/merged 2024-09-21T12:18:04.301 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/770797aa976054dfaa751a00ae864669efab899000ea888e38c5e87c687851c1/merged 2024-09-21T12:18:04.301 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/ba2149cd40ae59c5a65e5ec298e005cd31ddcd03226b9a96d51da43858de6ef5/merged 2024-09-21T12:18:04.301 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/e2b44f5b14b3fe35927c536373d8339e6ec4582b3ea2ad72d4019cd02dc30003/merged 2024-09-21T12:18:04.301 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/df7134d6be0b0919e46ebc938eab4fa587bc70c940444c91bf9d64e2b8dc12c9/merged 2024-09-21T12:18:04.301 INFO:teuthology.orchestra.run.smithi003.stdout:/var/lib/containers/storage/overlay/06be59e4ce09dea1a720106d96311d8d40ca52de800acdee5b536ce658ca2894/merged 2024-09-21T12:18:04.301 INFO:teuthology.orchestra.run.smithi003.stdout:/run/netns 2024-09-21T12:18:04.301 INFO:teuthology.orchestra.run.smithi003.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T12:18:04.301 INFO:teuthology.orchestra.run.smithi003.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-21T12:18:04.301 INFO:teuthology.orchestra.run.smithi003.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-21T12:18:04.302 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T12:18:04.302 DEBUG:teuthology.orchestra.run.smithi003:> ls /sys/fs/fuse/connections 2024-09-21T12:18:04.354 INFO:teuthology.orchestra.run.smithi003.stdout:165 2024-09-21T12:18:04.354 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [165] 2024-09-21T12:18:04.354 DEBUG:teuthology.orchestra.run.smithi003:> sudo stdin-killer -- python3 -c ' 2024-09-21T12:18:04.355 DEBUG:teuthology.orchestra.run.smithi003:> import glob 2024-09-21T12:18:04.355 DEBUG:teuthology.orchestra.run.smithi003:> import re 2024-09-21T12:18:04.355 DEBUG:teuthology.orchestra.run.smithi003:> import os 2024-09-21T12:18:04.355 DEBUG:teuthology.orchestra.run.smithi003:> import subprocess 2024-09-21T12:18:04.355 DEBUG:teuthology.orchestra.run.smithi003:> 2024-09-21T12:18:04.355 DEBUG:teuthology.orchestra.run.smithi003:> def _find_admin_socket(client_name): 2024-09-21T12:18:04.355 DEBUG:teuthology.orchestra.run.smithi003:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-21T12:18:04.355 DEBUG:teuthology.orchestra.run.smithi003:> files = glob.glob(asok_path) 2024-09-21T12:18:04.355 DEBUG:teuthology.orchestra.run.smithi003:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-21T12:18:04.355 DEBUG:teuthology.orchestra.run.smithi003:> 2024-09-21T12:18:04.355 DEBUG:teuthology.orchestra.run.smithi003:> # Given a non-glob path, it better be there 2024-09-21T12:18:04.355 DEBUG:teuthology.orchestra.run.smithi003:> if "*" not in asok_path: 2024-09-21T12:18:04.355 DEBUG:teuthology.orchestra.run.smithi003:> assert(len(files) == 1) 2024-09-21T12:18:04.355 DEBUG:teuthology.orchestra.run.smithi003:> return files[0] 2024-09-21T12:18:04.356 DEBUG:teuthology.orchestra.run.smithi003:> 2024-09-21T12:18:04.356 DEBUG:teuthology.orchestra.run.smithi003:> for f in files: 2024-09-21T12:18:04.356 DEBUG:teuthology.orchestra.run.smithi003:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-21T12:18:04.356 DEBUG:teuthology.orchestra.run.smithi003:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-21T12:18:04.356 DEBUG:teuthology.orchestra.run.smithi003:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-21T12:18:04.356 DEBUG:teuthology.orchestra.run.smithi003:> contents = proc_f.read() 2024-09-21T12:18:04.356 DEBUG:teuthology.orchestra.run.smithi003:> if mountpoint in contents: 2024-09-21T12:18:04.356 DEBUG:teuthology.orchestra.run.smithi003:> return f 2024-09-21T12:18:04.356 DEBUG:teuthology.orchestra.run.smithi003:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-21T12:18:04.356 DEBUG:teuthology.orchestra.run.smithi003:> 2024-09-21T12:18:04.356 DEBUG:teuthology.orchestra.run.smithi003:> print(_find_admin_socket("client.0")) 2024-09-21T12:18:04.356 DEBUG:teuthology.orchestra.run.smithi003:> ' 2024-09-21T12:18:04.475 INFO:teuthology.orchestra.run.smithi003.stdout:/var/run/ceph/ceph-client.0.76329.asok 2024-09-21T12:18:04.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T12:18:04.485 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:18:04 smithi003 ceph-mon[28057]: pgmap v192: 65 pgs: 65 active+clean; 579 KiB data, 167 MiB used, 536 GiB / 536 GiB avail; 8.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T12:18:04.485 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:18:04 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:18:04.485 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:18:04 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:18:04.485 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:18:04 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:18:04.485 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:18:04 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:18:04.485 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:18:04 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:18:04.486 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.76329.asok 2024-09-21T12:18:04.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T12:18:04.486 DEBUG:teuthology.orchestra.run.smithi003:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.76329.asok status 2024-09-21T12:18:04.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:18:04 smithi192 ceph-mon[35641]: pgmap v192: 65 pgs: 65 active+clean; 579 KiB data, 167 MiB used, 536 GiB / 536 GiB avail; 8.2 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-21T12:18:04.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:18:04 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:18:04.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:18:04 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:18:04.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:18:04 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:18:04.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:18:04 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:18:04.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:18:04 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:18:04.624 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-21T12:18:04.624 INFO:teuthology.orchestra.run.smithi003.stdout: "metadata": { 2024-09-21T12:18:04.624 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph_sha1": "4e45e6b490e6cbe082cdf155fea780438ec53fc7", 2024-09-21T12:18:04.624 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph_version": "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)", 2024-09-21T12:18:04.624 INFO:teuthology.orchestra.run.smithi003.stdout: "entity_id": "0", 2024-09-21T12:18:04.625 INFO:teuthology.orchestra.run.smithi003.stdout: "hostname": "smithi003", 2024-09-21T12:18:04.625 INFO:teuthology.orchestra.run.smithi003.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-21T12:18:04.625 INFO:teuthology.orchestra.run.smithi003.stdout: "pid": "76329", 2024-09-21T12:18:04.625 INFO:teuthology.orchestra.run.smithi003.stdout: "root": "/" 2024-09-21T12:18:04.625 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:18:04.625 INFO:teuthology.orchestra.run.smithi003.stdout: "dentry_count": 0, 2024-09-21T12:18:04.625 INFO:teuthology.orchestra.run.smithi003.stdout: "dentry_pinned_count": 0, 2024-09-21T12:18:04.625 INFO:teuthology.orchestra.run.smithi003.stdout: "id": 14600, 2024-09-21T12:18:04.625 INFO:teuthology.orchestra.run.smithi003.stdout: "inst": { 2024-09-21T12:18:04.626 INFO:teuthology.orchestra.run.smithi003.stdout: "name": { 2024-09-21T12:18:04.626 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "client", 2024-09-21T12:18:04.626 INFO:teuthology.orchestra.run.smithi003.stdout: "num": 14600 2024-09-21T12:18:04.626 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:18:04.626 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": { 2024-09-21T12:18:04.626 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2024-09-21T12:18:04.626 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "192.168.0.1:0", 2024-09-21T12:18:04.626 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 1734926769 2024-09-21T12:18:04.627 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-21T12:18:04.627 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:18:04.627 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": { 2024-09-21T12:18:04.627 INFO:teuthology.orchestra.run.smithi003.stdout: "type": "v1", 2024-09-21T12:18:04.627 INFO:teuthology.orchestra.run.smithi003.stdout: "addr": "192.168.0.1:0", 2024-09-21T12:18:04.627 INFO:teuthology.orchestra.run.smithi003.stdout: "nonce": 1734926769 2024-09-21T12:18:04.627 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:18:04.627 INFO:teuthology.orchestra.run.smithi003.stdout: "inst_str": "client.14600 192.168.0.1:0/1734926769", 2024-09-21T12:18:04.627 INFO:teuthology.orchestra.run.smithi003.stdout: "addr_str": "192.168.0.1:0/1734926769", 2024-09-21T12:18:04.628 INFO:teuthology.orchestra.run.smithi003.stdout: "inode_count": 1, 2024-09-21T12:18:04.628 INFO:teuthology.orchestra.run.smithi003.stdout: "mds_epoch": 14, 2024-09-21T12:18:04.628 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_epoch": 46, 2024-09-21T12:18:04.628 INFO:teuthology.orchestra.run.smithi003.stdout: "osd_epoch_barrier": 0, 2024-09-21T12:18:04.628 INFO:teuthology.orchestra.run.smithi003.stdout: "blocklisted": false, 2024-09-21T12:18:04.628 INFO:teuthology.orchestra.run.smithi003.stdout: "fs_name": "cephfs" 2024-09-21T12:18:04.628 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-21T12:18:04.633 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-21T12:18:04.633 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph fs ls 2024-09-21T12:18:04.890 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:18:05.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:05.411+0000 7fe62936e640 1 -- 172.21.15.3:0/2721390568 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe624106800 msgr2=0x7fe624106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:18:05.429 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:05.411+0000 7fe62936e640 1 --2- 172.21.15.3:0/2721390568 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe624106800 0x7fe624106be0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fe614009880 tx=0x7fe61402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:18:05.429 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:05.411+0000 7fe62936e640 1 -- 172.21.15.3:0/2721390568 shutdown_connections 2024-09-21T12:18:05.429 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:05.411+0000 7fe62936e640 1 --2- 172.21.15.3:0/2721390568 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe624100800 0x7fe624100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:05.429 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:05.411+0000 7fe62936e640 1 --2- 172.21.15.3:0/2721390568 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe624106800 0x7fe624106be0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:05.429 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:05.411+0000 7fe62936e640 1 -- 172.21.15.3:0/2721390568 >> 172.21.15.3:0/2721390568 conn(0x7fe6240fc520 msgr2=0x7fe6240fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:18:05.429 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:05.411+0000 7fe62936e640 1 -- 172.21.15.3:0/2721390568 shutdown_connections 2024-09-21T12:18:05.429 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:05.411+0000 7fe62936e640 1 -- 172.21.15.3:0/2721390568 wait complete. 2024-09-21T12:18:05.429 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:05.412+0000 7fe62936e640 1 Processor -- start 2024-09-21T12:18:05.429 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:05.412+0000 7fe62936e640 1 -- start start 2024-09-21T12:18:05.429 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:05.412+0000 7fe62936e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe624100800 0x7fe62419c630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:18:05.429 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:05.412+0000 7fe62936e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe624106800 0x7fe62419cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:18:05.429 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:05.412+0000 7fe62936e640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fe62410dd30 con 0x7fe624100800 2024-09-21T12:18:05.429 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:05.412+0000 7fe62936e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe62410dbb0 con 0x7fe624106800 2024-09-21T12:18:05.429 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:05.412+0000 7fe622ffd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe624100800 0x7fe62419c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:18:05.430 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:05.413+0000 7fe622ffd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe624100800 0x7fe62419c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56764/0 (socket says 172.21.15.3:56764) 2024-09-21T12:18:05.430 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:05.413+0000 7fe622ffd640 1 -- 172.21.15.3:0/2369798422 learned_addr learned my addr 172.21.15.3:0/2369798422 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:18:05.430 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:05.413+0000 7fe6227fc640 1 --2- 172.21.15.3:0/2369798422 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe624106800 0x7fe62419cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:18:05.430 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:05.413+0000 7fe622ffd640 1 -- 172.21.15.3:0/2369798422 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe624106800 msgr2=0x7fe62419cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:18:05.430 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:05.413+0000 7fe622ffd640 1 --2- 172.21.15.3:0/2369798422 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe624106800 0x7fe62419cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:05.430 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:05.413+0000 7fe622ffd640 1 -- 172.21.15.3:0/2369798422 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe624196700 con 0x7fe624100800 2024-09-21T12:18:05.430 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:05.413+0000 7fe622ffd640 1 --2- 172.21.15.3:0/2369798422 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe624100800 0x7fe62419c630 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe614031460 tx=0x7fe6140048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:18:05.430 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:05.413+0000 7fe61bfff640 1 -- 172.21.15.3:0/2369798422 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe61403f070 con 0x7fe624100800 2024-09-21T12:18:05.430 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:05.413+0000 7fe61bfff640 1 -- 172.21.15.3:0/2369798422 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe614004cf0 con 0x7fe624100800 2024-09-21T12:18:05.430 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:05.413+0000 7fe62936e640 1 -- 172.21.15.3:0/2369798422 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe624196990 con 0x7fe624100800 2024-09-21T12:18:05.430 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:05.413+0000 7fe61bfff640 1 -- 172.21.15.3:0/2369798422 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe614035030 con 0x7fe624100800 2024-09-21T12:18:05.430 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:05.413+0000 7fe62936e640 1 -- 172.21.15.3:0/2369798422 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe624196e90 con 0x7fe624100800 2024-09-21T12:18:05.430 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:05.414+0000 7fe62936e640 1 -- 172.21.15.3:0/2369798422 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe624101f40 con 0x7fe624100800 2024-09-21T12:18:05.430 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:05.415+0000 7fe61bfff640 1 -- 172.21.15.3:0/2369798422 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 19) ==== 92549+0+0 (secure 0 0 0) 0x7fe614042070 con 0x7fe624100800 2024-09-21T12:18:05.431 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:05.415+0000 7fe61bfff640 1 --2- 172.21.15.3:0/2369798422 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fe61006e310 0x7fe6100707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:18:05.431 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:05.415+0000 7fe61bfff640 1 -- 172.21.15.3:0/2369798422 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5554+0+0 (secure 0 0 0) 0x7fe6140aec20 con 0x7fe624100800 2024-09-21T12:18:05.431 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:05.415+0000 7fe6227fc640 1 --2- 172.21.15.3:0/2369798422 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fe61006e310 0x7fe6100707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:18:05.431 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:05.416+0000 7fe6227fc640 1 --2- 172.21.15.3:0/2369798422 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fe61006e310 0x7fe6100707d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe624197f50 tx=0x7fe60c008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:18:05.431 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:05.420+0000 7fe61bfff640 1 -- 172.21.15.3:0/2369798422 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe61407c5a0 con 0x7fe624100800 2024-09-21T12:18:05.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:05.636+0000 7fe62936e640 1 -- 172.21.15.3:0/2369798422 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fe624108d70 con 0x7fe624100800 2024-09-21T12:18:05.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:05.636+0000 7fe61bfff640 1 -- 172.21.15.3:0/2369798422 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) ==== 53+0+83 (secure 0 0 0) 0x7fe614080250 con 0x7fe624100800 2024-09-21T12:18:05.638 INFO:teuthology.orchestra.run.smithi003.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-09-21T12:18:05.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:05.639+0000 7fe62936e640 1 -- 172.21.15.3:0/2369798422 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fe61006e310 msgr2=0x7fe6100707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:18:05.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:05.639+0000 7fe62936e640 1 --2- 172.21.15.3:0/2369798422 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fe61006e310 0x7fe6100707d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe624197f50 tx=0x7fe60c008040 comp rx=0 tx=0).stop 2024-09-21T12:18:05.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:05.639+0000 7fe62936e640 1 -- 172.21.15.3:0/2369798422 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe624100800 msgr2=0x7fe62419c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:18:05.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:05.639+0000 7fe62936e640 1 --2- 172.21.15.3:0/2369798422 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe624100800 0x7fe62419c630 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe614031460 tx=0x7fe6140048f0 comp rx=0 tx=0).stop 2024-09-21T12:18:05.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:05.639+0000 7fe62936e640 1 -- 172.21.15.3:0/2369798422 shutdown_connections 2024-09-21T12:18:05.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:05.639+0000 7fe62936e640 1 --2- 172.21.15.3:0/2369798422 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fe61006e310 0x7fe6100707d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:05.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:05.639+0000 7fe62936e640 1 --2- 172.21.15.3:0/2369798422 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe624106800 0x7fe62419cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:05.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:05.639+0000 7fe62936e640 1 --2- 172.21.15.3:0/2369798422 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe624100800 0x7fe62419c630 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:05.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:05.639+0000 7fe62936e640 1 -- 172.21.15.3:0/2369798422 >> 172.21.15.3:0/2369798422 conn(0x7fe6240fc520 msgr2=0x7fe6240fcdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:18:05.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:05.639+0000 7fe62936e640 1 -- 172.21.15.3:0/2369798422 shutdown_connections 2024-09-21T12:18:05.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:05.639+0000 7fe62936e640 1 -- 172.21.15.3:0/2369798422 wait complete. 2024-09-21T12:18:06.307 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:18:06 smithi003 ceph-mon[28057]: pgmap v193: 65 pgs: 65 active+clean; 579 KiB data, 167 MiB used, 536 GiB / 536 GiB avail; 6.8 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-21T12:18:06.307 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:18:06 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/2369798422' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-21T12:18:06.335 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-21T12:18:06.336 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-21T12:18:06.336 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi192.front.sepia.ceph.com 2024-09-21T12:18:06.336 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-21T12:18:06.336 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-21T12:18:06.336 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-21T12:18:06.336 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-21T12:18:06.336 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-21T12:18:06.336 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-21T12:18:06.336 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T12:18:06.336 DEBUG:teuthology.orchestra.run.smithi192:> ip addr 2024-09-21T12:18:06.357 INFO:teuthology.orchestra.run.smithi192.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-21T12:18:06.357 INFO:teuthology.orchestra.run.smithi192.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-21T12:18:06.357 INFO:teuthology.orchestra.run.smithi192.stdout: inet 127.0.0.1/8 scope host lo 2024-09-21T12:18:06.357 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-21T12:18:06.357 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 ::1/128 scope host 2024-09-21T12:18:06.357 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-21T12:18:06.358 INFO:teuthology.orchestra.run.smithi192.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T12:18:06.358 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4e brd ff:ff:ff:ff:ff:ff 2024-09-21T12:18:06.358 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f0 2024-09-21T12:18:06.359 INFO:teuthology.orchestra.run.smithi192.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T12:18:06.359 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:d9:38:4f brd ff:ff:ff:ff:ff:ff 2024-09-21T12:18:06.359 INFO:teuthology.orchestra.run.smithi192.stdout: altname enp7s0f1 2024-09-21T12:18:06.359 INFO:teuthology.orchestra.run.smithi192.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-21T12:18:06.359 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:48 brd ff:ff:ff:ff:ff:ff 2024-09-21T12:18:06.359 INFO:teuthology.orchestra.run.smithi192.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-21T12:18:06.359 INFO:teuthology.orchestra.run.smithi192.stdout: link/ether 0c:c4:7a:88:80:49 brd ff:ff:ff:ff:ff:ff 2024-09-21T12:18:06.359 INFO:teuthology.orchestra.run.smithi192.stdout: inet 172.21.15.192/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-21T12:18:06.359 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft 42318sec preferred_lft 42318sec 2024-09-21T12:18:06.359 INFO:teuthology.orchestra.run.smithi192.stdout: inet6 fe80::ec4:7aff:fe88:8049/64 scope link noprefixroute 2024-09-21T12:18:06.359 INFO:teuthology.orchestra.run.smithi192.stdout: valid_lft forever preferred_lft forever 2024-09-21T12:18:06.360 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-21T12:18:06.360 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T12:18:06.360 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2024-09-21T12:18:06.360 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link add name ceph-brx type bridge 2024-09-21T12:18:06.360 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip addr flush dev ceph-brx 2024-09-21T12:18:06.360 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link set ceph-brx up 2024-09-21T12:18:06.360 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-21T12:18:06.360 DEBUG:teuthology.orchestra.run.smithi192:> ') 2024-09-21T12:18:06.454 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:18:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T12:18:06.464 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:18:06 smithi192 ceph-mon[35641]: pgmap v193: 65 pgs: 65 active+clean; 579 KiB data, 167 MiB used, 536 GiB / 536 GiB avail; 6.8 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-21T12:18:06.464 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:18:06 smithi192 ceph-mon[35641]: from='client.? 172.21.15.3:0/2369798422' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-21T12:18:06.573 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:18:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T12:18:06.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T12:18:06.580 DEBUG:teuthology.orchestra.run.smithi192:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-21T12:18:06.604 INFO:teuthology.orchestra.run.smithi192.stdout:1 2024-09-21T12:18:06.606 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T12:18:06.606 DEBUG:teuthology.orchestra.run.smithi192:> route 2024-09-21T12:18:06.675 INFO:teuthology.orchestra.run.smithi192.stdout:Kernel IP routing table 2024-09-21T12:18:06.675 INFO:teuthology.orchestra.run.smithi192.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-21T12:18:06.675 INFO:teuthology.orchestra.run.smithi192.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-21T12:18:06.675 INFO:teuthology.orchestra.run.smithi192.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-21T12:18:06.675 INFO:teuthology.orchestra.run.smithi192.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-21T12:18:06.676 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T12:18:06.676 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2024-09-21T12:18:06.676 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-21T12:18:06.676 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-21T12:18:06.676 DEBUG:teuthology.orchestra.run.smithi192:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-21T12:18:06.676 DEBUG:teuthology.orchestra.run.smithi192:> ') 2024-09-21T12:18:06.764 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:18:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T12:18:06.940 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:18:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T12:18:06.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T12:18:06.946 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list 2024-09-21T12:18:06.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T12:18:06.962 DEBUG:teuthology.orchestra.run.smithi192:> ip netns list-id 2024-09-21T12:18:07.017 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T12:18:07.018 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2024-09-21T12:18:07.018 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-21T12:18:07.018 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-21T12:18:07.018 DEBUG:teuthology.orchestra.run.smithi192:> ') 2024-09-21T12:18:07.105 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:18:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T12:18:07.128 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:18:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T12:18:07.135 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-21T12:18:07.135 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T12:18:07.135 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2024-09-21T12:18:07.135 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-21T12:18:07.135 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-21T12:18:07.135 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-21T12:18:07.135 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-21T12:18:07.135 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-21T12:18:07.135 DEBUG:teuthology.orchestra.run.smithi192:> ') 2024-09-21T12:18:07.183 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:18:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T12:18:07.258 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:18:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T12:18:07.264 DEBUG:teuthology.orchestra.run.smithi192:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-21T12:18:07.264 DEBUG:teuthology.orchestra.run.smithi192:> set -e 2024-09-21T12:18:07.264 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link set brx.0 up 2024-09-21T12:18:07.264 DEBUG:teuthology.orchestra.run.smithi192:> sudo ip link set dev brx.0 master ceph-brx 2024-09-21T12:18:07.264 DEBUG:teuthology.orchestra.run.smithi192:> ') 2024-09-21T12:18:07.312 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:18:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-21T12:18:07.334 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:18:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T12:18:07.340 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-21T12:18:07.340 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T12:18:07.340 DEBUG:teuthology.orchestra.run.smithi192:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-21T12:18:07.355 INFO:teuthology.orchestra.run.smithi192.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-21T12:18:07.355 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-21T12:18:07.356 DEBUG:teuthology.orchestra.run.smithi192:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-21T12:18:07.411 DEBUG:teuthology.orchestra.run.smithi192:> sudo modprobe fuse 2024-09-21T12:18:07.476 DEBUG:teuthology.orchestra.run.smithi192:> cat /proc/self/mounts | awk '{print $2}' 2024-09-21T12:18:07.533 INFO:teuthology.orchestra.run.smithi192.stdout:/proc 2024-09-21T12:18:07.533 INFO:teuthology.orchestra.run.smithi192.stdout:/sys 2024-09-21T12:18:07.533 INFO:teuthology.orchestra.run.smithi192.stdout:/dev 2024-09-21T12:18:07.533 INFO:teuthology.orchestra.run.smithi192.stdout:/sys/kernel/security 2024-09-21T12:18:07.533 INFO:teuthology.orchestra.run.smithi192.stdout:/dev/shm 2024-09-21T12:18:07.533 INFO:teuthology.orchestra.run.smithi192.stdout:/dev/pts 2024-09-21T12:18:07.533 INFO:teuthology.orchestra.run.smithi192.stdout:/run 2024-09-21T12:18:07.533 INFO:teuthology.orchestra.run.smithi192.stdout:/sys/fs/cgroup 2024-09-21T12:18:07.533 INFO:teuthology.orchestra.run.smithi192.stdout:/sys/fs/pstore 2024-09-21T12:18:07.534 INFO:teuthology.orchestra.run.smithi192.stdout:/sys/fs/bpf 2024-09-21T12:18:07.534 INFO:teuthology.orchestra.run.smithi192.stdout:/ 2024-09-21T12:18:07.534 INFO:teuthology.orchestra.run.smithi192.stdout:/sys/fs/selinux 2024-09-21T12:18:07.534 INFO:teuthology.orchestra.run.smithi192.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T12:18:07.534 INFO:teuthology.orchestra.run.smithi192.stdout:/sys/kernel/debug 2024-09-21T12:18:07.534 INFO:teuthology.orchestra.run.smithi192.stdout:/dev/mqueue 2024-09-21T12:18:07.534 INFO:teuthology.orchestra.run.smithi192.stdout:/dev/hugepages 2024-09-21T12:18:07.534 INFO:teuthology.orchestra.run.smithi192.stdout:/sys/kernel/tracing 2024-09-21T12:18:07.534 INFO:teuthology.orchestra.run.smithi192.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-21T12:18:07.534 INFO:teuthology.orchestra.run.smithi192.stdout:/sys/fs/fuse/connections 2024-09-21T12:18:07.534 INFO:teuthology.orchestra.run.smithi192.stdout:/sys/kernel/config 2024-09-21T12:18:07.534 INFO:teuthology.orchestra.run.smithi192.stdout:/run/credentials/systemd-sysctl.service 2024-09-21T12:18:07.534 INFO:teuthology.orchestra.run.smithi192.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-21T12:18:07.534 INFO:teuthology.orchestra.run.smithi192.stdout:/var/lib/nfs/rpc_pipefs 2024-09-21T12:18:07.535 INFO:teuthology.orchestra.run.smithi192.stdout:/run/user/1000 2024-09-21T12:18:07.535 INFO:teuthology.orchestra.run.smithi192.stdout:/var/lib/ceph 2024-09-21T12:18:07.535 INFO:teuthology.orchestra.run.smithi192.stdout:/run/user/0 2024-09-21T12:18:07.535 INFO:teuthology.orchestra.run.smithi192.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T12:18:07.535 INFO:teuthology.orchestra.run.smithi192.stdout:/var/lib/containers/storage/overlay 2024-09-21T12:18:07.535 INFO:teuthology.orchestra.run.smithi192.stdout:/var/lib/containers/storage/overlay/7e2525d72ed8175443318c0a961cffaaf0218afba861d6e38c1511173226b107/merged 2024-09-21T12:18:07.535 INFO:teuthology.orchestra.run.smithi192.stdout:/var/lib/containers/storage/overlay/8b38ed9c898817f6dd38797d02dd6b9b830a6936974c5873c43d9c0f840ac62a/merged 2024-09-21T12:18:07.535 INFO:teuthology.orchestra.run.smithi192.stdout:/var/lib/containers/storage/overlay/9b8c4b9b9c2e657081040b9f7b448d0e7f2ae150ce91d7810cea029b3b2cde88/merged 2024-09-21T12:18:07.535 INFO:teuthology.orchestra.run.smithi192.stdout:/var/lib/containers/storage/overlay/c16fee38360ba9b7dc70fe0783b2ac22fd1bf8dcc4017fd62c8d0f4013fd43e8/merged 2024-09-21T12:18:07.535 INFO:teuthology.orchestra.run.smithi192.stdout:/var/lib/containers/storage/overlay/eb1b03cf259499b5fcf69ff3e4e50446565835caf213a4aa1b9318cd8d1addf1/merged 2024-09-21T12:18:07.535 INFO:teuthology.orchestra.run.smithi192.stdout:/var/lib/containers/storage/overlay/1a976223bdf039431d5bf86bb951206f9ba730ca18ecdeceaa0068c331e7993f/merged 2024-09-21T12:18:07.535 INFO:teuthology.orchestra.run.smithi192.stdout:/var/lib/containers/storage/overlay/e613b1b26d340ea8417cf7d6dee3cd50cb5d0783f8b276eccef182315f24a240/merged 2024-09-21T12:18:07.535 INFO:teuthology.orchestra.run.smithi192.stdout:/var/lib/containers/storage/overlay/2a6cd3dea1b33b8241e0f7a4230d84e27fe56f94f6e1b9ae589ce216e156fadf/merged 2024-09-21T12:18:07.535 INFO:teuthology.orchestra.run.smithi192.stdout:/var/lib/containers/storage/overlay/ff66b648b3251dc81d91e45109df70d278ce8dc50e325bfb0f220f4dcc1ecaab/merged 2024-09-21T12:18:07.536 INFO:teuthology.orchestra.run.smithi192.stdout:/var/lib/containers/storage/overlay/7bfbc9586da1f34b420dff2b8ddef63da79a8639611bdb79f13053b60027c633/merged 2024-09-21T12:18:07.536 INFO:teuthology.orchestra.run.smithi192.stdout:/run/netns 2024-09-21T12:18:07.536 INFO:teuthology.orchestra.run.smithi192.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-21T12:18:07.536 INFO:teuthology.orchestra.run.smithi192.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-21T12:18:07.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T12:18:07.536 DEBUG:teuthology.orchestra.run.smithi192:> ls /sys/fs/fuse/connections 2024-09-21T12:18:07.588 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-21T12:18:07.588 DEBUG:teuthology.orchestra.run.smithi192:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-21T12:18:07.630 DEBUG:teuthology.orchestra.run.smithi192:> sudo modprobe fuse 2024-09-21T12:18:07.655 DEBUG:teuthology.orchestra.run.smithi192:> cat /proc/self/mounts | awk '{print $2}' 2024-09-21T12:18:07.713 INFO:teuthology.orchestra.run.smithi192.stdout:/proc 2024-09-21T12:18:07.713 INFO:teuthology.orchestra.run.smithi192.stdout:/sys 2024-09-21T12:18:07.713 INFO:teuthology.orchestra.run.smithi192.stdout:/dev 2024-09-21T12:18:07.713 INFO:teuthology.orchestra.run.smithi192.stdout:/sys/kernel/security 2024-09-21T12:18:07.713 INFO:teuthology.orchestra.run.smithi192.stdout:/dev/shm 2024-09-21T12:18:07.713 INFO:teuthology.orchestra.run.smithi192.stdout:/dev/pts 2024-09-21T12:18:07.713 INFO:teuthology.orchestra.run.smithi192.stdout:/run 2024-09-21T12:18:07.713 INFO:teuthology.orchestra.run.smithi192.stdout:/sys/fs/cgroup 2024-09-21T12:18:07.713 INFO:teuthology.orchestra.run.smithi192.stdout:/sys/fs/pstore 2024-09-21T12:18:07.713 INFO:teuthology.orchestra.run.smithi192.stdout:/sys/fs/bpf 2024-09-21T12:18:07.714 INFO:teuthology.orchestra.run.smithi192.stdout:/ 2024-09-21T12:18:07.714 INFO:teuthology.orchestra.run.smithi192.stdout:/sys/fs/selinux 2024-09-21T12:18:07.714 INFO:teuthology.orchestra.run.smithi192.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T12:18:07.714 INFO:teuthology.orchestra.run.smithi192.stdout:/sys/kernel/debug 2024-09-21T12:18:07.714 INFO:teuthology.orchestra.run.smithi192.stdout:/dev/mqueue 2024-09-21T12:18:07.714 INFO:teuthology.orchestra.run.smithi192.stdout:/dev/hugepages 2024-09-21T12:18:07.714 INFO:teuthology.orchestra.run.smithi192.stdout:/sys/kernel/tracing 2024-09-21T12:18:07.714 INFO:teuthology.orchestra.run.smithi192.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-21T12:18:07.714 INFO:teuthology.orchestra.run.smithi192.stdout:/sys/fs/fuse/connections 2024-09-21T12:18:07.714 INFO:teuthology.orchestra.run.smithi192.stdout:/sys/kernel/config 2024-09-21T12:18:07.714 INFO:teuthology.orchestra.run.smithi192.stdout:/run/credentials/systemd-sysctl.service 2024-09-21T12:18:07.714 INFO:teuthology.orchestra.run.smithi192.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-21T12:18:07.714 INFO:teuthology.orchestra.run.smithi192.stdout:/var/lib/nfs/rpc_pipefs 2024-09-21T12:18:07.714 INFO:teuthology.orchestra.run.smithi192.stdout:/run/user/1000 2024-09-21T12:18:07.715 INFO:teuthology.orchestra.run.smithi192.stdout:/var/lib/ceph 2024-09-21T12:18:07.715 INFO:teuthology.orchestra.run.smithi192.stdout:/run/user/0 2024-09-21T12:18:07.715 INFO:teuthology.orchestra.run.smithi192.stdout:/proc/sys/fs/binfmt_misc 2024-09-21T12:18:07.715 INFO:teuthology.orchestra.run.smithi192.stdout:/var/lib/containers/storage/overlay 2024-09-21T12:18:07.715 INFO:teuthology.orchestra.run.smithi192.stdout:/var/lib/containers/storage/overlay/7e2525d72ed8175443318c0a961cffaaf0218afba861d6e38c1511173226b107/merged 2024-09-21T12:18:07.715 INFO:teuthology.orchestra.run.smithi192.stdout:/var/lib/containers/storage/overlay/8b38ed9c898817f6dd38797d02dd6b9b830a6936974c5873c43d9c0f840ac62a/merged 2024-09-21T12:18:07.715 INFO:teuthology.orchestra.run.smithi192.stdout:/var/lib/containers/storage/overlay/9b8c4b9b9c2e657081040b9f7b448d0e7f2ae150ce91d7810cea029b3b2cde88/merged 2024-09-21T12:18:07.715 INFO:teuthology.orchestra.run.smithi192.stdout:/var/lib/containers/storage/overlay/c16fee38360ba9b7dc70fe0783b2ac22fd1bf8dcc4017fd62c8d0f4013fd43e8/merged 2024-09-21T12:18:07.715 INFO:teuthology.orchestra.run.smithi192.stdout:/var/lib/containers/storage/overlay/eb1b03cf259499b5fcf69ff3e4e50446565835caf213a4aa1b9318cd8d1addf1/merged 2024-09-21T12:18:07.715 INFO:teuthology.orchestra.run.smithi192.stdout:/var/lib/containers/storage/overlay/1a976223bdf039431d5bf86bb951206f9ba730ca18ecdeceaa0068c331e7993f/merged 2024-09-21T12:18:07.715 INFO:teuthology.orchestra.run.smithi192.stdout:/var/lib/containers/storage/overlay/e613b1b26d340ea8417cf7d6dee3cd50cb5d0783f8b276eccef182315f24a240/merged 2024-09-21T12:18:07.715 INFO:teuthology.orchestra.run.smithi192.stdout:/var/lib/containers/storage/overlay/2a6cd3dea1b33b8241e0f7a4230d84e27fe56f94f6e1b9ae589ce216e156fadf/merged 2024-09-21T12:18:07.715 INFO:teuthology.orchestra.run.smithi192.stdout:/var/lib/containers/storage/overlay/ff66b648b3251dc81d91e45109df70d278ce8dc50e325bfb0f220f4dcc1ecaab/merged 2024-09-21T12:18:07.715 INFO:teuthology.orchestra.run.smithi192.stdout:/var/lib/containers/storage/overlay/7bfbc9586da1f34b420dff2b8ddef63da79a8639611bdb79f13053b60027c633/merged 2024-09-21T12:18:07.716 INFO:teuthology.orchestra.run.smithi192.stdout:/run/netns 2024-09-21T12:18:07.716 INFO:teuthology.orchestra.run.smithi192.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-21T12:18:07.716 INFO:teuthology.orchestra.run.smithi192.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-21T12:18:07.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T12:18:07.716 DEBUG:teuthology.orchestra.run.smithi192:> ls /sys/fs/fuse/connections 2024-09-21T12:18:07.742 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi192.stderr:2024-09-21T12:18:07.741+0000 7fa6e85b9480 -1 init, newargv = 0x559bcac99090 newargc=15 2024-09-21T12:18:07.743 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi192.stderr:ceph-fuse[61577]: starting ceph client 2024-09-21T12:18:07.747 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi192.stderr:ceph-fuse[61577]: starting fuse 2024-09-21T12:18:07.758 INFO:teuthology.orchestra.run.smithi192.stdout:129 2024-09-21T12:18:07.758 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [129] 2024-09-21T12:18:07.758 DEBUG:teuthology.orchestra.run.smithi192:> sudo stdin-killer -- python3 -c ' 2024-09-21T12:18:07.758 DEBUG:teuthology.orchestra.run.smithi192:> import glob 2024-09-21T12:18:07.758 DEBUG:teuthology.orchestra.run.smithi192:> import re 2024-09-21T12:18:07.758 DEBUG:teuthology.orchestra.run.smithi192:> import os 2024-09-21T12:18:07.758 DEBUG:teuthology.orchestra.run.smithi192:> import subprocess 2024-09-21T12:18:07.758 DEBUG:teuthology.orchestra.run.smithi192:> 2024-09-21T12:18:07.759 DEBUG:teuthology.orchestra.run.smithi192:> def _find_admin_socket(client_name): 2024-09-21T12:18:07.759 DEBUG:teuthology.orchestra.run.smithi192:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-21T12:18:07.759 DEBUG:teuthology.orchestra.run.smithi192:> files = glob.glob(asok_path) 2024-09-21T12:18:07.759 DEBUG:teuthology.orchestra.run.smithi192:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-21T12:18:07.759 DEBUG:teuthology.orchestra.run.smithi192:> 2024-09-21T12:18:07.759 DEBUG:teuthology.orchestra.run.smithi192:> # Given a non-glob path, it better be there 2024-09-21T12:18:07.759 DEBUG:teuthology.orchestra.run.smithi192:> if "*" not in asok_path: 2024-09-21T12:18:07.759 DEBUG:teuthology.orchestra.run.smithi192:> assert(len(files) == 1) 2024-09-21T12:18:07.759 DEBUG:teuthology.orchestra.run.smithi192:> return files[0] 2024-09-21T12:18:07.759 DEBUG:teuthology.orchestra.run.smithi192:> 2024-09-21T12:18:07.759 DEBUG:teuthology.orchestra.run.smithi192:> for f in files: 2024-09-21T12:18:07.759 DEBUG:teuthology.orchestra.run.smithi192:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-21T12:18:07.759 DEBUG:teuthology.orchestra.run.smithi192:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-21T12:18:07.759 DEBUG:teuthology.orchestra.run.smithi192:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-21T12:18:07.759 DEBUG:teuthology.orchestra.run.smithi192:> contents = proc_f.read() 2024-09-21T12:18:07.760 DEBUG:teuthology.orchestra.run.smithi192:> if mountpoint in contents: 2024-09-21T12:18:07.760 DEBUG:teuthology.orchestra.run.smithi192:> return f 2024-09-21T12:18:07.760 DEBUG:teuthology.orchestra.run.smithi192:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-21T12:18:07.760 DEBUG:teuthology.orchestra.run.smithi192:> 2024-09-21T12:18:07.760 DEBUG:teuthology.orchestra.run.smithi192:> print(_find_admin_socket("client.1")) 2024-09-21T12:18:07.760 DEBUG:teuthology.orchestra.run.smithi192:> ' 2024-09-21T12:18:07.876 INFO:teuthology.orchestra.run.smithi192.stdout:/var/run/ceph/ceph-client.1.61577.asok 2024-09-21T12:18:07.879 INFO:teuthology.orchestra.run.smithi192.stderr:2024-09-21T12:18:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-21T12:18:07.886 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.61577.asok 2024-09-21T12:18:07.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T12:18:07.886 DEBUG:teuthology.orchestra.run.smithi192:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.61577.asok status 2024-09-21T12:18:08.020 INFO:teuthology.orchestra.run.smithi192.stdout:{ 2024-09-21T12:18:08.020 INFO:teuthology.orchestra.run.smithi192.stdout: "metadata": { 2024-09-21T12:18:08.021 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_sha1": "4e45e6b490e6cbe082cdf155fea780438ec53fc7", 2024-09-21T12:18:08.021 INFO:teuthology.orchestra.run.smithi192.stdout: "ceph_version": "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)", 2024-09-21T12:18:08.021 INFO:teuthology.orchestra.run.smithi192.stdout: "entity_id": "1", 2024-09-21T12:18:08.021 INFO:teuthology.orchestra.run.smithi192.stdout: "hostname": "smithi192", 2024-09-21T12:18:08.021 INFO:teuthology.orchestra.run.smithi192.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-21T12:18:08.021 INFO:teuthology.orchestra.run.smithi192.stdout: "pid": "61577", 2024-09-21T12:18:08.021 INFO:teuthology.orchestra.run.smithi192.stdout: "root": "/" 2024-09-21T12:18:08.021 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-21T12:18:08.021 INFO:teuthology.orchestra.run.smithi192.stdout: "dentry_count": 0, 2024-09-21T12:18:08.021 INFO:teuthology.orchestra.run.smithi192.stdout: "dentry_pinned_count": 0, 2024-09-21T12:18:08.021 INFO:teuthology.orchestra.run.smithi192.stdout: "id": 24361, 2024-09-21T12:18:08.021 INFO:teuthology.orchestra.run.smithi192.stdout: "inst": { 2024-09-21T12:18:08.021 INFO:teuthology.orchestra.run.smithi192.stdout: "name": { 2024-09-21T12:18:08.021 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "client", 2024-09-21T12:18:08.021 INFO:teuthology.orchestra.run.smithi192.stdout: "num": 24361 2024-09-21T12:18:08.021 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-21T12:18:08.022 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": { 2024-09-21T12:18:08.022 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-21T12:18:08.022 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "192.168.0.1:0", 2024-09-21T12:18:08.022 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3487024347 2024-09-21T12:18:08.022 INFO:teuthology.orchestra.run.smithi192.stdout: } 2024-09-21T12:18:08.022 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-21T12:18:08.022 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": { 2024-09-21T12:18:08.022 INFO:teuthology.orchestra.run.smithi192.stdout: "type": "v1", 2024-09-21T12:18:08.022 INFO:teuthology.orchestra.run.smithi192.stdout: "addr": "192.168.0.1:0", 2024-09-21T12:18:08.022 INFO:teuthology.orchestra.run.smithi192.stdout: "nonce": 3487024347 2024-09-21T12:18:08.022 INFO:teuthology.orchestra.run.smithi192.stdout: }, 2024-09-21T12:18:08.022 INFO:teuthology.orchestra.run.smithi192.stdout: "inst_str": "client.24361 192.168.0.1:0/3487024347", 2024-09-21T12:18:08.022 INFO:teuthology.orchestra.run.smithi192.stdout: "addr_str": "192.168.0.1:0/3487024347", 2024-09-21T12:18:08.022 INFO:teuthology.orchestra.run.smithi192.stdout: "inode_count": 1, 2024-09-21T12:18:08.023 INFO:teuthology.orchestra.run.smithi192.stdout: "mds_epoch": 14, 2024-09-21T12:18:08.023 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_epoch": 46, 2024-09-21T12:18:08.023 INFO:teuthology.orchestra.run.smithi192.stdout: "osd_epoch_barrier": 0, 2024-09-21T12:18:08.023 INFO:teuthology.orchestra.run.smithi192.stdout: "blocklisted": false, 2024-09-21T12:18:08.023 INFO:teuthology.orchestra.run.smithi192.stdout: "fs_name": "cephfs" 2024-09-21T12:18:08.023 INFO:teuthology.orchestra.run.smithi192.stdout:} 2024-09-21T12:18:08.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T12:18:08.029 DEBUG:teuthology.orchestra.run.smithi003:> stat --file-system '--printf=%T 2024-09-21T12:18:08.029 DEBUG:teuthology.orchestra.run.smithi003:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-21T12:18:08.050 INFO:teuthology.orchestra.run.smithi003.stdout:fuseblk 2024-09-21T12:18:08.050 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-21T12:18:08.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T12:18:08.051 DEBUG:teuthology.orchestra.run.smithi003:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-21T12:18:08.124 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T12:18:08.124 DEBUG:teuthology.orchestra.run.smithi192:> stat --file-system '--printf=%T 2024-09-21T12:18:08.124 DEBUG:teuthology.orchestra.run.smithi192:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-21T12:18:08.140 INFO:teuthology.orchestra.run.smithi192.stdout:fuseblk 2024-09-21T12:18:08.140 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-21T12:18:08.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T12:18:08.140 DEBUG:teuthology.orchestra.run.smithi192:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-21T12:18:08.208 INFO:teuthology.run_tasks:Running task print... 2024-09-21T12:18:08.224 INFO:teuthology.task.print:**** done client 2024-09-21T12:18:08.224 INFO:teuthology.run_tasks:Running task parallel... 2024-09-21T12:18:08.285 INFO:teuthology.task.parallel:starting parallel... 2024-09-21T12:18:08.285 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-21T12:18:08.286 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-21T12:18:08.286 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi003.front.sepia.ceph.com 2024-09-21T12:18:08.286 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -e sha1=5c1cdc3c470dae78e91a0ed2bcf13509a046d301 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-09-21T12:18:08.287 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-21T12:18:08.287 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-09-21T12:18:08.291 INFO:tasks.workunit:Pulling workunits from ref 5c1cdc3c470dae78e91a0ed2bcf13509a046d301 2024-09-21T12:18:08.291 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-21T12:18:08.291 INFO:tasks.workunit:timeout=3h 2024-09-21T12:18:08.291 INFO:tasks.workunit:cleanup=True 2024-09-21T12:18:08.291 DEBUG:teuthology.orchestra.run.smithi003:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-21T12:18:08.313 INFO:teuthology.orchestra.run.smithi003.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-21T12:18:08.313 INFO:teuthology.orchestra.run.smithi003.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-21T12:18:08.313 INFO:teuthology.orchestra.run.smithi003.stdout:Device: a5h/165d Inode: 1 Links: 2 2024-09-21T12:18:08.313 INFO:teuthology.orchestra.run.smithi003.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T12:18:08.313 INFO:teuthology.orchestra.run.smithi003.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-21T12:18:08.313 INFO:teuthology.orchestra.run.smithi003.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-21T12:18:08.313 INFO:teuthology.orchestra.run.smithi003.stdout:Modify: 2024-09-21 12:17:42.292346726 +0000 2024-09-21T12:18:08.313 INFO:teuthology.orchestra.run.smithi003.stdout:Change: 2024-09-21 12:18:08.120516120 +0000 2024-09-21T12:18:08.313 INFO:teuthology.orchestra.run.smithi003.stdout: Birth: - 2024-09-21T12:18:08.313 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-21T12:18:08.313 DEBUG:teuthology.orchestra.run.smithi003:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-21T12:18:08.378 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:18:08 smithi003 ceph-mon[28057]: pgmap v194: 65 pgs: 65 active+clean; 579 KiB data, 167 MiB used, 536 GiB / 536 GiB avail; 6.5 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-21T12:18:08.388 DEBUG:teuthology.orchestra.run.smithi192:> stat -- /home/ubuntu/cephtest/mnt.1 2024-09-21T12:18:08.404 INFO:teuthology.orchestra.run.smithi192.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-09-21T12:18:08.404 INFO:teuthology.orchestra.run.smithi192.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-21T12:18:08.405 INFO:teuthology.orchestra.run.smithi192.stdout:Device: 81h/129d Inode: 1 Links: 3 2024-09-21T12:18:08.405 INFO:teuthology.orchestra.run.smithi192.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-21T12:18:08.405 INFO:teuthology.orchestra.run.smithi192.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-21T12:18:08.405 INFO:teuthology.orchestra.run.smithi192.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-21T12:18:08.405 INFO:teuthology.orchestra.run.smithi192.stdout:Modify: 2024-09-21 12:18:08.381318719 +0000 2024-09-21T12:18:08.405 INFO:teuthology.orchestra.run.smithi192.stdout:Change: 2024-09-21 12:18:08.381318719 +0000 2024-09-21T12:18:08.405 INFO:teuthology.orchestra.run.smithi192.stdout: Birth: - 2024-09-21T12:18:08.405 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-09-21T12:18:08.405 DEBUG:teuthology.orchestra.run.smithi192:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-09-21T12:18:08.466 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:18:08 smithi192 ceph-mon[35641]: pgmap v194: 65 pgs: 65 active+clean; 579 KiB data, 167 MiB used, 536 GiB / 536 GiB avail; 6.5 KiB/s rd, 170 B/s wr, 6 op/s 2024-09-21T12:18:08.474 DEBUG:teuthology.orchestra.run.smithi003:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 5c1cdc3c470dae78e91a0ed2bcf13509a046d301 2024-09-21T12:18:08.475 DEBUG:teuthology.orchestra.run.smithi192:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout 5c1cdc3c470dae78e91a0ed2bcf13509a046d301 2024-09-21T12:18:08.491 INFO:tasks.workunit.client.0.smithi003.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-21T12:18:08.530 INFO:tasks.workunit.client.1.smithi192.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-09-21T12:18:08.582 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:18:09.061 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:09.056+0000 7f489937d640 1 -- 172.21.15.3:0/2431244348 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4894101a60 msgr2=0x7f4894101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:18:09.061 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:09.056+0000 7f489937d640 1 --2- 172.21.15.3:0/2431244348 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4894101a60 0x7f4894101ee0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f487c009900 tx=0x7f487c02c6e0 comp rx=0 tx=0).stop 2024-09-21T12:18:09.061 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:09.056+0000 7f489937d640 1 -- 172.21.15.3:0/2431244348 shutdown_connections 2024-09-21T12:18:09.061 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:09.056+0000 7f489937d640 1 --2- 172.21.15.3:0/2431244348 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4894101a60 0x7f4894101ee0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:09.061 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:09.056+0000 7f489937d640 1 --2- 172.21.15.3:0/2431244348 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4894100860 0x7f4894100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:09.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:09.056+0000 7f489937d640 1 -- 172.21.15.3:0/2431244348 >> 172.21.15.3:0/2431244348 conn(0x7f48940fc010 msgr2=0x7f48940fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:18:09.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:09.056+0000 7f489937d640 1 -- 172.21.15.3:0/2431244348 shutdown_connections 2024-09-21T12:18:09.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:09.056+0000 7f489937d640 1 -- 172.21.15.3:0/2431244348 wait complete. 2024-09-21T12:18:09.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:09.056+0000 7f489937d640 1 Processor -- start 2024-09-21T12:18:09.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:09.057+0000 7f489937d640 1 -- start start 2024-09-21T12:18:09.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:09.057+0000 7f489937d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4894100860 0x7f4894195270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:18:09.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:09.057+0000 7f489937d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4894101a60 0x7f48941957b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:18:09.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:09.057+0000 7f489937d640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f4894108590 con 0x7f4894100860 2024-09-21T12:18:09.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:09.057+0000 7f489937d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f4894108410 con 0x7f4894101a60 2024-09-21T12:18:09.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:09.057+0000 7f4892ffd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4894100860 0x7f4894195270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:18:09.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:09.057+0000 7f4892ffd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4894100860 0x7f4894195270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56784/0 (socket says 172.21.15.3:56784) 2024-09-21T12:18:09.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:09.057+0000 7f4892ffd640 1 -- 172.21.15.3:0/1323185441 learned_addr learned my addr 172.21.15.3:0/1323185441 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:18:09.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:09.057+0000 7f4892ffd640 1 -- 172.21.15.3:0/1323185441 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4894101a60 msgr2=0x7f48941957b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:18:09.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:09.057+0000 7f48927fc640 1 --2- 172.21.15.3:0/1323185441 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4894101a60 0x7f48941957b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:18:09.063 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:09.057+0000 7f4892ffd640 1 --2- 172.21.15.3:0/1323185441 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4894101a60 0x7f48941957b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:09.063 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:09.057+0000 7f4892ffd640 1 -- 172.21.15.3:0/1323185441 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4894195e30 con 0x7f4894100860 2024-09-21T12:18:09.063 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:09.058+0000 7f4892ffd640 1 --2- 172.21.15.3:0/1323185441 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4894100860 0x7f4894195270 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f488c00ea20 tx=0x7f488c00eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:18:09.063 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:09.058+0000 7f488bfff640 1 -- 172.21.15.3:0/1323185441 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f488c016070 con 0x7f4894100860 2024-09-21T12:18:09.063 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:09.058+0000 7f488bfff640 1 -- 172.21.15.3:0/1323185441 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f488c003e30 con 0x7f4894100860 2024-09-21T12:18:09.063 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:09.058+0000 7f489937d640 1 -- 172.21.15.3:0/1323185441 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f489419a870 con 0x7f4894100860 2024-09-21T12:18:09.063 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:09.058+0000 7f488bfff640 1 -- 172.21.15.3:0/1323185441 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f488c011470 con 0x7f4894100860 2024-09-21T12:18:09.063 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:09.058+0000 7f489937d640 1 -- 172.21.15.3:0/1323185441 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f489419ae00 con 0x7f4894100860 2024-09-21T12:18:09.063 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:09.059+0000 7f489937d640 1 -- 172.21.15.3:0/1323185441 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4894100c60 con 0x7f4894100860 2024-09-21T12:18:09.063 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:09.059+0000 7f488bfff640 1 -- 172.21.15.3:0/1323185441 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 19) ==== 92549+0+0 (secure 0 0 0) 0x7f488c019070 con 0x7f4894100860 2024-09-21T12:18:09.064 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:09.060+0000 7f488bfff640 1 --2- 172.21.15.3:0/1323185441 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f488006e310 0x7f48800707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:18:09.064 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:09.060+0000 7f488bfff640 1 -- 172.21.15.3:0/1323185441 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5554+0+0 (secure 0 0 0) 0x7f488c08e400 con 0x7f4894100860 2024-09-21T12:18:09.064 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:09.060+0000 7f48927fc640 1 --2- 172.21.15.3:0/1323185441 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f488006e310 0x7f48800707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:18:09.064 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:09.061+0000 7f48927fc640 1 --2- 172.21.15.3:0/1323185441 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f488006e310 0x7f48800707d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f487c006010 tx=0x7f487c000bc0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:18:09.066 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:09.064+0000 7f488bfff640 1 -- 172.21.15.3:0/1323185441 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f488c05bd80 con 0x7f4894100860 2024-09-21T12:18:09.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:09.241+0000 7f489937d640 1 -- 172.21.15.3:0/1323185441 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) -- 0x7f489418f3a0 con 0x7f4894100860 2024-09-21T12:18:09.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:09.241+0000 7f488bfff640 1 -- 172.21.15.3:0/1323185441 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v40)=0 v40) ==== 155+0+0 (secure 0 0 0) 0x7f488c05fa30 con 0x7f4894100860 2024-09-21T12:18:09.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:09.244+0000 7f489937d640 1 -- 172.21.15.3:0/1323185441 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f488006e310 msgr2=0x7f48800707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:18:09.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:09.244+0000 7f489937d640 1 --2- 172.21.15.3:0/1323185441 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f488006e310 0x7f48800707d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f487c006010 tx=0x7f487c000bc0 comp rx=0 tx=0).stop 2024-09-21T12:18:09.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:09.244+0000 7f489937d640 1 -- 172.21.15.3:0/1323185441 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4894100860 msgr2=0x7f4894195270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:18:09.245 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:09.244+0000 7f489937d640 1 --2- 172.21.15.3:0/1323185441 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4894100860 0x7f4894195270 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f488c00ea20 tx=0x7f488c00eee0 comp rx=0 tx=0).stop 2024-09-21T12:18:09.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:09.244+0000 7f489937d640 1 -- 172.21.15.3:0/1323185441 shutdown_connections 2024-09-21T12:18:09.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:09.244+0000 7f489937d640 1 --2- 172.21.15.3:0/1323185441 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f488006e310 0x7f48800707d0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:09.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:09.244+0000 7f489937d640 1 --2- 172.21.15.3:0/1323185441 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4894101a60 0x7f48941957b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:09.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:09.244+0000 7f489937d640 1 --2- 172.21.15.3:0/1323185441 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4894100860 0x7f4894195270 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:09.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:09.244+0000 7f489937d640 1 -- 172.21.15.3:0/1323185441 >> 172.21.15.3:0/1323185441 conn(0x7f48940fc010 msgr2=0x7f4894104f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:18:09.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:09.244+0000 7f489937d640 1 -- 172.21.15.3:0/1323185441 shutdown_connections 2024-09-21T12:18:09.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:09.244+0000 7f489937d640 1 -- 172.21.15.3:0/1323185441 wait complete. 2024-09-21T12:18:09.924 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -e sha1=5c1cdc3c470dae78e91a0ed2bcf13509a046d301 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-09-21T12:18:10.237 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:18:10.489 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:18:10 smithi003 ceph-mon[28057]: pgmap v195: 65 pgs: 65 active+clean; 579 KiB data, 167 MiB used, 536 GiB / 536 GiB avail; 5.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T12:18:10.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:18:10 smithi192 ceph-mon[35641]: pgmap v195: 65 pgs: 65 active+clean; 579 KiB data, 167 MiB used, 536 GiB / 536 GiB avail; 5.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-21T12:18:10.701 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:10.689+0000 7fe062612640 1 -- 172.21.15.3:0/2035294882 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe05c101960 msgr2=0x7fe05c101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:18:10.702 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:10.689+0000 7fe062612640 1 --2- 172.21.15.3:0/2035294882 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe05c101960 0x7fe05c101d60 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe04c009880 tx=0x7fe04c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:18:10.702 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:10.689+0000 7fe062612640 1 -- 172.21.15.3:0/2035294882 shutdown_connections 2024-09-21T12:18:10.702 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:10.689+0000 7fe062612640 1 --2- 172.21.15.3:0/2035294882 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe05c102b60 0x7fe05c102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:10.702 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:10.689+0000 7fe062612640 1 --2- 172.21.15.3:0/2035294882 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe05c101960 0x7fe05c101d60 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:10.702 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:10.689+0000 7fe062612640 1 -- 172.21.15.3:0/2035294882 >> 172.21.15.3:0/2035294882 conn(0x7fe05c0fd0f0 msgr2=0x7fe05c0ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:18:10.702 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:10.689+0000 7fe062612640 1 -- 172.21.15.3:0/2035294882 shutdown_connections 2024-09-21T12:18:10.702 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:10.689+0000 7fe062612640 1 -- 172.21.15.3:0/2035294882 wait complete. 2024-09-21T12:18:10.702 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:10.690+0000 7fe062612640 1 Processor -- start 2024-09-21T12:18:10.702 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:10.690+0000 7fe062612640 1 -- start start 2024-09-21T12:18:10.703 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:10.690+0000 7fe062612640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe05c101960 0x7fe05c197530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:18:10.703 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:10.690+0000 7fe062612640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe05c102b60 0x7fe05c197a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:18:10.703 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:10.690+0000 7fe062612640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fe05c10a800 con 0x7fe05c101960 2024-09-21T12:18:10.703 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:10.690+0000 7fe062612640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe05c10a680 con 0x7fe05c102b60 2024-09-21T12:18:10.703 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:10.690+0000 7fe05bfff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe05c101960 0x7fe05c197530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:18:10.703 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:10.690+0000 7fe05bfff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe05c101960 0x7fe05c197530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35862/0 (socket says 172.21.15.3:35862) 2024-09-21T12:18:10.703 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:10.690+0000 7fe05bfff640 1 -- 172.21.15.3:0/1115529527 learned_addr learned my addr 172.21.15.3:0/1115529527 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:18:10.703 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:10.691+0000 7fe05b7fe640 1 --2- 172.21.15.3:0/1115529527 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe05c102b60 0x7fe05c197a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:18:10.703 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:10.691+0000 7fe05bfff640 1 -- 172.21.15.3:0/1115529527 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe05c102b60 msgr2=0x7fe05c197a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:18:10.703 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:10.691+0000 7fe05bfff640 1 --2- 172.21.15.3:0/1115529527 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe05c102b60 0x7fe05c197a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:10.703 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:10.691+0000 7fe05bfff640 1 -- 172.21.15.3:0/1115529527 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe05c1980f0 con 0x7fe05c101960 2024-09-21T12:18:10.703 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:10.691+0000 7fe05bfff640 1 --2- 172.21.15.3:0/1115529527 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe05c101960 0x7fe05c197530 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe04c006010 tx=0x7fe04c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:18:10.704 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:10.691+0000 7fe0597fa640 1 -- 172.21.15.3:0/1115529527 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe04c03f070 con 0x7fe05c101960 2024-09-21T12:18:10.704 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:10.691+0000 7fe062612640 1 -- 172.21.15.3:0/1115529527 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe05c19cad0 con 0x7fe05c101960 2024-09-21T12:18:10.704 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:10.691+0000 7fe0597fa640 1 -- 172.21.15.3:0/1115529527 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe04c0044d0 con 0x7fe05c101960 2024-09-21T12:18:10.704 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:10.691+0000 7fe062612640 1 -- 172.21.15.3:0/1115529527 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe05c19d060 con 0x7fe05c101960 2024-09-21T12:18:10.704 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:10.691+0000 7fe0597fa640 1 -- 172.21.15.3:0/1115529527 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe04c035030 con 0x7fe05c101960 2024-09-21T12:18:10.704 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:10.692+0000 7fe062612640 1 -- 172.21.15.3:0/1115529527 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe05c101d60 con 0x7fe05c101960 2024-09-21T12:18:10.704 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:10.693+0000 7fe0597fa640 1 -- 172.21.15.3:0/1115529527 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 19) ==== 92549+0+0 (secure 0 0 0) 0x7fe04c042070 con 0x7fe05c101960 2024-09-21T12:18:10.704 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:10.693+0000 7fe0597fa640 1 --2- 172.21.15.3:0/1115529527 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fe04406e310 0x7fe0440707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:18:10.704 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:10.693+0000 7fe0597fa640 1 -- 172.21.15.3:0/1115529527 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5554+0+0 (secure 0 0 0) 0x7fe04c0aedb0 con 0x7fe05c101960 2024-09-21T12:18:10.704 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:10.693+0000 7fe05b7fe640 1 --2- 172.21.15.3:0/1115529527 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fe04406e310 0x7fe0440707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:18:10.704 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:10.694+0000 7fe05b7fe640 1 --2- 172.21.15.3:0/1115529527 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fe04406e310 0x7fe0440707d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe05c1989e0 tx=0x7fe050008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:18:10.704 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:10.698+0000 7fe0597fa640 1 -- 172.21.15.3:0/1115529527 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe04c07c730 con 0x7fe05c101960 2024-09-21T12:18:10.877 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:10.875+0000 7fe062612640 1 -- 172.21.15.3:0/1115529527 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) -- 0x7fe05c191610 con 0x7fe05c101960 2024-09-21T12:18:10.877 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:10.875+0000 7fe0597fa640 1 -- 172.21.15.3:0/1115529527 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v40)=0 v40) ==== 163+0+0 (secure 0 0 0) 0x7fe04c0803e0 con 0x7fe05c101960 2024-09-21T12:18:10.879 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:10.877+0000 7fe062612640 1 -- 172.21.15.3:0/1115529527 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fe04406e310 msgr2=0x7fe0440707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:18:10.879 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:10.877+0000 7fe062612640 1 --2- 172.21.15.3:0/1115529527 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fe04406e310 0x7fe0440707d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe05c1989e0 tx=0x7fe050008040 comp rx=0 tx=0).stop 2024-09-21T12:18:10.879 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:10.877+0000 7fe062612640 1 -- 172.21.15.3:0/1115529527 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe05c101960 msgr2=0x7fe05c197530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:18:10.879 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:10.877+0000 7fe062612640 1 --2- 172.21.15.3:0/1115529527 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe05c101960 0x7fe05c197530 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe04c006010 tx=0x7fe04c0048f0 comp rx=0 tx=0).stop 2024-09-21T12:18:10.879 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:10.877+0000 7fe062612640 1 -- 172.21.15.3:0/1115529527 shutdown_connections 2024-09-21T12:18:10.879 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:10.877+0000 7fe062612640 1 --2- 172.21.15.3:0/1115529527 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fe04406e310 0x7fe0440707d0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:10.879 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:10.877+0000 7fe062612640 1 --2- 172.21.15.3:0/1115529527 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe05c102b60 0x7fe05c197a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:10.880 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:10.877+0000 7fe062612640 1 --2- 172.21.15.3:0/1115529527 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe05c101960 0x7fe05c197530 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:10.880 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:10.877+0000 7fe062612640 1 -- 172.21.15.3:0/1115529527 >> 172.21.15.3:0/1115529527 conn(0x7fe05c0fd0f0 msgr2=0x7fe05c106070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:18:10.880 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:10.878+0000 7fe062612640 1 -- 172.21.15.3:0/1115529527 shutdown_connections 2024-09-21T12:18:10.880 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:10.878+0000 7fe062612640 1 -- 172.21.15.3:0/1115529527 wait complete. 2024-09-21T12:18:11.534 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -e sha1=5c1cdc3c470dae78e91a0ed2bcf13509a046d301 -- bash -c 'ceph config set global log_to_journald false --force' 2024-09-21T12:18:11.793 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:18:12.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:12.279+0000 7f7fe5ce8640 1 -- 172.21.15.3:0/3676019512 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7fe00ffc20 msgr2=0x7f7fe0100020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:18:12.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:12.279+0000 7f7fe5ce8640 1 --2- 172.21.15.3:0/3676019512 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7fe00ffc20 0x7f7fe0100020 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f7fd0009880 tx=0x7f7fd002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:18:12.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:12.279+0000 7f7fe5ce8640 1 -- 172.21.15.3:0/3676019512 shutdown_connections 2024-09-21T12:18:12.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:12.279+0000 7f7fe5ce8640 1 --2- 172.21.15.3:0/3676019512 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7fe0102c00 0x7f7fe0103080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:12.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:12.279+0000 7f7fe5ce8640 1 --2- 172.21.15.3:0/3676019512 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7fe00ffc20 0x7f7fe0100020 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:12.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:12.279+0000 7f7fe5ce8640 1 -- 172.21.15.3:0/3676019512 >> 172.21.15.3:0/3676019512 conn(0x7f7fe00fb770 msgr2=0x7f7fe00fdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:18:12.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:12.279+0000 7f7fe5ce8640 1 -- 172.21.15.3:0/3676019512 shutdown_connections 2024-09-21T12:18:12.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:12.279+0000 7f7fe5ce8640 1 -- 172.21.15.3:0/3676019512 wait complete. 2024-09-21T12:18:12.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:12.280+0000 7f7fe5ce8640 1 Processor -- start 2024-09-21T12:18:12.293 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:12.280+0000 7f7fe5ce8640 1 -- start start 2024-09-21T12:18:12.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:12.280+0000 7f7fe5ce8640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7fe00ffc20 0x7f7fe01024f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:18:12.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:12.280+0000 7f7fe5ce8640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7fe0102c00 0x7f7fe0100bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:18:12.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:12.280+0000 7f7fe5ce8640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe010a800 con 0x7f7fe0102c00 2024-09-21T12:18:12.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:12.280+0000 7f7fe5ce8640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7fe010a680 con 0x7f7fe00ffc20 2024-09-21T12:18:12.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:12.280+0000 7f7fd7fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7fe0102c00 0x7f7fe0100bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:18:12.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:12.280+0000 7f7fd7fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7fe0102c00 0x7f7fe0100bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35878/0 (socket says 172.21.15.3:35878) 2024-09-21T12:18:12.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:12.280+0000 7f7fd7fff640 1 -- 172.21.15.3:0/2040971663 learned_addr learned my addr 172.21.15.3:0/2040971663 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:18:12.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:12.281+0000 7f7fdf7fe640 1 --2- 172.21.15.3:0/2040971663 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7fe00ffc20 0x7f7fe01024f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:18:12.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:12.281+0000 7f7fd7fff640 1 -- 172.21.15.3:0/2040971663 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7fe00ffc20 msgr2=0x7f7fe01024f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:18:12.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:12.281+0000 7f7fd7fff640 1 --2- 172.21.15.3:0/2040971663 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7fe00ffc20 0x7f7fe01024f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:12.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:12.281+0000 7f7fd7fff640 1 -- 172.21.15.3:0/2040971663 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fe01010f0 con 0x7f7fe0102c00 2024-09-21T12:18:12.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:12.281+0000 7f7fd7fff640 1 --2- 172.21.15.3:0/2040971663 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7fe0102c00 0x7f7fe0100bb0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f7fc800b420 tx=0x7f7fc800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:18:12.294 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:12.281+0000 7f7fdd7fa640 1 -- 172.21.15.3:0/2040971663 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7fc8011630 con 0x7f7fe0102c00 2024-09-21T12:18:12.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:12.281+0000 7f7fdd7fa640 1 -- 172.21.15.3:0/2040971663 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7fc8016070 con 0x7f7fe0102c00 2024-09-21T12:18:12.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:12.281+0000 7f7fe5ce8640 1 -- 172.21.15.3:0/2040971663 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fe01013e0 con 0x7f7fe0102c00 2024-09-21T12:18:12.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:12.281+0000 7f7fdd7fa640 1 -- 172.21.15.3:0/2040971663 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7fc8010d40 con 0x7f7fe0102c00 2024-09-21T12:18:12.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:12.281+0000 7f7fe5ce8640 1 -- 172.21.15.3:0/2040971663 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fe01019f0 con 0x7f7fe0102c00 2024-09-21T12:18:12.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:12.282+0000 7f7fe5ce8640 1 -- 172.21.15.3:0/2040971663 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fe0100020 con 0x7f7fe0102c00 2024-09-21T12:18:12.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:12.283+0000 7f7fdd7fa640 1 -- 172.21.15.3:0/2040971663 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 19) ==== 92549+0+0 (secure 0 0 0) 0x7f7fc801b460 con 0x7f7fe0102c00 2024-09-21T12:18:12.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:12.283+0000 7f7fdd7fa640 1 --2- 172.21.15.3:0/2040971663 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f7fcc06e2b0 0x7f7fcc070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:18:12.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:12.283+0000 7f7fdd7fa640 1 -- 172.21.15.3:0/2040971663 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5554+0+0 (secure 0 0 0) 0x7f7fc808da40 con 0x7f7fe0102c00 2024-09-21T12:18:12.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:12.283+0000 7f7fdf7fe640 1 --2- 172.21.15.3:0/2040971663 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f7fcc06e2b0 0x7f7fcc070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:18:12.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:12.284+0000 7f7fdf7fe640 1 --2- 172.21.15.3:0/2040971663 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f7fcc06e2b0 0x7f7fcc070770 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7fd0000c00 tx=0x7f7fd0005a20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:18:12.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:12.287+0000 7f7fdd7fa640 1 -- 172.21.15.3:0/2040971663 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7fc805b340 con 0x7f7fe0102c00 2024-09-21T12:18:12.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:18:12 smithi003 ceph-mon[28057]: pgmap v196: 65 pgs: 65 active+clean; 585 KiB data, 167 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-21T12:18:12.466 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:12.464+0000 7f7fe5ce8640 1 -- 172.21.15.3:0/2040971663 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) -- 0x7f7fe0062df0 con 0x7f7fe0102c00 2024-09-21T12:18:12.466 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:12.464+0000 7f7fdd7fa640 1 -- 172.21.15.3:0/2040971663 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v40)=0 v40) ==== 135+0+0 (secure 0 0 0) 0x7f7fc805eff0 con 0x7f7fe0102c00 2024-09-21T12:18:12.468 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:12.466+0000 7f7fe5ce8640 1 -- 172.21.15.3:0/2040971663 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f7fcc06e2b0 msgr2=0x7f7fcc070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:18:12.468 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:12.466+0000 7f7fe5ce8640 1 --2- 172.21.15.3:0/2040971663 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f7fcc06e2b0 0x7f7fcc070770 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7fd0000c00 tx=0x7f7fd0005a20 comp rx=0 tx=0).stop 2024-09-21T12:18:12.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:12.466+0000 7f7fe5ce8640 1 -- 172.21.15.3:0/2040971663 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7fe0102c00 msgr2=0x7f7fe0100bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:18:12.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:12.466+0000 7f7fe5ce8640 1 --2- 172.21.15.3:0/2040971663 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7fe0102c00 0x7f7fe0100bb0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f7fc800b420 tx=0x7f7fc800b8e0 comp rx=0 tx=0).stop 2024-09-21T12:18:12.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:12.466+0000 7f7fe5ce8640 1 -- 172.21.15.3:0/2040971663 shutdown_connections 2024-09-21T12:18:12.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:12.466+0000 7f7fe5ce8640 1 --2- 172.21.15.3:0/2040971663 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f7fcc06e2b0 0x7f7fcc070770 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:12.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:12.466+0000 7f7fe5ce8640 1 --2- 172.21.15.3:0/2040971663 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7fe0102c00 0x7f7fe0100bb0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:12.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:12.466+0000 7f7fe5ce8640 1 --2- 172.21.15.3:0/2040971663 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7fe00ffc20 0x7f7fe01024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:12.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:12.466+0000 7f7fe5ce8640 1 -- 172.21.15.3:0/2040971663 >> 172.21.15.3:0/2040971663 conn(0x7f7fe00fb770 msgr2=0x7f7fe01060b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:18:12.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:12.466+0000 7f7fe5ce8640 1 -- 172.21.15.3:0/2040971663 shutdown_connections 2024-09-21T12:18:12.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:12.467+0000 7f7fe5ce8640 1 -- 172.21.15.3:0/2040971663 wait complete. 2024-09-21T12:18:12.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:18:12 smithi192 ceph-mon[35641]: pgmap v196: 65 pgs: 65 active+clean; 585 KiB data, 167 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 767 B/s wr, 2 op/s 2024-09-21T12:18:13.127 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -e sha1=5c1cdc3c470dae78e91a0ed2bcf13509a046d301 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr' 2024-09-21T12:18:13.388 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:18:13.884 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:13.880+0000 7f0b172e2640 1 -- 172.21.15.3:0/3366568764 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0b10100860 msgr2=0x7f0b10100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:18:13.884 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:13.880+0000 7f0b172e2640 1 --2- 172.21.15.3:0/3366568764 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0b10100860 0x7f0b10100c60 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c009880 tx=0x7f0b0c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:18:13.884 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:13.880+0000 7f0b172e2640 1 -- 172.21.15.3:0/3366568764 shutdown_connections 2024-09-21T12:18:13.884 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:13.880+0000 7f0b172e2640 1 --2- 172.21.15.3:0/3366568764 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b10101a60 0x7f0b10101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:13.884 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:13.880+0000 7f0b172e2640 1 --2- 172.21.15.3:0/3366568764 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0b10100860 0x7f0b10100c60 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:13.884 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:13.880+0000 7f0b172e2640 1 -- 172.21.15.3:0/3366568764 >> 172.21.15.3:0/3366568764 conn(0x7f0b100fc010 msgr2=0x7f0b100fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:18:13.884 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:13.880+0000 7f0b172e2640 1 -- 172.21.15.3:0/3366568764 shutdown_connections 2024-09-21T12:18:13.884 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:13.880+0000 7f0b172e2640 1 -- 172.21.15.3:0/3366568764 wait complete. 2024-09-21T12:18:13.884 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:13.881+0000 7f0b172e2640 1 Processor -- start 2024-09-21T12:18:13.884 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:13.881+0000 7f0b172e2640 1 -- start start 2024-09-21T12:18:13.885 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:13.881+0000 7f0b172e2640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0b10100860 0x7f0b10197580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:18:13.885 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:13.881+0000 7f0b172e2640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b10101a60 0x7f0b10197ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:18:13.885 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:13.881+0000 7f0b172e2640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f0b10109700 con 0x7f0b10100860 2024-09-21T12:18:13.885 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:13.881+0000 7f0b172e2640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0b10109580 con 0x7f0b10101a60 2024-09-21T12:18:13.885 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:13.881+0000 7f0b1507e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0b10100860 0x7f0b10197580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:18:13.885 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:13.881+0000 7f0b1507e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0b10100860 0x7f0b10197580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35892/0 (socket says 172.21.15.3:35892) 2024-09-21T12:18:13.885 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:13.881+0000 7f0b1507e640 1 -- 172.21.15.3:0/3771813817 learned_addr learned my addr 172.21.15.3:0/3771813817 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:18:13.885 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:13.881+0000 7f0b1487d640 1 --2- 172.21.15.3:0/3771813817 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b10101a60 0x7f0b10197ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:18:13.885 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:13.882+0000 7f0b1507e640 1 -- 172.21.15.3:0/3771813817 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b10101a60 msgr2=0x7f0b10197ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:18:13.885 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:13.882+0000 7f0b1507e640 1 --2- 172.21.15.3:0/3771813817 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b10101a60 0x7f0b10197ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:18:13.885 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:13.882+0000 7f0b1507e640 1 -- 172.21.15.3:0/3771813817 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b10198140 con 0x7f0b10100860 2024-09-21T12:18:13.885 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:13.882+0000 7f0b1487d640 1 --2- 172.21.15.3:0/3771813817 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b10101a60 0x7f0b10197ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T12:18:13.885 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:13.882+0000 7f0b1507e640 1 --2- 172.21.15.3:0/3771813817 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0b10100860 0x7f0b10197580 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c006010 tx=0x7f0b0c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:18:13.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:13.882+0000 7f0b067fc640 1 -- 172.21.15.3:0/3771813817 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0b0c03f070 con 0x7f0b10100860 2024-09-21T12:18:13.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:13.882+0000 7f0b067fc640 1 -- 172.21.15.3:0/3771813817 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0b0c0044d0 con 0x7f0b10100860 2024-09-21T12:18:13.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:13.882+0000 7f0b172e2640 1 -- 172.21.15.3:0/3771813817 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b1019cb20 con 0x7f0b10100860 2024-09-21T12:18:13.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:13.882+0000 7f0b067fc640 1 -- 172.21.15.3:0/3771813817 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0b0c035030 con 0x7f0b10100860 2024-09-21T12:18:13.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:13.882+0000 7f0b172e2640 1 -- 172.21.15.3:0/3771813817 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b1019d0b0 con 0x7f0b10100860 2024-09-21T12:18:13.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:13.883+0000 7f0b172e2640 1 -- 172.21.15.3:0/3771813817 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b10100c60 con 0x7f0b10100860 2024-09-21T12:18:13.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:13.884+0000 7f0b067fc640 1 -- 172.21.15.3:0/3771813817 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 19) ==== 92549+0+0 (secure 0 0 0) 0x7f0b0c042070 con 0x7f0b10100860 2024-09-21T12:18:13.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:13.884+0000 7f0b067fc640 1 --2- 172.21.15.3:0/3771813817 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f0afc06e310 0x7f0afc0707d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:18:13.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:13.884+0000 7f0b1487d640 1 --2- 172.21.15.3:0/3771813817 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f0afc06e310 0x7f0afc0707d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:18:13.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:13.884+0000 7f0b067fc640 1 -- 172.21.15.3:0/3771813817 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5554+0+0 (secure 0 0 0) 0x7f0b0c0aedb0 con 0x7f0b10100860 2024-09-21T12:18:13.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:13.885+0000 7f0b1487d640 1 --2- 172.21.15.3:0/3771813817 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f0afc06e310 0x7f0afc0707d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0b00006fd0 tx=0x7f0b00008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:18:13.890 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:13.889+0000 7f0b067fc640 1 -- 172.21.15.3:0/3771813817 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0b0c07c730 con 0x7f0b10100860 2024-09-21T12:18:14.085 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:18:14.083+0000 7f0b172e2640 1 -- 172.21.15.3:0/3771813817 --> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:5c1cdc3c470dae78e91a0ed2bcf13509a046d301", "daemon_types": "mgr", "target": ["mon-mgr", ""]}) -- 0x7f0b1006a930 con 0x7f0afc06e310 2024-09-21T12:18:14.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:18:14 smithi192 ceph-mon[35641]: pgmap v197: 65 pgs: 65 active+clean; 585 KiB data, 167 MiB used, 536 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-09-21T12:18:14.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:18:14 smithi003 ceph-mon[28057]: pgmap v197: 65 pgs: 65 active+clean; 585 KiB data, 167 MiB used, 536 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-09-21T12:18:15.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:18:15 smithi192 ceph-mon[35641]: from='client.14624 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:5c1cdc3c470dae78e91a0ed2bcf13509a046d301", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:18:15.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:18:15 smithi003 ceph-mon[28057]: from='client.14624 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:5c1cdc3c470dae78e91a0ed2bcf13509a046d301", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:18:16.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:18:16 smithi003 ceph-mon[28057]: pgmap v198: 65 pgs: 65 active+clean; 585 KiB data, 167 MiB used, 536 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-09-21T12:18:16.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:18:16 smithi192 ceph-mon[35641]: pgmap v198: 65 pgs: 65 active+clean; 585 KiB data, 167 MiB used, 536 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-09-21T12:18:17.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:18:17 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:18:17.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:18:17 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:18:18.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:18:18 smithi192 ceph-mon[35641]: pgmap v199: 65 pgs: 65 active+clean; 585 KiB data, 167 MiB used, 536 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-09-21T12:18:18.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:18:18 smithi003 ceph-mon[28057]: pgmap v199: 65 pgs: 65 active+clean; 585 KiB data, 167 MiB used, 536 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-09-21T12:18:20.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:18:20 smithi192 ceph-mon[35641]: pgmap v200: 65 pgs: 65 active+clean; 585 KiB data, 167 MiB used, 536 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-09-21T12:18:20.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:18:20 smithi003 ceph-mon[28057]: pgmap v200: 65 pgs: 65 active+clean; 585 KiB data, 167 MiB used, 536 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-09-21T12:18:22.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:18:22 smithi192 ceph-mon[35641]: pgmap v201: 65 pgs: 65 active+clean; 588 KiB data, 167 MiB used, 536 GiB / 536 GiB avail; 1023 B/s wr, 0 op/s 2024-09-21T12:18:22.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:18:22 smithi003 ceph-mon[28057]: pgmap v201: 65 pgs: 65 active+clean; 588 KiB data, 167 MiB used, 536 GiB / 536 GiB avail; 1023 B/s wr, 0 op/s 2024-09-21T12:18:24.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:18:24 smithi192 ceph-mon[35641]: pgmap v202: 65 pgs: 65 active+clean; 588 KiB data, 167 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-09-21T12:18:24.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:18:24 smithi003 ceph-mon[28057]: pgmap v202: 65 pgs: 65 active+clean; 588 KiB data, 167 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-09-21T12:18:26.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:18:26 smithi192 ceph-mon[35641]: pgmap v203: 65 pgs: 65 active+clean; 588 KiB data, 167 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-09-21T12:18:26.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:18:26 smithi003 ceph-mon[28057]: pgmap v203: 65 pgs: 65 active+clean; 588 KiB data, 167 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-09-21T12:18:28.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:18:28 smithi192 ceph-mon[35641]: pgmap v204: 65 pgs: 65 active+clean; 588 KiB data, 167 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-09-21T12:18:28.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:18:28 smithi003 ceph-mon[28057]: pgmap v204: 65 pgs: 65 active+clean; 588 KiB data, 167 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-09-21T12:18:30.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:18:30 smithi192 ceph-mon[35641]: pgmap v205: 65 pgs: 65 active+clean; 588 KiB data, 167 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-09-21T12:18:30.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:18:30 smithi003 ceph-mon[28057]: pgmap v205: 65 pgs: 65 active+clean; 588 KiB data, 167 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-09-21T12:18:32.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:18:32 smithi192 ceph-mon[35641]: pgmap v206: 65 pgs: 65 active+clean; 588 KiB data, 167 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-09-21T12:18:32.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:18:32 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:18:32.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:18:32 smithi003 ceph-mon[28057]: pgmap v206: 65 pgs: 65 active+clean; 588 KiB data, 167 MiB used, 536 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-09-21T12:18:32.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:18:32 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:18:34.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:18:34 smithi192 ceph-mon[35641]: pgmap v207: 65 pgs: 65 active+clean; 588 KiB data, 167 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:18:34.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:18:34 smithi003 ceph-mon[28057]: pgmap v207: 65 pgs: 65 active+clean; 588 KiB data, 167 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:18:36.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:18:36 smithi192 ceph-mon[35641]: pgmap v208: 65 pgs: 65 active+clean; 588 KiB data, 167 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:18:36.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:18:36 smithi003 ceph-mon[28057]: pgmap v208: 65 pgs: 65 active+clean; 588 KiB data, 167 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:18:38.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:18:38 smithi192 ceph-mon[35641]: pgmap v209: 65 pgs: 65 active+clean; 588 KiB data, 167 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:18:38.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:18:38 smithi003 ceph-mon[28057]: pgmap v209: 65 pgs: 65 active+clean; 588 KiB data, 167 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:18:40.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:18:40 smithi192 ceph-mon[35641]: pgmap v210: 65 pgs: 65 active+clean; 588 KiB data, 167 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:18:40.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:18:40 smithi003 ceph-mon[28057]: pgmap v210: 65 pgs: 65 active+clean; 588 KiB data, 167 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:18:42.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:18:42 smithi192 ceph-mon[35641]: pgmap v211: 65 pgs: 65 active+clean; 588 KiB data, 167 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:18:42.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:18:42 smithi003 ceph-mon[28057]: pgmap v211: 65 pgs: 65 active+clean; 588 KiB data, 167 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:18:44.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:18:44 smithi192 ceph-mon[35641]: pgmap v212: 65 pgs: 65 active+clean; 588 KiB data, 167 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:18:44.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:18:44 smithi003 ceph-mon[28057]: pgmap v212: 65 pgs: 65 active+clean; 588 KiB data, 167 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:18:46.249 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:18:46 smithi192 ceph-mon[35641]: pgmap v213: 65 pgs: 65 active+clean; 588 KiB data, 167 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:18:46.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:18:46 smithi003 ceph-mon[28057]: pgmap v213: 65 pgs: 65 active+clean; 588 KiB data, 167 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:18:47.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:18:47 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:18:47.581 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:18:47 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:18:48.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:18:48 smithi192 ceph-mon[35641]: pgmap v214: 65 pgs: 65 active+clean; 588 KiB data, 167 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:18:48.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:18:48 smithi003 ceph-mon[28057]: pgmap v214: 65 pgs: 65 active+clean; 588 KiB data, 167 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:18:50.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:18:50 smithi003 ceph-mon[28057]: pgmap v215: 65 pgs: 65 active+clean; 588 KiB data, 167 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:18:50.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:18:50 smithi192 ceph-mon[35641]: pgmap v215: 65 pgs: 65 active+clean; 588 KiB data, 167 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:18:52.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:18:52 smithi003 ceph-mon[28057]: pgmap v216: 65 pgs: 65 active+clean; 588 KiB data, 167 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:18:52.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:18:52 smithi192 ceph-mon[35641]: pgmap v216: 65 pgs: 65 active+clean; 588 KiB data, 167 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:18:54.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:18:54 smithi003 ceph-mon[28057]: pgmap v217: 65 pgs: 65 active+clean; 588 KiB data, 167 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:18:54.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:18:54 smithi192 ceph-mon[35641]: pgmap v217: 65 pgs: 65 active+clean; 588 KiB data, 167 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:18:56.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:18:56 smithi003 ceph-mon[28057]: pgmap v218: 65 pgs: 65 active+clean; 588 KiB data, 167 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:18:56.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:18:56 smithi192 ceph-mon[35641]: pgmap v218: 65 pgs: 65 active+clean; 588 KiB data, 167 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:18:58.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:18:58 smithi003 ceph-mon[28057]: pgmap v219: 65 pgs: 65 active+clean; 588 KiB data, 167 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:18:58.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:18:58 smithi192 ceph-mon[35641]: pgmap v219: 65 pgs: 65 active+clean; 588 KiB data, 167 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:19:00.559 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:19:00 smithi192 ceph-mon[35641]: pgmap v220: 65 pgs: 65 active+clean; 588 KiB data, 167 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:19:00.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:19:00 smithi003 ceph-mon[28057]: pgmap v220: 65 pgs: 65 active+clean; 588 KiB data, 167 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:19:02.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:19:02 smithi003 ceph-mon[28057]: pgmap v221: 65 pgs: 65 active+clean; 588 KiB data, 167 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:19:02.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:19:02 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:19:02.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:19:02 smithi192 ceph-mon[35641]: pgmap v221: 65 pgs: 65 active+clean; 588 KiB data, 167 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:19:02.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:19:02 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:19:04.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:19:04 smithi003 ceph-mon[28057]: pgmap v222: 65 pgs: 65 active+clean; 588 KiB data, 167 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:19:04.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:19:04 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:19:04.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:19:04 smithi192 ceph-mon[35641]: pgmap v222: 65 pgs: 65 active+clean; 588 KiB data, 167 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:19:04.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:19:04 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:19:06.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:19:06 smithi003 ceph-mon[28057]: pgmap v223: 65 pgs: 65 active+clean; 588 KiB data, 167 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:19:06.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:19:06 smithi192 ceph-mon[35641]: pgmap v223: 65 pgs: 65 active+clean; 588 KiB data, 167 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:19:08.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:19:08 smithi003 ceph-mon[28057]: pgmap v224: 65 pgs: 65 active+clean; 588 KiB data, 167 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:19:08.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:19:08 smithi192 ceph-mon[35641]: pgmap v224: 65 pgs: 65 active+clean; 588 KiB data, 167 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:19:10.386 INFO:tasks.workunit.client.1.smithi192.stderr:Note: switching to '5c1cdc3c470dae78e91a0ed2bcf13509a046d301'. 2024-09-21T12:19:10.386 INFO:tasks.workunit.client.1.smithi192.stderr: 2024-09-21T12:19:10.387 INFO:tasks.workunit.client.1.smithi192.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-21T12:19:10.387 INFO:tasks.workunit.client.1.smithi192.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-21T12:19:10.387 INFO:tasks.workunit.client.1.smithi192.stderr:state without impacting any branches by switching back to a branch. 2024-09-21T12:19:10.387 INFO:tasks.workunit.client.1.smithi192.stderr: 2024-09-21T12:19:10.387 INFO:tasks.workunit.client.1.smithi192.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-21T12:19:10.387 INFO:tasks.workunit.client.1.smithi192.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-21T12:19:10.387 INFO:tasks.workunit.client.1.smithi192.stderr: 2024-09-21T12:19:10.387 INFO:tasks.workunit.client.1.smithi192.stderr: git switch -c 2024-09-21T12:19:10.387 INFO:tasks.workunit.client.1.smithi192.stderr: 2024-09-21T12:19:10.387 INFO:tasks.workunit.client.1.smithi192.stderr:Or undo this operation with: 2024-09-21T12:19:10.387 INFO:tasks.workunit.client.1.smithi192.stderr: 2024-09-21T12:19:10.387 INFO:tasks.workunit.client.1.smithi192.stderr: git switch - 2024-09-21T12:19:10.387 INFO:tasks.workunit.client.1.smithi192.stderr: 2024-09-21T12:19:10.388 INFO:tasks.workunit.client.1.smithi192.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-21T12:19:10.388 INFO:tasks.workunit.client.1.smithi192.stderr: 2024-09-21T12:19:10.388 INFO:tasks.workunit.client.1.smithi192.stderr:HEAD is now at 5c1cdc3c470 ceph-volume: fix OSD lvm/tpm2 activation 2024-09-21T12:19:10.392 DEBUG:teuthology.orchestra.run.smithi192:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-09-21T12:19:10.458 INFO:tasks.workunit.client.1.smithi192.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-21T12:19:10.460 INFO:tasks.workunit.client.1.smithi192.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-21T12:19:10.460 INFO:tasks.workunit.client.1.smithi192.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-21T12:19:10.538 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:19:10 smithi003 ceph-mon[28057]: pgmap v225: 65 pgs: 65 active+clean; 588 KiB data, 167 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:19:10.538 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:19:10 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:19:10.539 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:19:10 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:19:10.539 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:19:10 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:19:10.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:19:10 smithi192 ceph-mon[35641]: pgmap v225: 65 pgs: 65 active+clean; 588 KiB data, 167 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:19:10.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:19:10 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:19:10.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:19:10 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:19:10.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:19:10 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:19:11.104 INFO:tasks.workunit.client.1.smithi192.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-21T12:19:11.181 INFO:tasks.workunit.client.1.smithi192.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-21T12:19:11.222 INFO:tasks.workunit.client.1.smithi192.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-21T12:19:11.224 INFO:tasks.workunit.client.1.smithi192.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-21T12:19:11.224 INFO:tasks.workunit.client.1.smithi192.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-21T12:19:11.264 INFO:tasks.workunit.client.1.smithi192.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-21T12:19:11.267 DEBUG:teuthology.orchestra.run.smithi192:> set -ex 2024-09-21T12:19:11.267 DEBUG:teuthology.orchestra.run.smithi192:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-09-21T12:19:11.284 INFO:teuthology.orchestra.run.smithi003.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:5c1cdc3c470dae78e91a0ed2bcf13509a046d301 2024-09-21T12:19:11.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:11.282+0000 7f0b067fc640 1 -- 172.21.15.3:0/3771813817 <== mgr.14217 v2:172.21.15.3:6800/2480880781 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+89 (secure 0 0 0) 0x7f0b1006a930 con 0x7f0afc06e310 2024-09-21T12:19:11.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:11.285+0000 7f0b172e2640 1 -- 172.21.15.3:0/3771813817 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f0afc06e310 msgr2=0x7f0afc0707d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:19:11.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:11.285+0000 7f0b172e2640 1 --2- 172.21.15.3:0/3771813817 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f0afc06e310 0x7f0afc0707d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f0b00006fd0 tx=0x7f0b00008040 comp rx=0 tx=0).stop 2024-09-21T12:19:11.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:11.285+0000 7f0b172e2640 1 -- 172.21.15.3:0/3771813817 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0b10100860 msgr2=0x7f0b10197580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:19:11.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:11.285+0000 7f0b172e2640 1 --2- 172.21.15.3:0/3771813817 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0b10100860 0x7f0b10197580 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f0b0c006010 tx=0x7f0b0c0048f0 comp rx=0 tx=0).stop 2024-09-21T12:19:11.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:11.286+0000 7f0b172e2640 1 -- 172.21.15.3:0/3771813817 shutdown_connections 2024-09-21T12:19:11.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:11.286+0000 7f0b172e2640 1 --2- 172.21.15.3:0/3771813817 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f0afc06e310 0x7f0afc0707d0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:11.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:11.286+0000 7f0b172e2640 1 --2- 172.21.15.3:0/3771813817 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0b10101a60 0x7f0b10197ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:11.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:11.286+0000 7f0b172e2640 1 --2- 172.21.15.3:0/3771813817 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0b10100860 0x7f0b10197580 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:11.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:11.286+0000 7f0b172e2640 1 -- 172.21.15.3:0/3771813817 >> 172.21.15.3:0/3771813817 conn(0x7f0b100fc010 msgr2=0x7f0b1006a220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:19:11.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:11.286+0000 7f0b172e2640 1 -- 172.21.15.3:0/3771813817 shutdown_connections 2024-09-21T12:19:11.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:11.286+0000 7f0b172e2640 1 -- 172.21.15.3:0/3771813817 wait complete. 2024-09-21T12:19:11.324 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-09-21T12:19:11.325 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-21T12:19:11.325 DEBUG:teuthology.orchestra.run.smithi192:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=5c1cdc3c470dae78e91a0ed2bcf13509a046d301 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-09-21T12:19:11.391 INFO:tasks.workunit.client.1.smithi192.stderr:+ mkdir -p fsstress 2024-09-21T12:19:11.393 INFO:tasks.workunit.client.1.smithi192.stderr:+ pushd fsstress 2024-09-21T12:19:11.394 INFO:tasks.workunit.client.1.smithi192.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-21T12:19:11.394 INFO:tasks.workunit.client.1.smithi192.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-21T12:19:11.937 INFO:tasks.workunit.client.1.smithi192.stderr:+ tar xzf ltp-full.tgz 2024-09-21T12:19:12.135 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -e sha1=5c1cdc3c470dae78e91a0ed2bcf13509a046d301 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2024-09-21T12:19:12.398 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:19:12 smithi003 ceph-mon[28057]: pgmap v226: 65 pgs: 65 active+clean; 588 KiB data, 167 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:19:12.398 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:19:12 smithi003 ceph-mon[28057]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:5c1cdc3c470dae78e91a0ed2bcf13509a046d301 2024-09-21T12:19:12.398 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:19:12 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:19:12.398 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:19:12 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:19:12.399 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:19:12 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:19:12.399 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:19:12 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:19:12.399 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:19:12 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:19:12.399 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:19:12 smithi003 ceph-mon[28057]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:5c1cdc3c470dae78e91a0ed2bcf13509a046d301 2024-09-21T12:19:12.546 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:19:12.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:19:12 smithi192 ceph-mon[35641]: pgmap v226: 65 pgs: 65 active+clean; 588 KiB data, 167 MiB used, 536 GiB / 536 GiB avail 2024-09-21T12:19:12.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:19:12 smithi192 ceph-mon[35641]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:5c1cdc3c470dae78e91a0ed2bcf13509a046d301 2024-09-21T12:19:12.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:19:12 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:19:12.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:19:12 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:19:12.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:19:12 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:19:12.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:19:12 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:19:12.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:19:12 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:19:12.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:19:12 smithi192 ceph-mon[35641]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:5c1cdc3c470dae78e91a0ed2bcf13509a046d301 2024-09-21T12:19:13.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.291+0000 7f9969cf0640 1 -- 172.21.15.3:0/1679474747 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9964101a60 msgr2=0x7f9964101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:19:13.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.291+0000 7f9969cf0640 1 --2- 172.21.15.3:0/1679474747 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9964101a60 0x7f9964101ee0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f995800d8e0 tx=0x7f995802c370 comp rx=0 tx=0).stop 2024-09-21T12:19:13.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.291+0000 7f9969cf0640 1 -- 172.21.15.3:0/1679474747 shutdown_connections 2024-09-21T12:19:13.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.291+0000 7f9969cf0640 1 --2- 172.21.15.3:0/1679474747 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9964101a60 0x7f9964101ee0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:13.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.291+0000 7f9969cf0640 1 --2- 172.21.15.3:0/1679474747 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9964100860 0x7f9964100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:13.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.291+0000 7f9969cf0640 1 -- 172.21.15.3:0/1679474747 >> 172.21.15.3:0/1679474747 conn(0x7f99640fc010 msgr2=0x7f99640fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:19:13.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.291+0000 7f9969cf0640 1 -- 172.21.15.3:0/1679474747 shutdown_connections 2024-09-21T12:19:13.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.291+0000 7f9969cf0640 1 -- 172.21.15.3:0/1679474747 wait complete. 2024-09-21T12:19:13.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.292+0000 7f9969cf0640 1 Processor -- start 2024-09-21T12:19:13.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.293+0000 7f9969cf0640 1 -- start start 2024-09-21T12:19:13.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.293+0000 7f9969cf0640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9964100860 0x7f99641952a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:19:13.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.294+0000 7f99637fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9964100860 0x7f99641952a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:19:13.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.294+0000 7f99637fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9964100860 0x7f99641952a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50022/0 (socket says 172.21.15.3:50022) 2024-09-21T12:19:13.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.294+0000 7f99637fe640 1 -- 172.21.15.3:0/852648529 learned_addr learned my addr 172.21.15.3:0/852648529 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:19:13.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.294+0000 7f9969cf0640 1 --2- 172.21.15.3:0/852648529 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9964101a60 0x7f99641957e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:19:13.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.294+0000 7f9969cf0640 1 -- 172.21.15.3:0/852648529 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f9964108570 con 0x7f9964100860 2024-09-21T12:19:13.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.294+0000 7f9962ffd640 1 --2- 172.21.15.3:0/852648529 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9964101a60 0x7f99641957e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:19:13.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.294+0000 7f9969cf0640 1 -- 172.21.15.3:0/852648529 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f99641083f0 con 0x7f9964101a60 2024-09-21T12:19:13.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.295+0000 7f99637fe640 1 -- 172.21.15.3:0/852648529 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9964101a60 msgr2=0x7f99641957e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:19:13.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.295+0000 7f99637fe640 1 --2- 172.21.15.3:0/852648529 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9964101a60 0x7f99641957e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:13.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.295+0000 7f99637fe640 1 -- 172.21.15.3:0/852648529 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9964195e60 con 0x7f9964100860 2024-09-21T12:19:13.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.295+0000 7f99637fe640 1 --2- 172.21.15.3:0/852648529 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9964100860 0x7f99641952a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f995400ecb0 tx=0x7f995400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:19:13.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.296+0000 7f9960ff9640 1 -- 172.21.15.3:0/852648529 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f995400cdb0 con 0x7f9964100860 2024-09-21T12:19:13.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.296+0000 7f9960ff9640 1 -- 172.21.15.3:0/852648529 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f995400eda0 con 0x7f9964100860 2024-09-21T12:19:13.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.296+0000 7f9960ff9640 1 -- 172.21.15.3:0/852648529 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9954018940 con 0x7f9964100860 2024-09-21T12:19:13.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.296+0000 7f9969cf0640 1 -- 172.21.15.3:0/852648529 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f996419a8a0 con 0x7f9964100860 2024-09-21T12:19:13.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.296+0000 7f9969cf0640 1 -- 172.21.15.3:0/852648529 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f996419ae80 con 0x7f9964100860 2024-09-21T12:19:13.300 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.299+0000 7f9969cf0640 1 -- 172.21.15.3:0/852648529 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9964100c60 con 0x7f9964100860 2024-09-21T12:19:13.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.299+0000 7f9960ff9640 1 -- 172.21.15.3:0/852648529 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 19) ==== 92549+0+0 (secure 0 0 0) 0x7f9954018ae0 con 0x7f9964100860 2024-09-21T12:19:13.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.300+0000 7f9960ff9640 1 --2- 172.21.15.3:0/852648529 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f994c06e360 0x7f994c070820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:19:13.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.301+0000 7f9960ff9640 1 -- 172.21.15.3:0/852648529 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5554+0+0 (secure 0 0 0) 0x7f995408e880 con 0x7f9964100860 2024-09-21T12:19:13.303 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.302+0000 7f9962ffd640 1 --2- 172.21.15.3:0/852648529 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f994c06e360 0x7f994c070820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:19:13.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.304+0000 7f9962ffd640 1 --2- 172.21.15.3:0/852648529 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f994c06e360 0x7f994c070820 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9958000c00 tx=0x7f995802e040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:19:13.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.312+0000 7f9960ff9640 1 -- 172.21.15.3:0/852648529 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9954054210 con 0x7f9964100860 2024-09-21T12:19:13.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.638+0000 7f9969cf0640 1 -- 172.21.15.3:0/852648529 --> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f99640626f0 con 0x7f994c06e360 2024-09-21T12:19:13.642 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.640+0000 7f9960ff9640 1 -- 172.21.15.3:0/852648529 <== mgr.14217 v2:172.21.15.3:6800/2480880781 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+351 (secure 0 0 0) 0x7f99640626f0 con 0x7f994c06e360 2024-09-21T12:19:13.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.643+0000 7f9969cf0640 1 -- 172.21.15.3:0/852648529 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f994c06e360 msgr2=0x7f994c070820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:19:13.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.644+0000 7f9969cf0640 1 --2- 172.21.15.3:0/852648529 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f994c06e360 0x7f994c070820 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9958000c00 tx=0x7f995802e040 comp rx=0 tx=0).stop 2024-09-21T12:19:13.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.644+0000 7f9969cf0640 1 -- 172.21.15.3:0/852648529 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9964100860 msgr2=0x7f99641952a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:19:13.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.644+0000 7f9969cf0640 1 --2- 172.21.15.3:0/852648529 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9964100860 0x7f99641952a0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f995400ecb0 tx=0x7f995400c6a0 comp rx=0 tx=0).stop 2024-09-21T12:19:13.646 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.644+0000 7f9969cf0640 1 -- 172.21.15.3:0/852648529 shutdown_connections 2024-09-21T12:19:13.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.645+0000 7f9969cf0640 1 --2- 172.21.15.3:0/852648529 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f994c06e360 0x7f994c070820 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:13.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.645+0000 7f9969cf0640 1 --2- 172.21.15.3:0/852648529 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9964101a60 0x7f99641957e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:13.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.645+0000 7f9969cf0640 1 --2- 172.21.15.3:0/852648529 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9964100860 0x7f99641952a0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:13.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.645+0000 7f9969cf0640 1 -- 172.21.15.3:0/852648529 >> 172.21.15.3:0/852648529 conn(0x7f99640fc010 msgr2=0x7f9964104fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:19:13.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.645+0000 7f9969cf0640 1 -- 172.21.15.3:0/852648529 shutdown_connections 2024-09-21T12:19:13.647 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.645+0000 7f9969cf0640 1 -- 172.21.15.3:0/852648529 wait complete. 2024-09-21T12:19:13.659 INFO:teuthology.orchestra.run.smithi003.stdout:true 2024-09-21T12:19:13.786 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.783+0000 7fe88959a640 1 -- 172.21.15.3:0/1131463744 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe880031740 con 0x7fe88c102b30 2024-09-21T12:19:13.786 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.783+0000 7fe890dd5640 1 -- 172.21.15.3:0/1131463744 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe88c102b30 msgr2=0x7fe88c104fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:19:13.786 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.783+0000 7fe890dd5640 1 --2- 172.21.15.3:0/1131463744 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe88c102b30 0x7fe88c104fa0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fe880009880 tx=0x7fe88002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:19:13.786 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.783+0000 7fe890dd5640 1 -- 172.21.15.3:0/1131463744 shutdown_connections 2024-09-21T12:19:13.787 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.783+0000 7fe890dd5640 1 --2- 172.21.15.3:0/1131463744 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe88c102b30 0x7fe88c104fa0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:13.787 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.783+0000 7fe890dd5640 1 --2- 172.21.15.3:0/1131463744 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe88c1001e0 0x7fe88c1025f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:13.787 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.783+0000 7fe890dd5640 1 -- 172.21.15.3:0/1131463744 >> 172.21.15.3:0/1131463744 conn(0x7fe88c0fc010 msgr2=0x7fe88c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:19:13.787 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.784+0000 7fe890dd5640 1 -- 172.21.15.3:0/1131463744 shutdown_connections 2024-09-21T12:19:13.787 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.784+0000 7fe890dd5640 1 -- 172.21.15.3:0/1131463744 wait complete. 2024-09-21T12:19:13.787 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.785+0000 7fe890dd5640 1 Processor -- start 2024-09-21T12:19:13.788 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.785+0000 7fe890dd5640 1 -- start start 2024-09-21T12:19:13.788 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.785+0000 7fe890dd5640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe88c1001e0 0x7fe88c10de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:19:13.788 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.785+0000 7fe890dd5640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe88c102b30 0x7fe88c10e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:19:13.788 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.785+0000 7fe890dd5640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fe88c110d70 con 0x7fe88c102b30 2024-09-21T12:19:13.788 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.785+0000 7fe890dd5640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe88c110bf0 con 0x7fe88c1001e0 2024-09-21T12:19:13.788 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.785+0000 7fe88a59c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe88c1001e0 0x7fe88c10de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:19:13.788 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.785+0000 7fe88a59c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe88c1001e0 0x7fe88c10de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.3:39948/0 (socket says 172.21.15.3:39948) 2024-09-21T12:19:13.788 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.786+0000 7fe88a59c640 1 -- 172.21.15.3:0/2751066943 learned_addr learned my addr 172.21.15.3:0/2751066943 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:19:13.788 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.786+0000 7fe889d9b640 1 --2- 172.21.15.3:0/2751066943 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe88c102b30 0x7fe88c10e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:19:13.788 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.786+0000 7fe88a59c640 1 -- 172.21.15.3:0/2751066943 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe88c102b30 msgr2=0x7fe88c10e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:19:13.788 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.786+0000 7fe88a59c640 1 --2- 172.21.15.3:0/2751066943 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe88c102b30 0x7fe88c10e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:13.788 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.786+0000 7fe88a59c640 1 -- 172.21.15.3:0/2751066943 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe88c10ea20 con 0x7fe88c1001e0 2024-09-21T12:19:13.789 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.786+0000 7fe88a59c640 1 --2- 172.21.15.3:0/2751066943 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe88c1001e0 0x7fe88c10de40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe87c00e970 tx=0x7fe87c00ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:19:13.789 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.787+0000 7fe87b7fe640 1 -- 172.21.15.3:0/2751066943 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe87c00cac0 con 0x7fe88c1001e0 2024-09-21T12:19:13.789 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.787+0000 7fe890dd5640 1 -- 172.21.15.3:0/2751066943 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe88c06bd30 con 0x7fe88c1001e0 2024-09-21T12:19:13.790 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.787+0000 7fe890dd5640 1 -- 172.21.15.3:0/2751066943 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe88c06c240 con 0x7fe88c1001e0 2024-09-21T12:19:13.790 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.788+0000 7fe87b7fe640 1 -- 172.21.15.3:0/2751066943 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe87c00cc60 con 0x7fe88c1001e0 2024-09-21T12:19:13.790 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.788+0000 7fe87b7fe640 1 -- 172.21.15.3:0/2751066943 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe87c018720 con 0x7fe88c1001e0 2024-09-21T12:19:13.791 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.789+0000 7fe890dd5640 1 -- 172.21.15.3:0/2751066943 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe86c0052c0 con 0x7fe88c1001e0 2024-09-21T12:19:13.791 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.790+0000 7fe87b7fe640 1 -- 172.21.15.3:0/2751066943 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 19) ==== 92549+0+0 (secure 0 0 0) 0x7fe87c010430 con 0x7fe88c1001e0 2024-09-21T12:19:13.792 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.790+0000 7fe87b7fe640 1 --2- 172.21.15.3:0/2751066943 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fe87406e3a0 0x7fe874070860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:19:13.793 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.791+0000 7fe889d9b640 1 --2- 172.21.15.3:0/2751066943 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fe87406e3a0 0x7fe874070860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:19:13.793 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.791+0000 7fe87b7fe640 1 -- 172.21.15.3:0/2751066943 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5554+0+0 (secure 0 0 0) 0x7fe87c08e700 con 0x7fe88c1001e0 2024-09-21T12:19:13.794 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.792+0000 7fe889d9b640 1 --2- 172.21.15.3:0/2751066943 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fe87406e3a0 0x7fe874070860 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe880000c00 tx=0x7fe880004280 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:19:13.796 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:13.795+0000 7fe87b7fe640 1 -- 172.21.15.3:0/2751066943 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe87c05c060 con 0x7fe88c1001e0 2024-09-21T12:19:14.192 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.191+0000 7fe890dd5640 1 -- 172.21.15.3:0/2751066943 --> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fe86c000bf0 con 0x7fe87406e3a0 2024-09-21T12:19:14.194 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.192+0000 7fe87b7fe640 1 -- 172.21.15.3:0/2751066943 <== mgr.14217 v2:172.21.15.3:6800/2480880781 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+351 (secure 0 0 0) 0x7fe86c000bf0 con 0x7fe87406e3a0 2024-09-21T12:19:14.197 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.196+0000 7fe890dd5640 1 -- 172.21.15.3:0/2751066943 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fe87406e3a0 msgr2=0x7fe874070860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:19:14.197 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.196+0000 7fe890dd5640 1 --2- 172.21.15.3:0/2751066943 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fe87406e3a0 0x7fe874070860 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fe880000c00 tx=0x7fe880004280 comp rx=0 tx=0).stop 2024-09-21T12:19:14.197 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.196+0000 7fe890dd5640 1 -- 172.21.15.3:0/2751066943 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe88c1001e0 msgr2=0x7fe88c10de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:19:14.197 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.196+0000 7fe890dd5640 1 --2- 172.21.15.3:0/2751066943 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe88c1001e0 0x7fe88c10de40 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe87c00e970 tx=0x7fe87c00ee30 comp rx=0 tx=0).stop 2024-09-21T12:19:14.198 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.196+0000 7fe890dd5640 1 -- 172.21.15.3:0/2751066943 shutdown_connections 2024-09-21T12:19:14.198 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.196+0000 7fe890dd5640 1 --2- 172.21.15.3:0/2751066943 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fe87406e3a0 0x7fe874070860 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:14.198 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.196+0000 7fe890dd5640 1 --2- 172.21.15.3:0/2751066943 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe88c102b30 0x7fe88c10e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:14.198 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.196+0000 7fe890dd5640 1 --2- 172.21.15.3:0/2751066943 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe88c1001e0 0x7fe88c10de40 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:14.198 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.196+0000 7fe890dd5640 1 -- 172.21.15.3:0/2751066943 >> 172.21.15.3:0/2751066943 conn(0x7fe88c0fc010 msgr2=0x7fe88c0fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:19:14.199 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.197+0000 7fe890dd5640 1 -- 172.21.15.3:0/2751066943 shutdown_connections 2024-09-21T12:19:14.199 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.197+0000 7fe890dd5640 1 -- 172.21.15.3:0/2751066943 wait complete. 2024-09-21T12:19:14.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:19:14 smithi003 ceph-mon[28057]: pgmap v227: 65 pgs: 65 active+clean; 654 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 5.6 KiB/s wr, 0 op/s 2024-09-21T12:19:14.335 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.333+0000 7f612ecd5640 1 -- 172.21.15.3:0/299356509 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f612810a560 msgr2=0x7f612810a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:19:14.335 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.333+0000 7f612ecd5640 1 --2- 172.21.15.3:0/299356509 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f612810a560 0x7f612810a960 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f611c00fa90 tx=0x7f611c02e630 comp rx=0 tx=0).stop 2024-09-21T12:19:14.336 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.334+0000 7f612ecd5640 1 -- 172.21.15.3:0/299356509 shutdown_connections 2024-09-21T12:19:14.336 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.334+0000 7f612ecd5640 1 --2- 172.21.15.3:0/299356509 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f612810af30 0x7f61280730f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:14.336 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.334+0000 7f612ecd5640 1 --2- 172.21.15.3:0/299356509 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f612810a560 0x7f612810a960 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:14.336 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.334+0000 7f612ecd5640 1 -- 172.21.15.3:0/299356509 >> 172.21.15.3:0/299356509 conn(0x7f612806ed60 msgr2=0x7f61280711a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:19:14.336 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.334+0000 7f612ecd5640 1 -- 172.21.15.3:0/299356509 shutdown_connections 2024-09-21T12:19:14.337 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.335+0000 7f612ecd5640 1 -- 172.21.15.3:0/299356509 wait complete. 2024-09-21T12:19:14.337 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.336+0000 7f612ecd5640 1 Processor -- start 2024-09-21T12:19:14.338 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.336+0000 7f612ecd5640 1 -- start start 2024-09-21T12:19:14.338 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.336+0000 7f612ecd5640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f612810a560 0x7f61281a60f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:19:14.338 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.336+0000 7f612ecd5640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f612810af30 0x7f61281a6630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:19:14.338 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.336+0000 7f612ca71640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f612810a560 0x7f61281a60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:19:14.338 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.336+0000 7f612ca71640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f612810a560 0x7f61281a60f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.3:39970/0 (socket says 172.21.15.3:39970) 2024-09-21T12:19:14.338 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.336+0000 7f612ca71640 1 -- 172.21.15.3:0/1837496217 learned_addr learned my addr 172.21.15.3:0/1837496217 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:19:14.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.336+0000 7f612ecd5640 1 -- 172.21.15.3:0/1837496217 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f6128110d00 con 0x7f612810af30 2024-09-21T12:19:14.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.336+0000 7f612ecd5640 1 -- 172.21.15.3:0/1837496217 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6128110b80 con 0x7f612810a560 2024-09-21T12:19:14.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.337+0000 7f612ca71640 1 -- 172.21.15.3:0/1837496217 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f612810af30 msgr2=0x7f61281a6630 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-21T12:19:14.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.337+0000 7f612ca71640 1 --2- 172.21.15.3:0/1837496217 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f612810af30 0x7f61281a6630 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:14.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.337+0000 7f612ca71640 1 -- 172.21.15.3:0/1837496217 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61281a6cb0 con 0x7f612810a560 2024-09-21T12:19:14.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.337+0000 7f612ca71640 1 --2- 172.21.15.3:0/1837496217 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f612810a560 0x7f61281a60f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f611c009230 tx=0x7f611c00f430 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:19:14.339 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.338+0000 7f6125ffb640 1 -- 172.21.15.3:0/1837496217 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f611c004030 con 0x7f612810a560 2024-09-21T12:19:14.340 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.338+0000 7f612ecd5640 1 -- 172.21.15.3:0/1837496217 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61281ab6f0 con 0x7f612810a560 2024-09-21T12:19:14.340 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.338+0000 7f612ecd5640 1 -- 172.21.15.3:0/1837496217 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61281abd00 con 0x7f612810a560 2024-09-21T12:19:14.340 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.338+0000 7f6125ffb640 1 -- 172.21.15.3:0/1837496217 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f611c00edd0 con 0x7f612810a560 2024-09-21T12:19:14.340 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.338+0000 7f6125ffb640 1 -- 172.21.15.3:0/1837496217 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f611c003b80 con 0x7f612810a560 2024-09-21T12:19:14.341 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.340+0000 7f612ecd5640 1 -- 172.21.15.3:0/1837496217 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f610c0052c0 con 0x7f612810a560 2024-09-21T12:19:14.343 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.341+0000 7f6125ffb640 1 -- 172.21.15.3:0/1837496217 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 19) ==== 92549+0+0 (secure 0 0 0) 0x7f611c00c050 con 0x7f612810a560 2024-09-21T12:19:14.343 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.341+0000 7f6125ffb640 1 --2- 172.21.15.3:0/1837496217 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f611806e3a0 0x7f6118070860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:19:14.343 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.342+0000 7f6125ffb640 1 -- 172.21.15.3:0/1837496217 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5554+0+0 (secure 0 0 0) 0x7f611c0aec90 con 0x7f612810a560 2024-09-21T12:19:14.344 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.342+0000 7f6127fff640 1 --2- 172.21.15.3:0/1837496217 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f611806e3a0 0x7f6118070860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:19:14.344 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.343+0000 7f6127fff640 1 --2- 172.21.15.3:0/1837496217 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f611806e3a0 0x7f6118070860 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f61281a75a0 tx=0x7f611400b3d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:19:14.348 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.346+0000 7f6125ffb640 1 -- 172.21.15.3:0/1837496217 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f611c03d3a0 con 0x7f612810a560 2024-09-21T12:19:14.692 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.691+0000 7f612ecd5640 1 -- 172.21.15.3:0/1837496217 --> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f610c000bf0 con 0x7f611806e3a0 2024-09-21T12:19:14.712 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.710+0000 7f6125ffb640 1 -- 172.21.15.3:0/1837496217 <== mgr.14217 v2:172.21.15.3:6800/2480880781 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3792 (secure 0 0 0) 0x7f610c000bf0 con 0x7f611806e3a0 2024-09-21T12:19:14.712 INFO:teuthology.orchestra.run.smithi003.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:19:14.712 INFO:teuthology.orchestra.run.smithi003.stdout:alertmanager.smithi003 smithi003 *:9093,9094 running (5m) 70s ago 6m 25.8M - 0.25.0 c8568f914cd2 5c03f233277e 2024-09-21T12:19:14.712 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-exporter.smithi003 smithi003 running (7m) 70s ago 7m 8321k - 19.1.1-373-g4e45e6b4 164465d2334a 38ef0e2dfcc4 2024-09-21T12:19:14.712 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-exporter.smithi192 smithi192 running (6m) 74s ago 6m 5259k - 19.1.1-373-g4e45e6b4 164465d2334a 848a2ec72db7 2024-09-21T12:19:14.712 INFO:teuthology.orchestra.run.smithi003.stdout:crash.smithi003 smithi003 running (7m) 70s ago 7m 6899k - 19.1.1-373-g4e45e6b4 164465d2334a c63f209dc1dc 2024-09-21T12:19:14.712 INFO:teuthology.orchestra.run.smithi003.stdout:crash.smithi192 smithi192 running (6m) 74s ago 6m 6895k - 19.1.1-373-g4e45e6b4 164465d2334a cc70c9a7b2f7 2024-09-21T12:19:14.712 INFO:teuthology.orchestra.run.smithi003.stdout:grafana.smithi003 smithi003 *:3000 running (5m) 70s ago 6m 79.4M - 9.4.12 2bacad6d85d8 f504f60818f0 2024-09-21T12:19:14.713 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi003.ebjgyl smithi003 running (93s) 70s ago 92s 11.8M - 19.1.1-373-g4e45e6b4 164465d2334a 16e0b2cac16a 2024-09-21T12:19:14.713 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi003.gfkngj smithi003 running (87s) 70s ago 86s 16.7M - 19.1.1-373-g4e45e6b4 164465d2334a 109c04f87fbd 2024-09-21T12:19:14.713 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi192.ktdqns smithi192 running (84s) 74s ago 84s 13.1M - 19.1.1-373-g4e45e6b4 164465d2334a 495c73fb3bb0 2024-09-21T12:19:14.713 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi192.ywqqxe smithi192 running (90s) 74s ago 90s 13.1M - 19.1.1-373-g4e45e6b4 164465d2334a 270a01030cbe 2024-09-21T12:19:14.713 INFO:teuthology.orchestra.run.smithi003.stdout:mgr.smithi003.wztftl smithi003 *:9283,8765,8443 running (8m) 70s ago 8m 501M - 19.1.1-373-g4e45e6b4 164465d2334a 060c1f18749f 2024-09-21T12:19:14.713 INFO:teuthology.orchestra.run.smithi003.stdout:mgr.smithi192.qsaprd smithi192 *:8443,9283,8765 running (6m) 74s ago 6m 442M - 19.1.1-373-g4e45e6b4 164465d2334a 8acd4fe1e324 2024-09-21T12:19:14.713 INFO:teuthology.orchestra.run.smithi003.stdout:mon.smithi003 smithi003 running (8m) 70s ago 8m 48.4M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 16bccf2c7503 2024-09-21T12:19:14.713 INFO:teuthology.orchestra.run.smithi003.stdout:mon.smithi192 smithi192 running (6m) 74s ago 6m 35.4M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 4fe4c4b3dc5d 2024-09-21T12:19:14.713 INFO:teuthology.orchestra.run.smithi003.stdout:node-exporter.smithi003 smithi003 *:9100 running (7m) 70s ago 7m 15.8M - 1.5.0 0da6a335fe13 a1eb875faefc 2024-09-21T12:19:14.713 INFO:teuthology.orchestra.run.smithi003.stdout:node-exporter.smithi192 smithi192 *:9100 running (6m) 74s ago 6m 16.4M - 1.5.0 0da6a335fe13 10c2542c2e19 2024-09-21T12:19:14.713 INFO:teuthology.orchestra.run.smithi003.stdout:osd.0 smithi003 running (4m) 70s ago 4m 54.6M 3948M 19.1.1-373-g4e45e6b4 164465d2334a d07f1489720d 2024-09-21T12:19:14.713 INFO:teuthology.orchestra.run.smithi003.stdout:osd.1 smithi003 running (4m) 70s ago 4m 48.1M 3948M 19.1.1-373-g4e45e6b4 164465d2334a 6abd75a07645 2024-09-21T12:19:14.713 INFO:teuthology.orchestra.run.smithi003.stdout:osd.2 smithi003 running (3m) 70s ago 3m 48.4M 3948M 19.1.1-373-g4e45e6b4 164465d2334a 3265369e573b 2024-09-21T12:19:14.713 INFO:teuthology.orchestra.run.smithi003.stdout:osd.3 smithi192 running (3m) 74s ago 3m 44.4M 4970M 19.1.1-373-g4e45e6b4 164465d2334a 13efcfd71c05 2024-09-21T12:19:14.714 INFO:teuthology.orchestra.run.smithi003.stdout:osd.4 smithi192 running (3m) 74s ago 3m 44.0M 4970M 19.1.1-373-g4e45e6b4 164465d2334a f33bf453cb3e 2024-09-21T12:19:14.714 INFO:teuthology.orchestra.run.smithi003.stdout:osd.5 smithi192 running (2m) 74s ago 2m 42.0M 4970M 19.1.1-373-g4e45e6b4 164465d2334a 12d7b7c8e985 2024-09-21T12:19:14.714 INFO:teuthology.orchestra.run.smithi003.stdout:prometheus.smithi003 smithi003 *:9095 running (5m) 70s ago 6m 58.9M - 2.43.0 a07b618ecd1d 4ecd73d1b37c 2024-09-21T12:19:14.716 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.713+0000 7f612ecd5640 1 -- 172.21.15.3:0/1837496217 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f611806e3a0 msgr2=0x7f6118070860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:19:14.716 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.713+0000 7f612ecd5640 1 --2- 172.21.15.3:0/1837496217 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f611806e3a0 0x7f6118070860 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f61281a75a0 tx=0x7f611400b3d0 comp rx=0 tx=0).stop 2024-09-21T12:19:14.716 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.714+0000 7f612ecd5640 1 -- 172.21.15.3:0/1837496217 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f612810a560 msgr2=0x7f61281a60f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:19:14.716 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.714+0000 7f612ecd5640 1 --2- 172.21.15.3:0/1837496217 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f612810a560 0x7f61281a60f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f611c009230 tx=0x7f611c00f430 comp rx=0 tx=0).stop 2024-09-21T12:19:14.716 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.714+0000 7f612ecd5640 1 -- 172.21.15.3:0/1837496217 shutdown_connections 2024-09-21T12:19:14.716 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.714+0000 7f612ecd5640 1 --2- 172.21.15.3:0/1837496217 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f611806e3a0 0x7f6118070860 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:14.716 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.714+0000 7f612ecd5640 1 --2- 172.21.15.3:0/1837496217 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f612810af30 0x7f61281a6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:14.716 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.714+0000 7f612ecd5640 1 --2- 172.21.15.3:0/1837496217 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f612810a560 0x7f61281a60f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:14.716 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.714+0000 7f612ecd5640 1 -- 172.21.15.3:0/1837496217 >> 172.21.15.3:0/1837496217 conn(0x7f612806ed60 msgr2=0x7f612810d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:19:14.717 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.714+0000 7f612ecd5640 1 -- 172.21.15.3:0/1837496217 shutdown_connections 2024-09-21T12:19:14.717 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.714+0000 7f612ecd5640 1 -- 172.21.15.3:0/1837496217 wait complete. 2024-09-21T12:19:14.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:19:14 smithi192 ceph-mon[35641]: pgmap v227: 65 pgs: 65 active+clean; 654 KiB data, 171 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 5.6 KiB/s wr, 0 op/s 2024-09-21T12:19:14.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.839+0000 7fd6bee37640 1 -- 172.21.15.3:0/1769377182 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6b8104da0 msgr2=0x7fd6b8107190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:19:14.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.839+0000 7fd6bee37640 1 --2- 172.21.15.3:0/1769377182 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6b8104da0 0x7fd6b8107190 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd6a4009880 tx=0x7fd6a402a4b0 comp rx=0 tx=0).stop 2024-09-21T12:19:14.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.839+0000 7fd6bee37640 1 -- 172.21.15.3:0/1769377182 shutdown_connections 2024-09-21T12:19:14.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.839+0000 7fd6bee37640 1 --2- 172.21.15.3:0/1769377182 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6b8104da0 0x7fd6b8107190 secure :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fd6a4009880 tx=0x7fd6a402a4b0 comp rx=0 tx=0).stop 2024-09-21T12:19:14.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.839+0000 7fd6bee37640 1 --2- 172.21.15.3:0/1769377182 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd6b8102470 0x7fd6b8104860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:14.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.839+0000 7fd6bee37640 1 -- 172.21.15.3:0/1769377182 >> 172.21.15.3:0/1769377182 conn(0x7fd6b80fc030 msgr2=0x7fd6b80fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:19:14.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.839+0000 7fd6bee37640 1 -- 172.21.15.3:0/1769377182 shutdown_connections 2024-09-21T12:19:14.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.839+0000 7fd6bee37640 1 -- 172.21.15.3:0/1769377182 wait complete. 2024-09-21T12:19:14.842 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.840+0000 7fd6bee37640 1 Processor -- start 2024-09-21T12:19:14.842 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.840+0000 7fd6bee37640 1 -- start start 2024-09-21T12:19:14.842 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.840+0000 7fd6bee37640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd6b8102470 0x7fd6b8101d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:19:14.842 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.840+0000 7fd6bee37640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6b8100420 0x7fd6b81008a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:19:14.842 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.840+0000 7fd6bee37640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fd6b810a7c0 con 0x7fd6b8102470 2024-09-21T12:19:14.842 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.840+0000 7fd6bee37640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd6b810a640 con 0x7fd6b8100420 2024-09-21T12:19:14.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.841+0000 7fd6b7fff640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6b8100420 0x7fd6b81008a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:19:14.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.841+0000 7fd6b7fff640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6b8100420 0x7fd6b81008a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.3:39990/0 (socket says 172.21.15.3:39990) 2024-09-21T12:19:14.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.841+0000 7fd6b7fff640 1 -- 172.21.15.3:0/2530679144 learned_addr learned my addr 172.21.15.3:0/2530679144 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:19:14.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.841+0000 7fd6bcbd3640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd6b8102470 0x7fd6b8101d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:19:14.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.841+0000 7fd6b7fff640 1 -- 172.21.15.3:0/2530679144 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd6b8102470 msgr2=0x7fd6b8101d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:19:14.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.841+0000 7fd6b7fff640 1 --2- 172.21.15.3:0/2530679144 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd6b8102470 0x7fd6b8101d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:14.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.841+0000 7fd6b7fff640 1 -- 172.21.15.3:0/2530679144 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6b8100de0 con 0x7fd6b8100420 2024-09-21T12:19:14.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.841+0000 7fd6b7fff640 1 --2- 172.21.15.3:0/2530679144 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6b8100420 0x7fd6b81008a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd6a4009230 tx=0x7fd6a40048f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:19:14.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.842+0000 7fd6b5ffb640 1 -- 172.21.15.3:0/2530679144 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd6a403f070 con 0x7fd6b8100420 2024-09-21T12:19:14.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.842+0000 7fd6b5ffb640 1 -- 172.21.15.3:0/2530679144 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd6a40044d0 con 0x7fd6b8100420 2024-09-21T12:19:14.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.842+0000 7fd6b5ffb640 1 -- 172.21.15.3:0/2530679144 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd6a4035030 con 0x7fd6b8100420 2024-09-21T12:19:14.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.842+0000 7fd6bee37640 1 -- 172.21.15.3:0/2530679144 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6b81010d0 con 0x7fd6b8100420 2024-09-21T12:19:14.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.842+0000 7fd6bee37640 1 -- 172.21.15.3:0/2530679144 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6b819f9e0 con 0x7fd6b8100420 2024-09-21T12:19:14.846 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.844+0000 7fd6bee37640 1 -- 172.21.15.3:0/2530679144 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6b8105180 con 0x7fd6b8100420 2024-09-21T12:19:14.846 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.844+0000 7fd6b5ffb640 1 -- 172.21.15.3:0/2530679144 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 19) ==== 92549+0+0 (secure 0 0 0) 0x7fd6a4042070 con 0x7fd6b8100420 2024-09-21T12:19:14.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.845+0000 7fd6b5ffb640 1 --2- 172.21.15.3:0/2530679144 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fd6a806e350 0x7fd6a8070810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:19:14.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.846+0000 7fd6b5ffb640 1 -- 172.21.15.3:0/2530679144 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5554+0+0 (secure 0 0 0) 0x7fd6a40aedd0 con 0x7fd6b8100420 2024-09-21T12:19:14.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.846+0000 7fd6bcbd3640 1 --2- 172.21.15.3:0/2530679144 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fd6a806e350 0x7fd6a8070810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:19:14.849 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.847+0000 7fd6bcbd3640 1 --2- 172.21.15.3:0/2530679144 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fd6a806e350 0x7fd6a8070810 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac009890 tx=0x7fd6ac008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:19:14.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:14.850+0000 7fd6b5ffb640 1 -- 172.21.15.3:0/2530679144 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd6a407c6a0 con 0x7fd6b8100420 2024-09-21T12:19:15.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:15.329+0000 7fd6bee37640 1 -- 172.21.15.3:0/2530679144 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fd6b819fd20 con 0x7fd6b8100420 2024-09-21T12:19:15.331 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:15.330+0000 7fd6b5ffb640 1 -- 172.21.15.3:0/2530679144 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+633 (secure 0 0 0) 0x7fd6a4080350 con 0x7fd6b8100420 2024-09-21T12:19:15.332 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-21T12:19:15.332 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": { 2024-09-21T12:19:15.332 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2 2024-09-21T12:19:15.332 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:19:15.332 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": { 2024-09-21T12:19:15.332 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2 2024-09-21T12:19:15.332 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:19:15.332 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": { 2024-09-21T12:19:15.332 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 6 2024-09-21T12:19:15.332 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:19:15.332 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": { 2024-09-21T12:19:15.333 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 4 2024-09-21T12:19:15.333 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:19:15.333 INFO:teuthology.orchestra.run.smithi003.stdout: "overall": { 2024-09-21T12:19:15.333 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 14 2024-09-21T12:19:15.333 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-21T12:19:15.333 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-21T12:19:15.335 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:15.333+0000 7fd6bee37640 1 -- 172.21.15.3:0/2530679144 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fd6a806e350 msgr2=0x7fd6a8070810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:19:15.336 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:15.333+0000 7fd6bee37640 1 --2- 172.21.15.3:0/2530679144 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fd6a806e350 0x7fd6a8070810 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac009890 tx=0x7fd6ac008040 comp rx=0 tx=0).stop 2024-09-21T12:19:15.336 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:15.333+0000 7fd6bee37640 1 -- 172.21.15.3:0/2530679144 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6b8100420 msgr2=0x7fd6b81008a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:19:15.336 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:15.333+0000 7fd6bee37640 1 --2- 172.21.15.3:0/2530679144 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6b8100420 0x7fd6b81008a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fd6a4009230 tx=0x7fd6a40048f0 comp rx=0 tx=0).stop 2024-09-21T12:19:15.336 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:15.333+0000 7fd6bee37640 1 -- 172.21.15.3:0/2530679144 shutdown_connections 2024-09-21T12:19:15.336 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:15.333+0000 7fd6bee37640 1 --2- 172.21.15.3:0/2530679144 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fd6a806e350 0x7fd6a8070810 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:15.336 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:15.333+0000 7fd6bee37640 1 --2- 172.21.15.3:0/2530679144 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd6b8100420 0x7fd6b81008a0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:15.337 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:15.333+0000 7fd6bee37640 1 --2- 172.21.15.3:0/2530679144 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd6b8102470 0x7fd6b8101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:15.337 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:15.333+0000 7fd6bee37640 1 -- 172.21.15.3:0/2530679144 >> 172.21.15.3:0/2530679144 conn(0x7fd6b80fc030 msgr2=0x7fd6b80fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:19:15.337 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:15.333+0000 7fd6bee37640 1 -- 172.21.15.3:0/2530679144 shutdown_connections 2024-09-21T12:19:15.337 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:15.333+0000 7fd6bee37640 1 -- 172.21.15.3:0/2530679144 wait complete. 2024-09-21T12:19:15.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:15.448+0000 7fef305ab640 1 -- 172.21.15.3:0/402810735 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fef28102b60 msgr2=0x7fef28102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:19:15.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:15.448+0000 7fef305ab640 1 --2- 172.21.15.3:0/402810735 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fef28102b60 0x7fef28102fe0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fef240098d0 tx=0x7fef2402a4f0 comp rx=0 tx=0).stop 2024-09-21T12:19:15.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:15.449+0000 7fef305ab640 1 -- 172.21.15.3:0/402810735 shutdown_connections 2024-09-21T12:19:15.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:15.449+0000 7fef305ab640 1 --2- 172.21.15.3:0/402810735 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fef28102b60 0x7fef28102fe0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:15.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:15.449+0000 7fef305ab640 1 --2- 172.21.15.3:0/402810735 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef28101960 0x7fef28101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:15.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:15.449+0000 7fef305ab640 1 -- 172.21.15.3:0/402810735 >> 172.21.15.3:0/402810735 conn(0x7fef280fd0f0 msgr2=0x7fef280ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:19:15.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:15.449+0000 7fef305ab640 1 -- 172.21.15.3:0/402810735 shutdown_connections 2024-09-21T12:19:15.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:15.449+0000 7fef305ab640 1 -- 172.21.15.3:0/402810735 wait complete. 2024-09-21T12:19:15.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:15.450+0000 7fef305ab640 1 Processor -- start 2024-09-21T12:19:15.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:15.450+0000 7fef305ab640 1 -- start start 2024-09-21T12:19:15.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:15.450+0000 7fef305ab640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef28101960 0x7fef281974a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:19:15.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:15.450+0000 7fef305ab640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fef28102b60 0x7fef281979e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:19:15.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:15.450+0000 7fef305ab640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fef2810a780 con 0x7fef28102b60 2024-09-21T12:19:15.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:15.450+0000 7fef305ab640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fef2810a600 con 0x7fef28101960 2024-09-21T12:19:15.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:15.450+0000 7fef2db46640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fef28102b60 0x7fef281979e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:19:15.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:15.450+0000 7fef2db46640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fef28102b60 0x7fef281979e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50100/0 (socket says 172.21.15.3:50100) 2024-09-21T12:19:15.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:15.450+0000 7fef2db46640 1 -- 172.21.15.3:0/2964437888 learned_addr learned my addr 172.21.15.3:0/2964437888 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:19:15.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:15.451+0000 7fef2e347640 1 --2- 172.21.15.3:0/2964437888 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef28101960 0x7fef281974a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:19:15.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:15.451+0000 7fef2db46640 1 -- 172.21.15.3:0/2964437888 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef28101960 msgr2=0x7fef281974a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:19:15.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:15.451+0000 7fef2db46640 1 --2- 172.21.15.3:0/2964437888 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef28101960 0x7fef281974a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:15.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:15.451+0000 7fef2db46640 1 -- 172.21.15.3:0/2964437888 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef28198060 con 0x7fef28102b60 2024-09-21T12:19:15.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:15.451+0000 7fef2e347640 1 --2- 172.21.15.3:0/2964437888 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef28101960 0x7fef281974a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T12:19:15.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:15.451+0000 7fef2db46640 1 --2- 172.21.15.3:0/2964437888 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fef28102b60 0x7fef281979e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fef240058c0 tx=0x7fef240048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:19:15.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:15.452+0000 7fef1f7fe640 1 -- 172.21.15.3:0/2964437888 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fef2403f070 con 0x7fef28102b60 2024-09-21T12:19:15.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:15.452+0000 7fef1f7fe640 1 -- 172.21.15.3:0/2964437888 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fef24004a60 con 0x7fef28102b60 2024-09-21T12:19:15.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:15.452+0000 7fef1f7fe640 1 -- 172.21.15.3:0/2964437888 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fef24035030 con 0x7fef28102b60 2024-09-21T12:19:15.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:15.452+0000 7fef305ab640 1 -- 172.21.15.3:0/2964437888 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef2806bc70 con 0x7fef28102b60 2024-09-21T12:19:15.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:15.452+0000 7fef305ab640 1 -- 172.21.15.3:0/2964437888 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef2806c200 con 0x7fef28102b60 2024-09-21T12:19:15.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:15.454+0000 7fef305ab640 1 -- 172.21.15.3:0/2964437888 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef28101d60 con 0x7fef28102b60 2024-09-21T12:19:15.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:15.454+0000 7fef1f7fe640 1 -- 172.21.15.3:0/2964437888 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 19) ==== 92549+0+0 (secure 0 0 0) 0x7fef24042070 con 0x7fef28102b60 2024-09-21T12:19:15.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:15.455+0000 7fef1f7fe640 1 --2- 172.21.15.3:0/2964437888 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fef1406e350 0x7fef14070810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:19:15.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:15.455+0000 7fef2e347640 1 --2- 172.21.15.3:0/2964437888 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fef1406e350 0x7fef14070810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:19:15.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:15.456+0000 7fef1f7fe640 1 -- 172.21.15.3:0/2964437888 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5554+0+0 (secure 0 0 0) 0x7fef24005480 con 0x7fef28102b60 2024-09-21T12:19:15.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:15.456+0000 7fef2e347640 1 --2- 172.21.15.3:0/2964437888 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fef1406e350 0x7fef14070810 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fef281029c0 tx=0x7fef18005f90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:19:15.465 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:15.464+0000 7fef1f7fe640 1 -- 172.21.15.3:0/2964437888 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fef2407fd70 con 0x7fef28102b60 2024-09-21T12:19:15.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:19:15 smithi003 ceph-mon[28057]: from='client.14628 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:19:15.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:19:15 smithi003 ceph-mon[28057]: from='client.24375 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:19:15.686 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:15.685+0000 7fef305ab640 1 -- 172.21.15.3:0/2964437888 --> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fef28062630 con 0x7fef1406e350 2024-09-21T12:19:15.688 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:15.686+0000 7fef1f7fe640 1 -- 172.21.15.3:0/2964437888 <== mgr.14217 v2:172.21.15.3:6800/2480880781 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+351 (secure 0 0 0) 0x7fef28062630 con 0x7fef1406e350 2024-09-21T12:19:15.688 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-21T12:19:15.688 INFO:teuthology.orchestra.run.smithi003.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:5c1cdc3c470dae78e91a0ed2bcf13509a046d301", 2024-09-21T12:19:15.688 INFO:teuthology.orchestra.run.smithi003.stdout: "in_progress": true, 2024-09-21T12:19:15.688 INFO:teuthology.orchestra.run.smithi003.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-21T12:19:15.688 INFO:teuthology.orchestra.run.smithi003.stdout: "services_complete": [], 2024-09-21T12:19:15.688 INFO:teuthology.orchestra.run.smithi003.stdout: "progress": "", 2024-09-21T12:19:15.688 INFO:teuthology.orchestra.run.smithi003.stdout: "message": "Doing first pull of quay.ceph.io/ceph-ci/ceph:5c1cdc3c470dae78e91a0ed2bcf13509a046d301 image", 2024-09-21T12:19:15.689 INFO:teuthology.orchestra.run.smithi003.stdout: "is_paused": false 2024-09-21T12:19:15.689 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-21T12:19:15.691 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:15.689+0000 7fef305ab640 1 -- 172.21.15.3:0/2964437888 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fef1406e350 msgr2=0x7fef14070810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:19:15.691 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:15.689+0000 7fef305ab640 1 --2- 172.21.15.3:0/2964437888 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fef1406e350 0x7fef14070810 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fef281029c0 tx=0x7fef18005f90 comp rx=0 tx=0).stop 2024-09-21T12:19:15.691 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:15.689+0000 7fef305ab640 1 -- 172.21.15.3:0/2964437888 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fef28102b60 msgr2=0x7fef281979e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:19:15.691 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:15.689+0000 7fef305ab640 1 --2- 172.21.15.3:0/2964437888 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fef28102b60 0x7fef281979e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fef240058c0 tx=0x7fef240048f0 comp rx=0 tx=0).stop 2024-09-21T12:19:15.691 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:15.689+0000 7fef305ab640 1 -- 172.21.15.3:0/2964437888 shutdown_connections 2024-09-21T12:19:15.691 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:15.689+0000 7fef305ab640 1 --2- 172.21.15.3:0/2964437888 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fef1406e350 0x7fef14070810 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:15.691 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:15.689+0000 7fef305ab640 1 --2- 172.21.15.3:0/2964437888 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fef28102b60 0x7fef281979e0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:15.691 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:15.689+0000 7fef305ab640 1 --2- 172.21.15.3:0/2964437888 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fef28101960 0x7fef281974a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:15.691 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:15.689+0000 7fef305ab640 1 -- 172.21.15.3:0/2964437888 >> 172.21.15.3:0/2964437888 conn(0x7fef280fd0f0 msgr2=0x7fef28106020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:19:15.691 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:15.689+0000 7fef305ab640 1 -- 172.21.15.3:0/2964437888 shutdown_connections 2024-09-21T12:19:15.691 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:15.689+0000 7fef305ab640 1 -- 172.21.15.3:0/2964437888 wait complete. 2024-09-21T12:19:15.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:19:15 smithi192 ceph-mon[35641]: from='client.14628 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:19:15.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:19:15 smithi192 ceph-mon[35641]: from='client.24375 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:19:16.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:19:16 smithi003 ceph-mon[28057]: pgmap v228: 65 pgs: 65 active+clean; 7.2 MiB data, 182 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 569 KiB/s wr, 6 op/s 2024-09-21T12:19:16.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:19:16 smithi003 ceph-mon[28057]: from='client.24379 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:19:16.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:19:16 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/2530679144' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:19:16.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:19:16 smithi192 ceph-mon[35641]: pgmap v228: 65 pgs: 65 active+clean; 7.2 MiB data, 182 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 569 KiB/s wr, 6 op/s 2024-09-21T12:19:16.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:19:16 smithi192 ceph-mon[35641]: from='client.24379 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:19:16.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:19:16 smithi192 ceph-mon[35641]: from='client.? 172.21.15.3:0/2530679144' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:19:17.565 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:19:17 smithi003 ceph-mon[28057]: from='client.14640 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:19:17.565 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:19:17 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:19:17.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:19:17 smithi192 ceph-mon[35641]: from='client.14640 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:19:17.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:19:17 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:19:18.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:19:18 smithi003 ceph-mon[28057]: pgmap v229: 65 pgs: 65 active+clean; 13 MiB data, 202 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.0 MiB/s wr, 24 op/s 2024-09-21T12:19:18.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:19:18 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:19:18.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:19:18 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:19:18.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:19:18 smithi192 ceph-mon[35641]: pgmap v229: 65 pgs: 65 active+clean; 13 MiB data, 202 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.0 MiB/s wr, 24 op/s 2024-09-21T12:19:18.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:19:18 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:19:18.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:19:18 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:19:19.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:19:19 smithi003 ceph-mon[28057]: Upgrade: Target is version 19.3.0-5103-g5c1cdc3c (squid) 2024-09-21T12:19:19.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:19:19 smithi003 ceph-mon[28057]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, digests ['quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472'] 2024-09-21T12:19:19.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:19:19 smithi003 ceph-mon[28057]: Upgrade: Need to upgrade myself (mgr.smithi003.wztftl) 2024-09-21T12:19:19.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:19:19 smithi003 ceph-mon[28057]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 on smithi192 2024-09-21T12:19:19.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:19:19 smithi192 ceph-mon[35641]: Upgrade: Target is version 19.3.0-5103-g5c1cdc3c (squid) 2024-09-21T12:19:19.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:19:19 smithi192 ceph-mon[35641]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, digests ['quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472'] 2024-09-21T12:19:19.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:19:19 smithi192 ceph-mon[35641]: Upgrade: Need to upgrade myself (mgr.smithi003.wztftl) 2024-09-21T12:19:19.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:19:19 smithi192 ceph-mon[35641]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 on smithi192 2024-09-21T12:19:20.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:19:20 smithi003 ceph-mon[28057]: pgmap v230: 65 pgs: 65 active+clean; 14 MiB data, 212 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.1 MiB/s wr, 36 op/s 2024-09-21T12:19:20.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:19:20 smithi192 ceph-mon[35641]: pgmap v230: 65 pgs: 65 active+clean; 14 MiB data, 212 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.1 MiB/s wr, 36 op/s 2024-09-21T12:19:22.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:19:22 smithi003 ceph-mon[28057]: pgmap v231: 65 pgs: 65 active+clean; 18 MiB data, 222 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.5 MiB/s wr, 58 op/s 2024-09-21T12:19:22.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:19:22 smithi192 ceph-mon[35641]: pgmap v231: 65 pgs: 65 active+clean; 18 MiB data, 222 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.5 MiB/s wr, 58 op/s 2024-09-21T12:19:22.798 INFO:tasks.workunit.client.0.smithi003.stderr:Updating files: 87% (11098/12697) Updating files: 88% (11174/12697) Updating files: 89% (11301/12697) Updating files: 90% (11428/12697) Updating files: 91% (11555/12697) Updating files: 92% (11682/12697) Updating files: 93% (11809/12697) Updating files: 94% (11936/12697) Updating files: 95% (12063/12697) Updating files: 96% (12190/12697) Updating files: 97% (12317/12697) Updating files: 98% (12444/12697) Updating files: 99% (12571/12697) Updating files: 100% (12697/12697) Updating files: 100% (12697/12697), done. 2024-09-21T12:19:23.896 INFO:tasks.workunit.client.0.smithi003.stderr:Note: switching to '5c1cdc3c470dae78e91a0ed2bcf13509a046d301'. 2024-09-21T12:19:23.896 INFO:tasks.workunit.client.0.smithi003.stderr: 2024-09-21T12:19:23.897 INFO:tasks.workunit.client.0.smithi003.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-21T12:19:23.897 INFO:tasks.workunit.client.0.smithi003.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-21T12:19:23.897 INFO:tasks.workunit.client.0.smithi003.stderr:state without impacting any branches by switching back to a branch. 2024-09-21T12:19:23.897 INFO:tasks.workunit.client.0.smithi003.stderr: 2024-09-21T12:19:23.897 INFO:tasks.workunit.client.0.smithi003.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-21T12:19:23.897 INFO:tasks.workunit.client.0.smithi003.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-21T12:19:23.897 INFO:tasks.workunit.client.0.smithi003.stderr: 2024-09-21T12:19:23.897 INFO:tasks.workunit.client.0.smithi003.stderr: git switch -c 2024-09-21T12:19:23.897 INFO:tasks.workunit.client.0.smithi003.stderr: 2024-09-21T12:19:23.897 INFO:tasks.workunit.client.0.smithi003.stderr:Or undo this operation with: 2024-09-21T12:19:23.897 INFO:tasks.workunit.client.0.smithi003.stderr: 2024-09-21T12:19:23.897 INFO:tasks.workunit.client.0.smithi003.stderr: git switch - 2024-09-21T12:19:23.897 INFO:tasks.workunit.client.0.smithi003.stderr: 2024-09-21T12:19:23.897 INFO:tasks.workunit.client.0.smithi003.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-21T12:19:23.898 INFO:tasks.workunit.client.0.smithi003.stderr: 2024-09-21T12:19:23.898 INFO:tasks.workunit.client.0.smithi003.stderr:HEAD is now at 5c1cdc3c470 ceph-volume: fix OSD lvm/tpm2 activation 2024-09-21T12:19:23.905 DEBUG:teuthology.orchestra.run.smithi003:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-21T12:19:24.026 INFO:tasks.workunit.client.0.smithi003.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-21T12:19:24.029 INFO:tasks.workunit.client.0.smithi003.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-21T12:19:24.029 INFO:tasks.workunit.client.0.smithi003.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-21T12:19:24.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:19:24 smithi003 ceph-mon[28057]: pgmap v232: 65 pgs: 65 active+clean; 19 MiB data, 232 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.6 MiB/s wr, 74 op/s 2024-09-21T12:19:24.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:19:24 smithi192 ceph-mon[35641]: pgmap v232: 65 pgs: 65 active+clean; 19 MiB data, 232 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1.6 MiB/s wr, 74 op/s 2024-09-21T12:19:26.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:19:26 smithi003 ceph-mon[28057]: pgmap v233: 65 pgs: 65 active+clean; 24 MiB data, 244 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.0 MiB/s wr, 81 op/s 2024-09-21T12:19:26.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:19:26 smithi192 ceph-mon[35641]: pgmap v233: 65 pgs: 65 active+clean; 24 MiB data, 244 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.0 MiB/s wr, 81 op/s 2024-09-21T12:19:28.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:19:28 smithi003 ceph-mon[28057]: pgmap v234: 65 pgs: 65 active+clean; 35 MiB data, 289 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.3 MiB/s wr, 107 op/s 2024-09-21T12:19:28.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:19:28 smithi192 ceph-mon[35641]: pgmap v234: 65 pgs: 65 active+clean; 35 MiB data, 289 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.3 MiB/s wr, 107 op/s 2024-09-21T12:19:29.816 INFO:tasks.workunit.client.0.smithi003.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-21T12:19:30.097 INFO:tasks.workunit.client.0.smithi003.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-21T12:19:30.206 INFO:tasks.workunit.client.0.smithi003.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-21T12:19:30.208 INFO:tasks.workunit.client.0.smithi003.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-21T12:19:30.208 INFO:tasks.workunit.client.0.smithi003.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-21T12:19:30.291 INFO:tasks.workunit.client.0.smithi003.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-21T12:19:30.295 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-09-21T12:19:30.295 DEBUG:teuthology.orchestra.run.smithi003:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-21T12:19:30.311 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-09-21T12:19:30.313 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-21T12:19:30.313 DEBUG:teuthology.orchestra.run.smithi003:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=5c1cdc3c470dae78e91a0ed2bcf13509a046d301 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-09-21T12:19:30.380 INFO:tasks.workunit.client.0.smithi003.stderr:+ mkdir -p fsstress 2024-09-21T12:19:30.383 INFO:tasks.workunit.client.0.smithi003.stderr:+ pushd fsstress 2024-09-21T12:19:30.385 INFO:tasks.workunit.client.0.smithi003.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-21T12:19:30.385 INFO:tasks.workunit.client.0.smithi003.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-21T12:19:30.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:19:30 smithi003 ceph-mon[28057]: pgmap v235: 65 pgs: 65 active+clean; 41 MiB data, 307 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.4 MiB/s wr, 107 op/s 2024-09-21T12:19:30.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:19:30 smithi192 ceph-mon[35641]: pgmap v235: 65 pgs: 65 active+clean; 41 MiB data, 307 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.4 MiB/s wr, 107 op/s 2024-09-21T12:19:31.159 INFO:tasks.workunit.client.0.smithi003.stderr:+ tar xzf ltp-full.tgz 2024-09-21T12:19:32.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:19:32 smithi003 ceph-mon[28057]: pgmap v236: 65 pgs: 65 active+clean; 47 MiB data, 333 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.9 MiB/s wr, 122 op/s 2024-09-21T12:19:32.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:19:32 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:19:32.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:19:32 smithi192 ceph-mon[35641]: pgmap v236: 65 pgs: 65 active+clean; 47 MiB data, 333 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 2.9 MiB/s wr, 122 op/s 2024-09-21T12:19:32.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:19:32 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:19:34.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:19:34 smithi003 ceph-mon[28057]: pgmap v237: 65 pgs: 65 active+clean; 56 MiB data, 359 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.2 MiB/s wr, 116 op/s 2024-09-21T12:19:34.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:19:34 smithi192 ceph-mon[35641]: pgmap v237: 65 pgs: 65 active+clean; 56 MiB data, 359 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.2 MiB/s wr, 116 op/s 2024-09-21T12:19:36.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:19:36 smithi003 ceph-mon[28057]: pgmap v238: 65 pgs: 65 active+clean; 56 MiB data, 369 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.2 MiB/s wr, 112 op/s 2024-09-21T12:19:36.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:19:36 smithi192 ceph-mon[35641]: pgmap v238: 65 pgs: 65 active+clean; 56 MiB data, 369 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.2 MiB/s wr, 112 op/s 2024-09-21T12:19:38.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:19:38 smithi003 ceph-mon[28057]: pgmap v239: 65 pgs: 65 active+clean; 73 MiB data, 402 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 4.1 MiB/s wr, 147 op/s 2024-09-21T12:19:38.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:19:38 smithi192 ceph-mon[35641]: pgmap v239: 65 pgs: 65 active+clean; 73 MiB data, 402 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 4.1 MiB/s wr, 147 op/s 2024-09-21T12:19:40.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:19:40 smithi003 ceph-mon[28057]: pgmap v240: 65 pgs: 65 active+clean; 74 MiB data, 413 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.3 MiB/s wr, 135 op/s 2024-09-21T12:19:40.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:19:40 smithi192 ceph-mon[35641]: pgmap v240: 65 pgs: 65 active+clean; 74 MiB data, 413 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.3 MiB/s wr, 135 op/s 2024-09-21T12:19:42.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:19:42 smithi003 ceph-mon[28057]: pgmap v241: 65 pgs: 65 active+clean; 83 MiB data, 438 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.6 MiB/s wr, 163 op/s 2024-09-21T12:19:42.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:19:42 smithi192 ceph-mon[35641]: pgmap v241: 65 pgs: 65 active+clean; 83 MiB data, 438 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.6 MiB/s wr, 163 op/s 2024-09-21T12:19:44.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:19:44 smithi003 ceph-mon[28057]: pgmap v242: 65 pgs: 65 active+clean; 92 MiB data, 485 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.8 MiB/s wr, 174 op/s 2024-09-21T12:19:44.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:19:44 smithi192 ceph-mon[35641]: pgmap v242: 65 pgs: 65 active+clean; 92 MiB data, 485 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.8 MiB/s wr, 174 op/s 2024-09-21T12:19:45.800 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:45.795+0000 7f171e247640 1 -- 172.21.15.3:0/3380680599 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1718104d20 msgr2=0x7f1718107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:19:45.800 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:45.795+0000 7f171e247640 1 --2- 172.21.15.3:0/3380680599 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1718104d20 0x7f1718107110 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f170c0098b0 tx=0x7f170c02a4d0 comp rx=0 tx=0).stop 2024-09-21T12:19:45.800 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:45.795+0000 7f171e247640 1 -- 172.21.15.3:0/3380680599 shutdown_connections 2024-09-21T12:19:45.800 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:45.795+0000 7f171e247640 1 --2- 172.21.15.3:0/3380680599 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1718104d20 0x7f1718107110 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:45.800 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:45.795+0000 7f171e247640 1 --2- 172.21.15.3:0/3380680599 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17181023f0 0x7f17181047e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:45.800 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:45.795+0000 7f171e247640 1 -- 172.21.15.3:0/3380680599 >> 172.21.15.3:0/3380680599 conn(0x7f17180fc010 msgr2=0x7f17180fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:19:45.800 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:45.795+0000 7f171e247640 1 -- 172.21.15.3:0/3380680599 shutdown_connections 2024-09-21T12:19:45.800 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:45.795+0000 7f171e247640 1 -- 172.21.15.3:0/3380680599 wait complete. 2024-09-21T12:19:45.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:45.796+0000 7f171e247640 1 Processor -- start 2024-09-21T12:19:45.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:45.796+0000 7f171e247640 1 -- start start 2024-09-21T12:19:45.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:45.797+0000 7f171e247640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f17181023f0 0x7f1718197570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:19:45.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:45.797+0000 7f171e247640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1718104d20 0x7f1718197ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:19:45.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:45.797+0000 7f171e247640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f171810a7b0 con 0x7f17181023f0 2024-09-21T12:19:45.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:45.797+0000 7f171e247640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f171810a630 con 0x7f1718104d20 2024-09-21T12:19:45.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:45.797+0000 7f17177fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f17181023f0 0x7f1718197570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:19:45.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:45.797+0000 7f17177fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f17181023f0 0x7f1718197570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:43116/0 (socket says 172.21.15.3:43116) 2024-09-21T12:19:45.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:45.797+0000 7f17177fe640 1 -- 172.21.15.3:0/383602996 learned_addr learned my addr 172.21.15.3:0/383602996 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:19:45.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:45.797+0000 7f1716ffd640 1 --2- 172.21.15.3:0/383602996 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1718104d20 0x7f1718197ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:19:45.801 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:45.797+0000 7f17177fe640 1 -- 172.21.15.3:0/383602996 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1718104d20 msgr2=0x7f1718197ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:19:45.802 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:45.797+0000 7f17177fe640 1 --2- 172.21.15.3:0/383602996 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1718104d20 0x7f1718197ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:45.802 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:45.797+0000 7f17177fe640 1 -- 172.21.15.3:0/383602996 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1718198130 con 0x7f17181023f0 2024-09-21T12:19:45.802 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:45.797+0000 7f17177fe640 1 --2- 172.21.15.3:0/383602996 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f17181023f0 0x7f1718197570 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f170800e970 tx=0x7f170800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:19:45.802 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:45.797+0000 7f1714ff9640 1 -- 172.21.15.3:0/383602996 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f170800cac0 con 0x7f17181023f0 2024-09-21T12:19:45.802 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:45.797+0000 7f1714ff9640 1 -- 172.21.15.3:0/383602996 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f17080054e0 con 0x7f17181023f0 2024-09-21T12:19:45.802 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:45.797+0000 7f171e247640 1 -- 172.21.15.3:0/383602996 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f171819cb70 con 0x7f17181023f0 2024-09-21T12:19:45.802 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:45.797+0000 7f1714ff9640 1 -- 172.21.15.3:0/383602996 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1708010430 con 0x7f17181023f0 2024-09-21T12:19:45.802 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:45.798+0000 7f171e247640 1 -- 172.21.15.3:0/383602996 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f171819d0d0 con 0x7f17181023f0 2024-09-21T12:19:45.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:45.799+0000 7f171e247640 1 -- 172.21.15.3:0/383602996 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f171810af90 con 0x7f17181023f0 2024-09-21T12:19:45.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:45.799+0000 7f1714ff9640 1 -- 172.21.15.3:0/383602996 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 19) ==== 92549+0+0 (secure 0 0 0) 0x7f1708004f00 con 0x7f17181023f0 2024-09-21T12:19:45.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:45.799+0000 7f1714ff9640 1 --2- 172.21.15.3:0/383602996 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f170006e300 0x7f17000707c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:19:45.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:45.800+0000 7f1714ff9640 1 -- 172.21.15.3:0/383602996 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5554+0+0 (secure 0 0 0) 0x7f170808e770 con 0x7f17181023f0 2024-09-21T12:19:45.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:45.800+0000 7f1716ffd640 1 --2- 172.21.15.3:0/383602996 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f170006e300 0x7f17000707c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:19:45.803 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:45.800+0000 7f1716ffd640 1 --2- 172.21.15.3:0/383602996 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f170006e300 0x7f17000707c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f170c005ab0 tx=0x7f170c005a20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:19:45.805 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:45.804+0000 7f1714ff9640 1 -- 172.21.15.3:0/383602996 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f170805c0f0 con 0x7f17181023f0 2024-09-21T12:19:46.106 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.104+0000 7f171e247640 1 -- 172.21.15.3:0/383602996 --> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f1718105760 con 0x7f170006e300 2024-09-21T12:19:46.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.105+0000 7f1714ff9640 1 -- 172.21.15.3:0/383602996 <== mgr.14217 v2:172.21.15.3:6800/2480880781 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+439 (secure 0 0 0) 0x7f1718105760 con 0x7f170006e300 2024-09-21T12:19:46.109 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.108+0000 7f171e247640 1 -- 172.21.15.3:0/383602996 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f170006e300 msgr2=0x7f17000707c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:19:46.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.108+0000 7f171e247640 1 --2- 172.21.15.3:0/383602996 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f170006e300 0x7f17000707c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f170c005ab0 tx=0x7f170c005a20 comp rx=0 tx=0).stop 2024-09-21T12:19:46.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.108+0000 7f171e247640 1 -- 172.21.15.3:0/383602996 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f17181023f0 msgr2=0x7f1718197570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:19:46.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.108+0000 7f171e247640 1 --2- 172.21.15.3:0/383602996 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f17181023f0 0x7f1718197570 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f170800e970 tx=0x7f170800ed70 comp rx=0 tx=0).stop 2024-09-21T12:19:46.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.108+0000 7f171e247640 1 -- 172.21.15.3:0/383602996 shutdown_connections 2024-09-21T12:19:46.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.108+0000 7f171e247640 1 --2- 172.21.15.3:0/383602996 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f170006e300 0x7f17000707c0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:46.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.108+0000 7f171e247640 1 --2- 172.21.15.3:0/383602996 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1718104d20 0x7f1718197ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:46.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.108+0000 7f171e247640 1 --2- 172.21.15.3:0/383602996 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f17181023f0 0x7f1718197570 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:46.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.108+0000 7f171e247640 1 -- 172.21.15.3:0/383602996 >> 172.21.15.3:0/383602996 conn(0x7f17180fc010 msgr2=0x7f17180fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:19:46.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.108+0000 7f171e247640 1 -- 172.21.15.3:0/383602996 shutdown_connections 2024-09-21T12:19:46.111 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.108+0000 7f171e247640 1 -- 172.21.15.3:0/383602996 wait complete. 2024-09-21T12:19:46.119 INFO:teuthology.orchestra.run.smithi003.stdout:true 2024-09-21T12:19:46.212 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.210+0000 7f66accf7640 1 -- 172.21.15.3:0/2068192102 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f66a8100b60 msgr2=0x7f66a8100fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:19:46.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.210+0000 7f66accf7640 1 --2- 172.21.15.3:0/2068192102 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f66a8100b60 0x7f66a8100fc0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f669c009880 tx=0x7f669c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:19:46.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.211+0000 7f66accf7640 1 -- 172.21.15.3:0/2068192102 shutdown_connections 2024-09-21T12:19:46.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.211+0000 7f66accf7640 1 --2- 172.21.15.3:0/2068192102 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f66a8100b60 0x7f66a8100fc0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:46.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.211+0000 7f66accf7640 1 --2- 172.21.15.3:0/2068192102 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f66a8100220 0x7f66a8100620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:46.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.211+0000 7f66accf7640 1 -- 172.21.15.3:0/2068192102 >> 172.21.15.3:0/2068192102 conn(0x7f66a80fc010 msgr2=0x7f66a80fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:19:46.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.211+0000 7f66accf7640 1 -- 172.21.15.3:0/2068192102 shutdown_connections 2024-09-21T12:19:46.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.211+0000 7f66accf7640 1 -- 172.21.15.3:0/2068192102 wait complete. 2024-09-21T12:19:46.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.212+0000 7f66accf7640 1 Processor -- start 2024-09-21T12:19:46.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.212+0000 7f66accf7640 1 -- start start 2024-09-21T12:19:46.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.212+0000 7f66accf7640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f66a8100220 0x7f66a81996a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:19:46.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.212+0000 7f66accf7640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f66a8100b60 0x7f66a8199be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:19:46.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.212+0000 7f66accf7640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f66a810c970 con 0x7f66a8100b60 2024-09-21T12:19:46.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.212+0000 7f66accf7640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f66a810c7f0 con 0x7f66a8100220 2024-09-21T12:19:46.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.212+0000 7f66a5d9b640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f66a8100b60 0x7f66a8199be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:19:46.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.212+0000 7f66a5d9b640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f66a8100b60 0x7f66a8199be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:43134/0 (socket says 172.21.15.3:43134) 2024-09-21T12:19:46.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.212+0000 7f66a5d9b640 1 -- 172.21.15.3:0/652181699 learned_addr learned my addr 172.21.15.3:0/652181699 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:19:46.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.212+0000 7f66a659c640 1 --2- 172.21.15.3:0/652181699 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f66a8100220 0x7f66a81996a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:19:46.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.213+0000 7f66a5d9b640 1 -- 172.21.15.3:0/652181699 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f66a8100220 msgr2=0x7f66a81996a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:19:46.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.213+0000 7f66a5d9b640 1 --2- 172.21.15.3:0/652181699 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f66a8100220 0x7f66a81996a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:46.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.213+0000 7f66a5d9b640 1 -- 172.21.15.3:0/652181699 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66a819a260 con 0x7f66a8100b60 2024-09-21T12:19:46.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.213+0000 7f66a5d9b640 1 --2- 172.21.15.3:0/652181699 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f66a8100b60 0x7f66a8199be0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f669c009230 tx=0x7f669c004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:19:46.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.213+0000 7f66977fe640 1 -- 172.21.15.3:0/652181699 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f669c03f070 con 0x7f66a8100b60 2024-09-21T12:19:46.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.213+0000 7f66accf7640 1 -- 172.21.15.3:0/652181699 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66a819ec40 con 0x7f66a8100b60 2024-09-21T12:19:46.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.213+0000 7f66accf7640 1 -- 172.21.15.3:0/652181699 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66a819f180 con 0x7f66a8100b60 2024-09-21T12:19:46.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.213+0000 7f66977fe640 1 -- 172.21.15.3:0/652181699 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f669c004a90 con 0x7f66a8100b60 2024-09-21T12:19:46.217 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.213+0000 7f66977fe640 1 -- 172.21.15.3:0/652181699 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f669c035030 con 0x7f66a8100b60 2024-09-21T12:19:46.217 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.215+0000 7f66accf7640 1 -- 172.21.15.3:0/652181699 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66a8100620 con 0x7f66a8100b60 2024-09-21T12:19:46.217 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.216+0000 7f66977fe640 1 -- 172.21.15.3:0/652181699 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 19) ==== 92549+0+0 (secure 0 0 0) 0x7f669c042070 con 0x7f66a8100b60 2024-09-21T12:19:46.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.216+0000 7f66977fe640 1 --2- 172.21.15.3:0/652181699 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f669006e2b0 0x7f6690070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:19:46.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.217+0000 7f66977fe640 1 -- 172.21.15.3:0/652181699 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5554+0+0 (secure 0 0 0) 0x7f669c0aed10 con 0x7f66a8100b60 2024-09-21T12:19:46.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.217+0000 7f66a659c640 1 --2- 172.21.15.3:0/652181699 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f669006e2b0 0x7f6690070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:19:46.219 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.217+0000 7f66a659c640 1 --2- 172.21.15.3:0/652181699 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f669006e2b0 0x7f6690070770 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6698009bd0 tx=0x7f6698005f90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:19:46.222 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.221+0000 7f66977fe640 1 -- 172.21.15.3:0/652181699 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f669c0802c0 con 0x7f66a8100b60 2024-09-21T12:19:46.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.525+0000 7f66accf7640 1 -- 172.21.15.3:0/652181699 --> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f66a8062630 con 0x7f669006e2b0 2024-09-21T12:19:46.527 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:19:46 smithi003 ceph-mon[28057]: pgmap v243: 65 pgs: 65 active+clean; 93 MiB data, 503 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.2 MiB/s wr, 175 op/s 2024-09-21T12:19:46.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.526+0000 7f66977fe640 1 -- 172.21.15.3:0/652181699 <== mgr.14217 v2:172.21.15.3:6800/2480880781 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+439 (secure 0 0 0) 0x7f66a8062630 con 0x7f669006e2b0 2024-09-21T12:19:46.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.528+0000 7f66accf7640 1 -- 172.21.15.3:0/652181699 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f669006e2b0 msgr2=0x7f6690070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:19:46.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.528+0000 7f66accf7640 1 --2- 172.21.15.3:0/652181699 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f669006e2b0 0x7f6690070770 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f6698009bd0 tx=0x7f6698005f90 comp rx=0 tx=0).stop 2024-09-21T12:19:46.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.528+0000 7f66accf7640 1 -- 172.21.15.3:0/652181699 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f66a8100b60 msgr2=0x7f66a8199be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:19:46.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.528+0000 7f66accf7640 1 --2- 172.21.15.3:0/652181699 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f66a8100b60 0x7f66a8199be0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f669c009230 tx=0x7f669c004570 comp rx=0 tx=0).stop 2024-09-21T12:19:46.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.529+0000 7f66accf7640 1 -- 172.21.15.3:0/652181699 shutdown_connections 2024-09-21T12:19:46.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.529+0000 7f66accf7640 1 --2- 172.21.15.3:0/652181699 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f669006e2b0 0x7f6690070770 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:46.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.529+0000 7f66accf7640 1 --2- 172.21.15.3:0/652181699 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f66a8100b60 0x7f66a8199be0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:46.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.529+0000 7f66accf7640 1 --2- 172.21.15.3:0/652181699 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f66a8100220 0x7f66a81996a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:46.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.529+0000 7f66accf7640 1 -- 172.21.15.3:0/652181699 >> 172.21.15.3:0/652181699 conn(0x7f66a80fc010 msgr2=0x7f66a8108b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:19:46.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.529+0000 7f66accf7640 1 -- 172.21.15.3:0/652181699 shutdown_connections 2024-09-21T12:19:46.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.529+0000 7f66accf7640 1 -- 172.21.15.3:0/652181699 wait complete. 2024-09-21T12:19:46.633 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.631+0000 7fd75f290640 1 -- 172.21.15.3:0/480900294 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd758100860 msgr2=0x7fd758100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:19:46.633 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.631+0000 7fd75f290640 1 --2- 172.21.15.3:0/480900294 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd758100860 0x7fd758100c60 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fd754009880 tx=0x7fd75402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:19:46.633 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.631+0000 7fd75f290640 1 -- 172.21.15.3:0/480900294 shutdown_connections 2024-09-21T12:19:46.633 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.631+0000 7fd75f290640 1 --2- 172.21.15.3:0/480900294 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd758101a60 0x7fd758101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:46.633 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.631+0000 7fd75f290640 1 --2- 172.21.15.3:0/480900294 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd758100860 0x7fd758100c60 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:46.633 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.631+0000 7fd75f290640 1 -- 172.21.15.3:0/480900294 >> 172.21.15.3:0/480900294 conn(0x7fd7580fc010 msgr2=0x7fd7580fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:19:46.633 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.631+0000 7fd75f290640 1 -- 172.21.15.3:0/480900294 shutdown_connections 2024-09-21T12:19:46.633 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.631+0000 7fd75f290640 1 -- 172.21.15.3:0/480900294 wait complete. 2024-09-21T12:19:46.635 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.632+0000 7fd75f290640 1 Processor -- start 2024-09-21T12:19:46.635 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.632+0000 7fd75f290640 1 -- start start 2024-09-21T12:19:46.635 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.632+0000 7fd75f290640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd758100860 0x7fd758104780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:19:46.635 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.632+0000 7fd75f290640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd758101a60 0x7fd758102e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:19:46.635 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.632+0000 7fd75f290640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fd758109680 con 0x7fd758101a60 2024-09-21T12:19:46.635 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.632+0000 7fd75f290640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd758109500 con 0x7fd758100860 2024-09-21T12:19:46.636 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.632+0000 7fd75d02c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd758100860 0x7fd758104780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:19:46.636 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.632+0000 7fd75c82b640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd758101a60 0x7fd758102e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:19:46.636 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.632+0000 7fd75d02c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd758100860 0x7fd758104780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.3:38940/0 (socket says 172.21.15.3:38940) 2024-09-21T12:19:46.636 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.632+0000 7fd75d02c640 1 -- 172.21.15.3:0/2320024434 learned_addr learned my addr 172.21.15.3:0/2320024434 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:19:46.636 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.633+0000 7fd75d02c640 1 -- 172.21.15.3:0/2320024434 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd758101a60 msgr2=0x7fd758102e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:19:46.636 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.633+0000 7fd75d02c640 1 --2- 172.21.15.3:0/2320024434 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd758101a60 0x7fd758102e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:46.636 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.633+0000 7fd75d02c640 1 -- 172.21.15.3:0/2320024434 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd758103380 con 0x7fd758100860 2024-09-21T12:19:46.636 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.633+0000 7fd75d02c640 1 --2- 172.21.15.3:0/2320024434 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd758100860 0x7fd758104780 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd754006010 tx=0x7fd7540045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:19:46.636 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.633+0000 7fd74e7fc640 1 -- 172.21.15.3:0/2320024434 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd75403f070 con 0x7fd758100860 2024-09-21T12:19:46.636 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.633+0000 7fd74e7fc640 1 -- 172.21.15.3:0/2320024434 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd754004a50 con 0x7fd758100860 2024-09-21T12:19:46.636 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.633+0000 7fd74e7fc640 1 -- 172.21.15.3:0/2320024434 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd754035030 con 0x7fd758100860 2024-09-21T12:19:46.636 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.633+0000 7fd75f290640 1 -- 172.21.15.3:0/2320024434 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd758103610 con 0x7fd758100860 2024-09-21T12:19:46.637 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.634+0000 7fd75f290640 1 -- 172.21.15.3:0/2320024434 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd758103b40 con 0x7fd758100860 2024-09-21T12:19:46.637 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.635+0000 7fd74e7fc640 1 -- 172.21.15.3:0/2320024434 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 19) ==== 92549+0+0 (secure 0 0 0) 0x7fd754042070 con 0x7fd758100860 2024-09-21T12:19:46.637 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.636+0000 7fd75f290640 1 -- 172.21.15.3:0/2320024434 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd758100c60 con 0x7fd758100860 2024-09-21T12:19:46.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.636+0000 7fd74e7fc640 1 --2- 172.21.15.3:0/2320024434 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fd74406e350 0x7fd744070810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:19:46.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.636+0000 7fd74e7fc640 1 -- 172.21.15.3:0/2320024434 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5554+0+0 (secure 0 0 0) 0x7fd7540aebe0 con 0x7fd758100860 2024-09-21T12:19:46.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.636+0000 7fd75c82b640 1 --2- 172.21.15.3:0/2320024434 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fd74406e350 0x7fd744070810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:19:46.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.637+0000 7fd75c82b640 1 --2- 172.21.15.3:0/2320024434 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fd74406e350 0x7fd744070810 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd758104500 tx=0x7fd74800b390 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:19:46.643 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.641+0000 7fd74e7fc640 1 -- 172.21.15.3:0/2320024434 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd7540801f0 con 0x7fd758100860 2024-09-21T12:19:46.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:19:46 smithi192 ceph-mon[35641]: pgmap v243: 65 pgs: 65 active+clean; 93 MiB data, 503 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.2 MiB/s wr, 175 op/s 2024-09-21T12:19:46.944 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.942+0000 7fd75f290640 1 -- 172.21.15.3:0/2320024434 --> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fd75806a400 con 0x7fd74406e350 2024-09-21T12:19:46.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.955+0000 7fd74e7fc640 1 -- 172.21.15.3:0/2320024434 <== mgr.14217 v2:172.21.15.3:6800/2480880781 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7fd75806a400 con 0x7fd74406e350 2024-09-21T12:19:46.957 INFO:teuthology.orchestra.run.smithi003.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:19:46.957 INFO:teuthology.orchestra.run.smithi003.stdout:alertmanager.smithi003 smithi003 *:9093,9094 running (5m) 102s ago 7m 25.8M - 0.25.0 c8568f914cd2 5c03f233277e 2024-09-21T12:19:46.957 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-exporter.smithi003 smithi003 running (7m) 102s ago 7m 8321k - 19.1.1-373-g4e45e6b4 164465d2334a 38ef0e2dfcc4 2024-09-21T12:19:46.957 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-exporter.smithi192 smithi192 running (6m) 106s ago 6m 5259k - 19.1.1-373-g4e45e6b4 164465d2334a 848a2ec72db7 2024-09-21T12:19:46.957 INFO:teuthology.orchestra.run.smithi003.stdout:crash.smithi003 smithi003 running (7m) 102s ago 7m 6899k - 19.1.1-373-g4e45e6b4 164465d2334a c63f209dc1dc 2024-09-21T12:19:46.957 INFO:teuthology.orchestra.run.smithi003.stdout:crash.smithi192 smithi192 running (6m) 106s ago 6m 6895k - 19.1.1-373-g4e45e6b4 164465d2334a cc70c9a7b2f7 2024-09-21T12:19:46.957 INFO:teuthology.orchestra.run.smithi003.stdout:grafana.smithi003 smithi003 *:3000 running (5m) 102s ago 7m 79.4M - 9.4.12 2bacad6d85d8 f504f60818f0 2024-09-21T12:19:46.957 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi003.ebjgyl smithi003 running (2m) 102s ago 2m 11.8M - 19.1.1-373-g4e45e6b4 164465d2334a 16e0b2cac16a 2024-09-21T12:19:46.957 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi003.gfkngj smithi003 running (119s) 102s ago 119s 16.7M - 19.1.1-373-g4e45e6b4 164465d2334a 109c04f87fbd 2024-09-21T12:19:46.957 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi192.ktdqns smithi192 running (117s) 106s ago 116s 13.1M - 19.1.1-373-g4e45e6b4 164465d2334a 495c73fb3bb0 2024-09-21T12:19:46.957 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi192.ywqqxe smithi192 running (2m) 106s ago 2m 13.1M - 19.1.1-373-g4e45e6b4 164465d2334a 270a01030cbe 2024-09-21T12:19:46.957 INFO:teuthology.orchestra.run.smithi003.stdout:mgr.smithi003.wztftl smithi003 *:9283,8765,8443 running (8m) 102s ago 8m 501M - 19.1.1-373-g4e45e6b4 164465d2334a 060c1f18749f 2024-09-21T12:19:46.958 INFO:teuthology.orchestra.run.smithi003.stdout:mgr.smithi192.qsaprd smithi192 *:8443,9283,8765 running (6m) 106s ago 6m 442M - 19.1.1-373-g4e45e6b4 164465d2334a 8acd4fe1e324 2024-09-21T12:19:46.958 INFO:teuthology.orchestra.run.smithi003.stdout:mon.smithi003 smithi003 running (8m) 102s ago 9m 48.4M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 16bccf2c7503 2024-09-21T12:19:46.958 INFO:teuthology.orchestra.run.smithi003.stdout:mon.smithi192 smithi192 running (6m) 106s ago 6m 35.4M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 4fe4c4b3dc5d 2024-09-21T12:19:46.958 INFO:teuthology.orchestra.run.smithi003.stdout:node-exporter.smithi003 smithi003 *:9100 running (7m) 102s ago 7m 15.8M - 1.5.0 0da6a335fe13 a1eb875faefc 2024-09-21T12:19:46.958 INFO:teuthology.orchestra.run.smithi003.stdout:node-exporter.smithi192 smithi192 *:9100 running (6m) 106s ago 6m 16.4M - 1.5.0 0da6a335fe13 10c2542c2e19 2024-09-21T12:19:46.958 INFO:teuthology.orchestra.run.smithi003.stdout:osd.0 smithi003 running (5m) 102s ago 5m 54.6M 3948M 19.1.1-373-g4e45e6b4 164465d2334a d07f1489720d 2024-09-21T12:19:46.958 INFO:teuthology.orchestra.run.smithi003.stdout:osd.1 smithi003 running (4m) 102s ago 4m 48.1M 3948M 19.1.1-373-g4e45e6b4 164465d2334a 6abd75a07645 2024-09-21T12:19:46.958 INFO:teuthology.orchestra.run.smithi003.stdout:osd.2 smithi003 running (4m) 102s ago 4m 48.4M 3948M 19.1.1-373-g4e45e6b4 164465d2334a 3265369e573b 2024-09-21T12:19:46.958 INFO:teuthology.orchestra.run.smithi003.stdout:osd.3 smithi192 running (4m) 106s ago 4m 44.4M 4970M 19.1.1-373-g4e45e6b4 164465d2334a 13efcfd71c05 2024-09-21T12:19:46.958 INFO:teuthology.orchestra.run.smithi003.stdout:osd.4 smithi192 running (3m) 106s ago 3m 44.0M 4970M 19.1.1-373-g4e45e6b4 164465d2334a f33bf453cb3e 2024-09-21T12:19:46.958 INFO:teuthology.orchestra.run.smithi003.stdout:osd.5 smithi192 running (3m) 106s ago 3m 42.0M 4970M 19.1.1-373-g4e45e6b4 164465d2334a 12d7b7c8e985 2024-09-21T12:19:46.958 INFO:teuthology.orchestra.run.smithi003.stdout:prometheus.smithi003 smithi003 *:9095 running (5m) 102s ago 7m 58.9M - 2.43.0 a07b618ecd1d 4ecd73d1b37c 2024-09-21T12:19:46.960 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.958+0000 7fd75f290640 1 -- 172.21.15.3:0/2320024434 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fd74406e350 msgr2=0x7fd744070810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:19:46.960 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.958+0000 7fd75f290640 1 --2- 172.21.15.3:0/2320024434 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fd74406e350 0x7fd744070810 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd758104500 tx=0x7fd74800b390 comp rx=0 tx=0).stop 2024-09-21T12:19:46.960 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.958+0000 7fd75f290640 1 -- 172.21.15.3:0/2320024434 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd758100860 msgr2=0x7fd758104780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:19:46.960 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.958+0000 7fd75f290640 1 --2- 172.21.15.3:0/2320024434 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd758100860 0x7fd758104780 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd754006010 tx=0x7fd7540045e0 comp rx=0 tx=0).stop 2024-09-21T12:19:46.960 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.958+0000 7fd75f290640 1 -- 172.21.15.3:0/2320024434 shutdown_connections 2024-09-21T12:19:46.960 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.958+0000 7fd75f290640 1 --2- 172.21.15.3:0/2320024434 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fd74406e350 0x7fd744070810 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:46.960 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.958+0000 7fd75f290640 1 --2- 172.21.15.3:0/2320024434 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd758101a60 0x7fd758102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:46.960 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.958+0000 7fd75f290640 1 --2- 172.21.15.3:0/2320024434 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd758100860 0x7fd758104780 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:46.960 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.958+0000 7fd75f290640 1 -- 172.21.15.3:0/2320024434 >> 172.21.15.3:0/2320024434 conn(0x7fd7580fc010 msgr2=0x7fd758069cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:19:46.960 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.958+0000 7fd75f290640 1 -- 172.21.15.3:0/2320024434 shutdown_connections 2024-09-21T12:19:46.960 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:46.958+0000 7fd75f290640 1 -- 172.21.15.3:0/2320024434 wait complete. 2024-09-21T12:19:47.077 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.075+0000 7fee581f9640 1 -- 172.21.15.3:0/2408384100 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fee50101a60 msgr2=0x7fee50101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:19:47.077 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.075+0000 7fee581f9640 1 --2- 172.21.15.3:0/2408384100 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fee50101a60 0x7fee50101ee0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fee400097e0 tx=0x7fee4002a3f0 comp rx=0 tx=0).stop 2024-09-21T12:19:47.077 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.075+0000 7fee581f9640 1 -- 172.21.15.3:0/2408384100 shutdown_connections 2024-09-21T12:19:47.077 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.075+0000 7fee581f9640 1 --2- 172.21.15.3:0/2408384100 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fee50101a60 0x7fee50101ee0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:47.077 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.075+0000 7fee581f9640 1 --2- 172.21.15.3:0/2408384100 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fee50100860 0x7fee50100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:47.078 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.075+0000 7fee581f9640 1 -- 172.21.15.3:0/2408384100 >> 172.21.15.3:0/2408384100 conn(0x7fee500fc010 msgr2=0x7fee500fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:19:47.078 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.075+0000 7fee581f9640 1 -- 172.21.15.3:0/2408384100 shutdown_connections 2024-09-21T12:19:47.078 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.076+0000 7fee581f9640 1 -- 172.21.15.3:0/2408384100 wait complete. 2024-09-21T12:19:47.078 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.076+0000 7fee581f9640 1 Processor -- start 2024-09-21T12:19:47.079 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.076+0000 7fee581f9640 1 -- start start 2024-09-21T12:19:47.079 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.077+0000 7fee581f9640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fee50100860 0x7fee50197480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:19:47.079 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.077+0000 7fee581f9640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fee50101a60 0x7fee501979c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:19:47.079 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.077+0000 7fee581f9640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fee50109680 con 0x7fee50101a60 2024-09-21T12:19:47.079 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.077+0000 7fee581f9640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fee50109500 con 0x7fee50100860 2024-09-21T12:19:47.079 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.077+0000 7fee55794640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fee50101a60 0x7fee501979c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:19:47.079 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.077+0000 7fee55f95640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fee50100860 0x7fee50197480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:19:47.079 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.077+0000 7fee55794640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fee50101a60 0x7fee501979c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:43170/0 (socket says 172.21.15.3:43170) 2024-09-21T12:19:47.079 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.077+0000 7fee55794640 1 -- 172.21.15.3:0/2874803034 learned_addr learned my addr 172.21.15.3:0/2874803034 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:19:47.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.077+0000 7fee55f95640 1 -- 172.21.15.3:0/2874803034 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fee50101a60 msgr2=0x7fee501979c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:19:47.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.077+0000 7fee55f95640 1 --2- 172.21.15.3:0/2874803034 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fee50101a60 0x7fee501979c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:47.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.077+0000 7fee55f95640 1 -- 172.21.15.3:0/2874803034 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee50198040 con 0x7fee50100860 2024-09-21T12:19:47.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.078+0000 7fee55f95640 1 --2- 172.21.15.3:0/2874803034 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fee50100860 0x7fee50197480 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fee501018c0 tx=0x7fee4c00edd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:19:47.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.078+0000 7fee46ffd640 1 -- 172.21.15.3:0/2874803034 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fee4c004240 con 0x7fee50100860 2024-09-21T12:19:47.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.078+0000 7fee581f9640 1 -- 172.21.15.3:0/2874803034 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee5019ca80 con 0x7fee50100860 2024-09-21T12:19:47.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.078+0000 7fee46ffd640 1 -- 172.21.15.3:0/2874803034 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fee4c0043e0 con 0x7fee50100860 2024-09-21T12:19:47.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.078+0000 7fee46ffd640 1 -- 172.21.15.3:0/2874803034 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fee4c003e40 con 0x7fee50100860 2024-09-21T12:19:47.081 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.078+0000 7fee581f9640 1 -- 172.21.15.3:0/2874803034 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee5019d010 con 0x7fee50100860 2024-09-21T12:19:47.081 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.079+0000 7fee581f9640 1 -- 172.21.15.3:0/2874803034 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee50100c60 con 0x7fee50100860 2024-09-21T12:19:47.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.080+0000 7fee46ffd640 1 -- 172.21.15.3:0/2874803034 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 19) ==== 92549+0+0 (secure 0 0 0) 0x7fee4c003680 con 0x7fee50100860 2024-09-21T12:19:47.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.081+0000 7fee46ffd640 1 --2- 172.21.15.3:0/2874803034 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fee3c06e2b0 0x7fee3c070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:19:47.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.081+0000 7fee46ffd640 1 -- 172.21.15.3:0/2874803034 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5554+0+0 (secure 0 0 0) 0x7fee4c08e960 con 0x7fee50100860 2024-09-21T12:19:47.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.081+0000 7fee55794640 1 --2- 172.21.15.3:0/2874803034 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fee3c06e2b0 0x7fee3c070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:19:47.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.082+0000 7fee55794640 1 --2- 172.21.15.3:0/2874803034 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fee3c06e2b0 0x7fee3c070770 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fee50198930 tx=0x7fee40030890 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:19:47.088 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.087+0000 7fee46ffd640 1 -- 172.21.15.3:0/2874803034 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fee4c05c1c0 con 0x7fee50100860 2024-09-21T12:19:47.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.437+0000 7fee581f9640 1 -- 172.21.15.3:0/2874803034 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fee50062df0 con 0x7fee50100860 2024-09-21T12:19:47.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.438+0000 7fee46ffd640 1 -- 172.21.15.3:0/2874803034 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+633 (secure 0 0 0) 0x7fee4c05fe70 con 0x7fee50100860 2024-09-21T12:19:47.439 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-21T12:19:47.439 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": { 2024-09-21T12:19:47.439 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2 2024-09-21T12:19:47.439 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:19:47.439 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": { 2024-09-21T12:19:47.440 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2 2024-09-21T12:19:47.440 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:19:47.440 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": { 2024-09-21T12:19:47.440 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 6 2024-09-21T12:19:47.440 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:19:47.440 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": { 2024-09-21T12:19:47.440 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 4 2024-09-21T12:19:47.440 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:19:47.440 INFO:teuthology.orchestra.run.smithi003.stdout: "overall": { 2024-09-21T12:19:47.440 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 14 2024-09-21T12:19:47.440 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-21T12:19:47.440 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-21T12:19:47.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.440+0000 7fee581f9640 1 -- 172.21.15.3:0/2874803034 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fee3c06e2b0 msgr2=0x7fee3c070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:19:47.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.440+0000 7fee581f9640 1 --2- 172.21.15.3:0/2874803034 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fee3c06e2b0 0x7fee3c070770 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fee50198930 tx=0x7fee40030890 comp rx=0 tx=0).stop 2024-09-21T12:19:47.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.440+0000 7fee581f9640 1 -- 172.21.15.3:0/2874803034 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fee50100860 msgr2=0x7fee50197480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:19:47.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.440+0000 7fee581f9640 1 --2- 172.21.15.3:0/2874803034 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fee50100860 0x7fee50197480 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fee501018c0 tx=0x7fee4c00edd0 comp rx=0 tx=0).stop 2024-09-21T12:19:47.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.440+0000 7fee581f9640 1 -- 172.21.15.3:0/2874803034 shutdown_connections 2024-09-21T12:19:47.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.440+0000 7fee581f9640 1 --2- 172.21.15.3:0/2874803034 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fee3c06e2b0 0x7fee3c070770 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:47.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.440+0000 7fee581f9640 1 --2- 172.21.15.3:0/2874803034 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fee50101a60 0x7fee501979c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:47.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.440+0000 7fee581f9640 1 --2- 172.21.15.3:0/2874803034 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fee50100860 0x7fee50197480 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:47.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.440+0000 7fee581f9640 1 -- 172.21.15.3:0/2874803034 >> 172.21.15.3:0/2874803034 conn(0x7fee500fc010 msgr2=0x7fee500fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:19:47.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.440+0000 7fee581f9640 1 -- 172.21.15.3:0/2874803034 shutdown_connections 2024-09-21T12:19:47.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.440+0000 7fee581f9640 1 -- 172.21.15.3:0/2874803034 wait complete. 2024-09-21T12:19:47.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.536+0000 7fa56624f640 1 -- 172.21.15.3:0/2976497819 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa560100240 msgr2=0x7fa560100640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:19:47.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.536+0000 7fa56624f640 1 --2- 172.21.15.3:0/2976497819 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa560100240 0x7fa560100640 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fa550009880 tx=0x7fa55002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:19:47.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.536+0000 7fa56624f640 1 -- 172.21.15.3:0/2976497819 shutdown_connections 2024-09-21T12:19:47.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.536+0000 7fa56624f640 1 --2- 172.21.15.3:0/2976497819 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa560100b80 0x7fa560100fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:47.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.536+0000 7fa56624f640 1 --2- 172.21.15.3:0/2976497819 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa560100240 0x7fa560100640 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:47.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.536+0000 7fa56624f640 1 -- 172.21.15.3:0/2976497819 >> 172.21.15.3:0/2976497819 conn(0x7fa5600fc010 msgr2=0x7fa5600fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:19:47.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.537+0000 7fa56624f640 1 -- 172.21.15.3:0/2976497819 shutdown_connections 2024-09-21T12:19:47.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.537+0000 7fa56624f640 1 -- 172.21.15.3:0/2976497819 wait complete. 2024-09-21T12:19:47.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.537+0000 7fa56624f640 1 Processor -- start 2024-09-21T12:19:47.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.537+0000 7fa56624f640 1 -- start start 2024-09-21T12:19:47.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.538+0000 7fa56624f640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa560100240 0x7fa560199670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:19:47.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.538+0000 7fa56624f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa560100b80 0x7fa560199bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:19:47.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.538+0000 7fa56624f640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fa56010c970 con 0x7fa560100b80 2024-09-21T12:19:47.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.538+0000 7fa56624f640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa56010c7f0 con 0x7fa560100240 2024-09-21T12:19:47.541 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.538+0000 7fa55effd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa560100b80 0x7fa560199bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:19:47.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.538+0000 7fa55effd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa560100b80 0x7fa560199bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:43188/0 (socket says 172.21.15.3:43188) 2024-09-21T12:19:47.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.538+0000 7fa55effd640 1 -- 172.21.15.3:0/2730509841 learned_addr learned my addr 172.21.15.3:0/2730509841 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:19:47.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.538+0000 7fa55f7fe640 1 --2- 172.21.15.3:0/2730509841 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa560100240 0x7fa560199670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:19:47.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.538+0000 7fa55effd640 1 -- 172.21.15.3:0/2730509841 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa560100240 msgr2=0x7fa560199670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:19:47.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.538+0000 7fa55effd640 1 --2- 172.21.15.3:0/2730509841 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa560100240 0x7fa560199670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:47.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.538+0000 7fa55effd640 1 -- 172.21.15.3:0/2730509841 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa56019a230 con 0x7fa560100b80 2024-09-21T12:19:47.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.538+0000 7fa55f7fe640 1 --2- 172.21.15.3:0/2730509841 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa560100240 0x7fa560199670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T12:19:47.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.539+0000 7fa55effd640 1 --2- 172.21.15.3:0/2730509841 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa560100b80 0x7fa560199bb0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa55400d8d0 tx=0x7fa55400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:19:47.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.539+0000 7fa55cff9640 1 -- 172.21.15.3:0/2730509841 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa554017030 con 0x7fa560100b80 2024-09-21T12:19:47.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.539+0000 7fa55cff9640 1 -- 172.21.15.3:0/2730509841 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa554004020 con 0x7fa560100b80 2024-09-21T12:19:47.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.539+0000 7fa56624f640 1 -- 172.21.15.3:0/2730509841 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa56019ec70 con 0x7fa560100b80 2024-09-21T12:19:47.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.539+0000 7fa55cff9640 1 -- 172.21.15.3:0/2730509841 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa5540047a0 con 0x7fa560100b80 2024-09-21T12:19:47.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.539+0000 7fa56624f640 1 -- 172.21.15.3:0/2730509841 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa56019f1b0 con 0x7fa560100b80 2024-09-21T12:19:47.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.540+0000 7fa56624f640 1 -- 172.21.15.3:0/2730509841 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa560100640 con 0x7fa560100b80 2024-09-21T12:19:47.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.541+0000 7fa55cff9640 1 -- 172.21.15.3:0/2730509841 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 19) ==== 92549+0+0 (secure 0 0 0) 0x7fa5540041d0 con 0x7fa560100b80 2024-09-21T12:19:47.543 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.542+0000 7fa55cff9640 1 --2- 172.21.15.3:0/2730509841 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fa54806e2b0 0x7fa548070770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:19:47.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.542+0000 7fa55cff9640 1 -- 172.21.15.3:0/2730509841 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5554+0+0 (secure 0 0 0) 0x7fa554018070 con 0x7fa560100b80 2024-09-21T12:19:47.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.542+0000 7fa55f7fe640 1 --2- 172.21.15.3:0/2730509841 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fa54806e2b0 0x7fa548070770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:19:47.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.542+0000 7fa55f7fe640 1 --2- 172.21.15.3:0/2730509841 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fa54806e2b0 0x7fa548070770 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa550000c00 tx=0x7fa5500058d0 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:19:47.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.548+0000 7fa55cff9640 1 -- 172.21.15.3:0/2730509841 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa55405b8f0 con 0x7fa560100b80 2024-09-21T12:19:47.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:19:47 smithi192 ceph-mon[35641]: from='client.14644 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:19:47.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:19:47 smithi192 ceph-mon[35641]: from='client.14648 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:19:47.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:19:47 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:19:47.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:19:47 smithi003 ceph-mon[28057]: from='client.14644 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:19:47.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:19:47 smithi003 ceph-mon[28057]: from='client.14648 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:19:47.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:19:47 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:19:47.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.839+0000 7fa56624f640 1 -- 172.21.15.3:0/2730509841 --> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fa5600626f0 con 0x7fa54806e2b0 2024-09-21T12:19:47.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.840+0000 7fa55cff9640 1 -- 172.21.15.3:0/2730509841 <== mgr.14217 v2:172.21.15.3:6800/2480880781 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+439 (secure 0 0 0) 0x7fa5600626f0 con 0x7fa54806e2b0 2024-09-21T12:19:47.842 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-21T12:19:47.842 INFO:teuthology.orchestra.run.smithi003.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T12:19:47.842 INFO:teuthology.orchestra.run.smithi003.stdout: "in_progress": true, 2024-09-21T12:19:47.842 INFO:teuthology.orchestra.run.smithi003.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-21T12:19:47.842 INFO:teuthology.orchestra.run.smithi003.stdout: "services_complete": [], 2024-09-21T12:19:47.842 INFO:teuthology.orchestra.run.smithi003.stdout: "progress": "0/2 daemons upgraded", 2024-09-21T12:19:47.842 INFO:teuthology.orchestra.run.smithi003.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 image on host smithi192", 2024-09-21T12:19:47.842 INFO:teuthology.orchestra.run.smithi003.stdout: "is_paused": false 2024-09-21T12:19:47.842 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-21T12:19:47.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.842+0000 7fa56624f640 1 -- 172.21.15.3:0/2730509841 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fa54806e2b0 msgr2=0x7fa548070770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:19:47.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.842+0000 7fa56624f640 1 --2- 172.21.15.3:0/2730509841 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fa54806e2b0 0x7fa548070770 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa550000c00 tx=0x7fa5500058d0 comp rx=0 tx=0).stop 2024-09-21T12:19:47.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.842+0000 7fa56624f640 1 -- 172.21.15.3:0/2730509841 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa560100b80 msgr2=0x7fa560199bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:19:47.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.842+0000 7fa56624f640 1 --2- 172.21.15.3:0/2730509841 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa560100b80 0x7fa560199bb0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa55400d8d0 tx=0x7fa55400dd90 comp rx=0 tx=0).stop 2024-09-21T12:19:47.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.843+0000 7fa56624f640 1 -- 172.21.15.3:0/2730509841 shutdown_connections 2024-09-21T12:19:47.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.843+0000 7fa56624f640 1 --2- 172.21.15.3:0/2730509841 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fa54806e2b0 0x7fa548070770 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:47.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.843+0000 7fa56624f640 1 --2- 172.21.15.3:0/2730509841 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa560100b80 0x7fa560199bb0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:47.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.843+0000 7fa56624f640 1 --2- 172.21.15.3:0/2730509841 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa560100240 0x7fa560199670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:19:47.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.843+0000 7fa56624f640 1 -- 172.21.15.3:0/2730509841 >> 172.21.15.3:0/2730509841 conn(0x7fa5600fc010 msgr2=0x7fa560108b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:19:47.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.843+0000 7fa56624f640 1 -- 172.21.15.3:0/2730509841 shutdown_connections 2024-09-21T12:19:47.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:19:47.843+0000 7fa56624f640 1 -- 172.21.15.3:0/2730509841 wait complete. 2024-09-21T12:19:48.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:19:48 smithi003 ceph-mon[28057]: pgmap v244: 65 pgs: 65 active+clean; 108 MiB data, 543 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 4.4 MiB/s wr, 212 op/s 2024-09-21T12:19:48.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:19:48 smithi003 ceph-mon[28057]: from='client.24397 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:19:48.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:19:48 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/2874803034' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:19:48.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:19:48 smithi192 ceph-mon[35641]: pgmap v244: 65 pgs: 65 active+clean; 108 MiB data, 543 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 4.4 MiB/s wr, 212 op/s 2024-09-21T12:19:48.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:19:48 smithi192 ceph-mon[35641]: from='client.24397 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:19:48.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:19:48 smithi192 ceph-mon[35641]: from='client.? 172.21.15.3:0/2874803034' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:19:49.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:19:49 smithi192 ceph-mon[35641]: from='client.14660 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:19:49.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:19:49 smithi003 ceph-mon[28057]: from='client.14660 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:19:50.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:19:50 smithi192 ceph-mon[35641]: pgmap v245: 65 pgs: 65 active+clean; 115 MiB data, 565 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.6 MiB/s wr, 196 op/s 2024-09-21T12:19:50.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:19:50 smithi003 ceph-mon[28057]: pgmap v245: 65 pgs: 65 active+clean; 115 MiB data, 565 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.6 MiB/s wr, 196 op/s 2024-09-21T12:19:52.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:19:52 smithi192 ceph-mon[35641]: pgmap v246: 65 pgs: 65 active+clean; 129 MiB data, 607 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 4.7 MiB/s wr, 256 op/s 2024-09-21T12:19:52.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:19:52 smithi003 ceph-mon[28057]: pgmap v246: 65 pgs: 65 active+clean; 129 MiB data, 607 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 4.7 MiB/s wr, 256 op/s 2024-09-21T12:19:54.716 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:19:54 smithi192 ceph-mon[35641]: pgmap v247: 65 pgs: 65 active+clean; 132 MiB data, 623 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 4.2 MiB/s wr, 262 op/s 2024-09-21T12:19:54.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:19:54 smithi003 ceph-mon[28057]: pgmap v247: 65 pgs: 65 active+clean; 132 MiB data, 623 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 4.2 MiB/s wr, 262 op/s 2024-09-21T12:19:56.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:19:56 smithi192 ceph-mon[35641]: pgmap v248: 65 pgs: 65 active+clean; 133 MiB data, 638 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.5 MiB/s wr, 246 op/s 2024-09-21T12:19:56.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:19:56 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:19:56.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:19:56 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi192.qsaprd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T12:19:56.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:19:56 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T12:19:56.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:19:56 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:19:56.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:19:56 smithi003 ceph-mon[28057]: pgmap v248: 65 pgs: 65 active+clean; 133 MiB data, 638 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 3.5 MiB/s wr, 246 op/s 2024-09-21T12:19:56.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:19:56 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:19:56.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:19:56 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi192.qsaprd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T12:19:56.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:19:56 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T12:19:56.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:19:56 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:19:57.619 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:19:57 smithi192 ceph-mon[35641]: Upgrade: Updating mgr.smithi192.qsaprd 2024-09-21T12:19:57.619 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:19:57 smithi192 ceph-mon[35641]: Deploying daemon mgr.smithi192.qsaprd on smithi192 2024-09-21T12:19:57.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:19:57 smithi003 ceph-mon[28057]: Upgrade: Updating mgr.smithi192.qsaprd 2024-09-21T12:19:57.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:19:57 smithi003 ceph-mon[28057]: Deploying daemon mgr.smithi192.qsaprd on smithi192 2024-09-21T12:19:58.484 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:19:58 smithi192 ceph-mon[35641]: pgmap v249: 65 pgs: 65 active+clean; 147 MiB data, 681 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 4.6 MiB/s wr, 284 op/s 2024-09-21T12:19:58.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:19:58 smithi003 ceph-mon[28057]: pgmap v249: 65 pgs: 65 active+clean; 147 MiB data, 681 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 4.6 MiB/s wr, 284 op/s 2024-09-21T12:19:59.287 INFO:tasks.workunit.client.1.smithi192.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-21T12:19:59.293 INFO:tasks.workunit.client.1.smithi192.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-21T12:19:59.293 INFO:tasks.workunit.client.1.smithi192.stderr:+ make 2024-09-21T12:19:59.966 INFO:tasks.workunit.client.1.smithi192.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-21T12:20:00.567 INFO:tasks.workunit.client.1.smithi192.stderr:++ readlink -f fsstress 2024-09-21T12:20:00.569 INFO:tasks.workunit.client.1.smithi192.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-21T12:20:00.569 INFO:tasks.workunit.client.1.smithi192.stderr:+ popd 2024-09-21T12:20:00.570 INFO:tasks.workunit.client.1.smithi192.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-21T12:20:00.570 INFO:tasks.workunit.client.1.smithi192.stderr:+ popd 2024-09-21T12:20:00.570 INFO:tasks.workunit.client.1.smithi192.stdout:~/cephtest/mnt.1/client.1/tmp 2024-09-21T12:20:00.571 INFO:tasks.workunit.client.1.smithi192.stderr:++ mktemp -d -p . 2024-09-21T12:20:00.574 INFO:tasks.workunit.client.1.smithi192.stderr:+ T=./tmp.mjjFytj4Ae 2024-09-21T12:20:00.574 INFO:tasks.workunit.client.1.smithi192.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.mjjFytj4Ae -l 1 -n 1000 -p 10 -v 2024-09-21T12:20:00.580 INFO:tasks.workunit.client.1.smithi192.stdout:seed = 1726374628 2024-09-21T12:20:00.586 INFO:tasks.workunit.client.1.smithi192.stdout:0/0: write - no filename 2024-09-21T12:20:00.587 INFO:tasks.workunit.client.1.smithi192.stdout:0/1: rename - no filename 2024-09-21T12:20:00.588 INFO:tasks.workunit.client.1.smithi192.stdout:1/0: write - no filename 2024-09-21T12:20:00.588 INFO:tasks.workunit.client.1.smithi192.stdout:1/1: fdatasync - no filename 2024-09-21T12:20:00.594 INFO:tasks.workunit.client.1.smithi192.stdout:0/2: mknod c0 0 2024-09-21T12:20:00.597 INFO:tasks.workunit.client.1.smithi192.stdout:1/2: mknod c0 0 2024-09-21T12:20:00.598 INFO:tasks.workunit.client.1.smithi192.stdout:1/3: chown c0 1437 1 2024-09-21T12:20:00.598 INFO:tasks.workunit.client.1.smithi192.stdout:1/4: write - no filename 2024-09-21T12:20:00.598 INFO:tasks.workunit.client.1.smithi192.stdout:1/5: dwrite - no filename 2024-09-21T12:20:00.598 INFO:tasks.workunit.client.1.smithi192.stdout:1/6: fdatasync - no filename 2024-09-21T12:20:00.599 INFO:tasks.workunit.client.1.smithi192.stdout:0/3: rename c0 to c1 0 2024-09-21T12:20:00.601 INFO:tasks.workunit.client.1.smithi192.stdout:4/0: dwrite - no filename 2024-09-21T12:20:00.602 INFO:tasks.workunit.client.1.smithi192.stdout:2/0: mknod c0 0 2024-09-21T12:20:00.602 INFO:tasks.workunit.client.1.smithi192.stdout:2/1: write - no filename 2024-09-21T12:20:00.602 INFO:tasks.workunit.client.1.smithi192.stdout:2/2: dread - no filename 2024-09-21T12:20:00.605 INFO:tasks.workunit.client.1.smithi192.stdout:1/7: creat f1 x:0 0 0 2024-09-21T12:20:00.608 INFO:tasks.workunit.client.1.smithi192.stdout:3/0: symlink l0 0 2024-09-21T12:20:00.608 INFO:tasks.workunit.client.1.smithi192.stdout:3/1: dwrite - no filename 2024-09-21T12:20:00.611 INFO:tasks.workunit.client.1.smithi192.stdout:1/8: mkdir d2 0 2024-09-21T12:20:00.613 INFO:tasks.workunit.client.1.smithi192.stdout:6/0: dwrite - no filename 2024-09-21T12:20:00.616 INFO:tasks.workunit.client.1.smithi192.stdout:4/1: mknod c0 0 2024-09-21T12:20:00.618 INFO:tasks.workunit.client.1.smithi192.stdout:3/2: creat f1 x:0 0 0 2024-09-21T12:20:00.619 INFO:tasks.workunit.client.1.smithi192.stdout:3/3: dread - f1 zero size 2024-09-21T12:20:00.627 INFO:tasks.workunit.client.1.smithi192.stdout:5/0: mkdir d0 0 2024-09-21T12:20:00.628 INFO:tasks.workunit.client.1.smithi192.stdout:5/1: dread - no filename 2024-09-21T12:20:00.630 INFO:tasks.workunit.client.1.smithi192.stdout:4/2: symlink l1 0 2024-09-21T12:20:00.630 INFO:tasks.workunit.client.1.smithi192.stdout:4/3: dread - no filename 2024-09-21T12:20:00.630 INFO:tasks.workunit.client.1.smithi192.stdout:4/4: readlink l1 0 2024-09-21T12:20:00.630 INFO:tasks.workunit.client.1.smithi192.stdout:4/5: dread - no filename 2024-09-21T12:20:00.630 INFO:tasks.workunit.client.1.smithi192.stdout:4/6: write - no filename 2024-09-21T12:20:00.630 INFO:tasks.workunit.client.1.smithi192.stdout:4/7: chown l1 15815 1 2024-09-21T12:20:00.630 INFO:tasks.workunit.client.1.smithi192.stdout:4/8: chown l1 1245057 1 2024-09-21T12:20:00.632 INFO:tasks.workunit.client.1.smithi192.stdout:3/4: symlink l2 0 2024-09-21T12:20:00.632 INFO:tasks.workunit.client.1.smithi192.stdout:3/5: readlink l0 0 2024-09-21T12:20:00.632 INFO:tasks.workunit.client.1.smithi192.stdout:3/6: chown f1 15936055 1 2024-09-21T12:20:00.633 INFO:tasks.workunit.client.1.smithi192.stdout:2/3: link c0 c1 0 2024-09-21T12:20:00.633 INFO:tasks.workunit.client.1.smithi192.stdout:2/4: truncate - no filename 2024-09-21T12:20:00.633 INFO:tasks.workunit.client.1.smithi192.stdout:2/5: dread - no filename 2024-09-21T12:20:00.635 INFO:tasks.workunit.client.1.smithi192.stdout:1/9: mknod d2/c3 0 2024-09-21T12:20:00.636 INFO:tasks.workunit.client.1.smithi192.stdout:1/10: chown d2/c3 199709 1 2024-09-21T12:20:00.636 INFO:tasks.workunit.client.1.smithi192.stdout:1/11: stat d2 0 2024-09-21T12:20:00.636 INFO:tasks.workunit.client.1.smithi192.stdout:1/12: truncate f1 562596 0 2024-09-21T12:20:00.636 INFO:tasks.workunit.client.1.smithi192.stdout:1/13: fdatasync f1 0 2024-09-21T12:20:00.639 INFO:tasks.workunit.client.1.smithi192.stdout:8/0: write - no filename 2024-09-21T12:20:00.639 INFO:tasks.workunit.client.1.smithi192.stdout:8/1: dread - no filename 2024-09-21T12:20:00.639 INFO:tasks.workunit.client.1.smithi192.stdout:8/2: truncate - no filename 2024-09-21T12:20:00.639 INFO:tasks.workunit.client.1.smithi192.stdout:8/3: readlink - no filename 2024-09-21T12:20:00.641 INFO:tasks.workunit.client.1.smithi192.stdout:6/1: symlink l0 0 2024-09-21T12:20:00.642 INFO:tasks.workunit.client.1.smithi192.stdout:6/2: read - no filename 2024-09-21T12:20:00.642 INFO:tasks.workunit.client.1.smithi192.stdout:6/3: write - no filename 2024-09-21T12:20:00.642 INFO:tasks.workunit.client.1.smithi192.stdout:6/4: write - no filename 2024-09-21T12:20:00.642 INFO:tasks.workunit.client.1.smithi192.stdout:6/5: write - no filename 2024-09-21T12:20:00.642 INFO:tasks.workunit.client.1.smithi192.stdout:6/6: truncate - no filename 2024-09-21T12:20:00.643 INFO:tasks.workunit.client.1.smithi192.stdout:6/7: chown l0 5944428 1 2024-09-21T12:20:00.643 INFO:tasks.workunit.client.1.smithi192.stdout:6/8: dread - no filename 2024-09-21T12:20:00.643 INFO:tasks.workunit.client.1.smithi192.stdout:6/9: write - no filename 2024-09-21T12:20:00.644 INFO:tasks.workunit.client.1.smithi192.stdout:1/14: dwrite f1 [0,4194304] 0 2024-09-21T12:20:00.645 INFO:tasks.workunit.client.1.smithi192.stdout:4/9: mkdir d2 0 2024-09-21T12:20:00.645 INFO:tasks.workunit.client.1.smithi192.stdout:4/10: dread - no filename 2024-09-21T12:20:00.648 INFO:tasks.workunit.client.1.smithi192.stdout:3/7: mknod c3 0 2024-09-21T12:20:00.655 INFO:tasks.workunit.client.1.smithi192.stdout:9/0: dwrite - no filename 2024-09-21T12:20:00.658 INFO:tasks.workunit.client.1.smithi192.stdout:7/0: creat f0 x:0 0 0 2024-09-21T12:20:00.658 INFO:tasks.workunit.client.1.smithi192.stdout:7/1: read - f0 zero size 2024-09-21T12:20:00.658 INFO:tasks.workunit.client.1.smithi192.stdout:7/2: fdatasync f0 0 2024-09-21T12:20:00.665 INFO:tasks.workunit.client.1.smithi192.stdout:6/10: symlink l1 0 2024-09-21T12:20:00.666 INFO:tasks.workunit.client.1.smithi192.stdout:6/11: write - no filename 2024-09-21T12:20:00.667 INFO:tasks.workunit.client.1.smithi192.stdout:5/2: creat d0/f1 x:0 0 0 2024-09-21T12:20:00.670 INFO:tasks.workunit.client.1.smithi192.stdout:1/15: mknod d2/c4 0 2024-09-21T12:20:00.674 INFO:tasks.workunit.client.1.smithi192.stdout:3/8: mknod c4 0 2024-09-21T12:20:00.676 INFO:tasks.workunit.client.1.smithi192.stdout:2/6: chown c1 1383589 1 2024-09-21T12:20:00.677 INFO:tasks.workunit.client.1.smithi192.stdout:2/7: read - no filename 2024-09-21T12:20:00.681 INFO:tasks.workunit.client.1.smithi192.stdout:7/3: mknod c1 0 2024-09-21T12:20:00.681 INFO:tasks.workunit.client.1.smithi192.stdout:7/4: chown f0 119961 1 2024-09-21T12:20:00.683 INFO:tasks.workunit.client.1.smithi192.stdout:8/4: symlink l0 0 2024-09-21T12:20:00.685 INFO:tasks.workunit.client.1.smithi192.stdout:6/12: creat f2 x:0 0 0 2024-09-21T12:20:00.686 INFO:tasks.workunit.client.1.smithi192.stdout:6/13: dread - f2 zero size 2024-09-21T12:20:00.687 INFO:tasks.workunit.client.1.smithi192.stdout:5/3: mkdir d0/d2 0 2024-09-21T12:20:00.688 INFO:tasks.workunit.client.1.smithi192.stdout:5/4: chown d0/d2 3876 1 2024-09-21T12:20:00.688 INFO:tasks.workunit.client.1.smithi192.stdout:5/5: fdatasync d0/f1 0 2024-09-21T12:20:00.689 INFO:tasks.workunit.client.1.smithi192.stdout:5/6: rename d0/d2 to d0/d2/d3 22 2024-09-21T12:20:00.689 INFO:tasks.workunit.client.1.smithi192.stdout:5/7: truncate d0/f1 993322 0 2024-09-21T12:20:00.690 INFO:tasks.workunit.client.1.smithi192.stdout:4/11: mknod d2/c3 0 2024-09-21T12:20:00.691 INFO:tasks.workunit.client.1.smithi192.stdout:4/12: chown d2 2944671 1 2024-09-21T12:20:00.691 INFO:tasks.workunit.client.1.smithi192.stdout:4/13: dread - no filename 2024-09-21T12:20:00.692 INFO:tasks.workunit.client.1.smithi192.stdout:3/9: rename l2 to l5 0 2024-09-21T12:20:00.695 INFO:tasks.workunit.client.1.smithi192.stdout:9/1: creat f0 x:0 0 0 2024-09-21T12:20:00.699 INFO:tasks.workunit.client.1.smithi192.stdout:7/5: mknod c2 0 2024-09-21T12:20:00.702 INFO:tasks.workunit.client.1.smithi192.stdout:8/5: creat f1 x:0 0 0 2024-09-21T12:20:00.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:00 smithi192 ceph-mon[35641]: pgmap v250: 65 pgs: 65 active+clean; 155 MiB data, 706 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 4.1 MiB/s wr, 269 op/s 2024-09-21T12:20:00.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:00 smithi192 ceph-mon[35641]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-21T12:20:00.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:00 smithi192 ceph-mon[35641]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:20:00.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:00 smithi192 ceph-mon[35641]: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:20:00.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:00 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:20:00.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:00 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:20:00.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:00 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:20:00.799 INFO:tasks.workunit.client.1.smithi192.stdout:6/14: mknod c3 0 2024-09-21T12:20:00.799 INFO:tasks.workunit.client.1.smithi192.stdout:8/6: stat l0 0 2024-09-21T12:20:00.799 INFO:tasks.workunit.client.1.smithi192.stdout:5/8: mknod d0/c4 0 2024-09-21T12:20:00.800 INFO:tasks.workunit.client.1.smithi192.stdout:9/2: symlink l1 0 2024-09-21T12:20:00.800 INFO:tasks.workunit.client.1.smithi192.stdout:2/8: chown c0 24 1 2024-09-21T12:20:00.800 INFO:tasks.workunit.client.1.smithi192.stdout:2/9: write - no filename 2024-09-21T12:20:00.801 INFO:tasks.workunit.client.1.smithi192.stdout:7/6: creat f3 x:0 0 0 2024-09-21T12:20:00.801 INFO:tasks.workunit.client.1.smithi192.stdout:9/3: write f0 [823100,126730] 0 2024-09-21T12:20:00.802 INFO:tasks.workunit.client.1.smithi192.stdout:6/15: rename c3 to c4 0 2024-09-21T12:20:00.803 INFO:tasks.workunit.client.1.smithi192.stdout:1/16: link d2/c3 d2/c5 0 2024-09-21T12:20:00.805 INFO:tasks.workunit.client.1.smithi192.stdout:8/7: mknod c2 0 2024-09-21T12:20:00.806 INFO:tasks.workunit.client.1.smithi192.stdout:9/4: dread f0 [0,4194304] 0 2024-09-21T12:20:00.807 INFO:tasks.workunit.client.1.smithi192.stdout:9/5: dread f0 [0,4194304] 0 2024-09-21T12:20:00.810 INFO:tasks.workunit.client.1.smithi192.stdout:2/10: creat f2 x:0 0 0 2024-09-21T12:20:00.812 INFO:tasks.workunit.client.1.smithi192.stdout:7/7: unlink c1 0 2024-09-21T12:20:00.812 INFO:tasks.workunit.client.1.smithi192.stdout:7/8: readlink - no filename 2024-09-21T12:20:00.816 INFO:tasks.workunit.client.1.smithi192.stdout:6/16: creat f5 x:0 0 0 2024-09-21T12:20:00.816 INFO:tasks.workunit.client.1.smithi192.stdout:6/17: write f2 [496460,63919] 0 2024-09-21T12:20:00.823 INFO:tasks.workunit.client.1.smithi192.stdout:4/14: link l1 d2/l4 0 2024-09-21T12:20:00.826 INFO:tasks.workunit.client.1.smithi192.stdout:5/9: mkdir d0/d2/d5 0 2024-09-21T12:20:00.826 INFO:tasks.workunit.client.1.smithi192.stdout:5/10: fdatasync d0/f1 0 2024-09-21T12:20:00.827 INFO:tasks.workunit.client.1.smithi192.stdout:5/11: write d0/f1 [742649,78568] 0 2024-09-21T12:20:00.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:00 smithi003 ceph-mon[28057]: pgmap v250: 65 pgs: 65 active+clean; 155 MiB data, 706 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 4.1 MiB/s wr, 269 op/s 2024-09-21T12:20:00.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:00 smithi003 ceph-mon[28057]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-21T12:20:00.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:00 smithi003 ceph-mon[28057]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:20:00.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:00 smithi003 ceph-mon[28057]: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:20:00.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:00 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:20:00.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:00 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:20:00.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:00 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:20:00.850 INFO:tasks.workunit.client.1.smithi192.stdout:2/11: link c0 c3 0 2024-09-21T12:20:00.851 INFO:tasks.workunit.client.1.smithi192.stdout:2/12: write f2 [570550,48788] 0 2024-09-21T12:20:00.851 INFO:tasks.workunit.client.1.smithi192.stdout:2/13: readlink - no filename 2024-09-21T12:20:00.851 INFO:tasks.workunit.client.1.smithi192.stdout:2/14: rmdir - no directory 2024-09-21T12:20:00.858 INFO:tasks.workunit.client.1.smithi192.stdout:2/15: mknod c4 0 2024-09-21T12:20:00.859 INFO:tasks.workunit.client.1.smithi192.stdout:2/16: chown c4 18 1 2024-09-21T12:20:00.864 INFO:tasks.workunit.client.1.smithi192.stdout:2/17: chown c0 0 1 2024-09-21T12:20:00.865 INFO:tasks.workunit.client.1.smithi192.stdout:2/18: write f2 [53403,117558] 0 2024-09-21T12:20:00.869 INFO:tasks.workunit.client.1.smithi192.stdout:2/19: dread f2 [0,4194304] 0 2024-09-21T12:20:00.874 INFO:tasks.workunit.client.1.smithi192.stdout:2/20: creat f5 x:0 0 0 2024-09-21T12:20:00.883 INFO:tasks.workunit.client.1.smithi192.stdout:2/21: dwrite f2 [0,4194304] 0 2024-09-21T12:20:00.885 INFO:tasks.workunit.client.1.smithi192.stdout:2/22: creat f6 x:0 0 0 2024-09-21T12:20:00.886 INFO:tasks.workunit.client.1.smithi192.stdout:2/23: write f2 [2844928,90295] 0 2024-09-21T12:20:00.895 INFO:tasks.workunit.client.1.smithi192.stdout:2/24: dwrite f6 [0,4194304] 0 2024-09-21T12:20:00.900 INFO:tasks.workunit.client.1.smithi192.stdout:2/25: dread f6 [0,4194304] 0 2024-09-21T12:20:00.902 INFO:tasks.workunit.client.1.smithi192.stdout:2/26: unlink f5 0 2024-09-21T12:20:01.051 INFO:tasks.workunit.client.1.smithi192.stdout:1/17: fsync f1 0 2024-09-21T12:20:01.053 INFO:tasks.workunit.client.1.smithi192.stdout:1/18: mkdir d2/d6 0 2024-09-21T12:20:01.056 INFO:tasks.workunit.client.1.smithi192.stdout:1/19: creat d2/d6/f7 x:0 0 0 2024-09-21T12:20:01.060 INFO:tasks.workunit.client.1.smithi192.stdout:1/20: dread f1 [0,4194304] 0 2024-09-21T12:20:01.061 INFO:tasks.workunit.client.1.smithi192.stdout:1/21: symlink d2/l8 0 2024-09-21T12:20:01.064 INFO:tasks.workunit.client.1.smithi192.stdout:1/22: creat d2/d6/f9 x:0 0 0 2024-09-21T12:20:01.067 INFO:tasks.workunit.client.1.smithi192.stdout:1/23: dread f1 [0,4194304] 0 2024-09-21T12:20:01.068 INFO:tasks.workunit.client.1.smithi192.stdout:1/24: mkdir d2/da 0 2024-09-21T12:20:01.071 INFO:tasks.workunit.client.1.smithi192.stdout:1/25: rename d2/l8 to d2/lb 0 2024-09-21T12:20:01.072 INFO:tasks.workunit.client.1.smithi192.stdout:1/26: dread - d2/d6/f9 zero size 2024-09-21T12:20:01.072 INFO:tasks.workunit.client.1.smithi192.stdout:1/27: write d2/d6/f9 [570768,6040] 0 2024-09-21T12:20:01.079 INFO:tasks.workunit.client.1.smithi192.stdout:1/28: dwrite d2/d6/f7 [0,4194304] 0 2024-09-21T12:20:01.092 INFO:tasks.workunit.client.1.smithi192.stdout:8/8: fsync f1 0 2024-09-21T12:20:01.093 INFO:tasks.workunit.client.1.smithi192.stdout:8/9: write f1 [540060,9207] 0 2024-09-21T12:20:01.098 INFO:tasks.workunit.client.1.smithi192.stdout:9/6: getdents . 0 2024-09-21T12:20:01.100 INFO:tasks.workunit.client.1.smithi192.stdout:9/7: creat f2 x:0 0 0 2024-09-21T12:20:01.103 INFO:tasks.workunit.client.1.smithi192.stdout:9/8: link f2 f3 0 2024-09-21T12:20:01.105 INFO:tasks.workunit.client.1.smithi192.stdout:9/9: write f3 [548051,51505] 0 2024-09-21T12:20:01.113 INFO:tasks.workunit.client.1.smithi192.stdout:9/10: dwrite f3 [0,4194304] 0 2024-09-21T12:20:01.115 INFO:tasks.workunit.client.1.smithi192.stdout:9/11: symlink l4 0 2024-09-21T12:20:01.115 INFO:tasks.workunit.client.1.smithi192.stdout:9/12: readlink l1 0 2024-09-21T12:20:01.117 INFO:tasks.workunit.client.1.smithi192.stdout:9/13: mkdir d5 0 2024-09-21T12:20:01.120 INFO:tasks.workunit.client.1.smithi192.stdout:9/14: mknod d5/c6 0 2024-09-21T12:20:01.127 INFO:tasks.workunit.client.1.smithi192.stdout:9/15: dwrite f2 [0,4194304] 0 2024-09-21T12:20:01.132 INFO:tasks.workunit.client.1.smithi192.stdout:8/10: getdents . 0 2024-09-21T12:20:01.133 INFO:tasks.workunit.client.1.smithi192.stdout:4/15: getdents d2 0 2024-09-21T12:20:01.134 INFO:tasks.workunit.client.1.smithi192.stdout:4/16: chown d2/c3 3611196 1 2024-09-21T12:20:01.134 INFO:tasks.workunit.client.1.smithi192.stdout:4/17: dread - no filename 2024-09-21T12:20:01.136 INFO:tasks.workunit.client.1.smithi192.stdout:4/18: unlink d2/c3 0 2024-09-21T12:20:01.136 INFO:tasks.workunit.client.1.smithi192.stdout:4/19: dwrite - no filename 2024-09-21T12:20:01.136 INFO:tasks.workunit.client.1.smithi192.stdout:8/11: getdents . 0 2024-09-21T12:20:01.138 INFO:tasks.workunit.client.1.smithi192.stdout:4/20: chown l1 50798765 1 2024-09-21T12:20:01.139 INFO:tasks.workunit.client.1.smithi192.stdout:8/12: dread f1 [0,4194304] 0 2024-09-21T12:20:01.140 INFO:tasks.workunit.client.1.smithi192.stdout:4/21: creat d2/f5 x:0 0 0 2024-09-21T12:20:01.148 INFO:tasks.workunit.client.1.smithi192.stdout:8/13: dwrite f1 [0,4194304] 0 2024-09-21T12:20:01.148 INFO:tasks.workunit.client.1.smithi192.stdout:8/14: chown f1 7235 1 2024-09-21T12:20:01.149 INFO:tasks.workunit.client.1.smithi192.stdout:8/15: write f1 [3456941,24465] 0 2024-09-21T12:20:01.152 INFO:tasks.workunit.client.1.smithi192.stdout:8/16: symlink l3 0 2024-09-21T12:20:01.155 INFO:tasks.workunit.client.1.smithi192.stdout:6/18: truncate f2 68075 0 2024-09-21T12:20:01.158 INFO:tasks.workunit.client.1.smithi192.stdout:5/12: truncate d0/f1 444842 0 2024-09-21T12:20:01.159 INFO:tasks.workunit.client.1.smithi192.stdout:8/17: dwrite f1 [0,4194304] 0 2024-09-21T12:20:01.162 INFO:tasks.workunit.client.1.smithi192.stdout:5/13: fdatasync d0/f1 0 2024-09-21T12:20:01.164 INFO:tasks.workunit.client.1.smithi192.stdout:8/18: creat f4 x:0 0 0 2024-09-21T12:20:01.167 INFO:tasks.workunit.client.1.smithi192.stdout:8/19: symlink l5 0 2024-09-21T12:20:01.177 INFO:tasks.workunit.client.1.smithi192.stdout:8/20: fdatasync f1 0 2024-09-21T12:20:01.181 INFO:tasks.workunit.client.1.smithi192.stdout:8/21: dread f1 [0,4194304] 0 2024-09-21T12:20:01.187 INFO:tasks.workunit.client.1.smithi192.stdout:8/22: dwrite f4 [0,4194304] 0 2024-09-21T12:20:01.187 INFO:tasks.workunit.client.1.smithi192.stdout:8/23: fdatasync f1 0 2024-09-21T12:20:01.209 INFO:tasks.workunit.client.1.smithi192.stdout:1/29: truncate d2/d6/f7 2931283 0 2024-09-21T12:20:01.211 INFO:tasks.workunit.client.1.smithi192.stdout:1/30: rmdir d2 39 2024-09-21T12:20:01.211 INFO:tasks.workunit.client.1.smithi192.stdout:1/31: truncate f1 5207884 0 2024-09-21T12:20:01.215 INFO:tasks.workunit.client.1.smithi192.stdout:1/32: write d2/d6/f9 [942812,13334] 0 2024-09-21T12:20:01.216 INFO:tasks.workunit.client.1.smithi192.stdout:1/33: write d2/d6/f9 [1201685,21018] 0 2024-09-21T12:20:01.221 INFO:tasks.workunit.client.1.smithi192.stdout:1/34: unlink d2/lb 0 2024-09-21T12:20:01.234 INFO:tasks.workunit.client.1.smithi192.stdout:4/22: getdents d2 0 2024-09-21T12:20:01.236 INFO:tasks.workunit.client.1.smithi192.stdout:4/23: rmdir d2 39 2024-09-21T12:20:01.239 INFO:tasks.workunit.client.1.smithi192.stdout:4/24: dread - d2/f5 zero size 2024-09-21T12:20:01.241 INFO:tasks.workunit.client.1.smithi192.stdout:4/25: creat d2/f6 x:0 0 0 2024-09-21T12:20:01.242 INFO:tasks.workunit.client.1.smithi192.stdout:4/26: dread - d2/f6 zero size 2024-09-21T12:20:01.242 INFO:tasks.workunit.client.1.smithi192.stdout:4/27: truncate d2/f5 567673 0 2024-09-21T12:20:01.244 INFO:tasks.workunit.client.1.smithi192.stdout:4/28: rmdir d2 39 2024-09-21T12:20:01.248 INFO:tasks.workunit.client.1.smithi192.stdout:5/14: dread d0/f1 [0,4194304] 0 2024-09-21T12:20:01.249 INFO:tasks.workunit.client.1.smithi192.stdout:5/15: dread d0/f1 [0,4194304] 0 2024-09-21T12:20:01.249 INFO:tasks.workunit.client.1.smithi192.stdout:4/29: symlink d2/l7 0 2024-09-21T12:20:01.284 INFO:tasks.workunit.client.1.smithi192.stdout:8/24: write f4 [4592536,88865] 0 2024-09-21T12:20:01.284 INFO:tasks.workunit.client.1.smithi192.stdout:4/30: write d2/f6 [954246,42227] 0 2024-09-21T12:20:01.285 INFO:tasks.workunit.client.1.smithi192.stdout:1/35: truncate f1 3564599 0 2024-09-21T12:20:01.286 INFO:tasks.workunit.client.1.smithi192.stdout:4/31: truncate d2/f5 628263 0 2024-09-21T12:20:01.286 INFO:tasks.workunit.client.1.smithi192.stdout:8/25: symlink l6 0 2024-09-21T12:20:01.291 INFO:tasks.workunit.client.1.smithi192.stdout:1/36: chown d2/c3 1717 1 2024-09-21T12:20:01.291 INFO:tasks.workunit.client.1.smithi192.stdout:5/16: truncate d0/f1 1378419 0 2024-09-21T12:20:01.302 INFO:tasks.workunit.client.1.smithi192.stdout:4/32: dwrite d2/f5 [0,4194304] 0 2024-09-21T12:20:01.302 INFO:tasks.workunit.client.1.smithi192.stdout:8/26: dwrite f1 [4194304,4194304] 0 2024-09-21T12:20:01.304 INFO:tasks.workunit.client.1.smithi192.stdout:4/33: read d2/f5 [2568766,102972] 0 2024-09-21T12:20:01.304 INFO:tasks.workunit.client.1.smithi192.stdout:8/27: read f1 [5895283,68291] 0 2024-09-21T12:20:01.307 INFO:tasks.workunit.client.1.smithi192.stdout:8/28: chown c2 130238 1 2024-09-21T12:20:01.310 INFO:tasks.workunit.client.1.smithi192.stdout:1/37: dwrite d2/d6/f9 [0,4194304] 0 2024-09-21T12:20:01.310 INFO:tasks.workunit.client.1.smithi192.stdout:4/34: symlink d2/l8 0 2024-09-21T12:20:01.313 INFO:tasks.workunit.client.1.smithi192.stdout:5/17: write d0/f1 [1582892,49281] 0 2024-09-21T12:20:01.329 INFO:tasks.workunit.client.1.smithi192.stdout:4/35: mknod d2/c9 0 2024-09-21T12:20:01.329 INFO:tasks.workunit.client.1.smithi192.stdout:8/29: link f1 f7 0 2024-09-21T12:20:01.329 INFO:tasks.workunit.client.1.smithi192.stdout:1/38: creat d2/da/fc x:0 0 0 2024-09-21T12:20:01.329 INFO:tasks.workunit.client.1.smithi192.stdout:1/39: stat d2/d6/f9 0 2024-09-21T12:20:01.466 INFO:tasks.workunit.client.1.smithi192.stdout:4/36: creat d2/fa x:0 0 0 2024-09-21T12:20:01.466 INFO:tasks.workunit.client.1.smithi192.stdout:4/37: chown d2/f6 893501 1 2024-09-21T12:20:01.469 INFO:tasks.workunit.client.1.smithi192.stdout:4/38: mkdir d2/db 0 2024-09-21T12:20:01.470 INFO:tasks.workunit.client.1.smithi192.stdout:4/39: read d2/f6 [587735,45521] 0 2024-09-21T12:20:01.473 INFO:tasks.workunit.client.1.smithi192.stdout:4/40: symlink d2/lc 0 2024-09-21T12:20:01.474 INFO:tasks.workunit.client.1.smithi192.stdout:4/41: chown d2/f5 551711 1 2024-09-21T12:20:01.476 INFO:tasks.workunit.client.1.smithi192.stdout:4/42: write d2/f6 [1277458,57121] 0 2024-09-21T12:20:01.648 INFO:tasks.workunit.client.1.smithi192.stdout:5/18: truncate d0/f1 1287798 0 2024-09-21T12:20:01.657 INFO:tasks.workunit.client.1.smithi192.stdout:1/40: dwrite f1 [0,4194304] 0 2024-09-21T12:20:01.660 INFO:tasks.workunit.client.1.smithi192.stdout:1/41: mknod d2/d6/cd 0 2024-09-21T12:20:01.661 INFO:tasks.workunit.client.1.smithi192.stdout:1/42: write d2/d6/f9 [3455117,118108] 0 2024-09-21T12:20:01.673 INFO:tasks.workunit.client.1.smithi192.stdout:1/43: getdents d2/da 0 2024-09-21T12:20:01.676 INFO:tasks.workunit.client.1.smithi192.stdout:1/44: dread f1 [0,4194304] 0 2024-09-21T12:20:01.683 INFO:tasks.workunit.client.1.smithi192.stdout:1/45: dwrite d2/da/fc [0,4194304] 0 2024-09-21T12:20:01.752 INFO:tasks.workunit.client.1.smithi192.stdout:5/19: write d0/f1 [1108852,14630] 0 2024-09-21T12:20:01.754 INFO:tasks.workunit.client.1.smithi192.stdout:5/20: read d0/f1 [689792,54963] 0 2024-09-21T12:20:01.757 INFO:tasks.workunit.client.1.smithi192.stdout:5/21: link d0/f1 d0/f6 0 2024-09-21T12:20:01.766 INFO:tasks.workunit.client.1.smithi192.stdout:5/22: dwrite d0/f6 [0,4194304] 0 2024-09-21T12:20:01.793 INFO:tasks.workunit.client.1.smithi192.stdout:5/23: write d0/f1 [4747133,98516] 0 2024-09-21T12:20:01.794 INFO:tasks.workunit.client.1.smithi192.stdout:5/24: write d0/f6 [3774068,7019] 0 2024-09-21T12:20:01.798 INFO:tasks.workunit.client.1.smithi192.stdout:5/25: fsync d0/f1 0 2024-09-21T12:20:01.799 INFO:tasks.workunit.client.1.smithi192.stdout:5/26: read d0/f1 [2203922,80201] 0 2024-09-21T12:20:01.807 INFO:tasks.workunit.client.1.smithi192.stdout:5/27: truncate d0/f6 2583529 0 2024-09-21T12:20:01.822 INFO:tasks.workunit.client.1.smithi192.stdout:5/28: dwrite d0/f6 [0,4194304] 0 2024-09-21T12:20:01.823 INFO:tasks.workunit.client.1.smithi192.stdout:5/29: chown d0/f1 3178 1 2024-09-21T12:20:01.824 INFO:tasks.workunit.client.1.smithi192.stdout:5/30: write d0/f6 [4465126,40529] 0 2024-09-21T12:20:01.825 INFO:tasks.workunit.client.1.smithi192.stdout:5/31: rename d0/d2 to d0/d2/d7 22 2024-09-21T12:20:01.827 INFO:tasks.workunit.client.1.smithi192.stdout:5/32: creat d0/f8 x:0 0 0 2024-09-21T12:20:01.835 INFO:tasks.workunit.client.1.smithi192.stdout:5/33: dwrite d0/f8 [0,4194304] 0 2024-09-21T12:20:01.837 INFO:tasks.workunit.client.1.smithi192.stdout:5/34: rmdir d0 39 2024-09-21T12:20:01.847 INFO:tasks.workunit.client.1.smithi192.stdout:5/35: dwrite d0/f1 [0,4194304] 0 2024-09-21T12:20:01.847 INFO:tasks.workunit.client.1.smithi192.stdout:5/36: stat d0/f6 0 2024-09-21T12:20:01.850 INFO:tasks.workunit.client.1.smithi192.stdout:5/37: fsync d0/f8 0 2024-09-21T12:20:01.854 INFO:tasks.workunit.client.1.smithi192.stdout:5/38: unlink d0/c4 0 2024-09-21T12:20:01.858 INFO:tasks.workunit.client.1.smithi192.stdout:5/39: link d0/f8 d0/d2/f9 0 2024-09-21T12:20:01.860 INFO:tasks.workunit.client.1.smithi192.stdout:5/40: fdatasync d0/d2/f9 0 2024-09-21T12:20:01.860 INFO:tasks.workunit.client.1.smithi192.stdout:5/41: readlink - no filename 2024-09-21T12:20:01.860 INFO:tasks.workunit.client.1.smithi192.stdout:5/42: rename d0/d2 to d0/d2/d5/da 22 2024-09-21T12:20:01.861 INFO:tasks.workunit.client.1.smithi192.stdout:5/43: stat d0/f6 0 2024-09-21T12:20:01.862 INFO:tasks.workunit.client.1.smithi192.stdout:5/44: write d0/f8 [2909637,10069] 0 2024-09-21T12:20:01.865 INFO:tasks.workunit.client.1.smithi192.stdout:5/45: mknod d0/d2/d5/cb 0 2024-09-21T12:20:01.865 INFO:tasks.workunit.client.1.smithi192.stdout:5/46: readlink - no filename 2024-09-21T12:20:01.868 INFO:tasks.workunit.client.1.smithi192.stdout:5/47: dread d0/f6 [0,4194304] 0 2024-09-21T12:20:01.869 INFO:tasks.workunit.client.1.smithi192.stdout:5/48: readlink - no filename 2024-09-21T12:20:01.870 INFO:tasks.workunit.client.1.smithi192.stdout:5/49: dread d0/f6 [4194304,4194304] 0 2024-09-21T12:20:01.870 INFO:tasks.workunit.client.1.smithi192.stdout:5/50: readlink - no filename 2024-09-21T12:20:01.876 INFO:tasks.workunit.client.1.smithi192.stdout:5/51: rename d0/d2/d5 to d0/dc 0 2024-09-21T12:20:01.878 INFO:tasks.workunit.client.1.smithi192.stdout:5/52: creat d0/dc/fd x:0 0 0 2024-09-21T12:20:01.884 INFO:tasks.workunit.client.1.smithi192.stdout:5/53: getdents d0/d2 0 2024-09-21T12:20:01.891 INFO:tasks.workunit.client.1.smithi192.stdout:5/54: dwrite d0/dc/fd [0,4194304] 0 2024-09-21T12:20:01.892 INFO:tasks.workunit.client.1.smithi192.stdout:5/55: chown d0/d2/f9 438136616 1 2024-09-21T12:20:01.894 INFO:tasks.workunit.client.1.smithi192.stdout:5/56: mkdir d0/de 0 2024-09-21T12:20:01.895 INFO:tasks.workunit.client.1.smithi192.stdout:5/57: fdatasync d0/d2/f9 0 2024-09-21T12:20:01.897 INFO:tasks.workunit.client.1.smithi192.stdout:5/58: mknod d0/cf 0 2024-09-21T12:20:01.900 INFO:tasks.workunit.client.1.smithi192.stdout:5/59: link d0/d2/f9 d0/f10 0 2024-09-21T12:20:01.903 INFO:tasks.workunit.client.1.smithi192.stdout:5/60: write d0/f8 [2098135,119104] 0 2024-09-21T12:20:01.904 INFO:tasks.workunit.client.1.smithi192.stdout:5/61: write d0/f10 [2169397,6136] 0 2024-09-21T12:20:01.906 INFO:tasks.workunit.client.1.smithi192.stdout:5/62: mknod d0/de/c11 0 2024-09-21T12:20:01.916 INFO:tasks.workunit.client.1.smithi192.stdout:5/63: truncate d0/d2/f9 2292192 0 2024-09-21T12:20:01.917 INFO:tasks.workunit.client.1.smithi192.stdout:5/64: creat d0/f12 x:0 0 0 2024-09-21T12:20:01.923 INFO:tasks.workunit.client.1.smithi192.stdout:5/65: dread d0/f10 [0,4194304] 0 2024-09-21T12:20:01.925 INFO:tasks.workunit.client.1.smithi192.stdout:5/66: mkdir d0/dc/d13 0 2024-09-21T12:20:01.926 INFO:tasks.workunit.client.1.smithi192.stdout:5/67: chown d0 520766 1 2024-09-21T12:20:01.927 INFO:tasks.workunit.client.1.smithi192.stdout:5/68: creat d0/d2/f14 x:0 0 0 2024-09-21T12:20:01.930 INFO:tasks.workunit.client.1.smithi192.stdout:5/69: creat d0/f15 x:0 0 0 2024-09-21T12:20:01.930 INFO:tasks.workunit.client.1.smithi192.stdout:5/70: write d0/f12 [111687,19920] 0 2024-09-21T12:20:01.937 INFO:tasks.workunit.client.1.smithi192.stdout:5/71: dwrite d0/d2/f9 [0,4194304] 0 2024-09-21T12:20:01.942 INFO:tasks.workunit.client.1.smithi192.stdout:5/72: dread d0/f10 [0,4194304] 0 2024-09-21T12:20:01.944 INFO:tasks.workunit.client.1.smithi192.stdout:5/73: creat d0/d2/f16 x:0 0 0 2024-09-21T12:20:01.945 INFO:tasks.workunit.client.1.smithi192.stdout:5/74: dread - d0/d2/f16 zero size 2024-09-21T12:20:01.954 INFO:tasks.workunit.client.1.smithi192.stdout:5/75: dwrite d0/f10 [4194304,4194304] 0 2024-09-21T12:20:01.958 INFO:tasks.workunit.client.1.smithi192.stdout:5/76: dread d0/f6 [0,4194304] 0 2024-09-21T12:20:01.971 INFO:tasks.workunit.client.1.smithi192.stdout:5/77: truncate d0/d2/f9 1923589 0 2024-09-21T12:20:01.971 INFO:tasks.workunit.client.1.smithi192.stdout:5/78: stat d0/f10 0 2024-09-21T12:20:01.972 INFO:tasks.workunit.client.1.smithi192.stdout:5/79: write d0/f6 [895309,126315] 0 2024-09-21T12:20:01.981 INFO:tasks.workunit.client.1.smithi192.stdout:5/80: truncate d0/f1 3705094 0 2024-09-21T12:20:01.983 INFO:tasks.workunit.client.1.smithi192.stdout:5/81: dread d0/f10 [0,4194304] 0 2024-09-21T12:20:01.985 INFO:tasks.workunit.client.1.smithi192.stdout:5/82: dread d0/f12 [0,4194304] 0 2024-09-21T12:20:01.988 INFO:tasks.workunit.client.1.smithi192.stdout:5/83: write d0/f1 [4399231,72597] 0 2024-09-21T12:20:01.989 INFO:tasks.workunit.client.1.smithi192.stdout:5/84: chown d0/f8 121 1 2024-09-21T12:20:01.991 INFO:tasks.workunit.client.1.smithi192.stdout:5/85: symlink d0/dc/l17 0 2024-09-21T12:20:01.994 INFO:tasks.workunit.client.1.smithi192.stdout:5/86: rename d0/dc/fd to d0/dc/d13/f18 0 2024-09-21T12:20:02.000 INFO:tasks.workunit.client.1.smithi192.stdout:5/87: rename d0/dc/d13/f18 to d0/de/f19 0 2024-09-21T12:20:02.003 INFO:tasks.workunit.client.1.smithi192.stdout:5/88: unlink d0/f1 0 2024-09-21T12:20:02.005 INFO:tasks.workunit.client.1.smithi192.stdout:5/89: mkdir d0/d1a 0 2024-09-21T12:20:02.007 INFO:tasks.workunit.client.1.smithi192.stdout:5/90: symlink d0/de/l1b 0 2024-09-21T12:20:02.015 INFO:tasks.workunit.client.1.smithi192.stdout:5/91: truncate d0/f10 939277 0 2024-09-21T12:20:02.021 INFO:tasks.workunit.client.1.smithi192.stdout:5/92: chown d0/de/c11 2323 1 2024-09-21T12:20:02.031 INFO:tasks.workunit.client.1.smithi192.stdout:5/93: write d0/d2/f9 [1680969,58809] 0 2024-09-21T12:20:02.035 INFO:tasks.workunit.client.1.smithi192.stdout:5/94: creat d0/dc/f1c x:0 0 0 2024-09-21T12:20:02.036 INFO:tasks.workunit.client.1.smithi192.stdout:5/95: dread - d0/d2/f16 zero size 2024-09-21T12:20:02.039 INFO:tasks.workunit.client.1.smithi192.stdout:5/96: mkdir d0/d1a/d1d 0 2024-09-21T12:20:02.042 INFO:tasks.workunit.client.1.smithi192.stdout:5/97: rename d0/f6 to d0/dc/f1e 0 2024-09-21T12:20:02.058 INFO:tasks.workunit.client.1.smithi192.stdout:5/98: dwrite d0/f10 [0,4194304] 0 2024-09-21T12:20:02.060 INFO:tasks.workunit.client.1.smithi192.stdout:5/99: stat d0/d2 0 2024-09-21T12:20:02.061 INFO:tasks.workunit.client.1.smithi192.stdout:5/100: dread - d0/f15 zero size 2024-09-21T12:20:02.071 INFO:tasks.workunit.client.1.smithi192.stdout:5/101: dwrite d0/dc/f1c [0,4194304] 0 2024-09-21T12:20:02.073 INFO:tasks.workunit.client.1.smithi192.stdout:5/102: symlink d0/dc/d13/l1f 0 2024-09-21T12:20:02.073 INFO:tasks.workunit.client.1.smithi192.stdout:5/103: stat d0 0 2024-09-21T12:20:02.075 INFO:tasks.workunit.client.1.smithi192.stdout:5/104: write d0/d2/f14 [437560,14794] 0 2024-09-21T12:20:02.077 INFO:tasks.workunit.client.1.smithi192.stdout:5/105: mknod d0/d2/c20 0 2024-09-21T12:20:02.082 INFO:tasks.workunit.client.1.smithi192.stdout:5/106: rename d0/d1a/d1d to d0/d2/d21 0 2024-09-21T12:20:02.086 INFO:tasks.workunit.client.1.smithi192.stdout:5/107: creat d0/dc/f22 x:0 0 0 2024-09-21T12:20:02.090 INFO:tasks.workunit.client.1.smithi192.stdout:5/108: dread d0/f10 [0,4194304] 0 2024-09-21T12:20:02.093 INFO:tasks.workunit.client.1.smithi192.stdout:5/109: symlink d0/dc/d13/l23 0 2024-09-21T12:20:02.094 INFO:tasks.workunit.client.1.smithi192.stdout:5/110: write d0/d2/f14 [21476,69866] 0 2024-09-21T12:20:02.101 INFO:tasks.workunit.client.1.smithi192.stdout:5/111: dwrite d0/d2/f9 [0,4194304] 0 2024-09-21T12:20:02.105 INFO:tasks.workunit.client.1.smithi192.stdout:5/112: unlink d0/dc/d13/l23 0 2024-09-21T12:20:02.108 INFO:tasks.workunit.client.1.smithi192.stdout:5/113: mknod d0/dc/d13/c24 0 2024-09-21T12:20:02.110 INFO:tasks.workunit.client.1.smithi192.stdout:5/114: unlink d0/d2/f16 0 2024-09-21T12:20:02.115 INFO:tasks.workunit.client.1.smithi192.stdout:5/115: link d0/de/f19 d0/d2/d21/f25 0 2024-09-21T12:20:02.123 INFO:tasks.workunit.client.1.smithi192.stdout:5/116: dwrite d0/dc/f22 [0,4194304] 0 2024-09-21T12:20:02.126 INFO:tasks.workunit.client.1.smithi192.stdout:5/117: creat d0/f26 x:0 0 0 2024-09-21T12:20:02.140 INFO:tasks.workunit.client.1.smithi192.stdout:5/118: dwrite d0/f12 [0,4194304] 0 2024-09-21T12:20:02.144 INFO:tasks.workunit.client.1.smithi192.stdout:5/119: mknod d0/dc/d13/c27 0 2024-09-21T12:20:02.149 INFO:tasks.workunit.client.1.smithi192.stdout:5/120: fsync d0/dc/f22 0 2024-09-21T12:20:02.160 INFO:tasks.workunit.client.1.smithi192.stdout:5/121: dwrite d0/d2/f14 [0,4194304] 0 2024-09-21T12:20:02.169 INFO:tasks.workunit.client.1.smithi192.stdout:5/122: dwrite d0/f10 [0,4194304] 0 2024-09-21T12:20:02.175 INFO:tasks.workunit.client.1.smithi192.stdout:5/123: creat d0/f28 x:0 0 0 2024-09-21T12:20:02.176 INFO:tasks.workunit.client.1.smithi192.stdout:5/124: chown d0/d2/d21 379932124 1 2024-09-21T12:20:02.183 INFO:tasks.workunit.client.1.smithi192.stdout:5/125: dwrite d0/f10 [0,4194304] 0 2024-09-21T12:20:02.200 INFO:tasks.workunit.client.1.smithi192.stdout:5/126: fdatasync d0/f8 0 2024-09-21T12:20:02.205 INFO:tasks.workunit.client.1.smithi192.stdout:5/127: rename d0/dc/f1e to d0/d1a/f29 0 2024-09-21T12:20:02.205 INFO:tasks.workunit.client.1.smithi192.stdout:5/128: fsync d0/f26 0 2024-09-21T12:20:02.213 INFO:tasks.workunit.client.1.smithi192.stdout:5/129: dwrite d0/f12 [4194304,4194304] 0 2024-09-21T12:20:02.220 INFO:tasks.workunit.client.1.smithi192.stdout:5/130: link d0/d2/d21/f25 d0/de/f2a 0 2024-09-21T12:20:02.223 INFO:tasks.workunit.client.1.smithi192.stdout:5/131: mknod d0/d2/d21/c2b 0 2024-09-21T12:20:02.226 INFO:tasks.workunit.client.1.smithi192.stdout:5/132: creat d0/d2/d21/f2c x:0 0 0 2024-09-21T12:20:02.228 INFO:tasks.workunit.client.1.smithi192.stdout:5/133: mknod d0/de/c2d 0 2024-09-21T12:20:02.230 INFO:tasks.workunit.client.1.smithi192.stdout:5/134: mknod d0/d2/c2e 0 2024-09-21T12:20:02.232 INFO:tasks.workunit.client.1.smithi192.stdout:5/135: unlink d0/dc/d13/c27 0 2024-09-21T12:20:02.250 INFO:tasks.workunit.client.1.smithi192.stdout:5/136: dwrite d0/de/f2a [0,4194304] 0 2024-09-21T12:20:02.251 INFO:tasks.workunit.client.1.smithi192.stdout:5/137: chown d0/f26 5 1 2024-09-21T12:20:02.252 INFO:tasks.workunit.client.1.smithi192.stdout:5/138: write d0/d2/f9 [4652682,30303] 0 2024-09-21T12:20:02.261 INFO:tasks.workunit.client.1.smithi192.stdout:5/139: dwrite d0/f26 [0,4194304] 0 2024-09-21T12:20:02.263 INFO:tasks.workunit.client.1.smithi192.stdout:5/140: read d0/de/f19 [4150645,18598] 0 2024-09-21T12:20:02.278 INFO:tasks.workunit.client.1.smithi192.stdout:5/141: truncate d0/d2/f14 2573710 0 2024-09-21T12:20:02.289 INFO:tasks.workunit.client.1.smithi192.stdout:5/142: truncate d0/f10 817876 0 2024-09-21T12:20:02.291 INFO:tasks.workunit.client.1.smithi192.stdout:5/143: unlink d0/d2/d21/c2b 0 2024-09-21T12:20:02.293 INFO:tasks.workunit.client.1.smithi192.stdout:5/144: rmdir d0 39 2024-09-21T12:20:02.295 INFO:tasks.workunit.client.1.smithi192.stdout:5/145: chown d0/d2/d21/f2c 1156 1 2024-09-21T12:20:02.295 INFO:tasks.workunit.client.1.smithi192.stdout:5/146: readlink d0/dc/d13/l1f 0 2024-09-21T12:20:02.299 INFO:tasks.workunit.client.1.smithi192.stdout:5/147: dread d0/de/f19 [0,4194304] 0 2024-09-21T12:20:02.301 INFO:tasks.workunit.client.1.smithi192.stdout:5/148: symlink d0/d2/d21/l2f 0 2024-09-21T12:20:02.470 INFO:tasks.workunit.client.1.smithi192.stdout:5/149: dwrite d0/d2/f14 [0,4194304] 0 2024-09-21T12:20:02.556 INFO:tasks.workunit.client.1.smithi192.stdout:5/150: symlink d0/de/l30 0 2024-09-21T12:20:02.558 INFO:tasks.workunit.client.1.smithi192.stdout:5/151: creat d0/d2/d21/f31 x:0 0 0 2024-09-21T12:20:02.564 INFO:tasks.workunit.client.1.smithi192.stdout:5/152: truncate d0/dc/f22 196577 0 2024-09-21T12:20:02.565 INFO:tasks.workunit.client.1.smithi192.stdout:5/153: rmdir d0/de 39 2024-09-21T12:20:02.567 INFO:tasks.workunit.client.1.smithi192.stdout:5/154: fsync d0/d2/d21/f25 0 2024-09-21T12:20:02.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:02 smithi192 ceph-mon[35641]: pgmap v251: 65 pgs: 65 active+clean; 163 MiB data, 710 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 4.1 MiB/s wr, 296 op/s 2024-09-21T12:20:02.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:02 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:20:02.772 INFO:tasks.workunit.client.1.smithi192.stdout:5/155: fdatasync d0/f10 0 2024-09-21T12:20:02.775 INFO:tasks.workunit.client.1.smithi192.stdout:5/156: creat d0/d1a/f32 x:0 0 0 2024-09-21T12:20:02.776 INFO:tasks.workunit.client.1.smithi192.stdout:5/157: fdatasync d0/d1a/f32 0 2024-09-21T12:20:02.779 INFO:tasks.workunit.client.1.smithi192.stdout:5/158: mknod d0/de/c33 0 2024-09-21T12:20:02.782 INFO:tasks.workunit.client.1.smithi192.stdout:5/159: fsync d0/d2/f9 0 2024-09-21T12:20:02.786 INFO:tasks.workunit.client.1.smithi192.stdout:5/160: creat d0/d1a/f34 x:0 0 0 2024-09-21T12:20:02.787 INFO:tasks.workunit.client.1.smithi192.stdout:5/161: chown d0/de/c11 3143282 1 2024-09-21T12:20:02.789 INFO:tasks.workunit.client.1.smithi192.stdout:5/162: mkdir d0/de/d35 0 2024-09-21T12:20:02.796 INFO:tasks.workunit.client.1.smithi192.stdout:5/163: getdents d0/d2 0 2024-09-21T12:20:02.796 INFO:tasks.workunit.client.1.smithi192.stdout:5/164: chown d0/d2/f9 8030559 1 2024-09-21T12:20:02.797 INFO:tasks.workunit.client.1.smithi192.stdout:5/165: rmdir d0/d1a 39 2024-09-21T12:20:02.803 INFO:tasks.workunit.client.1.smithi192.stdout:5/166: dwrite d0/d2/d21/f25 [0,4194304] 0 2024-09-21T12:20:02.807 INFO:tasks.workunit.client.1.smithi192.stdout:5/167: mkdir d0/d1a/d36 0 2024-09-21T12:20:02.808 INFO:tasks.workunit.client.1.smithi192.stdout:5/168: chown d0/f8 265778373 1 2024-09-21T12:20:02.810 INFO:tasks.workunit.client.1.smithi192.stdout:5/169: mkdir d0/dc/d13/d37 0 2024-09-21T12:20:02.813 INFO:tasks.workunit.client.1.smithi192.stdout:5/170: mkdir d0/dc/d13/d37/d38 0 2024-09-21T12:20:02.815 INFO:tasks.workunit.client.1.smithi192.stdout:5/171: mknod d0/de/d35/c39 0 2024-09-21T12:20:02.821 INFO:tasks.workunit.client.1.smithi192.stdout:5/172: dwrite d0/dc/f1c [0,4194304] 0 2024-09-21T12:20:02.825 INFO:tasks.workunit.client.1.smithi192.stdout:5/173: read d0/dc/f22 [37464,3772] 0 2024-09-21T12:20:02.828 INFO:tasks.workunit.client.1.smithi192.stdout:5/174: symlink d0/dc/d13/d37/l3a 0 2024-09-21T12:20:02.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:02 smithi003 ceph-mon[28057]: pgmap v251: 65 pgs: 65 active+clean; 163 MiB data, 710 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 4.1 MiB/s wr, 296 op/s 2024-09-21T12:20:02.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:02 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:20:02.832 INFO:tasks.workunit.client.1.smithi192.stdout:5/175: creat d0/f3b x:0 0 0 2024-09-21T12:20:02.832 INFO:tasks.workunit.client.1.smithi192.stdout:5/176: dread - d0/d2/d21/f2c zero size 2024-09-21T12:20:02.835 INFO:tasks.workunit.client.1.smithi192.stdout:5/177: unlink d0/dc/d13/l1f 0 2024-09-21T12:20:02.837 INFO:tasks.workunit.client.1.smithi192.stdout:5/178: symlink d0/dc/d13/d37/l3c 0 2024-09-21T12:20:02.838 INFO:tasks.workunit.client.1.smithi192.stdout:5/179: rmdir d0/d2 39 2024-09-21T12:20:02.838 INFO:tasks.workunit.client.1.smithi192.stdout:5/180: dread - d0/f3b zero size 2024-09-21T12:20:02.841 INFO:tasks.workunit.client.1.smithi192.stdout:5/181: creat d0/de/d35/f3d x:0 0 0 2024-09-21T12:20:02.846 INFO:tasks.workunit.client.1.smithi192.stdout:5/182: link d0/d2/f9 d0/d2/f3e 0 2024-09-21T12:20:02.848 INFO:tasks.workunit.client.1.smithi192.stdout:5/183: symlink d0/d2/l3f 0 2024-09-21T12:20:02.848 INFO:tasks.workunit.client.1.smithi192.stdout:5/184: stat d0/de/f19 0 2024-09-21T12:20:02.848 INFO:tasks.workunit.client.1.smithi192.stdout:5/185: chown d0/de/c2d 27 1 2024-09-21T12:20:02.849 INFO:tasks.workunit.client.1.smithi192.stdout:5/186: chown d0/dc/d13/d37/d38 3718 1 2024-09-21T12:20:02.987 INFO:tasks.workunit.client.1.smithi192.stdout:5/187: mknod d0/de/d35/c40 0 2024-09-21T12:20:03.021 INFO:tasks.workunit.client.1.smithi192.stdout:5/188: truncate d0/de/f2a 2582550 0 2024-09-21T12:20:03.022 INFO:tasks.workunit.client.1.smithi192.stdout:5/189: mknod d0/dc/c41 0 2024-09-21T12:20:03.023 INFO:tasks.workunit.client.1.smithi192.stdout:5/190: chown d0/d2/d21/f31 1 1 2024-09-21T12:20:03.025 INFO:tasks.workunit.client.1.smithi192.stdout:5/191: unlink d0/de/d35/f3d 0 2024-09-21T12:20:03.026 INFO:tasks.workunit.client.1.smithi192.stdout:5/192: mkdir d0/d42 0 2024-09-21T12:20:03.028 INFO:tasks.workunit.client.1.smithi192.stdout:5/193: creat d0/d2/f43 x:0 0 0 2024-09-21T12:20:04.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:04 smithi192 ceph-mon[35641]: pgmap v252: 65 pgs: 65 active+clean; 187 MiB data, 779 MiB used, 536 GiB / 536 GiB avail; 44 KiB/s rd, 5.3 MiB/s wr, 247 op/s 2024-09-21T12:20:04.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:04 smithi003 ceph-mon[28057]: pgmap v252: 65 pgs: 65 active+clean; 187 MiB data, 779 MiB used, 536 GiB / 536 GiB avail; 44 KiB/s rd, 5.3 MiB/s wr, 247 op/s 2024-09-21T12:20:06.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:06 smithi192 ceph-mon[35641]: pgmap v253: 65 pgs: 65 active+clean; 196 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 81 KiB/s rd, 5.9 MiB/s wr, 212 op/s 2024-09-21T12:20:06.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:06 smithi192 ceph-mon[35641]: Standby manager daemon smithi192.qsaprd restarted 2024-09-21T12:20:06.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:06 smithi192 ceph-mon[35641]: Standby manager daemon smithi192.qsaprd started 2024-09-21T12:20:06.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:06 smithi192 ceph-mon[35641]: from='mgr.? 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi192.qsaprd/crt"}]: dispatch 2024-09-21T12:20:06.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:06 smithi192 ceph-mon[35641]: from='mgr.? 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T12:20:06.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:06 smithi192 ceph-mon[35641]: from='mgr.? 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi192.qsaprd/key"}]: dispatch 2024-09-21T12:20:06.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:06 smithi192 ceph-mon[35641]: from='mgr.? 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T12:20:06.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:06 smithi003 ceph-mon[28057]: pgmap v253: 65 pgs: 65 active+clean; 196 MiB data, 823 MiB used, 536 GiB / 536 GiB avail; 81 KiB/s rd, 5.9 MiB/s wr, 212 op/s 2024-09-21T12:20:06.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:06 smithi003 ceph-mon[28057]: Standby manager daemon smithi192.qsaprd restarted 2024-09-21T12:20:06.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:06 smithi003 ceph-mon[28057]: Standby manager daemon smithi192.qsaprd started 2024-09-21T12:20:06.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:06 smithi003 ceph-mon[28057]: from='mgr.? 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi192.qsaprd/crt"}]: dispatch 2024-09-21T12:20:06.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:06 smithi003 ceph-mon[28057]: from='mgr.? 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T12:20:06.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:06 smithi003 ceph-mon[28057]: from='mgr.? 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi192.qsaprd/key"}]: dispatch 2024-09-21T12:20:06.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:06 smithi003 ceph-mon[28057]: from='mgr.? 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T12:20:07.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:07 smithi192 ceph-mon[35641]: mgrmap e20: smithi003.wztftl(active, since 7m), standbys: smithi192.qsaprd 2024-09-21T12:20:07.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:07 smithi003 ceph-mon[28057]: mgrmap e20: smithi003.wztftl(active, since 7m), standbys: smithi192.qsaprd 2024-09-21T12:20:08.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:08 smithi192 ceph-mon[35641]: pgmap v254: 65 pgs: 65 active+clean; 245 MiB data, 971 MiB used, 535 GiB / 536 GiB avail; 215 KiB/s rd, 15 MiB/s wr, 239 op/s 2024-09-21T12:20:08.809 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:08 smithi003 ceph-mon[28057]: pgmap v254: 65 pgs: 65 active+clean; 245 MiB data, 971 MiB used, 535 GiB / 536 GiB avail; 215 KiB/s rd, 15 MiB/s wr, 239 op/s 2024-09-21T12:20:10.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:10 smithi192 ceph-mon[35641]: pgmap v255: 65 pgs: 65 active+clean; 259 MiB data, 996 MiB used, 535 GiB / 536 GiB avail; 225 KiB/s rd, 15 MiB/s wr, 208 op/s 2024-09-21T12:20:10.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:10 smithi003 ceph-mon[28057]: pgmap v255: 65 pgs: 65 active+clean; 259 MiB data, 996 MiB used, 535 GiB / 536 GiB avail; 225 KiB/s rd, 15 MiB/s wr, 208 op/s 2024-09-21T12:20:12.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:12 smithi192 ceph-mon[35641]: pgmap v256: 65 pgs: 65 active+clean; 270 MiB data, 1007 MiB used, 535 GiB / 536 GiB avail; 225 KiB/s rd, 15 MiB/s wr, 243 op/s 2024-09-21T12:20:12.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:12 smithi003 ceph-mon[28057]: pgmap v256: 65 pgs: 65 active+clean; 270 MiB data, 1007 MiB used, 535 GiB / 536 GiB avail; 225 KiB/s rd, 15 MiB/s wr, 243 op/s 2024-09-21T12:20:14.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:14 smithi192 ceph-mon[35641]: pgmap v257: 65 pgs: 65 active+clean; 272 MiB data, 1015 MiB used, 535 GiB / 536 GiB avail; 225 KiB/s rd, 15 MiB/s wr, 237 op/s 2024-09-21T12:20:14.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:14 smithi003 ceph-mon[28057]: pgmap v257: 65 pgs: 65 active+clean; 272 MiB data, 1015 MiB used, 535 GiB / 536 GiB avail; 225 KiB/s rd, 15 MiB/s wr, 237 op/s 2024-09-21T12:20:14.935 INFO:tasks.workunit.client.1.smithi192.stdout:9/16: sync 2024-09-21T12:20:14.935 INFO:tasks.workunit.client.1.smithi192.stdout:7/9: sync 2024-09-21T12:20:14.936 INFO:tasks.workunit.client.1.smithi192.stdout:3/10: sync 2024-09-21T12:20:14.936 INFO:tasks.workunit.client.1.smithi192.stdout:0/4: sync 2024-09-21T12:20:14.936 INFO:tasks.workunit.client.1.smithi192.stdout:2/27: sync 2024-09-21T12:20:14.936 INFO:tasks.workunit.client.1.smithi192.stdout:4/43: sync 2024-09-21T12:20:14.936 INFO:tasks.workunit.client.1.smithi192.stdout:6/19: sync 2024-09-21T12:20:14.936 INFO:tasks.workunit.client.1.smithi192.stdout:1/46: sync 2024-09-21T12:20:14.936 INFO:tasks.workunit.client.1.smithi192.stdout:8/30: sync 2024-09-21T12:20:14.936 INFO:tasks.workunit.client.1.smithi192.stdout:5/194: sync 2024-09-21T12:20:14.936 INFO:tasks.workunit.client.1.smithi192.stdout:4/44: stat d2/c9 0 2024-09-21T12:20:14.937 INFO:tasks.workunit.client.1.smithi192.stdout:2/28: read f2 [3052465,69167] 0 2024-09-21T12:20:14.937 INFO:tasks.workunit.client.1.smithi192.stdout:5/195: chown d0/dc/l17 3 1 2024-09-21T12:20:14.937 INFO:tasks.workunit.client.1.smithi192.stdout:0/5: chown c1 2957721 1 2024-09-21T12:20:14.937 INFO:tasks.workunit.client.1.smithi192.stdout:0/6: dread - no filename 2024-09-21T12:20:14.937 INFO:tasks.workunit.client.1.smithi192.stdout:0/7: truncate - no filename 2024-09-21T12:20:14.937 INFO:tasks.workunit.client.1.smithi192.stdout:0/8: truncate - no filename 2024-09-21T12:20:14.937 INFO:tasks.workunit.client.1.smithi192.stdout:0/9: write - no filename 2024-09-21T12:20:14.937 INFO:tasks.workunit.client.1.smithi192.stdout:0/10: dwrite - no filename 2024-09-21T12:20:14.938 INFO:tasks.workunit.client.1.smithi192.stdout:0/11: dread - no filename 2024-09-21T12:20:14.938 INFO:tasks.workunit.client.1.smithi192.stdout:8/31: creat f8 x:0 0 0 2024-09-21T12:20:14.938 INFO:tasks.workunit.client.1.smithi192.stdout:0/12: stat c1 0 2024-09-21T12:20:14.938 INFO:tasks.workunit.client.1.smithi192.stdout:8/32: readlink l6 0 2024-09-21T12:20:14.938 INFO:tasks.workunit.client.1.smithi192.stdout:6/20: creat f6 x:0 0 0 2024-09-21T12:20:14.938 INFO:tasks.workunit.client.1.smithi192.stdout:9/17: truncate f3 5022665 0 2024-09-21T12:20:14.942 INFO:tasks.workunit.client.1.smithi192.stdout:2/29: rename f6 to f7 0 2024-09-21T12:20:14.942 INFO:tasks.workunit.client.1.smithi192.stdout:8/33: symlink l9 0 2024-09-21T12:20:14.943 INFO:tasks.workunit.client.1.smithi192.stdout:8/34: write f8 [160885,59541] 0 2024-09-21T12:20:14.944 INFO:tasks.workunit.client.1.smithi192.stdout:9/18: fdatasync f0 0 2024-09-21T12:20:14.946 INFO:tasks.workunit.client.1.smithi192.stdout:5/196: truncate d0/de/f2a 3394024 0 2024-09-21T12:20:14.947 INFO:tasks.workunit.client.1.smithi192.stdout:2/30: mknod c8 0 2024-09-21T12:20:14.947 INFO:tasks.workunit.client.1.smithi192.stdout:5/197: chown d0/dc/d13/d37 110 1 2024-09-21T12:20:14.948 INFO:tasks.workunit.client.1.smithi192.stdout:2/31: chown c4 84635 1 2024-09-21T12:20:14.948 INFO:tasks.workunit.client.1.smithi192.stdout:2/32: rmdir - no directory 2024-09-21T12:20:14.949 INFO:tasks.workunit.client.1.smithi192.stdout:8/35: unlink l6 0 2024-09-21T12:20:14.949 INFO:tasks.workunit.client.1.smithi192.stdout:8/36: readlink l0 0 2024-09-21T12:20:14.953 INFO:tasks.workunit.client.1.smithi192.stdout:2/33: mknod c9 0 2024-09-21T12:20:14.955 INFO:tasks.workunit.client.1.smithi192.stdout:8/37: rename f1 to fa 0 2024-09-21T12:20:14.957 INFO:tasks.workunit.client.1.smithi192.stdout:4/45: getdents d2 0 2024-09-21T12:20:14.958 INFO:tasks.workunit.client.1.smithi192.stdout:4/46: read d2/f5 [2105688,49877] 0 2024-09-21T12:20:14.959 INFO:tasks.workunit.client.1.smithi192.stdout:0/13: getdents . 0 2024-09-21T12:20:14.959 INFO:tasks.workunit.client.1.smithi192.stdout:0/14: read - no filename 2024-09-21T12:20:14.959 INFO:tasks.workunit.client.1.smithi192.stdout:0/15: read - no filename 2024-09-21T12:20:14.960 INFO:tasks.workunit.client.1.smithi192.stdout:5/198: mkdir d0/d42/d44 0 2024-09-21T12:20:14.962 INFO:tasks.workunit.client.1.smithi192.stdout:2/34: symlink la 0 2024-09-21T12:20:14.963 INFO:tasks.workunit.client.1.smithi192.stdout:8/38: fdatasync fa 0 2024-09-21T12:20:14.963 INFO:tasks.workunit.client.1.smithi192.stdout:4/47: dread d2/f5 [0,4194304] 0 2024-09-21T12:20:14.963 INFO:tasks.workunit.client.1.smithi192.stdout:8/39: stat l5 0 2024-09-21T12:20:14.966 INFO:tasks.workunit.client.1.smithi192.stdout:0/16: creat f2 x:0 0 0 2024-09-21T12:20:14.966 INFO:tasks.workunit.client.1.smithi192.stdout:0/17: chown f2 61 1 2024-09-21T12:20:14.967 INFO:tasks.workunit.client.1.smithi192.stdout:0/18: dread - f2 zero size 2024-09-21T12:20:14.968 INFO:tasks.workunit.client.1.smithi192.stdout:0/19: fdatasync f2 0 2024-09-21T12:20:14.968 INFO:tasks.workunit.client.1.smithi192.stdout:5/199: fsync d0/d2/f14 0 2024-09-21T12:20:14.971 INFO:tasks.workunit.client.1.smithi192.stdout:8/40: creat fb x:0 0 0 2024-09-21T12:20:14.971 INFO:tasks.workunit.client.1.smithi192.stdout:4/48: write d2/f5 [23195,15534] 0 2024-09-21T12:20:14.972 INFO:tasks.workunit.client.1.smithi192.stdout:4/49: write d2/f5 [378788,73621] 0 2024-09-21T12:20:14.975 INFO:tasks.workunit.client.1.smithi192.stdout:0/20: unlink f2 0 2024-09-21T12:20:14.975 INFO:tasks.workunit.client.1.smithi192.stdout:0/21: dwrite - no filename 2024-09-21T12:20:14.975 INFO:tasks.workunit.client.1.smithi192.stdout:5/200: truncate d0/d2/d21/f2c 313648 0 2024-09-21T12:20:14.979 INFO:tasks.workunit.client.1.smithi192.stdout:8/41: creat fc x:0 0 0 2024-09-21T12:20:14.981 INFO:tasks.workunit.client.1.smithi192.stdout:4/50: symlink d2/ld 0 2024-09-21T12:20:14.985 INFO:tasks.workunit.client.1.smithi192.stdout:0/22: mkdir d3 0 2024-09-21T12:20:14.985 INFO:tasks.workunit.client.1.smithi192.stdout:0/23: chown c1 93823393 1 2024-09-21T12:20:14.985 INFO:tasks.workunit.client.1.smithi192.stdout:0/24: chown d3 454 1 2024-09-21T12:20:14.989 INFO:tasks.workunit.client.1.smithi192.stdout:8/42: creat fd x:0 0 0 2024-09-21T12:20:14.990 INFO:tasks.workunit.client.1.smithi192.stdout:4/51: truncate d2/fa 980325 0 2024-09-21T12:20:14.995 INFO:tasks.workunit.client.1.smithi192.stdout:8/43: creat fe x:0 0 0 2024-09-21T12:20:14.995 INFO:tasks.workunit.client.1.smithi192.stdout:8/44: chown l9 1018157 1 2024-09-21T12:20:14.995 INFO:tasks.workunit.client.1.smithi192.stdout:8/45: rmdir - no directory 2024-09-21T12:20:14.996 INFO:tasks.workunit.client.1.smithi192.stdout:0/25: mknod d3/c4 0 2024-09-21T12:20:14.999 INFO:tasks.workunit.client.1.smithi192.stdout:8/46: rename f4 to ff 0 2024-09-21T12:20:14.999 INFO:tasks.workunit.client.1.smithi192.stdout:8/47: dread - fd zero size 2024-09-21T12:20:15.162 INFO:tasks.workunit.client.1.smithi192.stdout:7/10: sync 2024-09-21T12:20:15.164 INFO:tasks.workunit.client.1.smithi192.stdout:7/11: rename c2 to c4 0 2024-09-21T12:20:15.165 INFO:tasks.workunit.client.1.smithi192.stdout:7/12: dread - f3 zero size 2024-09-21T12:20:15.224 INFO:tasks.workunit.client.1.smithi192.stdout:4/52: sync 2024-09-21T12:20:15.224 INFO:tasks.workunit.client.1.smithi192.stdout:3/11: sync 2024-09-21T12:20:15.224 INFO:tasks.workunit.client.1.smithi192.stdout:3/12: readlink l5 0 2024-09-21T12:20:15.224 INFO:tasks.workunit.client.1.smithi192.stdout:3/13: chown l5 15196 1 2024-09-21T12:20:15.225 INFO:tasks.workunit.client.1.smithi192.stdout:3/14: chown l0 13855 1 2024-09-21T12:20:15.278 INFO:tasks.workunit.client.1.smithi192.stdout:1/47: write d2/d6/f9 [4657983,56388] 0 2024-09-21T12:20:15.284 INFO:tasks.workunit.client.1.smithi192.stdout:1/48: dread f1 [0,4194304] 0 2024-09-21T12:20:15.284 INFO:tasks.workunit.client.1.smithi192.stdout:6/21: dwrite f5 [0,4194304] 0 2024-09-21T12:20:15.289 INFO:tasks.workunit.client.1.smithi192.stdout:2/35: write f2 [3567713,120870] 0 2024-09-21T12:20:15.290 INFO:tasks.workunit.client.1.smithi192.stdout:2/36: fsync f7 0 2024-09-21T12:20:15.294 INFO:tasks.workunit.client.1.smithi192.stdout:2/37: symlink lb 0 2024-09-21T12:20:15.296 INFO:tasks.workunit.client.1.smithi192.stdout:2/38: chown c3 1127867 1 2024-09-21T12:20:15.300 INFO:tasks.workunit.client.1.smithi192.stdout:4/53: read d2/fa [795447,90075] 0 2024-09-21T12:20:15.301 INFO:tasks.workunit.client.1.smithi192.stdout:2/39: dread f7 [0,4194304] 0 2024-09-21T12:20:15.301 INFO:tasks.workunit.client.1.smithi192.stdout:0/26: getdents d3 0 2024-09-21T12:20:15.302 INFO:tasks.workunit.client.1.smithi192.stdout:2/40: stat c3 0 2024-09-21T12:20:15.302 INFO:tasks.workunit.client.1.smithi192.stdout:0/27: stat d3/c4 0 2024-09-21T12:20:15.303 INFO:tasks.workunit.client.1.smithi192.stdout:2/41: write f7 [860369,106850] 0 2024-09-21T12:20:15.303 INFO:tasks.workunit.client.1.smithi192.stdout:8/48: getdents . 0 2024-09-21T12:20:15.305 INFO:tasks.workunit.client.1.smithi192.stdout:5/201: dwrite d0/d2/f3e [0,4194304] 0 2024-09-21T12:20:15.306 INFO:tasks.workunit.client.1.smithi192.stdout:8/49: write fe [201753,93851] 0 2024-09-21T12:20:15.307 INFO:tasks.workunit.client.1.smithi192.stdout:8/50: chown f7 1 1 2024-09-21T12:20:15.308 INFO:tasks.workunit.client.1.smithi192.stdout:0/28: mkdir d3/d5 0 2024-09-21T12:20:15.308 INFO:tasks.workunit.client.1.smithi192.stdout:0/29: write - no filename 2024-09-21T12:20:15.308 INFO:tasks.workunit.client.1.smithi192.stdout:0/30: truncate - no filename 2024-09-21T12:20:15.308 INFO:tasks.workunit.client.1.smithi192.stdout:2/42: fdatasync f7 0 2024-09-21T12:20:15.308 INFO:tasks.workunit.client.1.smithi192.stdout:2/43: rmdir - no directory 2024-09-21T12:20:15.308 INFO:tasks.workunit.client.1.smithi192.stdout:8/51: truncate fc 410053 0 2024-09-21T12:20:15.309 INFO:tasks.workunit.client.1.smithi192.stdout:2/44: chown f7 1602904 1 2024-09-21T12:20:15.311 INFO:tasks.workunit.client.1.smithi192.stdout:5/202: dread - d0/d1a/f34 zero size 2024-09-21T12:20:15.311 INFO:tasks.workunit.client.1.smithi192.stdout:5/203: readlink d0/dc/l17 0 2024-09-21T12:20:15.312 INFO:tasks.workunit.client.1.smithi192.stdout:0/31: unlink c1 0 2024-09-21T12:20:15.312 INFO:tasks.workunit.client.1.smithi192.stdout:0/32: dread - no filename 2024-09-21T12:20:15.312 INFO:tasks.workunit.client.1.smithi192.stdout:0/33: truncate - no filename 2024-09-21T12:20:15.313 INFO:tasks.workunit.client.1.smithi192.stdout:0/34: read - no filename 2024-09-21T12:20:15.313 INFO:tasks.workunit.client.1.smithi192.stdout:0/35: dwrite - no filename 2024-09-21T12:20:15.313 INFO:tasks.workunit.client.1.smithi192.stdout:0/36: stat d3 0 2024-09-21T12:20:15.313 INFO:tasks.workunit.client.1.smithi192.stdout:0/37: dread - no filename 2024-09-21T12:20:15.313 INFO:tasks.workunit.client.1.smithi192.stdout:0/38: fdatasync - no filename 2024-09-21T12:20:15.313 INFO:tasks.workunit.client.1.smithi192.stdout:0/39: write - no filename 2024-09-21T12:20:15.313 INFO:tasks.workunit.client.1.smithi192.stdout:0/40: truncate - no filename 2024-09-21T12:20:15.316 INFO:tasks.workunit.client.1.smithi192.stdout:8/52: mknod c10 0 2024-09-21T12:20:15.317 INFO:tasks.workunit.client.1.smithi192.stdout:0/41: mkdir d3/d6 0 2024-09-21T12:20:15.317 INFO:tasks.workunit.client.1.smithi192.stdout:0/42: dwrite - no filename 2024-09-21T12:20:15.317 INFO:tasks.workunit.client.1.smithi192.stdout:0/43: chown d3/c4 7 1 2024-09-21T12:20:15.317 INFO:tasks.workunit.client.1.smithi192.stdout:0/44: truncate - no filename 2024-09-21T12:20:15.319 INFO:tasks.workunit.client.1.smithi192.stdout:8/53: unlink l0 0 2024-09-21T12:20:15.320 INFO:tasks.workunit.client.1.smithi192.stdout:8/54: truncate fd 739889 0 2024-09-21T12:20:15.321 INFO:tasks.workunit.client.1.smithi192.stdout:0/45: symlink d3/d5/l7 0 2024-09-21T12:20:15.322 INFO:tasks.workunit.client.1.smithi192.stdout:0/46: chown d3/d5 21 1 2024-09-21T12:20:15.322 INFO:tasks.workunit.client.1.smithi192.stdout:0/47: dwrite - no filename 2024-09-21T12:20:15.322 INFO:tasks.workunit.client.1.smithi192.stdout:0/48: dread - no filename 2024-09-21T12:20:15.322 INFO:tasks.workunit.client.1.smithi192.stdout:0/49: stat d3 0 2024-09-21T12:20:15.322 INFO:tasks.workunit.client.1.smithi192.stdout:0/50: fsync - no filename 2024-09-21T12:20:15.322 INFO:tasks.workunit.client.1.smithi192.stdout:0/51: read - no filename 2024-09-21T12:20:15.324 INFO:tasks.workunit.client.1.smithi192.stdout:8/55: creat f11 x:0 0 0 2024-09-21T12:20:15.329 INFO:tasks.workunit.client.1.smithi192.stdout:0/52: symlink d3/d6/l8 0 2024-09-21T12:20:15.329 INFO:tasks.workunit.client.1.smithi192.stdout:0/53: dread - no filename 2024-09-21T12:20:15.329 INFO:tasks.workunit.client.1.smithi192.stdout:0/54: write - no filename 2024-09-21T12:20:15.332 INFO:tasks.workunit.client.1.smithi192.stdout:0/55: creat d3/d5/f9 x:0 0 0 2024-09-21T12:20:15.332 INFO:tasks.workunit.client.1.smithi192.stdout:0/56: truncate d3/d5/f9 215813 0 2024-09-21T12:20:15.351 INFO:tasks.workunit.client.1.smithi192.stdout:7/13: dwrite f0 [0,4194304] 0 2024-09-21T12:20:15.352 INFO:tasks.workunit.client.1.smithi192.stdout:7/14: creat f5 x:0 0 0 2024-09-21T12:20:15.353 INFO:tasks.workunit.client.1.smithi192.stdout:7/15: write f5 [379351,91947] 0 2024-09-21T12:20:15.360 INFO:tasks.workunit.client.1.smithi192.stdout:3/15: write f1 [536025,31502] 0 2024-09-21T12:20:15.373 INFO:tasks.workunit.client.1.smithi192.stdout:1/49: write f1 [2152020,120077] 0 2024-09-21T12:20:15.376 INFO:tasks.workunit.client.1.smithi192.stdout:3/16: dread f1 [0,4194304] 0 2024-09-21T12:20:15.377 INFO:tasks.workunit.client.1.smithi192.stdout:7/16: fsync f0 0 2024-09-21T12:20:15.378 INFO:tasks.workunit.client.1.smithi192.stdout:9/19: dwrite f2 [0,4194304] 0 2024-09-21T12:20:15.378 INFO:tasks.workunit.client.1.smithi192.stdout:4/54: write d2/fa [832708,70295] 0 2024-09-21T12:20:15.380 INFO:tasks.workunit.client.1.smithi192.stdout:9/20: chown f3 6672 1 2024-09-21T12:20:15.383 INFO:tasks.workunit.client.1.smithi192.stdout:9/21: read f3 [1923285,33522] 0 2024-09-21T12:20:15.386 INFO:tasks.workunit.client.1.smithi192.stdout:1/50: dwrite f1 [0,4194304] 0 2024-09-21T12:20:15.388 INFO:tasks.workunit.client.1.smithi192.stdout:1/51: chown d2/c5 0 1 2024-09-21T12:20:15.390 INFO:tasks.workunit.client.1.smithi192.stdout:8/56: getdents . 0 2024-09-21T12:20:15.391 INFO:tasks.workunit.client.1.smithi192.stdout:3/17: dwrite f1 [0,4194304] 0 2024-09-21T12:20:15.391 INFO:tasks.workunit.client.1.smithi192.stdout:4/55: mknod d2/db/ce 0 2024-09-21T12:20:15.396 INFO:tasks.workunit.client.1.smithi192.stdout:9/22: dread f2 [0,4194304] 0 2024-09-21T12:20:15.396 INFO:tasks.workunit.client.1.smithi192.stdout:8/57: creat f12 x:0 0 0 2024-09-21T12:20:15.397 INFO:tasks.workunit.client.1.smithi192.stdout:4/56: mkdir d2/df 0 2024-09-21T12:20:15.399 INFO:tasks.workunit.client.1.smithi192.stdout:3/18: rename c3 to c6 0 2024-09-21T12:20:15.399 INFO:tasks.workunit.client.1.smithi192.stdout:1/52: dread f1 [0,4194304] 0 2024-09-21T12:20:15.401 INFO:tasks.workunit.client.1.smithi192.stdout:8/58: symlink l13 0 2024-09-21T12:20:15.402 INFO:tasks.workunit.client.1.smithi192.stdout:9/23: write f3 [6001651,29388] 0 2024-09-21T12:20:15.404 INFO:tasks.workunit.client.1.smithi192.stdout:7/17: truncate f0 2233971 0 2024-09-21T12:20:15.407 INFO:tasks.workunit.client.1.smithi192.stdout:1/53: mkdir d2/de 0 2024-09-21T12:20:15.408 INFO:tasks.workunit.client.1.smithi192.stdout:8/59: dwrite fc [0,4194304] 0 2024-09-21T12:20:15.409 INFO:tasks.workunit.client.1.smithi192.stdout:8/60: write fe [1203440,11167] 0 2024-09-21T12:20:15.410 INFO:tasks.workunit.client.1.smithi192.stdout:9/24: rmdir d5 39 2024-09-21T12:20:15.412 INFO:tasks.workunit.client.1.smithi192.stdout:7/18: mkdir d6 0 2024-09-21T12:20:15.417 INFO:tasks.workunit.client.1.smithi192.stdout:8/61: mkdir d14 0 2024-09-21T12:20:15.417 INFO:tasks.workunit.client.1.smithi192.stdout:8/62: chown c2 450801875 1 2024-09-21T12:20:15.417 INFO:tasks.workunit.client.1.smithi192.stdout:8/63: chown c2 3680 1 2024-09-21T12:20:15.419 INFO:tasks.workunit.client.1.smithi192.stdout:1/54: mknod d2/de/cf 0 2024-09-21T12:20:15.420 INFO:tasks.workunit.client.1.smithi192.stdout:8/64: truncate ff 1432013 0 2024-09-21T12:20:15.420 INFO:tasks.workunit.client.1.smithi192.stdout:8/65: chown fa 149 1 2024-09-21T12:20:15.421 INFO:tasks.workunit.client.1.smithi192.stdout:7/19: creat d6/f7 x:0 0 0 2024-09-21T12:20:15.421 INFO:tasks.workunit.client.1.smithi192.stdout:8/66: truncate fd 1038789 0 2024-09-21T12:20:15.421 INFO:tasks.workunit.client.1.smithi192.stdout:7/20: dread - f3 zero size 2024-09-21T12:20:15.421 INFO:tasks.workunit.client.1.smithi192.stdout:8/67: readlink l3 0 2024-09-21T12:20:15.422 INFO:tasks.workunit.client.1.smithi192.stdout:7/21: rename d6 to d6/d8 22 2024-09-21T12:20:15.424 INFO:tasks.workunit.client.1.smithi192.stdout:7/22: mkdir d6/d9 0 2024-09-21T12:20:15.428 INFO:tasks.workunit.client.1.smithi192.stdout:1/55: dwrite d2/d6/f7 [0,4194304] 0 2024-09-21T12:20:15.433 INFO:tasks.workunit.client.1.smithi192.stdout:7/23: link c4 d6/d9/ca 0 2024-09-21T12:20:15.434 INFO:tasks.workunit.client.1.smithi192.stdout:3/19: dwrite f1 [4194304,4194304] 0 2024-09-21T12:20:15.435 INFO:tasks.workunit.client.1.smithi192.stdout:7/24: dread - f3 zero size 2024-09-21T12:20:15.437 INFO:tasks.workunit.client.1.smithi192.stdout:3/20: symlink l7 0 2024-09-21T12:20:15.438 INFO:tasks.workunit.client.1.smithi192.stdout:1/56: dwrite d2/d6/f9 [0,4194304] 0 2024-09-21T12:20:15.439 INFO:tasks.workunit.client.1.smithi192.stdout:3/21: chown l0 490557 1 2024-09-21T12:20:15.440 INFO:tasks.workunit.client.1.smithi192.stdout:7/25: rmdir d6 39 2024-09-21T12:20:15.443 INFO:tasks.workunit.client.1.smithi192.stdout:3/22: rename f1 to f8 0 2024-09-21T12:20:15.444 INFO:tasks.workunit.client.1.smithi192.stdout:8/68: dread ff [0,4194304] 0 2024-09-21T12:20:15.446 INFO:tasks.workunit.client.1.smithi192.stdout:1/57: creat d2/d6/f10 x:0 0 0 2024-09-21T12:20:15.449 INFO:tasks.workunit.client.1.smithi192.stdout:7/26: dwrite f5 [0,4194304] 0 2024-09-21T12:20:15.452 INFO:tasks.workunit.client.1.smithi192.stdout:1/58: creat d2/de/f11 x:0 0 0 2024-09-21T12:20:15.454 INFO:tasks.workunit.client.1.smithi192.stdout:7/27: truncate d6/f7 654799 0 2024-09-21T12:20:15.455 INFO:tasks.workunit.client.1.smithi192.stdout:8/69: creat d14/f15 x:0 0 0 2024-09-21T12:20:15.456 INFO:tasks.workunit.client.1.smithi192.stdout:8/70: chown c10 11773818 1 2024-09-21T12:20:15.457 INFO:tasks.workunit.client.1.smithi192.stdout:7/28: creat d6/fb x:0 0 0 2024-09-21T12:20:15.460 INFO:tasks.workunit.client.1.smithi192.stdout:1/59: dwrite d2/d6/f7 [0,4194304] 0 2024-09-21T12:20:15.461 INFO:tasks.workunit.client.1.smithi192.stdout:8/71: link f8 d14/f16 0 2024-09-21T12:20:15.464 INFO:tasks.workunit.client.1.smithi192.stdout:7/29: creat d6/d9/fc x:0 0 0 2024-09-21T12:20:15.465 INFO:tasks.workunit.client.1.smithi192.stdout:7/30: dread d6/f7 [0,4194304] 0 2024-09-21T12:20:15.466 INFO:tasks.workunit.client.1.smithi192.stdout:8/72: rename l5 to d14/l17 0 2024-09-21T12:20:15.469 INFO:tasks.workunit.client.1.smithi192.stdout:8/73: mkdir d14/d18 0 2024-09-21T12:20:15.469 INFO:tasks.workunit.client.1.smithi192.stdout:8/74: write fb [344175,93438] 0 2024-09-21T12:20:15.471 INFO:tasks.workunit.client.1.smithi192.stdout:8/75: mknod d14/c19 0 2024-09-21T12:20:15.472 INFO:tasks.workunit.client.1.smithi192.stdout:8/76: mkdir d14/d1a 0 2024-09-21T12:20:15.474 INFO:tasks.workunit.client.1.smithi192.stdout:8/77: symlink d14/d18/l1b 0 2024-09-21T12:20:15.475 INFO:tasks.workunit.client.1.smithi192.stdout:8/78: symlink d14/d1a/l1c 0 2024-09-21T12:20:15.486 INFO:tasks.workunit.client.1.smithi192.stdout:1/60: rename d2/d6 to d2/d12 0 2024-09-21T12:20:15.488 INFO:tasks.workunit.client.1.smithi192.stdout:1/61: mknod d2/da/c13 0 2024-09-21T12:20:15.491 INFO:tasks.workunit.client.1.smithi192.stdout:1/62: creat d2/f14 x:0 0 0 2024-09-21T12:20:15.491 INFO:tasks.workunit.client.1.smithi192.stdout:8/79: truncate ff 2374290 0 2024-09-21T12:20:15.492 INFO:tasks.workunit.client.1.smithi192.stdout:8/80: write f7 [8352139,5615] 0 2024-09-21T12:20:15.494 INFO:tasks.workunit.client.1.smithi192.stdout:1/63: symlink d2/de/l15 0 2024-09-21T12:20:15.498 INFO:tasks.workunit.client.1.smithi192.stdout:8/81: dwrite f7 [4194304,4194304] 0 2024-09-21T12:20:15.499 INFO:tasks.workunit.client.1.smithi192.stdout:8/82: read - d14/f15 zero size 2024-09-21T12:20:15.504 INFO:tasks.workunit.client.1.smithi192.stdout:1/64: dwrite d2/de/f11 [0,4194304] 0 2024-09-21T12:20:15.504 INFO:tasks.workunit.client.1.smithi192.stdout:8/83: truncate d14/f15 482448 0 2024-09-21T12:20:15.506 INFO:tasks.workunit.client.1.smithi192.stdout:8/84: write f7 [8017333,53075] 0 2024-09-21T12:20:15.509 INFO:tasks.workunit.client.1.smithi192.stdout:7/31: dwrite f3 [0,4194304] 0 2024-09-21T12:20:15.512 INFO:tasks.workunit.client.1.smithi192.stdout:8/85: mkdir d14/d1a/d1d 0 2024-09-21T12:20:15.516 INFO:tasks.workunit.client.1.smithi192.stdout:7/32: mknod d6/cd 0 2024-09-21T12:20:15.519 INFO:tasks.workunit.client.1.smithi192.stdout:1/65: write d2/da/fc [4094606,23970] 0 2024-09-21T12:20:15.520 INFO:tasks.workunit.client.1.smithi192.stdout:7/33: symlink d6/le 0 2024-09-21T12:20:15.521 INFO:tasks.workunit.client.1.smithi192.stdout:7/34: write f5 [3351345,119963] 0 2024-09-21T12:20:15.524 INFO:tasks.workunit.client.1.smithi192.stdout:7/35: unlink d6/f7 0 2024-09-21T12:20:15.526 INFO:tasks.workunit.client.1.smithi192.stdout:7/36: fsync d6/d9/fc 0 2024-09-21T12:20:15.526 INFO:tasks.workunit.client.1.smithi192.stdout:8/86: dread fe [0,4194304] 0 2024-09-21T12:20:15.527 INFO:tasks.workunit.client.1.smithi192.stdout:1/66: dwrite d2/d12/f9 [0,4194304] 0 2024-09-21T12:20:15.527 INFO:tasks.workunit.client.1.smithi192.stdout:7/37: write f3 [4093399,13753] 0 2024-09-21T12:20:15.529 INFO:tasks.workunit.client.1.smithi192.stdout:1/67: chown d2/d12/f9 96975023 1 2024-09-21T12:20:15.530 INFO:tasks.workunit.client.1.smithi192.stdout:7/38: creat d6/ff x:0 0 0 2024-09-21T12:20:15.532 INFO:tasks.workunit.client.1.smithi192.stdout:8/87: creat d14/d1a/d1d/f1e x:0 0 0 2024-09-21T12:20:15.535 INFO:tasks.workunit.client.1.smithi192.stdout:1/68: rmdir d2/da 39 2024-09-21T12:20:15.535 INFO:tasks.workunit.client.1.smithi192.stdout:8/88: dread fa [4194304,4194304] 0 2024-09-21T12:20:15.538 INFO:tasks.workunit.client.1.smithi192.stdout:1/69: dread d2/d12/f9 [4194304,4194304] 0 2024-09-21T12:20:15.541 INFO:tasks.workunit.client.1.smithi192.stdout:8/89: symlink d14/l1f 0 2024-09-21T12:20:15.545 INFO:tasks.workunit.client.1.smithi192.stdout:1/70: rename d2/de/cf to d2/d12/c16 0 2024-09-21T12:20:15.546 INFO:tasks.workunit.client.1.smithi192.stdout:1/71: chown d2/d12/f10 1 1 2024-09-21T12:20:15.549 INFO:tasks.workunit.client.1.smithi192.stdout:1/72: dread f1 [0,4194304] 0 2024-09-21T12:20:15.552 INFO:tasks.workunit.client.1.smithi192.stdout:1/73: symlink d2/l17 0 2024-09-21T12:20:15.555 INFO:tasks.workunit.client.1.smithi192.stdout:1/74: creat d2/de/f18 x:0 0 0 2024-09-21T12:20:15.555 INFO:tasks.workunit.client.1.smithi192.stdout:8/90: truncate fa 7501463 0 2024-09-21T12:20:15.556 INFO:tasks.workunit.client.1.smithi192.stdout:1/75: write d2/d12/f10 [312879,81063] 0 2024-09-21T12:20:15.562 INFO:tasks.workunit.client.1.smithi192.stdout:8/91: dwrite d14/d1a/d1d/f1e [0,4194304] 0 2024-09-21T12:20:15.564 INFO:tasks.workunit.client.1.smithi192.stdout:2/45: sync 2024-09-21T12:20:15.564 INFO:tasks.workunit.client.1.smithi192.stdout:6/22: sync 2024-09-21T12:20:15.566 INFO:tasks.workunit.client.1.smithi192.stdout:1/76: dwrite d2/da/fc [0,4194304] 0 2024-09-21T12:20:15.568 INFO:tasks.workunit.client.1.smithi192.stdout:2/46: symlink lc 0 2024-09-21T12:20:15.568 INFO:tasks.workunit.client.1.smithi192.stdout:2/47: rmdir - no directory 2024-09-21T12:20:15.569 INFO:tasks.workunit.client.1.smithi192.stdout:2/48: chown f7 16584313 1 2024-09-21T12:20:15.569 INFO:tasks.workunit.client.1.smithi192.stdout:6/23: read f2 [24962,4126] 0 2024-09-21T12:20:15.572 INFO:tasks.workunit.client.1.smithi192.stdout:1/77: creat d2/de/f19 x:0 0 0 2024-09-21T12:20:15.573 INFO:tasks.workunit.client.1.smithi192.stdout:2/49: dread f2 [0,4194304] 0 2024-09-21T12:20:15.575 INFO:tasks.workunit.client.1.smithi192.stdout:2/50: chown la 18204 1 2024-09-21T12:20:15.576 INFO:tasks.workunit.client.1.smithi192.stdout:2/51: readlink la 0 2024-09-21T12:20:15.576 INFO:tasks.workunit.client.1.smithi192.stdout:6/24: stat c4 0 2024-09-21T12:20:15.577 INFO:tasks.workunit.client.1.smithi192.stdout:1/78: unlink d2/l17 0 2024-09-21T12:20:15.579 INFO:tasks.workunit.client.1.smithi192.stdout:1/79: write d2/f14 [478296,117128] 0 2024-09-21T12:20:15.580 INFO:tasks.workunit.client.1.smithi192.stdout:2/52: creat fd x:0 0 0 2024-09-21T12:20:15.580 INFO:tasks.workunit.client.1.smithi192.stdout:2/53: rmdir - no directory 2024-09-21T12:20:15.580 INFO:tasks.workunit.client.1.smithi192.stdout:1/80: chown d2/d12/cd 22487737 1 2024-09-21T12:20:15.581 INFO:tasks.workunit.client.1.smithi192.stdout:8/92: dwrite d14/f16 [0,4194304] 0 2024-09-21T12:20:15.581 INFO:tasks.workunit.client.1.smithi192.stdout:6/25: rename l0 to l7 0 2024-09-21T12:20:15.586 INFO:tasks.workunit.client.1.smithi192.stdout:2/54: creat fe x:0 0 0 2024-09-21T12:20:15.586 INFO:tasks.workunit.client.1.smithi192.stdout:2/55: truncate fd 407186 0 2024-09-21T12:20:15.586 INFO:tasks.workunit.client.1.smithi192.stdout:1/81: creat d2/d12/f1a x:0 0 0 2024-09-21T12:20:15.587 INFO:tasks.workunit.client.1.smithi192.stdout:1/82: chown d2/c5 17151251 1 2024-09-21T12:20:15.589 INFO:tasks.workunit.client.1.smithi192.stdout:8/93: mkdir d14/d1a/d1d/d20 0 2024-09-21T12:20:15.593 INFO:tasks.workunit.client.1.smithi192.stdout:1/83: symlink d2/l1b 0 2024-09-21T12:20:15.594 INFO:tasks.workunit.client.1.smithi192.stdout:8/94: dwrite fc [0,4194304] 0 2024-09-21T12:20:15.627 INFO:tasks.workunit.client.1.smithi192.stdout:1/84: mknod d2/de/c1c 0 2024-09-21T12:20:15.631 INFO:tasks.workunit.client.1.smithi192.stdout:8/95: rename d14/f16 to d14/d18/f21 0 2024-09-21T12:20:15.632 INFO:tasks.workunit.client.1.smithi192.stdout:1/85: mknod d2/c1d 0 2024-09-21T12:20:15.637 INFO:tasks.workunit.client.1.smithi192.stdout:8/96: link fe d14/d18/f22 0 2024-09-21T12:20:15.640 INFO:tasks.workunit.client.1.smithi192.stdout:8/97: creat d14/d1a/f23 x:0 0 0 2024-09-21T12:20:15.642 INFO:tasks.workunit.client.1.smithi192.stdout:8/98: fdatasync d14/d18/f21 0 2024-09-21T12:20:15.648 INFO:tasks.workunit.client.1.smithi192.stdout:1/86: truncate f1 335988 0 2024-09-21T12:20:15.649 INFO:tasks.workunit.client.1.smithi192.stdout:1/87: mkdir d2/d12/d1e 0 2024-09-21T12:20:15.650 INFO:tasks.workunit.client.1.smithi192.stdout:1/88: mkdir d2/da/d1f 0 2024-09-21T12:20:15.651 INFO:tasks.workunit.client.1.smithi192.stdout:1/89: write d2/de/f11 [2345127,30218] 0 2024-09-21T12:20:15.656 INFO:tasks.workunit.client.1.smithi192.stdout:1/90: link d2/de/f19 d2/da/d1f/f20 0 2024-09-21T12:20:15.656 INFO:tasks.workunit.client.1.smithi192.stdout:1/91: dread - d2/d12/f1a zero size 2024-09-21T12:20:15.659 INFO:tasks.workunit.client.1.smithi192.stdout:1/92: mknod d2/d12/c21 0 2024-09-21T12:20:15.659 INFO:tasks.workunit.client.1.smithi192.stdout:1/93: stat d2/c5 0 2024-09-21T12:20:15.659 INFO:tasks.workunit.client.1.smithi192.stdout:1/94: stat d2/c5 0 2024-09-21T12:20:15.674 INFO:tasks.workunit.client.1.smithi192.stdout:1/95: write f1 [304328,60081] 0 2024-09-21T12:20:15.676 INFO:tasks.workunit.client.1.smithi192.stdout:1/96: unlink d2/d12/f7 0 2024-09-21T12:20:15.679 INFO:tasks.workunit.client.1.smithi192.stdout:1/97: link d2/de/f19 d2/da/d1f/f22 0 2024-09-21T12:20:15.679 INFO:tasks.workunit.client.1.smithi192.stdout:1/98: stat d2/de/f11 0 2024-09-21T12:20:15.679 INFO:tasks.workunit.client.1.smithi192.stdout:1/99: read - d2/de/f18 zero size 2024-09-21T12:20:15.688 INFO:tasks.workunit.client.1.smithi192.stdout:1/100: write d2/da/d1f/f22 [266317,58585] 0 2024-09-21T12:20:15.689 INFO:tasks.workunit.client.1.smithi192.stdout:1/101: readlink d2/l1b 0 2024-09-21T12:20:15.691 INFO:tasks.workunit.client.1.smithi192.stdout:1/102: dread d2/d12/f10 [0,4194304] 0 2024-09-21T12:20:15.692 INFO:tasks.workunit.client.1.smithi192.stdout:1/103: readlink d2/de/l15 0 2024-09-21T12:20:15.692 INFO:tasks.workunit.client.1.smithi192.stdout:1/104: truncate d2/d12/f10 1084253 0 2024-09-21T12:20:15.694 INFO:tasks.workunit.client.1.smithi192.stdout:9/25: sync 2024-09-21T12:20:15.694 INFO:tasks.workunit.client.1.smithi192.stdout:0/57: sync 2024-09-21T12:20:15.694 INFO:tasks.workunit.client.1.smithi192.stdout:3/23: sync 2024-09-21T12:20:15.694 INFO:tasks.workunit.client.1.smithi192.stdout:5/204: sync 2024-09-21T12:20:15.694 INFO:tasks.workunit.client.1.smithi192.stdout:4/57: sync 2024-09-21T12:20:15.697 INFO:tasks.workunit.client.1.smithi192.stdout:0/58: creat d3/fa x:0 0 0 2024-09-21T12:20:15.697 INFO:tasks.workunit.client.1.smithi192.stdout:1/105: rmdir d2/d12/d1e 0 2024-09-21T12:20:15.698 INFO:tasks.workunit.client.1.smithi192.stdout:9/26: dread f3 [4194304,4194304] 0 2024-09-21T12:20:15.699 INFO:tasks.workunit.client.1.smithi192.stdout:0/59: write d3/fa [971344,89954] 0 2024-09-21T12:20:15.700 INFO:tasks.workunit.client.1.smithi192.stdout:5/205: read d0/de/f19 [3075231,92703] 0 2024-09-21T12:20:15.703 INFO:tasks.workunit.client.1.smithi192.stdout:1/106: creat d2/da/d1f/f23 x:0 0 0 2024-09-21T12:20:15.704 INFO:tasks.workunit.client.1.smithi192.stdout:3/24: dwrite f8 [4194304,4194304] 0 2024-09-21T12:20:15.708 INFO:tasks.workunit.client.1.smithi192.stdout:3/25: rename l5 to l9 0 2024-09-21T12:20:15.709 INFO:tasks.workunit.client.1.smithi192.stdout:9/27: dwrite f3 [4194304,4194304] 0 2024-09-21T12:20:15.709 INFO:tasks.workunit.client.1.smithi192.stdout:1/107: rmdir d2/d12 39 2024-09-21T12:20:15.713 INFO:tasks.workunit.client.1.smithi192.stdout:4/58: write d2/f6 [1320483,118919] 0 2024-09-21T12:20:15.717 INFO:tasks.workunit.client.1.smithi192.stdout:3/26: mknod ca 0 2024-09-21T12:20:15.717 INFO:tasks.workunit.client.1.smithi192.stdout:3/27: write f8 [1569311,10797] 0 2024-09-21T12:20:15.718 INFO:tasks.workunit.client.1.smithi192.stdout:3/28: stat ca 0 2024-09-21T12:20:15.718 INFO:tasks.workunit.client.1.smithi192.stdout:3/29: write f8 [2756163,736] 0 2024-09-21T12:20:15.720 INFO:tasks.workunit.client.1.smithi192.stdout:1/108: mkdir d2/da/d1f/d24 0 2024-09-21T12:20:15.721 INFO:tasks.workunit.client.1.smithi192.stdout:9/28: creat d5/f7 x:0 0 0 2024-09-21T12:20:15.723 INFO:tasks.workunit.client.1.smithi192.stdout:3/30: mkdir db 0 2024-09-21T12:20:15.724 INFO:tasks.workunit.client.1.smithi192.stdout:9/29: unlink f3 0 2024-09-21T12:20:15.726 INFO:tasks.workunit.client.1.smithi192.stdout:3/31: symlink db/lc 0 2024-09-21T12:20:15.745 INFO:tasks.workunit.client.1.smithi192.stdout:0/60: truncate d3/d5/f9 96653 0 2024-09-21T12:20:15.745 INFO:tasks.workunit.client.1.smithi192.stdout:5/206: write d0/f15 [758555,40063] 0 2024-09-21T12:20:15.747 INFO:tasks.workunit.client.1.smithi192.stdout:0/61: read d3/fa [770810,116150] 0 2024-09-21T12:20:15.748 INFO:tasks.workunit.client.1.smithi192.stdout:9/30: dwrite d5/f7 [0,4194304] 0 2024-09-21T12:20:15.775 INFO:tasks.workunit.client.1.smithi192.stdout:0/62: creat d3/d6/fb x:0 0 0 2024-09-21T12:20:15.775 INFO:tasks.workunit.client.1.smithi192.stdout:5/207: dread d0/dc/f1c [0,4194304] 0 2024-09-21T12:20:15.778 INFO:tasks.workunit.client.1.smithi192.stdout:9/31: mkdir d5/d8 0 2024-09-21T12:20:15.778 INFO:tasks.workunit.client.1.smithi192.stdout:9/32: fdatasync d5/f7 0 2024-09-21T12:20:15.785 INFO:tasks.workunit.client.1.smithi192.stdout:5/208: unlink d0/de/f19 0 2024-09-21T12:20:15.811 INFO:tasks.workunit.client.1.smithi192.stdout:6/26: sync 2024-09-21T12:20:15.811 INFO:tasks.workunit.client.1.smithi192.stdout:7/39: sync 2024-09-21T12:20:15.811 INFO:tasks.workunit.client.1.smithi192.stdout:9/33: read f2 [3962090,64179] 0 2024-09-21T12:20:15.812 INFO:tasks.workunit.client.1.smithi192.stdout:5/209: truncate d0/f3b 488256 0 2024-09-21T12:20:15.812 INFO:tasks.workunit.client.1.smithi192.stdout:6/27: chown l1 6 1 2024-09-21T12:20:15.813 INFO:tasks.workunit.client.1.smithi192.stdout:7/40: chown c4 3525250 1 2024-09-21T12:20:15.813 INFO:tasks.workunit.client.1.smithi192.stdout:6/28: read f2 [54999,88863] 0 2024-09-21T12:20:15.817 INFO:tasks.workunit.client.1.smithi192.stdout:9/34: symlink d5/l9 0 2024-09-21T12:20:15.817 INFO:tasks.workunit.client.1.smithi192.stdout:9/35: stat d5 0 2024-09-21T12:20:15.817 INFO:tasks.workunit.client.1.smithi192.stdout:9/36: chown l1 8939 1 2024-09-21T12:20:15.820 INFO:tasks.workunit.client.1.smithi192.stdout:7/41: creat d6/f10 x:0 0 0 2024-09-21T12:20:15.821 INFO:tasks.workunit.client.1.smithi192.stdout:7/42: readlink d6/le 0 2024-09-21T12:20:15.823 INFO:tasks.workunit.client.1.smithi192.stdout:6/29: creat f8 x:0 0 0 2024-09-21T12:20:15.827 INFO:tasks.workunit.client.1.smithi192.stdout:7/43: creat d6/d9/f11 x:0 0 0 2024-09-21T12:20:15.828 INFO:tasks.workunit.client.1.smithi192.stdout:6/30: symlink l9 0 2024-09-21T12:20:15.830 INFO:tasks.workunit.client.1.smithi192.stdout:9/37: getdents d5/d8 0 2024-09-21T12:20:15.832 INFO:tasks.workunit.client.1.smithi192.stdout:9/38: fdatasync f2 0 2024-09-21T12:20:15.834 INFO:tasks.workunit.client.1.smithi192.stdout:7/44: dwrite d6/fb [0,4194304] 0 2024-09-21T12:20:15.835 INFO:tasks.workunit.client.1.smithi192.stdout:7/45: chown d6/ff 65979806 1 2024-09-21T12:20:15.837 INFO:tasks.workunit.client.1.smithi192.stdout:7/46: mknod d6/d9/c12 0 2024-09-21T12:20:15.843 INFO:tasks.workunit.client.1.smithi192.stdout:9/39: link f0 d5/fa 0 2024-09-21T12:20:15.843 INFO:tasks.workunit.client.1.smithi192.stdout:7/47: dwrite d6/fb [0,4194304] 0 2024-09-21T12:20:15.844 INFO:tasks.workunit.client.1.smithi192.stdout:7/48: stat d6/d9/c12 0 2024-09-21T12:20:15.847 INFO:tasks.workunit.client.1.smithi192.stdout:7/49: unlink d6/d9/ca 0 2024-09-21T12:20:15.849 INFO:tasks.workunit.client.1.smithi192.stdout:9/40: dwrite d5/f7 [0,4194304] 0 2024-09-21T12:20:15.853 INFO:tasks.workunit.client.1.smithi192.stdout:7/50: creat d6/d9/f13 x:0 0 0 2024-09-21T12:20:15.858 INFO:tasks.workunit.client.1.smithi192.stdout:7/51: unlink d6/cd 0 2024-09-21T12:20:15.859 INFO:tasks.workunit.client.1.smithi192.stdout:9/41: getdents d5/d8 0 2024-09-21T12:20:15.859 INFO:tasks.workunit.client.1.smithi192.stdout:9/42: readlink l1 0 2024-09-21T12:20:15.862 INFO:tasks.workunit.client.1.smithi192.stdout:7/52: rename d6/fb to d6/d9/f14 0 2024-09-21T12:20:15.864 INFO:tasks.workunit.client.1.smithi192.stdout:9/43: creat d5/fb x:0 0 0 2024-09-21T12:20:15.867 INFO:tasks.workunit.client.1.smithi192.stdout:9/44: dread d5/f7 [0,4194304] 0 2024-09-21T12:20:15.882 INFO:tasks.workunit.client.1.smithi192.stdout:5/210: rename d0/d2/d21 to d0/de/d45 0 2024-09-21T12:20:15.886 INFO:tasks.workunit.client.1.smithi192.stdout:5/211: creat d0/d1a/d36/f46 x:0 0 0 2024-09-21T12:20:15.887 INFO:tasks.workunit.client.1.smithi192.stdout:6/31: dwrite f2 [0,4194304] 0 2024-09-21T12:20:15.888 INFO:tasks.workunit.client.1.smithi192.stdout:6/32: write f6 [813620,125837] 0 2024-09-21T12:20:15.889 INFO:tasks.workunit.client.1.smithi192.stdout:8/99: sync 2024-09-21T12:20:15.889 INFO:tasks.workunit.client.1.smithi192.stdout:2/56: sync 2024-09-21T12:20:15.890 INFO:tasks.workunit.client.1.smithi192.stdout:2/57: dread - fe zero size 2024-09-21T12:20:15.891 INFO:tasks.workunit.client.1.smithi192.stdout:6/33: chown l7 212737 1 2024-09-21T12:20:15.892 INFO:tasks.workunit.client.1.smithi192.stdout:6/34: chown l7 141 1 2024-09-21T12:20:15.893 INFO:tasks.workunit.client.1.smithi192.stdout:5/212: fsync d0/d1a/f29 0 2024-09-21T12:20:15.897 INFO:tasks.workunit.client.1.smithi192.stdout:2/58: dread f2 [0,4194304] 0 2024-09-21T12:20:15.899 INFO:tasks.workunit.client.1.smithi192.stdout:6/35: mkdir da 0 2024-09-21T12:20:15.904 INFO:tasks.workunit.client.1.smithi192.stdout:8/100: getdents d14/d1a/d1d/d20 0 2024-09-21T12:20:15.906 INFO:tasks.workunit.client.1.smithi192.stdout:2/59: creat ff x:0 0 0 2024-09-21T12:20:15.909 INFO:tasks.workunit.client.1.smithi192.stdout:5/213: symlink d0/dc/d13/d37/d38/l47 0 2024-09-21T12:20:15.910 INFO:tasks.workunit.client.1.smithi192.stdout:0/63: write d3/d5/f9 [1097079,80840] 0 2024-09-21T12:20:15.911 INFO:tasks.workunit.client.1.smithi192.stdout:6/36: mknod da/cb 0 2024-09-21T12:20:15.913 INFO:tasks.workunit.client.1.smithi192.stdout:5/214: creat d0/d2/f48 x:0 0 0 2024-09-21T12:20:15.914 INFO:tasks.workunit.client.1.smithi192.stdout:6/37: dread f6 [0,4194304] 0 2024-09-21T12:20:15.917 INFO:tasks.workunit.client.1.smithi192.stdout:7/53: dwrite f0 [0,4194304] 0 2024-09-21T12:20:15.919 INFO:tasks.workunit.client.1.smithi192.stdout:7/54: dread - d6/d9/fc zero size 2024-09-21T12:20:15.922 INFO:tasks.workunit.client.1.smithi192.stdout:7/55: readlink d6/le 0 2024-09-21T12:20:15.925 INFO:tasks.workunit.client.1.smithi192.stdout:9/45: dwrite f0 [0,4194304] 0 2024-09-21T12:20:15.928 INFO:tasks.workunit.client.1.smithi192.stdout:7/56: dread f3 [0,4194304] 0 2024-09-21T12:20:15.930 INFO:tasks.workunit.client.1.smithi192.stdout:7/57: write d6/d9/f13 [966675,127575] 0 2024-09-21T12:20:15.935 INFO:tasks.workunit.client.1.smithi192.stdout:9/46: unlink f0 0 2024-09-21T12:20:15.939 INFO:tasks.workunit.client.1.smithi192.stdout:2/60: getdents . 0 2024-09-21T12:20:15.941 INFO:tasks.workunit.client.1.smithi192.stdout:7/58: rename d6/d9/fc to d6/f15 0 2024-09-21T12:20:15.944 INFO:tasks.workunit.client.1.smithi192.stdout:9/47: mkdir d5/dc 0 2024-09-21T12:20:15.945 INFO:tasks.workunit.client.1.smithi192.stdout:6/38: getdents da 0 2024-09-21T12:20:15.945 INFO:tasks.workunit.client.1.smithi192.stdout:6/39: chown c4 54287 1 2024-09-21T12:20:15.947 INFO:tasks.workunit.client.1.smithi192.stdout:0/64: write d3/fa [146447,105561] 0 2024-09-21T12:20:15.952 INFO:tasks.workunit.client.1.smithi192.stdout:7/59: dread f3 [0,4194304] 0 2024-09-21T12:20:15.952 INFO:tasks.workunit.client.1.smithi192.stdout:0/65: mknod d3/cc 0 2024-09-21T12:20:15.953 INFO:tasks.workunit.client.1.smithi192.stdout:6/40: truncate f6 127352 0 2024-09-21T12:20:15.954 INFO:tasks.workunit.client.1.smithi192.stdout:2/61: link c8 c10 0 2024-09-21T12:20:15.954 INFO:tasks.workunit.client.1.smithi192.stdout:7/60: write f0 [129153,19041] 0 2024-09-21T12:20:15.955 INFO:tasks.workunit.client.1.smithi192.stdout:5/215: dwrite d0/dc/f1c [0,4194304] 0 2024-09-21T12:20:15.956 INFO:tasks.workunit.client.1.smithi192.stdout:7/61: truncate d6/ff 393976 0 2024-09-21T12:20:15.956 INFO:tasks.workunit.client.1.smithi192.stdout:2/62: dread fd [0,4194304] 0 2024-09-21T12:20:15.957 INFO:tasks.workunit.client.1.smithi192.stdout:0/66: creat d3/d6/fd x:0 0 0 2024-09-21T12:20:15.959 INFO:tasks.workunit.client.1.smithi192.stdout:0/67: truncate d3/d6/fd 476871 0 2024-09-21T12:20:15.961 INFO:tasks.workunit.client.1.smithi192.stdout:6/41: rename f5 to da/fc 0 2024-09-21T12:20:15.962 INFO:tasks.workunit.client.1.smithi192.stdout:6/42: dread - f8 zero size 2024-09-21T12:20:15.966 INFO:tasks.workunit.client.1.smithi192.stdout:0/68: dwrite d3/d6/fb [0,4194304] 0 2024-09-21T12:20:15.966 INFO:tasks.workunit.client.1.smithi192.stdout:7/62: symlink d6/l16 0 2024-09-21T12:20:15.968 INFO:tasks.workunit.client.1.smithi192.stdout:2/63: rename c4 to c11 0 2024-09-21T12:20:15.974 INFO:tasks.workunit.client.1.smithi192.stdout:6/43: symlink da/ld 0 2024-09-21T12:20:15.978 INFO:tasks.workunit.client.1.smithi192.stdout:5/216: truncate d0/de/d45/f2c 1097420 0 2024-09-21T12:20:15.980 INFO:tasks.workunit.client.1.smithi192.stdout:0/69: mkdir d3/de 0 2024-09-21T12:20:15.983 INFO:tasks.workunit.client.1.smithi192.stdout:2/64: creat f12 x:0 0 0 2024-09-21T12:20:15.983 INFO:tasks.workunit.client.1.smithi192.stdout:0/70: dread d3/d6/fb [0,4194304] 0 2024-09-21T12:20:15.986 INFO:tasks.workunit.client.1.smithi192.stdout:5/217: creat d0/de/d45/f49 x:0 0 0 2024-09-21T12:20:15.987 INFO:tasks.workunit.client.1.smithi192.stdout:5/218: dread d0/dc/f22 [0,4194304] 0 2024-09-21T12:20:15.989 INFO:tasks.workunit.client.1.smithi192.stdout:7/63: link f0 d6/d9/f17 0 2024-09-21T12:20:15.990 INFO:tasks.workunit.client.1.smithi192.stdout:2/65: symlink l13 0 2024-09-21T12:20:15.993 INFO:tasks.workunit.client.1.smithi192.stdout:0/71: mknod d3/cf 0 2024-09-21T12:20:15.993 INFO:tasks.workunit.client.1.smithi192.stdout:5/219: dwrite d0/de/d45/f49 [0,4194304] 0 2024-09-21T12:20:15.995 INFO:tasks.workunit.client.1.smithi192.stdout:7/64: rmdir d6 39 2024-09-21T12:20:15.998 INFO:tasks.workunit.client.1.smithi192.stdout:6/44: truncate da/fc 494599 0 2024-09-21T12:20:16.001 INFO:tasks.workunit.client.1.smithi192.stdout:1/109: sync 2024-09-21T12:20:16.001 INFO:tasks.workunit.client.1.smithi192.stdout:2/66: truncate f2 2823248 0 2024-09-21T12:20:16.001 INFO:tasks.workunit.client.1.smithi192.stdout:4/59: sync 2024-09-21T12:20:16.001 INFO:tasks.workunit.client.1.smithi192.stdout:3/32: sync 2024-09-21T12:20:16.001 INFO:tasks.workunit.client.1.smithi192.stdout:2/67: dread - ff zero size 2024-09-21T12:20:16.002 INFO:tasks.workunit.client.1.smithi192.stdout:3/33: chown f8 99892 1 2024-09-21T12:20:16.002 INFO:tasks.workunit.client.1.smithi192.stdout:1/110: chown d2/c3 1779 1 2024-09-21T12:20:16.003 INFO:tasks.workunit.client.1.smithi192.stdout:1/111: write d2/de/f18 [793847,18805] 0 2024-09-21T12:20:16.003 INFO:tasks.workunit.client.1.smithi192.stdout:0/72: symlink d3/l10 0 2024-09-21T12:20:16.005 INFO:tasks.workunit.client.1.smithi192.stdout:1/112: write d2/de/f19 [572974,73637] 0 2024-09-21T12:20:16.008 INFO:tasks.workunit.client.1.smithi192.stdout:3/34: dwrite f8 [0,4194304] 0 2024-09-21T12:20:16.014 INFO:tasks.workunit.client.1.smithi192.stdout:4/60: unlink d2/db/ce 0 2024-09-21T12:20:16.018 INFO:tasks.workunit.client.1.smithi192.stdout:7/65: symlink d6/d9/l18 0 2024-09-21T12:20:16.021 INFO:tasks.workunit.client.1.smithi192.stdout:3/35: symlink db/ld 0 2024-09-21T12:20:16.025 INFO:tasks.workunit.client.1.smithi192.stdout:4/61: creat d2/db/f10 x:0 0 0 2024-09-21T12:20:16.033 INFO:tasks.workunit.client.1.smithi192.stdout:0/73: creat d3/de/f11 x:0 0 0 2024-09-21T12:20:16.033 INFO:tasks.workunit.client.1.smithi192.stdout:7/66: symlink d6/d9/l19 0 2024-09-21T12:20:16.034 INFO:tasks.workunit.client.1.smithi192.stdout:3/36: stat c6 0 2024-09-21T12:20:16.034 INFO:tasks.workunit.client.1.smithi192.stdout:2/68: read f2 [2630679,40722] 0 2024-09-21T12:20:16.034 INFO:tasks.workunit.client.1.smithi192.stdout:4/62: read d2/fa [463269,25373] 0 2024-09-21T12:20:16.034 INFO:tasks.workunit.client.1.smithi192.stdout:6/45: link c4 da/ce 0 2024-09-21T12:20:16.035 INFO:tasks.workunit.client.1.smithi192.stdout:0/74: rmdir d3 39 2024-09-21T12:20:16.037 INFO:tasks.workunit.client.1.smithi192.stdout:5/220: link d0/de/d35/c39 d0/dc/d13/d37/d38/c4a 0 2024-09-21T12:20:16.038 INFO:tasks.workunit.client.1.smithi192.stdout:7/67: fsync d6/f15 0 2024-09-21T12:20:16.041 INFO:tasks.workunit.client.1.smithi192.stdout:2/69: creat f14 x:0 0 0 2024-09-21T12:20:16.044 INFO:tasks.workunit.client.1.smithi192.stdout:3/37: creat db/fe x:0 0 0 2024-09-21T12:20:16.045 INFO:tasks.workunit.client.1.smithi192.stdout:0/75: chown d3/fa 0 1 2024-09-21T12:20:16.047 INFO:tasks.workunit.client.1.smithi192.stdout:4/63: rename d2/lc to d2/df/l11 0 2024-09-21T12:20:16.047 INFO:tasks.workunit.client.1.smithi192.stdout:4/64: fsync d2/f5 0 2024-09-21T12:20:16.050 INFO:tasks.workunit.client.1.smithi192.stdout:5/221: unlink d0/dc/c41 0 2024-09-21T12:20:16.052 INFO:tasks.workunit.client.1.smithi192.stdout:7/68: mknod d6/c1a 0 2024-09-21T12:20:16.053 INFO:tasks.workunit.client.1.smithi192.stdout:4/65: dwrite d2/f6 [0,4194304] 0 2024-09-21T12:20:16.053 INFO:tasks.workunit.client.1.smithi192.stdout:2/70: creat f15 x:0 0 0 2024-09-21T12:20:16.056 INFO:tasks.workunit.client.1.smithi192.stdout:3/38: symlink db/lf 0 2024-09-21T12:20:16.058 INFO:tasks.workunit.client.1.smithi192.stdout:4/66: dread d2/f6 [0,4194304] 0 2024-09-21T12:20:16.063 INFO:tasks.workunit.client.1.smithi192.stdout:5/222: creat d0/d1a/f4b x:0 0 0 2024-09-21T12:20:16.064 INFO:tasks.workunit.client.1.smithi192.stdout:7/69: mknod d6/d9/c1b 0 2024-09-21T12:20:16.066 INFO:tasks.workunit.client.1.smithi192.stdout:2/71: symlink l16 0 2024-09-21T12:20:16.075 INFO:tasks.workunit.client.1.smithi192.stdout:4/67: rmdir d2/db 39 2024-09-21T12:20:16.077 INFO:tasks.workunit.client.1.smithi192.stdout:5/223: dread - d0/d1a/f32 zero size 2024-09-21T12:20:16.077 INFO:tasks.workunit.client.1.smithi192.stdout:5/224: dread - d0/d1a/f4b zero size 2024-09-21T12:20:16.079 INFO:tasks.workunit.client.1.smithi192.stdout:7/70: write d6/d9/f14 [4334752,52211] 0 2024-09-21T12:20:16.079 INFO:tasks.workunit.client.1.smithi192.stdout:7/71: fsync f5 0 2024-09-21T12:20:16.081 INFO:tasks.workunit.client.1.smithi192.stdout:2/72: symlink l17 0 2024-09-21T12:20:16.087 INFO:tasks.workunit.client.1.smithi192.stdout:2/73: dwrite ff [0,4194304] 0 2024-09-21T12:20:16.087 INFO:tasks.workunit.client.1.smithi192.stdout:4/68: truncate d2/db/f10 247720 0 2024-09-21T12:20:16.088 INFO:tasks.workunit.client.1.smithi192.stdout:2/74: chown la 3643197 1 2024-09-21T12:20:16.089 INFO:tasks.workunit.client.1.smithi192.stdout:5/225: rename d0/d1a/f4b to d0/dc/d13/d37/d38/f4c 0 2024-09-21T12:20:16.096 INFO:tasks.workunit.client.1.smithi192.stdout:2/75: symlink l18 0 2024-09-21T12:20:16.098 INFO:tasks.workunit.client.1.smithi192.stdout:0/76: truncate d3/fa 712550 0 2024-09-21T12:20:16.100 INFO:tasks.workunit.client.1.smithi192.stdout:5/226: truncate d0/f26 3195747 0 2024-09-21T12:20:16.102 INFO:tasks.workunit.client.1.smithi192.stdout:7/72: link d6/d9/f14 d6/d9/f1c 0 2024-09-21T12:20:16.104 INFO:tasks.workunit.client.1.smithi192.stdout:3/39: link l9 db/l10 0 2024-09-21T12:20:16.107 INFO:tasks.workunit.client.1.smithi192.stdout:2/76: creat f19 x:0 0 0 2024-09-21T12:20:16.107 INFO:tasks.workunit.client.1.smithi192.stdout:9/48: sync 2024-09-21T12:20:16.107 INFO:tasks.workunit.client.1.smithi192.stdout:8/101: sync 2024-09-21T12:20:16.107 INFO:tasks.workunit.client.1.smithi192.stdout:2/77: chown f12 1170 1 2024-09-21T12:20:16.112 INFO:tasks.workunit.client.1.smithi192.stdout:5/227: readlink d0/de/l30 0 2024-09-21T12:20:16.112 INFO:tasks.workunit.client.1.smithi192.stdout:8/102: dwrite fd [0,4194304] 0 2024-09-21T12:20:16.112 INFO:tasks.workunit.client.1.smithi192.stdout:5/228: chown d0/d1a/f32 3235 1 2024-09-21T12:20:16.113 INFO:tasks.workunit.client.1.smithi192.stdout:7/73: rmdir d6/d9 39 2024-09-21T12:20:16.116 INFO:tasks.workunit.client.1.smithi192.stdout:3/40: mknod db/c11 0 2024-09-21T12:20:16.119 INFO:tasks.workunit.client.1.smithi192.stdout:7/74: dwrite d6/f15 [0,4194304] 0 2024-09-21T12:20:16.122 INFO:tasks.workunit.client.1.smithi192.stdout:2/78: dread fd [0,4194304] 0 2024-09-21T12:20:16.123 INFO:tasks.workunit.client.1.smithi192.stdout:2/79: dread - f19 zero size 2024-09-21T12:20:16.131 INFO:tasks.workunit.client.1.smithi192.stdout:6/46: dwrite da/fc [0,4194304] 0 2024-09-21T12:20:16.131 INFO:tasks.workunit.client.1.smithi192.stdout:5/229: mknod d0/de/d35/c4d 0 2024-09-21T12:20:16.132 INFO:tasks.workunit.client.1.smithi192.stdout:2/80: dwrite f7 [0,4194304] 0 2024-09-21T12:20:16.134 INFO:tasks.workunit.client.1.smithi192.stdout:3/41: symlink db/l12 0 2024-09-21T12:20:16.138 INFO:tasks.workunit.client.1.smithi192.stdout:4/69: getdents d2/db 0 2024-09-21T12:20:16.143 INFO:tasks.workunit.client.1.smithi192.stdout:6/47: dread f6 [0,4194304] 0 2024-09-21T12:20:16.146 INFO:tasks.workunit.client.1.smithi192.stdout:2/81: mknod c1a 0 2024-09-21T12:20:16.149 INFO:tasks.workunit.client.1.smithi192.stdout:2/82: dread f7 [0,4194304] 0 2024-09-21T12:20:16.152 INFO:tasks.workunit.client.1.smithi192.stdout:3/42: creat db/f13 x:0 0 0 2024-09-21T12:20:16.153 INFO:tasks.workunit.client.1.smithi192.stdout:7/75: mknod d6/d9/c1d 0 2024-09-21T12:20:16.156 INFO:tasks.workunit.client.1.smithi192.stdout:2/83: dwrite f14 [0,4194304] 0 2024-09-21T12:20:16.158 INFO:tasks.workunit.client.1.smithi192.stdout:3/43: dread f8 [4194304,4194304] 0 2024-09-21T12:20:16.160 INFO:tasks.workunit.client.1.smithi192.stdout:6/48: unlink f6 0 2024-09-21T12:20:16.161 INFO:tasks.workunit.client.1.smithi192.stdout:0/77: truncate d3/d5/f9 828856 0 2024-09-21T12:20:16.164 INFO:tasks.workunit.client.1.smithi192.stdout:1/113: sync 2024-09-21T12:20:16.169 INFO:tasks.workunit.client.1.smithi192.stdout:7/76: mkdir d6/d9/d1e 0 2024-09-21T12:20:16.171 INFO:tasks.workunit.client.1.smithi192.stdout:4/70: symlink d2/l12 0 2024-09-21T12:20:16.172 INFO:tasks.workunit.client.1.smithi192.stdout:2/84: mkdir d1b 0 2024-09-21T12:20:16.173 INFO:tasks.workunit.client.1.smithi192.stdout:3/44: creat db/f14 x:0 0 0 2024-09-21T12:20:16.174 INFO:tasks.workunit.client.1.smithi192.stdout:6/49: symlink da/lf 0 2024-09-21T12:20:16.176 INFO:tasks.workunit.client.1.smithi192.stdout:0/78: creat d3/f12 x:0 0 0 2024-09-21T12:20:16.177 INFO:tasks.workunit.client.1.smithi192.stdout:8/103: write ff [737081,48565] 0 2024-09-21T12:20:16.180 INFO:tasks.workunit.client.1.smithi192.stdout:8/104: fsync ff 0 2024-09-21T12:20:16.180 INFO:tasks.workunit.client.1.smithi192.stdout:9/49: link d5/fb d5/fd 0 2024-09-21T12:20:16.181 INFO:tasks.workunit.client.1.smithi192.stdout:7/77: mkdir d6/d9/d1f 0 2024-09-21T12:20:16.181 INFO:tasks.workunit.client.1.smithi192.stdout:4/71: dwrite d2/db/f10 [0,4194304] 0 2024-09-21T12:20:16.182 INFO:tasks.workunit.client.1.smithi192.stdout:7/78: chown d6/ff 54 1 2024-09-21T12:20:16.184 INFO:tasks.workunit.client.1.smithi192.stdout:2/85: rename l13 to d1b/l1c 0 2024-09-21T12:20:16.185 INFO:tasks.workunit.client.1.smithi192.stdout:6/50: dwrite f8 [0,4194304] 0 2024-09-21T12:20:16.186 INFO:tasks.workunit.client.1.smithi192.stdout:2/86: chown f14 50 1 2024-09-21T12:20:16.190 INFO:tasks.workunit.client.1.smithi192.stdout:0/79: rmdir d3 39 2024-09-21T12:20:16.191 INFO:tasks.workunit.client.1.smithi192.stdout:5/230: dwrite d0/d2/f14 [0,4194304] 0 2024-09-21T12:20:16.192 INFO:tasks.workunit.client.1.smithi192.stdout:1/114: mknod d2/da/d1f/d24/c25 0 2024-09-21T12:20:16.196 INFO:tasks.workunit.client.1.smithi192.stdout:8/105: unlink fb 0 2024-09-21T12:20:16.202 INFO:tasks.workunit.client.1.smithi192.stdout:3/45: unlink db/l10 0 2024-09-21T12:20:16.204 INFO:tasks.workunit.client.1.smithi192.stdout:5/231: dwrite d0/f8 [0,4194304] 0 2024-09-21T12:20:16.204 INFO:tasks.workunit.client.1.smithi192.stdout:6/51: chown da/ce 11533 1 2024-09-21T12:20:16.205 INFO:tasks.workunit.client.1.smithi192.stdout:1/115: dwrite d2/da/d1f/f23 [0,4194304] 0 2024-09-21T12:20:16.210 INFO:tasks.workunit.client.1.smithi192.stdout:8/106: readlink d14/l17 0 2024-09-21T12:20:16.211 INFO:tasks.workunit.client.1.smithi192.stdout:7/79: mkdir d6/d20 0 2024-09-21T12:20:16.212 INFO:tasks.workunit.client.1.smithi192.stdout:3/46: rmdir db 39 2024-09-21T12:20:16.213 INFO:tasks.workunit.client.1.smithi192.stdout:2/87: link f19 d1b/f1d 0 2024-09-21T12:20:16.214 INFO:tasks.workunit.client.1.smithi192.stdout:4/72: dread d2/f6 [0,4194304] 0 2024-09-21T12:20:16.215 INFO:tasks.workunit.client.1.smithi192.stdout:6/52: rename f2 to da/f10 0 2024-09-21T12:20:16.216 INFO:tasks.workunit.client.1.smithi192.stdout:7/80: write d6/f15 [841405,119091] 0 2024-09-21T12:20:16.218 INFO:tasks.workunit.client.1.smithi192.stdout:6/53: chown l7 33211397 1 2024-09-21T12:20:16.218 INFO:tasks.workunit.client.1.smithi192.stdout:7/81: dread - d6/f10 zero size 2024-09-21T12:20:16.223 INFO:tasks.workunit.client.1.smithi192.stdout:0/80: dwrite d3/f12 [0,4194304] 0 2024-09-21T12:20:16.223 INFO:tasks.workunit.client.1.smithi192.stdout:5/232: dread d0/d1a/f29 [0,4194304] 0 2024-09-21T12:20:16.224 INFO:tasks.workunit.client.1.smithi192.stdout:1/116: write d2/d12/f9 [3707139,33197] 0 2024-09-21T12:20:16.227 INFO:tasks.workunit.client.1.smithi192.stdout:4/73: unlink d2/ld 0 2024-09-21T12:20:16.231 INFO:tasks.workunit.client.1.smithi192.stdout:6/54: symlink da/l11 0 2024-09-21T12:20:16.235 INFO:tasks.workunit.client.1.smithi192.stdout:3/47: dwrite db/f14 [0,4194304] 0 2024-09-21T12:20:16.238 INFO:tasks.workunit.client.1.smithi192.stdout:1/117: rmdir d2/d12 39 2024-09-21T12:20:16.241 INFO:tasks.workunit.client.1.smithi192.stdout:4/74: dread d2/db/f10 [0,4194304] 0 2024-09-21T12:20:16.242 INFO:tasks.workunit.client.1.smithi192.stdout:2/88: dwrite d1b/f1d [0,4194304] 0 2024-09-21T12:20:16.242 INFO:tasks.workunit.client.1.smithi192.stdout:7/82: creat d6/d9/d1f/f21 x:0 0 0 2024-09-21T12:20:16.243 INFO:tasks.workunit.client.1.smithi192.stdout:6/55: creat da/f12 x:0 0 0 2024-09-21T12:20:16.244 INFO:tasks.workunit.client.1.smithi192.stdout:7/83: stat d6/d9/d1e 0 2024-09-21T12:20:16.245 INFO:tasks.workunit.client.1.smithi192.stdout:2/89: write f14 [4761293,3117] 0 2024-09-21T12:20:16.246 INFO:tasks.workunit.client.1.smithi192.stdout:6/56: dread - da/f12 zero size 2024-09-21T12:20:16.246 INFO:tasks.workunit.client.1.smithi192.stdout:2/90: chown ff 756422244 1 2024-09-21T12:20:16.247 INFO:tasks.workunit.client.1.smithi192.stdout:7/84: dread d6/ff [0,4194304] 0 2024-09-21T12:20:16.247 INFO:tasks.workunit.client.1.smithi192.stdout:6/57: write f8 [2408936,17766] 0 2024-09-21T12:20:16.248 INFO:tasks.workunit.client.1.smithi192.stdout:3/48: fdatasync f8 0 2024-09-21T12:20:16.248 INFO:tasks.workunit.client.1.smithi192.stdout:3/49: stat c6 0 2024-09-21T12:20:16.249 INFO:tasks.workunit.client.1.smithi192.stdout:7/85: write f5 [2404072,53117] 0 2024-09-21T12:20:16.250 INFO:tasks.workunit.client.1.smithi192.stdout:3/50: dread - db/fe zero size 2024-09-21T12:20:16.250 INFO:tasks.workunit.client.1.smithi192.stdout:1/118: chown d2/d12 20 1 2024-09-21T12:20:16.255 INFO:tasks.workunit.client.1.smithi192.stdout:4/75: write d2/db/f10 [4377462,116406] 0 2024-09-21T12:20:16.258 INFO:tasks.workunit.client.1.smithi192.stdout:4/76: chown l1 903730 1 2024-09-21T12:20:16.259 INFO:tasks.workunit.client.1.smithi192.stdout:7/86: dwrite d6/f10 [0,4194304] 0 2024-09-21T12:20:16.262 INFO:tasks.workunit.client.1.smithi192.stdout:2/91: mkdir d1b/d1e 0 2024-09-21T12:20:16.265 INFO:tasks.workunit.client.1.smithi192.stdout:3/51: mknod db/c15 0 2024-09-21T12:20:16.265 INFO:tasks.workunit.client.1.smithi192.stdout:1/119: creat d2/da/d1f/d24/f26 x:0 0 0 2024-09-21T12:20:16.265 INFO:tasks.workunit.client.1.smithi192.stdout:2/92: chown c1 0 1 2024-09-21T12:20:16.266 INFO:tasks.workunit.client.1.smithi192.stdout:6/58: write da/f10 [483481,38981] 0 2024-09-21T12:20:16.267 INFO:tasks.workunit.client.1.smithi192.stdout:2/93: dread - f12 zero size 2024-09-21T12:20:16.269 INFO:tasks.workunit.client.1.smithi192.stdout:1/120: chown d2/da/d1f/f20 554 1 2024-09-21T12:20:16.270 INFO:tasks.workunit.client.1.smithi192.stdout:8/107: truncate d14/d1a/d1d/f1e 2419443 0 2024-09-21T12:20:16.272 INFO:tasks.workunit.client.1.smithi192.stdout:4/77: dwrite d2/db/f10 [0,4194304] 0 2024-09-21T12:20:16.272 INFO:tasks.workunit.client.1.smithi192.stdout:3/52: mkdir db/d16 0 2024-09-21T12:20:16.274 INFO:tasks.workunit.client.1.smithi192.stdout:8/108: truncate f12 487363 0 2024-09-21T12:20:16.276 INFO:tasks.workunit.client.1.smithi192.stdout:1/121: creat d2/da/f27 x:0 0 0 2024-09-21T12:20:16.277 INFO:tasks.workunit.client.1.smithi192.stdout:5/233: dwrite d0/dc/f22 [0,4194304] 0 2024-09-21T12:20:16.279 INFO:tasks.workunit.client.1.smithi192.stdout:1/122: write d2/da/d1f/f23 [485021,98240] 0 2024-09-21T12:20:16.280 INFO:tasks.workunit.client.1.smithi192.stdout:2/94: symlink d1b/d1e/l1f 0 2024-09-21T12:20:16.282 INFO:tasks.workunit.client.1.smithi192.stdout:3/53: dread db/f14 [0,4194304] 0 2024-09-21T12:20:16.282 INFO:tasks.workunit.client.1.smithi192.stdout:4/78: dread d2/f6 [0,4194304] 0 2024-09-21T12:20:16.285 INFO:tasks.workunit.client.1.smithi192.stdout:8/109: unlink d14/l1f 0 2024-09-21T12:20:16.291 INFO:tasks.workunit.client.1.smithi192.stdout:2/95: creat d1b/d1e/f20 x:0 0 0 2024-09-21T12:20:16.294 INFO:tasks.workunit.client.1.smithi192.stdout:0/81: truncate d3/d5/f9 1747396 0 2024-09-21T12:20:16.298 INFO:tasks.workunit.client.1.smithi192.stdout:3/54: mknod db/c17 0 2024-09-21T12:20:16.301 INFO:tasks.workunit.client.1.smithi192.stdout:3/55: write db/f13 [344512,66760] 0 2024-09-21T12:20:16.306 INFO:tasks.workunit.client.1.smithi192.stdout:7/87: dwrite d6/d9/f14 [0,4194304] 0 2024-09-21T12:20:16.306 INFO:tasks.workunit.client.1.smithi192.stdout:4/79: dread d2/fa [0,4194304] 0 2024-09-21T12:20:16.307 INFO:tasks.workunit.client.1.smithi192.stdout:3/56: dread db/f13 [0,4194304] 0 2024-09-21T12:20:16.308 INFO:tasks.workunit.client.1.smithi192.stdout:3/57: chown f8 90732223 1 2024-09-21T12:20:16.309 INFO:tasks.workunit.client.1.smithi192.stdout:5/234: getdents d0/dc/d13/d37/d38 0 2024-09-21T12:20:16.310 INFO:tasks.workunit.client.1.smithi192.stdout:1/123: getdents d2/de 0 2024-09-21T12:20:16.310 INFO:tasks.workunit.client.1.smithi192.stdout:2/96: write f2 [1765717,88908] 0 2024-09-21T12:20:16.312 INFO:tasks.workunit.client.1.smithi192.stdout:0/82: truncate d3/d6/fb 2460873 0 2024-09-21T12:20:16.317 INFO:tasks.workunit.client.1.smithi192.stdout:2/97: dwrite d1b/d1e/f20 [0,4194304] 0 2024-09-21T12:20:16.322 INFO:tasks.workunit.client.1.smithi192.stdout:2/98: dread ff [0,4194304] 0 2024-09-21T12:20:16.325 INFO:tasks.workunit.client.1.smithi192.stdout:2/99: dread d1b/f1d [0,4194304] 0 2024-09-21T12:20:16.332 INFO:tasks.workunit.client.1.smithi192.stdout:2/100: dwrite f2 [0,4194304] 0 2024-09-21T12:20:16.357 INFO:tasks.workunit.client.1.smithi192.stdout:9/50: sync 2024-09-21T12:20:16.383 INFO:tasks.workunit.client.1.smithi192.stdout:7/88: mknod d6/d9/c22 0 2024-09-21T12:20:16.383 INFO:tasks.workunit.client.1.smithi192.stdout:8/110: getdents d14/d1a 0 2024-09-21T12:20:16.384 INFO:tasks.workunit.client.1.smithi192.stdout:5/235: chown d0/de/d45/f2c 31861 1 2024-09-21T12:20:16.385 INFO:tasks.workunit.client.1.smithi192.stdout:1/124: creat d2/da/d1f/d24/f28 x:0 0 0 2024-09-21T12:20:16.386 INFO:tasks.workunit.client.1.smithi192.stdout:0/83: mknod d3/d6/c13 0 2024-09-21T12:20:16.389 INFO:tasks.workunit.client.1.smithi192.stdout:2/101: truncate f7 3888443 0 2024-09-21T12:20:16.391 INFO:tasks.workunit.client.1.smithi192.stdout:7/89: dread d6/d9/f14 [0,4194304] 0 2024-09-21T12:20:16.391 INFO:tasks.workunit.client.1.smithi192.stdout:4/80: mknod d2/c13 0 2024-09-21T12:20:16.394 INFO:tasks.workunit.client.1.smithi192.stdout:3/58: mkdir db/d16/d18 0 2024-09-21T12:20:16.394 INFO:tasks.workunit.client.1.smithi192.stdout:7/90: chown d6/d9/d1f/f21 0 1 2024-09-21T12:20:16.395 INFO:tasks.workunit.client.1.smithi192.stdout:5/236: dwrite d0/f15 [0,4194304] 0 2024-09-21T12:20:16.399 INFO:tasks.workunit.client.1.smithi192.stdout:1/125: symlink d2/de/l29 0 2024-09-21T12:20:16.403 INFO:tasks.workunit.client.1.smithi192.stdout:0/84: creat d3/d5/f14 x:0 0 0 2024-09-21T12:20:16.405 INFO:tasks.workunit.client.1.smithi192.stdout:2/102: unlink la 0 2024-09-21T12:20:16.405 INFO:tasks.workunit.client.1.smithi192.stdout:2/103: chown l17 45977 1 2024-09-21T12:20:16.406 INFO:tasks.workunit.client.1.smithi192.stdout:2/104: write f12 [68620,100069] 0 2024-09-21T12:20:16.407 INFO:tasks.workunit.client.1.smithi192.stdout:9/51: rename d5/fd to d5/d8/fe 0 2024-09-21T12:20:16.408 INFO:tasks.workunit.client.1.smithi192.stdout:9/52: chown d5/d8/fe 27 1 2024-09-21T12:20:16.410 INFO:tasks.workunit.client.1.smithi192.stdout:4/81: mknod d2/db/c14 0 2024-09-21T12:20:16.412 INFO:tasks.workunit.client.1.smithi192.stdout:5/237: symlink d0/de/d35/l4e 0 2024-09-21T12:20:16.413 INFO:tasks.workunit.client.1.smithi192.stdout:8/111: symlink d14/d1a/d1d/d20/l24 0 2024-09-21T12:20:16.413 INFO:tasks.workunit.client.1.smithi192.stdout:1/126: symlink d2/d12/l2a 0 2024-09-21T12:20:16.414 INFO:tasks.workunit.client.1.smithi192.stdout:0/85: symlink d3/d6/l15 0 2024-09-21T12:20:16.415 INFO:tasks.workunit.client.1.smithi192.stdout:0/86: stat d3/d6/fd 0 2024-09-21T12:20:16.416 INFO:tasks.workunit.client.1.smithi192.stdout:9/53: creat d5/d8/ff x:0 0 0 2024-09-21T12:20:16.417 INFO:tasks.workunit.client.1.smithi192.stdout:4/82: creat d2/db/f15 x:0 0 0 2024-09-21T12:20:16.419 INFO:tasks.workunit.client.1.smithi192.stdout:7/91: creat d6/d9/d1e/f23 x:0 0 0 2024-09-21T12:20:16.421 INFO:tasks.workunit.client.1.smithi192.stdout:5/238: read d0/de/d45/f25 [1099502,70104] 0 2024-09-21T12:20:16.421 INFO:tasks.workunit.client.1.smithi192.stdout:3/59: rename l9 to db/d16/d18/l19 0 2024-09-21T12:20:16.422 INFO:tasks.workunit.client.1.smithi192.stdout:1/127: dwrite d2/d12/f1a [0,4194304] 0 2024-09-21T12:20:16.422 INFO:tasks.workunit.client.1.smithi192.stdout:7/92: write f5 [2215855,100456] 0 2024-09-21T12:20:16.423 INFO:tasks.workunit.client.1.smithi192.stdout:5/239: chown d0/d1a 134957 1 2024-09-21T12:20:16.423 INFO:tasks.workunit.client.1.smithi192.stdout:1/128: stat d2/de 0 2024-09-21T12:20:16.425 INFO:tasks.workunit.client.1.smithi192.stdout:7/93: chown d6/d9/c22 2019 1 2024-09-21T12:20:16.425 INFO:tasks.workunit.client.1.smithi192.stdout:1/129: write d2/da/d1f/f20 [1258968,35636] 0 2024-09-21T12:20:16.427 INFO:tasks.workunit.client.1.smithi192.stdout:9/54: dread d5/f7 [0,4194304] 0 2024-09-21T12:20:16.428 INFO:tasks.workunit.client.1.smithi192.stdout:2/105: rename f12 to d1b/f21 0 2024-09-21T12:20:16.430 INFO:tasks.workunit.client.1.smithi192.stdout:3/60: mknod db/c1a 0 2024-09-21T12:20:16.430 INFO:tasks.workunit.client.1.smithi192.stdout:6/59: sync 2024-09-21T12:20:16.431 INFO:tasks.workunit.client.1.smithi192.stdout:6/60: stat da/f12 0 2024-09-21T12:20:16.431 INFO:tasks.workunit.client.1.smithi192.stdout:5/240: rmdir d0/d2 39 2024-09-21T12:20:16.431 INFO:tasks.workunit.client.1.smithi192.stdout:6/61: fsync f8 0 2024-09-21T12:20:16.437 INFO:tasks.workunit.client.1.smithi192.stdout:1/130: creat d2/d12/f2b x:0 0 0 2024-09-21T12:20:16.439 INFO:tasks.workunit.client.1.smithi192.stdout:6/62: dwrite f8 [4194304,4194304] 0 2024-09-21T12:20:16.439 INFO:tasks.workunit.client.1.smithi192.stdout:2/106: rmdir d1b/d1e 39 2024-09-21T12:20:16.440 INFO:tasks.workunit.client.1.smithi192.stdout:1/131: read d2/d12/f10 [1021070,22499] 0 2024-09-21T12:20:16.443 INFO:tasks.workunit.client.1.smithi192.stdout:0/87: rename d3/f12 to d3/de/f16 0 2024-09-21T12:20:16.444 INFO:tasks.workunit.client.1.smithi192.stdout:9/55: dread d5/fa [0,4194304] 0 2024-09-21T12:20:16.445 INFO:tasks.workunit.client.1.smithi192.stdout:3/61: mknod db/c1b 0 2024-09-21T12:20:16.447 INFO:tasks.workunit.client.1.smithi192.stdout:9/56: read d5/f7 [947942,33664] 0 2024-09-21T12:20:16.447 INFO:tasks.workunit.client.1.smithi192.stdout:5/241: creat d0/de/d45/f4f x:0 0 0 2024-09-21T12:20:16.448 INFO:tasks.workunit.client.1.smithi192.stdout:4/83: link d2/fa d2/db/f16 0 2024-09-21T12:20:16.450 INFO:tasks.workunit.client.1.smithi192.stdout:1/132: dwrite d2/de/f19 [0,4194304] 0 2024-09-21T12:20:16.451 INFO:tasks.workunit.client.1.smithi192.stdout:1/133: stat d2/d12/c21 0 2024-09-21T12:20:16.454 INFO:tasks.workunit.client.1.smithi192.stdout:6/63: creat da/f13 x:0 0 0 2024-09-21T12:20:16.460 INFO:tasks.workunit.client.1.smithi192.stdout:7/94: dwrite d6/d9/f14 [0,4194304] 0 2024-09-21T12:20:16.461 INFO:tasks.workunit.client.1.smithi192.stdout:3/62: unlink db/fe 0 2024-09-21T12:20:16.462 INFO:tasks.workunit.client.1.smithi192.stdout:7/95: chown d6/d9/d1e/f23 1559029 1 2024-09-21T12:20:16.466 INFO:tasks.workunit.client.1.smithi192.stdout:4/84: rename d2/db/f10 to d2/df/f17 0 2024-09-21T12:20:16.466 INFO:tasks.workunit.client.1.smithi192.stdout:0/88: dwrite d3/de/f16 [0,4194304] 0 2024-09-21T12:20:16.471 INFO:tasks.workunit.client.1.smithi192.stdout:1/134: symlink d2/da/d1f/l2c 0 2024-09-21T12:20:16.473 INFO:tasks.workunit.client.1.smithi192.stdout:6/64: unlink l7 0 2024-09-21T12:20:16.473 INFO:tasks.workunit.client.1.smithi192.stdout:6/65: dread - da/f13 zero size 2024-09-21T12:20:16.473 INFO:tasks.workunit.client.1.smithi192.stdout:1/135: dread d2/d12/f9 [0,4194304] 0 2024-09-21T12:20:16.474 INFO:tasks.workunit.client.1.smithi192.stdout:6/66: write da/f12 [603253,46135] 0 2024-09-21T12:20:16.478 INFO:tasks.workunit.client.1.smithi192.stdout:9/57: symlink d5/l10 0 2024-09-21T12:20:16.480 INFO:tasks.workunit.client.1.smithi192.stdout:3/63: rename db/c1b to db/c1c 0 2024-09-21T12:20:16.481 INFO:tasks.workunit.client.1.smithi192.stdout:5/242: mknod d0/de/c50 0 2024-09-21T12:20:16.482 INFO:tasks.workunit.client.1.smithi192.stdout:1/136: dwrite d2/da/fc [0,4194304] 0 2024-09-21T12:20:16.485 INFO:tasks.workunit.client.1.smithi192.stdout:0/89: creat d3/d5/f17 x:0 0 0 2024-09-21T12:20:16.485 INFO:tasks.workunit.client.1.smithi192.stdout:4/85: rename d2/l8 to d2/db/l18 0 2024-09-21T12:20:16.486 INFO:tasks.workunit.client.1.smithi192.stdout:2/107: dwrite ff [0,4194304] 0 2024-09-21T12:20:16.486 INFO:tasks.workunit.client.1.smithi192.stdout:4/86: chown d2 4 1 2024-09-21T12:20:16.489 INFO:tasks.workunit.client.1.smithi192.stdout:2/108: write ff [4443978,124439] 0 2024-09-21T12:20:16.494 INFO:tasks.workunit.client.1.smithi192.stdout:9/58: stat d5/l9 0 2024-09-21T12:20:16.495 INFO:tasks.workunit.client.1.smithi192.stdout:7/96: link d6/d9/f11 d6/d9/d1e/f24 0 2024-09-21T12:20:16.496 INFO:tasks.workunit.client.1.smithi192.stdout:3/64: dread f8 [0,4194304] 0 2024-09-21T12:20:16.498 INFO:tasks.workunit.client.1.smithi192.stdout:0/90: rename d3/d6/c13 to d3/d6/c18 0 2024-09-21T12:20:16.498 INFO:tasks.workunit.client.1.smithi192.stdout:5/243: dread d0/f15 [0,4194304] 0 2024-09-21T12:20:16.499 INFO:tasks.workunit.client.1.smithi192.stdout:0/91: dread - d3/de/f11 zero size 2024-09-21T12:20:16.500 INFO:tasks.workunit.client.1.smithi192.stdout:0/92: chown d3/d6/l15 0 1 2024-09-21T12:20:16.500 INFO:tasks.workunit.client.1.smithi192.stdout:4/87: dwrite d2/f5 [0,4194304] 0 2024-09-21T12:20:16.501 INFO:tasks.workunit.client.1.smithi192.stdout:1/137: link d2/d12/f10 d2/da/d1f/f2d 0 2024-09-21T12:20:16.501 INFO:tasks.workunit.client.1.smithi192.stdout:1/138: write f1 [1095904,74515] 0 2024-09-21T12:20:16.502 INFO:tasks.workunit.client.1.smithi192.stdout:9/59: mkdir d5/d8/d11 0 2024-09-21T12:20:16.503 INFO:tasks.workunit.client.1.smithi192.stdout:6/67: link l1 da/l14 0 2024-09-21T12:20:16.505 INFO:tasks.workunit.client.1.smithi192.stdout:2/109: truncate f19 3064984 0 2024-09-21T12:20:16.514 INFO:tasks.workunit.client.1.smithi192.stdout:1/139: creat d2/d12/f2e x:0 0 0 2024-09-21T12:20:16.514 INFO:tasks.workunit.client.1.smithi192.stdout:5/244: dwrite d0/f15 [0,4194304] 0 2024-09-21T12:20:16.519 INFO:tasks.workunit.client.1.smithi192.stdout:7/97: truncate f3 509230 0 2024-09-21T12:20:16.520 INFO:tasks.workunit.client.1.smithi192.stdout:7/98: chown d6/d9/f13 176219 1 2024-09-21T12:20:16.520 INFO:tasks.workunit.client.1.smithi192.stdout:7/99: stat d6/d9/l19 0 2024-09-21T12:20:16.520 INFO:tasks.workunit.client.1.smithi192.stdout:7/100: fsync f5 0 2024-09-21T12:20:16.525 INFO:tasks.workunit.client.1.smithi192.stdout:9/60: symlink d5/l12 0 2024-09-21T12:20:16.527 INFO:tasks.workunit.client.1.smithi192.stdout:1/140: mkdir d2/d12/d2f 0 2024-09-21T12:20:16.528 INFO:tasks.workunit.client.1.smithi192.stdout:8/112: sync 2024-09-21T12:20:16.529 INFO:tasks.workunit.client.1.smithi192.stdout:5/245: unlink d0/dc/f1c 0 2024-09-21T12:20:16.532 INFO:tasks.workunit.client.1.smithi192.stdout:3/65: write f8 [768629,9384] 0 2024-09-21T12:20:16.532 INFO:tasks.workunit.client.1.smithi192.stdout:2/110: symlink d1b/l22 0 2024-09-21T12:20:16.533 INFO:tasks.workunit.client.1.smithi192.stdout:3/66: read f8 [8282933,21567] 0 2024-09-21T12:20:16.534 INFO:tasks.workunit.client.1.smithi192.stdout:1/141: dwrite f1 [0,4194304] 0 2024-09-21T12:20:16.536 INFO:tasks.workunit.client.1.smithi192.stdout:7/101: mknod d6/d9/d1e/c25 0 2024-09-21T12:20:16.537 INFO:tasks.workunit.client.1.smithi192.stdout:7/102: dread - d6/d9/d1e/f24 zero size 2024-09-21T12:20:16.540 INFO:tasks.workunit.client.1.smithi192.stdout:0/93: write d3/d6/fb [21985,60758] 0 2024-09-21T12:20:16.541 INFO:tasks.workunit.client.1.smithi192.stdout:0/94: write d3/de/f11 [871190,50759] 0 2024-09-21T12:20:16.542 INFO:tasks.workunit.client.1.smithi192.stdout:4/88: write d2/fa [1229783,40511] 0 2024-09-21T12:20:16.543 INFO:tasks.workunit.client.1.smithi192.stdout:7/103: dread f0 [0,4194304] 0 2024-09-21T12:20:16.544 INFO:tasks.workunit.client.1.smithi192.stdout:5/246: chown d0/d2/f9 4190284 1 2024-09-21T12:20:16.544 INFO:tasks.workunit.client.1.smithi192.stdout:8/113: creat d14/d1a/f25 x:0 0 0 2024-09-21T12:20:16.545 INFO:tasks.workunit.client.1.smithi192.stdout:5/247: write d0/de/d45/f49 [628293,16887] 0 2024-09-21T12:20:16.545 INFO:tasks.workunit.client.1.smithi192.stdout:6/68: link c4 da/c15 0 2024-09-21T12:20:16.545 INFO:tasks.workunit.client.1.smithi192.stdout:8/114: write f11 [1001380,47565] 0 2024-09-21T12:20:16.552 INFO:tasks.workunit.client.1.smithi192.stdout:8/115: dread f8 [0,4194304] 0 2024-09-21T12:20:16.552 INFO:tasks.workunit.client.1.smithi192.stdout:6/69: dwrite da/fc [0,4194304] 0 2024-09-21T12:20:16.553 INFO:tasks.workunit.client.1.smithi192.stdout:8/116: read ff [697100,127528] 0 2024-09-21T12:20:16.554 INFO:tasks.workunit.client.1.smithi192.stdout:8/117: fdatasync d14/d1a/f25 0 2024-09-21T12:20:16.556 INFO:tasks.workunit.client.1.smithi192.stdout:8/118: chown d14/d1a/d1d/d20/l24 22 1 2024-09-21T12:20:16.556 INFO:tasks.workunit.client.1.smithi192.stdout:9/61: mkdir d5/d8/d11/d13 0 2024-09-21T12:20:16.558 INFO:tasks.workunit.client.1.smithi192.stdout:8/119: truncate fc 4398788 0 2024-09-21T12:20:16.558 INFO:tasks.workunit.client.1.smithi192.stdout:9/62: chown d5/d8/d11/d13 0 1 2024-09-21T12:20:16.558 INFO:tasks.workunit.client.1.smithi192.stdout:6/70: dread da/fc [0,4194304] 0 2024-09-21T12:20:16.560 INFO:tasks.workunit.client.1.smithi192.stdout:6/71: write da/f13 [463066,4981] 0 2024-09-21T12:20:16.560 INFO:tasks.workunit.client.1.smithi192.stdout:8/120: write d14/d18/f21 [3988890,104123] 0 2024-09-21T12:20:16.562 INFO:tasks.workunit.client.1.smithi192.stdout:5/248: fdatasync d0/de/d45/f25 0 2024-09-21T12:20:16.564 INFO:tasks.workunit.client.1.smithi192.stdout:6/72: dread da/f10 [0,4194304] 0 2024-09-21T12:20:16.565 INFO:tasks.workunit.client.1.smithi192.stdout:6/73: write da/f13 [465966,110211] 0 2024-09-21T12:20:16.570 INFO:tasks.workunit.client.1.smithi192.stdout:4/89: mkdir d2/d19 0 2024-09-21T12:20:16.571 INFO:tasks.workunit.client.1.smithi192.stdout:4/90: truncate d2/fa 1437097 0 2024-09-21T12:20:16.573 INFO:tasks.workunit.client.1.smithi192.stdout:7/104: symlink d6/l26 0 2024-09-21T12:20:16.575 INFO:tasks.workunit.client.1.smithi192.stdout:8/121: chown f7 511 1 2024-09-21T12:20:16.576 INFO:tasks.workunit.client.1.smithi192.stdout:8/122: write ff [760862,98767] 0 2024-09-21T12:20:16.576 INFO:tasks.workunit.client.1.smithi192.stdout:8/123: chown c10 141 1 2024-09-21T12:20:16.577 INFO:tasks.workunit.client.1.smithi192.stdout:3/67: link db/lc db/l1d 0 2024-09-21T12:20:16.578 INFO:tasks.workunit.client.1.smithi192.stdout:1/142: link d2/d12/cd d2/da/c30 0 2024-09-21T12:20:16.579 INFO:tasks.workunit.client.1.smithi192.stdout:6/74: rename da/f12 to da/f16 0 2024-09-21T12:20:16.580 INFO:tasks.workunit.client.1.smithi192.stdout:4/91: mkdir d2/db/d1a 0 2024-09-21T12:20:16.581 INFO:tasks.workunit.client.1.smithi192.stdout:9/63: creat d5/d8/d11/d13/f14 x:0 0 0 2024-09-21T12:20:16.581 INFO:tasks.workunit.client.1.smithi192.stdout:7/105: truncate d6/ff 28708 0 2024-09-21T12:20:16.583 INFO:tasks.workunit.client.1.smithi192.stdout:9/64: dread - d5/d8/ff zero size 2024-09-21T12:20:16.584 INFO:tasks.workunit.client.1.smithi192.stdout:5/249: mknod d0/d42/d44/c51 0 2024-09-21T12:20:16.584 INFO:tasks.workunit.client.1.smithi192.stdout:7/106: write d6/d9/f14 [5135102,97048] 0 2024-09-21T12:20:16.584 INFO:tasks.workunit.client.1.smithi192.stdout:8/124: dwrite d14/d18/f21 [0,4194304] 0 2024-09-21T12:20:16.585 INFO:tasks.workunit.client.1.smithi192.stdout:3/68: readlink db/l1d 0 2024-09-21T12:20:16.586 INFO:tasks.workunit.client.1.smithi192.stdout:7/107: chown f5 1964 1 2024-09-21T12:20:16.588 INFO:tasks.workunit.client.1.smithi192.stdout:1/143: rename d2/da/d1f/f23 to d2/da/f31 0 2024-09-21T12:20:16.590 INFO:tasks.workunit.client.1.smithi192.stdout:4/92: creat d2/db/f1b x:0 0 0 2024-09-21T12:20:16.598 INFO:tasks.workunit.client.1.smithi192.stdout:3/69: truncate f8 7484910 0 2024-09-21T12:20:16.598 INFO:tasks.workunit.client.1.smithi192.stdout:5/250: dwrite d0/d2/f48 [0,4194304] 0 2024-09-21T12:20:16.599 INFO:tasks.workunit.client.1.smithi192.stdout:8/125: dwrite d14/d1a/f25 [0,4194304] 0 2024-09-21T12:20:16.601 INFO:tasks.workunit.client.1.smithi192.stdout:7/108: dwrite d6/f15 [0,4194304] 0 2024-09-21T12:20:16.601 INFO:tasks.workunit.client.1.smithi192.stdout:8/126: stat d14/d1a/d1d/d20/l24 0 2024-09-21T12:20:16.602 INFO:tasks.workunit.client.1.smithi192.stdout:1/144: dread d2/da/f31 [0,4194304] 0 2024-09-21T12:20:16.603 INFO:tasks.workunit.client.1.smithi192.stdout:8/127: chown d14/d1a/l1c 3187 1 2024-09-21T12:20:16.604 INFO:tasks.workunit.client.1.smithi192.stdout:9/65: link d5/d8/ff d5/d8/f15 0 2024-09-21T12:20:16.611 INFO:tasks.workunit.client.1.smithi192.stdout:1/145: dwrite f1 [0,4194304] 0 2024-09-21T12:20:16.615 INFO:tasks.workunit.client.1.smithi192.stdout:8/128: rename d14/l17 to d14/d1a/d1d/d20/l26 0 2024-09-21T12:20:16.617 INFO:tasks.workunit.client.1.smithi192.stdout:8/129: read f12 [149501,122105] 0 2024-09-21T12:20:16.617 INFO:tasks.workunit.client.1.smithi192.stdout:9/66: write d5/fa [3805819,129602] 0 2024-09-21T12:20:16.618 INFO:tasks.workunit.client.1.smithi192.stdout:9/67: readlink l4 0 2024-09-21T12:20:16.619 INFO:tasks.workunit.client.1.smithi192.stdout:9/68: chown d5/d8/f15 25869 1 2024-09-21T12:20:16.619 INFO:tasks.workunit.client.1.smithi192.stdout:4/93: creat d2/db/d1a/f1c x:0 0 0 2024-09-21T12:20:16.622 INFO:tasks.workunit.client.1.smithi192.stdout:5/251: symlink d0/l52 0 2024-09-21T12:20:16.624 INFO:tasks.workunit.client.1.smithi192.stdout:4/94: dread d2/db/f16 [0,4194304] 0 2024-09-21T12:20:16.625 INFO:tasks.workunit.client.1.smithi192.stdout:4/95: dread - d2/db/f15 zero size 2024-09-21T12:20:16.626 INFO:tasks.workunit.client.1.smithi192.stdout:4/96: stat d2/fa 0 2024-09-21T12:20:16.626 INFO:tasks.workunit.client.1.smithi192.stdout:8/130: rename d14/d1a/f23 to d14/d1a/f27 0 2024-09-21T12:20:16.629 INFO:tasks.workunit.client.1.smithi192.stdout:5/252: dwrite d0/d2/f3e [0,4194304] 0 2024-09-21T12:20:16.631 INFO:tasks.workunit.client.1.smithi192.stdout:7/109: creat d6/f27 x:0 0 0 2024-09-21T12:20:16.632 INFO:tasks.workunit.client.1.smithi192.stdout:6/75: truncate da/fc 3771941 0 2024-09-21T12:20:16.635 INFO:tasks.workunit.client.1.smithi192.stdout:3/70: dread f8 [4194304,4194304] 0 2024-09-21T12:20:16.638 INFO:tasks.workunit.client.1.smithi192.stdout:4/97: symlink d2/db/l1d 0 2024-09-21T12:20:16.647 INFO:tasks.workunit.client.1.smithi192.stdout:3/71: creat db/f1e x:0 0 0 2024-09-21T12:20:16.647 INFO:tasks.workunit.client.1.smithi192.stdout:3/72: readlink db/lf 0 2024-09-21T12:20:16.649 INFO:tasks.workunit.client.1.smithi192.stdout:9/69: creat d5/f16 x:0 0 0 2024-09-21T12:20:16.650 INFO:tasks.workunit.client.1.smithi192.stdout:4/98: unlink d2/l12 0 2024-09-21T12:20:16.655 INFO:tasks.workunit.client.1.smithi192.stdout:6/76: rename l1 to da/l17 0 2024-09-21T12:20:16.655 INFO:tasks.workunit.client.1.smithi192.stdout:6/77: write f8 [3820204,73746] 0 2024-09-21T12:20:16.658 INFO:tasks.workunit.client.1.smithi192.stdout:1/146: truncate d2/da/fc 2353351 0 2024-09-21T12:20:16.658 INFO:tasks.workunit.client.1.smithi192.stdout:1/147: chown d2/da/f31 1 1 2024-09-21T12:20:16.658 INFO:tasks.workunit.client.1.smithi192.stdout:1/148: chown d2/c1d 116 1 2024-09-21T12:20:16.659 INFO:tasks.workunit.client.1.smithi192.stdout:6/78: dread da/f16 [0,4194304] 0 2024-09-21T12:20:16.661 INFO:tasks.workunit.client.1.smithi192.stdout:1/149: write d2/d12/f2e [786131,94851] 0 2024-09-21T12:20:16.664 INFO:tasks.workunit.client.1.smithi192.stdout:5/253: write d0/de/d45/f31 [617945,68361] 0 2024-09-21T12:20:16.665 INFO:tasks.workunit.client.1.smithi192.stdout:3/73: dwrite db/f13 [0,4194304] 0 2024-09-21T12:20:16.667 INFO:tasks.workunit.client.1.smithi192.stdout:1/150: dread d2/d12/f2e [0,4194304] 0 2024-09-21T12:20:16.667 INFO:tasks.workunit.client.1.smithi192.stdout:6/79: mkdir da/d18 0 2024-09-21T12:20:16.671 INFO:tasks.workunit.client.1.smithi192.stdout:3/74: dread f8 [4194304,4194304] 0 2024-09-21T12:20:16.671 INFO:tasks.workunit.client.1.smithi192.stdout:8/131: getdents d14/d1a/d1d/d20 0 2024-09-21T12:20:16.671 INFO:tasks.workunit.client.1.smithi192.stdout:6/80: stat da/f16 0 2024-09-21T12:20:16.671 INFO:tasks.workunit.client.1.smithi192.stdout:6/81: fsync da/f13 0 2024-09-21T12:20:16.672 INFO:tasks.workunit.client.1.smithi192.stdout:8/132: chown c10 1 1 2024-09-21T12:20:16.673 INFO:tasks.workunit.client.1.smithi192.stdout:8/133: read fe [351220,106315] 0 2024-09-21T12:20:16.674 INFO:tasks.workunit.client.1.smithi192.stdout:7/110: chown d6/ff 147798471 1 2024-09-21T12:20:16.674 INFO:tasks.workunit.client.1.smithi192.stdout:7/111: read d6/d9/f17 [1553666,48716] 0 2024-09-21T12:20:16.676 INFO:tasks.workunit.client.1.smithi192.stdout:4/99: getdents d2/db/d1a 0 2024-09-21T12:20:16.677 INFO:tasks.workunit.client.1.smithi192.stdout:9/70: write d5/fb [724377,81556] 0 2024-09-21T12:20:16.677 INFO:tasks.workunit.client.1.smithi192.stdout:9/71: read - d5/d8/f15 zero size 2024-09-21T12:20:16.680 INFO:tasks.workunit.client.1.smithi192.stdout:1/151: creat d2/da/f32 x:0 0 0 2024-09-21T12:20:16.680 INFO:tasks.workunit.client.1.smithi192.stdout:3/75: rmdir db/d16/d18 39 2024-09-21T12:20:16.680 INFO:tasks.workunit.client.1.smithi192.stdout:1/152: write d2/da/d1f/d24/f28 [562394,106951] 0 2024-09-21T12:20:16.682 INFO:tasks.workunit.client.1.smithi192.stdout:1/153: read d2/f14 [102616,21009] 0 2024-09-21T12:20:16.683 INFO:tasks.workunit.client.1.smithi192.stdout:1/154: write f1 [2120242,73504] 0 2024-09-21T12:20:16.685 INFO:tasks.workunit.client.1.smithi192.stdout:8/134: fdatasync f12 0 2024-09-21T12:20:16.686 INFO:tasks.workunit.client.1.smithi192.stdout:7/112: symlink d6/d9/l28 0 2024-09-21T12:20:16.689 INFO:tasks.workunit.client.1.smithi192.stdout:5/254: dwrite d0/d1a/f29 [0,4194304] 0 2024-09-21T12:20:16.690 INFO:tasks.workunit.client.1.smithi192.stdout:9/72: creat d5/d8/d11/f17 x:0 0 0 2024-09-21T12:20:16.696 INFO:tasks.workunit.client.1.smithi192.stdout:1/155: dread d2/d12/f2e [0,4194304] 0 2024-09-21T12:20:16.696 INFO:tasks.workunit.client.1.smithi192.stdout:1/156: chown d2/d12/c21 5 1 2024-09-21T12:20:16.697 INFO:tasks.workunit.client.1.smithi192.stdout:1/157: write f1 [1375583,22142] 0 2024-09-21T12:20:16.697 INFO:tasks.workunit.client.1.smithi192.stdout:8/135: creat d14/d18/f28 x:0 0 0 2024-09-21T12:20:16.698 INFO:tasks.workunit.client.1.smithi192.stdout:8/136: chown d14/c19 22424684 1 2024-09-21T12:20:16.698 INFO:tasks.workunit.client.1.smithi192.stdout:7/113: mkdir d6/d9/d29 0 2024-09-21T12:20:16.699 INFO:tasks.workunit.client.1.smithi192.stdout:8/137: chown f12 41735 1 2024-09-21T12:20:16.699 INFO:tasks.workunit.client.1.smithi192.stdout:7/114: fsync d6/f10 0 2024-09-21T12:20:16.700 INFO:tasks.workunit.client.1.smithi192.stdout:1/158: dread d2/da/d1f/f2d [0,4194304] 0 2024-09-21T12:20:16.705 INFO:tasks.workunit.client.1.smithi192.stdout:7/115: dwrite d6/d9/f14 [0,4194304] 0 2024-09-21T12:20:16.705 INFO:tasks.workunit.client.1.smithi192.stdout:3/76: stat db/d16/d18/l19 0 2024-09-21T12:20:16.713 INFO:tasks.workunit.client.1.smithi192.stdout:8/138: mknod d14/d18/c29 0 2024-09-21T12:20:16.717 INFO:tasks.workunit.client.1.smithi192.stdout:8/139: dwrite fc [0,4194304] 0 2024-09-21T12:20:16.722 INFO:tasks.workunit.client.1.smithi192.stdout:6/82: dread da/fc [0,4194304] 0 2024-09-21T12:20:16.724 INFO:tasks.workunit.client.1.smithi192.stdout:3/77: rename db/d16 to db/d16/d1f 22 2024-09-21T12:20:16.724 INFO:tasks.workunit.client.1.smithi192.stdout:6/83: rename da/d18 to da/d18/d19 22 2024-09-21T12:20:16.726 INFO:tasks.workunit.client.1.smithi192.stdout:9/73: creat d5/dc/f18 x:0 0 0 2024-09-21T12:20:16.727 INFO:tasks.workunit.client.1.smithi192.stdout:9/74: dread - d5/d8/ff zero size 2024-09-21T12:20:16.727 INFO:tasks.workunit.client.1.smithi192.stdout:1/159: symlink d2/d12/d2f/l33 0 2024-09-21T12:20:16.728 INFO:tasks.workunit.client.1.smithi192.stdout:6/84: dread da/fc [0,4194304] 0 2024-09-21T12:20:16.728 INFO:tasks.workunit.client.1.smithi192.stdout:8/140: rename d14/f15 to d14/f2a 0 2024-09-21T12:20:16.729 INFO:tasks.workunit.client.1.smithi192.stdout:7/116: symlink d6/d9/d29/l2a 0 2024-09-21T12:20:16.730 INFO:tasks.workunit.client.1.smithi192.stdout:3/78: mknod db/c20 0 2024-09-21T12:20:16.732 INFO:tasks.workunit.client.1.smithi192.stdout:6/85: dread da/fc [0,4194304] 0 2024-09-21T12:20:16.734 INFO:tasks.workunit.client.1.smithi192.stdout:9/75: mkdir d5/d19 0 2024-09-21T12:20:16.734 INFO:tasks.workunit.client.1.smithi192.stdout:3/79: dread f8 [0,4194304] 0 2024-09-21T12:20:16.735 INFO:tasks.workunit.client.1.smithi192.stdout:1/160: mknod d2/c34 0 2024-09-21T12:20:16.735 INFO:tasks.workunit.client.1.smithi192.stdout:1/161: chown d2/c3 828781 1 2024-09-21T12:20:16.736 INFO:tasks.workunit.client.1.smithi192.stdout:1/162: read d2/da/d1f/f22 [2629266,537] 0 2024-09-21T12:20:16.737 INFO:tasks.workunit.client.1.smithi192.stdout:1/163: write d2/d12/f2b [95400,38560] 0 2024-09-21T12:20:16.738 INFO:tasks.workunit.client.1.smithi192.stdout:7/117: creat d6/d9/f2b x:0 0 0 2024-09-21T12:20:16.739 INFO:tasks.workunit.client.1.smithi192.stdout:5/255: truncate d0/de/d45/f49 2780520 0 2024-09-21T12:20:16.739 INFO:tasks.workunit.client.1.smithi192.stdout:6/86: creat da/f1a x:0 0 0 2024-09-21T12:20:16.742 INFO:tasks.workunit.client.1.smithi192.stdout:8/141: rename d14/d1a/d1d/f1e to d14/d1a/d1d/f2b 0 2024-09-21T12:20:16.743 INFO:tasks.workunit.client.1.smithi192.stdout:3/80: mkdir db/d16/d18/d21 0 2024-09-21T12:20:16.746 INFO:tasks.workunit.client.1.smithi192.stdout:1/164: rmdir d2/de 39 2024-09-21T12:20:16.748 INFO:tasks.workunit.client.1.smithi192.stdout:8/142: dwrite f8 [0,4194304] 0 2024-09-21T12:20:16.749 INFO:tasks.workunit.client.1.smithi192.stdout:3/81: dread f8 [4194304,4194304] 0 2024-09-21T12:20:16.749 INFO:tasks.workunit.client.1.smithi192.stdout:5/256: rename d0/de/d45/f25 to d0/dc/d13/f53 0 2024-09-21T12:20:16.749 INFO:tasks.workunit.client.1.smithi192.stdout:8/143: readlink l13 0 2024-09-21T12:20:16.750 INFO:tasks.workunit.client.1.smithi192.stdout:3/82: write db/f13 [3840471,97910] 0 2024-09-21T12:20:16.755 INFO:tasks.workunit.client.1.smithi192.stdout:5/257: dread d0/d1a/f29 [0,4194304] 0 2024-09-21T12:20:16.757 INFO:tasks.workunit.client.1.smithi192.stdout:5/258: chown d0/f8 0 1 2024-09-21T12:20:16.757 INFO:tasks.workunit.client.1.smithi192.stdout:1/165: creat d2/da/d1f/d24/f35 x:0 0 0 2024-09-21T12:20:16.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:16 smithi192 ceph-mon[35641]: pgmap v258: 65 pgs: 65 active+clean; 273 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 181 KiB/s rd, 13 MiB/s wr, 228 op/s 2024-09-21T12:20:16.758 INFO:tasks.workunit.client.1.smithi192.stdout:3/83: dwrite db/f1e [0,4194304] 0 2024-09-21T12:20:16.765 INFO:tasks.workunit.client.1.smithi192.stdout:5/259: dwrite d0/d2/f3e [0,4194304] 0 2024-09-21T12:20:16.767 INFO:tasks.workunit.client.1.smithi192.stdout:5/260: chown d0/d42/d44/c51 3 1 2024-09-21T12:20:16.768 INFO:tasks.workunit.client.1.smithi192.stdout:7/118: creat d6/f2c x:0 0 0 2024-09-21T12:20:16.773 INFO:tasks.workunit.client.1.smithi192.stdout:3/84: unlink db/lf 0 2024-09-21T12:20:16.775 INFO:tasks.workunit.client.1.smithi192.stdout:1/166: symlink d2/da/d1f/l36 0 2024-09-21T12:20:16.775 INFO:tasks.workunit.client.1.smithi192.stdout:1/167: chown d2/c5 148306386 1 2024-09-21T12:20:16.777 INFO:tasks.workunit.client.1.smithi192.stdout:3/85: dread db/f1e [0,4194304] 0 2024-09-21T12:20:16.780 INFO:tasks.workunit.client.1.smithi192.stdout:7/119: mkdir d6/d9/d2d 0 2024-09-21T12:20:16.785 INFO:tasks.workunit.client.1.smithi192.stdout:3/86: creat db/f22 x:0 0 0 2024-09-21T12:20:16.786 INFO:tasks.workunit.client.1.smithi192.stdout:8/144: dwrite f12 [0,4194304] 0 2024-09-21T12:20:16.788 INFO:tasks.workunit.client.1.smithi192.stdout:8/145: read fa [4167195,235] 0 2024-09-21T12:20:16.794 INFO:tasks.workunit.client.1.smithi192.stdout:1/168: dread d2/de/f19 [0,4194304] 0 2024-09-21T12:20:16.796 INFO:tasks.workunit.client.1.smithi192.stdout:7/120: mknod d6/c2e 0 2024-09-21T12:20:16.797 INFO:tasks.workunit.client.1.smithi192.stdout:5/261: write d0/de/f2a [118124,12287] 0 2024-09-21T12:20:16.798 INFO:tasks.workunit.client.1.smithi192.stdout:8/146: symlink d14/d1a/d1d/l2c 0 2024-09-21T12:20:16.799 INFO:tasks.workunit.client.1.smithi192.stdout:8/147: chown ff 9 1 2024-09-21T12:20:16.799 INFO:tasks.workunit.client.1.smithi192.stdout:5/262: dread d0/de/d45/f2c [0,4194304] 0 2024-09-21T12:20:16.799 INFO:tasks.workunit.client.1.smithi192.stdout:8/148: chown l13 11860 1 2024-09-21T12:20:16.800 INFO:tasks.workunit.client.1.smithi192.stdout:3/87: mkdir db/d16/d18/d21/d23 0 2024-09-21T12:20:16.803 INFO:tasks.workunit.client.1.smithi192.stdout:5/263: dread d0/d2/f48 [0,4194304] 0 2024-09-21T12:20:16.805 INFO:tasks.workunit.client.1.smithi192.stdout:7/121: rename d6/d9/d29/l2a to d6/d9/l2f 0 2024-09-21T12:20:16.807 INFO:tasks.workunit.client.1.smithi192.stdout:5/264: dread d0/d2/f48 [0,4194304] 0 2024-09-21T12:20:16.808 INFO:tasks.workunit.client.1.smithi192.stdout:5/265: write d0/dc/f22 [791910,91678] 0 2024-09-21T12:20:16.809 INFO:tasks.workunit.client.1.smithi192.stdout:8/149: mknod d14/d1a/c2d 0 2024-09-21T12:20:16.811 INFO:tasks.workunit.client.1.smithi192.stdout:3/88: symlink db/d16/d18/l24 0 2024-09-21T12:20:16.811 INFO:tasks.workunit.client.1.smithi192.stdout:3/89: dread - db/f22 zero size 2024-09-21T12:20:16.812 INFO:tasks.workunit.client.1.smithi192.stdout:3/90: fdatasync db/f13 0 2024-09-21T12:20:16.816 INFO:tasks.workunit.client.1.smithi192.stdout:2/111: sync 2024-09-21T12:20:16.816 INFO:tasks.workunit.client.1.smithi192.stdout:3/91: dread db/f13 [0,4194304] 0 2024-09-21T12:20:16.817 INFO:tasks.workunit.client.1.smithi192.stdout:2/112: write f14 [4549224,55187] 0 2024-09-21T12:20:16.818 INFO:tasks.workunit.client.1.smithi192.stdout:5/266: creat d0/de/d35/f54 x:0 0 0 2024-09-21T12:20:16.820 INFO:tasks.workunit.client.1.smithi192.stdout:5/267: fdatasync d0/dc/f22 0 2024-09-21T12:20:16.820 INFO:tasks.workunit.client.1.smithi192.stdout:1/169: dwrite d2/d12/f10 [0,4194304] 0 2024-09-21T12:20:16.822 INFO:tasks.workunit.client.1.smithi192.stdout:3/92: dread db/f1e [0,4194304] 0 2024-09-21T12:20:16.822 INFO:tasks.workunit.client.1.smithi192.stdout:7/122: write d6/d9/f17 [1534696,2696] 0 2024-09-21T12:20:16.823 INFO:tasks.workunit.client.1.smithi192.stdout:3/93: write db/f13 [4691377,59934] 0 2024-09-21T12:20:16.824 INFO:tasks.workunit.client.1.smithi192.stdout:3/94: write db/f22 [254974,53069] 0 2024-09-21T12:20:16.827 INFO:tasks.workunit.client.1.smithi192.stdout:8/150: link d14/d1a/f27 d14/d1a/f2e 0 2024-09-21T12:20:16.828 INFO:tasks.workunit.client.1.smithi192.stdout:8/151: chown d14/d1a/d1d 10526 1 2024-09-21T12:20:16.829 INFO:tasks.workunit.client.1.smithi192.stdout:2/113: write d1b/f21 [1178024,109399] 0 2024-09-21T12:20:16.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:16 smithi003 ceph-mon[28057]: pgmap v258: 65 pgs: 65 active+clean; 273 MiB data, 1019 MiB used, 535 GiB / 536 GiB avail; 181 KiB/s rd, 13 MiB/s wr, 228 op/s 2024-09-21T12:20:16.830 INFO:tasks.workunit.client.1.smithi192.stdout:2/114: fsync fe 0 2024-09-21T12:20:16.830 INFO:tasks.workunit.client.1.smithi192.stdout:2/115: readlink l16 0 2024-09-21T12:20:16.834 INFO:tasks.workunit.client.1.smithi192.stdout:1/170: creat d2/da/d1f/f37 x:0 0 0 2024-09-21T12:20:16.838 INFO:tasks.workunit.client.1.smithi192.stdout:2/116: read d1b/f21 [246657,48058] 0 2024-09-21T12:20:16.841 INFO:tasks.workunit.client.1.smithi192.stdout:3/95: symlink db/d16/d18/d21/d23/l25 0 2024-09-21T12:20:16.844 INFO:tasks.workunit.client.1.smithi192.stdout:7/123: write d6/d9/d1e/f24 [790881,48776] 0 2024-09-21T12:20:16.845 INFO:tasks.workunit.client.1.smithi192.stdout:7/124: write d6/d9/f1c [4360777,94954] 0 2024-09-21T12:20:16.846 INFO:tasks.workunit.client.1.smithi192.stdout:8/152: write fe [2179241,94668] 0 2024-09-21T12:20:16.846 INFO:tasks.workunit.client.1.smithi192.stdout:7/125: write d6/d9/f14 [1218634,27046] 0 2024-09-21T12:20:16.847 INFO:tasks.workunit.client.1.smithi192.stdout:3/96: fdatasync db/f1e 0 2024-09-21T12:20:16.850 INFO:tasks.workunit.client.1.smithi192.stdout:5/268: getdents d0/de/d45 0 2024-09-21T12:20:16.851 INFO:tasks.workunit.client.1.smithi192.stdout:8/153: creat d14/d1a/d1d/f2f x:0 0 0 2024-09-21T12:20:16.852 INFO:tasks.workunit.client.1.smithi192.stdout:2/117: creat d1b/f23 x:0 0 0 2024-09-21T12:20:16.853 INFO:tasks.workunit.client.1.smithi192.stdout:3/97: creat db/d16/d18/d21/f26 x:0 0 0 2024-09-21T12:20:16.855 INFO:tasks.workunit.client.1.smithi192.stdout:8/154: symlink d14/l30 0 2024-09-21T12:20:16.856 INFO:tasks.workunit.client.1.smithi192.stdout:5/269: symlink d0/de/l55 0 2024-09-21T12:20:16.858 INFO:tasks.workunit.client.1.smithi192.stdout:8/155: creat d14/d1a/f31 x:0 0 0 2024-09-21T12:20:16.860 INFO:tasks.workunit.client.1.smithi192.stdout:5/270: unlink d0/d2/f9 0 2024-09-21T12:20:16.861 INFO:tasks.workunit.client.1.smithi192.stdout:2/118: dwrite fe [0,4194304] 0 2024-09-21T12:20:16.864 INFO:tasks.workunit.client.1.smithi192.stdout:3/98: dwrite db/d16/d18/d21/f26 [0,4194304] 0 2024-09-21T12:20:16.867 INFO:tasks.workunit.client.1.smithi192.stdout:3/99: write db/f13 [3716231,26725] 0 2024-09-21T12:20:16.872 INFO:tasks.workunit.client.1.smithi192.stdout:8/156: dwrite d14/d1a/f31 [0,4194304] 0 2024-09-21T12:20:16.873 INFO:tasks.workunit.client.1.smithi192.stdout:8/157: chown d14/d1a/f2e 2 1 2024-09-21T12:20:16.873 INFO:tasks.workunit.client.1.smithi192.stdout:3/100: symlink db/d16/d18/l27 0 2024-09-21T12:20:16.875 INFO:tasks.workunit.client.1.smithi192.stdout:3/101: write db/f13 [1131764,69970] 0 2024-09-21T12:20:16.877 INFO:tasks.workunit.client.1.smithi192.stdout:8/158: creat d14/d18/f32 x:0 0 0 2024-09-21T12:20:16.883 INFO:tasks.workunit.client.1.smithi192.stdout:3/102: fsync db/d16/d18/d21/f26 0 2024-09-21T12:20:16.884 INFO:tasks.workunit.client.1.smithi192.stdout:8/159: rmdir d14/d1a 39 2024-09-21T12:20:16.887 INFO:tasks.workunit.client.1.smithi192.stdout:3/103: mknod db/d16/d18/d21/d23/c28 0 2024-09-21T12:20:16.888 INFO:tasks.workunit.client.1.smithi192.stdout:8/160: creat d14/d18/f33 x:0 0 0 2024-09-21T12:20:16.894 INFO:tasks.workunit.client.1.smithi192.stdout:2/119: write fd [1323652,46482] 0 2024-09-21T12:20:16.894 INFO:tasks.workunit.client.1.smithi192.stdout:8/161: dwrite d14/d18/f21 [0,4194304] 0 2024-09-21T12:20:16.897 INFO:tasks.workunit.client.1.smithi192.stdout:3/104: rename db/d16/d18/d21/f26 to db/d16/f29 0 2024-09-21T12:20:16.905 INFO:tasks.workunit.client.1.smithi192.stdout:8/162: fsync d14/d18/f32 0 2024-09-21T12:20:16.906 INFO:tasks.workunit.client.1.smithi192.stdout:8/163: fdatasync fc 0 2024-09-21T12:20:16.907 INFO:tasks.workunit.client.1.smithi192.stdout:3/105: dread db/f14 [0,4194304] 0 2024-09-21T12:20:16.908 INFO:tasks.workunit.client.1.smithi192.stdout:2/120: rename d1b/f21 to d1b/f24 0 2024-09-21T12:20:16.914 INFO:tasks.workunit.client.1.smithi192.stdout:8/164: creat d14/d1a/d1d/d20/f34 x:0 0 0 2024-09-21T12:20:16.916 INFO:tasks.workunit.client.1.smithi192.stdout:2/121: fsync f19 0 2024-09-21T12:20:16.917 INFO:tasks.workunit.client.1.smithi192.stdout:2/122: fsync f2 0 2024-09-21T12:20:16.917 INFO:tasks.workunit.client.1.smithi192.stdout:8/165: rmdir d14 39 2024-09-21T12:20:16.921 INFO:tasks.workunit.client.1.smithi192.stdout:5/271: dwrite d0/f10 [0,4194304] 0 2024-09-21T12:20:16.926 INFO:tasks.workunit.client.1.smithi192.stdout:5/272: creat d0/dc/d13/d37/f56 x:0 0 0 2024-09-21T12:20:16.928 INFO:tasks.workunit.client.1.smithi192.stdout:2/123: mknod d1b/d1e/c25 0 2024-09-21T12:20:16.930 INFO:tasks.workunit.client.1.smithi192.stdout:8/166: creat d14/d1a/f35 x:0 0 0 2024-09-21T12:20:16.930 INFO:tasks.workunit.client.1.smithi192.stdout:8/167: write d14/d18/f32 [853735,40765] 0 2024-09-21T12:20:16.931 INFO:tasks.workunit.client.1.smithi192.stdout:8/168: fdatasync fc 0 2024-09-21T12:20:16.932 INFO:tasks.workunit.client.1.smithi192.stdout:5/273: rename d0/dc/l17 to d0/de/d35/l57 0 2024-09-21T12:20:16.933 INFO:tasks.workunit.client.1.smithi192.stdout:2/124: rmdir d1b 39 2024-09-21T12:20:16.937 INFO:tasks.workunit.client.1.smithi192.stdout:3/106: dwrite db/f14 [0,4194304] 0 2024-09-21T12:20:16.938 INFO:tasks.workunit.client.1.smithi192.stdout:8/169: symlink d14/l36 0 2024-09-21T12:20:16.939 INFO:tasks.workunit.client.1.smithi192.stdout:8/170: readlink d14/d1a/d1d/d20/l24 0 2024-09-21T12:20:16.942 INFO:tasks.workunit.client.1.smithi192.stdout:3/107: mkdir db/d2a 0 2024-09-21T12:20:16.943 INFO:tasks.workunit.client.1.smithi192.stdout:3/108: write db/f1e [4951184,45527] 0 2024-09-21T12:20:16.943 INFO:tasks.workunit.client.1.smithi192.stdout:8/171: creat d14/d1a/d1d/d20/f37 x:0 0 0 2024-09-21T12:20:16.947 INFO:tasks.workunit.client.1.smithi192.stdout:8/172: rename fe to d14/d1a/d1d/f38 0 2024-09-21T12:20:16.952 INFO:tasks.workunit.client.1.smithi192.stdout:8/173: mkdir d14/d1a/d1d/d39 0 2024-09-21T12:20:16.953 INFO:tasks.workunit.client.1.smithi192.stdout:3/109: link l7 db/d2a/l2b 0 2024-09-21T12:20:16.954 INFO:tasks.workunit.client.1.smithi192.stdout:8/174: rmdir d14 39 2024-09-21T12:20:16.958 INFO:tasks.workunit.client.1.smithi192.stdout:8/175: stat d14/d1a/c2d 0 2024-09-21T12:20:16.958 INFO:tasks.workunit.client.1.smithi192.stdout:8/176: fdatasync fd 0 2024-09-21T12:20:16.959 INFO:tasks.workunit.client.1.smithi192.stdout:5/274: write d0/f26 [2964272,83221] 0 2024-09-21T12:20:16.962 INFO:tasks.workunit.client.1.smithi192.stdout:8/177: mknod d14/d18/c3a 0 2024-09-21T12:20:16.962 INFO:tasks.workunit.client.1.smithi192.stdout:8/178: chown d14/d1a/f25 30 1 2024-09-21T12:20:16.964 INFO:tasks.workunit.client.1.smithi192.stdout:3/110: creat db/d16/f2c x:0 0 0 2024-09-21T12:20:16.965 INFO:tasks.workunit.client.1.smithi192.stdout:5/275: symlink d0/de/d35/l58 0 2024-09-21T12:20:16.967 INFO:tasks.workunit.client.1.smithi192.stdout:8/179: dwrite d14/d18/f21 [0,4194304] 0 2024-09-21T12:20:16.968 INFO:tasks.workunit.client.1.smithi192.stdout:3/111: rmdir db/d16/d18/d21 39 2024-09-21T12:20:16.970 INFO:tasks.workunit.client.1.smithi192.stdout:5/276: rmdir d0/dc/d13/d37 39 2024-09-21T12:20:16.971 INFO:tasks.workunit.client.1.smithi192.stdout:8/180: creat d14/d1a/f3b x:0 0 0 2024-09-21T12:20:16.977 INFO:tasks.workunit.client.1.smithi192.stdout:3/112: mkdir db/d16/d18/d2d 0 2024-09-21T12:20:16.981 INFO:tasks.workunit.client.1.smithi192.stdout:5/277: rename d0/de/d35/c40 to d0/c59 0 2024-09-21T12:20:16.981 INFO:tasks.workunit.client.1.smithi192.stdout:8/181: rename d14/d1a to d14/d1a/d1d/d20/d3c 22 2024-09-21T12:20:16.983 INFO:tasks.workunit.client.1.smithi192.stdout:3/113: dwrite db/f1e [4194304,4194304] 0 2024-09-21T12:20:16.984 INFO:tasks.workunit.client.1.smithi192.stdout:3/114: read - db/d16/f2c zero size 2024-09-21T12:20:16.987 INFO:tasks.workunit.client.1.smithi192.stdout:5/278: dread d0/d2/f48 [0,4194304] 0 2024-09-21T12:20:16.992 INFO:tasks.workunit.client.1.smithi192.stdout:5/279: creat d0/de/d45/f5a x:0 0 0 2024-09-21T12:20:16.995 INFO:tasks.workunit.client.1.smithi192.stdout:5/280: truncate d0/d1a/f32 168433 0 2024-09-21T12:20:16.995 INFO:tasks.workunit.client.1.smithi192.stdout:8/182: dread fa [0,4194304] 0 2024-09-21T12:20:16.996 INFO:tasks.workunit.client.1.smithi192.stdout:5/281: write d0/d2/f14 [518573,65372] 0 2024-09-21T12:20:16.997 INFO:tasks.workunit.client.1.smithi192.stdout:5/282: read d0/f8 [1276450,11859] 0 2024-09-21T12:20:17.003 INFO:tasks.workunit.client.1.smithi192.stdout:5/283: dwrite d0/dc/f22 [0,4194304] 0 2024-09-21T12:20:17.007 INFO:tasks.workunit.client.1.smithi192.stdout:5/284: stat d0/de/c33 0 2024-09-21T12:20:17.017 INFO:tasks.workunit.client.1.smithi192.stdout:3/115: write f8 [485895,101527] 0 2024-09-21T12:20:17.024 INFO:tasks.workunit.client.1.smithi192.stdout:3/116: dwrite db/d16/f29 [0,4194304] 0 2024-09-21T12:20:17.031 INFO:tasks.workunit.client.1.smithi192.stdout:3/117: dwrite db/f14 [0,4194304] 0 2024-09-21T12:20:17.032 INFO:tasks.workunit.client.1.smithi192.stdout:8/183: truncate d14/d1a/f25 2998176 0 2024-09-21T12:20:17.033 INFO:tasks.workunit.client.1.smithi192.stdout:4/100: sync 2024-09-21T12:20:17.033 INFO:tasks.workunit.client.1.smithi192.stdout:0/95: sync 2024-09-21T12:20:17.035 INFO:tasks.workunit.client.1.smithi192.stdout:3/118: rmdir db/d2a 39 2024-09-21T12:20:17.036 INFO:tasks.workunit.client.1.smithi192.stdout:3/119: write db/d16/f2c [792635,4421] 0 2024-09-21T12:20:17.037 INFO:tasks.workunit.client.1.smithi192.stdout:8/184: unlink f12 0 2024-09-21T12:20:17.039 INFO:tasks.workunit.client.1.smithi192.stdout:0/96: unlink d3/d5/l7 0 2024-09-21T12:20:17.042 INFO:tasks.workunit.client.1.smithi192.stdout:5/285: dwrite d0/d2/f43 [0,4194304] 0 2024-09-21T12:20:17.043 INFO:tasks.workunit.client.1.smithi192.stdout:3/120: unlink db/d16/f29 0 2024-09-21T12:20:17.047 INFO:tasks.workunit.client.1.smithi192.stdout:0/97: chown d3/d6/c18 600553 1 2024-09-21T12:20:17.047 INFO:tasks.workunit.client.1.smithi192.stdout:5/286: dread d0/de/f2a [0,4194304] 0 2024-09-21T12:20:17.050 INFO:tasks.workunit.client.1.smithi192.stdout:8/185: truncate fd 3834629 0 2024-09-21T12:20:17.056 INFO:tasks.workunit.client.1.smithi192.stdout:0/98: mkdir d3/d5/d19 0 2024-09-21T12:20:17.056 INFO:tasks.workunit.client.1.smithi192.stdout:0/99: readlink d3/d6/l8 0 2024-09-21T12:20:17.059 INFO:tasks.workunit.client.1.smithi192.stdout:4/101: link l1 d2/l1e 0 2024-09-21T12:20:17.060 INFO:tasks.workunit.client.1.smithi192.stdout:3/121: rmdir db/d16/d18/d21 39 2024-09-21T12:20:17.064 INFO:tasks.workunit.client.1.smithi192.stdout:0/100: rename d3/de/f16 to d3/f1a 0 2024-09-21T12:20:17.064 INFO:tasks.workunit.client.1.smithi192.stdout:4/102: dwrite d2/db/d1a/f1c [0,4194304] 0 2024-09-21T12:20:17.064 INFO:tasks.workunit.client.1.smithi192.stdout:3/122: rmdir db/d16 39 2024-09-21T12:20:17.065 INFO:tasks.workunit.client.1.smithi192.stdout:4/103: chown d2/db/d1a 43698 1 2024-09-21T12:20:17.066 INFO:tasks.workunit.client.1.smithi192.stdout:5/287: creat d0/dc/d13/f5b x:0 0 0 2024-09-21T12:20:17.073 INFO:tasks.workunit.client.1.smithi192.stdout:0/101: write d3/f1a [2876055,116953] 0 2024-09-21T12:20:17.074 INFO:tasks.workunit.client.1.smithi192.stdout:0/102: write d3/d5/f17 [70498,121463] 0 2024-09-21T12:20:17.074 INFO:tasks.workunit.client.1.smithi192.stdout:3/123: mkdir db/d2a/d2e 0 2024-09-21T12:20:17.075 INFO:tasks.workunit.client.1.smithi192.stdout:3/124: write db/f14 [2927636,69761] 0 2024-09-21T12:20:17.080 INFO:tasks.workunit.client.1.smithi192.stdout:0/103: creat d3/d5/f1b x:0 0 0 2024-09-21T12:20:17.088 INFO:tasks.workunit.client.1.smithi192.stdout:3/125: dwrite db/d16/f2c [0,4194304] 0 2024-09-21T12:20:17.089 INFO:tasks.workunit.client.1.smithi192.stdout:0/104: mknod d3/c1c 0 2024-09-21T12:20:17.094 INFO:tasks.workunit.client.1.smithi192.stdout:5/288: rename d0/f12 to d0/de/f5c 0 2024-09-21T12:20:17.096 INFO:tasks.workunit.client.1.smithi192.stdout:0/105: mkdir d3/d6/d1d 0 2024-09-21T12:20:17.097 INFO:tasks.workunit.client.1.smithi192.stdout:0/106: write d3/de/f11 [1677987,90260] 0 2024-09-21T12:20:17.104 INFO:tasks.workunit.client.1.smithi192.stdout:0/107: mknod d3/c1e 0 2024-09-21T12:20:17.109 INFO:tasks.workunit.client.1.smithi192.stdout:5/289: truncate d0/d1a/f32 48173 0 2024-09-21T12:20:17.109 INFO:tasks.workunit.client.1.smithi192.stdout:5/290: dread - d0/de/d45/f5a zero size 2024-09-21T12:20:17.111 INFO:tasks.workunit.client.1.smithi192.stdout:0/108: unlink d3/d6/fb 0 2024-09-21T12:20:17.113 INFO:tasks.workunit.client.1.smithi192.stdout:3/126: creat db/d16/d18/f2f x:0 0 0 2024-09-21T12:20:17.113 INFO:tasks.workunit.client.1.smithi192.stdout:3/127: chown db/c15 1520238971 1 2024-09-21T12:20:17.116 INFO:tasks.workunit.client.1.smithi192.stdout:4/104: write d2/f6 [1970119,79464] 0 2024-09-21T12:20:17.119 INFO:tasks.workunit.client.1.smithi192.stdout:0/109: unlink d3/d5/f17 0 2024-09-21T12:20:17.121 INFO:tasks.workunit.client.1.smithi192.stdout:5/291: creat d0/dc/d13/d37/f5d x:0 0 0 2024-09-21T12:20:17.121 INFO:tasks.workunit.client.1.smithi192.stdout:1/171: sync 2024-09-21T12:20:17.122 INFO:tasks.workunit.client.1.smithi192.stdout:9/76: sync 2024-09-21T12:20:17.122 INFO:tasks.workunit.client.1.smithi192.stdout:6/87: sync 2024-09-21T12:20:17.122 INFO:tasks.workunit.client.1.smithi192.stdout:7/126: sync 2024-09-21T12:20:17.124 INFO:tasks.workunit.client.1.smithi192.stdout:4/105: rename d2/f6 to d2/db/f1f 0 2024-09-21T12:20:17.128 INFO:tasks.workunit.client.1.smithi192.stdout:5/292: mknod d0/d1a/c5e 0 2024-09-21T12:20:17.129 INFO:tasks.workunit.client.1.smithi192.stdout:7/127: rmdir d6 39 2024-09-21T12:20:17.133 INFO:tasks.workunit.client.1.smithi192.stdout:9/77: unlink d5/d8/fe 0 2024-09-21T12:20:17.134 INFO:tasks.workunit.client.1.smithi192.stdout:4/106: fdatasync d2/db/f1f 0 2024-09-21T12:20:17.136 INFO:tasks.workunit.client.1.smithi192.stdout:0/110: mknod d3/d5/d19/c1f 0 2024-09-21T12:20:17.141 INFO:tasks.workunit.client.1.smithi192.stdout:9/78: stat d5/c6 0 2024-09-21T12:20:17.143 INFO:tasks.workunit.client.1.smithi192.stdout:4/107: chown d2/l4 1280162 1 2024-09-21T12:20:17.144 INFO:tasks.workunit.client.1.smithi192.stdout:4/108: fdatasync d2/db/f15 0 2024-09-21T12:20:17.146 INFO:tasks.workunit.client.1.smithi192.stdout:9/79: dwrite d5/dc/f18 [0,4194304] 0 2024-09-21T12:20:17.148 INFO:tasks.workunit.client.1.smithi192.stdout:0/111: symlink d3/d6/d1d/l20 0 2024-09-21T12:20:17.151 INFO:tasks.workunit.client.1.smithi192.stdout:5/293: rename d0/d1a/c5e to d0/dc/d13/c5f 0 2024-09-21T12:20:17.154 INFO:tasks.workunit.client.1.smithi192.stdout:4/109: truncate d2/db/f16 1250 0 2024-09-21T12:20:17.156 INFO:tasks.workunit.client.1.smithi192.stdout:7/128: mknod d6/d20/c30 0 2024-09-21T12:20:17.156 INFO:tasks.workunit.client.1.smithi192.stdout:7/129: chown d6/f10 61214223 1 2024-09-21T12:20:17.157 INFO:tasks.workunit.client.1.smithi192.stdout:7/130: chown d6/f27 8 1 2024-09-21T12:20:17.158 INFO:tasks.workunit.client.1.smithi192.stdout:4/110: dread d2/db/d1a/f1c [0,4194304] 0 2024-09-21T12:20:17.159 INFO:tasks.workunit.client.1.smithi192.stdout:0/112: mknod d3/d6/c21 0 2024-09-21T12:20:17.160 INFO:tasks.workunit.client.1.smithi192.stdout:0/113: write d3/de/f11 [2626612,4921] 0 2024-09-21T12:20:17.164 INFO:tasks.workunit.client.1.smithi192.stdout:9/80: mknod d5/d19/c1a 0 2024-09-21T12:20:17.165 INFO:tasks.workunit.client.1.smithi192.stdout:4/111: dwrite d2/db/d1a/f1c [0,4194304] 0 2024-09-21T12:20:17.165 INFO:tasks.workunit.client.1.smithi192.stdout:9/81: chown d5/d8/d11/f17 7977878 1 2024-09-21T12:20:17.168 INFO:tasks.workunit.client.1.smithi192.stdout:0/114: mknod d3/c22 0 2024-09-21T12:20:17.176 INFO:tasks.workunit.client.1.smithi192.stdout:7/131: rename c4 to d6/d9/c31 0 2024-09-21T12:20:17.178 INFO:tasks.workunit.client.1.smithi192.stdout:0/115: mknod d3/d5/c23 0 2024-09-21T12:20:17.178 INFO:tasks.workunit.client.1.smithi192.stdout:0/116: stat d3/d6/d1d 0 2024-09-21T12:20:17.178 INFO:tasks.workunit.client.1.smithi192.stdout:0/117: readlink d3/d6/l8 0 2024-09-21T12:20:17.183 INFO:tasks.workunit.client.1.smithi192.stdout:0/118: link d3/d5/f1b d3/de/f24 0 2024-09-21T12:20:17.186 INFO:tasks.workunit.client.1.smithi192.stdout:0/119: write d3/de/f24 [321869,121679] 0 2024-09-21T12:20:17.189 INFO:tasks.workunit.client.1.smithi192.stdout:0/120: mknod d3/d5/c25 0 2024-09-21T12:20:17.190 INFO:tasks.workunit.client.1.smithi192.stdout:0/121: chown d3/de/f11 115 1 2024-09-21T12:20:17.201 INFO:tasks.workunit.client.1.smithi192.stdout:9/82: dread d5/fb [0,4194304] 0 2024-09-21T12:20:17.201 INFO:tasks.workunit.client.1.smithi192.stdout:9/83: dread - d5/f16 zero size 2024-09-21T12:20:17.207 INFO:tasks.workunit.client.1.smithi192.stdout:4/112: dread d2/fa [0,4194304] 0 2024-09-21T12:20:17.215 INFO:tasks.workunit.client.1.smithi192.stdout:4/113: dwrite d2/df/f17 [0,4194304] 0 2024-09-21T12:20:17.216 INFO:tasks.workunit.client.1.smithi192.stdout:4/114: read d2/db/f16 [415,26537] 0 2024-09-21T12:20:17.216 INFO:tasks.workunit.client.1.smithi192.stdout:5/294: dwrite d0/f8 [0,4194304] 0 2024-09-21T12:20:17.217 INFO:tasks.workunit.client.1.smithi192.stdout:4/115: fdatasync d2/db/f1b 0 2024-09-21T12:20:17.221 INFO:tasks.workunit.client.1.smithi192.stdout:5/295: dread d0/d2/f48 [0,4194304] 0 2024-09-21T12:20:17.223 INFO:tasks.workunit.client.1.smithi192.stdout:8/186: sync 2024-09-21T12:20:17.224 INFO:tasks.workunit.client.1.smithi192.stdout:2/125: sync 2024-09-21T12:20:17.224 INFO:tasks.workunit.client.1.smithi192.stdout:4/116: creat d2/f20 x:0 0 0 2024-09-21T12:20:17.224 INFO:tasks.workunit.client.1.smithi192.stdout:4/117: stat d2 0 2024-09-21T12:20:17.225 INFO:tasks.workunit.client.1.smithi192.stdout:5/296: symlink d0/dc/l60 0 2024-09-21T12:20:17.225 INFO:tasks.workunit.client.1.smithi192.stdout:8/187: write ff [1871091,100169] 0 2024-09-21T12:20:17.231 INFO:tasks.workunit.client.1.smithi192.stdout:5/297: unlink d0/de/l55 0 2024-09-21T12:20:17.231 INFO:tasks.workunit.client.1.smithi192.stdout:5/298: stat d0/dc/d13 0 2024-09-21T12:20:17.233 INFO:tasks.workunit.client.1.smithi192.stdout:8/188: unlink c2 0 2024-09-21T12:20:17.234 INFO:tasks.workunit.client.1.smithi192.stdout:2/126: symlink d1b/d1e/l26 0 2024-09-21T12:20:17.234 INFO:tasks.workunit.client.1.smithi192.stdout:8/189: write d14/d1a/d1d/d20/f37 [267983,78650] 0 2024-09-21T12:20:17.234 INFO:tasks.workunit.client.1.smithi192.stdout:2/127: stat f15 0 2024-09-21T12:20:17.241 INFO:tasks.workunit.client.1.smithi192.stdout:8/190: creat d14/d1a/d1d/d39/f3d x:0 0 0 2024-09-21T12:20:17.241 INFO:tasks.workunit.client.1.smithi192.stdout:0/122: getdents d3/d5 0 2024-09-21T12:20:17.242 INFO:tasks.workunit.client.1.smithi192.stdout:8/191: write d14/d18/f32 [1174031,108884] 0 2024-09-21T12:20:17.242 INFO:tasks.workunit.client.1.smithi192.stdout:2/128: creat d1b/f27 x:0 0 0 2024-09-21T12:20:17.243 INFO:tasks.workunit.client.1.smithi192.stdout:2/129: chown d1b/d1e/l26 5 1 2024-09-21T12:20:17.245 INFO:tasks.workunit.client.1.smithi192.stdout:0/123: creat d3/d5/d19/f26 x:0 0 0 2024-09-21T12:20:17.247 INFO:tasks.workunit.client.1.smithi192.stdout:0/124: truncate d3/de/f24 755740 0 2024-09-21T12:20:17.247 INFO:tasks.workunit.client.1.smithi192.stdout:2/130: mknod d1b/c28 0 2024-09-21T12:20:17.248 INFO:tasks.workunit.client.1.smithi192.stdout:8/192: dwrite fc [0,4194304] 0 2024-09-21T12:20:17.249 INFO:tasks.workunit.client.1.smithi192.stdout:0/125: mknod d3/d5/d19/c27 0 2024-09-21T12:20:17.251 INFO:tasks.workunit.client.1.smithi192.stdout:8/193: creat d14/d1a/d1d/d39/f3e x:0 0 0 2024-09-21T12:20:17.256 INFO:tasks.workunit.client.1.smithi192.stdout:8/194: rmdir d14/d18 39 2024-09-21T12:20:17.257 INFO:tasks.workunit.client.1.smithi192.stdout:0/126: dwrite d3/de/f24 [0,4194304] 0 2024-09-21T12:20:17.258 INFO:tasks.workunit.client.1.smithi192.stdout:0/127: chown d3/d5/c25 65629323 1 2024-09-21T12:20:17.258 INFO:tasks.workunit.client.1.smithi192.stdout:8/195: write d14/d18/f32 [1886870,10539] 0 2024-09-21T12:20:17.259 INFO:tasks.workunit.client.1.smithi192.stdout:9/84: truncate d5/f7 3232688 0 2024-09-21T12:20:17.259 INFO:tasks.workunit.client.1.smithi192.stdout:9/85: fdatasync d5/dc/f18 0 2024-09-21T12:20:17.260 INFO:tasks.workunit.client.1.smithi192.stdout:9/86: dread - d5/d8/d11/d13/f14 zero size 2024-09-21T12:20:17.263 INFO:tasks.workunit.client.1.smithi192.stdout:0/128: mkdir d3/d5/d28 0 2024-09-21T12:20:17.266 INFO:tasks.workunit.client.1.smithi192.stdout:8/196: dwrite d14/d1a/f35 [0,4194304] 0 2024-09-21T12:20:17.268 INFO:tasks.workunit.client.1.smithi192.stdout:9/87: creat d5/d19/f1b x:0 0 0 2024-09-21T12:20:17.268 INFO:tasks.workunit.client.1.smithi192.stdout:9/88: chown l1 89942 1 2024-09-21T12:20:17.272 INFO:tasks.workunit.client.1.smithi192.stdout:0/129: unlink d3/c22 0 2024-09-21T12:20:17.272 INFO:tasks.workunit.client.1.smithi192.stdout:0/130: chown d3/d6/fd 439 1 2024-09-21T12:20:17.273 INFO:tasks.workunit.client.1.smithi192.stdout:8/197: unlink c10 0 2024-09-21T12:20:17.278 INFO:tasks.workunit.client.1.smithi192.stdout:9/89: creat d5/d8/d11/d13/f1c x:0 0 0 2024-09-21T12:20:17.278 INFO:tasks.workunit.client.1.smithi192.stdout:8/198: dread fc [0,4194304] 0 2024-09-21T12:20:17.278 INFO:tasks.workunit.client.1.smithi192.stdout:0/131: symlink d3/d5/l29 0 2024-09-21T12:20:17.278 INFO:tasks.workunit.client.1.smithi192.stdout:8/199: read - d14/d1a/f3b zero size 2024-09-21T12:20:17.279 INFO:tasks.workunit.client.1.smithi192.stdout:9/90: truncate d5/d8/d11/d13/f1c 103980 0 2024-09-21T12:20:17.279 INFO:tasks.workunit.client.1.smithi192.stdout:9/91: fdatasync d5/d19/f1b 0 2024-09-21T12:20:17.283 INFO:tasks.workunit.client.1.smithi192.stdout:0/132: dwrite d3/d5/f1b [0,4194304] 0 2024-09-21T12:20:17.285 INFO:tasks.workunit.client.1.smithi192.stdout:9/92: mknod d5/dc/c1d 0 2024-09-21T12:20:17.287 INFO:tasks.workunit.client.1.smithi192.stdout:0/133: unlink d3/d5/c25 0 2024-09-21T12:20:17.289 INFO:tasks.workunit.client.1.smithi192.stdout:5/299: dwrite d0/de/f5c [0,4194304] 0 2024-09-21T12:20:17.290 INFO:tasks.workunit.client.1.smithi192.stdout:5/300: dread - d0/dc/d13/d37/f5d zero size 2024-09-21T12:20:17.291 INFO:tasks.workunit.client.1.smithi192.stdout:5/301: chown d0/de/d45/f2c 192680 1 2024-09-21T12:20:17.297 INFO:tasks.workunit.client.1.smithi192.stdout:0/134: getdents d3/d5/d28 0 2024-09-21T12:20:17.299 INFO:tasks.workunit.client.1.smithi192.stdout:2/131: truncate fd 834401 0 2024-09-21T12:20:17.300 INFO:tasks.workunit.client.1.smithi192.stdout:7/132: sync 2024-09-21T12:20:17.300 INFO:tasks.workunit.client.1.smithi192.stdout:1/172: sync 2024-09-21T12:20:17.300 INFO:tasks.workunit.client.1.smithi192.stdout:3/128: sync 2024-09-21T12:20:17.300 INFO:tasks.workunit.client.1.smithi192.stdout:6/88: sync 2024-09-21T12:20:17.302 INFO:tasks.workunit.client.1.smithi192.stdout:0/135: dread d3/d5/f1b [0,4194304] 0 2024-09-21T12:20:17.303 INFO:tasks.workunit.client.1.smithi192.stdout:2/132: dread f19 [0,4194304] 0 2024-09-21T12:20:17.304 INFO:tasks.workunit.client.1.smithi192.stdout:2/133: readlink l18 0 2024-09-21T12:20:17.304 INFO:tasks.workunit.client.1.smithi192.stdout:6/89: readlink da/l14 0 2024-09-21T12:20:17.305 INFO:tasks.workunit.client.1.smithi192.stdout:6/90: stat da/f16 0 2024-09-21T12:20:17.305 INFO:tasks.workunit.client.1.smithi192.stdout:2/134: chown d1b/f23 0 1 2024-09-21T12:20:17.306 INFO:tasks.workunit.client.1.smithi192.stdout:1/173: creat d2/da/d1f/f38 x:0 0 0 2024-09-21T12:20:17.309 INFO:tasks.workunit.client.1.smithi192.stdout:2/135: truncate d1b/f23 196083 0 2024-09-21T12:20:17.310 INFO:tasks.workunit.client.1.smithi192.stdout:3/129: mknod db/d16/d18/d21/d23/c30 0 2024-09-21T12:20:17.311 INFO:tasks.workunit.client.1.smithi192.stdout:2/136: write ff [1686330,74883] 0 2024-09-21T12:20:17.311 INFO:tasks.workunit.client.1.smithi192.stdout:7/133: dwrite d6/d9/d1e/f23 [0,4194304] 0 2024-09-21T12:20:17.314 INFO:tasks.workunit.client.1.smithi192.stdout:0/136: dread d3/fa [0,4194304] 0 2024-09-21T12:20:17.315 INFO:tasks.workunit.client.1.smithi192.stdout:1/174: dread d2/de/f18 [0,4194304] 0 2024-09-21T12:20:17.317 INFO:tasks.workunit.client.1.smithi192.stdout:6/91: mknod da/d18/c1b 0 2024-09-21T12:20:17.320 INFO:tasks.workunit.client.1.smithi192.stdout:8/200: write d14/d1a/f2e [75012,86607] 0 2024-09-21T12:20:17.320 INFO:tasks.workunit.client.1.smithi192.stdout:7/134: rename d6/f2c to d6/d9/d1e/f32 0 2024-09-21T12:20:17.322 INFO:tasks.workunit.client.1.smithi192.stdout:3/130: dwrite db/d16/f2c [0,4194304] 0 2024-09-21T12:20:17.325 INFO:tasks.workunit.client.1.smithi192.stdout:0/137: mkdir d3/d5/d19/d2a 0 2024-09-21T12:20:17.326 INFO:tasks.workunit.client.1.smithi192.stdout:6/92: dread da/fc [0,4194304] 0 2024-09-21T12:20:17.326 INFO:tasks.workunit.client.1.smithi192.stdout:4/118: sync 2024-09-21T12:20:17.327 INFO:tasks.workunit.client.1.smithi192.stdout:1/175: symlink d2/d12/l39 0 2024-09-21T12:20:17.327 INFO:tasks.workunit.client.1.smithi192.stdout:8/201: dread ff [0,4194304] 0 2024-09-21T12:20:17.328 INFO:tasks.workunit.client.1.smithi192.stdout:9/93: write d5/fb [853604,49665] 0 2024-09-21T12:20:17.329 INFO:tasks.workunit.client.1.smithi192.stdout:8/202: dread - d14/d1a/d1d/d39/f3e zero size 2024-09-21T12:20:17.330 INFO:tasks.workunit.client.1.smithi192.stdout:1/176: dread d2/de/f18 [0,4194304] 0 2024-09-21T12:20:17.343 INFO:tasks.workunit.client.1.smithi192.stdout:7/135: dread d6/d9/f13 [0,4194304] 0 2024-09-21T12:20:17.343 INFO:tasks.workunit.client.1.smithi192.stdout:9/94: truncate d5/d19/f1b 344380 0 2024-09-21T12:20:17.343 INFO:tasks.workunit.client.1.smithi192.stdout:5/302: write d0/dc/d13/f53 [166443,99334] 0 2024-09-21T12:20:17.343 INFO:tasks.workunit.client.1.smithi192.stdout:8/203: chown d14/d1a/d1d/d39 17808 1 2024-09-21T12:20:17.348 INFO:tasks.workunit.client.1.smithi192.stdout:6/93: unlink da/c15 0 2024-09-21T12:20:17.349 INFO:tasks.workunit.client.1.smithi192.stdout:6/94: chown da/l11 12 1 2024-09-21T12:20:17.349 INFO:tasks.workunit.client.1.smithi192.stdout:9/95: mkdir d5/dc/d1e 0 2024-09-21T12:20:17.350 INFO:tasks.workunit.client.1.smithi192.stdout:9/96: chown d5/d8/d11/d13 155545 1 2024-09-21T12:20:17.350 INFO:tasks.workunit.client.1.smithi192.stdout:2/137: write fd [406573,100539] 0 2024-09-21T12:20:17.351 INFO:tasks.workunit.client.1.smithi192.stdout:9/97: chown d5/dc 3008 1 2024-09-21T12:20:17.351 INFO:tasks.workunit.client.1.smithi192.stdout:8/204: unlink d14/d1a/f35 0 2024-09-21T12:20:17.354 INFO:tasks.workunit.client.1.smithi192.stdout:1/177: dwrite d2/da/f31 [0,4194304] 0 2024-09-21T12:20:17.355 INFO:tasks.workunit.client.1.smithi192.stdout:5/303: rename d0/d2/f3e to d0/dc/f61 0 2024-09-21T12:20:17.356 INFO:tasks.workunit.client.1.smithi192.stdout:6/95: rename da/d18 to da/d18/d1c 22 2024-09-21T12:20:17.358 INFO:tasks.workunit.client.1.smithi192.stdout:7/136: link d6/d9/d1e/f23 d6/d9/d1e/f33 0 2024-09-21T12:20:17.358 INFO:tasks.workunit.client.1.smithi192.stdout:0/138: getdents d3/de 0 2024-09-21T12:20:17.360 INFO:tasks.workunit.client.1.smithi192.stdout:4/119: getdents d2 0 2024-09-21T12:20:17.360 INFO:tasks.workunit.client.1.smithi192.stdout:1/178: rmdir d2/d12 39 2024-09-21T12:20:17.361 INFO:tasks.workunit.client.1.smithi192.stdout:2/138: dwrite d1b/f23 [0,4194304] 0 2024-09-21T12:20:17.363 INFO:tasks.workunit.client.1.smithi192.stdout:6/96: mknod da/c1d 0 2024-09-21T12:20:17.364 INFO:tasks.workunit.client.1.smithi192.stdout:5/304: mknod d0/dc/c62 0 2024-09-21T12:20:17.365 INFO:tasks.workunit.client.1.smithi192.stdout:9/98: creat d5/dc/d1e/f1f x:0 0 0 2024-09-21T12:20:17.366 INFO:tasks.workunit.client.1.smithi192.stdout:5/305: dread - d0/d1a/d36/f46 zero size 2024-09-21T12:20:17.370 INFO:tasks.workunit.client.1.smithi192.stdout:7/137: symlink d6/d20/l34 0 2024-09-21T12:20:17.377 INFO:tasks.workunit.client.1.smithi192.stdout:6/97: mknod da/c1e 0 2024-09-21T12:20:17.378 INFO:tasks.workunit.client.1.smithi192.stdout:6/98: fsync da/f1a 0 2024-09-21T12:20:17.378 INFO:tasks.workunit.client.1.smithi192.stdout:9/99: rmdir d5/d8/d11 39 2024-09-21T12:20:17.378 INFO:tasks.workunit.client.1.smithi192.stdout:6/99: read da/fc [1852867,8661] 0 2024-09-21T12:20:17.380 INFO:tasks.workunit.client.1.smithi192.stdout:7/138: mknod d6/d9/d1e/c35 0 2024-09-21T12:20:17.382 INFO:tasks.workunit.client.1.smithi192.stdout:2/139: unlink d1b/l1c 0 2024-09-21T12:20:17.382 INFO:tasks.workunit.client.1.smithi192.stdout:2/140: fsync d1b/f27 0 2024-09-21T12:20:17.382 INFO:tasks.workunit.client.1.smithi192.stdout:2/141: fsync fd 0 2024-09-21T12:20:17.383 INFO:tasks.workunit.client.1.smithi192.stdout:0/139: link d3/d5/d19/f26 d3/d5/d19/d2a/f2b 0 2024-09-21T12:20:17.387 INFO:tasks.workunit.client.1.smithi192.stdout:4/120: write d2/fa [235711,123553] 0 2024-09-21T12:20:17.390 INFO:tasks.workunit.client.1.smithi192.stdout:0/140: mkdir d3/d6/d2c 0 2024-09-21T12:20:17.393 INFO:tasks.workunit.client.1.smithi192.stdout:8/205: dwrite d14/d1a/f25 [0,4194304] 0 2024-09-21T12:20:17.393 INFO:tasks.workunit.client.1.smithi192.stdout:7/139: rename d6/d9/d1e to d6/d9/d2d/d36 0 2024-09-21T12:20:17.393 INFO:tasks.workunit.client.1.smithi192.stdout:0/141: chown d3/d5/f14 2 1 2024-09-21T12:20:17.395 INFO:tasks.workunit.client.1.smithi192.stdout:6/100: dwrite da/f16 [0,4194304] 0 2024-09-21T12:20:17.396 INFO:tasks.workunit.client.1.smithi192.stdout:6/101: stat da/d18/c1b 0 2024-09-21T12:20:17.396 INFO:tasks.workunit.client.1.smithi192.stdout:7/140: chown d6/d9/d2d/d36/f32 13 1 2024-09-21T12:20:17.396 INFO:tasks.workunit.client.1.smithi192.stdout:0/142: write d3/de/f11 [3502495,5963] 0 2024-09-21T12:20:17.397 INFO:tasks.workunit.client.1.smithi192.stdout:4/121: mkdir d2/d21 0 2024-09-21T12:20:17.398 INFO:tasks.workunit.client.1.smithi192.stdout:0/143: chown d3/d5 59 1 2024-09-21T12:20:17.399 INFO:tasks.workunit.client.1.smithi192.stdout:1/179: truncate d2/d12/f1a 2347118 0 2024-09-21T12:20:17.400 INFO:tasks.workunit.client.1.smithi192.stdout:0/144: dread - d3/d5/d19/d2a/f2b zero size 2024-09-21T12:20:17.401 INFO:tasks.workunit.client.1.smithi192.stdout:2/142: write f19 [3750435,81284] 0 2024-09-21T12:20:17.405 INFO:tasks.workunit.client.1.smithi192.stdout:7/141: dwrite f0 [4194304,4194304] 0 2024-09-21T12:20:17.408 INFO:tasks.workunit.client.1.smithi192.stdout:9/100: write d5/f7 [1642952,50421] 0 2024-09-21T12:20:17.410 INFO:tasks.workunit.client.1.smithi192.stdout:2/143: dread ff [0,4194304] 0 2024-09-21T12:20:17.414 INFO:tasks.workunit.client.1.smithi192.stdout:1/180: symlink d2/d12/l3a 0 2024-09-21T12:20:17.416 INFO:tasks.workunit.client.1.smithi192.stdout:0/145: symlink d3/d6/d1d/l2d 0 2024-09-21T12:20:17.417 INFO:tasks.workunit.client.1.smithi192.stdout:5/306: link d0/dc/d13/c5f d0/de/c63 0 2024-09-21T12:20:17.418 INFO:tasks.workunit.client.1.smithi192.stdout:7/142: creat d6/d9/d1f/f37 x:0 0 0 2024-09-21T12:20:17.420 INFO:tasks.workunit.client.1.smithi192.stdout:2/144: dwrite f19 [0,4194304] 0 2024-09-21T12:20:17.420 INFO:tasks.workunit.client.1.smithi192.stdout:5/307: dread - d0/d1a/d36/f46 zero size 2024-09-21T12:20:17.421 INFO:tasks.workunit.client.1.smithi192.stdout:0/146: dread d3/fa [0,4194304] 0 2024-09-21T12:20:17.423 INFO:tasks.workunit.client.1.smithi192.stdout:6/102: getdents da/d18 0 2024-09-21T12:20:17.428 INFO:tasks.workunit.client.1.smithi192.stdout:6/103: mkdir da/d1f 0 2024-09-21T12:20:17.429 INFO:tasks.workunit.client.1.smithi192.stdout:9/101: truncate d5/d8/d11/d13/f14 754663 0 2024-09-21T12:20:17.430 INFO:tasks.workunit.client.1.smithi192.stdout:1/181: dwrite d2/de/f11 [0,4194304] 0 2024-09-21T12:20:17.430 INFO:tasks.workunit.client.1.smithi192.stdout:0/147: mknod d3/d6/d1d/c2e 0 2024-09-21T12:20:17.432 INFO:tasks.workunit.client.1.smithi192.stdout:9/102: write d5/f16 [838431,72428] 0 2024-09-21T12:20:17.432 INFO:tasks.workunit.client.1.smithi192.stdout:0/148: chown d3/cc 3 1 2024-09-21T12:20:17.437 INFO:tasks.workunit.client.1.smithi192.stdout:2/145: dread fe [0,4194304] 0 2024-09-21T12:20:17.438 INFO:tasks.workunit.client.1.smithi192.stdout:4/122: dwrite d2/db/f16 [0,4194304] 0 2024-09-21T12:20:17.440 INFO:tasks.workunit.client.1.smithi192.stdout:8/206: truncate d14/d1a/d1d/f38 1165700 0 2024-09-21T12:20:17.441 INFO:tasks.workunit.client.1.smithi192.stdout:0/149: dread d3/de/f24 [0,4194304] 0 2024-09-21T12:20:17.442 INFO:tasks.workunit.client.1.smithi192.stdout:9/103: symlink d5/d8/d11/d13/l20 0 2024-09-21T12:20:17.445 INFO:tasks.workunit.client.1.smithi192.stdout:2/146: write d1b/f24 [1489354,56583] 0 2024-09-21T12:20:17.446 INFO:tasks.workunit.client.1.smithi192.stdout:1/182: getdents d2/da 0 2024-09-21T12:20:17.446 INFO:tasks.workunit.client.1.smithi192.stdout:6/104: truncate f8 3143873 0 2024-09-21T12:20:17.449 INFO:tasks.workunit.client.1.smithi192.stdout:8/207: rename d14/d1a/d1d/d20/f34 to d14/f3f 0 2024-09-21T12:20:17.449 INFO:tasks.workunit.client.1.smithi192.stdout:2/147: truncate f14 5644749 0 2024-09-21T12:20:17.451 INFO:tasks.workunit.client.1.smithi192.stdout:1/183: symlink d2/d12/d2f/l3b 0 2024-09-21T12:20:17.452 INFO:tasks.workunit.client.1.smithi192.stdout:5/308: dwrite d0/f3b [0,4194304] 0 2024-09-21T12:20:17.453 INFO:tasks.workunit.client.1.smithi192.stdout:0/150: rename d3/d5/c23 to d3/de/c2f 0 2024-09-21T12:20:17.454 INFO:tasks.workunit.client.1.smithi192.stdout:1/184: write d2/da/d1f/f2d [2574862,54524] 0 2024-09-21T12:20:17.458 INFO:tasks.workunit.client.1.smithi192.stdout:1/185: creat d2/d12/f3c x:0 0 0 2024-09-21T12:20:17.461 INFO:tasks.workunit.client.1.smithi192.stdout:1/186: dread - d2/da/d1f/f37 zero size 2024-09-21T12:20:17.461 INFO:tasks.workunit.client.1.smithi192.stdout:8/208: dread fc [0,4194304] 0 2024-09-21T12:20:17.513 INFO:tasks.workunit.client.1.smithi192.stdout:3/131: sync 2024-09-21T12:20:17.525 INFO:tasks.workunit.client.1.smithi192.stdout:5/309: dwrite d0/de/f2a [0,4194304] 0 2024-09-21T12:20:17.526 INFO:tasks.workunit.client.1.smithi192.stdout:2/148: write f7 [4227173,33930] 0 2024-09-21T12:20:17.528 INFO:tasks.workunit.client.1.smithi192.stdout:1/187: symlink d2/l3d 0 2024-09-21T12:20:17.530 INFO:tasks.workunit.client.1.smithi192.stdout:5/310: chown d0/d1a/f34 1 1 2024-09-21T12:20:17.530 INFO:tasks.workunit.client.1.smithi192.stdout:6/105: write f8 [1925427,67283] 0 2024-09-21T12:20:17.532 INFO:tasks.workunit.client.1.smithi192.stdout:2/149: symlink d1b/d1e/l29 0 2024-09-21T12:20:17.534 INFO:tasks.workunit.client.1.smithi192.stdout:4/123: dwrite d2/fa [4194304,4194304] 0 2024-09-21T12:20:17.535 INFO:tasks.workunit.client.1.smithi192.stdout:3/132: rename db/c1c to db/d16/d18/d21/c31 0 2024-09-21T12:20:17.536 INFO:tasks.workunit.client.1.smithi192.stdout:3/133: write db/d16/f2c [236120,56847] 0 2024-09-21T12:20:17.538 INFO:tasks.workunit.client.1.smithi192.stdout:6/106: creat da/f20 x:0 0 0 2024-09-21T12:20:17.542 INFO:tasks.workunit.client.1.smithi192.stdout:4/124: rmdir d2/db 39 2024-09-21T12:20:17.545 INFO:tasks.workunit.client.1.smithi192.stdout:5/311: fdatasync d0/d1a/f32 0 2024-09-21T12:20:17.546 INFO:tasks.workunit.client.1.smithi192.stdout:6/107: dwrite f8 [0,4194304] 0 2024-09-21T12:20:17.546 INFO:tasks.workunit.client.1.smithi192.stdout:9/104: dread f2 [0,4194304] 0 2024-09-21T12:20:17.548 INFO:tasks.workunit.client.1.smithi192.stdout:3/134: rename db/d16/d18/d21/d23/c30 to db/d16/d18/d2d/c32 0 2024-09-21T12:20:17.550 INFO:tasks.workunit.client.1.smithi192.stdout:1/188: link d2/da/d1f/f2d d2/f3e 0 2024-09-21T12:20:17.553 INFO:tasks.workunit.client.1.smithi192.stdout:1/189: read - d2/da/d1f/d24/f35 zero size 2024-09-21T12:20:17.556 INFO:tasks.workunit.client.1.smithi192.stdout:9/105: rmdir d5/d19 39 2024-09-21T12:20:17.557 INFO:tasks.workunit.client.1.smithi192.stdout:8/209: dwrite ff [0,4194304] 0 2024-09-21T12:20:17.558 INFO:tasks.workunit.client.1.smithi192.stdout:3/135: chown db/l1d 2039530 1 2024-09-21T12:20:17.561 INFO:tasks.workunit.client.1.smithi192.stdout:5/312: rename d0/de/d35/l58 to d0/de/d45/l64 0 2024-09-21T12:20:17.562 INFO:tasks.workunit.client.1.smithi192.stdout:5/313: chown d0/dc/f61 57139 1 2024-09-21T12:20:17.565 INFO:tasks.workunit.client.1.smithi192.stdout:4/125: mknod d2/db/c22 0 2024-09-21T12:20:17.568 INFO:tasks.workunit.client.1.smithi192.stdout:8/210: dread d14/d18/f22 [0,4194304] 0 2024-09-21T12:20:17.570 INFO:tasks.workunit.client.1.smithi192.stdout:8/211: dread - d14/d1a/d1d/d39/f3e zero size 2024-09-21T12:20:17.571 INFO:tasks.workunit.client.1.smithi192.stdout:9/106: mkdir d5/d21 0 2024-09-21T12:20:17.571 INFO:tasks.workunit.client.1.smithi192.stdout:2/150: dread d1b/d1e/f20 [0,4194304] 0 2024-09-21T12:20:17.571 INFO:tasks.workunit.client.1.smithi192.stdout:8/212: stat d14/d1a/d1d/d39/f3d 0 2024-09-21T12:20:17.572 INFO:tasks.workunit.client.1.smithi192.stdout:4/126: unlink d2/db/f1b 0 2024-09-21T12:20:17.573 INFO:tasks.workunit.client.1.smithi192.stdout:5/314: mkdir d0/d65 0 2024-09-21T12:20:17.574 INFO:tasks.workunit.client.1.smithi192.stdout:5/315: dread - d0/dc/d13/d37/f56 zero size 2024-09-21T12:20:17.575 INFO:tasks.workunit.client.1.smithi192.stdout:9/107: read d5/d19/f1b [226256,116439] 0 2024-09-21T12:20:17.579 INFO:tasks.workunit.client.1.smithi192.stdout:5/316: stat d0/de/c11 0 2024-09-21T12:20:17.589 INFO:tasks.workunit.client.1.smithi192.stdout:2/151: creat d1b/f2a x:0 0 0 2024-09-21T12:20:17.589 INFO:tasks.workunit.client.1.smithi192.stdout:3/136: truncate f8 2213621 0 2024-09-21T12:20:17.591 INFO:tasks.workunit.client.1.smithi192.stdout:8/213: write fc [4714121,112342] 0 2024-09-21T12:20:17.591 INFO:tasks.workunit.client.1.smithi192.stdout:1/190: dwrite d2/d12/f1a [0,4194304] 0 2024-09-21T12:20:17.594 INFO:tasks.workunit.client.1.smithi192.stdout:4/127: truncate d2/db/f16 4725173 0 2024-09-21T12:20:17.594 INFO:tasks.workunit.client.1.smithi192.stdout:2/152: dread d1b/f1d [0,4194304] 0 2024-09-21T12:20:17.596 INFO:tasks.workunit.client.1.smithi192.stdout:1/191: mknod d2/da/d1f/d24/c3f 0 2024-09-21T12:20:17.597 INFO:tasks.workunit.client.1.smithi192.stdout:4/128: rmdir d2/db/d1a 39 2024-09-21T12:20:17.597 INFO:tasks.workunit.client.1.smithi192.stdout:5/317: write d0/f28 [889206,59107] 0 2024-09-21T12:20:17.607 INFO:tasks.workunit.client.1.smithi192.stdout:7/143: sync 2024-09-21T12:20:17.613 INFO:tasks.workunit.client.1.smithi192.stdout:9/108: truncate d5/f7 506430 0 2024-09-21T12:20:17.614 INFO:tasks.workunit.client.1.smithi192.stdout:8/214: write d14/d18/f22 [1239239,61188] 0 2024-09-21T12:20:17.619 INFO:tasks.workunit.client.1.smithi192.stdout:5/318: symlink d0/de/d45/l66 0 2024-09-21T12:20:17.621 INFO:tasks.workunit.client.1.smithi192.stdout:8/215: mknod d14/d1a/d1d/d39/c40 0 2024-09-21T12:20:17.622 INFO:tasks.workunit.client.1.smithi192.stdout:2/153: dwrite d1b/f23 [0,4194304] 0 2024-09-21T12:20:17.624 INFO:tasks.workunit.client.1.smithi192.stdout:8/216: chown d14/d1a/d1d/d20 269 1 2024-09-21T12:20:17.624 INFO:tasks.workunit.client.1.smithi192.stdout:4/129: creat d2/f23 x:0 0 0 2024-09-21T12:20:17.625 INFO:tasks.workunit.client.1.smithi192.stdout:1/192: dwrite d2/d12/f3c [0,4194304] 0 2024-09-21T12:20:17.626 INFO:tasks.workunit.client.1.smithi192.stdout:9/109: dread f2 [4194304,4194304] 0 2024-09-21T12:20:17.627 INFO:tasks.workunit.client.1.smithi192.stdout:8/217: write d14/d18/f32 [627938,38500] 0 2024-09-21T12:20:17.627 INFO:tasks.workunit.client.1.smithi192.stdout:7/144: rename d6/d9/f13 to d6/f38 0 2024-09-21T12:20:17.628 INFO:tasks.workunit.client.1.smithi192.stdout:1/193: chown d2/de/l29 75885408 1 2024-09-21T12:20:17.630 INFO:tasks.workunit.client.1.smithi192.stdout:5/319: creat d0/d65/f67 x:0 0 0 2024-09-21T12:20:17.633 INFO:tasks.workunit.client.1.smithi192.stdout:4/130: chown d2/c13 4 1 2024-09-21T12:20:17.633 INFO:tasks.workunit.client.1.smithi192.stdout:8/218: write d14/d18/f33 [508464,93779] 0 2024-09-21T12:20:17.635 INFO:tasks.workunit.client.1.smithi192.stdout:7/145: dread d6/f15 [0,4194304] 0 2024-09-21T12:20:17.639 INFO:tasks.workunit.client.1.smithi192.stdout:5/320: mkdir d0/d42/d68 0 2024-09-21T12:20:17.640 INFO:tasks.workunit.client.1.smithi192.stdout:5/321: readlink d0/dc/l60 0 2024-09-21T12:20:17.640 INFO:tasks.workunit.client.1.smithi192.stdout:8/219: mknod d14/d1a/c41 0 2024-09-21T12:20:17.641 INFO:tasks.workunit.client.1.smithi192.stdout:7/146: symlink d6/d9/d2d/l39 0 2024-09-21T12:20:17.641 INFO:tasks.workunit.client.1.smithi192.stdout:4/131: unlink d2/l4 0 2024-09-21T12:20:17.642 INFO:tasks.workunit.client.1.smithi192.stdout:2/154: rename lc to d1b/l2b 0 2024-09-21T12:20:17.643 INFO:tasks.workunit.client.1.smithi192.stdout:8/220: unlink d14/d1a/c2d 0 2024-09-21T12:20:17.645 INFO:tasks.workunit.client.1.smithi192.stdout:5/322: unlink d0/de/d45/f4f 0 2024-09-21T12:20:17.646 INFO:tasks.workunit.client.1.smithi192.stdout:5/323: fdatasync d0/d2/f14 0 2024-09-21T12:20:17.647 INFO:tasks.workunit.client.1.smithi192.stdout:9/110: dread d5/f7 [0,4194304] 0 2024-09-21T12:20:17.649 INFO:tasks.workunit.client.1.smithi192.stdout:2/155: unlink f2 0 2024-09-21T12:20:17.649 INFO:tasks.workunit.client.1.smithi192.stdout:5/324: write d0/de/d45/f31 [1160125,62052] 0 2024-09-21T12:20:17.651 INFO:tasks.workunit.client.1.smithi192.stdout:1/194: write d2/f14 [1151050,12410] 0 2024-09-21T12:20:17.653 INFO:tasks.workunit.client.1.smithi192.stdout:8/221: dwrite d14/d18/f33 [0,4194304] 0 2024-09-21T12:20:17.653 INFO:tasks.workunit.client.1.smithi192.stdout:4/132: mkdir d2/db/d24 0 2024-09-21T12:20:17.656 INFO:tasks.workunit.client.1.smithi192.stdout:5/325: dread d0/f8 [0,4194304] 0 2024-09-21T12:20:17.657 INFO:tasks.workunit.client.1.smithi192.stdout:5/326: fsync d0/d2/f43 0 2024-09-21T12:20:17.658 INFO:tasks.workunit.client.1.smithi192.stdout:2/156: creat d1b/d1e/f2c x:0 0 0 2024-09-21T12:20:17.659 INFO:tasks.workunit.client.1.smithi192.stdout:7/147: rmdir d6/d9/d29 0 2024-09-21T12:20:17.659 INFO:tasks.workunit.client.1.smithi192.stdout:5/327: write d0/f28 [1180114,108640] 0 2024-09-21T12:20:17.660 INFO:tasks.workunit.client.1.smithi192.stdout:7/148: chown d6/d9/l18 37623746 1 2024-09-21T12:20:17.660 INFO:tasks.workunit.client.1.smithi192.stdout:7/149: stat d6/d9/l18 0 2024-09-21T12:20:17.662 INFO:tasks.workunit.client.1.smithi192.stdout:8/222: mknod d14/d18/c42 0 2024-09-21T12:20:17.666 INFO:tasks.workunit.client.1.smithi192.stdout:2/157: creat d1b/d1e/f2d x:0 0 0 2024-09-21T12:20:17.666 INFO:tasks.workunit.client.1.smithi192.stdout:2/158: readlink d1b/l22 0 2024-09-21T12:20:17.667 INFO:tasks.workunit.client.1.smithi192.stdout:5/328: creat d0/d42/f69 x:0 0 0 2024-09-21T12:20:17.670 INFO:tasks.workunit.client.1.smithi192.stdout:9/111: creat d5/d8/f22 x:0 0 0 2024-09-21T12:20:17.671 INFO:tasks.workunit.client.1.smithi192.stdout:9/112: dread d5/f7 [0,4194304] 0 2024-09-21T12:20:17.677 INFO:tasks.workunit.client.1.smithi192.stdout:7/150: mkdir d6/d3a 0 2024-09-21T12:20:17.678 INFO:tasks.workunit.client.1.smithi192.stdout:7/151: truncate d6/d9/d1f/f21 578489 0 2024-09-21T12:20:17.680 INFO:tasks.workunit.client.1.smithi192.stdout:7/152: dread d6/f38 [0,4194304] 0 2024-09-21T12:20:17.682 INFO:tasks.workunit.client.1.smithi192.stdout:5/329: creat d0/f6a x:0 0 0 2024-09-21T12:20:17.684 INFO:tasks.workunit.client.1.smithi192.stdout:5/330: write d0/d1a/d36/f46 [462548,2398] 0 2024-09-21T12:20:17.685 INFO:tasks.workunit.client.1.smithi192.stdout:7/153: dread f0 [4194304,4194304] 0 2024-09-21T12:20:17.685 INFO:tasks.workunit.client.1.smithi192.stdout:9/113: rename d5/d8/d11/d13 to d5/d23 0 2024-09-21T12:20:17.686 INFO:tasks.workunit.client.1.smithi192.stdout:5/331: readlink d0/dc/d13/d37/l3a 0 2024-09-21T12:20:17.686 INFO:tasks.workunit.client.1.smithi192.stdout:1/195: write d2/da/d1f/f22 [3709204,18233] 0 2024-09-21T12:20:17.687 INFO:tasks.workunit.client.1.smithi192.stdout:7/154: fdatasync d6/d9/f11 0 2024-09-21T12:20:17.689 INFO:tasks.workunit.client.1.smithi192.stdout:7/155: write d6/d9/d1f/f21 [446994,17585] 0 2024-09-21T12:20:17.690 INFO:tasks.workunit.client.1.smithi192.stdout:5/332: fsync d0/de/d45/f49 0 2024-09-21T12:20:17.691 INFO:tasks.workunit.client.1.smithi192.stdout:5/333: write d0/de/d45/f31 [771175,92741] 0 2024-09-21T12:20:17.692 INFO:tasks.workunit.client.1.smithi192.stdout:9/114: dread d5/dc/f18 [0,4194304] 0 2024-09-21T12:20:17.696 INFO:tasks.workunit.client.1.smithi192.stdout:4/133: write d2/db/f16 [202028,5177] 0 2024-09-21T12:20:17.698 INFO:tasks.workunit.client.1.smithi192.stdout:9/115: rename d5/l10 to d5/d19/l24 0 2024-09-21T12:20:17.698 INFO:tasks.workunit.client.1.smithi192.stdout:0/151: sync 2024-09-21T12:20:17.698 INFO:tasks.workunit.client.1.smithi192.stdout:6/108: sync 2024-09-21T12:20:17.699 INFO:tasks.workunit.client.1.smithi192.stdout:8/223: write fd [3795137,59815] 0 2024-09-21T12:20:17.699 INFO:tasks.workunit.client.1.smithi192.stdout:1/196: dread d2/da/fc [0,4194304] 0 2024-09-21T12:20:17.699 INFO:tasks.workunit.client.1.smithi192.stdout:9/116: stat d5/fb 0 2024-09-21T12:20:17.700 INFO:tasks.workunit.client.1.smithi192.stdout:6/109: fsync da/f16 0 2024-09-21T12:20:17.700 INFO:tasks.workunit.client.1.smithi192.stdout:1/197: readlink d2/d12/d2f/l33 0 2024-09-21T12:20:17.700 INFO:tasks.workunit.client.1.smithi192.stdout:9/117: read - d5/dc/d1e/f1f zero size 2024-09-21T12:20:17.701 INFO:tasks.workunit.client.1.smithi192.stdout:4/134: chown d2/d19 53301 1 2024-09-21T12:20:17.702 INFO:tasks.workunit.client.1.smithi192.stdout:9/118: stat d5/d23 0 2024-09-21T12:20:17.707 INFO:tasks.workunit.client.1.smithi192.stdout:6/110: dwrite da/f16 [0,4194304] 0 2024-09-21T12:20:17.707 INFO:tasks.workunit.client.1.smithi192.stdout:7/156: write d6/ff [356552,34383] 0 2024-09-21T12:20:17.709 INFO:tasks.workunit.client.1.smithi192.stdout:9/119: creat d5/d23/f25 x:0 0 0 2024-09-21T12:20:17.710 INFO:tasks.workunit.client.1.smithi192.stdout:5/334: getdents d0/d65 0 2024-09-21T12:20:17.713 INFO:tasks.workunit.client.1.smithi192.stdout:8/224: creat d14/f43 x:0 0 0 2024-09-21T12:20:17.714 INFO:tasks.workunit.client.1.smithi192.stdout:8/225: write d14/d18/f33 [2960313,4607] 0 2024-09-21T12:20:17.715 INFO:tasks.workunit.client.1.smithi192.stdout:4/135: creat d2/d19/f25 x:0 0 0 2024-09-21T12:20:17.715 INFO:tasks.workunit.client.1.smithi192.stdout:8/226: fdatasync d14/d1a/f3b 0 2024-09-21T12:20:17.717 INFO:tasks.workunit.client.1.smithi192.stdout:9/120: symlink d5/dc/d1e/l26 0 2024-09-21T12:20:17.717 INFO:tasks.workunit.client.1.smithi192.stdout:1/198: write d2/da/d1f/f2d [2586642,47082] 0 2024-09-21T12:20:17.719 INFO:tasks.workunit.client.1.smithi192.stdout:7/157: rename d6/d9/d2d/d36/f33 to d6/d20/f3b 0 2024-09-21T12:20:17.720 INFO:tasks.workunit.client.1.smithi192.stdout:5/335: fdatasync d0/dc/d13/d37/d38/f4c 0 2024-09-21T12:20:17.722 INFO:tasks.workunit.client.1.smithi192.stdout:7/158: write d6/d9/f1c [2795048,1506] 0 2024-09-21T12:20:17.724 INFO:tasks.workunit.client.1.smithi192.stdout:8/227: creat d14/d1a/d1d/d20/f44 x:0 0 0 2024-09-21T12:20:17.724 INFO:tasks.workunit.client.1.smithi192.stdout:9/121: fdatasync d5/d8/ff 0 2024-09-21T12:20:17.725 INFO:tasks.workunit.client.1.smithi192.stdout:4/136: dwrite d2/d19/f25 [0,4194304] 0 2024-09-21T12:20:17.727 INFO:tasks.workunit.client.1.smithi192.stdout:1/199: rename d2/d12/f1a to d2/d12/d2f/f40 0 2024-09-21T12:20:17.728 INFO:tasks.workunit.client.1.smithi192.stdout:5/336: write d0/f10 [2652463,121960] 0 2024-09-21T12:20:17.732 INFO:tasks.workunit.client.1.smithi192.stdout:7/159: creat d6/d20/f3c x:0 0 0 2024-09-21T12:20:17.733 INFO:tasks.workunit.client.1.smithi192.stdout:7/160: fdatasync d6/d9/f14 0 2024-09-21T12:20:17.740 INFO:tasks.workunit.client.1.smithi192.stdout:1/200: mkdir d2/d12/d2f/d41 0 2024-09-21T12:20:17.741 INFO:tasks.workunit.client.1.smithi192.stdout:1/201: read - d2/da/f27 zero size 2024-09-21T12:20:17.746 INFO:tasks.workunit.client.1.smithi192.stdout:4/137: dwrite d2/f20 [0,4194304] 0 2024-09-21T12:20:17.748 INFO:tasks.workunit.client.1.smithi192.stdout:4/138: write d2/d19/f25 [2744839,9062] 0 2024-09-21T12:20:17.756 INFO:tasks.workunit.client.1.smithi192.stdout:1/202: dwrite d2/da/f27 [0,4194304] 0 2024-09-21T12:20:17.758 INFO:tasks.workunit.client.1.smithi192.stdout:9/122: dread d5/fa [0,4194304] 0 2024-09-21T12:20:17.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:17 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:20:17.758 INFO:tasks.workunit.client.1.smithi192.stdout:9/123: read d5/fb [117356,75102] 0 2024-09-21T12:20:17.758 INFO:tasks.workunit.client.1.smithi192.stdout:9/124: readlink d5/l9 0 2024-09-21T12:20:17.759 INFO:tasks.workunit.client.1.smithi192.stdout:7/161: symlink d6/d3a/l3d 0 2024-09-21T12:20:17.761 INFO:tasks.workunit.client.1.smithi192.stdout:4/139: fsync d2/db/d1a/f1c 0 2024-09-21T12:20:17.763 INFO:tasks.workunit.client.1.smithi192.stdout:4/140: read d2/f20 [1058404,117729] 0 2024-09-21T12:20:17.763 INFO:tasks.workunit.client.1.smithi192.stdout:8/228: getdents d14 0 2024-09-21T12:20:17.764 INFO:tasks.workunit.client.1.smithi192.stdout:1/203: symlink d2/d12/l42 0 2024-09-21T12:20:17.766 INFO:tasks.workunit.client.1.smithi192.stdout:7/162: fsync d6/d9/f17 0 2024-09-21T12:20:17.768 INFO:tasks.workunit.client.1.smithi192.stdout:7/163: read d6/d9/f11 [125263,108382] 0 2024-09-21T12:20:17.770 INFO:tasks.workunit.client.1.smithi192.stdout:8/229: rename d14/d18/c29 to d14/d1a/d1d/d20/c45 0 2024-09-21T12:20:17.774 INFO:tasks.workunit.client.1.smithi192.stdout:7/164: dread d6/d9/d2d/d36/f23 [0,4194304] 0 2024-09-21T12:20:17.775 INFO:tasks.workunit.client.1.smithi192.stdout:4/141: creat d2/db/f26 x:0 0 0 2024-09-21T12:20:17.776 INFO:tasks.workunit.client.1.smithi192.stdout:9/125: link d5/d19/l24 d5/dc/l27 0 2024-09-21T12:20:17.777 INFO:tasks.workunit.client.1.smithi192.stdout:5/337: creat d0/d2/f6b x:0 0 0 2024-09-21T12:20:17.778 INFO:tasks.workunit.client.1.smithi192.stdout:5/338: fdatasync d0/dc/f61 0 2024-09-21T12:20:17.778 INFO:tasks.workunit.client.1.smithi192.stdout:8/230: mkdir d14/d1a/d1d/d46 0 2024-09-21T12:20:17.779 INFO:tasks.workunit.client.1.smithi192.stdout:7/165: mkdir d6/d9/d1f/d3e 0 2024-09-21T12:20:17.783 INFO:tasks.workunit.client.1.smithi192.stdout:8/231: creat d14/d1a/d1d/d20/f47 x:0 0 0 2024-09-21T12:20:17.785 INFO:tasks.workunit.client.1.smithi192.stdout:7/166: creat d6/d3a/f3f x:0 0 0 2024-09-21T12:20:17.788 INFO:tasks.workunit.client.1.smithi192.stdout:8/232: mkdir d14/d1a/d1d/d48 0 2024-09-21T12:20:17.791 INFO:tasks.workunit.client.1.smithi192.stdout:4/142: creat d2/db/f27 x:0 0 0 2024-09-21T12:20:17.792 INFO:tasks.workunit.client.1.smithi192.stdout:8/233: dread ff [0,4194304] 0 2024-09-21T12:20:17.792 INFO:tasks.workunit.client.1.smithi192.stdout:8/234: fdatasync fc 0 2024-09-21T12:20:17.795 INFO:tasks.workunit.client.1.smithi192.stdout:4/143: dread d2/fa [0,4194304] 0 2024-09-21T12:20:17.796 INFO:tasks.workunit.client.1.smithi192.stdout:7/167: link d6/d9/f14 d6/d20/f40 0 2024-09-21T12:20:17.796 INFO:tasks.workunit.client.1.smithi192.stdout:4/144: write d2/d19/f25 [1987182,96152] 0 2024-09-21T12:20:17.798 INFO:tasks.workunit.client.1.smithi192.stdout:4/145: dread - d2/db/f26 zero size 2024-09-21T12:20:17.800 INFO:tasks.workunit.client.1.smithi192.stdout:7/168: creat d6/d9/d2d/d36/f41 x:0 0 0 2024-09-21T12:20:17.801 INFO:tasks.workunit.client.1.smithi192.stdout:7/169: readlink d6/d9/l18 0 2024-09-21T12:20:17.801 INFO:tasks.workunit.client.1.smithi192.stdout:1/204: dwrite d2/da/fc [0,4194304] 0 2024-09-21T12:20:17.804 INFO:tasks.workunit.client.1.smithi192.stdout:1/205: mknod d2/d12/d2f/c43 0 2024-09-21T12:20:17.806 INFO:tasks.workunit.client.1.smithi192.stdout:1/206: write d2/d12/f2b [1134677,80671] 0 2024-09-21T12:20:17.817 INFO:tasks.workunit.client.1.smithi192.stdout:9/126: truncate d5/d23/f14 477152 0 2024-09-21T12:20:17.819 INFO:tasks.workunit.client.1.smithi192.stdout:4/146: getdents d2/db 0 2024-09-21T12:20:17.820 INFO:tasks.workunit.client.1.smithi192.stdout:5/339: dwrite d0/d1a/f32 [0,4194304] 0 2024-09-21T12:20:17.821 INFO:tasks.workunit.client.1.smithi192.stdout:9/127: write d5/fa [793386,102938] 0 2024-09-21T12:20:17.825 INFO:tasks.workunit.client.1.smithi192.stdout:3/137: sync 2024-09-21T12:20:17.826 INFO:tasks.workunit.client.1.smithi192.stdout:4/147: mkdir d2/db/d24/d28 0 2024-09-21T12:20:17.828 INFO:tasks.workunit.client.1.smithi192.stdout:8/235: truncate d14/d18/f33 3036171 0 2024-09-21T12:20:17.828 INFO:tasks.workunit.client.1.smithi192.stdout:9/128: dwrite d5/d8/f22 [0,4194304] 0 2024-09-21T12:20:17.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:17 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:20:17.838 INFO:tasks.workunit.client.1.smithi192.stdout:7/170: dwrite f3 [0,4194304] 0 2024-09-21T12:20:17.838 INFO:tasks.workunit.client.1.smithi192.stdout:5/340: creat d0/de/f6c x:0 0 0 2024-09-21T12:20:17.839 INFO:tasks.workunit.client.1.smithi192.stdout:8/236: rmdir d14/d1a/d1d/d20 39 2024-09-21T12:20:17.840 INFO:tasks.workunit.client.1.smithi192.stdout:5/341: write d0/dc/d13/f53 [2395830,42340] 0 2024-09-21T12:20:17.841 INFO:tasks.workunit.client.1.smithi192.stdout:9/129: mknod d5/dc/d1e/c28 0 2024-09-21T12:20:17.842 INFO:tasks.workunit.client.1.smithi192.stdout:9/130: dread - d5/d23/f25 zero size 2024-09-21T12:20:17.843 INFO:tasks.workunit.client.1.smithi192.stdout:4/148: creat d2/df/f29 x:0 0 0 2024-09-21T12:20:17.845 INFO:tasks.workunit.client.1.smithi192.stdout:1/207: dwrite d2/d12/f9 [0,4194304] 0 2024-09-21T12:20:17.852 INFO:tasks.workunit.client.1.smithi192.stdout:5/342: symlink d0/dc/d13/d37/l6d 0 2024-09-21T12:20:17.852 INFO:tasks.workunit.client.1.smithi192.stdout:4/149: dwrite d2/db/f26 [0,4194304] 0 2024-09-21T12:20:17.855 INFO:tasks.workunit.client.1.smithi192.stdout:1/208: mkdir d2/da/d44 0 2024-09-21T12:20:17.858 INFO:tasks.workunit.client.1.smithi192.stdout:3/138: rename db/d16/d18/d2d to db/d16/d18/d33 0 2024-09-21T12:20:17.859 INFO:tasks.workunit.client.1.smithi192.stdout:3/139: chown db 2 1 2024-09-21T12:20:17.861 INFO:tasks.workunit.client.1.smithi192.stdout:1/209: dwrite d2/de/f11 [0,4194304] 0 2024-09-21T12:20:17.870 INFO:tasks.workunit.client.1.smithi192.stdout:5/343: rename d0/d1a to d0/d65/d6e 0 2024-09-21T12:20:17.875 INFO:tasks.workunit.client.1.smithi192.stdout:9/131: creat d5/d8/f29 x:0 0 0 2024-09-21T12:20:17.878 INFO:tasks.workunit.client.1.smithi192.stdout:8/237: dwrite fa [0,4194304] 0 2024-09-21T12:20:17.878 INFO:tasks.workunit.client.1.smithi192.stdout:8/238: fsync d14/d1a/d1d/f2f 0 2024-09-21T12:20:17.879 INFO:tasks.workunit.client.1.smithi192.stdout:8/239: fsync fd 0 2024-09-21T12:20:17.880 INFO:tasks.workunit.client.1.smithi192.stdout:5/344: creat d0/dc/f6f x:0 0 0 2024-09-21T12:20:17.883 INFO:tasks.workunit.client.1.smithi192.stdout:1/210: getdents d2/d12/d2f/d41 0 2024-09-21T12:20:17.887 INFO:tasks.workunit.client.1.smithi192.stdout:4/150: rename d2/c13 to d2/c2a 0 2024-09-21T12:20:17.889 INFO:tasks.workunit.client.1.smithi192.stdout:1/211: dwrite d2/da/d1f/f37 [0,4194304] 0 2024-09-21T12:20:17.893 INFO:tasks.workunit.client.1.smithi192.stdout:5/345: rmdir d0/de 39 2024-09-21T12:20:17.903 INFO:tasks.workunit.client.1.smithi192.stdout:4/151: creat d2/db/d1a/f2b x:0 0 0 2024-09-21T12:20:17.904 INFO:tasks.workunit.client.1.smithi192.stdout:3/140: write f8 [2211900,62791] 0 2024-09-21T12:20:17.907 INFO:tasks.workunit.client.1.smithi192.stdout:1/212: unlink d2/f14 0 2024-09-21T12:20:17.909 INFO:tasks.workunit.client.1.smithi192.stdout:4/152: dwrite d2/db/f26 [0,4194304] 0 2024-09-21T12:20:17.910 INFO:tasks.workunit.client.1.smithi192.stdout:5/346: read - d0/de/d35/f54 zero size 2024-09-21T12:20:17.911 INFO:tasks.workunit.client.1.smithi192.stdout:9/132: link d5/d8/f15 d5/dc/d1e/f2a 0 2024-09-21T12:20:17.916 INFO:tasks.workunit.client.1.smithi192.stdout:4/153: dwrite d2/d19/f25 [0,4194304] 0 2024-09-21T12:20:17.917 INFO:tasks.workunit.client.1.smithi192.stdout:5/347: dwrite d0/d2/f14 [0,4194304] 0 2024-09-21T12:20:17.920 INFO:tasks.workunit.client.1.smithi192.stdout:8/240: creat d14/d1a/d1d/f49 x:0 0 0 2024-09-21T12:20:17.923 INFO:tasks.workunit.client.1.smithi192.stdout:9/133: unlink d5/dc/d1e/f1f 0 2024-09-21T12:20:17.926 INFO:tasks.workunit.client.1.smithi192.stdout:1/213: mkdir d2/d45 0 2024-09-21T12:20:17.927 INFO:tasks.workunit.client.1.smithi192.stdout:1/214: fsync d2/da/fc 0 2024-09-21T12:20:17.930 INFO:tasks.workunit.client.1.smithi192.stdout:4/154: creat d2/db/d24/f2c x:0 0 0 2024-09-21T12:20:17.934 INFO:tasks.workunit.client.1.smithi192.stdout:8/241: fdatasync d14/d1a/d1d/d20/f44 0 2024-09-21T12:20:17.936 INFO:tasks.workunit.client.1.smithi192.stdout:9/134: unlink d5/f16 0 2024-09-21T12:20:17.939 INFO:tasks.workunit.client.1.smithi192.stdout:1/215: write d2/d12/d2f/f40 [4326602,27498] 0 2024-09-21T12:20:17.942 INFO:tasks.workunit.client.1.smithi192.stdout:4/155: creat d2/d19/f2d x:0 0 0 2024-09-21T12:20:17.944 INFO:tasks.workunit.client.1.smithi192.stdout:5/348: mkdir d0/d70 0 2024-09-21T12:20:17.945 INFO:tasks.workunit.client.1.smithi192.stdout:8/242: rmdir d14/d1a 39 2024-09-21T12:20:17.952 INFO:tasks.workunit.client.1.smithi192.stdout:5/349: creat d0/dc/d13/d37/f71 x:0 0 0 2024-09-21T12:20:17.953 INFO:tasks.workunit.client.1.smithi192.stdout:5/350: fsync d0/dc/d13/d37/d38/f4c 0 2024-09-21T12:20:17.955 INFO:tasks.workunit.client.1.smithi192.stdout:9/135: symlink d5/l2b 0 2024-09-21T12:20:17.956 INFO:tasks.workunit.client.1.smithi192.stdout:5/351: dread d0/f10 [0,4194304] 0 2024-09-21T12:20:17.957 INFO:tasks.workunit.client.1.smithi192.stdout:5/352: fdatasync d0/dc/f22 0 2024-09-21T12:20:17.958 INFO:tasks.workunit.client.1.smithi192.stdout:5/353: write d0/d2/f43 [3300368,99541] 0 2024-09-21T12:20:17.958 INFO:tasks.workunit.client.1.smithi192.stdout:4/156: creat d2/d21/f2e x:0 0 0 2024-09-21T12:20:17.959 INFO:tasks.workunit.client.1.smithi192.stdout:8/243: write d14/d1a/d1d/f49 [620277,14845] 0 2024-09-21T12:20:17.963 INFO:tasks.workunit.client.1.smithi192.stdout:1/216: write d2/d12/f2e [768001,82720] 0 2024-09-21T12:20:17.965 INFO:tasks.workunit.client.1.smithi192.stdout:8/244: dread f11 [0,4194304] 0 2024-09-21T12:20:17.966 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:17.963+0000 7f6085e43640 1 -- 172.21.15.3:0/3079246759 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6080101a60 msgr2=0x7f6080101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:17.966 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:17.963+0000 7f6085e43640 1 --2- 172.21.15.3:0/3079246759 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6080101a60 0x7f6080101ee0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f6074009880 tx=0x7f607402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:20:17.966 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:17.964+0000 7f6085e43640 1 -- 172.21.15.3:0/3079246759 shutdown_connections 2024-09-21T12:20:17.966 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:17.964+0000 7f6085e43640 1 --2- 172.21.15.3:0/3079246759 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6080101a60 0x7f6080101ee0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:17.966 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:17.964+0000 7f6085e43640 1 --2- 172.21.15.3:0/3079246759 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6080100860 0x7f6080100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:17.966 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:17.964+0000 7f6085e43640 1 -- 172.21.15.3:0/3079246759 >> 172.21.15.3:0/3079246759 conn(0x7f60800fc010 msgr2=0x7f60800fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:20:17.966 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:17.964+0000 7f6085e43640 1 -- 172.21.15.3:0/3079246759 shutdown_connections 2024-09-21T12:20:17.966 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:17.964+0000 7f6085e43640 1 -- 172.21.15.3:0/3079246759 wait complete. 2024-09-21T12:20:17.968 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:17.965+0000 7f6085e43640 1 Processor -- start 2024-09-21T12:20:17.968 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:17.965+0000 7f6085e43640 1 -- start start 2024-09-21T12:20:17.968 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:17.965+0000 7f6085e43640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6080100860 0x7f6080197540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:17.968 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:17.965+0000 7f6085e43640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6080101a60 0x7f6080197a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:17.968 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:17.965+0000 7f6085e43640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f60801096a0 con 0x7f6080100860 2024-09-21T12:20:17.968 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:17.965+0000 7f6085e43640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6080109520 con 0x7f6080101a60 2024-09-21T12:20:17.969 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:17.965+0000 7f607f7fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6080100860 0x7f6080197540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:17.969 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:17.965+0000 7f607f7fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6080100860 0x7f6080197540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45186/0 (socket says 172.21.15.3:45186) 2024-09-21T12:20:17.969 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:17.965+0000 7f607f7fe640 1 -- 172.21.15.3:0/2497458156 learned_addr learned my addr 172.21.15.3:0/2497458156 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:20:17.969 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:17.965+0000 7f607effd640 1 --2- 172.21.15.3:0/2497458156 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6080101a60 0x7f6080197a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:17.969 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:17.966+0000 7f607effd640 1 -- 172.21.15.3:0/2497458156 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6080100860 msgr2=0x7f6080197540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:17.969 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:17.966+0000 7f607effd640 1 --2- 172.21.15.3:0/2497458156 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6080100860 0x7f6080197540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:17.969 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:17.966+0000 7f607effd640 1 -- 172.21.15.3:0/2497458156 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6080198100 con 0x7f6080101a60 2024-09-21T12:20:17.969 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:17.966+0000 7f607f7fe640 1 --2- 172.21.15.3:0/2497458156 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6080100860 0x7f6080197540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T12:20:17.969 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:17.966+0000 7f607effd640 1 --2- 172.21.15.3:0/2497458156 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6080101a60 0x7f6080197a80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6074006010 tx=0x7f60740045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:20:17.969 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:17.966+0000 7f607cff9640 1 -- 172.21.15.3:0/2497458156 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f607403f070 con 0x7f6080101a60 2024-09-21T12:20:17.969 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:17.966+0000 7f6085e43640 1 -- 172.21.15.3:0/2497458156 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f608019cae0 con 0x7f6080101a60 2024-09-21T12:20:17.969 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:17.966+0000 7f6085e43640 1 -- 172.21.15.3:0/2497458156 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f608019d070 con 0x7f6080101a60 2024-09-21T12:20:17.969 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:17.966+0000 7f607cff9640 1 -- 172.21.15.3:0/2497458156 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f60740049d0 con 0x7f6080101a60 2024-09-21T12:20:17.969 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:17.966+0000 7f607cff9640 1 -- 172.21.15.3:0/2497458156 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6074035030 con 0x7f6080101a60 2024-09-21T12:20:17.970 INFO:tasks.workunit.client.1.smithi192.stdout:8/245: dread - d14/d1a/d1d/d20/f47 zero size 2024-09-21T12:20:17.970 INFO:tasks.workunit.client.1.smithi192.stdout:8/246: chown d14/d1a/f3b 5 1 2024-09-21T12:20:17.971 INFO:tasks.workunit.client.1.smithi192.stdout:4/157: dwrite d2/f20 [0,4194304] 0 2024-09-21T12:20:17.971 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:17.968+0000 7f6085e43640 1 -- 172.21.15.3:0/2497458156 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6080100c60 con 0x7f6080101a60 2024-09-21T12:20:17.971 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:17.969+0000 7f607cff9640 1 -- 172.21.15.3:0/2497458156 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 20) ==== 97937+0+0 (secure 0 0 0) 0x7f6074042070 con 0x7f6080101a60 2024-09-21T12:20:17.971 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:17.969+0000 7f607cff9640 1 --2- 172.21.15.3:0/2497458156 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f6068074940 0x7f6068076e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:17.971 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:17.969+0000 7f607cff9640 1 -- 172.21.15.3:0/2497458156 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5554+0+0 (secure 0 0 0) 0x7f60740b6950 con 0x7f6080101a60 2024-09-21T12:20:17.972 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:17.969+0000 7f607f7fe640 1 --2- 172.21.15.3:0/2497458156 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f6068074940 0x7f6068076e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:17.972 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:17.970+0000 7f607f7fe640 1 --2- 172.21.15.3:0/2497458156 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f6068074940 0x7f6068076e00 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f60700058c0 tx=0x7f6070005f90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:20:17.978 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:17.976+0000 7f607cff9640 1 -- 172.21.15.3:0/2497458156 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6074087ee0 con 0x7f6080101a60 2024-09-21T12:20:17.979 INFO:tasks.workunit.client.1.smithi192.stdout:8/247: rename d14/d18/f21 to d14/d1a/d1d/d39/f4a 0 2024-09-21T12:20:17.980 INFO:tasks.workunit.client.1.smithi192.stdout:9/136: getdents d5 0 2024-09-21T12:20:17.981 INFO:tasks.workunit.client.1.smithi192.stdout:9/137: stat d5/d19/c1a 0 2024-09-21T12:20:17.983 INFO:tasks.workunit.client.1.smithi192.stdout:8/248: symlink d14/d1a/d1d/d20/l4b 0 2024-09-21T12:20:17.988 INFO:tasks.workunit.client.1.smithi192.stdout:9/138: mkdir d5/d8/d2c 0 2024-09-21T12:20:17.988 INFO:tasks.workunit.client.1.smithi192.stdout:9/139: stat l1 0 2024-09-21T12:20:17.988 INFO:tasks.workunit.client.1.smithi192.stdout:1/217: dread d2/de/f19 [0,4194304] 0 2024-09-21T12:20:17.989 INFO:tasks.workunit.client.1.smithi192.stdout:8/249: dread d14/d18/f33 [0,4194304] 0 2024-09-21T12:20:17.992 INFO:tasks.workunit.client.1.smithi192.stdout:8/250: symlink d14/d1a/d1d/d46/l4c 0 2024-09-21T12:20:17.993 INFO:tasks.workunit.client.1.smithi192.stdout:9/140: creat d5/d8/f2d x:0 0 0 2024-09-21T12:20:17.995 INFO:tasks.workunit.client.1.smithi192.stdout:1/218: dwrite d2/da/d1f/d24/f35 [0,4194304] 0 2024-09-21T12:20:17.996 INFO:tasks.workunit.client.1.smithi192.stdout:9/141: chown d5/d8/ff 1444 1 2024-09-21T12:20:17.998 INFO:tasks.workunit.client.1.smithi192.stdout:8/251: write d14/f3f [698433,110238] 0 2024-09-21T12:20:17.999 INFO:tasks.workunit.client.1.smithi192.stdout:8/252: fdatasync fa 0 2024-09-21T12:20:18.001 INFO:tasks.workunit.client.1.smithi192.stdout:1/219: dwrite d2/d12/f2e [0,4194304] 0 2024-09-21T12:20:18.003 INFO:tasks.workunit.client.1.smithi192.stdout:1/220: write d2/da/d1f/f2d [1511260,7589] 0 2024-09-21T12:20:18.003 INFO:tasks.workunit.client.1.smithi192.stdout:9/142: unlink d5/d23/f1c 0 2024-09-21T12:20:18.010 INFO:tasks.workunit.client.1.smithi192.stdout:1/221: dwrite d2/da/f32 [0,4194304] 0 2024-09-21T12:20:18.011 INFO:tasks.workunit.client.1.smithi192.stdout:8/253: dread ff [0,4194304] 0 2024-09-21T12:20:18.013 INFO:tasks.workunit.client.1.smithi192.stdout:8/254: write d14/d1a/d1d/d20/f37 [533190,70604] 0 2024-09-21T12:20:18.013 INFO:tasks.workunit.client.1.smithi192.stdout:9/143: truncate d5/d8/f15 955393 0 2024-09-21T12:20:18.019 INFO:tasks.workunit.client.1.smithi192.stdout:8/255: symlink d14/d1a/l4d 0 2024-09-21T12:20:18.021 INFO:tasks.workunit.client.1.smithi192.stdout:1/222: link d2/da/f32 d2/da/f46 0 2024-09-21T12:20:18.023 INFO:tasks.workunit.client.1.smithi192.stdout:9/144: creat d5/d8/d11/f2e x:0 0 0 2024-09-21T12:20:18.024 INFO:tasks.workunit.client.1.smithi192.stdout:8/256: mkdir d14/d1a/d1d/d46/d4e 0 2024-09-21T12:20:18.027 INFO:tasks.workunit.client.1.smithi192.stdout:8/257: dread d14/d1a/f25 [0,4194304] 0 2024-09-21T12:20:18.029 INFO:tasks.workunit.client.1.smithi192.stdout:8/258: read d14/d1a/f27 [25397,121416] 0 2024-09-21T12:20:18.034 INFO:tasks.workunit.client.1.smithi192.stdout:9/145: link d5/d23/f25 d5/f2f 0 2024-09-21T12:20:18.039 INFO:tasks.workunit.client.1.smithi192.stdout:9/146: dread d5/fb [0,4194304] 0 2024-09-21T12:20:18.043 INFO:tasks.workunit.client.1.smithi192.stdout:9/147: write d5/f2f [768385,65801] 0 2024-09-21T12:20:18.048 INFO:tasks.workunit.client.1.smithi192.stdout:9/148: mkdir d5/dc/d30 0 2024-09-21T12:20:18.049 INFO:tasks.workunit.client.1.smithi192.stdout:1/223: truncate d2/da/f31 579062 0 2024-09-21T12:20:18.050 INFO:tasks.workunit.client.1.smithi192.stdout:9/149: dread d5/f7 [0,4194304] 0 2024-09-21T12:20:18.053 INFO:tasks.workunit.client.1.smithi192.stdout:1/224: creat d2/de/f47 x:0 0 0 2024-09-21T12:20:18.058 INFO:tasks.workunit.client.1.smithi192.stdout:1/225: dwrite d2/d12/d2f/f40 [0,4194304] 0 2024-09-21T12:20:18.062 INFO:tasks.workunit.client.1.smithi192.stdout:1/226: rename d2/d12/f9 to d2/de/f48 0 2024-09-21T12:20:18.062 INFO:tasks.workunit.client.1.smithi192.stdout:1/227: fdatasync d2/de/f11 0 2024-09-21T12:20:18.063 INFO:tasks.workunit.client.1.smithi192.stdout:8/259: truncate d14/d1a/f31 2425584 0 2024-09-21T12:20:18.071 INFO:tasks.workunit.client.1.smithi192.stdout:8/260: dread d14/d1a/f27 [0,4194304] 0 2024-09-21T12:20:18.071 INFO:tasks.workunit.client.1.smithi192.stdout:9/150: rename d5/d8/ff to d5/d21/f31 0 2024-09-21T12:20:18.072 INFO:tasks.workunit.client.1.smithi192.stdout:9/151: dread - d5/d8/f2d zero size 2024-09-21T12:20:18.075 INFO:tasks.workunit.client.1.smithi192.stdout:8/261: creat d14/d1a/d1d/d46/f4f x:0 0 0 2024-09-21T12:20:18.076 INFO:tasks.workunit.client.1.smithi192.stdout:8/262: symlink d14/d1a/l50 0 2024-09-21T12:20:18.077 INFO:tasks.workunit.client.1.smithi192.stdout:9/152: dwrite d5/dc/f18 [0,4194304] 0 2024-09-21T12:20:18.078 INFO:tasks.workunit.client.1.smithi192.stdout:9/153: chown l1 100181 1 2024-09-21T12:20:18.082 INFO:tasks.workunit.client.1.smithi192.stdout:8/263: mkdir d14/d1a/d1d/d51 0 2024-09-21T12:20:18.082 INFO:tasks.workunit.client.1.smithi192.stdout:8/264: dread - d14/d18/f28 zero size 2024-09-21T12:20:18.083 INFO:tasks.workunit.client.1.smithi192.stdout:9/154: dread d5/d23/f14 [0,4194304] 0 2024-09-21T12:20:18.091 INFO:tasks.workunit.client.1.smithi192.stdout:9/155: dread d5/d8/f15 [0,4194304] 0 2024-09-21T12:20:18.094 INFO:tasks.workunit.client.1.smithi192.stdout:9/156: readlink d5/dc/l27 0 2024-09-21T12:20:18.099 INFO:tasks.workunit.client.1.smithi192.stdout:1/228: truncate d2/d12/f3c 697791 0 2024-09-21T12:20:18.100 INFO:tasks.workunit.client.1.smithi192.stdout:1/229: dread - d2/da/d1f/d24/f26 zero size 2024-09-21T12:20:18.103 INFO:tasks.workunit.client.1.smithi192.stdout:1/230: mknod d2/da/d44/c49 0 2024-09-21T12:20:18.103 INFO:tasks.workunit.client.1.smithi192.stdout:1/231: stat d2/da 0 2024-09-21T12:20:18.104 INFO:tasks.workunit.client.1.smithi192.stdout:1/232: dread - d2/da/d1f/d24/f26 zero size 2024-09-21T12:20:18.106 INFO:tasks.workunit.client.1.smithi192.stdout:8/265: truncate d14/d1a/d1d/d39/f4a 2731943 0 2024-09-21T12:20:18.107 INFO:tasks.workunit.client.1.smithi192.stdout:8/266: write d14/d1a/d1d/f49 [900232,109382] 0 2024-09-21T12:20:18.109 INFO:tasks.workunit.client.1.smithi192.stdout:9/157: write d5/fb [1920624,86155] 0 2024-09-21T12:20:18.111 INFO:tasks.workunit.client.1.smithi192.stdout:8/267: dread d14/f2a [0,4194304] 0 2024-09-21T12:20:18.115 INFO:tasks.workunit.client.1.smithi192.stdout:9/158: dwrite d5/dc/f18 [0,4194304] 0 2024-09-21T12:20:18.118 INFO:tasks.workunit.client.1.smithi192.stdout:8/268: rename d14/f3f to d14/f52 0 2024-09-21T12:20:18.120 INFO:tasks.workunit.client.1.smithi192.stdout:8/269: truncate d14/d1a/d1d/d20/f37 809296 0 2024-09-21T12:20:18.120 INFO:tasks.workunit.client.1.smithi192.stdout:9/159: chown d5/dc/d1e/f2a 0 1 2024-09-21T12:20:18.122 INFO:tasks.workunit.client.1.smithi192.stdout:0/152: sync 2024-09-21T12:20:18.122 INFO:tasks.workunit.client.1.smithi192.stdout:6/111: sync 2024-09-21T12:20:18.122 INFO:tasks.workunit.client.1.smithi192.stdout:2/159: sync 2024-09-21T12:20:18.123 INFO:tasks.workunit.client.1.smithi192.stdout:8/270: dread d14/d18/f22 [0,4194304] 0 2024-09-21T12:20:18.128 INFO:tasks.workunit.client.1.smithi192.stdout:0/153: unlink d3/fa 0 2024-09-21T12:20:18.129 INFO:tasks.workunit.client.1.smithi192.stdout:2/160: symlink d1b/d1e/l2e 0 2024-09-21T12:20:18.130 INFO:tasks.workunit.client.1.smithi192.stdout:0/154: dread - d3/d5/d19/f26 zero size 2024-09-21T12:20:18.131 INFO:tasks.workunit.client.1.smithi192.stdout:6/112: rename da/f1a to da/f21 0 2024-09-21T12:20:18.132 INFO:tasks.workunit.client.1.smithi192.stdout:1/233: dwrite d2/da/f31 [0,4194304] 0 2024-09-21T12:20:18.133 INFO:tasks.workunit.client.1.smithi192.stdout:8/271: symlink d14/d1a/d1d/d20/l53 0 2024-09-21T12:20:18.133 INFO:tasks.workunit.client.1.smithi192.stdout:8/272: chown ff 2 1 2024-09-21T12:20:18.136 INFO:tasks.workunit.client.1.smithi192.stdout:9/160: truncate f2 7876964 0 2024-09-21T12:20:18.136 INFO:tasks.workunit.client.1.smithi192.stdout:2/161: dread fd [0,4194304] 0 2024-09-21T12:20:18.137 INFO:tasks.workunit.client.1.smithi192.stdout:9/161: write d5/f2f [623068,7388] 0 2024-09-21T12:20:18.139 INFO:tasks.workunit.client.1.smithi192.stdout:0/155: mknod d3/d6/c30 0 2024-09-21T12:20:18.141 INFO:tasks.workunit.client.1.smithi192.stdout:0/156: write d3/de/f11 [2006381,80585] 0 2024-09-21T12:20:18.141 INFO:tasks.workunit.client.1.smithi192.stdout:9/162: dread d5/fb [0,4194304] 0 2024-09-21T12:20:18.141 INFO:tasks.workunit.client.1.smithi192.stdout:0/157: stat d3 0 2024-09-21T12:20:18.141 INFO:tasks.workunit.client.1.smithi192.stdout:1/234: creat d2/d12/d2f/f4a x:0 0 0 2024-09-21T12:20:18.141 INFO:tasks.workunit.client.1.smithi192.stdout:0/158: chown d3/de/f11 4917267 1 2024-09-21T12:20:18.143 INFO:tasks.workunit.client.1.smithi192.stdout:1/235: write d2/da/d1f/d24/f26 [553000,42596] 0 2024-09-21T12:20:18.144 INFO:tasks.workunit.client.1.smithi192.stdout:8/273: unlink d14/d18/l1b 0 2024-09-21T12:20:18.146 INFO:tasks.workunit.client.1.smithi192.stdout:0/159: dread d3/de/f24 [0,4194304] 0 2024-09-21T12:20:18.147 INFO:tasks.workunit.client.1.smithi192.stdout:0/160: fdatasync d3/d5/f14 0 2024-09-21T12:20:18.148 INFO:tasks.workunit.client.1.smithi192.stdout:2/162: creat d1b/d1e/f2f x:0 0 0 2024-09-21T12:20:18.151 INFO:tasks.workunit.client.1.smithi192.stdout:6/113: truncate da/f13 75186 0 2024-09-21T12:20:18.153 INFO:tasks.workunit.client.1.smithi192.stdout:9/163: unlink d5/d8/f29 0 2024-09-21T12:20:18.154 INFO:tasks.workunit.client.1.smithi192.stdout:9/164: readlink l1 0 2024-09-21T12:20:18.154 INFO:tasks.workunit.client.1.smithi192.stdout:8/274: dread d14/d18/f32 [0,4194304] 0 2024-09-21T12:20:18.155 INFO:tasks.workunit.client.1.smithi192.stdout:1/236: rename d2/d12/d2f/l3b to d2/d45/l4b 0 2024-09-21T12:20:18.155 INFO:tasks.workunit.client.1.smithi192.stdout:2/163: dwrite d1b/f23 [0,4194304] 0 2024-09-21T12:20:18.156 INFO:tasks.workunit.client.1.smithi192.stdout:8/275: chown d14/d1a/d1d/d20/f44 56990 1 2024-09-21T12:20:18.162 INFO:tasks.workunit.client.1.smithi192.stdout:0/161: dwrite d3/de/f24 [0,4194304] 0 2024-09-21T12:20:18.169 INFO:tasks.workunit.client.1.smithi192.stdout:2/164: write d1b/d1e/f20 [1302151,33613] 0 2024-09-21T12:20:18.171 INFO:tasks.workunit.client.1.smithi192.stdout:1/237: unlink d2/da/d1f/f2d 0 2024-09-21T12:20:18.173 INFO:tasks.workunit.client.1.smithi192.stdout:1/238: write d2/d12/f2e [274557,60881] 0 2024-09-21T12:20:18.173 INFO:tasks.workunit.client.1.smithi192.stdout:5/354: sync 2024-09-21T12:20:18.174 INFO:tasks.workunit.client.1.smithi192.stdout:4/158: sync 2024-09-21T12:20:18.174 INFO:tasks.workunit.client.1.smithi192.stdout:7/171: sync 2024-09-21T12:20:18.174 INFO:tasks.workunit.client.1.smithi192.stdout:3/141: sync 2024-09-21T12:20:18.175 INFO:tasks.workunit.client.1.smithi192.stdout:0/162: rename d3/d5/d19/d2a to d3/d5/d19/d31 0 2024-09-21T12:20:18.177 INFO:tasks.workunit.client.1.smithi192.stdout:9/165: mkdir d5/d19/d32 0 2024-09-21T12:20:18.177 INFO:tasks.workunit.client.1.smithi192.stdout:1/239: read d2/d12/d2f/f40 [104934,1109] 0 2024-09-21T12:20:18.179 INFO:tasks.workunit.client.1.smithi192.stdout:2/165: dwrite d1b/d1e/f2c [0,4194304] 0 2024-09-21T12:20:18.179 INFO:tasks.workunit.client.1.smithi192.stdout:4/159: symlink d2/d21/l2f 0 2024-09-21T12:20:18.182 INFO:tasks.workunit.client.1.smithi192.stdout:1/240: chown d2/de/f11 3209 1 2024-09-21T12:20:18.182 INFO:tasks.workunit.client.1.smithi192.stdout:1/241: stat c0 0 2024-09-21T12:20:18.183 INFO:tasks.workunit.client.1.smithi192.stdout:2/166: truncate f19 4888465 0 2024-09-21T12:20:18.184 INFO:tasks.workunit.client.1.smithi192.stdout:2/167: chown c0 50389538 1 2024-09-21T12:20:18.185 INFO:tasks.workunit.client.1.smithi192.stdout:9/166: unlink d5/d19/f1b 0 2024-09-21T12:20:18.187 INFO:tasks.workunit.client.1.smithi192.stdout:0/163: creat d3/d5/d19/d31/f32 x:0 0 0 2024-09-21T12:20:18.188 INFO:tasks.workunit.client.1.smithi192.stdout:3/142: dwrite db/f1e [0,4194304] 0 2024-09-21T12:20:18.188 INFO:tasks.workunit.client.1.smithi192.stdout:0/164: stat d3/d6/c30 0 2024-09-21T12:20:18.192 INFO:tasks.workunit.client.1.smithi192.stdout:7/172: rename d6/l16 to d6/d20/l42 0 2024-09-21T12:20:18.194 INFO:tasks.workunit.client.1.smithi192.stdout:4/160: creat d2/df/f30 x:0 0 0 2024-09-21T12:20:18.195 INFO:tasks.workunit.client.1.smithi192.stdout:4/161: chown c0 49377695 1 2024-09-21T12:20:18.195 INFO:tasks.workunit.client.1.smithi192.stdout:0/165: dwrite d3/d5/f1b [0,4194304] 0 2024-09-21T12:20:18.196 INFO:tasks.workunit.client.1.smithi192.stdout:1/242: readlink d2/d45/l4b 0 2024-09-21T12:20:18.198 INFO:tasks.workunit.client.1.smithi192.stdout:2/168: creat d1b/d1e/f30 x:0 0 0 2024-09-21T12:20:18.200 INFO:tasks.workunit.client.1.smithi192.stdout:2/169: chown d1b/d1e 69053371 1 2024-09-21T12:20:18.203 INFO:tasks.workunit.client.1.smithi192.stdout:8/276: dread d14/d1a/d1d/d39/f4a [0,4194304] 0 2024-09-21T12:20:18.203 INFO:tasks.workunit.client.1.smithi192.stdout:3/143: chown db/d2a/l2b 166 1 2024-09-21T12:20:18.203 INFO:tasks.workunit.client.1.smithi192.stdout:2/170: truncate f14 6164230 0 2024-09-21T12:20:18.205 INFO:tasks.workunit.client.1.smithi192.stdout:2/171: read - d1b/d1e/f30 zero size 2024-09-21T12:20:18.206 INFO:tasks.workunit.client.1.smithi192.stdout:4/162: dwrite d2/db/f27 [0,4194304] 0 2024-09-21T12:20:18.206 INFO:tasks.workunit.client.1.smithi192.stdout:6/114: truncate f8 3023339 0 2024-09-21T12:20:18.207 INFO:tasks.workunit.client.1.smithi192.stdout:1/243: dread d2/de/f19 [0,4194304] 0 2024-09-21T12:20:18.208 INFO:tasks.workunit.client.1.smithi192.stdout:6/115: readlink da/l11 0 2024-09-21T12:20:18.209 INFO:tasks.workunit.client.1.smithi192.stdout:5/355: rename d0/f28 to d0/de/d45/f72 0 2024-09-21T12:20:18.209 INFO:tasks.workunit.client.1.smithi192.stdout:0/166: mkdir d3/de/d33 0 2024-09-21T12:20:18.214 INFO:tasks.workunit.client.1.smithi192.stdout:8/277: mkdir d14/d1a/d54 0 2024-09-21T12:20:18.215 INFO:tasks.workunit.client.1.smithi192.stdout:6/116: write da/f20 [564801,68714] 0 2024-09-21T12:20:18.218 INFO:tasks.workunit.client.1.smithi192.stdout:2/172: dwrite d1b/f2a [0,4194304] 0 2024-09-21T12:20:18.222 INFO:tasks.workunit.client.1.smithi192.stdout:3/144: symlink db/d2a/d2e/l34 0 2024-09-21T12:20:18.223 INFO:tasks.workunit.client.1.smithi192.stdout:5/356: rmdir d0/de/d35 39 2024-09-21T12:20:18.224 INFO:tasks.workunit.client.1.smithi192.stdout:7/173: dread d6/d9/f17 [0,4194304] 0 2024-09-21T12:20:18.224 INFO:tasks.workunit.client.1.smithi192.stdout:7/174: dread - d6/d3a/f3f zero size 2024-09-21T12:20:18.225 INFO:tasks.workunit.client.1.smithi192.stdout:0/167: creat d3/d5/d19/d31/f34 x:0 0 0 2024-09-21T12:20:18.227 INFO:tasks.workunit.client.1.smithi192.stdout:9/167: write d5/d21/f31 [522353,99269] 0 2024-09-21T12:20:18.230 INFO:tasks.workunit.client.1.smithi192.stdout:3/145: dwrite db/f13 [0,4194304] 0 2024-09-21T12:20:18.231 INFO:tasks.workunit.client.1.smithi192.stdout:9/168: chown d5/d19/d32 4 1 2024-09-21T12:20:18.231 INFO:tasks.workunit.client.1.smithi192.stdout:4/163: mknod d2/db/d24/d28/c31 0 2024-09-21T12:20:18.232 INFO:tasks.workunit.client.1.smithi192.stdout:3/146: readlink db/d16/d18/l27 0 2024-09-21T12:20:18.234 INFO:tasks.workunit.client.1.smithi192.stdout:2/173: unlink c3 0 2024-09-21T12:20:18.237 INFO:tasks.workunit.client.1.smithi192.stdout:5/357: unlink d0/de/c33 0 2024-09-21T12:20:18.237 INFO:tasks.workunit.client.1.smithi192.stdout:7/175: dwrite d6/d9/f2b [0,4194304] 0 2024-09-21T12:20:18.238 INFO:tasks.workunit.client.1.smithi192.stdout:2/174: write d1b/d1e/f20 [4512196,78170] 0 2024-09-21T12:20:18.239 INFO:tasks.workunit.client.1.smithi192.stdout:3/147: dread db/f22 [0,4194304] 0 2024-09-21T12:20:18.240 INFO:tasks.workunit.client.1.smithi192.stdout:8/278: symlink d14/d1a/d1d/d46/d4e/l55 0 2024-09-21T12:20:18.242 INFO:tasks.workunit.client.1.smithi192.stdout:6/117: symlink da/d1f/l22 0 2024-09-21T12:20:18.242 INFO:tasks.workunit.client.1.smithi192.stdout:4/164: mkdir d2/db/d24/d32 0 2024-09-21T12:20:18.245 INFO:tasks.workunit.client.1.smithi192.stdout:0/168: creat d3/de/d33/f35 x:0 0 0 2024-09-21T12:20:18.246 INFO:tasks.workunit.client.1.smithi192.stdout:0/169: chown d3/d5/d19/c1f 2906 1 2024-09-21T12:20:18.246 INFO:tasks.workunit.client.1.smithi192.stdout:2/175: unlink f7 0 2024-09-21T12:20:18.247 INFO:tasks.workunit.client.1.smithi192.stdout:2/176: stat c1a 0 2024-09-21T12:20:18.248 INFO:tasks.workunit.client.1.smithi192.stdout:2/177: dread - d1b/f27 zero size 2024-09-21T12:20:18.248 INFO:tasks.workunit.client.1.smithi192.stdout:7/176: rename d6/d9/c22 to d6/d9/d2d/c43 0 2024-09-21T12:20:18.248 INFO:tasks.workunit.client.1.smithi192.stdout:4/165: dread d2/db/f27 [0,4194304] 0 2024-09-21T12:20:18.249 INFO:tasks.workunit.client.1.smithi192.stdout:8/279: symlink d14/d1a/d1d/d39/l56 0 2024-09-21T12:20:18.252 INFO:tasks.workunit.client.1.smithi192.stdout:6/118: truncate da/f10 3356083 0 2024-09-21T12:20:18.252 INFO:tasks.workunit.client.1.smithi192.stdout:0/170: dread d3/d5/f1b [0,4194304] 0 2024-09-21T12:20:18.253 INFO:tasks.workunit.client.1.smithi192.stdout:8/280: dread f11 [0,4194304] 0 2024-09-21T12:20:18.254 INFO:tasks.workunit.client.1.smithi192.stdout:3/148: mknod db/c35 0 2024-09-21T12:20:18.256 INFO:tasks.workunit.client.1.smithi192.stdout:2/178: fdatasync d1b/f1d 0 2024-09-21T12:20:18.258 INFO:tasks.workunit.client.1.smithi192.stdout:1/244: truncate d2/de/f19 2249268 0 2024-09-21T12:20:18.260 INFO:tasks.workunit.client.1.smithi192.stdout:7/177: dwrite d6/d9/d1f/f37 [0,4194304] 0 2024-09-21T12:20:18.260 INFO:tasks.workunit.client.1.smithi192.stdout:4/166: dread d2/db/f26 [0,4194304] 0 2024-09-21T12:20:18.261 INFO:tasks.workunit.client.1.smithi192.stdout:5/358: rename d0/d42 to d0/d73 0 2024-09-21T12:20:18.261 INFO:tasks.workunit.client.1.smithi192.stdout:4/167: fdatasync d2/db/d24/f2c 0 2024-09-21T12:20:18.262 INFO:tasks.workunit.client.1.smithi192.stdout:5/359: dread - d0/dc/d13/d37/f5d zero size 2024-09-21T12:20:18.262 INFO:tasks.workunit.client.1.smithi192.stdout:4/168: dread - d2/d19/f2d zero size 2024-09-21T12:20:18.264 INFO:tasks.workunit.client.1.smithi192.stdout:4/169: rename d2 to d2/db/d33 22 2024-09-21T12:20:18.265 INFO:tasks.workunit.client.1.smithi192.stdout:2/179: dread d1b/f23 [0,4194304] 0 2024-09-21T12:20:18.267 INFO:tasks.workunit.client.1.smithi192.stdout:5/360: write d0/dc/d13/d37/f56 [350228,90757] 0 2024-09-21T12:20:18.269 INFO:tasks.workunit.client.1.smithi192.stdout:8/281: unlink d14/d1a/f3b 0 2024-09-21T12:20:18.269 INFO:tasks.workunit.client.1.smithi192.stdout:4/170: dread - d2/db/f15 zero size 2024-09-21T12:20:18.271 INFO:tasks.workunit.client.1.smithi192.stdout:4/171: stat d2/df/f29 0 2024-09-21T12:20:18.272 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.270+0000 7f6085e43640 1 -- 172.21.15.3:0/2497458156 --> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f608006a420 con 0x7f6068074940 2024-09-21T12:20:18.272 INFO:tasks.workunit.client.1.smithi192.stdout:7/178: dwrite d6/d9/d2d/d36/f41 [0,4194304] 0 2024-09-21T12:20:18.273 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.272+0000 7f607cff9640 1 -- 172.21.15.3:0/2497458156 <== mgr.14217 v2:172.21.15.3:6800/2480880781 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+321 (secure 0 0 0) 0x7f608006a420 con 0x7f6068074940 2024-09-21T12:20:18.274 INFO:tasks.workunit.client.1.smithi192.stdout:6/119: dwrite da/f21 [0,4194304] 0 2024-09-21T12:20:18.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.275+0000 7f6085e43640 1 -- 172.21.15.3:0/2497458156 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f6068074940 msgr2=0x7f6068076e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:18.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.275+0000 7f6085e43640 1 --2- 172.21.15.3:0/2497458156 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f6068074940 0x7f6068076e00 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f60700058c0 tx=0x7f6070005f90 comp rx=0 tx=0).stop 2024-09-21T12:20:18.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.275+0000 7f6085e43640 1 -- 172.21.15.3:0/2497458156 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6080101a60 msgr2=0x7f6080197a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:18.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.275+0000 7f6085e43640 1 --2- 172.21.15.3:0/2497458156 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6080101a60 0x7f6080197a80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f6074006010 tx=0x7f60740045e0 comp rx=0 tx=0).stop 2024-09-21T12:20:18.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.276+0000 7f6085e43640 1 -- 172.21.15.3:0/2497458156 shutdown_connections 2024-09-21T12:20:18.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.276+0000 7f6085e43640 1 --2- 172.21.15.3:0/2497458156 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f6068074940 0x7f6068076e00 secure :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f60700058c0 tx=0x7f6070005f90 comp rx=0 tx=0).stop 2024-09-21T12:20:18.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.276+0000 7f6085e43640 1 --2- 172.21.15.3:0/2497458156 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6080101a60 0x7f6080197a80 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:18.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.276+0000 7f6085e43640 1 --2- 172.21.15.3:0/2497458156 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6080100860 0x7f6080197540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:18.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.276+0000 7f6085e43640 1 -- 172.21.15.3:0/2497458156 >> 172.21.15.3:0/2497458156 conn(0x7f60800fc010 msgr2=0x7f6080069d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:20:18.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.276+0000 7f6085e43640 1 -- 172.21.15.3:0/2497458156 shutdown_connections 2024-09-21T12:20:18.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.276+0000 7f6085e43640 1 -- 172.21.15.3:0/2497458156 wait complete. 2024-09-21T12:20:18.279 INFO:tasks.workunit.client.1.smithi192.stdout:1/245: fdatasync d2/da/f32 0 2024-09-21T12:20:18.283 INFO:tasks.workunit.client.1.smithi192.stdout:9/169: truncate d5/d8/f15 16957 0 2024-09-21T12:20:18.286 INFO:tasks.workunit.client.1.smithi192.stdout:2/180: rmdir d1b/d1e 39 2024-09-21T12:20:18.287 INFO:tasks.workunit.client.1.smithi192.stdout:2/181: chown lb 290 1 2024-09-21T12:20:18.288 INFO:tasks.workunit.client.1.smithi192.stdout:2/182: chown c9 20625922 1 2024-09-21T12:20:18.290 INFO:tasks.workunit.client.1.smithi192.stdout:9/170: dwrite d5/d8/f2d [0,4194304] 0 2024-09-21T12:20:18.291 INFO:tasks.workunit.client.1.smithi192.stdout:5/361: dread - d0/de/d35/f54 zero size 2024-09-21T12:20:18.291 INFO:tasks.workunit.client.1.smithi192.stdout:9/171: chown d5/d23 8765732 1 2024-09-21T12:20:18.292 INFO:tasks.workunit.client.1.smithi192.stdout:5/362: fdatasync d0/de/d45/f5a 0 2024-09-21T12:20:18.295 INFO:tasks.workunit.client.1.smithi192.stdout:4/172: readlink d2/df/l11 0 2024-09-21T12:20:18.295 INFO:tasks.workunit.client.1.smithi192.stdout:0/171: mknod d3/d5/d28/c36 0 2024-09-21T12:20:18.296 INFO:teuthology.orchestra.run.smithi003.stdout:true 2024-09-21T12:20:18.296 INFO:tasks.workunit.client.1.smithi192.stdout:7/179: creat d6/d9/d1f/f44 x:0 0 0 2024-09-21T12:20:18.297 INFO:tasks.workunit.client.1.smithi192.stdout:6/120: chown c4 29657 1 2024-09-21T12:20:18.297 INFO:tasks.workunit.client.1.smithi192.stdout:5/363: truncate d0/de/d45/f31 1422310 0 2024-09-21T12:20:18.303 INFO:tasks.workunit.client.1.smithi192.stdout:2/183: rmdir d1b 39 2024-09-21T12:20:18.305 INFO:tasks.workunit.client.1.smithi192.stdout:9/172: fsync d5/fb 0 2024-09-21T12:20:18.307 INFO:tasks.workunit.client.1.smithi192.stdout:3/149: creat db/d16/d18/f36 x:0 0 0 2024-09-21T12:20:18.309 INFO:tasks.workunit.client.1.smithi192.stdout:4/173: mkdir d2/db/d34 0 2024-09-21T12:20:18.310 INFO:tasks.workunit.client.1.smithi192.stdout:4/174: write d2/d21/f2e [834285,72536] 0 2024-09-21T12:20:18.310 INFO:tasks.workunit.client.1.smithi192.stdout:0/172: symlink d3/de/l37 0 2024-09-21T12:20:18.312 INFO:tasks.workunit.client.1.smithi192.stdout:0/173: write d3/de/d33/f35 [453969,120432] 0 2024-09-21T12:20:18.312 INFO:tasks.workunit.client.1.smithi192.stdout:6/121: truncate da/fc 3539232 0 2024-09-21T12:20:18.325 INFO:tasks.workunit.client.1.smithi192.stdout:7/180: truncate d6/d9/f11 683782 0 2024-09-21T12:20:18.326 INFO:tasks.workunit.client.1.smithi192.stdout:4/175: dread d2/df/f17 [0,4194304] 0 2024-09-21T12:20:18.330 INFO:tasks.workunit.client.1.smithi192.stdout:8/282: getdents d14/d1a/d1d 0 2024-09-21T12:20:18.333 INFO:tasks.workunit.client.1.smithi192.stdout:3/150: mknod db/d16/c37 0 2024-09-21T12:20:18.334 INFO:tasks.workunit.client.1.smithi192.stdout:1/246: fdatasync d2/de/f19 0 2024-09-21T12:20:18.337 INFO:tasks.workunit.client.1.smithi192.stdout:7/181: symlink d6/d9/d2d/l45 0 2024-09-21T12:20:18.339 INFO:tasks.workunit.client.1.smithi192.stdout:4/176: chown d2/c9 0 1 2024-09-21T12:20:18.343 INFO:tasks.workunit.client.1.smithi192.stdout:5/364: rename d0/de/c50 to d0/dc/d13/c74 0 2024-09-21T12:20:18.345 INFO:tasks.workunit.client.1.smithi192.stdout:2/184: dwrite d1b/f23 [0,4194304] 0 2024-09-21T12:20:18.346 INFO:tasks.workunit.client.1.smithi192.stdout:2/185: chown l17 3379 1 2024-09-21T12:20:18.347 INFO:tasks.workunit.client.1.smithi192.stdout:9/173: creat d5/f33 x:0 0 0 2024-09-21T12:20:18.348 INFO:tasks.workunit.client.1.smithi192.stdout:9/174: chown d5/f33 104743 1 2024-09-21T12:20:18.349 INFO:tasks.workunit.client.1.smithi192.stdout:3/151: creat db/d2a/d2e/f38 x:0 0 0 2024-09-21T12:20:18.350 INFO:tasks.workunit.client.1.smithi192.stdout:1/247: creat d2/da/d1f/d24/f4c x:0 0 0 2024-09-21T12:20:18.352 INFO:tasks.workunit.client.1.smithi192.stdout:1/248: fdatasync d2/da/d1f/f37 0 2024-09-21T12:20:18.352 INFO:tasks.workunit.client.1.smithi192.stdout:0/174: truncate d3/de/d33/f35 220843 0 2024-09-21T12:20:18.355 INFO:tasks.workunit.client.1.smithi192.stdout:4/177: creat d2/df/f35 x:0 0 0 2024-09-21T12:20:18.356 INFO:tasks.workunit.client.1.smithi192.stdout:1/249: truncate d2/da/f27 4819440 0 2024-09-21T12:20:18.356 INFO:tasks.workunit.client.1.smithi192.stdout:2/186: dread f14 [4194304,4194304] 0 2024-09-21T12:20:18.357 INFO:tasks.workunit.client.1.smithi192.stdout:3/152: dwrite f8 [0,4194304] 0 2024-09-21T12:20:18.359 INFO:tasks.workunit.client.1.smithi192.stdout:5/365: dread d0/de/f2a [0,4194304] 0 2024-09-21T12:20:18.360 INFO:tasks.workunit.client.1.smithi192.stdout:5/366: stat d0/d73/d44/c51 0 2024-09-21T12:20:18.360 INFO:tasks.workunit.client.1.smithi192.stdout:9/175: rename d5/d23 to d5/d21/d34 0 2024-09-21T12:20:18.365 INFO:tasks.workunit.client.1.smithi192.stdout:1/250: unlink d2/da/d1f/l2c 0 2024-09-21T12:20:18.369 INFO:tasks.workunit.client.1.smithi192.stdout:8/283: link d14/d1a/d1d/d39/f4a d14/d1a/d1d/f57 0 2024-09-21T12:20:18.375 INFO:tasks.workunit.client.1.smithi192.stdout:9/176: dwrite d5/fa [0,4194304] 0 2024-09-21T12:20:18.377 INFO:tasks.workunit.client.1.smithi192.stdout:4/178: mkdir d2/d36 0 2024-09-21T12:20:18.378 INFO:tasks.workunit.client.1.smithi192.stdout:4/179: dread - d2/df/f35 zero size 2024-09-21T12:20:18.378 INFO:tasks.workunit.client.1.smithi192.stdout:2/187: rename d1b/d1e/f2c to d1b/d1e/f31 0 2024-09-21T12:20:18.382 INFO:tasks.workunit.client.1.smithi192.stdout:3/153: mknod db/c39 0 2024-09-21T12:20:18.383 INFO:tasks.workunit.client.1.smithi192.stdout:9/177: dwrite d5/fa [4194304,4194304] 0 2024-09-21T12:20:18.387 INFO:tasks.workunit.client.1.smithi192.stdout:7/182: truncate d6/d9/d1f/f37 2988606 0 2024-09-21T12:20:18.388 INFO:tasks.workunit.client.1.smithi192.stdout:5/367: mknod d0/d70/c75 0 2024-09-21T12:20:18.388 INFO:tasks.workunit.client.1.smithi192.stdout:5/368: chown d0/f10 6 1 2024-09-21T12:20:18.394 INFO:tasks.workunit.client.1.smithi192.stdout:0/175: dwrite d3/d5/d19/f26 [0,4194304] 0 2024-09-21T12:20:18.402 INFO:tasks.workunit.client.1.smithi192.stdout:0/176: dwrite d3/d5/d19/d31/f34 [0,4194304] 0 2024-09-21T12:20:18.403 INFO:tasks.workunit.client.1.smithi192.stdout:4/180: symlink d2/d36/l37 0 2024-09-21T12:20:18.407 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.405+0000 7fb206f60640 1 -- 172.21.15.3:0/4127337027 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb2001024b0 msgr2=0x7fb2001048a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:18.407 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.405+0000 7fb206f60640 1 --2- 172.21.15.3:0/4127337027 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb2001024b0 0x7fb2001048a0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fb1f4009880 tx=0x7fb1f402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:20:18.407 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.405+0000 7fb206f60640 1 -- 172.21.15.3:0/4127337027 shutdown_connections 2024-09-21T12:20:18.407 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.405+0000 7fb206f60640 1 --2- 172.21.15.3:0/4127337027 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb200104de0 0x7fb2001071d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:18.407 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.405+0000 7fb206f60640 1 --2- 172.21.15.3:0/4127337027 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb2001024b0 0x7fb2001048a0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:18.407 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.405+0000 7fb206f60640 1 -- 172.21.15.3:0/4127337027 >> 172.21.15.3:0/4127337027 conn(0x7fb2000fc010 msgr2=0x7fb2000fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:20:18.407 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.405+0000 7fb206f60640 1 -- 172.21.15.3:0/4127337027 shutdown_connections 2024-09-21T12:20:18.407 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.405+0000 7fb206f60640 1 -- 172.21.15.3:0/4127337027 wait complete. 2024-09-21T12:20:18.408 INFO:tasks.workunit.client.1.smithi192.stdout:8/284: rmdir d14/d1a/d54 0 2024-09-21T12:20:18.409 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.406+0000 7fb206f60640 1 Processor -- start 2024-09-21T12:20:18.409 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.406+0000 7fb206f60640 1 -- start start 2024-09-21T12:20:18.409 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.406+0000 7fb206f60640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb2001024b0 0x7fb200101da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:18.409 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.406+0000 7fb206f60640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb200104de0 0x7fb200100460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:18.409 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.406+0000 7fb206f60640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fb20010a820 con 0x7fb2001024b0 2024-09-21T12:20:18.409 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.406+0000 7fb206f60640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb20010a6a0 con 0x7fb200104de0 2024-09-21T12:20:18.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.406+0000 7fb204cfc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb2001024b0 0x7fb200101da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:18.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.406+0000 7fb204cfc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb2001024b0 0x7fb200101da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45200/0 (socket says 172.21.15.3:45200) 2024-09-21T12:20:18.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.406+0000 7fb204cfc640 1 -- 172.21.15.3:0/2252673794 learned_addr learned my addr 172.21.15.3:0/2252673794 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:20:18.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.407+0000 7fb1fffff640 1 --2- 172.21.15.3:0/2252673794 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb200104de0 0x7fb200100460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:18.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.407+0000 7fb204cfc640 1 -- 172.21.15.3:0/2252673794 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb200104de0 msgr2=0x7fb200100460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:18.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.407+0000 7fb204cfc640 1 --2- 172.21.15.3:0/2252673794 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb200104de0 0x7fb200100460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:18.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.407+0000 7fb204cfc640 1 -- 172.21.15.3:0/2252673794 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2001009a0 con 0x7fb2001024b0 2024-09-21T12:20:18.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.407+0000 7fb1fffff640 1 --2- 172.21.15.3:0/2252673794 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb200104de0 0x7fb200100460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T12:20:18.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.407+0000 7fb204cfc640 1 --2- 172.21.15.3:0/2252673794 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb2001024b0 0x7fb200101da0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb1f4009230 tx=0x7fb1f40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:20:18.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.407+0000 7fb1fdffb640 1 -- 172.21.15.3:0/2252673794 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb1f403f070 con 0x7fb2001024b0 2024-09-21T12:20:18.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.407+0000 7fb1fdffb640 1 -- 172.21.15.3:0/2252673794 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb1f40044d0 con 0x7fb2001024b0 2024-09-21T12:20:18.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.407+0000 7fb206f60640 1 -- 172.21.15.3:0/2252673794 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb200100c30 con 0x7fb2001024b0 2024-09-21T12:20:18.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.407+0000 7fb1fdffb640 1 -- 172.21.15.3:0/2252673794 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb1f4035030 con 0x7fb2001024b0 2024-09-21T12:20:18.410 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.407+0000 7fb206f60640 1 -- 172.21.15.3:0/2252673794 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2001011e0 con 0x7fb2001024b0 2024-09-21T12:20:18.411 INFO:tasks.workunit.client.1.smithi192.stdout:9/178: creat d5/dc/d30/f35 x:0 0 0 2024-09-21T12:20:18.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.409+0000 7fb206f60640 1 -- 172.21.15.3:0/2252673794 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb200102890 con 0x7fb2001024b0 2024-09-21T12:20:18.411 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.410+0000 7fb1fdffb640 1 -- 172.21.15.3:0/2252673794 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 20) ==== 97937+0+0 (secure 0 0 0) 0x7fb1f4042070 con 0x7fb2001024b0 2024-09-21T12:20:18.412 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.411+0000 7fb1fdffb640 1 --2- 172.21.15.3:0/2252673794 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fb1f0074950 0x7fb1f0076e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:18.413 INFO:tasks.workunit.client.1.smithi192.stdout:0/177: dread d3/d5/f9 [0,4194304] 0 2024-09-21T12:20:18.413 INFO:tasks.workunit.client.1.smithi192.stdout:7/183: unlink d6/d9/c31 0 2024-09-21T12:20:18.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.411+0000 7fb1fdffb640 1 -- 172.21.15.3:0/2252673794 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5554+0+0 (secure 0 0 0) 0x7fb1f40b7080 con 0x7fb2001024b0 2024-09-21T12:20:18.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.411+0000 7fb1fffff640 1 --2- 172.21.15.3:0/2252673794 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fb1f0074950 0x7fb1f0076e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:18.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.412+0000 7fb1fffff640 1 --2- 172.21.15.3:0/2252673794 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fb1f0074950 0x7fb1f0076e10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec006fd0 tx=0x7fb1ec008040 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:20:18.414 INFO:tasks.workunit.client.1.smithi192.stdout:1/251: write d2/f3e [2112789,103964] 0 2024-09-21T12:20:18.414 INFO:tasks.workunit.client.1.smithi192.stdout:7/184: write d6/f27 [1006271,57410] 0 2024-09-21T12:20:18.416 INFO:tasks.workunit.client.1.smithi192.stdout:2/188: creat d1b/f32 x:0 0 0 2024-09-21T12:20:18.416 INFO:tasks.workunit.client.1.smithi192.stdout:2/189: read d1b/f2a [2563200,35533] 0 2024-09-21T12:20:18.418 INFO:tasks.workunit.client.1.smithi192.stdout:3/154: creat db/d16/d18/f3a x:0 0 0 2024-09-21T12:20:18.419 INFO:tasks.workunit.client.1.smithi192.stdout:5/369: creat d0/de/f76 x:0 0 0 2024-09-21T12:20:18.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.418+0000 7fb1fdffb640 1 -- 172.21.15.3:0/2252673794 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb1f4084aa0 con 0x7fb2001024b0 2024-09-21T12:20:18.420 INFO:tasks.workunit.client.1.smithi192.stdout:7/185: creat d6/d3a/f46 x:0 0 0 2024-09-21T12:20:18.422 INFO:tasks.workunit.client.1.smithi192.stdout:4/181: rename d2/db/f16 to d2/d21/f38 0 2024-09-21T12:20:18.423 INFO:tasks.workunit.client.1.smithi192.stdout:2/190: mknod d1b/d1e/c33 0 2024-09-21T12:20:18.424 INFO:tasks.workunit.client.1.smithi192.stdout:9/179: mkdir d5/d8/d36 0 2024-09-21T12:20:18.425 INFO:tasks.workunit.client.1.smithi192.stdout:3/155: dwrite db/f1e [8388608,4194304] 0 2024-09-21T12:20:18.426 INFO:tasks.workunit.client.1.smithi192.stdout:3/156: chown ca 189915203 1 2024-09-21T12:20:18.427 INFO:tasks.workunit.client.1.smithi192.stdout:4/182: readlink d2/db/l18 0 2024-09-21T12:20:18.428 INFO:tasks.workunit.client.1.smithi192.stdout:3/157: write db/d16/d18/f3a [766823,109912] 0 2024-09-21T12:20:18.428 INFO:tasks.workunit.client.1.smithi192.stdout:2/191: unlink d1b/f23 0 2024-09-21T12:20:18.428 INFO:tasks.workunit.client.1.smithi192.stdout:1/252: fsync d2/d12/f10 0 2024-09-21T12:20:18.430 INFO:tasks.workunit.client.1.smithi192.stdout:5/370: mkdir d0/d73/d68/d77 0 2024-09-21T12:20:18.434 INFO:tasks.workunit.client.1.smithi192.stdout:1/253: dwrite d2/da/f46 [0,4194304] 0 2024-09-21T12:20:18.436 INFO:tasks.workunit.client.1.smithi192.stdout:1/254: write d2/d12/f10 [4940391,9543] 0 2024-09-21T12:20:18.438 INFO:tasks.workunit.client.1.smithi192.stdout:8/285: creat d14/d1a/d1d/f58 x:0 0 0 2024-09-21T12:20:18.442 INFO:tasks.workunit.client.1.smithi192.stdout:5/371: fsync d0/de/f76 0 2024-09-21T12:20:18.442 INFO:tasks.workunit.client.1.smithi192.stdout:5/372: chown d0/d73/d68 5403769 1 2024-09-21T12:20:18.443 INFO:tasks.workunit.client.1.smithi192.stdout:4/183: write d2/db/d1a/f2b [621216,63878] 0 2024-09-21T12:20:18.443 INFO:tasks.workunit.client.1.smithi192.stdout:9/180: mknod d5/d8/c37 0 2024-09-21T12:20:18.444 INFO:tasks.workunit.client.1.smithi192.stdout:9/181: chown d5/dc/d1e/c28 1 1 2024-09-21T12:20:18.446 INFO:tasks.workunit.client.1.smithi192.stdout:3/158: mkdir db/d16/d18/d33/d3b 0 2024-09-21T12:20:18.447 INFO:tasks.workunit.client.1.smithi192.stdout:3/159: write db/f14 [1955908,60923] 0 2024-09-21T12:20:18.451 INFO:tasks.workunit.client.1.smithi192.stdout:0/178: truncate d3/f1a 2214479 0 2024-09-21T12:20:18.452 INFO:tasks.workunit.client.1.smithi192.stdout:0/179: fdatasync d3/d6/fd 0 2024-09-21T12:20:18.455 INFO:tasks.workunit.client.1.smithi192.stdout:4/184: chown d2/db/d24/f2c 13 1 2024-09-21T12:20:18.456 INFO:tasks.workunit.client.1.smithi192.stdout:9/182: unlink d5/dc/c1d 0 2024-09-21T12:20:18.458 INFO:tasks.workunit.client.1.smithi192.stdout:7/186: write d6/d9/d2d/d36/f24 [92479,21692] 0 2024-09-21T12:20:18.460 INFO:tasks.workunit.client.1.smithi192.stdout:7/187: read d6/d20/f3b [2483732,88760] 0 2024-09-21T12:20:18.461 INFO:tasks.workunit.client.1.smithi192.stdout:1/255: mkdir d2/d4d 0 2024-09-21T12:20:18.462 INFO:tasks.workunit.client.1.smithi192.stdout:2/192: dread ff [0,4194304] 0 2024-09-21T12:20:18.465 INFO:tasks.workunit.client.1.smithi192.stdout:0/180: truncate d3/d5/f9 2710775 0 2024-09-21T12:20:18.466 INFO:tasks.workunit.client.1.smithi192.stdout:4/185: creat d2/db/d24/d28/f39 x:0 0 0 2024-09-21T12:20:18.466 INFO:tasks.workunit.client.1.smithi192.stdout:4/186: fsync d2/d21/f2e 0 2024-09-21T12:20:18.467 INFO:tasks.workunit.client.1.smithi192.stdout:9/183: mknod d5/d19/c38 0 2024-09-21T12:20:18.470 INFO:tasks.workunit.client.1.smithi192.stdout:5/373: creat d0/de/f78 x:0 0 0 2024-09-21T12:20:18.471 INFO:tasks.workunit.client.1.smithi192.stdout:1/256: symlink d2/d45/l4e 0 2024-09-21T12:20:18.471 INFO:tasks.workunit.client.1.smithi192.stdout:5/374: write d0/d65/f67 [732796,53375] 0 2024-09-21T12:20:18.476 INFO:tasks.workunit.client.1.smithi192.stdout:7/188: dread d6/d20/f40 [0,4194304] 0 2024-09-21T12:20:18.479 INFO:tasks.workunit.client.1.smithi192.stdout:3/160: creat db/f3c x:0 0 0 2024-09-21T12:20:18.481 INFO:tasks.workunit.client.1.smithi192.stdout:8/286: mknod d14/d1a/d1d/d39/c59 0 2024-09-21T12:20:18.482 INFO:tasks.workunit.client.1.smithi192.stdout:1/257: creat d2/da/d1f/f4f x:0 0 0 2024-09-21T12:20:18.486 INFO:tasks.workunit.client.1.smithi192.stdout:5/375: rename d0/d65/d6e/d36 to d0/de/d35/d79 0 2024-09-21T12:20:18.487 INFO:tasks.workunit.client.1.smithi192.stdout:5/376: read - d0/de/f6c zero size 2024-09-21T12:20:18.490 INFO:tasks.workunit.client.1.smithi192.stdout:7/189: rename d6/d20/f3b to d6/d20/f47 0 2024-09-21T12:20:18.491 INFO:tasks.workunit.client.1.smithi192.stdout:4/187: mknod d2/c3a 0 2024-09-21T12:20:18.493 INFO:tasks.workunit.client.1.smithi192.stdout:9/184: symlink d5/d8/l39 0 2024-09-21T12:20:18.494 INFO:tasks.workunit.client.1.smithi192.stdout:8/287: write d14/d18/f22 [928357,77803] 0 2024-09-21T12:20:18.495 INFO:tasks.workunit.client.1.smithi192.stdout:1/258: symlink d2/da/d1f/l50 0 2024-09-21T12:20:18.499 INFO:tasks.workunit.client.1.smithi192.stdout:3/161: mkdir db/d3d 0 2024-09-21T12:20:18.500 INFO:tasks.workunit.client.1.smithi192.stdout:8/288: mkdir d14/d18/d5a 0 2024-09-21T12:20:18.502 INFO:tasks.workunit.client.1.smithi192.stdout:2/193: link l18 d1b/l34 0 2024-09-21T12:20:18.503 INFO:tasks.workunit.client.1.smithi192.stdout:2/194: dread - d1b/d1e/f30 zero size 2024-09-21T12:20:18.504 INFO:tasks.workunit.client.1.smithi192.stdout:0/181: dwrite d3/f1a [0,4194304] 0 2024-09-21T12:20:18.504 INFO:tasks.workunit.client.1.smithi192.stdout:7/190: link d6/d9/d2d/d36/f24 d6/d20/f48 0 2024-09-21T12:20:18.505 INFO:tasks.workunit.client.1.smithi192.stdout:0/182: chown d3/d6/c21 25 1 2024-09-21T12:20:18.506 INFO:tasks.workunit.client.1.smithi192.stdout:9/185: fdatasync d5/d21/f31 0 2024-09-21T12:20:18.507 INFO:tasks.workunit.client.1.smithi192.stdout:9/186: chown d5/dc/d1e/l26 4656740 1 2024-09-21T12:20:18.507 INFO:tasks.workunit.client.1.smithi192.stdout:9/187: chown d5/dc/l27 51 1 2024-09-21T12:20:18.508 INFO:tasks.workunit.client.1.smithi192.stdout:3/162: rmdir db/d2a 39 2024-09-21T12:20:18.509 INFO:tasks.workunit.client.1.smithi192.stdout:3/163: chown db/d16/f2c 57565600 1 2024-09-21T12:20:18.510 INFO:tasks.workunit.client.1.smithi192.stdout:8/289: write f11 [1390462,111974] 0 2024-09-21T12:20:18.515 INFO:tasks.workunit.client.1.smithi192.stdout:2/195: symlink d1b/d1e/l35 0 2024-09-21T12:20:18.515 INFO:tasks.workunit.client.1.smithi192.stdout:2/196: dread - d1b/d1e/f30 zero size 2024-09-21T12:20:18.516 INFO:tasks.workunit.client.1.smithi192.stdout:4/188: rename d2/d36/l37 to d2/db/l3b 0 2024-09-21T12:20:18.521 INFO:tasks.workunit.client.1.smithi192.stdout:4/189: dwrite d2/d21/f2e [0,4194304] 0 2024-09-21T12:20:18.522 INFO:tasks.workunit.client.1.smithi192.stdout:4/190: dread - d2/db/d24/f2c zero size 2024-09-21T12:20:18.528 INFO:tasks.workunit.client.1.smithi192.stdout:5/377: truncate d0/d2/f43 1989897 0 2024-09-21T12:20:18.528 INFO:tasks.workunit.client.1.smithi192.stdout:1/259: write d2/d12/d2f/f40 [4122884,65601] 0 2024-09-21T12:20:18.530 INFO:tasks.workunit.client.1.smithi192.stdout:2/197: dread f14 [4194304,4194304] 0 2024-09-21T12:20:18.530 INFO:tasks.workunit.client.1.smithi192.stdout:1/260: write d2/de/f19 [632942,3008] 0 2024-09-21T12:20:18.531 INFO:tasks.workunit.client.1.smithi192.stdout:5/378: write d0/dc/f61 [2879637,72127] 0 2024-09-21T12:20:18.532 INFO:tasks.workunit.client.1.smithi192.stdout:1/261: read d2/de/f11 [3878651,10438] 0 2024-09-21T12:20:18.532 INFO:tasks.workunit.client.1.smithi192.stdout:1/262: fdatasync d2/d12/f2b 0 2024-09-21T12:20:18.533 INFO:tasks.workunit.client.1.smithi192.stdout:8/290: creat d14/d1a/d1d/d46/d4e/f5b x:0 0 0 2024-09-21T12:20:18.537 INFO:tasks.workunit.client.1.smithi192.stdout:2/198: creat d1b/d1e/f36 x:0 0 0 2024-09-21T12:20:18.537 INFO:tasks.workunit.client.1.smithi192.stdout:2/199: chown d1b/d1e/f20 423514180 1 2024-09-21T12:20:18.539 INFO:tasks.workunit.client.1.smithi192.stdout:5/379: unlink d0/f15 0 2024-09-21T12:20:18.541 INFO:tasks.workunit.client.1.smithi192.stdout:7/191: truncate f3 3318384 0 2024-09-21T12:20:18.543 INFO:tasks.workunit.client.1.smithi192.stdout:1/263: rename d2/da/d1f to d2/d12/d2f/d51 0 2024-09-21T12:20:18.543 INFO:tasks.workunit.client.1.smithi192.stdout:8/291: dread d14/d1a/d1d/f49 [0,4194304] 0 2024-09-21T12:20:18.544 INFO:tasks.workunit.client.1.smithi192.stdout:1/264: chown d2/d12/d2f/d51/f37 19 1 2024-09-21T12:20:18.546 INFO:tasks.workunit.client.1.smithi192.stdout:0/183: getdents d3/d5/d28 0 2024-09-21T12:20:18.547 INFO:tasks.workunit.client.1.smithi192.stdout:3/164: truncate db/d16/f2c 135727 0 2024-09-21T12:20:18.548 INFO:tasks.workunit.client.1.smithi192.stdout:3/165: dread - db/d16/d18/f2f zero size 2024-09-21T12:20:18.548 INFO:tasks.workunit.client.1.smithi192.stdout:3/166: dread - db/d16/d18/f36 zero size 2024-09-21T12:20:18.549 INFO:tasks.workunit.client.1.smithi192.stdout:3/167: chown db/c39 7 1 2024-09-21T12:20:18.551 INFO:tasks.workunit.client.1.smithi192.stdout:7/192: mknod d6/d9/d1f/c49 0 2024-09-21T12:20:18.551 INFO:tasks.workunit.client.1.smithi192.stdout:1/265: rmdir d2/d12 39 2024-09-21T12:20:18.553 INFO:tasks.workunit.client.1.smithi192.stdout:8/292: truncate d14/d18/f32 511690 0 2024-09-21T12:20:18.556 INFO:tasks.workunit.client.1.smithi192.stdout:2/200: symlink d1b/l37 0 2024-09-21T12:20:18.563 INFO:tasks.workunit.client.1.smithi192.stdout:2/201: dwrite d1b/d1e/f2f [0,4194304] 0 2024-09-21T12:20:18.563 INFO:tasks.workunit.client.1.smithi192.stdout:2/202: readlink d1b/d1e/l29 0 2024-09-21T12:20:18.563 INFO:tasks.workunit.client.1.smithi192.stdout:2/203: dread - d1b/f32 zero size 2024-09-21T12:20:18.565 INFO:tasks.workunit.client.1.smithi192.stdout:8/293: mkdir d14/d1a/d1d/d46/d5c 0 2024-09-21T12:20:18.567 INFO:tasks.workunit.client.1.smithi192.stdout:0/184: write d3/de/f24 [3170093,115992] 0 2024-09-21T12:20:18.569 INFO:tasks.workunit.client.1.smithi192.stdout:0/185: dread - d3/d5/d19/d31/f32 zero size 2024-09-21T12:20:18.570 INFO:tasks.workunit.client.1.smithi192.stdout:5/380: truncate d0/f3b 3502646 0 2024-09-21T12:20:18.570 INFO:tasks.workunit.client.1.smithi192.stdout:7/193: symlink d6/d9/d1f/d3e/l4a 0 2024-09-21T12:20:18.574 INFO:tasks.workunit.client.1.smithi192.stdout:2/204: readlink l18 0 2024-09-21T12:20:18.575 INFO:tasks.workunit.client.1.smithi192.stdout:7/194: dwrite f5 [0,4194304] 0 2024-09-21T12:20:18.577 INFO:tasks.workunit.client.1.smithi192.stdout:1/266: truncate d2/da/fc 3774767 0 2024-09-21T12:20:18.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:18 smithi003 ceph-mon[28057]: pgmap v259: 65 pgs: 65 active+clean; 291 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 219 KiB/s rd, 14 MiB/s wr, 264 op/s 2024-09-21T12:20:18.581 INFO:tasks.workunit.client.1.smithi192.stdout:3/168: creat db/d16/d18/f3e x:0 0 0 2024-09-21T12:20:18.582 INFO:tasks.workunit.client.1.smithi192.stdout:2/205: dwrite fd [0,4194304] 0 2024-09-21T12:20:18.584 INFO:tasks.workunit.client.1.smithi192.stdout:3/169: dread db/f1e [0,4194304] 0 2024-09-21T12:20:18.585 INFO:tasks.workunit.client.1.smithi192.stdout:5/381: mknod d0/d70/c7a 0 2024-09-21T12:20:18.585 INFO:tasks.workunit.client.1.smithi192.stdout:3/170: readlink db/d16/d18/l19 0 2024-09-21T12:20:18.586 INFO:tasks.workunit.client.1.smithi192.stdout:3/171: dread - db/d16/d18/f36 zero size 2024-09-21T12:20:18.587 INFO:tasks.workunit.client.1.smithi192.stdout:5/382: write d0/d2/f14 [2448305,47728] 0 2024-09-21T12:20:18.593 INFO:tasks.workunit.client.1.smithi192.stdout:7/195: creat d6/d9/d2d/d36/f4b x:0 0 0 2024-09-21T12:20:18.593 INFO:tasks.workunit.client.1.smithi192.stdout:5/383: dwrite d0/f6a [0,4194304] 0 2024-09-21T12:20:18.594 INFO:tasks.workunit.client.1.smithi192.stdout:7/196: write d6/d9/f17 [129745,108072] 0 2024-09-21T12:20:18.601 INFO:tasks.workunit.client.1.smithi192.stdout:7/197: dread f0 [4194304,4194304] 0 2024-09-21T12:20:18.601 INFO:tasks.workunit.client.1.smithi192.stdout:5/384: dread d0/dc/d13/d37/f56 [0,4194304] 0 2024-09-21T12:20:18.604 INFO:tasks.workunit.client.1.smithi192.stdout:7/198: read d6/d9/d1f/f21 [212016,704] 0 2024-09-21T12:20:18.607 INFO:tasks.workunit.client.1.smithi192.stdout:3/172: chown db/d2a/d2e 11001 1 2024-09-21T12:20:18.613 INFO:tasks.workunit.client.1.smithi192.stdout:0/186: truncate d3/d5/d19/f26 394818 0 2024-09-21T12:20:18.613 INFO:tasks.workunit.client.1.smithi192.stdout:0/187: readlink d3/l10 0 2024-09-21T12:20:18.614 INFO:tasks.workunit.client.1.smithi192.stdout:0/188: write d3/d5/d19/d31/f34 [2711957,39131] 0 2024-09-21T12:20:18.616 INFO:tasks.workunit.client.1.smithi192.stdout:5/385: stat d0/de/d35/l57 0 2024-09-21T12:20:18.617 INFO:tasks.workunit.client.1.smithi192.stdout:2/206: mkdir d1b/d38 0 2024-09-21T12:20:18.618 INFO:tasks.workunit.client.1.smithi192.stdout:3/173: rmdir db/d2a/d2e 39 2024-09-21T12:20:18.620 INFO:tasks.workunit.client.1.smithi192.stdout:8/294: link d14/d1a/d1d/d46/l4c d14/d1a/d1d/d20/l5d 0 2024-09-21T12:20:18.623 INFO:tasks.workunit.client.1.smithi192.stdout:2/207: dwrite d1b/f1d [0,4194304] 0 2024-09-21T12:20:18.627 INFO:tasks.workunit.client.1.smithi192.stdout:5/386: mkdir d0/d2/d7b 0 2024-09-21T12:20:18.628 INFO:tasks.workunit.client.1.smithi192.stdout:8/295: dread fa [4194304,4194304] 0 2024-09-21T12:20:18.629 INFO:tasks.workunit.client.1.smithi192.stdout:8/296: chown d14/f52 13 1 2024-09-21T12:20:18.629 INFO:tasks.workunit.client.1.smithi192.stdout:8/297: stat d14/f2a 0 2024-09-21T12:20:18.632 INFO:tasks.workunit.client.1.smithi192.stdout:7/199: truncate d6/d9/d1f/f37 1024121 0 2024-09-21T12:20:18.633 INFO:tasks.workunit.client.1.smithi192.stdout:7/200: stat d6/d9/d2d/l39 0 2024-09-21T12:20:18.635 INFO:tasks.workunit.client.1.smithi192.stdout:2/208: creat d1b/d1e/f39 x:0 0 0 2024-09-21T12:20:18.635 INFO:tasks.workunit.client.1.smithi192.stdout:1/267: write d2/d12/f3c [723989,96813] 0 2024-09-21T12:20:18.637 INFO:tasks.workunit.client.1.smithi192.stdout:2/209: write d1b/d1e/f2f [4532498,44272] 0 2024-09-21T12:20:18.638 INFO:tasks.workunit.client.1.smithi192.stdout:7/201: symlink d6/d20/l4c 0 2024-09-21T12:20:18.643 INFO:tasks.workunit.client.1.smithi192.stdout:2/210: unlink d1b/d1e/f20 0 2024-09-21T12:20:18.643 INFO:tasks.workunit.client.1.smithi192.stdout:2/211: stat d1b 0 2024-09-21T12:20:18.643 INFO:tasks.workunit.client.1.smithi192.stdout:8/298: dread d14/d1a/f25 [0,4194304] 0 2024-09-21T12:20:18.644 INFO:tasks.workunit.client.1.smithi192.stdout:1/268: dwrite d2/d12/f10 [0,4194304] 0 2024-09-21T12:20:18.646 INFO:tasks.workunit.client.1.smithi192.stdout:7/202: creat d6/d20/f4d x:0 0 0 2024-09-21T12:20:18.647 INFO:tasks.workunit.client.1.smithi192.stdout:7/203: chown d6/d20/f4d 1992562 1 2024-09-21T12:20:18.649 INFO:tasks.workunit.client.1.smithi192.stdout:5/387: creat d0/f7c x:0 0 0 2024-09-21T12:20:18.650 INFO:tasks.workunit.client.1.smithi192.stdout:3/174: dwrite db/f22 [0,4194304] 0 2024-09-21T12:20:18.652 INFO:tasks.workunit.client.1.smithi192.stdout:0/189: write d3/d5/f9 [314165,15124] 0 2024-09-21T12:20:18.653 INFO:tasks.workunit.client.1.smithi192.stdout:0/190: stat d3/f1a 0 2024-09-21T12:20:18.655 INFO:tasks.workunit.client.1.smithi192.stdout:0/191: chown d3/d6/d1d/c2e 35516 1 2024-09-21T12:20:18.657 INFO:tasks.workunit.client.1.smithi192.stdout:8/299: symlink d14/d18/l5e 0 2024-09-21T12:20:18.658 INFO:tasks.workunit.client.1.smithi192.stdout:0/192: read d3/d5/f9 [492005,24356] 0 2024-09-21T12:20:18.658 INFO:tasks.workunit.client.1.smithi192.stdout:3/175: dwrite db/f22 [0,4194304] 0 2024-09-21T12:20:18.662 INFO:tasks.workunit.client.1.smithi192.stdout:5/388: mknod d0/d65/c7d 0 2024-09-21T12:20:18.663 INFO:tasks.workunit.client.1.smithi192.stdout:6/122: sync 2024-09-21T12:20:18.664 INFO:tasks.workunit.client.1.smithi192.stdout:5/389: truncate d0/d73/f69 140502 0 2024-09-21T12:20:18.666 INFO:tasks.workunit.client.1.smithi192.stdout:1/269: mknod d2/d4d/c52 0 2024-09-21T12:20:18.666 INFO:tasks.workunit.client.1.smithi192.stdout:0/193: dwrite d3/de/f24 [4194304,4194304] 0 2024-09-21T12:20:18.668 INFO:tasks.workunit.client.1.smithi192.stdout:1/270: write d2/de/f11 [3145036,30145] 0 2024-09-21T12:20:18.676 INFO:tasks.workunit.client.1.smithi192.stdout:3/176: dread db/d16/f2c [0,4194304] 0 2024-09-21T12:20:18.681 INFO:tasks.workunit.client.1.smithi192.stdout:7/204: truncate d6/d9/f2b 3358896 0 2024-09-21T12:20:18.682 INFO:tasks.workunit.client.1.smithi192.stdout:7/205: readlink d6/d20/l34 0 2024-09-21T12:20:18.682 INFO:tasks.workunit.client.1.smithi192.stdout:5/390: symlink d0/d65/l7e 0 2024-09-21T12:20:18.683 INFO:tasks.workunit.client.1.smithi192.stdout:5/391: write d0/dc/f6f [422395,130343] 0 2024-09-21T12:20:18.687 INFO:tasks.workunit.client.1.smithi192.stdout:1/271: creat d2/da/d44/f53 x:0 0 0 2024-09-21T12:20:18.691 INFO:tasks.workunit.client.1.smithi192.stdout:1/272: dread d2/d12/f2b [0,4194304] 0 2024-09-21T12:20:18.692 INFO:tasks.workunit.client.1.smithi192.stdout:7/206: symlink d6/d20/l4e 0 2024-09-21T12:20:18.698 INFO:tasks.workunit.client.1.smithi192.stdout:0/194: link d3/d5/d19/d31/f34 d3/d5/d28/f38 0 2024-09-21T12:20:18.700 INFO:tasks.workunit.client.1.smithi192.stdout:8/300: dwrite d14/d1a/d1d/d39/f4a [0,4194304] 0 2024-09-21T12:20:18.700 INFO:tasks.workunit.client.1.smithi192.stdout:6/123: dread da/f10 [0,4194304] 0 2024-09-21T12:20:18.701 INFO:tasks.workunit.client.1.smithi192.stdout:8/301: chown d14/d1a/d1d/d20/l26 50638639 1 2024-09-21T12:20:18.702 INFO:tasks.workunit.client.1.smithi192.stdout:9/188: sync 2024-09-21T12:20:18.702 INFO:tasks.workunit.client.1.smithi192.stdout:4/191: sync 2024-09-21T12:20:18.703 INFO:tasks.workunit.client.1.smithi192.stdout:9/189: write d5/d21/d34/f25 [745499,93163] 0 2024-09-21T12:20:18.705 INFO:tasks.workunit.client.1.smithi192.stdout:2/212: link c11 d1b/c3a 0 2024-09-21T12:20:18.705 INFO:tasks.workunit.client.1.smithi192.stdout:5/392: write d0/dc/d13/d37/f56 [840115,93821] 0 2024-09-21T12:20:18.709 INFO:tasks.workunit.client.1.smithi192.stdout:6/124: mkdir da/d23 0 2024-09-21T12:20:18.710 INFO:tasks.workunit.client.1.smithi192.stdout:3/177: rmdir db/d3d 0 2024-09-21T12:20:18.717 INFO:tasks.workunit.client.1.smithi192.stdout:4/192: rename d2/db/d1a/f1c to d2/d36/f3c 0 2024-09-21T12:20:18.718 INFO:tasks.workunit.client.1.smithi192.stdout:4/193: chown d2/db/d24/f2c 0 1 2024-09-21T12:20:18.728 INFO:tasks.workunit.client.1.smithi192.stdout:5/393: dread d0/f26 [0,4194304] 0 2024-09-21T12:20:18.729 INFO:tasks.workunit.client.1.smithi192.stdout:5/394: dread d0/d73/f69 [0,4194304] 0 2024-09-21T12:20:18.732 INFO:tasks.workunit.client.1.smithi192.stdout:3/178: dread - db/d2a/d2e/f38 zero size 2024-09-21T12:20:18.734 INFO:tasks.workunit.client.1.smithi192.stdout:1/273: dwrite d2/da/fc [0,4194304] 0 2024-09-21T12:20:18.735 INFO:tasks.workunit.client.1.smithi192.stdout:6/125: dread da/f16 [0,4194304] 0 2024-09-21T12:20:18.736 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.734+0000 7fb206f60640 1 -- 172.21.15.3:0/2252673794 --> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fb2001058c0 con 0x7fb1f0074950 2024-09-21T12:20:18.737 INFO:tasks.workunit.client.1.smithi192.stdout:9/190: creat d5/d19/d32/f3a x:0 0 0 2024-09-21T12:20:18.738 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.736+0000 7fb1fdffb640 1 -- 172.21.15.3:0/2252673794 <== mgr.14217 v2:172.21.15.3:6800/2480880781 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+321 (secure 0 0 0) 0x7fb2001058c0 con 0x7fb1f0074950 2024-09-21T12:20:18.738 INFO:tasks.workunit.client.1.smithi192.stdout:7/207: write d6/d20/f47 [4479027,68177] 0 2024-09-21T12:20:18.738 INFO:tasks.workunit.client.1.smithi192.stdout:9/191: fsync d5/dc/d30/f35 0 2024-09-21T12:20:18.740 INFO:tasks.workunit.client.1.smithi192.stdout:2/213: mknod d1b/d38/c3b 0 2024-09-21T12:20:18.742 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.740+0000 7fb206f60640 1 -- 172.21.15.3:0/2252673794 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fb1f0074950 msgr2=0x7fb1f0076e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:18.742 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.740+0000 7fb206f60640 1 --2- 172.21.15.3:0/2252673794 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fb1f0074950 0x7fb1f0076e10 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb1ec006fd0 tx=0x7fb1ec008040 comp rx=0 tx=0).stop 2024-09-21T12:20:18.743 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.740+0000 7fb206f60640 1 -- 172.21.15.3:0/2252673794 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb2001024b0 msgr2=0x7fb200101da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:18.743 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.740+0000 7fb206f60640 1 --2- 172.21.15.3:0/2252673794 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb2001024b0 0x7fb200101da0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb1f4009230 tx=0x7fb1f40048f0 comp rx=0 tx=0).stop 2024-09-21T12:20:18.743 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.741+0000 7fb206f60640 1 -- 172.21.15.3:0/2252673794 shutdown_connections 2024-09-21T12:20:18.743 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.741+0000 7fb206f60640 1 --2- 172.21.15.3:0/2252673794 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fb1f0074950 0x7fb1f0076e10 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:18.743 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.741+0000 7fb206f60640 1 --2- 172.21.15.3:0/2252673794 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb200104de0 0x7fb200100460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:18.743 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.741+0000 7fb206f60640 1 --2- 172.21.15.3:0/2252673794 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb2001024b0 0x7fb200101da0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:18.743 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.741+0000 7fb206f60640 1 -- 172.21.15.3:0/2252673794 >> 172.21.15.3:0/2252673794 conn(0x7fb2000fc010 msgr2=0x7fb2000fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:20:18.743 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.741+0000 7fb206f60640 1 -- 172.21.15.3:0/2252673794 shutdown_connections 2024-09-21T12:20:18.743 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.741+0000 7fb206f60640 1 -- 172.21.15.3:0/2252673794 wait complete. 2024-09-21T12:20:18.744 INFO:tasks.workunit.client.1.smithi192.stdout:7/208: dread d6/d9/f1c [0,4194304] 0 2024-09-21T12:20:18.747 INFO:tasks.workunit.client.1.smithi192.stdout:8/302: getdents d14/d1a/d1d/d51 0 2024-09-21T12:20:18.749 INFO:tasks.workunit.client.1.smithi192.stdout:4/194: rename d2/l1e to d2/db/d24/l3d 0 2024-09-21T12:20:18.749 INFO:tasks.workunit.client.1.smithi192.stdout:7/209: dread d6/d9/d2d/d36/f41 [0,4194304] 0 2024-09-21T12:20:18.750 INFO:tasks.workunit.client.1.smithi192.stdout:9/192: readlink d5/l9 0 2024-09-21T12:20:18.751 INFO:tasks.workunit.client.1.smithi192.stdout:9/193: chown l4 244520650 1 2024-09-21T12:20:18.751 INFO:tasks.workunit.client.1.smithi192.stdout:7/210: chown d6/d9/f14 875915 1 2024-09-21T12:20:18.752 INFO:tasks.workunit.client.1.smithi192.stdout:2/214: creat d1b/d1e/f3c x:0 0 0 2024-09-21T12:20:18.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:18 smithi192 ceph-mon[35641]: pgmap v259: 65 pgs: 65 active+clean; 291 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 219 KiB/s rd, 14 MiB/s wr, 264 op/s 2024-09-21T12:20:18.758 INFO:tasks.workunit.client.1.smithi192.stdout:4/195: rmdir d2/db/d1a 39 2024-09-21T12:20:18.760 INFO:tasks.workunit.client.1.smithi192.stdout:1/274: dread d2/d12/d2f/d51/f37 [0,4194304] 0 2024-09-21T12:20:18.762 INFO:tasks.workunit.client.1.smithi192.stdout:2/215: mkdir d1b/d1e/d3d 0 2024-09-21T12:20:18.763 INFO:tasks.workunit.client.1.smithi192.stdout:7/211: read f3 [679321,52362] 0 2024-09-21T12:20:18.764 INFO:tasks.workunit.client.1.smithi192.stdout:5/395: rename d0/f8 to d0/f7f 0 2024-09-21T12:20:18.768 INFO:tasks.workunit.client.1.smithi192.stdout:2/216: dwrite d1b/f24 [0,4194304] 0 2024-09-21T12:20:18.768 INFO:tasks.workunit.client.1.smithi192.stdout:1/275: symlink d2/d12/d2f/d51/l54 0 2024-09-21T12:20:18.771 INFO:tasks.workunit.client.1.smithi192.stdout:3/179: getdents db/d2a/d2e 0 2024-09-21T12:20:18.772 INFO:tasks.workunit.client.1.smithi192.stdout:3/180: chown db/f13 3632 1 2024-09-21T12:20:18.775 INFO:tasks.workunit.client.1.smithi192.stdout:7/212: mknod d6/d9/d2d/c4f 0 2024-09-21T12:20:18.775 INFO:tasks.workunit.client.1.smithi192.stdout:2/217: dwrite d1b/d1e/f2f [4194304,4194304] 0 2024-09-21T12:20:18.775 INFO:tasks.workunit.client.1.smithi192.stdout:7/213: chown d6/f27 1 1 2024-09-21T12:20:18.777 INFO:tasks.workunit.client.1.smithi192.stdout:5/396: symlink d0/dc/d13/d37/l80 0 2024-09-21T12:20:18.777 INFO:tasks.workunit.client.1.smithi192.stdout:4/196: mkdir d2/db/d3e 0 2024-09-21T12:20:18.780 INFO:tasks.workunit.client.1.smithi192.stdout:9/194: creat d5/f3b x:0 0 0 2024-09-21T12:20:18.783 INFO:tasks.workunit.client.1.smithi192.stdout:7/214: dwrite f5 [0,4194304] 0 2024-09-21T12:20:18.785 INFO:tasks.workunit.client.1.smithi192.stdout:4/197: dwrite d2/f20 [0,4194304] 0 2024-09-21T12:20:18.788 INFO:tasks.workunit.client.1.smithi192.stdout:6/126: write da/fc [3685286,6897] 0 2024-09-21T12:20:18.794 INFO:tasks.workunit.client.1.smithi192.stdout:1/276: symlink d2/d12/d2f/d41/l55 0 2024-09-21T12:20:18.796 INFO:tasks.workunit.client.1.smithi192.stdout:9/195: creat d5/d19/f3c x:0 0 0 2024-09-21T12:20:18.797 INFO:tasks.workunit.client.1.smithi192.stdout:4/198: dwrite d2/df/f29 [0,4194304] 0 2024-09-21T12:20:18.797 INFO:tasks.workunit.client.1.smithi192.stdout:1/277: fdatasync d2/da/f27 0 2024-09-21T12:20:18.798 INFO:tasks.workunit.client.1.smithi192.stdout:3/181: creat db/d16/d18/d33/d3b/f3f x:0 0 0 2024-09-21T12:20:18.798 INFO:tasks.workunit.client.1.smithi192.stdout:8/303: dwrite d14/d1a/d1d/f49 [0,4194304] 0 2024-09-21T12:20:18.799 INFO:tasks.workunit.client.1.smithi192.stdout:1/278: fdatasync f1 0 2024-09-21T12:20:18.801 INFO:tasks.workunit.client.1.smithi192.stdout:7/215: symlink d6/d3a/l50 0 2024-09-21T12:20:18.802 INFO:tasks.workunit.client.1.smithi192.stdout:9/196: write d5/f3b [441210,36259] 0 2024-09-21T12:20:18.804 INFO:tasks.workunit.client.1.smithi192.stdout:4/199: read d2/d21/f2e [2131349,82048] 0 2024-09-21T12:20:18.806 INFO:tasks.workunit.client.1.smithi192.stdout:4/200: write d2/d19/f25 [5171853,42128] 0 2024-09-21T12:20:18.808 INFO:tasks.workunit.client.1.smithi192.stdout:5/397: getdents d0/d73/d68/d77 0 2024-09-21T12:20:18.809 INFO:tasks.workunit.client.1.smithi192.stdout:6/127: dwrite da/fc [0,4194304] 0 2024-09-21T12:20:18.811 INFO:tasks.workunit.client.1.smithi192.stdout:9/197: dread - d5/d8/d11/f2e zero size 2024-09-21T12:20:18.812 INFO:tasks.workunit.client.1.smithi192.stdout:2/218: write ff [4298902,13832] 0 2024-09-21T12:20:18.813 INFO:tasks.workunit.client.1.smithi192.stdout:4/201: rmdir d2/db 39 2024-09-21T12:20:18.813 INFO:tasks.workunit.client.1.smithi192.stdout:3/182: getdents db/d2a/d2e 0 2024-09-21T12:20:18.816 INFO:tasks.workunit.client.1.smithi192.stdout:2/219: dread - d1b/f32 zero size 2024-09-21T12:20:18.817 INFO:tasks.workunit.client.1.smithi192.stdout:7/216: rename d6/d9/d2d/d36 to d6/d9/d51 0 2024-09-21T12:20:18.819 INFO:tasks.workunit.client.1.smithi192.stdout:7/217: write d6/d9/d51/f4b [255648,101686] 0 2024-09-21T12:20:18.820 INFO:tasks.workunit.client.1.smithi192.stdout:6/128: symlink da/l24 0 2024-09-21T12:20:18.820 INFO:tasks.workunit.client.1.smithi192.stdout:6/129: readlink da/d1f/l22 0 2024-09-21T12:20:18.821 INFO:tasks.workunit.client.1.smithi192.stdout:6/130: chown da/l24 17131 1 2024-09-21T12:20:18.823 INFO:tasks.workunit.client.1.smithi192.stdout:9/198: mkdir d5/d21/d3d 0 2024-09-21T12:20:18.824 INFO:tasks.workunit.client.1.smithi192.stdout:9/199: dread - d5/d8/d11/f17 zero size 2024-09-21T12:20:18.826 INFO:tasks.workunit.client.1.smithi192.stdout:5/398: getdents d0/dc/d13/d37/d38 0 2024-09-21T12:20:18.827 INFO:tasks.workunit.client.1.smithi192.stdout:5/399: stat d0/de/d35/c4d 0 2024-09-21T12:20:18.829 INFO:tasks.workunit.client.1.smithi192.stdout:9/200: dwrite d5/fa [4194304,4194304] 0 2024-09-21T12:20:18.831 INFO:tasks.workunit.client.1.smithi192.stdout:3/183: mkdir db/d16/d18/d40 0 2024-09-21T12:20:18.832 INFO:tasks.workunit.client.1.smithi192.stdout:3/184: fdatasync db/f13 0 2024-09-21T12:20:18.836 INFO:tasks.workunit.client.1.smithi192.stdout:4/202: fsync d2/db/f26 0 2024-09-21T12:20:18.843 INFO:tasks.workunit.client.1.smithi192.stdout:7/218: link d6/d3a/f46 d6/f52 0 2024-09-21T12:20:18.847 INFO:tasks.workunit.client.1.smithi192.stdout:7/219: dread d6/ff [0,4194304] 0 2024-09-21T12:20:18.850 INFO:tasks.workunit.client.1.smithi192.stdout:4/203: link d2/db/d24/d28/f39 d2/d21/f3f 0 2024-09-21T12:20:18.853 INFO:tasks.workunit.client.1.smithi192.stdout:7/220: fsync d6/d20/f40 0 2024-09-21T12:20:18.855 INFO:tasks.workunit.client.1.smithi192.stdout:8/304: truncate f8 675013 0 2024-09-21T12:20:18.858 INFO:tasks.workunit.client.1.smithi192.stdout:7/221: dwrite f5 [4194304,4194304] 0 2024-09-21T12:20:18.860 INFO:tasks.workunit.client.1.smithi192.stdout:9/201: getdents d5/d19 0 2024-09-21T12:20:18.863 INFO:tasks.workunit.client.1.smithi192.stdout:4/204: creat d2/db/d1a/f40 x:0 0 0 2024-09-21T12:20:18.863 INFO:tasks.workunit.client.1.smithi192.stdout:5/400: dread d0/f3b [0,4194304] 0 2024-09-21T12:20:18.864 INFO:tasks.workunit.client.1.smithi192.stdout:5/401: dread - d0/dc/d13/d37/d38/f4c zero size 2024-09-21T12:20:18.864 INFO:tasks.workunit.client.1.smithi192.stdout:7/222: rmdir d6 39 2024-09-21T12:20:18.865 INFO:tasks.workunit.client.1.smithi192.stdout:5/402: dread - d0/de/f76 zero size 2024-09-21T12:20:18.872 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.870+0000 7f5b19636640 1 -- 172.21.15.3:0/771365989 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5b14102490 msgr2=0x7f5b14104880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:18.872 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.870+0000 7f5b19636640 1 --2- 172.21.15.3:0/771365989 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5b14102490 0x7f5b14104880 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f5b04009880 tx=0x7f5b0402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:20:18.872 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.870+0000 7f5b19636640 1 -- 172.21.15.3:0/771365989 shutdown_connections 2024-09-21T12:20:18.872 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.870+0000 7f5b19636640 1 --2- 172.21.15.3:0/771365989 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b14104dc0 0x7f5b141071b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:18.872 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.870+0000 7f5b19636640 1 --2- 172.21.15.3:0/771365989 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5b14102490 0x7f5b14104880 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:18.872 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.870+0000 7f5b19636640 1 -- 172.21.15.3:0/771365989 >> 172.21.15.3:0/771365989 conn(0x7f5b140fc010 msgr2=0x7f5b140fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:20:18.872 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.870+0000 7f5b19636640 1 -- 172.21.15.3:0/771365989 shutdown_connections 2024-09-21T12:20:18.873 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.870+0000 7f5b19636640 1 -- 172.21.15.3:0/771365989 wait complete. 2024-09-21T12:20:18.873 INFO:tasks.workunit.client.1.smithi192.stdout:2/220: truncate d1b/f1d 3904895 0 2024-09-21T12:20:18.873 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.871+0000 7f5b19636640 1 Processor -- start 2024-09-21T12:20:18.873 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.871+0000 7f5b19636640 1 -- start start 2024-09-21T12:20:18.876 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.872+0000 7f5b19636640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b14102490 0x7f5b14197500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:18.877 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.872+0000 7f5b19636640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5b14104dc0 0x7f5b14197a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:18.877 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.872+0000 7f5b19636640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f5b1410a7b0 con 0x7f5b14104dc0 2024-09-21T12:20:18.877 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.872+0000 7f5b19636640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5b1410a630 con 0x7f5b14102490 2024-09-21T12:20:18.877 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.872+0000 7f5b12ffd640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b14102490 0x7f5b14197500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:18.877 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.872+0000 7f5b12ffd640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b14102490 0x7f5b14197500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.3:32968/0 (socket says 172.21.15.3:32968) 2024-09-21T12:20:18.877 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.872+0000 7f5b12ffd640 1 -- 172.21.15.3:0/4065251268 learned_addr learned my addr 172.21.15.3:0/4065251268 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:20:18.877 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.872+0000 7f5b127fc640 1 --2- 172.21.15.3:0/4065251268 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5b14104dc0 0x7f5b14197a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:18.877 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.872+0000 7f5b127fc640 1 -- 172.21.15.3:0/4065251268 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b14102490 msgr2=0x7f5b14197500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:18.878 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.872+0000 7f5b127fc640 1 --2- 172.21.15.3:0/4065251268 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b14102490 0x7f5b14197500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:18.878 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.872+0000 7f5b127fc640 1 -- 172.21.15.3:0/4065251268 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b141980c0 con 0x7f5b14104dc0 2024-09-21T12:20:18.878 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.872+0000 7f5b12ffd640 1 --2- 172.21.15.3:0/4065251268 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b14102490 0x7f5b14197500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T12:20:18.878 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.873+0000 7f5b127fc640 1 --2- 172.21.15.3:0/4065251268 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5b14104dc0 0x7f5b14197a40 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f5b0800e940 tx=0x7f5b0800ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:20:18.878 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.873+0000 7f5afbfff640 1 -- 172.21.15.3:0/4065251268 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5b0800cac0 con 0x7f5b14104dc0 2024-09-21T12:20:18.878 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.873+0000 7f5b19636640 1 -- 172.21.15.3:0/4065251268 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b1419cb00 con 0x7f5b14104dc0 2024-09-21T12:20:18.878 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.873+0000 7f5afbfff640 1 -- 172.21.15.3:0/4065251268 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5b0800cc60 con 0x7f5b14104dc0 2024-09-21T12:20:18.878 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.873+0000 7f5afbfff640 1 -- 172.21.15.3:0/4065251268 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5b08018420 con 0x7f5b14104dc0 2024-09-21T12:20:18.878 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.873+0000 7f5b19636640 1 -- 172.21.15.3:0/4065251268 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b1419d030 con 0x7f5b14104dc0 2024-09-21T12:20:18.878 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.875+0000 7f5b19636640 1 -- 172.21.15.3:0/4065251268 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b14102870 con 0x7f5b14104dc0 2024-09-21T12:20:18.878 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.875+0000 7f5afbfff640 1 -- 172.21.15.3:0/4065251268 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 20) ==== 97937+0+0 (secure 0 0 0) 0x7f5b08018650 con 0x7f5b14104dc0 2024-09-21T12:20:18.879 INFO:tasks.workunit.client.1.smithi192.stdout:6/131: truncate da/f20 175583 0 2024-09-21T12:20:18.879 INFO:tasks.workunit.client.1.smithi192.stdout:4/205: mkdir d2/db/d3e/d41 0 2024-09-21T12:20:18.879 INFO:tasks.workunit.client.1.smithi192.stdout:5/403: symlink d0/d73/d68/d77/l81 0 2024-09-21T12:20:18.880 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.875+0000 7f5afbfff640 1 --2- 172.21.15.3:0/4065251268 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f5afc0748f0 0x7f5afc076db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:18.880 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.875+0000 7f5afbfff640 1 -- 172.21.15.3:0/4065251268 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5554+0+0 (secure 0 0 0) 0x7f5b080962e0 con 0x7f5b14104dc0 2024-09-21T12:20:18.880 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.876+0000 7f5b12ffd640 1 --2- 172.21.15.3:0/4065251268 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f5afc0748f0 0x7f5afc076db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:18.880 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.876+0000 7f5b12ffd640 1 --2- 172.21.15.3:0/4065251268 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f5afc0748f0 0x7f5afc076db0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5b040096c0 tx=0x7f5b04005a20 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:20:18.880 INFO:tasks.workunit.client.1.smithi192.stdout:8/305: getdents d14/d1a/d1d/d46 0 2024-09-21T12:20:18.881 INFO:tasks.workunit.client.1.smithi192.stdout:8/306: chown d14/d1a/f25 526769319 1 2024-09-21T12:20:18.881 INFO:tasks.workunit.client.1.smithi192.stdout:8/307: chown d14/d1a/c41 0 1 2024-09-21T12:20:18.881 INFO:tasks.workunit.client.1.smithi192.stdout:6/132: mknod da/d18/c25 0 2024-09-21T12:20:18.882 INFO:tasks.workunit.client.1.smithi192.stdout:6/133: write da/f21 [2179348,13685] 0 2024-09-21T12:20:18.883 INFO:tasks.workunit.client.1.smithi192.stdout:9/202: getdents d5/dc/d30 0 2024-09-21T12:20:18.884 INFO:tasks.workunit.client.1.smithi192.stdout:9/203: chown d5/f3b 103868581 1 2024-09-21T12:20:18.884 INFO:tasks.workunit.client.1.smithi192.stdout:9/204: chown d5/f3b 77663002 1 2024-09-21T12:20:18.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:18.884+0000 7f5afbfff640 1 -- 172.21.15.3:0/4065251268 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5b08067890 con 0x7f5b14104dc0 2024-09-21T12:20:18.944 INFO:tasks.workunit.client.1.smithi192.stdout:2/221: creat d1b/f3e x:0 0 0 2024-09-21T12:20:18.944 INFO:tasks.workunit.client.1.smithi192.stdout:4/206: mkdir d2/db/d34/d42 0 2024-09-21T12:20:18.944 INFO:tasks.workunit.client.1.smithi192.stdout:8/308: truncate d14/d1a/f27 922302 0 2024-09-21T12:20:18.945 INFO:tasks.workunit.client.1.smithi192.stdout:8/309: write d14/d18/f22 [1319958,115901] 0 2024-09-21T12:20:18.946 INFO:tasks.workunit.client.1.smithi192.stdout:5/404: link d0/dc/d13/d37/f56 d0/d2/d7b/f82 0 2024-09-21T12:20:18.947 INFO:tasks.workunit.client.1.smithi192.stdout:5/405: read d0/d2/d7b/f82 [122624,76244] 0 2024-09-21T12:20:18.948 INFO:tasks.workunit.client.1.smithi192.stdout:6/134: creat da/d23/f26 x:0 0 0 2024-09-21T12:20:18.949 INFO:tasks.workunit.client.1.smithi192.stdout:2/222: symlink d1b/d38/l3f 0 2024-09-21T12:20:18.954 INFO:tasks.workunit.client.1.smithi192.stdout:9/205: mknod d5/d8/d2c/c3e 0 2024-09-21T12:20:18.954 INFO:tasks.workunit.client.1.smithi192.stdout:4/207: dwrite d2/d21/f38 [0,4194304] 0 2024-09-21T12:20:18.955 INFO:tasks.workunit.client.1.smithi192.stdout:5/406: mknod d0/dc/d13/d37/c83 0 2024-09-21T12:20:18.956 INFO:tasks.workunit.client.1.smithi192.stdout:6/135: mkdir da/d1f/d27 0 2024-09-21T12:20:18.957 INFO:tasks.workunit.client.1.smithi192.stdout:6/136: readlink da/lf 0 2024-09-21T12:20:18.958 INFO:tasks.workunit.client.1.smithi192.stdout:2/223: creat d1b/d38/f40 x:0 0 0 2024-09-21T12:20:18.958 INFO:tasks.workunit.client.1.smithi192.stdout:8/310: getdents d14/d1a/d1d/d51 0 2024-09-21T12:20:18.959 INFO:tasks.workunit.client.1.smithi192.stdout:9/206: rmdir d5/d8/d2c 39 2024-09-21T12:20:18.960 INFO:tasks.workunit.client.1.smithi192.stdout:5/407: dread d0/f3b [0,4194304] 0 2024-09-21T12:20:18.965 INFO:tasks.workunit.client.1.smithi192.stdout:4/208: rename d2/db/f27 to d2/db/d3e/f43 0 2024-09-21T12:20:18.965 INFO:tasks.workunit.client.1.smithi192.stdout:4/209: write d2/f23 [867331,2238] 0 2024-09-21T12:20:18.966 INFO:tasks.workunit.client.1.smithi192.stdout:6/137: creat da/d1f/d27/f28 x:0 0 0 2024-09-21T12:20:18.967 INFO:tasks.workunit.client.1.smithi192.stdout:5/408: mkdir d0/d65/d6e/d84 0 2024-09-21T12:20:18.967 INFO:tasks.workunit.client.1.smithi192.stdout:4/210: write d2/d19/f25 [3222477,123445] 0 2024-09-21T12:20:18.968 INFO:tasks.workunit.client.1.smithi192.stdout:5/409: chown d0/de/f78 0 1 2024-09-21T12:20:18.968 INFO:tasks.workunit.client.1.smithi192.stdout:2/224: symlink d1b/l41 0 2024-09-21T12:20:18.969 INFO:tasks.workunit.client.1.smithi192.stdout:2/225: chown d1b/l34 0 1 2024-09-21T12:20:18.971 INFO:tasks.workunit.client.1.smithi192.stdout:6/138: symlink da/d18/l29 0 2024-09-21T12:20:18.972 INFO:tasks.workunit.client.1.smithi192.stdout:4/211: mknod d2/db/d3e/c44 0 2024-09-21T12:20:18.973 INFO:tasks.workunit.client.1.smithi192.stdout:4/212: write d2/db/f26 [5187453,121608] 0 2024-09-21T12:20:18.974 INFO:tasks.workunit.client.1.smithi192.stdout:0/195: sync 2024-09-21T12:20:18.976 INFO:tasks.workunit.client.1.smithi192.stdout:5/410: mkdir d0/d73/d44/d85 0 2024-09-21T12:20:18.978 INFO:tasks.workunit.client.1.smithi192.stdout:6/139: mknod da/d1f/c2a 0 2024-09-21T12:20:18.980 INFO:tasks.workunit.client.1.smithi192.stdout:4/213: unlink d2/df/f35 0 2024-09-21T12:20:18.981 INFO:tasks.workunit.client.1.smithi192.stdout:5/411: dread d0/de/d45/f72 [0,4194304] 0 2024-09-21T12:20:18.982 INFO:tasks.workunit.client.1.smithi192.stdout:6/140: write da/f16 [4092985,5745] 0 2024-09-21T12:20:18.988 INFO:tasks.workunit.client.1.smithi192.stdout:6/141: fdatasync da/f10 0 2024-09-21T12:20:18.988 INFO:tasks.workunit.client.1.smithi192.stdout:6/142: readlink da/d1f/l22 0 2024-09-21T12:20:18.990 INFO:tasks.workunit.client.1.smithi192.stdout:5/412: symlink d0/d2/d7b/l86 0 2024-09-21T12:20:18.991 INFO:tasks.workunit.client.1.smithi192.stdout:5/413: dread - d0/d2/f6b zero size 2024-09-21T12:20:18.991 INFO:tasks.workunit.client.1.smithi192.stdout:5/414: fsync d0/de/d45/f31 0 2024-09-21T12:20:18.993 INFO:tasks.workunit.client.1.smithi192.stdout:0/196: getdents d3/d5/d19/d31 0 2024-09-21T12:20:18.993 INFO:tasks.workunit.client.1.smithi192.stdout:0/197: chown d3/de 725641733 1 2024-09-21T12:20:18.997 INFO:tasks.workunit.client.1.smithi192.stdout:5/415: creat d0/de/d35/f87 x:0 0 0 2024-09-21T12:20:18.997 INFO:tasks.workunit.client.1.smithi192.stdout:5/416: truncate d0/f7f 4439023 0 2024-09-21T12:20:18.998 INFO:tasks.workunit.client.1.smithi192.stdout:5/417: stat d0/d2/c20 0 2024-09-21T12:20:19.001 INFO:tasks.workunit.client.1.smithi192.stdout:5/418: rmdir d0/de/d35 39 2024-09-21T12:20:19.004 INFO:tasks.workunit.client.1.smithi192.stdout:0/198: getdents d3/d6 0 2024-09-21T12:20:19.005 INFO:tasks.workunit.client.1.smithi192.stdout:5/419: dwrite d0/dc/f22 [0,4194304] 0 2024-09-21T12:20:19.010 INFO:tasks.workunit.client.1.smithi192.stdout:5/420: symlink d0/d65/d6e/l88 0 2024-09-21T12:20:19.019 INFO:tasks.workunit.client.1.smithi192.stdout:5/421: rename d0/d2/f43 to d0/dc/d13/d37/f89 0 2024-09-21T12:20:19.022 INFO:tasks.workunit.client.1.smithi192.stdout:5/422: readlink d0/de/d35/l4e 0 2024-09-21T12:20:19.025 INFO:tasks.workunit.client.1.smithi192.stdout:5/423: mknod d0/d65/c8a 0 2024-09-21T12:20:19.025 INFO:tasks.workunit.client.1.smithi192.stdout:5/424: read - d0/dc/d13/f5b zero size 2024-09-21T12:20:19.030 INFO:tasks.workunit.client.1.smithi192.stdout:5/425: dwrite d0/de/f76 [0,4194304] 0 2024-09-21T12:20:19.043 INFO:tasks.workunit.client.1.smithi192.stdout:1/279: sync 2024-09-21T12:20:19.045 INFO:tasks.workunit.client.1.smithi192.stdout:6/143: fsync da/d1f/d27/f28 0 2024-09-21T12:20:19.046 INFO:tasks.workunit.client.1.smithi192.stdout:9/207: dwrite d5/d21/d34/f14 [0,4194304] 0 2024-09-21T12:20:19.046 INFO:tasks.workunit.client.1.smithi192.stdout:6/144: chown da/l24 167383745 1 2024-09-21T12:20:19.048 INFO:tasks.workunit.client.1.smithi192.stdout:5/426: dread d0/d65/d6e/f29 [0,4194304] 0 2024-09-21T12:20:19.049 INFO:tasks.workunit.client.1.smithi192.stdout:1/280: dread d2/d12/d2f/d51/d24/f28 [0,4194304] 0 2024-09-21T12:20:19.050 INFO:tasks.workunit.client.1.smithi192.stdout:1/281: stat d2/da/c13 0 2024-09-21T12:20:19.051 INFO:tasks.workunit.client.1.smithi192.stdout:1/282: chown d2/c3 1957125 1 2024-09-21T12:20:19.053 INFO:tasks.workunit.client.1.smithi192.stdout:9/208: dwrite d5/fa [4194304,4194304] 0 2024-09-21T12:20:19.054 INFO:tasks.workunit.client.1.smithi192.stdout:6/145: stat da/f13 0 2024-09-21T12:20:19.054 INFO:tasks.workunit.client.1.smithi192.stdout:1/283: truncate d2/d12/d2f/d51/f4f 7780 0 2024-09-21T12:20:19.055 INFO:tasks.workunit.client.1.smithi192.stdout:6/146: write da/d23/f26 [224997,57099] 0 2024-09-21T12:20:19.058 INFO:tasks.workunit.client.1.smithi192.stdout:5/427: symlink d0/de/d35/l8b 0 2024-09-21T12:20:19.061 INFO:tasks.workunit.client.1.smithi192.stdout:6/147: dwrite da/f16 [0,4194304] 0 2024-09-21T12:20:19.062 INFO:tasks.workunit.client.1.smithi192.stdout:9/209: rename d5/dc/d1e to d5/d8/d36/d3f 0 2024-09-21T12:20:19.063 INFO:tasks.workunit.client.1.smithi192.stdout:8/311: truncate d14/d1a/d1d/f38 673281 0 2024-09-21T12:20:19.065 INFO:tasks.workunit.client.1.smithi192.stdout:1/284: mknod d2/d12/d2f/d41/c56 0 2024-09-21T12:20:19.066 INFO:tasks.workunit.client.1.smithi192.stdout:1/285: truncate d2/d12/d2f/f40 5048515 0 2024-09-21T12:20:19.071 INFO:tasks.workunit.client.1.smithi192.stdout:5/428: mknod d0/d70/c8c 0 2024-09-21T12:20:19.071 INFO:tasks.workunit.client.1.smithi192.stdout:5/429: readlink d0/de/d35/l8b 0 2024-09-21T12:20:19.072 INFO:tasks.workunit.client.1.smithi192.stdout:5/430: truncate d0/de/f78 676742 0 2024-09-21T12:20:19.077 INFO:tasks.workunit.client.1.smithi192.stdout:9/210: rename d5/d21/d34 to d5/dc/d40 0 2024-09-21T12:20:19.084 INFO:tasks.workunit.client.1.smithi192.stdout:6/148: fsync f8 0 2024-09-21T12:20:19.087 INFO:tasks.workunit.client.1.smithi192.stdout:1/286: rename d2/d12/d2f/d51/l36 to d2/de/l57 0 2024-09-21T12:20:19.089 INFO:tasks.workunit.client.1.smithi192.stdout:9/211: symlink d5/dc/d40/l41 0 2024-09-21T12:20:19.091 INFO:tasks.workunit.client.1.smithi192.stdout:3/185: sync 2024-09-21T12:20:19.091 INFO:tasks.workunit.client.1.smithi192.stdout:7/223: sync 2024-09-21T12:20:19.092 INFO:tasks.workunit.client.1.smithi192.stdout:3/186: write db/f22 [2150029,127597] 0 2024-09-21T12:20:19.092 INFO:tasks.workunit.client.1.smithi192.stdout:8/312: unlink d14/d1a/d1d/f2f 0 2024-09-21T12:20:19.093 INFO:tasks.workunit.client.1.smithi192.stdout:3/187: readlink db/l1d 0 2024-09-21T12:20:19.093 INFO:tasks.workunit.client.1.smithi192.stdout:8/313: read f11 [197368,94159] 0 2024-09-21T12:20:19.095 INFO:tasks.workunit.client.1.smithi192.stdout:5/431: symlink d0/dc/d13/l8d 0 2024-09-21T12:20:19.096 INFO:tasks.workunit.client.1.smithi192.stdout:8/314: dread f7 [4194304,4194304] 0 2024-09-21T12:20:19.099 INFO:tasks.workunit.client.1.smithi192.stdout:1/287: mkdir d2/d12/d2f/d51/d24/d58 0 2024-09-21T12:20:19.103 INFO:tasks.workunit.client.1.smithi192.stdout:7/224: truncate d6/f52 150734 0 2024-09-21T12:20:19.108 INFO:tasks.workunit.client.1.smithi192.stdout:0/199: dwrite d3/d5/d19/d31/f2b [0,4194304] 0 2024-09-21T12:20:19.109 INFO:tasks.workunit.client.1.smithi192.stdout:0/200: dread - d3/d5/f14 zero size 2024-09-21T12:20:19.110 INFO:tasks.workunit.client.1.smithi192.stdout:0/201: write d3/d5/d19/f26 [3354066,30966] 0 2024-09-21T12:20:19.114 INFO:tasks.workunit.client.1.smithi192.stdout:0/202: write d3/de/f11 [2459207,103759] 0 2024-09-21T12:20:19.114 INFO:tasks.workunit.client.1.smithi192.stdout:9/212: mkdir d5/d21/d3d/d42 0 2024-09-21T12:20:19.117 INFO:tasks.workunit.client.1.smithi192.stdout:7/225: rmdir d6/d9/d51 39 2024-09-21T12:20:19.117 INFO:tasks.workunit.client.1.smithi192.stdout:9/213: dwrite d5/dc/d40/f25 [0,4194304] 0 2024-09-21T12:20:19.118 INFO:tasks.workunit.client.1.smithi192.stdout:7/226: fdatasync f5 0 2024-09-21T12:20:19.119 INFO:tasks.workunit.client.1.smithi192.stdout:7/227: readlink d6/d9/d1f/d3e/l4a 0 2024-09-21T12:20:19.121 INFO:tasks.workunit.client.1.smithi192.stdout:3/188: symlink db/d2a/l41 0 2024-09-21T12:20:19.122 INFO:tasks.workunit.client.1.smithi192.stdout:3/189: chown db/d16/d18/l19 2101 1 2024-09-21T12:20:19.129 INFO:tasks.workunit.client.1.smithi192.stdout:6/149: link da/l17 da/l2b 0 2024-09-21T12:20:19.133 INFO:tasks.workunit.client.1.smithi192.stdout:6/150: dwrite da/fc [0,4194304] 0 2024-09-21T12:20:19.135 INFO:tasks.workunit.client.1.smithi192.stdout:0/203: mkdir d3/d5/d28/d39 0 2024-09-21T12:20:19.137 INFO:tasks.workunit.client.1.smithi192.stdout:4/214: sync 2024-09-21T12:20:19.137 INFO:tasks.workunit.client.1.smithi192.stdout:2/226: sync 2024-09-21T12:20:19.139 INFO:tasks.workunit.client.1.smithi192.stdout:2/227: readlink d1b/d1e/l1f 0 2024-09-21T12:20:19.139 INFO:tasks.workunit.client.1.smithi192.stdout:1/288: truncate d2/da/f27 672890 0 2024-09-21T12:20:19.143 INFO:tasks.workunit.client.1.smithi192.stdout:9/214: creat d5/d8/d36/f43 x:0 0 0 2024-09-21T12:20:19.146 INFO:tasks.workunit.client.1.smithi192.stdout:3/190: fdatasync db/d16/f2c 0 2024-09-21T12:20:19.148 INFO:tasks.workunit.client.1.smithi192.stdout:8/315: rename d14/d1a/d1d/d46/d5c to d14/d1a/d1d/d20/d5f 0 2024-09-21T12:20:19.150 INFO:tasks.workunit.client.1.smithi192.stdout:3/191: dread db/f1e [4194304,4194304] 0 2024-09-21T12:20:19.152 INFO:tasks.workunit.client.1.smithi192.stdout:6/151: mknod da/c2c 0 2024-09-21T12:20:19.153 INFO:tasks.workunit.client.1.smithi192.stdout:0/204: symlink d3/d5/l3a 0 2024-09-21T12:20:19.154 INFO:tasks.workunit.client.1.smithi192.stdout:0/205: chown d3/d5/f1b 70083550 1 2024-09-21T12:20:19.155 INFO:tasks.workunit.client.1.smithi192.stdout:3/192: dwrite db/d16/d18/f2f [0,4194304] 0 2024-09-21T12:20:19.158 INFO:tasks.workunit.client.1.smithi192.stdout:2/228: symlink d1b/d1e/l42 0 2024-09-21T12:20:19.159 INFO:tasks.workunit.client.1.smithi192.stdout:4/215: dread d2/d21/f2e [0,4194304] 0 2024-09-21T12:20:19.159 INFO:tasks.workunit.client.1.smithi192.stdout:2/229: fsync d1b/d1e/f36 0 2024-09-21T12:20:19.159 INFO:tasks.workunit.client.1.smithi192.stdout:9/215: mkdir d5/d8/d11/d44 0 2024-09-21T12:20:19.166 INFO:tasks.workunit.client.1.smithi192.stdout:1/289: rename d2/de/c1c to d2/d45/c59 0 2024-09-21T12:20:19.170 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.168+0000 7f5b19636640 1 -- 172.21.15.3:0/4065251268 --> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f5b14105740 con 0x7f5afc0748f0 2024-09-21T12:20:19.172 INFO:tasks.workunit.client.1.smithi192.stdout:6/152: unlink da/lf 0 2024-09-21T12:20:19.172 INFO:tasks.workunit.client.1.smithi192.stdout:6/153: chown da/d1f/d27 30284412 1 2024-09-21T12:20:19.176 INFO:tasks.workunit.client.1.smithi192.stdout:1/290: mkdir d2/da/d44/d5a 0 2024-09-21T12:20:19.182 INFO:tasks.workunit.client.1.smithi192.stdout:1/291: dwrite d2/d12/d2f/d51/f37 [0,4194304] 0 2024-09-21T12:20:19.183 INFO:tasks.workunit.client.1.smithi192.stdout:6/154: link da/f16 da/d23/f2d 0 2024-09-21T12:20:19.185 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.183+0000 7f5afbfff640 1 -- 172.21.15.3:0/4065251268 <== mgr.14217 v2:172.21.15.3:6800/2480880781 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3768 (secure 0 0 0) 0x7f5b14105740 con 0x7f5afc0748f0 2024-09-21T12:20:19.185 INFO:teuthology.orchestra.run.smithi003.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:20:19.185 INFO:teuthology.orchestra.run.smithi003.stdout:alertmanager.smithi003 smithi003 *:9093,9094 running (6m) 2m ago 7m 25.8M - 0.25.0 c8568f914cd2 5c03f233277e 2024-09-21T12:20:19.185 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-exporter.smithi003 smithi003 running (8m) 2m ago 8m 8321k - 19.1.1-373-g4e45e6b4 164465d2334a 38ef0e2dfcc4 2024-09-21T12:20:19.186 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-exporter.smithi192 smithi192 running (7m) 2m ago 7m 5259k - 19.1.1-373-g4e45e6b4 164465d2334a 848a2ec72db7 2024-09-21T12:20:19.186 INFO:teuthology.orchestra.run.smithi003.stdout:crash.smithi003 smithi003 running (8m) 2m ago 8m 6899k - 19.1.1-373-g4e45e6b4 164465d2334a c63f209dc1dc 2024-09-21T12:20:19.186 INFO:teuthology.orchestra.run.smithi003.stdout:crash.smithi192 smithi192 running (7m) 2m ago 7m 6895k - 19.1.1-373-g4e45e6b4 164465d2334a cc70c9a7b2f7 2024-09-21T12:20:19.186 INFO:teuthology.orchestra.run.smithi003.stdout:grafana.smithi003 smithi003 *:3000 running (6m) 2m ago 7m 79.4M - 9.4.12 2bacad6d85d8 f504f60818f0 2024-09-21T12:20:19.186 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi003.ebjgyl smithi003 running (2m) 2m ago 2m 11.8M - 19.1.1-373-g4e45e6b4 164465d2334a 16e0b2cac16a 2024-09-21T12:20:19.186 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi003.gfkngj smithi003 running (2m) 2m ago 2m 16.7M - 19.1.1-373-g4e45e6b4 164465d2334a 109c04f87fbd 2024-09-21T12:20:19.186 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi192.ktdqns smithi192 running (2m) 2m ago 2m 13.1M - 19.1.1-373-g4e45e6b4 164465d2334a 495c73fb3bb0 2024-09-21T12:20:19.186 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi192.ywqqxe smithi192 running (2m) 2m ago 2m 13.1M - 19.1.1-373-g4e45e6b4 164465d2334a 270a01030cbe 2024-09-21T12:20:19.186 INFO:teuthology.orchestra.run.smithi003.stdout:mgr.smithi003.wztftl smithi003 *:9283,8765,8443 running (9m) 2m ago 9m 501M - 19.1.1-373-g4e45e6b4 164465d2334a 060c1f18749f 2024-09-21T12:20:19.186 INFO:teuthology.orchestra.run.smithi003.stdout:mgr.smithi192.qsaprd smithi192 *:8443,9283,8765 starting - - - - 2024-09-21T12:20:19.186 INFO:teuthology.orchestra.run.smithi003.stdout:mon.smithi003 smithi003 running (9m) 2m ago 9m 48.4M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 16bccf2c7503 2024-09-21T12:20:19.186 INFO:teuthology.orchestra.run.smithi003.stdout:mon.smithi192 smithi192 running (7m) 2m ago 7m 35.4M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 4fe4c4b3dc5d 2024-09-21T12:20:19.186 INFO:teuthology.orchestra.run.smithi003.stdout:node-exporter.smithi003 smithi003 *:9100 running (8m) 2m ago 8m 15.8M - 1.5.0 0da6a335fe13 a1eb875faefc 2024-09-21T12:20:19.187 INFO:teuthology.orchestra.run.smithi003.stdout:node-exporter.smithi192 smithi192 *:9100 running (7m) 2m ago 7m 16.4M - 1.5.0 0da6a335fe13 10c2542c2e19 2024-09-21T12:20:19.187 INFO:teuthology.orchestra.run.smithi003.stdout:osd.0 smithi003 running (6m) 2m ago 6m 54.6M 3948M 19.1.1-373-g4e45e6b4 164465d2334a d07f1489720d 2024-09-21T12:20:19.187 INFO:teuthology.orchestra.run.smithi003.stdout:osd.1 smithi003 running (5m) 2m ago 5m 48.1M 3948M 19.1.1-373-g4e45e6b4 164465d2334a 6abd75a07645 2024-09-21T12:20:19.187 INFO:teuthology.orchestra.run.smithi003.stdout:osd.2 smithi003 running (5m) 2m ago 5m 48.4M 3948M 19.1.1-373-g4e45e6b4 164465d2334a 3265369e573b 2024-09-21T12:20:19.187 INFO:teuthology.orchestra.run.smithi003.stdout:osd.3 smithi192 running (4m) 2m ago 4m 44.4M 4970M 19.1.1-373-g4e45e6b4 164465d2334a 13efcfd71c05 2024-09-21T12:20:19.187 INFO:teuthology.orchestra.run.smithi003.stdout:osd.4 smithi192 running (4m) 2m ago 4m 44.0M 4970M 19.1.1-373-g4e45e6b4 164465d2334a f33bf453cb3e 2024-09-21T12:20:19.187 INFO:teuthology.orchestra.run.smithi003.stdout:osd.5 smithi192 running (3m) 2m ago 3m 42.0M 4970M 19.1.1-373-g4e45e6b4 164465d2334a 12d7b7c8e985 2024-09-21T12:20:19.187 INFO:teuthology.orchestra.run.smithi003.stdout:prometheus.smithi003 smithi003 *:9095 running (6m) 2m ago 7m 58.9M - 2.43.0 a07b618ecd1d 4ecd73d1b37c 2024-09-21T12:20:19.188 INFO:tasks.workunit.client.1.smithi192.stdout:1/292: mkdir d2/d12/d5b 0 2024-09-21T12:20:19.188 INFO:tasks.workunit.client.1.smithi192.stdout:2/230: getdents d1b/d38 0 2024-09-21T12:20:19.189 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.186+0000 7f5b19636640 1 -- 172.21.15.3:0/4065251268 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f5afc0748f0 msgr2=0x7f5afc076db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:19.189 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.186+0000 7f5b19636640 1 --2- 172.21.15.3:0/4065251268 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f5afc0748f0 0x7f5afc076db0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5b040096c0 tx=0x7f5b04005a20 comp rx=0 tx=0).stop 2024-09-21T12:20:19.189 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.186+0000 7f5b19636640 1 -- 172.21.15.3:0/4065251268 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5b14104dc0 msgr2=0x7f5b14197a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:19.189 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.186+0000 7f5b19636640 1 --2- 172.21.15.3:0/4065251268 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5b14104dc0 0x7f5b14197a40 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f5b0800e940 tx=0x7f5b0800ee00 comp rx=0 tx=0).stop 2024-09-21T12:20:19.189 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.187+0000 7f5b19636640 1 -- 172.21.15.3:0/4065251268 shutdown_connections 2024-09-21T12:20:19.189 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.187+0000 7f5b19636640 1 --2- 172.21.15.3:0/4065251268 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7f5afc0748f0 0x7f5afc076db0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:19.189 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.187+0000 7f5b19636640 1 --2- 172.21.15.3:0/4065251268 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5b14104dc0 0x7f5b14197a40 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:19.189 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.187+0000 7f5b19636640 1 --2- 172.21.15.3:0/4065251268 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5b14102490 0x7f5b14197500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:19.189 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.187+0000 7f5b19636640 1 -- 172.21.15.3:0/4065251268 >> 172.21.15.3:0/4065251268 conn(0x7f5b140fc010 msgr2=0x7f5b140fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:20:19.190 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.187+0000 7f5b19636640 1 -- 172.21.15.3:0/4065251268 shutdown_connections 2024-09-21T12:20:19.190 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.187+0000 7f5b19636640 1 -- 172.21.15.3:0/4065251268 wait complete. 2024-09-21T12:20:19.190 INFO:tasks.workunit.client.1.smithi192.stdout:6/155: creat da/f2e x:0 0 0 2024-09-21T12:20:19.190 INFO:tasks.workunit.client.1.smithi192.stdout:6/156: write da/d23/f26 [1126277,28800] 0 2024-09-21T12:20:19.193 INFO:tasks.workunit.client.1.smithi192.stdout:1/293: mkdir d2/d12/d2f/d41/d5c 0 2024-09-21T12:20:19.239 INFO:tasks.workunit.client.1.smithi192.stdout:5/432: truncate d0/d65/f67 231939 0 2024-09-21T12:20:19.240 INFO:tasks.workunit.client.1.smithi192.stdout:3/193: write db/d16/f2c [9879,22102] 0 2024-09-21T12:20:19.240 INFO:tasks.workunit.client.1.smithi192.stdout:7/228: write d6/d9/f11 [729885,90604] 0 2024-09-21T12:20:19.242 INFO:tasks.workunit.client.1.smithi192.stdout:3/194: chown db/c15 27 1 2024-09-21T12:20:19.242 INFO:tasks.workunit.client.1.smithi192.stdout:8/316: write d14/d1a/f31 [1257816,99223] 0 2024-09-21T12:20:19.242 INFO:tasks.workunit.client.1.smithi192.stdout:9/216: truncate d5/fa 4659579 0 2024-09-21T12:20:19.242 INFO:tasks.workunit.client.1.smithi192.stdout:7/229: write d6/d3a/f3f [982387,64010] 0 2024-09-21T12:20:19.243 INFO:tasks.workunit.client.1.smithi192.stdout:9/217: readlink d5/dc/l27 0 2024-09-21T12:20:19.244 INFO:tasks.workunit.client.1.smithi192.stdout:2/231: symlink d1b/l43 0 2024-09-21T12:20:19.245 INFO:tasks.workunit.client.1.smithi192.stdout:6/157: write da/f13 [841607,43402] 0 2024-09-21T12:20:19.245 INFO:tasks.workunit.client.1.smithi192.stdout:2/232: readlink lb 0 2024-09-21T12:20:19.245 INFO:tasks.workunit.client.1.smithi192.stdout:5/433: rename d0/d73/d68 to d0/d65/d8e 0 2024-09-21T12:20:19.246 INFO:tasks.workunit.client.1.smithi192.stdout:1/294: write d2/d12/d2f/d51/d24/f28 [974614,35822] 0 2024-09-21T12:20:19.246 INFO:tasks.workunit.client.1.smithi192.stdout:7/230: mknod d6/d3a/c53 0 2024-09-21T12:20:19.246 INFO:tasks.workunit.client.1.smithi192.stdout:8/317: truncate d14/d1a/d1d/d46/f4f 496292 0 2024-09-21T12:20:19.247 INFO:tasks.workunit.client.1.smithi192.stdout:2/233: chown d1b/c28 49783270 1 2024-09-21T12:20:19.248 INFO:tasks.workunit.client.1.smithi192.stdout:6/158: fsync da/f13 0 2024-09-21T12:20:19.248 INFO:tasks.workunit.client.1.smithi192.stdout:5/434: write d0/de/f6c [747024,116105] 0 2024-09-21T12:20:19.249 INFO:tasks.workunit.client.1.smithi192.stdout:3/195: creat db/d2a/f42 x:0 0 0 2024-09-21T12:20:19.250 INFO:tasks.workunit.client.1.smithi192.stdout:7/231: mknod d6/d20/c54 0 2024-09-21T12:20:19.251 INFO:tasks.workunit.client.1.smithi192.stdout:5/435: write d0/de/d45/f31 [320688,10322] 0 2024-09-21T12:20:19.254 INFO:tasks.workunit.client.1.smithi192.stdout:6/159: creat da/f2f x:0 0 0 2024-09-21T12:20:19.255 INFO:tasks.workunit.client.1.smithi192.stdout:3/196: creat db/d16/d18/d33/f43 x:0 0 0 2024-09-21T12:20:19.258 INFO:tasks.workunit.client.1.smithi192.stdout:5/436: dwrite d0/f6a [0,4194304] 0 2024-09-21T12:20:19.260 INFO:tasks.workunit.client.1.smithi192.stdout:8/318: rename d14/c19 to d14/d1a/d1d/d46/c60 0 2024-09-21T12:20:19.261 INFO:tasks.workunit.client.1.smithi192.stdout:1/295: creat d2/da/d44/d5a/f5d x:0 0 0 2024-09-21T12:20:19.264 INFO:tasks.workunit.client.1.smithi192.stdout:6/160: unlink da/f2e 0 2024-09-21T12:20:19.265 INFO:tasks.workunit.client.1.smithi192.stdout:1/296: dread d2/d12/d2f/d51/f37 [0,4194304] 0 2024-09-21T12:20:19.271 INFO:tasks.workunit.client.1.smithi192.stdout:9/218: dread d5/fa [0,4194304] 0 2024-09-21T12:20:19.273 INFO:tasks.workunit.client.1.smithi192.stdout:9/219: read d5/dc/d40/f25 [4083081,18831] 0 2024-09-21T12:20:19.274 INFO:tasks.workunit.client.1.smithi192.stdout:6/161: rename da/l11 to da/d18/l30 0 2024-09-21T12:20:19.278 INFO:tasks.workunit.client.1.smithi192.stdout:1/297: mkdir d2/d12/d2f/d51/d24/d5e 0 2024-09-21T12:20:19.280 INFO:tasks.workunit.client.1.smithi192.stdout:5/437: symlink d0/de/l8f 0 2024-09-21T12:20:19.285 INFO:tasks.workunit.client.1.smithi192.stdout:9/220: rename d5/d8/d11/f2e to d5/d8/d36/f45 0 2024-09-21T12:20:19.286 INFO:tasks.workunit.client.1.smithi192.stdout:9/221: chown d5/dc/d40/l20 15935 1 2024-09-21T12:20:19.288 INFO:tasks.workunit.client.1.smithi192.stdout:5/438: mknod d0/dc/d13/d37/c90 0 2024-09-21T12:20:19.288 INFO:tasks.workunit.client.1.smithi192.stdout:2/234: write d1b/f2a [4728421,108834] 0 2024-09-21T12:20:19.289 INFO:tasks.workunit.client.1.smithi192.stdout:2/235: chown d1b/d38/l3f 44 1 2024-09-21T12:20:19.291 INFO:tasks.workunit.client.1.smithi192.stdout:6/162: unlink da/l2b 0 2024-09-21T12:20:19.294 INFO:tasks.workunit.client.1.smithi192.stdout:1/298: rename d2/de/f11 to d2/d12/d2f/f5f 0 2024-09-21T12:20:19.298 INFO:tasks.workunit.client.1.smithi192.stdout:9/222: symlink d5/dc/d40/l46 0 2024-09-21T12:20:19.299 INFO:tasks.workunit.client.1.smithi192.stdout:9/223: chown d5/dc/d40/f14 2 1 2024-09-21T12:20:19.300 INFO:tasks.workunit.client.1.smithi192.stdout:1/299: dwrite d2/d12/d2f/d51/f20 [0,4194304] 0 2024-09-21T12:20:19.301 INFO:tasks.workunit.client.1.smithi192.stdout:2/236: mkdir d1b/d38/d44 0 2024-09-21T12:20:19.307 INFO:tasks.workunit.client.1.smithi192.stdout:1/300: dwrite d2/da/fc [4194304,4194304] 0 2024-09-21T12:20:19.308 INFO:tasks.workunit.client.1.smithi192.stdout:9/224: dread d5/f3b [0,4194304] 0 2024-09-21T12:20:19.310 INFO:tasks.workunit.client.1.smithi192.stdout:8/319: link d14/l30 d14/d1a/d1d/l61 0 2024-09-21T12:20:19.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.310+0000 7fdb2a7f6640 1 -- 172.21.15.3:0/1271157175 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb24101a60 msgr2=0x7fdb24101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:19.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.310+0000 7fdb2a7f6640 1 --2- 172.21.15.3:0/1271157175 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb24101a60 0x7fdb24101ee0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fdb18009880 tx=0x7fdb1802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:20:19.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.310+0000 7fdb2a7f6640 1 -- 172.21.15.3:0/1271157175 shutdown_connections 2024-09-21T12:20:19.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.310+0000 7fdb2a7f6640 1 --2- 172.21.15.3:0/1271157175 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb24101a60 0x7fdb24101ee0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:19.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.310+0000 7fdb2a7f6640 1 --2- 172.21.15.3:0/1271157175 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb24100860 0x7fdb24100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:19.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.310+0000 7fdb2a7f6640 1 -- 172.21.15.3:0/1271157175 >> 172.21.15.3:0/1271157175 conn(0x7fdb240fc010 msgr2=0x7fdb240fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:20:19.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.311+0000 7fdb2a7f6640 1 -- 172.21.15.3:0/1271157175 shutdown_connections 2024-09-21T12:20:19.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.311+0000 7fdb2a7f6640 1 -- 172.21.15.3:0/1271157175 wait complete. 2024-09-21T12:20:19.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.312+0000 7fdb2a7f6640 1 Processor -- start 2024-09-21T12:20:19.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.312+0000 7fdb2a7f6640 1 -- start start 2024-09-21T12:20:19.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.312+0000 7fdb2a7f6640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb24100860 0x7fdb240732d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:19.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.312+0000 7fdb2a7f6640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb24101a60 0x7fdb24073810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:19.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.312+0000 7fdb2a7f6640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fdb24108570 con 0x7fdb24100860 2024-09-21T12:20:19.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.312+0000 7fdb2a7f6640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fdb241083f0 con 0x7fdb24101a60 2024-09-21T12:20:19.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.313+0000 7fdb237fe640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb24101a60 0x7fdb24073810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:19.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.313+0000 7fdb237fe640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb24101a60 0x7fdb24073810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.3:32994/0 (socket says 172.21.15.3:32994) 2024-09-21T12:20:19.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.313+0000 7fdb237fe640 1 -- 172.21.15.3:0/521347410 learned_addr learned my addr 172.21.15.3:0/521347410 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:20:19.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.313+0000 7fdb23fff640 1 --2- 172.21.15.3:0/521347410 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb24100860 0x7fdb240732d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:19.316 INFO:tasks.workunit.client.1.smithi192.stdout:3/197: truncate db/d16/f2c 33899 0 2024-09-21T12:20:19.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.313+0000 7fdb237fe640 1 -- 172.21.15.3:0/521347410 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb24100860 msgr2=0x7fdb240732d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:19.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.313+0000 7fdb237fe640 1 --2- 172.21.15.3:0/521347410 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb24100860 0x7fdb240732d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:19.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.313+0000 7fdb237fe640 1 -- 172.21.15.3:0/521347410 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb24073e90 con 0x7fdb24101a60 2024-09-21T12:20:19.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.314+0000 7fdb237fe640 1 --2- 172.21.15.3:0/521347410 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb24101a60 0x7fdb24073810 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdb18009230 tx=0x7fdb18004570 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:20:19.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.315+0000 7fdb217fa640 1 -- 172.21.15.3:0/521347410 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdb1803f070 con 0x7fdb24101a60 2024-09-21T12:20:19.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.315+0000 7fdb2a7f6640 1 -- 172.21.15.3:0/521347410 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb241a7430 con 0x7fdb24101a60 2024-09-21T12:20:19.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.315+0000 7fdb2a7f6640 1 -- 172.21.15.3:0/521347410 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb241a79c0 con 0x7fdb24101a60 2024-09-21T12:20:19.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.315+0000 7fdb217fa640 1 -- 172.21.15.3:0/521347410 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdb18004a90 con 0x7fdb24101a60 2024-09-21T12:20:19.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.315+0000 7fdb217fa640 1 -- 172.21.15.3:0/521347410 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdb18035030 con 0x7fdb24101a60 2024-09-21T12:20:19.317 INFO:tasks.workunit.client.1.smithi192.stdout:1/301: dwrite d2/de/f19 [4194304,4194304] 0 2024-09-21T12:20:19.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.316+0000 7fdb2a7f6640 1 -- 172.21.15.3:0/521347410 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb2406d320 con 0x7fdb24101a60 2024-09-21T12:20:19.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.317+0000 7fdb217fa640 1 -- 172.21.15.3:0/521347410 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 20) ==== 97937+0+0 (secure 0 0 0) 0x7fdb18042070 con 0x7fdb24101a60 2024-09-21T12:20:19.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.318+0000 7fdb217fa640 1 --2- 172.21.15.3:0/521347410 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fdb0c0749a0 0x7fdb0c076e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:19.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.318+0000 7fdb217fa640 1 -- 172.21.15.3:0/521347410 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5554+0+0 (secure 0 0 0) 0x7fdb180b6ab0 con 0x7fdb24101a60 2024-09-21T12:20:19.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.319+0000 7fdb23fff640 1 --2- 172.21.15.3:0/521347410 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fdb0c0749a0 0x7fdb0c076e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:19.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.319+0000 7fdb23fff640 1 --2- 172.21.15.3:0/521347410 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fdb0c0749a0 0x7fdb0c076e60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fdb241018c0 tx=0x7fdb14005f90 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:20:19.325 INFO:tasks.workunit.client.1.smithi192.stdout:8/320: dread d14/d1a/d1d/d20/f37 [0,4194304] 0 2024-09-21T12:20:19.326 INFO:tasks.workunit.client.1.smithi192.stdout:1/302: unlink c0 0 2024-09-21T12:20:19.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.324+0000 7fdb217fa640 1 -- 172.21.15.3:0/521347410 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdb18088040 con 0x7fdb24101a60 2024-09-21T12:20:19.327 INFO:tasks.workunit.client.1.smithi192.stdout:9/225: creat d5/d21/d3d/d42/f47 x:0 0 0 2024-09-21T12:20:19.327 INFO:tasks.workunit.client.1.smithi192.stdout:9/226: fdatasync d5/d19/d32/f3a 0 2024-09-21T12:20:19.328 INFO:tasks.workunit.client.1.smithi192.stdout:9/227: stat d5/d21/f31 0 2024-09-21T12:20:19.331 INFO:tasks.workunit.client.1.smithi192.stdout:3/198: mknod db/d16/d18/c44 0 2024-09-21T12:20:19.335 INFO:tasks.workunit.client.1.smithi192.stdout:1/303: creat d2/da/f60 x:0 0 0 2024-09-21T12:20:19.336 INFO:tasks.workunit.client.1.smithi192.stdout:9/228: fdatasync d5/fa 0 2024-09-21T12:20:19.338 INFO:tasks.workunit.client.1.smithi192.stdout:3/199: rmdir db/d16/d18/d21/d23 39 2024-09-21T12:20:19.339 INFO:tasks.workunit.client.1.smithi192.stdout:1/304: fdatasync d2/d12/d2f/d51/f4f 0 2024-09-21T12:20:19.341 INFO:tasks.workunit.client.1.smithi192.stdout:5/439: dwrite d0/de/d45/f49 [0,4194304] 0 2024-09-21T12:20:19.341 INFO:tasks.workunit.client.1.smithi192.stdout:1/305: chown d2/da/f32 23330 1 2024-09-21T12:20:19.342 INFO:tasks.workunit.client.1.smithi192.stdout:2/237: link f19 d1b/f45 0 2024-09-21T12:20:19.343 INFO:tasks.workunit.client.1.smithi192.stdout:1/306: readlink d2/l1b 0 2024-09-21T12:20:19.344 INFO:tasks.workunit.client.1.smithi192.stdout:9/229: creat d5/d19/f48 x:0 0 0 2024-09-21T12:20:19.346 INFO:tasks.workunit.client.1.smithi192.stdout:6/163: dwrite da/f16 [4194304,4194304] 0 2024-09-21T12:20:19.346 INFO:tasks.workunit.client.1.smithi192.stdout:8/321: creat d14/d1a/d1d/d48/f62 x:0 0 0 2024-09-21T12:20:19.349 INFO:tasks.workunit.client.1.smithi192.stdout:3/200: dread db/f22 [0,4194304] 0 2024-09-21T12:20:19.349 INFO:tasks.workunit.client.1.smithi192.stdout:6/164: write da/f13 [637214,77597] 0 2024-09-21T12:20:19.352 INFO:tasks.workunit.client.1.smithi192.stdout:2/238: rmdir d1b/d1e 39 2024-09-21T12:20:19.356 INFO:tasks.workunit.client.1.smithi192.stdout:5/440: dread d0/dc/d13/f53 [0,4194304] 0 2024-09-21T12:20:19.357 INFO:tasks.workunit.client.1.smithi192.stdout:9/230: mknod d5/d21/c49 0 2024-09-21T12:20:19.357 INFO:tasks.workunit.client.1.smithi192.stdout:8/322: creat d14/d1a/d1d/d46/d4e/f63 x:0 0 0 2024-09-21T12:20:19.359 INFO:tasks.workunit.client.1.smithi192.stdout:8/323: read - d14/d1a/d1d/d48/f62 zero size 2024-09-21T12:20:19.362 INFO:tasks.workunit.client.1.smithi192.stdout:8/324: dread d14/d1a/f25 [0,4194304] 0 2024-09-21T12:20:19.363 INFO:tasks.workunit.client.1.smithi192.stdout:0/206: sync 2024-09-21T12:20:19.363 INFO:tasks.workunit.client.1.smithi192.stdout:4/216: sync 2024-09-21T12:20:19.363 INFO:tasks.workunit.client.1.smithi192.stdout:7/232: sync 2024-09-21T12:20:19.365 INFO:tasks.workunit.client.1.smithi192.stdout:9/231: write d5/d8/d36/f45 [546698,76029] 0 2024-09-21T12:20:19.365 INFO:tasks.workunit.client.1.smithi192.stdout:2/239: symlink d1b/d1e/l46 0 2024-09-21T12:20:19.366 INFO:tasks.workunit.client.1.smithi192.stdout:1/307: rmdir d2/d12/d5b 0 2024-09-21T12:20:19.367 INFO:tasks.workunit.client.1.smithi192.stdout:9/232: write d5/d19/f48 [232560,13284] 0 2024-09-21T12:20:19.369 INFO:tasks.workunit.client.1.smithi192.stdout:7/233: creat d6/d9/d1f/f55 x:0 0 0 2024-09-21T12:20:19.369 INFO:tasks.workunit.client.1.smithi192.stdout:0/207: creat d3/d5/d19/d31/f3b x:0 0 0 2024-09-21T12:20:19.370 INFO:tasks.workunit.client.1.smithi192.stdout:9/233: stat d5/d8/d11/f17 0 2024-09-21T12:20:19.372 INFO:tasks.workunit.client.1.smithi192.stdout:1/308: mkdir d2/d12/d2f/d41/d61 0 2024-09-21T12:20:19.372 INFO:tasks.workunit.client.1.smithi192.stdout:6/165: fdatasync da/f13 0 2024-09-21T12:20:19.379 INFO:tasks.workunit.client.1.smithi192.stdout:2/240: dwrite f15 [0,4194304] 0 2024-09-21T12:20:19.379 INFO:tasks.workunit.client.1.smithi192.stdout:6/166: creat da/d1f/f31 x:0 0 0 2024-09-21T12:20:19.381 INFO:tasks.workunit.client.1.smithi192.stdout:1/309: mknod d2/d12/d2f/d51/c62 0 2024-09-21T12:20:19.382 INFO:tasks.workunit.client.1.smithi192.stdout:6/167: fdatasync da/d23/f2d 0 2024-09-21T12:20:19.385 INFO:tasks.workunit.client.1.smithi192.stdout:2/241: creat d1b/d1e/f47 x:0 0 0 2024-09-21T12:20:19.387 INFO:tasks.workunit.client.1.smithi192.stdout:3/201: dread db/f13 [0,4194304] 0 2024-09-21T12:20:19.387 INFO:tasks.workunit.client.1.smithi192.stdout:0/208: dwrite d3/f1a [0,4194304] 0 2024-09-21T12:20:19.388 INFO:tasks.workunit.client.1.smithi192.stdout:6/168: stat da/l17 0 2024-09-21T12:20:19.389 INFO:tasks.workunit.client.1.smithi192.stdout:1/310: creat d2/d12/f63 x:0 0 0 2024-09-21T12:20:19.391 INFO:tasks.workunit.client.1.smithi192.stdout:9/234: dread d5/fa [0,4194304] 0 2024-09-21T12:20:19.394 INFO:tasks.workunit.client.1.smithi192.stdout:5/441: dwrite d0/d2/d7b/f82 [0,4194304] 0 2024-09-21T12:20:19.395 INFO:tasks.workunit.client.1.smithi192.stdout:0/209: fsync d3/d5/d28/f38 0 2024-09-21T12:20:19.397 INFO:tasks.workunit.client.1.smithi192.stdout:4/217: dwrite d2/db/d3e/f43 [0,4194304] 0 2024-09-21T12:20:19.398 INFO:tasks.workunit.client.1.smithi192.stdout:5/442: chown d0/f6a 11583689 1 2024-09-21T12:20:19.398 INFO:tasks.workunit.client.1.smithi192.stdout:1/311: truncate d2/d12/d2f/d51/f4f 286732 0 2024-09-21T12:20:19.401 INFO:tasks.workunit.client.1.smithi192.stdout:4/218: write d2/db/f26 [2021827,64910] 0 2024-09-21T12:20:19.402 INFO:tasks.workunit.client.1.smithi192.stdout:5/443: write d0/dc/d13/f5b [796657,60465] 0 2024-09-21T12:20:19.403 INFO:tasks.workunit.client.1.smithi192.stdout:2/242: dread d1b/f24 [0,4194304] 0 2024-09-21T12:20:19.404 INFO:tasks.workunit.client.1.smithi192.stdout:6/169: dread da/d23/f2d [0,4194304] 0 2024-09-21T12:20:19.404 INFO:tasks.workunit.client.1.smithi192.stdout:1/312: truncate d2/da/f60 473314 0 2024-09-21T12:20:19.406 INFO:tasks.workunit.client.1.smithi192.stdout:0/210: creat d3/de/d33/f3c x:0 0 0 2024-09-21T12:20:19.407 INFO:tasks.workunit.client.1.smithi192.stdout:3/202: link db/f22 db/d2a/d2e/f45 0 2024-09-21T12:20:19.409 INFO:tasks.workunit.client.1.smithi192.stdout:6/170: mknod da/d1f/c32 0 2024-09-21T12:20:19.411 INFO:tasks.workunit.client.1.smithi192.stdout:0/211: mknod d3/d6/c3d 0 2024-09-21T12:20:19.413 INFO:tasks.workunit.client.1.smithi192.stdout:2/243: truncate d1b/f1d 398169 0 2024-09-21T12:20:19.413 INFO:tasks.workunit.client.1.smithi192.stdout:4/219: dwrite d2/f23 [0,4194304] 0 2024-09-21T12:20:19.414 INFO:tasks.workunit.client.1.smithi192.stdout:0/212: read - d3/d5/d19/d31/f3b zero size 2024-09-21T12:20:19.415 INFO:tasks.workunit.client.1.smithi192.stdout:6/171: unlink da/d23/f2d 0 2024-09-21T12:20:19.415 INFO:tasks.workunit.client.1.smithi192.stdout:0/213: chown d3/d5/d19/c27 0 1 2024-09-21T12:20:19.416 INFO:tasks.workunit.client.1.smithi192.stdout:0/214: read - d3/de/d33/f3c zero size 2024-09-21T12:20:19.418 INFO:tasks.workunit.client.1.smithi192.stdout:0/215: chown d3/f1a 897587 1 2024-09-21T12:20:19.418 INFO:tasks.workunit.client.1.smithi192.stdout:2/244: mknod d1b/d1e/d3d/c48 0 2024-09-21T12:20:19.419 INFO:tasks.workunit.client.1.smithi192.stdout:3/203: dread db/d16/d18/f3a [0,4194304] 0 2024-09-21T12:20:19.420 INFO:tasks.workunit.client.1.smithi192.stdout:2/245: stat d1b/d1e/f3c 0 2024-09-21T12:20:19.421 INFO:tasks.workunit.client.1.smithi192.stdout:2/246: dread - d1b/d1e/f47 zero size 2024-09-21T12:20:19.422 INFO:tasks.workunit.client.1.smithi192.stdout:0/216: creat d3/d5/d19/f3e x:0 0 0 2024-09-21T12:20:19.424 INFO:tasks.workunit.client.1.smithi192.stdout:4/220: dwrite d2/df/f30 [0,4194304] 0 2024-09-21T12:20:19.425 INFO:tasks.workunit.client.1.smithi192.stdout:6/172: dread da/d23/f26 [0,4194304] 0 2024-09-21T12:20:19.427 INFO:tasks.workunit.client.1.smithi192.stdout:0/217: fdatasync d3/d5/f9 0 2024-09-21T12:20:19.429 INFO:tasks.workunit.client.1.smithi192.stdout:4/221: rmdir d2/db 39 2024-09-21T12:20:19.429 INFO:tasks.workunit.client.1.smithi192.stdout:2/247: chown d1b/f1d 2600940 1 2024-09-21T12:20:19.430 INFO:tasks.workunit.client.1.smithi192.stdout:4/222: write d2/df/f30 [4022195,124209] 0 2024-09-21T12:20:19.437 INFO:tasks.workunit.client.1.smithi192.stdout:2/248: creat d1b/d38/f49 x:0 0 0 2024-09-21T12:20:19.437 INFO:tasks.workunit.client.1.smithi192.stdout:2/249: stat ff 0 2024-09-21T12:20:19.439 INFO:tasks.workunit.client.1.smithi192.stdout:4/223: truncate d2/db/d1a/f2b 1616535 0 2024-09-21T12:20:19.441 INFO:tasks.workunit.client.1.smithi192.stdout:5/444: dread d0/d65/d6e/f32 [0,4194304] 0 2024-09-21T12:20:19.442 INFO:tasks.workunit.client.1.smithi192.stdout:2/250: mknod d1b/d1e/c4a 0 2024-09-21T12:20:19.443 INFO:tasks.workunit.client.1.smithi192.stdout:4/224: unlink d2/db/d3e/c44 0 2024-09-21T12:20:19.444 INFO:tasks.workunit.client.1.smithi192.stdout:0/218: rmdir d3/d6/d2c 0 2024-09-21T12:20:19.445 INFO:tasks.workunit.client.1.smithi192.stdout:3/204: link db/d16/d18/d21/d23/l25 db/l46 0 2024-09-21T12:20:19.446 INFO:tasks.workunit.client.1.smithi192.stdout:5/445: mkdir d0/d65/d6e/d91 0 2024-09-21T12:20:19.447 INFO:tasks.workunit.client.1.smithi192.stdout:2/251: creat d1b/d1e/d3d/f4b x:0 0 0 2024-09-21T12:20:19.449 INFO:tasks.workunit.client.1.smithi192.stdout:4/225: creat d2/db/d3e/f45 x:0 0 0 2024-09-21T12:20:19.449 INFO:tasks.workunit.client.1.smithi192.stdout:6/173: getdents da/d18 0 2024-09-21T12:20:19.450 INFO:tasks.workunit.client.1.smithi192.stdout:0/219: creat d3/d6/f3f x:0 0 0 2024-09-21T12:20:19.451 INFO:tasks.workunit.client.1.smithi192.stdout:0/220: readlink d3/d5/l29 0 2024-09-21T12:20:19.451 INFO:tasks.workunit.client.1.smithi192.stdout:3/205: mknod db/d16/d18/d21/d23/c47 0 2024-09-21T12:20:19.452 INFO:tasks.workunit.client.1.smithi192.stdout:5/446: creat d0/d65/d6e/f92 x:0 0 0 2024-09-21T12:20:19.456 INFO:tasks.workunit.client.1.smithi192.stdout:0/221: rmdir d3/d6/d1d 39 2024-09-21T12:20:19.456 INFO:tasks.workunit.client.1.smithi192.stdout:0/222: chown d3/d5/d19/c1f 16901511 1 2024-09-21T12:20:19.457 INFO:tasks.workunit.client.1.smithi192.stdout:0/223: dread - d3/d5/d19/f3e zero size 2024-09-21T12:20:19.458 INFO:tasks.workunit.client.1.smithi192.stdout:3/206: rename db/f14 to db/d16/d18/d33/f48 0 2024-09-21T12:20:19.458 INFO:tasks.workunit.client.1.smithi192.stdout:3/207: dread - db/d2a/d2e/f38 zero size 2024-09-21T12:20:19.461 INFO:tasks.workunit.client.1.smithi192.stdout:3/208: dread db/d16/d18/f2f [0,4194304] 0 2024-09-21T12:20:19.465 INFO:tasks.workunit.client.1.smithi192.stdout:2/252: creat d1b/f4c x:0 0 0 2024-09-21T12:20:19.467 INFO:tasks.workunit.client.1.smithi192.stdout:5/447: creat d0/d73/d44/d85/f93 x:0 0 0 2024-09-21T12:20:19.472 INFO:tasks.workunit.client.1.smithi192.stdout:5/448: creat d0/d73/d44/d85/f94 x:0 0 0 2024-09-21T12:20:19.474 INFO:tasks.workunit.client.1.smithi192.stdout:3/209: truncate db/f13 2202607 0 2024-09-21T12:20:19.479 INFO:tasks.workunit.client.1.smithi192.stdout:0/224: link d3/d6/c21 d3/d6/c40 0 2024-09-21T12:20:19.482 INFO:tasks.workunit.client.1.smithi192.stdout:3/210: symlink db/d16/d18/d21/l49 0 2024-09-21T12:20:19.484 INFO:tasks.workunit.client.1.smithi192.stdout:2/253: getdents d1b/d1e/d3d 0 2024-09-21T12:20:19.485 INFO:tasks.workunit.client.1.smithi192.stdout:0/225: dread d3/d5/f9 [0,4194304] 0 2024-09-21T12:20:19.485 INFO:tasks.workunit.client.1.smithi192.stdout:6/174: write f8 [764779,90688] 0 2024-09-21T12:20:19.485 INFO:tasks.workunit.client.1.smithi192.stdout:5/449: dread d0/d2/f14 [0,4194304] 0 2024-09-21T12:20:19.485 INFO:tasks.workunit.client.1.smithi192.stdout:3/211: mkdir db/d16/d18/d33/d4a 0 2024-09-21T12:20:19.487 INFO:tasks.workunit.client.1.smithi192.stdout:3/212: chown db/d16/d18/f3a 43 1 2024-09-21T12:20:19.487 INFO:tasks.workunit.client.1.smithi192.stdout:5/450: write d0/de/d45/f5a [619405,110447] 0 2024-09-21T12:20:19.490 INFO:tasks.workunit.client.1.smithi192.stdout:4/226: truncate d2/d21/f38 2634727 0 2024-09-21T12:20:19.491 INFO:tasks.workunit.client.1.smithi192.stdout:0/226: rename d3/d5/d28/f38 to d3/d5/d28/d39/f41 0 2024-09-21T12:20:19.492 INFO:tasks.workunit.client.1.smithi192.stdout:6/175: dwrite da/f2f [0,4194304] 0 2024-09-21T12:20:19.493 INFO:tasks.workunit.client.1.smithi192.stdout:6/176: chown da/d1f/l22 229292392 1 2024-09-21T12:20:19.499 INFO:tasks.workunit.client.1.smithi192.stdout:3/213: symlink db/d16/l4b 0 2024-09-21T12:20:19.501 INFO:tasks.workunit.client.1.smithi192.stdout:4/227: dwrite d2/d36/f3c [4194304,4194304] 0 2024-09-21T12:20:19.501 INFO:tasks.workunit.client.1.smithi192.stdout:5/451: rename d0/dc/c62 to d0/d65/d6e/d91/c95 0 2024-09-21T12:20:19.506 INFO:tasks.workunit.client.1.smithi192.stdout:6/177: creat da/d18/f33 x:0 0 0 2024-09-21T12:20:19.507 INFO:tasks.workunit.client.1.smithi192.stdout:6/178: dread - da/d1f/d27/f28 zero size 2024-09-21T12:20:19.509 INFO:tasks.workunit.client.1.smithi192.stdout:3/214: dread db/d16/f2c [0,4194304] 0 2024-09-21T12:20:19.517 INFO:tasks.workunit.client.1.smithi192.stdout:5/452: dwrite d0/de/f2a [0,4194304] 0 2024-09-21T12:20:19.518 INFO:tasks.workunit.client.1.smithi192.stdout:6/179: rename da/f10 to da/d23/f34 0 2024-09-21T12:20:19.518 INFO:tasks.workunit.client.1.smithi192.stdout:6/180: readlink l9 0 2024-09-21T12:20:19.526 INFO:tasks.workunit.client.1.smithi192.stdout:6/181: creat da/f35 x:0 0 0 2024-09-21T12:20:19.530 INFO:tasks.workunit.client.1.smithi192.stdout:3/215: symlink db/d16/d18/d40/l4c 0 2024-09-21T12:20:19.530 INFO:tasks.workunit.client.1.smithi192.stdout:0/227: getdents d3/d6/d1d 0 2024-09-21T12:20:19.531 INFO:tasks.workunit.client.1.smithi192.stdout:6/182: mknod da/d23/c36 0 2024-09-21T12:20:19.533 INFO:tasks.workunit.client.1.smithi192.stdout:2/254: write f19 [648760,117836] 0 2024-09-21T12:20:19.535 INFO:tasks.workunit.client.1.smithi192.stdout:0/228: symlink d3/d5/d28/d39/l42 0 2024-09-21T12:20:19.535 INFO:tasks.workunit.client.1.smithi192.stdout:0/229: fsync d3/d6/f3f 0 2024-09-21T12:20:19.537 INFO:tasks.workunit.client.1.smithi192.stdout:3/216: symlink db/d16/d18/d21/l4d 0 2024-09-21T12:20:19.538 INFO:tasks.workunit.client.1.smithi192.stdout:2/255: write fe [3509873,52154] 0 2024-09-21T12:20:19.539 INFO:tasks.workunit.client.1.smithi192.stdout:2/256: write d1b/d1e/f47 [837986,70449] 0 2024-09-21T12:20:19.539 INFO:tasks.workunit.client.1.smithi192.stdout:5/453: write d0/d73/f69 [488611,28131] 0 2024-09-21T12:20:19.540 INFO:tasks.workunit.client.1.smithi192.stdout:2/257: chown l16 796 1 2024-09-21T12:20:19.543 INFO:tasks.workunit.client.1.smithi192.stdout:3/217: rmdir db/d16 39 2024-09-21T12:20:19.547 INFO:tasks.workunit.client.1.smithi192.stdout:5/454: dwrite d0/dc/d13/d37/f56 [0,4194304] 0 2024-09-21T12:20:19.548 INFO:tasks.workunit.client.1.smithi192.stdout:2/258: rename d1b/f32 to d1b/d38/f4d 0 2024-09-21T12:20:19.548 INFO:tasks.workunit.client.1.smithi192.stdout:5/455: chown d0/de/d35/l8b 0 1 2024-09-21T12:20:19.549 INFO:tasks.workunit.client.1.smithi192.stdout:2/259: chown d1b/d1e/d3d/c48 0 1 2024-09-21T12:20:19.556 INFO:tasks.workunit.client.1.smithi192.stdout:6/183: dwrite da/f16 [4194304,4194304] 0 2024-09-21T12:20:19.557 INFO:tasks.workunit.client.1.smithi192.stdout:6/184: readlink l9 0 2024-09-21T12:20:19.561 INFO:tasks.workunit.client.1.smithi192.stdout:3/218: symlink db/d16/d18/d33/d4a/l4e 0 2024-09-21T12:20:19.561 INFO:tasks.workunit.client.1.smithi192.stdout:5/456: link d0/dc/cb d0/d2/d7b/c96 0 2024-09-21T12:20:19.561 INFO:tasks.workunit.client.1.smithi192.stdout:6/185: rename da/d18 to da/d23/d37 0 2024-09-21T12:20:19.564 INFO:tasks.workunit.client.1.smithi192.stdout:6/186: mknod da/d23/d37/c38 0 2024-09-21T12:20:19.565 INFO:tasks.workunit.client.1.smithi192.stdout:3/219: creat db/f4f x:0 0 0 2024-09-21T12:20:19.566 INFO:tasks.workunit.client.1.smithi192.stdout:5/457: rename d0/de to d0/d73/d44/d85/d97 0 2024-09-21T12:20:19.567 INFO:tasks.workunit.client.1.smithi192.stdout:0/230: dwrite d3/d5/d19/d31/f34 [0,4194304] 0 2024-09-21T12:20:19.568 INFO:tasks.workunit.client.1.smithi192.stdout:5/458: write d0/d2/f6b [613962,29612] 0 2024-09-21T12:20:19.569 INFO:tasks.workunit.client.1.smithi192.stdout:6/187: rename da/f2f to da/d23/d37/f39 0 2024-09-21T12:20:19.571 INFO:tasks.workunit.client.1.smithi192.stdout:0/231: mkdir d3/de/d43 0 2024-09-21T12:20:19.573 INFO:tasks.workunit.client.1.smithi192.stdout:0/232: mknod d3/de/d43/c44 0 2024-09-21T12:20:19.574 INFO:tasks.workunit.client.1.smithi192.stdout:6/188: link c4 da/d23/d37/c3a 0 2024-09-21T12:20:19.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:19 smithi003 ceph-mon[28057]: from='client.24413 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:20:19.627 INFO:tasks.workunit.client.1.smithi192.stdout:2/260: getdents d1b 0 2024-09-21T12:20:19.627 INFO:tasks.workunit.client.1.smithi192.stdout:0/233: chown d3/d6/c18 846 1 2024-09-21T12:20:19.628 INFO:tasks.workunit.client.1.smithi192.stdout:2/261: symlink d1b/d38/l4e 0 2024-09-21T12:20:19.630 INFO:tasks.workunit.client.1.smithi192.stdout:0/234: unlink d3/d6/l8 0 2024-09-21T12:20:19.630 INFO:tasks.workunit.client.1.smithi192.stdout:2/262: fsync d1b/d1e/f2f 0 2024-09-21T12:20:19.633 INFO:tasks.workunit.client.1.smithi192.stdout:2/263: unlink d1b/d1e/f3c 0 2024-09-21T12:20:19.635 INFO:tasks.workunit.client.1.smithi192.stdout:0/235: symlink d3/de/d33/l45 0 2024-09-21T12:20:19.636 INFO:tasks.workunit.client.1.smithi192.stdout:5/459: dwrite d0/d65/d6e/f34 [0,4194304] 0 2024-09-21T12:20:19.636 INFO:tasks.workunit.client.1.smithi192.stdout:6/189: dwrite da/fc [0,4194304] 0 2024-09-21T12:20:19.639 INFO:tasks.workunit.client.1.smithi192.stdout:5/460: truncate d0/d65/d6e/f92 841528 0 2024-09-21T12:20:19.646 INFO:tasks.workunit.client.1.smithi192.stdout:6/190: link da/d23/d37/f39 da/f3b 0 2024-09-21T12:20:19.648 INFO:tasks.workunit.client.1.smithi192.stdout:0/236: dwrite d3/de/d33/f3c [0,4194304] 0 2024-09-21T12:20:19.653 INFO:tasks.workunit.client.1.smithi192.stdout:6/191: creat da/d1f/f3c x:0 0 0 2024-09-21T12:20:19.654 INFO:tasks.workunit.client.1.smithi192.stdout:6/192: dread - da/f35 zero size 2024-09-21T12:20:19.656 INFO:tasks.workunit.client.1.smithi192.stdout:0/237: chown d3/d6/c40 15 1 2024-09-21T12:20:19.658 INFO:tasks.workunit.client.1.smithi192.stdout:5/461: getdents d0/d73/d44/d85/d97 0 2024-09-21T12:20:19.660 INFO:tasks.workunit.client.1.smithi192.stdout:5/462: readlink d0/d73/d44/d85/d97/d45/l66 0 2024-09-21T12:20:19.662 INFO:tasks.workunit.client.1.smithi192.stdout:0/238: link d3/de/l37 d3/d5/d28/l46 0 2024-09-21T12:20:19.663 INFO:tasks.workunit.client.1.smithi192.stdout:0/239: write d3/de/f11 [3424633,36500] 0 2024-09-21T12:20:19.665 INFO:tasks.workunit.client.1.smithi192.stdout:2/264: dread d1b/d1e/f2f [0,4194304] 0 2024-09-21T12:20:19.666 INFO:tasks.workunit.client.1.smithi192.stdout:5/463: getdents d0/dc/d13/d37 0 2024-09-21T12:20:19.669 INFO:tasks.workunit.client.1.smithi192.stdout:5/464: mkdir d0/d65/d8e/d98 0 2024-09-21T12:20:19.672 INFO:tasks.workunit.client.1.smithi192.stdout:5/465: mkdir d0/d65/d6e/d99 0 2024-09-21T12:20:19.673 INFO:tasks.workunit.client.1.smithi192.stdout:2/265: dwrite d1b/f24 [0,4194304] 0 2024-09-21T12:20:19.675 INFO:tasks.workunit.client.1.smithi192.stdout:2/266: write d1b/d1e/f36 [680164,71445] 0 2024-09-21T12:20:19.675 INFO:tasks.workunit.client.1.smithi192.stdout:6/193: truncate da/f3b 3284698 0 2024-09-21T12:20:19.677 INFO:tasks.workunit.client.1.smithi192.stdout:6/194: write da/fc [1360194,122693] 0 2024-09-21T12:20:19.679 INFO:tasks.workunit.client.1.smithi192.stdout:5/466: mknod d0/c9a 0 2024-09-21T12:20:19.679 INFO:tasks.workunit.client.1.smithi192.stdout:0/240: write d3/de/d33/f35 [1051541,117705] 0 2024-09-21T12:20:19.681 INFO:tasks.workunit.client.1.smithi192.stdout:6/195: read da/f13 [627803,9442] 0 2024-09-21T12:20:19.682 INFO:tasks.workunit.client.1.smithi192.stdout:5/467: read d0/d73/f69 [195312,111934] 0 2024-09-21T12:20:19.684 INFO:tasks.workunit.client.1.smithi192.stdout:0/241: mknod d3/de/d43/c47 0 2024-09-21T12:20:19.686 INFO:tasks.workunit.client.1.smithi192.stdout:0/242: fdatasync d3/d6/fd 0 2024-09-21T12:20:19.688 INFO:tasks.workunit.client.1.smithi192.stdout:2/267: dwrite d1b/d1e/f39 [0,4194304] 0 2024-09-21T12:20:19.689 INFO:tasks.workunit.client.1.smithi192.stdout:0/243: symlink d3/d5/d19/l48 0 2024-09-21T12:20:19.692 INFO:tasks.workunit.client.1.smithi192.stdout:2/268: read fd [3517690,24433] 0 2024-09-21T12:20:19.693 INFO:tasks.workunit.client.1.smithi192.stdout:5/468: dwrite d0/dc/d13/d37/d38/f4c [0,4194304] 0 2024-09-21T12:20:19.695 INFO:tasks.workunit.client.1.smithi192.stdout:0/244: mknod d3/d6/d1d/c49 0 2024-09-21T12:20:19.699 INFO:tasks.workunit.client.1.smithi192.stdout:2/269: mknod d1b/d38/c4f 0 2024-09-21T12:20:19.699 INFO:tasks.workunit.client.1.smithi192.stdout:8/325: sync 2024-09-21T12:20:19.700 INFO:tasks.workunit.client.1.smithi192.stdout:7/234: sync 2024-09-21T12:20:19.701 INFO:tasks.workunit.client.1.smithi192.stdout:2/270: chown d1b/d1e/l46 1 1 2024-09-21T12:20:19.702 INFO:tasks.workunit.client.1.smithi192.stdout:2/271: dread - d1b/d1e/f2d zero size 2024-09-21T12:20:19.702 INFO:tasks.workunit.client.1.smithi192.stdout:5/469: rename d0/d65/l7e to d0/dc/d13/d37/l9b 0 2024-09-21T12:20:19.702 INFO:tasks.workunit.client.1.smithi192.stdout:2/272: readlink d1b/l22 0 2024-09-21T12:20:19.704 INFO:tasks.workunit.client.1.smithi192.stdout:0/245: rmdir d3/d5/d28 39 2024-09-21T12:20:19.706 INFO:tasks.workunit.client.1.smithi192.stdout:7/235: fsync d6/ff 0 2024-09-21T12:20:19.708 INFO:tasks.workunit.client.1.smithi192.stdout:7/236: readlink d6/d20/l34 0 2024-09-21T12:20:19.710 INFO:tasks.workunit.client.1.smithi192.stdout:0/246: unlink d3/d5/d19/c27 0 2024-09-21T12:20:19.711 INFO:tasks.workunit.client.1.smithi192.stdout:2/273: dwrite d1b/d1e/f39 [0,4194304] 0 2024-09-21T12:20:19.713 INFO:tasks.workunit.client.1.smithi192.stdout:7/237: symlink d6/d3a/l56 0 2024-09-21T12:20:19.713 INFO:tasks.workunit.client.1.smithi192.stdout:8/326: dread f11 [0,4194304] 0 2024-09-21T12:20:19.713 INFO:tasks.workunit.client.1.smithi192.stdout:2/274: chown d1b/l41 18 1 2024-09-21T12:20:19.716 INFO:tasks.workunit.client.1.smithi192.stdout:0/247: creat d3/de/d33/f4a x:0 0 0 2024-09-21T12:20:19.717 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.715+0000 7fdb2a7f6640 1 -- 172.21.15.3:0/521347410 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fdb24062df0 con 0x7fdb24101a60 2024-09-21T12:20:19.718 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-21T12:20:19.718 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": { 2024-09-21T12:20:19.718 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2 2024-09-21T12:20:19.718 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:20:19.718 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": { 2024-09-21T12:20:19.718 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T12:20:19.718 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 1 2024-09-21T12:20:19.718 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:20:19.718 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": { 2024-09-21T12:20:19.719 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 6 2024-09-21T12:20:19.719 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:20:19.719 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": { 2024-09-21T12:20:19.719 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 4 2024-09-21T12:20:19.719 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:20:19.719 INFO:teuthology.orchestra.run.smithi003.stdout: "overall": { 2024-09-21T12:20:19.719 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 13, 2024-09-21T12:20:19.719 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 1 2024-09-21T12:20:19.719 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-21T12:20:19.719 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-21T12:20:19.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.716+0000 7fdb217fa640 1 -- 172.21.15.3:0/521347410 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+841 (secure 0 0 0) 0x7fdb1808c870 con 0x7fdb24101a60 2024-09-21T12:20:19.720 INFO:tasks.workunit.client.1.smithi192.stdout:7/238: unlink d6/d9/c1d 0 2024-09-21T12:20:19.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.720+0000 7fdb2a7f6640 1 -- 172.21.15.3:0/521347410 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fdb0c0749a0 msgr2=0x7fdb0c076e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:19.722 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.720+0000 7fdb2a7f6640 1 --2- 172.21.15.3:0/521347410 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fdb0c0749a0 0x7fdb0c076e60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fdb241018c0 tx=0x7fdb14005f90 comp rx=0 tx=0).stop 2024-09-21T12:20:19.722 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.720+0000 7fdb2a7f6640 1 -- 172.21.15.3:0/521347410 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb24101a60 msgr2=0x7fdb24073810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:19.722 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.720+0000 7fdb2a7f6640 1 --2- 172.21.15.3:0/521347410 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb24101a60 0x7fdb24073810 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fdb18009230 tx=0x7fdb18004570 comp rx=0 tx=0).stop 2024-09-21T12:20:19.722 INFO:tasks.workunit.client.1.smithi192.stdout:8/327: truncate ff 1613322 0 2024-09-21T12:20:19.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.720+0000 7fdb2a7f6640 1 -- 172.21.15.3:0/521347410 shutdown_connections 2024-09-21T12:20:19.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.720+0000 7fdb2a7f6640 1 --2- 172.21.15.3:0/521347410 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fdb0c0749a0 0x7fdb0c076e60 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:19.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.720+0000 7fdb2a7f6640 1 --2- 172.21.15.3:0/521347410 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdb24101a60 0x7fdb24073810 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:19.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.720+0000 7fdb2a7f6640 1 --2- 172.21.15.3:0/521347410 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdb24100860 0x7fdb240732d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:19.723 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.720+0000 7fdb2a7f6640 1 -- 172.21.15.3:0/521347410 >> 172.21.15.3:0/521347410 conn(0x7fdb240fc010 msgr2=0x7fdb24104e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:20:19.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.720+0000 7fdb2a7f6640 1 -- 172.21.15.3:0/521347410 shutdown_connections 2024-09-21T12:20:19.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.721+0000 7fdb2a7f6640 1 -- 172.21.15.3:0/521347410 wait complete. 2024-09-21T12:20:19.726 INFO:tasks.workunit.client.1.smithi192.stdout:5/470: link d0/d2/d7b/l86 d0/d73/d44/d85/l9c 0 2024-09-21T12:20:19.726 INFO:tasks.workunit.client.1.smithi192.stdout:2/275: symlink d1b/d1e/d3d/l50 0 2024-09-21T12:20:19.726 INFO:tasks.workunit.client.1.smithi192.stdout:5/471: write d0/dc/d13/d37/d38/f4c [766559,77211] 0 2024-09-21T12:20:19.729 INFO:tasks.workunit.client.1.smithi192.stdout:0/248: mknod d3/d6/c4b 0 2024-09-21T12:20:19.732 INFO:tasks.workunit.client.1.smithi192.stdout:8/328: creat d14/d1a/d1d/f64 x:0 0 0 2024-09-21T12:20:19.734 INFO:tasks.workunit.client.1.smithi192.stdout:2/276: dwrite d1b/f1d [0,4194304] 0 2024-09-21T12:20:19.738 INFO:tasks.workunit.client.1.smithi192.stdout:0/249: dwrite d3/d6/f3f [0,4194304] 0 2024-09-21T12:20:19.743 INFO:tasks.workunit.client.1.smithi192.stdout:2/277: dread d1b/d1e/f39 [0,4194304] 0 2024-09-21T12:20:19.747 INFO:tasks.workunit.client.1.smithi192.stdout:8/329: dread d14/d1a/d1d/f57 [0,4194304] 0 2024-09-21T12:20:19.750 INFO:tasks.workunit.client.1.smithi192.stdout:8/330: write d14/d1a/d1d/d46/d4e/f63 [658616,54623] 0 2024-09-21T12:20:19.750 INFO:tasks.workunit.client.1.smithi192.stdout:2/278: mknod d1b/c51 0 2024-09-21T12:20:19.750 INFO:tasks.workunit.client.1.smithi192.stdout:2/279: chown fd 277436182 1 2024-09-21T12:20:19.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:19 smithi192 ceph-mon[35641]: from='client.24413 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:20:19.760 INFO:tasks.workunit.client.1.smithi192.stdout:8/331: getdents d14/d1a/d1d/d51 0 2024-09-21T12:20:19.761 INFO:tasks.workunit.client.1.smithi192.stdout:2/280: creat d1b/f52 x:0 0 0 2024-09-21T12:20:19.764 INFO:tasks.workunit.client.1.smithi192.stdout:8/332: unlink d14/d1a/d1d/f38 0 2024-09-21T12:20:19.766 INFO:tasks.workunit.client.1.smithi192.stdout:2/281: mkdir d1b/d38/d53 0 2024-09-21T12:20:19.768 INFO:tasks.workunit.client.1.smithi192.stdout:8/333: rename fa to d14/d1a/d1d/d46/d4e/f65 0 2024-09-21T12:20:19.768 INFO:tasks.workunit.client.1.smithi192.stdout:8/334: stat d14/d18/c3a 0 2024-09-21T12:20:19.770 INFO:tasks.workunit.client.1.smithi192.stdout:8/335: read d14/d1a/d1d/d46/d4e/f63 [599283,45800] 0 2024-09-21T12:20:19.770 INFO:tasks.workunit.client.1.smithi192.stdout:2/282: mknod d1b/c54 0 2024-09-21T12:20:19.772 INFO:tasks.workunit.client.1.smithi192.stdout:8/336: chown d14/d1a/f2e 44 1 2024-09-21T12:20:19.776 INFO:tasks.workunit.client.1.smithi192.stdout:2/283: dread d1b/d1e/f36 [0,4194304] 0 2024-09-21T12:20:19.778 INFO:tasks.workunit.client.1.smithi192.stdout:2/284: truncate d1b/d38/f49 289877 0 2024-09-21T12:20:19.778 INFO:tasks.workunit.client.1.smithi192.stdout:8/337: dread d14/d18/f32 [0,4194304] 0 2024-09-21T12:20:19.786 INFO:tasks.workunit.client.1.smithi192.stdout:8/338: dwrite d14/d1a/d1d/f49 [4194304,4194304] 0 2024-09-21T12:20:19.790 INFO:tasks.workunit.client.0.smithi003.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-21T12:20:19.793 INFO:tasks.workunit.client.1.smithi192.stdout:8/339: symlink d14/d1a/d1d/d39/l66 0 2024-09-21T12:20:19.794 INFO:tasks.workunit.client.1.smithi192.stdout:8/340: dread - d14/d1a/d1d/f64 zero size 2024-09-21T12:20:19.797 INFO:tasks.workunit.client.1.smithi192.stdout:8/341: creat d14/d1a/d1d/d20/d5f/f67 x:0 0 0 2024-09-21T12:20:19.797 INFO:tasks.workunit.client.0.smithi003.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-21T12:20:19.797 INFO:tasks.workunit.client.0.smithi003.stderr:+ make 2024-09-21T12:20:19.800 INFO:tasks.workunit.client.1.smithi192.stdout:8/342: rename d14/f52 to d14/d1a/d1d/d20/d5f/f68 0 2024-09-21T12:20:19.803 INFO:tasks.workunit.client.1.smithi192.stdout:2/285: truncate d1b/f1d 3167166 0 2024-09-21T12:20:19.805 INFO:tasks.workunit.client.1.smithi192.stdout:2/286: write d1b/f3e [59074,39854] 0 2024-09-21T12:20:19.811 INFO:tasks.workunit.client.1.smithi192.stdout:2/287: unlink d1b/l41 0 2024-09-21T12:20:19.815 INFO:tasks.workunit.client.1.smithi192.stdout:3/220: sync 2024-09-21T12:20:19.816 INFO:tasks.workunit.client.1.smithi192.stdout:1/313: sync 2024-09-21T12:20:19.816 INFO:tasks.workunit.client.1.smithi192.stdout:9/235: sync 2024-09-21T12:20:19.816 INFO:tasks.workunit.client.1.smithi192.stdout:4/228: sync 2024-09-21T12:20:19.816 INFO:tasks.workunit.client.1.smithi192.stdout:2/288: unlink d1b/d1e/l35 0 2024-09-21T12:20:19.817 INFO:tasks.workunit.client.1.smithi192.stdout:1/314: chown d2/da/f32 34181 1 2024-09-21T12:20:19.817 INFO:tasks.workunit.client.1.smithi192.stdout:3/221: readlink db/d16/d18/d21/l49 0 2024-09-21T12:20:19.818 INFO:tasks.workunit.client.1.smithi192.stdout:8/343: dwrite d14/d1a/d1d/d39/f4a [0,4194304] 0 2024-09-21T12:20:19.819 INFO:tasks.workunit.client.1.smithi192.stdout:9/236: rmdir d5/dc/d30 39 2024-09-21T12:20:19.820 INFO:tasks.workunit.client.1.smithi192.stdout:1/315: write d2/da/f46 [3882995,15911] 0 2024-09-21T12:20:19.820 INFO:tasks.workunit.client.1.smithi192.stdout:4/229: rmdir d2/d36 39 2024-09-21T12:20:19.827 INFO:tasks.workunit.client.1.smithi192.stdout:4/230: dwrite d2/df/f29 [4194304,4194304] 0 2024-09-21T12:20:19.829 INFO:tasks.workunit.client.1.smithi192.stdout:9/237: chown d5/l2b 7 1 2024-09-21T12:20:19.831 INFO:tasks.workunit.client.1.smithi192.stdout:3/222: fdatasync db/d16/d18/d33/f48 0 2024-09-21T12:20:19.839 INFO:tasks.workunit.client.1.smithi192.stdout:1/316: dwrite d2/d12/d2f/f5f [0,4194304] 0 2024-09-21T12:20:19.842 INFO:tasks.workunit.client.1.smithi192.stdout:2/289: rename c9 to d1b/c55 0 2024-09-21T12:20:19.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.843+0000 7fcf341b2640 1 -- 172.21.15.3:0/492583782 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf2c102b70 msgr2=0x7fcf2c102ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:19.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.843+0000 7fcf341b2640 1 --2- 172.21.15.3:0/492583782 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf2c102b70 0x7fcf2c102ff0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fcf20009880 tx=0x7fcf2002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:20:19.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.843+0000 7fcf341b2640 1 -- 172.21.15.3:0/492583782 shutdown_connections 2024-09-21T12:20:19.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.843+0000 7fcf341b2640 1 --2- 172.21.15.3:0/492583782 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf2c102b70 0x7fcf2c102ff0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:19.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.843+0000 7fcf341b2640 1 --2- 172.21.15.3:0/492583782 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcf2c101970 0x7fcf2c101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:19.846 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.843+0000 7fcf341b2640 1 -- 172.21.15.3:0/492583782 >> 172.21.15.3:0/492583782 conn(0x7fcf2c0fd140 msgr2=0x7fcf2c0ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:20:19.846 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.844+0000 7fcf341b2640 1 -- 172.21.15.3:0/492583782 shutdown_connections 2024-09-21T12:20:19.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.844+0000 7fcf341b2640 1 -- 172.21.15.3:0/492583782 wait complete. 2024-09-21T12:20:19.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.845+0000 7fcf341b2640 1 Processor -- start 2024-09-21T12:20:19.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.845+0000 7fcf341b2640 1 -- start start 2024-09-21T12:20:19.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.845+0000 7fcf341b2640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcf2c101970 0x7fcf2c195390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:19.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.845+0000 7fcf341b2640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf2c102b70 0x7fcf2c1958d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:19.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.845+0000 7fcf341b2640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fcf2c0761d0 con 0x7fcf2c102b70 2024-09-21T12:20:19.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.845+0000 7fcf341b2640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fcf2c076050 con 0x7fcf2c101970 2024-09-21T12:20:19.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.845+0000 7fcf3174d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf2c102b70 0x7fcf2c1958d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:19.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.845+0000 7fcf31f4e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcf2c101970 0x7fcf2c195390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:19.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.845+0000 7fcf3174d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf2c102b70 0x7fcf2c1958d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45250/0 (socket says 172.21.15.3:45250) 2024-09-21T12:20:19.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.845+0000 7fcf31f4e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcf2c101970 0x7fcf2c195390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.3:33014/0 (socket says 172.21.15.3:33014) 2024-09-21T12:20:19.848 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.845+0000 7fcf3174d640 1 -- 172.21.15.3:0/3806470772 learned_addr learned my addr 172.21.15.3:0/3806470772 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:20:19.848 INFO:tasks.workunit.client.1.smithi192.stdout:3/223: rmdir db/d16/d18/d33/d3b 39 2024-09-21T12:20:19.849 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.846+0000 7fcf3174d640 1 -- 172.21.15.3:0/3806470772 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcf2c101970 msgr2=0x7fcf2c195390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:19.849 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.846+0000 7fcf3174d640 1 --2- 172.21.15.3:0/3806470772 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcf2c101970 0x7fcf2c195390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:19.849 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.846+0000 7fcf3174d640 1 -- 172.21.15.3:0/3806470772 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf2c195ec0 con 0x7fcf2c102b70 2024-09-21T12:20:19.849 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.846+0000 7fcf3174d640 1 --2- 172.21.15.3:0/3806470772 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf2c102b70 0x7fcf2c1958d0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fcf20006010 tx=0x7fcf200048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:20:19.849 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.847+0000 7fcf1effd640 1 -- 172.21.15.3:0/3806470772 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcf2003f070 con 0x7fcf2c102b70 2024-09-21T12:20:19.849 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.847+0000 7fcf341b2640 1 -- 172.21.15.3:0/3806470772 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf2c1ab980 con 0x7fcf2c102b70 2024-09-21T12:20:19.849 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.847+0000 7fcf341b2640 1 -- 172.21.15.3:0/3806470772 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf2c1abf00 con 0x7fcf2c102b70 2024-09-21T12:20:19.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.848+0000 7fcf1effd640 1 -- 172.21.15.3:0/3806470772 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcf200044d0 con 0x7fcf2c102b70 2024-09-21T12:20:19.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.848+0000 7fcf1effd640 1 -- 172.21.15.3:0/3806470772 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcf20049060 con 0x7fcf2c102b70 2024-09-21T12:20:19.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.850+0000 7fcf341b2640 1 -- 172.21.15.3:0/3806470772 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf2c101d50 con 0x7fcf2c102b70 2024-09-21T12:20:19.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.850+0000 7fcf1effd640 1 -- 172.21.15.3:0/3806470772 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 20) ==== 97937+0+0 (secure 0 0 0) 0x7fcf20042070 con 0x7fcf2c102b70 2024-09-21T12:20:19.852 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.850+0000 7fcf1effd640 1 --2- 172.21.15.3:0/3806470772 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fcf18074b50 0x7fcf18077010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:19.852 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.850+0000 7fcf1effd640 1 -- 172.21.15.3:0/3806470772 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(46..46 src has 1..46) ==== 5554+0+0 (secure 0 0 0) 0x7fcf200b6a30 con 0x7fcf2c102b70 2024-09-21T12:20:19.852 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.850+0000 7fcf31f4e640 1 --2- 172.21.15.3:0/3806470772 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fcf18074b50 0x7fcf18077010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:19.853 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.851+0000 7fcf31f4e640 1 --2- 172.21.15.3:0/3806470772 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fcf18074b50 0x7fcf18077010 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c1029d0 tx=0x7fcf28009110 comp rx=0 tx=0).ready entity=mgr.14217 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:20:19.853 INFO:tasks.workunit.client.1.smithi192.stdout:1/317: symlink d2/d12/d2f/l64 0 2024-09-21T12:20:19.853 INFO:tasks.workunit.client.1.smithi192.stdout:1/318: chown d2/d12/d2f/f5f 0 1 2024-09-21T12:20:19.854 INFO:tasks.workunit.client.1.smithi192.stdout:4/231: link d2/d19/f2d d2/db/d1a/f46 0 2024-09-21T12:20:19.857 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:19.855+0000 7fcf1effd640 1 -- 172.21.15.3:0/3806470772 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcf200852d0 con 0x7fcf2c102b70 2024-09-21T12:20:19.857 INFO:tasks.workunit.client.1.smithi192.stdout:3/224: creat db/d16/d18/d21/d23/f50 x:0 0 0 2024-09-21T12:20:19.860 INFO:tasks.workunit.client.1.smithi192.stdout:4/232: mknod d2/df/c47 0 2024-09-21T12:20:19.862 INFO:tasks.workunit.client.1.smithi192.stdout:3/225: dwrite db/f4f [0,4194304] 0 2024-09-21T12:20:19.863 INFO:tasks.workunit.client.1.smithi192.stdout:1/319: unlink d2/d12/c16 0 2024-09-21T12:20:19.864 INFO:tasks.workunit.client.1.smithi192.stdout:3/226: dread - db/d2a/d2e/f38 zero size 2024-09-21T12:20:19.869 INFO:tasks.workunit.client.1.smithi192.stdout:4/233: symlink d2/d19/l48 0 2024-09-21T12:20:19.869 INFO:tasks.workunit.client.1.smithi192.stdout:9/238: write d5/dc/d40/f25 [3321150,92383] 0 2024-09-21T12:20:19.870 INFO:tasks.workunit.client.1.smithi192.stdout:4/234: write d2/df/f30 [1513996,21906] 0 2024-09-21T12:20:19.873 INFO:tasks.workunit.client.1.smithi192.stdout:1/320: rename d2/da/d44 to d2/d12/d2f/d51/d24/d65 0 2024-09-21T12:20:19.876 INFO:tasks.workunit.client.1.smithi192.stdout:8/344: truncate d14/d1a/f31 2299394 0 2024-09-21T12:20:19.878 INFO:tasks.workunit.client.1.smithi192.stdout:9/239: unlink d5/d19/d32/f3a 0 2024-09-21T12:20:19.883 INFO:tasks.workunit.client.1.smithi192.stdout:1/321: rename d2/d12/d2f/d51/f22 to d2/d12/d2f/d41/d61/f66 0 2024-09-21T12:20:19.888 INFO:tasks.workunit.client.1.smithi192.stdout:8/345: symlink d14/d1a/d1d/d20/d5f/l69 0 2024-09-21T12:20:19.889 INFO:tasks.workunit.client.1.smithi192.stdout:8/346: stat d14/d1a/d1d/d20/f47 0 2024-09-21T12:20:19.891 INFO:tasks.workunit.client.1.smithi192.stdout:9/240: unlink d5/d19/f48 0 2024-09-21T12:20:19.896 INFO:tasks.workunit.client.1.smithi192.stdout:8/347: dwrite d14/d1a/d1d/d39/f3e [0,4194304] 0 2024-09-21T12:20:19.897 INFO:tasks.workunit.client.1.smithi192.stdout:8/348: chown d14/d1a/d1d/d20/d5f 7 1 2024-09-21T12:20:19.899 INFO:tasks.workunit.client.1.smithi192.stdout:4/235: dread d2/fa [0,4194304] 0 2024-09-21T12:20:19.905 INFO:tasks.workunit.client.1.smithi192.stdout:1/322: creat d2/d12/d2f/d51/d24/d5e/f67 x:0 0 0 2024-09-21T12:20:19.906 INFO:tasks.workunit.client.1.smithi192.stdout:1/323: write d2/da/f31 [325891,94678] 0 2024-09-21T12:20:19.908 INFO:tasks.workunit.client.1.smithi192.stdout:8/349: rename d14/d1a/d1d/d20/l4b to d14/d1a/d1d/d39/l6a 0 2024-09-21T12:20:19.910 INFO:tasks.workunit.client.1.smithi192.stdout:4/236: symlink d2/db/d24/d28/l49 0 2024-09-21T12:20:19.924 INFO:tasks.workunit.client.1.smithi192.stdout:4/237: unlink d2/db/d3e/f45 0 2024-09-21T12:20:19.926 INFO:tasks.workunit.client.1.smithi192.stdout:1/324: creat d2/d12/d2f/d41/d5c/f68 x:0 0 0 2024-09-21T12:20:19.928 INFO:tasks.workunit.client.1.smithi192.stdout:1/325: dread d2/da/f60 [0,4194304] 0 2024-09-21T12:20:19.929 INFO:tasks.workunit.client.1.smithi192.stdout:8/350: symlink d14/d1a/d1d/d51/l6b 0 2024-09-21T12:20:19.934 INFO:tasks.workunit.client.1.smithi192.stdout:4/238: creat d2/db/d34/f4a x:0 0 0 2024-09-21T12:20:19.934 INFO:tasks.workunit.client.1.smithi192.stdout:8/351: dwrite d14/d1a/d1d/d46/d4e/f5b [0,4194304] 0 2024-09-21T12:20:19.937 INFO:tasks.workunit.client.1.smithi192.stdout:7/239: sync 2024-09-21T12:20:19.937 INFO:tasks.workunit.client.1.smithi192.stdout:6/196: sync 2024-09-21T12:20:19.939 INFO:tasks.workunit.client.1.smithi192.stdout:9/241: truncate d5/d8/f2d 3264103 0 2024-09-21T12:20:19.940 INFO:tasks.workunit.client.1.smithi192.stdout:9/242: chown d5/d21/d3d 19137098 1 2024-09-21T12:20:19.942 INFO:tasks.workunit.client.1.smithi192.stdout:4/239: dread d2/db/d1a/f2b [0,4194304] 0 2024-09-21T12:20:19.947 INFO:tasks.workunit.client.1.smithi192.stdout:7/240: dread - d6/d9/d51/f32 zero size 2024-09-21T12:20:19.948 INFO:tasks.workunit.client.1.smithi192.stdout:6/197: rename da/d23/d37/l29 to da/d23/l3d 0 2024-09-21T12:20:19.948 INFO:tasks.workunit.client.1.smithi192.stdout:6/198: chown da/d23/d37/l30 825845142 1 2024-09-21T12:20:19.949 INFO:tasks.workunit.client.1.smithi192.stdout:4/240: mkdir d2/d19/d4b 0 2024-09-21T12:20:19.952 INFO:tasks.workunit.client.1.smithi192.stdout:8/352: write d14/d18/f28 [280359,26604] 0 2024-09-21T12:20:19.953 INFO:tasks.workunit.client.1.smithi192.stdout:8/353: write d14/d1a/d1d/d20/f44 [314936,67090] 0 2024-09-21T12:20:19.956 INFO:tasks.workunit.client.1.smithi192.stdout:9/243: mknod d5/dc/d30/c4a 0 2024-09-21T12:20:19.958 INFO:tasks.workunit.client.1.smithi192.stdout:6/199: unlink da/f21 0 2024-09-21T12:20:19.960 INFO:tasks.workunit.client.1.smithi192.stdout:1/326: getdents d2/de 0 2024-09-21T12:20:19.961 INFO:tasks.workunit.client.1.smithi192.stdout:1/327: write d2/de/f47 [554391,56941] 0 2024-09-21T12:20:19.964 INFO:tasks.workunit.client.1.smithi192.stdout:1/328: write d2/da/fc [8922832,88920] 0 2024-09-21T12:20:19.965 INFO:tasks.workunit.client.1.smithi192.stdout:8/354: fdatasync d14/d1a/d1d/d46/d4e/f63 0 2024-09-21T12:20:19.966 INFO:tasks.workunit.client.1.smithi192.stdout:8/355: read - d14/d1a/d1d/f64 zero size 2024-09-21T12:20:19.967 INFO:tasks.workunit.client.1.smithi192.stdout:1/329: truncate d2/d12/f63 974251 0 2024-09-21T12:20:19.968 INFO:tasks.workunit.client.1.smithi192.stdout:8/356: chown d14/d1a/d1d/d20/f47 57 1 2024-09-21T12:20:19.969 INFO:tasks.workunit.client.1.smithi192.stdout:4/241: creat d2/d36/f4c x:0 0 0 2024-09-21T12:20:19.975 INFO:tasks.workunit.client.1.smithi192.stdout:1/330: creat d2/d12/d2f/d41/d61/f69 x:0 0 0 2024-09-21T12:20:19.977 INFO:tasks.workunit.client.1.smithi192.stdout:6/200: fdatasync da/f20 0 2024-09-21T12:20:19.978 INFO:tasks.workunit.client.1.smithi192.stdout:4/242: creat d2/db/d24/d28/f4d x:0 0 0 2024-09-21T12:20:19.982 INFO:tasks.workunit.client.1.smithi192.stdout:1/331: rename d2/l1b to d2/d12/d2f/d51/l6a 0 2024-09-21T12:20:19.983 INFO:tasks.workunit.client.1.smithi192.stdout:8/357: mknod d14/d18/c6c 0 2024-09-21T12:20:19.984 INFO:tasks.workunit.client.1.smithi192.stdout:7/241: fsync d6/f52 0 2024-09-21T12:20:19.986 INFO:tasks.workunit.client.1.smithi192.stdout:0/250: sync 2024-09-21T12:20:19.986 INFO:tasks.workunit.client.1.smithi192.stdout:5/472: sync 2024-09-21T12:20:19.986 INFO:tasks.workunit.client.1.smithi192.stdout:6/201: chown da/d23/d37/f39 0 1 2024-09-21T12:20:19.987 INFO:tasks.workunit.client.1.smithi192.stdout:6/202: dread - da/d1f/f31 zero size 2024-09-21T12:20:19.989 INFO:tasks.workunit.client.1.smithi192.stdout:9/244: getdents d5/d8/d36/d3f 0 2024-09-21T12:20:19.990 INFO:tasks.workunit.client.1.smithi192.stdout:9/245: dread d5/d8/f15 [0,4194304] 0 2024-09-21T12:20:19.990 INFO:tasks.workunit.client.1.smithi192.stdout:1/332: mkdir d2/da/d6b 0 2024-09-21T12:20:19.991 INFO:tasks.workunit.client.1.smithi192.stdout:9/246: dread - d5/dc/d30/f35 zero size 2024-09-21T12:20:19.991 INFO:tasks.workunit.client.1.smithi192.stdout:8/358: symlink d14/d1a/d1d/d46/l6d 0 2024-09-21T12:20:19.993 INFO:tasks.workunit.client.1.smithi192.stdout:7/242: symlink d6/d9/d51/l57 0 2024-09-21T12:20:19.994 INFO:tasks.workunit.client.1.smithi192.stdout:7/243: write d6/f52 [1124442,112146] 0 2024-09-21T12:20:19.997 INFO:tasks.workunit.client.1.smithi192.stdout:1/333: dwrite d2/d12/d2f/d41/d5c/f68 [0,4194304] 0 2024-09-21T12:20:19.998 INFO:tasks.workunit.client.1.smithi192.stdout:4/243: mknod d2/db/d24/d32/c4e 0 2024-09-21T12:20:19.998 INFO:tasks.workunit.client.1.smithi192.stdout:1/334: write d2/d12/d2f/f4a [835922,56472] 0 2024-09-21T12:20:19.999 INFO:tasks.workunit.client.1.smithi192.stdout:4/244: write d2/df/f30 [175760,4976] 0 2024-09-21T12:20:20.001 INFO:tasks.workunit.client.1.smithi192.stdout:6/203: mkdir da/d1f/d27/d3e 0 2024-09-21T12:20:20.005 INFO:tasks.workunit.client.1.smithi192.stdout:8/359: mknod d14/d1a/d1d/d48/c6e 0 2024-09-21T12:20:20.009 INFO:tasks.workunit.client.1.smithi192.stdout:6/204: dwrite da/f13 [0,4194304] 0 2024-09-21T12:20:20.009 INFO:tasks.workunit.client.1.smithi192.stdout:7/244: mknod d6/d9/d1f/d3e/c58 0 2024-09-21T12:20:20.010 INFO:tasks.workunit.client.1.smithi192.stdout:7/245: dread - d6/d9/d51/f32 zero size 2024-09-21T12:20:20.010 INFO:tasks.workunit.client.1.smithi192.stdout:7/246: chown d6/d20 8 1 2024-09-21T12:20:20.014 INFO:tasks.workunit.client.1.smithi192.stdout:1/335: symlink d2/d12/l6c 0 2024-09-21T12:20:20.014 INFO:tasks.workunit.client.1.smithi192.stdout:1/336: fsync f1 0 2024-09-21T12:20:20.018 INFO:tasks.workunit.client.1.smithi192.stdout:4/245: mkdir d2/db/d24/d32/d4f 0 2024-09-21T12:20:20.020 INFO:tasks.workunit.client.1.smithi192.stdout:9/247: creat d5/d8/d2c/f4b x:0 0 0 2024-09-21T12:20:20.020 INFO:tasks.workunit.client.1.smithi192.stdout:9/248: dread - d5/f33 zero size 2024-09-21T12:20:20.021 INFO:tasks.workunit.client.1.smithi192.stdout:8/360: chown d14/d18/c42 80902392 1 2024-09-21T12:20:20.024 INFO:tasks.workunit.client.1.smithi192.stdout:0/251: creat d3/d6/f4c x:0 0 0 2024-09-21T12:20:20.026 INFO:tasks.workunit.client.1.smithi192.stdout:6/205: creat da/d1f/f3f x:0 0 0 2024-09-21T12:20:20.027 INFO:tasks.workunit.client.1.smithi192.stdout:3/227: sync 2024-09-21T12:20:20.027 INFO:tasks.workunit.client.1.smithi192.stdout:2/290: sync 2024-09-21T12:20:20.029 INFO:tasks.workunit.client.1.smithi192.stdout:3/228: truncate db/d16/d18/f36 384024 0 2024-09-21T12:20:20.030 INFO:tasks.workunit.client.1.smithi192.stdout:7/247: mknod d6/d9/d1f/c59 0 2024-09-21T12:20:20.030 INFO:tasks.workunit.client.1.smithi192.stdout:0/252: dwrite d3/d5/f14 [0,4194304] 0 2024-09-21T12:20:20.031 INFO:tasks.workunit.client.1.smithi192.stdout:1/337: mknod d2/d12/d2f/d41/d61/c6d 0 2024-09-21T12:20:20.031 INFO:tasks.workunit.client.1.smithi192.stdout:7/248: write f5 [1833331,113108] 0 2024-09-21T12:20:20.031 INFO:tasks.workunit.client.1.smithi192.stdout:3/229: chown db/d16/d18/f3a 1874833 1 2024-09-21T12:20:20.033 INFO:tasks.workunit.client.1.smithi192.stdout:4/246: creat d2/d21/f50 x:0 0 0 2024-09-21T12:20:20.033 INFO:tasks.workunit.client.1.smithi192.stdout:3/230: chown db/d16/d18/f36 12 1 2024-09-21T12:20:20.033 INFO:tasks.workunit.client.1.smithi192.stdout:4/247: read - d2/d19/f2d zero size 2024-09-21T12:20:20.038 INFO:tasks.workunit.client.1.smithi192.stdout:7/249: dwrite d6/d20/f3c [0,4194304] 0 2024-09-21T12:20:20.038 INFO:tasks.workunit.client.1.smithi192.stdout:9/249: rename d5/dc/d30/f35 to d5/d21/f4c 0 2024-09-21T12:20:20.039 INFO:tasks.workunit.client.1.smithi192.stdout:9/250: write d5/f2f [4099586,29610] 0 2024-09-21T12:20:20.045 INFO:tasks.workunit.client.1.smithi192.stdout:5/473: link d0/d73/d44/d85/d97/d45/l64 d0/d65/d6e/l9d 0 2024-09-21T12:20:20.045 INFO:tasks.workunit.client.1.smithi192.stdout:2/291: creat d1b/d1e/d3d/f56 x:0 0 0 2024-09-21T12:20:20.047 INFO:tasks.workunit.client.1.smithi192.stdout:5/474: write d0/dc/f6f [15964,12290] 0 2024-09-21T12:20:20.047 INFO:tasks.workunit.client.1.smithi192.stdout:9/251: fdatasync d5/f2f 0 2024-09-21T12:20:20.047 INFO:tasks.workunit.client.1.smithi192.stdout:0/253: creat d3/d6/d1d/f4d x:0 0 0 2024-09-21T12:20:20.049 INFO:tasks.workunit.client.1.smithi192.stdout:1/338: readlink d2/d12/d2f/d51/l6a 0 2024-09-21T12:20:20.051 INFO:tasks.workunit.client.1.smithi192.stdout:8/361: truncate d14/d18/f22 96088 0 2024-09-21T12:20:20.053 INFO:tasks.workunit.client.1.smithi192.stdout:1/339: truncate d2/d12/d2f/d51/d24/f28 1251696 0 2024-09-21T12:20:20.054 INFO:tasks.workunit.client.1.smithi192.stdout:8/362: write d14/d1a/d1d/d20/f44 [1189688,6109] 0 2024-09-21T12:20:20.055 INFO:tasks.workunit.client.1.smithi192.stdout:2/292: dwrite f15 [0,4194304] 0 2024-09-21T12:20:20.056 INFO:tasks.workunit.client.1.smithi192.stdout:8/363: chown d14/d18/f28 3565 1 2024-09-21T12:20:20.059 INFO:tasks.workunit.client.1.smithi192.stdout:8/364: read d14/d1a/d1d/d46/d4e/f65 [155282,15074] 0 2024-09-21T12:20:20.068 INFO:tasks.workunit.client.1.smithi192.stdout:1/340: unlink d2/de/f47 0 2024-09-21T12:20:20.069 INFO:tasks.workunit.client.1.smithi192.stdout:1/341: truncate d2/de/f18 1663914 0 2024-09-21T12:20:20.071 INFO:tasks.workunit.client.1.smithi192.stdout:4/248: rename d2/db/l3b to d2/db/d24/d32/d4f/l51 0 2024-09-21T12:20:20.072 INFO:tasks.workunit.client.1.smithi192.stdout:2/293: rmdir d1b 39 2024-09-21T12:20:20.072 INFO:tasks.workunit.client.1.smithi192.stdout:4/249: dread - d2/db/d24/d28/f4d zero size 2024-09-21T12:20:20.074 INFO:tasks.workunit.client.1.smithi192.stdout:8/365: creat d14/d1a/d1d/d48/f6f x:0 0 0 2024-09-21T12:20:20.076 INFO:tasks.workunit.client.1.smithi192.stdout:8/366: stat d14/d1a/d1d/d48/f6f 0 2024-09-21T12:20:20.076 INFO:tasks.workunit.client.1.smithi192.stdout:6/206: dwrite da/d23/d37/f39 [0,4194304] 0 2024-09-21T12:20:20.078 INFO:tasks.workunit.client.1.smithi192.stdout:1/342: symlink d2/d12/l6e 0 2024-09-21T12:20:20.079 INFO:tasks.workunit.client.1.smithi192.stdout:0/254: dwrite d3/d5/f14 [4194304,4194304] 0 2024-09-21T12:20:20.080 INFO:tasks.workunit.client.1.smithi192.stdout:7/250: rename f5 to d6/d9/d2d/f5a 0 2024-09-21T12:20:20.084 INFO:tasks.workunit.client.1.smithi192.stdout:8/367: dwrite d14/d1a/d1d/f57 [4194304,4194304] 0 2024-09-21T12:20:20.087 INFO:tasks.workunit.client.1.smithi192.stdout:4/250: mkdir d2/df/d52 0 2024-09-21T12:20:20.092 INFO:tasks.workunit.client.1.smithi192.stdout:1/343: creat d2/d4d/f6f x:0 0 0 2024-09-21T12:20:20.097 INFO:tasks.workunit.client.1.smithi192.stdout:0/255: symlink d3/de/l4e 0 2024-09-21T12:20:20.101 INFO:tasks.workunit.client.1.smithi192.stdout:5/475: rename d0/d70 to d0/d73/d44/d85/d97/d9e 0 2024-09-21T12:20:20.106 INFO:tasks.workunit.client.1.smithi192.stdout:1/344: creat d2/d12/d2f/d51/d24/f70 x:0 0 0 2024-09-21T12:20:20.108 INFO:tasks.workunit.client.1.smithi192.stdout:0/256: creat d3/d5/d19/f4f x:0 0 0 2024-09-21T12:20:20.110 INFO:tasks.workunit.client.1.smithi192.stdout:0/257: write d3/d5/d19/f4f [886632,51223] 0 2024-09-21T12:20:20.112 INFO:tasks.workunit.client.1.smithi192.stdout:9/252: rename d5/d21/d3d/d42 to d5/d8/d36/d3f/d4d 0 2024-09-21T12:20:20.112 INFO:tasks.workunit.client.1.smithi192.stdout:1/345: dwrite d2/d12/d2f/f5f [4194304,4194304] 0 2024-09-21T12:20:20.116 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:20.114+0000 7fcf341b2640 1 -- 172.21.15.3:0/3806470772 --> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fcf2c02dbc0 con 0x7fcf18074b50 2024-09-21T12:20:20.116 INFO:tasks.workunit.client.1.smithi192.stdout:8/368: unlink d14/l30 0 2024-09-21T12:20:20.117 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:20.116+0000 7fcf1effd640 1 -- 172.21.15.3:0/3806470772 <== mgr.14217 v2:172.21.15.3:6800/2480880781 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+341 (secure 0 0 0) 0x7fcf280095e0 con 0x7fcf18074b50 2024-09-21T12:20:20.117 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-21T12:20:20.117 INFO:teuthology.orchestra.run.smithi003.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T12:20:20.118 INFO:teuthology.orchestra.run.smithi003.stdout: "in_progress": true, 2024-09-21T12:20:20.118 INFO:teuthology.orchestra.run.smithi003.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-21T12:20:20.118 INFO:teuthology.orchestra.run.smithi003.stdout: "services_complete": [], 2024-09-21T12:20:20.118 INFO:teuthology.orchestra.run.smithi003.stdout: "progress": "1/2 daemons upgraded", 2024-09-21T12:20:20.118 INFO:teuthology.orchestra.run.smithi003.stdout: "message": "Currently upgrading mgr daemons", 2024-09-21T12:20:20.118 INFO:teuthology.orchestra.run.smithi003.stdout: "is_paused": false 2024-09-21T12:20:20.118 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-21T12:20:20.119 INFO:tasks.workunit.client.1.smithi192.stdout:4/251: mknod d2/df/d52/c53 0 2024-09-21T12:20:20.120 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:20.119+0000 7fcf341b2640 1 -- 172.21.15.3:0/3806470772 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fcf18074b50 msgr2=0x7fcf18077010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:20.121 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:20.119+0000 7fcf341b2640 1 --2- 172.21.15.3:0/3806470772 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fcf18074b50 0x7fcf18077010 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c1029d0 tx=0x7fcf28009110 comp rx=0 tx=0).stop 2024-09-21T12:20:20.121 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:20.119+0000 7fcf341b2640 1 -- 172.21.15.3:0/3806470772 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf2c102b70 msgr2=0x7fcf2c1958d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:20.121 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:20.119+0000 7fcf341b2640 1 --2- 172.21.15.3:0/3806470772 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf2c102b70 0x7fcf2c1958d0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fcf20006010 tx=0x7fcf200048f0 comp rx=0 tx=0).stop 2024-09-21T12:20:20.121 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:20.119+0000 7fcf341b2640 1 -- 172.21.15.3:0/3806470772 shutdown_connections 2024-09-21T12:20:20.121 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:20.119+0000 7fcf341b2640 1 --2- 172.21.15.3:0/3806470772 >> [v2:172.21.15.3:6800/2480880781,v1:172.21.15.3:6801/2480880781] conn(0x7fcf18074b50 0x7fcf18077010 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:20.121 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:20.119+0000 7fcf341b2640 1 --2- 172.21.15.3:0/3806470772 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcf2c102b70 0x7fcf2c1958d0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:20.121 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:20.119+0000 7fcf341b2640 1 --2- 172.21.15.3:0/3806470772 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcf2c101970 0x7fcf2c195390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:20.121 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:20.119+0000 7fcf341b2640 1 -- 172.21.15.3:0/3806470772 >> 172.21.15.3:0/3806470772 conn(0x7fcf2c0fd140 msgr2=0x7fcf2c105fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:20:20.121 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:20.119+0000 7fcf341b2640 1 -- 172.21.15.3:0/3806470772 shutdown_connections 2024-09-21T12:20:20.121 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:20.119+0000 7fcf341b2640 1 -- 172.21.15.3:0/3806470772 wait complete. 2024-09-21T12:20:20.122 INFO:tasks.workunit.client.1.smithi192.stdout:7/251: creat d6/d9/f5b x:0 0 0 2024-09-21T12:20:20.127 INFO:tasks.workunit.client.1.smithi192.stdout:9/253: creat d5/dc/d40/f4e x:0 0 0 2024-09-21T12:20:20.129 INFO:tasks.workunit.client.1.smithi192.stdout:0/258: dwrite d3/d5/d28/d39/f41 [0,4194304] 0 2024-09-21T12:20:20.131 INFO:tasks.workunit.client.1.smithi192.stdout:2/294: creat d1b/f57 x:0 0 0 2024-09-21T12:20:20.134 INFO:tasks.workunit.client.1.smithi192.stdout:2/295: chown d1b/d38/c4f 121 1 2024-09-21T12:20:20.135 INFO:tasks.workunit.client.1.smithi192.stdout:8/369: mknod d14/d1a/d1d/d51/c70 0 2024-09-21T12:20:20.135 INFO:tasks.workunit.client.1.smithi192.stdout:0/259: dread d3/d5/f14 [0,4194304] 0 2024-09-21T12:20:20.137 INFO:tasks.workunit.client.1.smithi192.stdout:4/252: rmdir d2/db/d24/d32 39 2024-09-21T12:20:20.138 INFO:tasks.workunit.client.1.smithi192.stdout:4/253: fsync d2/d19/f25 0 2024-09-21T12:20:20.139 INFO:tasks.workunit.client.1.smithi192.stdout:8/370: dread d14/d1a/f27 [0,4194304] 0 2024-09-21T12:20:20.143 INFO:tasks.workunit.client.1.smithi192.stdout:9/254: creat d5/d8/d2c/f4f x:0 0 0 2024-09-21T12:20:20.144 INFO:tasks.workunit.client.1.smithi192.stdout:9/255: read d5/d8/d36/d3f/f2a [4980,21312] 0 2024-09-21T12:20:20.146 INFO:tasks.workunit.client.1.smithi192.stdout:2/296: symlink d1b/d1e/l58 0 2024-09-21T12:20:20.156 INFO:tasks.workunit.client.1.smithi192.stdout:8/371: dread f7 [0,4194304] 0 2024-09-21T12:20:20.158 INFO:tasks.workunit.client.1.smithi192.stdout:7/252: mknod d6/d9/c5c 0 2024-09-21T12:20:20.159 INFO:tasks.workunit.client.1.smithi192.stdout:7/253: chown d6/f10 26 1 2024-09-21T12:20:20.162 INFO:tasks.workunit.client.1.smithi192.stdout:9/256: fdatasync d5/d8/d36/d3f/f2a 0 2024-09-21T12:20:20.164 INFO:tasks.workunit.client.1.smithi192.stdout:2/297: symlink d1b/d38/l59 0 2024-09-21T12:20:20.164 INFO:tasks.workunit.client.1.smithi192.stdout:2/298: write fe [1698925,15644] 0 2024-09-21T12:20:20.165 INFO:tasks.workunit.client.1.smithi192.stdout:9/257: read d5/d8/f22 [3684243,129184] 0 2024-09-21T12:20:20.166 INFO:tasks.workunit.client.1.smithi192.stdout:5/476: creat d0/d73/d44/d85/d97/d9e/f9f x:0 0 0 2024-09-21T12:20:20.168 INFO:tasks.workunit.client.1.smithi192.stdout:5/477: read - d0/d73/d44/d85/d97/d9e/f9f zero size 2024-09-21T12:20:20.175 INFO:tasks.workunit.client.1.smithi192.stdout:1/346: getdents d2/d12/d2f/d41/d61 0 2024-09-21T12:20:20.175 INFO:tasks.workunit.client.1.smithi192.stdout:4/254: write d2/d21/f3f [387247,65836] 0 2024-09-21T12:20:20.176 INFO:tasks.workunit.client.1.smithi192.stdout:1/347: write d2/da/f46 [1530180,1545] 0 2024-09-21T12:20:20.181 INFO:tasks.workunit.client.1.smithi192.stdout:2/299: write d1b/d1e/f39 [3704553,16352] 0 2024-09-21T12:20:20.185 INFO:tasks.workunit.client.1.smithi192.stdout:3/231: sync 2024-09-21T12:20:20.195 INFO:tasks.workunit.client.1.smithi192.stdout:4/255: mknod d2/df/c54 0 2024-09-21T12:20:20.199 INFO:tasks.workunit.client.1.smithi192.stdout:2/300: creat d1b/d1e/d3d/f5a x:0 0 0 2024-09-21T12:20:20.200 INFO:tasks.workunit.client.1.smithi192.stdout:0/260: getdents d3/d5 0 2024-09-21T12:20:20.202 INFO:tasks.workunit.client.1.smithi192.stdout:7/254: truncate d6/d9/d51/f23 4228167 0 2024-09-21T12:20:20.203 INFO:tasks.workunit.client.1.smithi192.stdout:3/232: creat db/d16/d18/d40/f51 x:0 0 0 2024-09-21T12:20:20.204 INFO:tasks.workunit.client.1.smithi192.stdout:5/478: dwrite d0/d65/d6e/f29 [0,4194304] 0 2024-09-21T12:20:20.209 INFO:tasks.workunit.client.1.smithi192.stdout:9/258: link d5/d8/d36/d3f/c28 d5/dc/d30/c50 0 2024-09-21T12:20:20.210 INFO:tasks.workunit.client.1.smithi192.stdout:9/259: dread d5/d21/f31 [0,4194304] 0 2024-09-21T12:20:20.210 INFO:tasks.workunit.client.1.smithi192.stdout:3/233: unlink db/d2a/l2b 0 2024-09-21T12:20:20.211 INFO:tasks.workunit.client.1.smithi192.stdout:8/372: creat d14/d1a/d1d/d39/f71 x:0 0 0 2024-09-21T12:20:20.211 INFO:tasks.workunit.client.1.smithi192.stdout:3/234: dread - db/d2a/f42 zero size 2024-09-21T12:20:20.216 INFO:tasks.workunit.client.1.smithi192.stdout:0/261: truncate d3/d6/fd 424358 0 2024-09-21T12:20:20.217 INFO:tasks.workunit.client.1.smithi192.stdout:0/262: stat d3/d6/c21 0 2024-09-21T12:20:20.220 INFO:tasks.workunit.client.1.smithi192.stdout:9/260: unlink d5/fb 0 2024-09-21T12:20:20.224 INFO:tasks.workunit.client.1.smithi192.stdout:8/373: read - d14/d1a/d1d/f64 zero size 2024-09-21T12:20:20.226 INFO:tasks.workunit.client.1.smithi192.stdout:5/479: mkdir d0/d65/d6e/d99/da0 0 2024-09-21T12:20:20.226 INFO:tasks.workunit.client.1.smithi192.stdout:1/348: truncate d2/da/f31 1514123 0 2024-09-21T12:20:20.227 INFO:tasks.workunit.client.1.smithi192.stdout:1/349: chown d2/d12/f3c 123 1 2024-09-21T12:20:20.229 INFO:tasks.workunit.client.1.smithi192.stdout:0/263: mkdir d3/d5/d28/d39/d50 0 2024-09-21T12:20:20.229 INFO:tasks.workunit.client.1.smithi192.stdout:0/264: readlink d3/d5/l29 0 2024-09-21T12:20:20.231 INFO:tasks.workunit.client.1.smithi192.stdout:0/265: dread d3/d5/f9 [0,4194304] 0 2024-09-21T12:20:20.231 INFO:tasks.workunit.client.1.smithi192.stdout:9/261: unlink d5/d8/d36/d3f/f2a 0 2024-09-21T12:20:20.232 INFO:tasks.workunit.client.1.smithi192.stdout:0/266: dread - d3/d5/d19/d31/f32 zero size 2024-09-21T12:20:20.232 INFO:tasks.workunit.client.1.smithi192.stdout:9/262: write d5/f33 [990046,59038] 0 2024-09-21T12:20:20.235 INFO:tasks.workunit.client.1.smithi192.stdout:4/256: getdents d2/df 0 2024-09-21T12:20:20.239 INFO:tasks.workunit.client.1.smithi192.stdout:5/480: mknod d0/d65/d6e/ca1 0 2024-09-21T12:20:20.240 INFO:tasks.workunit.client.1.smithi192.stdout:1/350: symlink d2/d12/d2f/d51/d24/d5e/l71 0 2024-09-21T12:20:20.241 INFO:tasks.workunit.client.1.smithi192.stdout:7/255: write d6/d20/f47 [1180003,27109] 0 2024-09-21T12:20:20.241 INFO:tasks.workunit.client.1.smithi192.stdout:9/263: rmdir d5/d19 39 2024-09-21T12:20:20.243 INFO:tasks.workunit.client.1.smithi192.stdout:8/374: dread ff [0,4194304] 0 2024-09-21T12:20:20.244 INFO:tasks.workunit.client.1.smithi192.stdout:4/257: mkdir d2/d36/d55 0 2024-09-21T12:20:20.250 INFO:tasks.workunit.client.1.smithi192.stdout:8/375: dwrite d14/d1a/d1d/d39/f71 [0,4194304] 0 2024-09-21T12:20:20.252 INFO:tasks.workunit.client.1.smithi192.stdout:0/267: truncate d3/d6/fd 704425 0 2024-09-21T12:20:20.254 INFO:tasks.workunit.client.1.smithi192.stdout:4/258: fdatasync d2/d21/f2e 0 2024-09-21T12:20:20.255 INFO:tasks.workunit.client.1.smithi192.stdout:3/235: getdents db/d16/d18/d33/d4a 0 2024-09-21T12:20:20.260 INFO:tasks.workunit.client.1.smithi192.stdout:9/264: creat d5/d8/d11/d44/f51 x:0 0 0 2024-09-21T12:20:20.261 INFO:tasks.workunit.client.1.smithi192.stdout:8/376: creat d14/d1a/d1d/d39/f72 x:0 0 0 2024-09-21T12:20:20.264 INFO:tasks.workunit.client.1.smithi192.stdout:4/259: mkdir d2/db/d34/d56 0 2024-09-21T12:20:20.265 INFO:tasks.workunit.client.1.smithi192.stdout:3/236: fdatasync db/d16/d18/f3a 0 2024-09-21T12:20:20.268 INFO:tasks.workunit.client.1.smithi192.stdout:7/256: creat d6/d9/f5d x:0 0 0 2024-09-21T12:20:20.269 INFO:tasks.workunit.client.1.smithi192.stdout:9/265: truncate d5/f3b 770723 0 2024-09-21T12:20:20.272 INFO:tasks.workunit.client.1.smithi192.stdout:6/207: sync 2024-09-21T12:20:20.273 INFO:tasks.workunit.client.1.smithi192.stdout:7/257: dwrite d6/d9/d51/f23 [0,4194304] 0 2024-09-21T12:20:20.273 INFO:tasks.workunit.client.1.smithi192.stdout:6/208: read da/f3b [427525,128666] 0 2024-09-21T12:20:20.274 INFO:tasks.workunit.client.1.smithi192.stdout:4/260: rename d2/db/d24 to d2/db/d3e/d57 0 2024-09-21T12:20:20.274 INFO:tasks.workunit.client.1.smithi192.stdout:6/209: chown da/d1f/l22 137 1 2024-09-21T12:20:20.275 INFO:tasks.workunit.client.1.smithi192.stdout:4/261: chown d2/db/d3e/d57/f2c 3903 1 2024-09-21T12:20:20.275 INFO:tasks.workunit.client.1.smithi192.stdout:3/237: creat db/d16/d18/d33/d4a/f52 x:0 0 0 2024-09-21T12:20:20.277 INFO:tasks.workunit.client.1.smithi192.stdout:1/351: getdents d2/d12/d2f/d51/d24/d65 0 2024-09-21T12:20:20.277 INFO:tasks.workunit.client.1.smithi192.stdout:4/262: chown d2/db/d1a/f40 1504 1 2024-09-21T12:20:20.278 INFO:tasks.workunit.client.1.smithi192.stdout:3/238: write f8 [1986448,53052] 0 2024-09-21T12:20:20.280 INFO:tasks.workunit.client.1.smithi192.stdout:1/352: chown d2/da/f32 3964 1 2024-09-21T12:20:20.282 INFO:tasks.workunit.client.1.smithi192.stdout:3/239: write db/d16/d18/d40/f51 [844412,40918] 0 2024-09-21T12:20:20.282 INFO:tasks.workunit.client.1.smithi192.stdout:7/258: rename d6/d20/f3c to d6/d9/d2d/f5e 0 2024-09-21T12:20:20.283 INFO:tasks.workunit.client.1.smithi192.stdout:1/353: chown d2/d12/d2f/d51/d24/d65/f53 244087 1 2024-09-21T12:20:20.285 INFO:tasks.workunit.client.1.smithi192.stdout:1/354: write d2/d12/d2f/d51/d24/f35 [1124034,88478] 0 2024-09-21T12:20:20.287 INFO:tasks.workunit.client.1.smithi192.stdout:4/263: creat d2/df/d52/f58 x:0 0 0 2024-09-21T12:20:20.289 INFO:tasks.workunit.client.1.smithi192.stdout:4/264: write d2/db/d1a/f40 [190651,92542] 0 2024-09-21T12:20:20.290 INFO:tasks.workunit.client.1.smithi192.stdout:8/377: rename d14/d1a/d1d/d20/f37 to d14/d1a/d1d/d46/f73 0 2024-09-21T12:20:20.290 INFO:tasks.workunit.client.1.smithi192.stdout:7/259: dread d6/d3a/f3f [0,4194304] 0 2024-09-21T12:20:20.291 INFO:tasks.workunit.client.1.smithi192.stdout:1/355: truncate d2/d12/d2f/d51/d24/f26 697786 0 2024-09-21T12:20:20.291 INFO:tasks.workunit.client.1.smithi192.stdout:4/265: chown d2/df/l11 0 1 2024-09-21T12:20:20.293 INFO:tasks.workunit.client.1.smithi192.stdout:7/260: write d6/f10 [3463514,21599] 0 2024-09-21T12:20:20.296 INFO:tasks.workunit.client.1.smithi192.stdout:6/210: link da/d23/d37/c38 da/d1f/d27/c40 0 2024-09-21T12:20:20.297 INFO:tasks.workunit.client.1.smithi192.stdout:4/266: dread d2/db/d1a/f40 [0,4194304] 0 2024-09-21T12:20:20.298 INFO:tasks.workunit.client.1.smithi192.stdout:7/261: chown d6/d9/d51/c25 83 1 2024-09-21T12:20:20.298 INFO:tasks.workunit.client.1.smithi192.stdout:6/211: write f8 [2951588,49850] 0 2024-09-21T12:20:20.299 INFO:tasks.workunit.client.1.smithi192.stdout:7/262: chown d6/f10 489013862 1 2024-09-21T12:20:20.299 INFO:tasks.workunit.client.1.smithi192.stdout:6/212: stat da/d1f/c2a 0 2024-09-21T12:20:20.303 INFO:tasks.workunit.client.1.smithi192.stdout:9/266: dread d5/d8/f2d [0,4194304] 0 2024-09-21T12:20:20.303 INFO:tasks.workunit.client.1.smithi192.stdout:8/378: dread d14/d1a/d1d/d39/f4a [0,4194304] 0 2024-09-21T12:20:20.304 INFO:tasks.workunit.client.1.smithi192.stdout:4/267: dread d2/f23 [0,4194304] 0 2024-09-21T12:20:20.310 INFO:tasks.workunit.client.1.smithi192.stdout:7/263: rmdir d6/d9/d2d 39 2024-09-21T12:20:20.312 INFO:tasks.workunit.client.1.smithi192.stdout:6/213: symlink da/d1f/l41 0 2024-09-21T12:20:20.313 INFO:tasks.workunit.client.1.smithi192.stdout:6/214: readlink da/d23/d37/l30 0 2024-09-21T12:20:20.314 INFO:tasks.workunit.client.1.smithi192.stdout:9/267: mknod d5/d8/d2c/c52 0 2024-09-21T12:20:20.317 INFO:tasks.workunit.client.1.smithi192.stdout:4/268: rename d2/d21/f50 to d2/df/d52/f59 0 2024-09-21T12:20:20.321 INFO:tasks.workunit.client.1.smithi192.stdout:3/240: dwrite db/d16/f2c [0,4194304] 0 2024-09-21T12:20:20.322 INFO:tasks.workunit.client.1.smithi192.stdout:3/241: chown db/d2a/f42 852702 1 2024-09-21T12:20:20.323 INFO:tasks.workunit.client.1.smithi192.stdout:6/215: creat da/f42 x:0 0 0 2024-09-21T12:20:20.323 INFO:tasks.workunit.client.1.smithi192.stdout:9/268: mkdir d5/dc/d30/d53 0 2024-09-21T12:20:20.324 INFO:tasks.workunit.client.1.smithi192.stdout:6/216: fdatasync da/fc 0 2024-09-21T12:20:20.325 INFO:tasks.workunit.client.1.smithi192.stdout:9/269: dread - d5/d8/d2c/f4b zero size 2024-09-21T12:20:20.326 INFO:tasks.workunit.client.1.smithi192.stdout:8/379: dread d14/d18/f33 [0,4194304] 0 2024-09-21T12:20:20.332 INFO:tasks.workunit.client.1.smithi192.stdout:1/356: dwrite d2/da/f27 [0,4194304] 0 2024-09-21T12:20:20.332 INFO:tasks.workunit.client.1.smithi192.stdout:6/217: rename da/l17 to da/d23/l43 0 2024-09-21T12:20:20.335 INFO:tasks.workunit.client.1.smithi192.stdout:9/270: creat d5/d21/d3d/f54 x:0 0 0 2024-09-21T12:20:20.336 INFO:tasks.workunit.client.1.smithi192.stdout:8/380: chown d14/d1a/d1d/d46/l4c 7 1 2024-09-21T12:20:20.339 INFO:tasks.workunit.client.1.smithi192.stdout:7/264: creat d6/d9/f5f x:0 0 0 2024-09-21T12:20:20.342 INFO:tasks.workunit.client.1.smithi192.stdout:3/242: symlink db/d16/l53 0 2024-09-21T12:20:20.342 INFO:tasks.workunit.client.1.smithi192.stdout:3/243: chown c4 38085 1 2024-09-21T12:20:20.347 INFO:tasks.workunit.client.1.smithi192.stdout:1/357: rename d2/d12/c21 to d2/da/d6b/c72 0 2024-09-21T12:20:20.353 INFO:tasks.workunit.client.1.smithi192.stdout:4/269: getdents d2 0 2024-09-21T12:20:20.357 INFO:tasks.workunit.client.1.smithi192.stdout:7/265: rename d6/d20/f47 to d6/d9/d1f/d3e/f60 0 2024-09-21T12:20:20.361 INFO:tasks.workunit.client.1.smithi192.stdout:3/244: mknod db/d16/d18/d33/c54 0 2024-09-21T12:20:20.362 INFO:tasks.workunit.client.1.smithi192.stdout:4/270: rmdir d2/df/d52 39 2024-09-21T12:20:20.367 INFO:tasks.workunit.client.1.smithi192.stdout:7/266: rename d6/d9/d1f/f44 to d6/d3a/f61 0 2024-09-21T12:20:20.368 INFO:tasks.workunit.client.1.smithi192.stdout:6/218: write da/d23/f34 [3749508,71349] 0 2024-09-21T12:20:20.369 INFO:tasks.workunit.client.1.smithi192.stdout:8/381: symlink d14/d18/d5a/l74 0 2024-09-21T12:20:20.370 INFO:tasks.workunit.client.1.smithi192.stdout:2/301: sync 2024-09-21T12:20:20.372 INFO:tasks.workunit.client.1.smithi192.stdout:9/271: write d5/d21/f31 [876609,64013] 0 2024-09-21T12:20:20.372 INFO:tasks.workunit.client.1.smithi192.stdout:9/272: readlink d5/d8/l39 0 2024-09-21T12:20:20.374 INFO:tasks.workunit.client.1.smithi192.stdout:3/245: rename db/c35 to db/d16/d18/d21/d23/c55 0 2024-09-21T12:20:20.375 INFO:tasks.workunit.client.1.smithi192.stdout:6/219: mknod da/d1f/d27/c44 0 2024-09-21T12:20:20.376 INFO:tasks.workunit.client.1.smithi192.stdout:8/382: chown d14/d18/c3a 0 1 2024-09-21T12:20:20.377 INFO:tasks.workunit.client.1.smithi192.stdout:4/271: creat d2/d19/d4b/f5a x:0 0 0 2024-09-21T12:20:20.377 INFO:tasks.workunit.client.1.smithi192.stdout:9/273: truncate d5/fa 2624041 0 2024-09-21T12:20:20.379 INFO:tasks.workunit.client.1.smithi192.stdout:6/220: creat da/d1f/f45 x:0 0 0 2024-09-21T12:20:20.380 INFO:tasks.workunit.client.1.smithi192.stdout:7/267: dwrite d6/f15 [0,4194304] 0 2024-09-21T12:20:20.380 INFO:tasks.workunit.client.1.smithi192.stdout:8/383: write d14/d1a/d1d/d20/d5f/f67 [598260,75025] 0 2024-09-21T12:20:20.381 INFO:tasks.workunit.client.1.smithi192.stdout:6/221: write da/f35 [776959,80137] 0 2024-09-21T12:20:20.403 INFO:tasks.workunit.client.0.smithi003.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-21T12:20:20.449 INFO:tasks.workunit.client.1.smithi192.stdout:2/302: creat d1b/f5b x:0 0 0 2024-09-21T12:20:20.449 INFO:tasks.workunit.client.1.smithi192.stdout:9/274: rmdir d5/d8/d36/d3f 39 2024-09-21T12:20:20.450 INFO:tasks.workunit.client.1.smithi192.stdout:3/246: dwrite db/d16/d18/f3e [0,4194304] 0 2024-09-21T12:20:20.451 INFO:tasks.workunit.client.1.smithi192.stdout:7/268: symlink d6/d9/d1f/l62 0 2024-09-21T12:20:20.452 INFO:tasks.workunit.client.1.smithi192.stdout:6/222: symlink da/l46 0 2024-09-21T12:20:20.453 INFO:tasks.workunit.client.1.smithi192.stdout:8/384: mknod d14/d1a/d1d/d39/c75 0 2024-09-21T12:20:20.456 INFO:tasks.workunit.client.1.smithi192.stdout:6/223: mkdir da/d1f/d27/d47 0 2024-09-21T12:20:20.457 INFO:tasks.workunit.client.1.smithi192.stdout:9/275: mkdir d5/d8/d36/d55 0 2024-09-21T12:20:20.457 INFO:tasks.workunit.client.1.smithi192.stdout:3/247: write db/d16/d18/d33/d3b/f3f [822930,64362] 0 2024-09-21T12:20:20.458 INFO:tasks.workunit.client.1.smithi192.stdout:8/385: creat d14/d1a/d1d/d46/d4e/f76 x:0 0 0 2024-09-21T12:20:20.459 INFO:tasks.workunit.client.1.smithi192.stdout:6/224: mkdir da/d1f/d48 0 2024-09-21T12:20:20.460 INFO:tasks.workunit.client.1.smithi192.stdout:6/225: chown f8 1862 1 2024-09-21T12:20:20.461 INFO:tasks.workunit.client.1.smithi192.stdout:9/276: mknod d5/dc/c56 0 2024-09-21T12:20:20.461 INFO:tasks.workunit.client.1.smithi192.stdout:8/386: rename d14/d1a to d14/d1a/d1d/d20/d77 22 2024-09-21T12:20:20.462 INFO:tasks.workunit.client.1.smithi192.stdout:7/269: dwrite d6/f27 [0,4194304] 0 2024-09-21T12:20:20.463 INFO:tasks.workunit.client.1.smithi192.stdout:3/248: write db/d16/d18/d33/d4a/f52 [1016492,95039] 0 2024-09-21T12:20:20.464 INFO:tasks.workunit.client.1.smithi192.stdout:6/226: write da/d1f/f45 [527354,114744] 0 2024-09-21T12:20:20.464 INFO:tasks.workunit.client.1.smithi192.stdout:9/277: dread - d5/d8/d11/f17 zero size 2024-09-21T12:20:20.466 INFO:tasks.workunit.client.1.smithi192.stdout:8/387: write d14/d1a/d1d/f58 [1014587,38188] 0 2024-09-21T12:20:20.468 INFO:tasks.workunit.client.1.smithi192.stdout:7/270: mkdir d6/d3a/d63 0 2024-09-21T12:20:20.468 INFO:tasks.workunit.client.1.smithi192.stdout:9/278: dread - d5/d8/d2c/f4b zero size 2024-09-21T12:20:20.469 INFO:tasks.workunit.client.1.smithi192.stdout:3/249: write db/d16/d18/d33/f43 [432754,5742] 0 2024-09-21T12:20:20.469 INFO:tasks.workunit.client.1.smithi192.stdout:2/303: dwrite f14 [0,4194304] 0 2024-09-21T12:20:20.471 INFO:tasks.workunit.client.1.smithi192.stdout:3/250: write db/f3c [33807,119904] 0 2024-09-21T12:20:20.473 INFO:tasks.workunit.client.1.smithi192.stdout:8/388: symlink d14/l78 0 2024-09-21T12:20:20.476 INFO:tasks.workunit.client.1.smithi192.stdout:6/227: link da/f42 da/d23/f49 0 2024-09-21T12:20:20.477 INFO:tasks.workunit.client.1.smithi192.stdout:9/279: mknod d5/d8/d36/d55/c57 0 2024-09-21T12:20:20.477 INFO:tasks.workunit.client.1.smithi192.stdout:3/251: creat db/d2a/d2e/f56 x:0 0 0 2024-09-21T12:20:20.478 INFO:tasks.workunit.client.1.smithi192.stdout:3/252: fdatasync db/d16/f2c 0 2024-09-21T12:20:20.478 INFO:tasks.workunit.client.1.smithi192.stdout:8/389: truncate ff 1417361 0 2024-09-21T12:20:20.480 INFO:tasks.workunit.client.1.smithi192.stdout:2/304: link d1b/d1e/l42 d1b/d38/d53/l5c 0 2024-09-21T12:20:20.480 INFO:tasks.workunit.client.1.smithi192.stdout:6/228: write da/d23/f26 [791515,65423] 0 2024-09-21T12:20:20.481 INFO:tasks.workunit.client.1.smithi192.stdout:9/280: creat d5/d8/d2c/f58 x:0 0 0 2024-09-21T12:20:20.481 INFO:tasks.workunit.client.1.smithi192.stdout:2/305: chown d1b/f52 72 1 2024-09-21T12:20:20.482 INFO:tasks.workunit.client.1.smithi192.stdout:8/390: creat d14/d1a/f79 x:0 0 0 2024-09-21T12:20:20.483 INFO:tasks.workunit.client.1.smithi192.stdout:6/229: truncate da/d1f/f3f 823317 0 2024-09-21T12:20:20.483 INFO:tasks.workunit.client.1.smithi192.stdout:8/391: chown d14 0 1 2024-09-21T12:20:20.484 INFO:tasks.workunit.client.1.smithi192.stdout:6/230: write da/d1f/f31 [646250,103439] 0 2024-09-21T12:20:20.485 INFO:tasks.workunit.client.1.smithi192.stdout:3/253: rename db/c17 to db/d16/d18/c57 0 2024-09-21T12:20:20.486 INFO:tasks.workunit.client.1.smithi192.stdout:8/392: mknod d14/d1a/d1d/d39/c7a 0 2024-09-21T12:20:20.487 INFO:tasks.workunit.client.1.smithi192.stdout:6/231: unlink l9 0 2024-09-21T12:20:20.488 INFO:tasks.workunit.client.1.smithi192.stdout:0/268: sync 2024-09-21T12:20:20.488 INFO:tasks.workunit.client.1.smithi192.stdout:5/481: sync 2024-09-21T12:20:20.489 INFO:tasks.workunit.client.1.smithi192.stdout:3/254: creat db/d16/d18/d33/d3b/f58 x:0 0 0 2024-09-21T12:20:20.489 INFO:tasks.workunit.client.1.smithi192.stdout:9/281: dwrite d5/d8/f15 [0,4194304] 0 2024-09-21T12:20:20.489 INFO:tasks.workunit.client.1.smithi192.stdout:0/269: stat d3/d5/l29 0 2024-09-21T12:20:20.489 INFO:tasks.workunit.client.1.smithi192.stdout:6/232: stat da/d1f/c2a 0 2024-09-21T12:20:20.491 INFO:tasks.workunit.client.1.smithi192.stdout:6/233: stat da/l24 0 2024-09-21T12:20:20.491 INFO:tasks.workunit.client.1.smithi192.stdout:8/393: unlink d14/d18/c3a 0 2024-09-21T12:20:20.492 INFO:tasks.workunit.client.1.smithi192.stdout:2/306: getdents d1b 0 2024-09-21T12:20:20.492 INFO:tasks.workunit.client.1.smithi192.stdout:0/270: fsync d3/d5/d28/d39/f41 0 2024-09-21T12:20:20.495 INFO:tasks.workunit.client.1.smithi192.stdout:6/234: write da/fc [4534547,13024] 0 2024-09-21T12:20:20.497 INFO:tasks.workunit.client.1.smithi192.stdout:5/482: symlink d0/d65/d8e/d98/la2 0 2024-09-21T12:20:20.498 INFO:tasks.workunit.client.1.smithi192.stdout:8/394: truncate d14/d1a/d1d/d39/f72 144030 0 2024-09-21T12:20:20.498 INFO:tasks.workunit.client.1.smithi192.stdout:2/307: rename l17 to d1b/d38/d53/l5d 0 2024-09-21T12:20:20.499 INFO:tasks.workunit.client.1.smithi192.stdout:5/483: read d0/dc/d13/d37/d38/f4c [3021279,126042] 0 2024-09-21T12:20:20.499 INFO:tasks.workunit.client.1.smithi192.stdout:2/308: write d1b/f4c [62167,46466] 0 2024-09-21T12:20:20.500 INFO:tasks.workunit.client.1.smithi192.stdout:9/282: mknod d5/d8/d36/c59 0 2024-09-21T12:20:20.500 INFO:tasks.workunit.client.1.smithi192.stdout:8/395: truncate d14/d1a/d1d/f64 1026398 0 2024-09-21T12:20:20.501 INFO:tasks.workunit.client.1.smithi192.stdout:2/309: write d1b/f27 [1003768,12132] 0 2024-09-21T12:20:20.504 INFO:tasks.workunit.client.1.smithi192.stdout:0/271: rename d3/d5/d19/d31 to d3/d5/d19/d51 0 2024-09-21T12:20:20.506 INFO:tasks.workunit.client.1.smithi192.stdout:1/358: sync 2024-09-21T12:20:20.510 INFO:tasks.workunit.client.1.smithi192.stdout:3/255: link db/lc db/l59 0 2024-09-21T12:20:20.510 INFO:tasks.workunit.client.1.smithi192.stdout:2/310: mkdir d1b/d1e/d5e 0 2024-09-21T12:20:20.512 INFO:tasks.workunit.client.1.smithi192.stdout:6/235: creat da/d1f/d27/d3e/f4a x:0 0 0 2024-09-21T12:20:20.512 INFO:tasks.workunit.client.1.smithi192.stdout:7/271: dwrite d6/d9/d1f/f37 [0,4194304] 0 2024-09-21T12:20:20.513 INFO:tasks.workunit.client.1.smithi192.stdout:5/484: dread d0/f3b [0,4194304] 0 2024-09-21T12:20:20.515 INFO:tasks.workunit.client.1.smithi192.stdout:2/311: write d1b/f27 [1599832,95990] 0 2024-09-21T12:20:20.515 INFO:tasks.workunit.client.1.smithi192.stdout:0/272: unlink d3/d6/c4b 0 2024-09-21T12:20:20.515 INFO:tasks.workunit.client.1.smithi192.stdout:9/283: dwrite d5/d8/d36/f43 [0,4194304] 0 2024-09-21T12:20:20.516 INFO:tasks.workunit.client.1.smithi192.stdout:6/236: chown da/d23/f26 228 1 2024-09-21T12:20:20.516 INFO:tasks.workunit.client.1.smithi192.stdout:8/396: mkdir d14/d18/d7b 0 2024-09-21T12:20:20.519 INFO:tasks.workunit.client.1.smithi192.stdout:7/272: write d6/d20/f48 [1446339,1405] 0 2024-09-21T12:20:20.519 INFO:tasks.workunit.client.1.smithi192.stdout:9/284: readlink d5/l2b 0 2024-09-21T12:20:20.522 INFO:tasks.workunit.client.1.smithi192.stdout:9/285: dread - d5/d21/f4c zero size 2024-09-21T12:20:20.524 INFO:tasks.workunit.client.1.smithi192.stdout:0/273: mknod d3/de/d33/c52 0 2024-09-21T12:20:20.525 INFO:tasks.workunit.client.1.smithi192.stdout:9/286: chown d5/d8/d11/f17 2702 1 2024-09-21T12:20:20.527 INFO:tasks.workunit.client.1.smithi192.stdout:1/359: dwrite d2/d12/d2f/d51/d24/d5e/f67 [0,4194304] 0 2024-09-21T12:20:20.528 INFO:tasks.workunit.client.1.smithi192.stdout:8/397: write d14/d1a/d1d/f57 [6110104,114487] 0 2024-09-21T12:20:20.530 INFO:tasks.workunit.client.1.smithi192.stdout:0/274: read - d3/d5/d19/f3e zero size 2024-09-21T12:20:20.537 INFO:tasks.workunit.client.1.smithi192.stdout:3/256: symlink db/d16/d18/d33/l5a 0 2024-09-21T12:20:20.538 INFO:tasks.workunit.client.1.smithi192.stdout:7/273: mknod d6/d9/d2d/c64 0 2024-09-21T12:20:20.538 INFO:tasks.workunit.client.1.smithi192.stdout:9/287: write d5/d8/d36/f45 [75322,65808] 0 2024-09-21T12:20:20.539 INFO:tasks.workunit.client.1.smithi192.stdout:3/257: readlink db/d16/d18/l27 0 2024-09-21T12:20:20.539 INFO:tasks.workunit.client.1.smithi192.stdout:2/312: dread d1b/f45 [0,4194304] 0 2024-09-21T12:20:20.540 INFO:tasks.workunit.client.1.smithi192.stdout:8/398: mknod d14/d1a/d1d/c7c 0 2024-09-21T12:20:20.543 INFO:tasks.workunit.client.1.smithi192.stdout:0/275: getdents d3/d6/d1d 0 2024-09-21T12:20:20.544 INFO:tasks.workunit.client.1.smithi192.stdout:2/313: write d1b/d1e/f2d [907255,44133] 0 2024-09-21T12:20:20.545 INFO:tasks.workunit.client.1.smithi192.stdout:9/288: unlink d5/dc/d40/f4e 0 2024-09-21T12:20:20.546 INFO:tasks.workunit.client.1.smithi192.stdout:3/258: symlink db/d16/d18/d33/d3b/l5b 0 2024-09-21T12:20:20.547 INFO:tasks.workunit.client.1.smithi192.stdout:2/314: fdatasync ff 0 2024-09-21T12:20:20.551 INFO:tasks.workunit.client.1.smithi192.stdout:9/289: mkdir d5/d8/d11/d5a 0 2024-09-21T12:20:20.552 INFO:tasks.workunit.client.1.smithi192.stdout:0/276: symlink d3/d5/d28/d39/d50/l53 0 2024-09-21T12:20:20.552 INFO:tasks.workunit.client.1.smithi192.stdout:6/237: dwrite da/f3b [0,4194304] 0 2024-09-21T12:20:20.554 INFO:tasks.workunit.client.1.smithi192.stdout:2/315: unlink d1b/d38/f40 0 2024-09-21T12:20:20.555 INFO:tasks.workunit.client.1.smithi192.stdout:7/274: dwrite d6/d3a/f46 [0,4194304] 0 2024-09-21T12:20:20.559 INFO:tasks.workunit.client.1.smithi192.stdout:6/238: read da/d1f/f31 [683594,64002] 0 2024-09-21T12:20:20.559 INFO:tasks.workunit.client.1.smithi192.stdout:9/290: write d5/d8/f15 [3184340,34053] 0 2024-09-21T12:20:20.563 INFO:tasks.workunit.client.1.smithi192.stdout:0/277: write d3/d6/d1d/f4d [52615,3246] 0 2024-09-21T12:20:20.564 INFO:tasks.workunit.client.1.smithi192.stdout:1/360: dwrite d2/da/f60 [0,4194304] 0 2024-09-21T12:20:20.567 INFO:tasks.workunit.client.1.smithi192.stdout:2/316: creat d1b/d1e/f5f x:0 0 0 2024-09-21T12:20:20.568 INFO:tasks.workunit.client.1.smithi192.stdout:6/239: read - da/d1f/d27/d3e/f4a zero size 2024-09-21T12:20:20.569 INFO:tasks.workunit.client.1.smithi192.stdout:0/278: write d3/d5/d19/d51/f3b [623106,7459] 0 2024-09-21T12:20:20.571 INFO:tasks.workunit.client.1.smithi192.stdout:3/259: dwrite db/d16/d18/d33/f43 [0,4194304] 0 2024-09-21T12:20:20.572 INFO:tasks.workunit.client.1.smithi192.stdout:9/291: rename d5/d19 to d5/d19/d5b 22 2024-09-21T12:20:20.573 INFO:tasks.workunit.client.1.smithi192.stdout:0/279: readlink d3/d5/d19/l48 0 2024-09-21T12:20:20.575 INFO:tasks.workunit.client.1.smithi192.stdout:1/361: mknod d2/d12/d2f/d51/d24/d58/c73 0 2024-09-21T12:20:20.577 INFO:tasks.workunit.client.1.smithi192.stdout:2/317: link d1b/d38/f49 d1b/d38/f60 0 2024-09-21T12:20:20.577 INFO:tasks.workunit.client.1.smithi192.stdout:1/362: chown d2/d12/d2f 20456 1 2024-09-21T12:20:20.578 INFO:tasks.workunit.client.1.smithi192.stdout:1/363: stat d2/da/c13 0 2024-09-21T12:20:20.579 INFO:tasks.workunit.client.1.smithi192.stdout:6/240: link da/f16 da/f4b 0 2024-09-21T12:20:20.580 INFO:tasks.workunit.client.1.smithi192.stdout:7/275: dwrite d6/d9/d2d/f5a [0,4194304] 0 2024-09-21T12:20:20.582 INFO:tasks.workunit.client.1.smithi192.stdout:3/260: dread db/f4f [0,4194304] 0 2024-09-21T12:20:20.582 INFO:tasks.workunit.client.1.smithi192.stdout:0/280: creat d3/de/d43/f54 x:0 0 0 2024-09-21T12:20:20.585 INFO:tasks.workunit.client.1.smithi192.stdout:2/318: creat d1b/d38/d53/f61 x:0 0 0 2024-09-21T12:20:20.585 INFO:tasks.workunit.client.1.smithi192.stdout:6/241: fdatasync da/f20 0 2024-09-21T12:20:20.586 INFO:tasks.workunit.client.1.smithi192.stdout:1/364: creat d2/d12/d2f/d51/d24/d65/f74 x:0 0 0 2024-09-21T12:20:20.589 INFO:tasks.workunit.client.1.smithi192.stdout:6/242: chown da/c2c 6368802 1 2024-09-21T12:20:20.589 INFO:tasks.workunit.client.1.smithi192.stdout:2/319: mkdir d1b/d1e/d62 0 2024-09-21T12:20:20.591 INFO:tasks.workunit.client.1.smithi192.stdout:9/292: creat d5/dc/f5c x:0 0 0 2024-09-21T12:20:20.596 INFO:tasks.workunit.client.1.smithi192.stdout:6/243: read da/d23/f34 [2041521,19113] 0 2024-09-21T12:20:20.597 INFO:tasks.workunit.client.1.smithi192.stdout:9/293: dread - d5/d8/d11/f17 zero size 2024-09-21T12:20:20.597 INFO:tasks.workunit.client.1.smithi192.stdout:7/276: dwrite d6/d9/d2d/f5a [8388608,4194304] 0 2024-09-21T12:20:20.597 INFO:tasks.workunit.client.1.smithi192.stdout:0/281: dwrite d3/d6/f4c [0,4194304] 0 2024-09-21T12:20:20.599 INFO:tasks.workunit.client.1.smithi192.stdout:7/277: chown d6/d9/d51/l57 219 1 2024-09-21T12:20:20.599 INFO:tasks.workunit.client.1.smithi192.stdout:9/294: dread - d5/d8/d2c/f58 zero size 2024-09-21T12:20:20.599 INFO:tasks.workunit.client.1.smithi192.stdout:0/282: dread - d3/d5/d19/f3e zero size 2024-09-21T12:20:20.600 INFO:tasks.workunit.client.1.smithi192.stdout:7/278: readlink d6/d9/d51/l57 0 2024-09-21T12:20:20.600 INFO:tasks.workunit.client.1.smithi192.stdout:1/365: rename d2/d12/f10 to d2/d12/d2f/d51/d24/d65/d5a/f75 0 2024-09-21T12:20:20.602 INFO:tasks.workunit.client.1.smithi192.stdout:2/320: rmdir d1b/d38/d44 0 2024-09-21T12:20:20.603 INFO:tasks.workunit.client.1.smithi192.stdout:7/279: write d6/d9/f1c [107942,123326] 0 2024-09-21T12:20:20.603 INFO:tasks.workunit.client.1.smithi192.stdout:1/366: dread - d2/d12/d2f/d51/d24/d65/f74 zero size 2024-09-21T12:20:20.604 INFO:tasks.workunit.client.1.smithi192.stdout:1/367: chown d2/c4 82138 1 2024-09-21T12:20:20.605 INFO:tasks.workunit.client.1.smithi192.stdout:1/368: fsync d2/d12/d2f/d51/f38 0 2024-09-21T12:20:20.613 INFO:tasks.workunit.client.1.smithi192.stdout:0/283: symlink d3/d5/d28/d39/l55 0 2024-09-21T12:20:20.613 INFO:tasks.workunit.client.1.smithi192.stdout:2/321: symlink d1b/d1e/d3d/l63 0 2024-09-21T12:20:20.614 INFO:tasks.workunit.client.1.smithi192.stdout:0/284: chown d3/d5/d28/d39/l42 12 1 2024-09-21T12:20:20.615 INFO:tasks.workunit.client.1.smithi192.stdout:0/285: chown d3/de/d43/f54 231220 1 2024-09-21T12:20:20.615 INFO:tasks.workunit.client.1.smithi192.stdout:1/369: mknod d2/d12/d2f/d51/d24/d65/d5a/c76 0 2024-09-21T12:20:20.617 INFO:tasks.workunit.client.1.smithi192.stdout:7/280: creat d6/d3a/d63/f65 x:0 0 0 2024-09-21T12:20:20.617 INFO:tasks.workunit.client.1.smithi192.stdout:2/322: mknod d1b/d38/d53/c64 0 2024-09-21T12:20:20.619 INFO:tasks.workunit.client.1.smithi192.stdout:0/286: creat d3/d5/d28/f56 x:0 0 0 2024-09-21T12:20:20.620 INFO:tasks.workunit.client.1.smithi192.stdout:2/323: mkdir d1b/d65 0 2024-09-21T12:20:20.621 INFO:tasks.workunit.client.1.smithi192.stdout:1/370: stat d2/d12/d2f/d51/d24/d5e/f67 0 2024-09-21T12:20:20.621 INFO:tasks.workunit.client.1.smithi192.stdout:9/295: dwrite d5/d21/f4c [0,4194304] 0 2024-09-21T12:20:20.623 INFO:tasks.workunit.client.1.smithi192.stdout:7/281: creat d6/d9/d1f/f66 x:0 0 0 2024-09-21T12:20:20.625 INFO:tasks.workunit.client.1.smithi192.stdout:0/287: symlink d3/d5/d28/l57 0 2024-09-21T12:20:20.626 INFO:tasks.workunit.client.1.smithi192.stdout:2/324: write ff [1362503,47533] 0 2024-09-21T12:20:20.626 INFO:tasks.workunit.client.1.smithi192.stdout:6/244: dwrite da/f20 [0,4194304] 0 2024-09-21T12:20:20.627 INFO:tasks.workunit.client.1.smithi192.stdout:7/282: write d6/d9/d2d/f5a [2533983,23930] 0 2024-09-21T12:20:20.630 INFO:tasks.workunit.client.1.smithi192.stdout:9/296: creat d5/d8/d2c/f5d x:0 0 0 2024-09-21T12:20:20.632 INFO:tasks.workunit.client.1.smithi192.stdout:6/245: creat da/d1f/f4c x:0 0 0 2024-09-21T12:20:20.633 INFO:tasks.workunit.client.1.smithi192.stdout:7/283: read d6/d9/d51/f23 [2538366,57353] 0 2024-09-21T12:20:20.636 INFO:tasks.workunit.client.1.smithi192.stdout:4/272: sync 2024-09-21T12:20:20.638 INFO:tasks.workunit.client.1.smithi192.stdout:7/284: mknod d6/d3a/c67 0 2024-09-21T12:20:20.638 INFO:tasks.workunit.client.1.smithi192.stdout:6/246: read da/d23/f26 [1153329,104956] 0 2024-09-21T12:20:20.642 INFO:tasks.workunit.client.1.smithi192.stdout:7/285: unlink d6/d9/c5c 0 2024-09-21T12:20:20.642 INFO:tasks.workunit.client.1.smithi192.stdout:6/247: chown c4 2397180 1 2024-09-21T12:20:20.643 INFO:tasks.workunit.client.1.smithi192.stdout:0/288: truncate d3/de/f24 4372727 0 2024-09-21T12:20:20.643 INFO:tasks.workunit.client.1.smithi192.stdout:7/286: stat d6/ff 0 2024-09-21T12:20:20.644 INFO:tasks.workunit.client.1.smithi192.stdout:6/248: chown da/d23/d37 1 1 2024-09-21T12:20:20.644 INFO:tasks.workunit.client.1.smithi192.stdout:2/325: dwrite d1b/d1e/d3d/f56 [0,4194304] 0 2024-09-21T12:20:20.646 INFO:tasks.workunit.client.1.smithi192.stdout:6/249: chown da/d1f 52 1 2024-09-21T12:20:20.651 INFO:tasks.workunit.client.1.smithi192.stdout:4/273: chown d2/db/d3e/d57/d32/d4f/l51 23 1 2024-09-21T12:20:20.653 INFO:tasks.workunit.client.1.smithi192.stdout:9/297: dwrite d5/dc/d40/f25 [0,4194304] 0 2024-09-21T12:20:20.656 INFO:tasks.workunit.client.1.smithi192.stdout:2/326: truncate d1b/d1e/d3d/f5a 909693 0 2024-09-21T12:20:20.665 INFO:tasks.workunit.client.1.smithi192.stdout:0/289: dwrite d3/d5/d19/d51/f32 [0,4194304] 0 2024-09-21T12:20:20.665 INFO:tasks.workunit.client.1.smithi192.stdout:1/371: dread d2/da/f46 [0,4194304] 0 2024-09-21T12:20:20.667 INFO:tasks.workunit.client.1.smithi192.stdout:7/287: dread d6/d3a/f46 [0,4194304] 0 2024-09-21T12:20:20.668 INFO:tasks.workunit.client.1.smithi192.stdout:9/298: dread d5/d8/d36/f43 [0,4194304] 0 2024-09-21T12:20:20.669 INFO:tasks.workunit.client.1.smithi192.stdout:9/299: chown d5/dc/d40/l41 855019 1 2024-09-21T12:20:20.670 INFO:tasks.workunit.client.1.smithi192.stdout:1/372: mknod d2/d12/d2f/d41/d61/c77 0 2024-09-21T12:20:20.671 INFO:tasks.workunit.client.1.smithi192.stdout:6/250: write da/f16 [4241044,2679] 0 2024-09-21T12:20:20.671 INFO:tasks.workunit.client.1.smithi192.stdout:7/288: mkdir d6/d9/d2d/d68 0 2024-09-21T12:20:20.672 INFO:tasks.workunit.client.1.smithi192.stdout:1/373: chown d2/f3e 2466609 1 2024-09-21T12:20:20.675 INFO:tasks.workunit.client.1.smithi192.stdout:2/327: write d1b/d38/f60 [1249116,42388] 0 2024-09-21T12:20:20.676 INFO:tasks.workunit.client.1.smithi192.stdout:0/290: getdents d3/de/d33 0 2024-09-21T12:20:20.678 INFO:tasks.workunit.client.1.smithi192.stdout:1/374: symlink d2/d4d/l78 0 2024-09-21T12:20:20.678 INFO:tasks.workunit.client.1.smithi192.stdout:2/328: chown d1b/d65 48379162 1 2024-09-21T12:20:20.680 INFO:tasks.workunit.client.1.smithi192.stdout:0/291: chown d3/d6/d1d/l2d 5 1 2024-09-21T12:20:20.681 INFO:tasks.workunit.client.1.smithi192.stdout:6/251: rename da/d1f/f31 to da/d1f/d48/f4d 0 2024-09-21T12:20:20.683 INFO:tasks.workunit.client.1.smithi192.stdout:4/274: dwrite d2/d21/f2e [4194304,4194304] 0 2024-09-21T12:20:20.684 INFO:tasks.workunit.client.1.smithi192.stdout:1/375: write d2/de/f48 [4156358,24647] 0 2024-09-21T12:20:20.686 INFO:tasks.workunit.client.1.smithi192.stdout:2/329: link d1b/d1e/d3d/f4b d1b/d1e/f66 0 2024-09-21T12:20:20.688 INFO:tasks.workunit.client.1.smithi192.stdout:0/292: rename d3/d5/d19/f26 to d3/d5/d19/f58 0 2024-09-21T12:20:20.691 INFO:tasks.workunit.client.1.smithi192.stdout:6/252: rename da/d1f/d27/c44 to da/d23/d37/c4e 0 2024-09-21T12:20:20.693 INFO:tasks.workunit.client.1.smithi192.stdout:1/376: dread - d2/d12/d2f/d51/d24/d65/f53 zero size 2024-09-21T12:20:20.695 INFO:tasks.workunit.client.1.smithi192.stdout:4/275: creat d2/db/d3e/d41/f5b x:0 0 0 2024-09-21T12:20:20.696 INFO:tasks.workunit.client.1.smithi192.stdout:7/289: dwrite d6/d9/d1f/f21 [0,4194304] 0 2024-09-21T12:20:20.698 INFO:tasks.workunit.client.1.smithi192.stdout:7/290: readlink d6/d3a/l3d 0 2024-09-21T12:20:20.698 INFO:tasks.workunit.client.1.smithi192.stdout:2/330: dread f15 [0,4194304] 0 2024-09-21T12:20:20.700 INFO:tasks.workunit.client.1.smithi192.stdout:0/293: getdents d3/de/d43 0 2024-09-21T12:20:20.700 INFO:tasks.workunit.client.1.smithi192.stdout:9/300: dread d5/dc/d40/f14 [0,4194304] 0 2024-09-21T12:20:20.700 INFO:tasks.workunit.client.1.smithi192.stdout:4/276: unlink d2/db/f1f 0 2024-09-21T12:20:20.701 INFO:tasks.workunit.client.1.smithi192.stdout:7/291: read d6/d9/d1f/d3e/f60 [3058627,121212] 0 2024-09-21T12:20:20.701 INFO:tasks.workunit.client.1.smithi192.stdout:2/331: read d1b/d1e/d3d/f56 [2519283,59718] 0 2024-09-21T12:20:20.702 INFO:tasks.workunit.client.1.smithi192.stdout:1/377: rename d2/de/l15 to d2/d12/d2f/d51/d24/d65/l79 0 2024-09-21T12:20:20.703 INFO:tasks.workunit.client.1.smithi192.stdout:9/301: dread - d5/d8/d2c/f4f zero size 2024-09-21T12:20:20.703 INFO:tasks.workunit.client.1.smithi192.stdout:4/277: chown d2/db/d1a/f2b 0 1 2024-09-21T12:20:20.705 INFO:tasks.workunit.client.1.smithi192.stdout:6/253: dread da/f35 [0,4194304] 0 2024-09-21T12:20:20.708 INFO:tasks.workunit.client.1.smithi192.stdout:7/292: mkdir d6/d20/d69 0 2024-09-21T12:20:20.708 INFO:tasks.workunit.client.1.smithi192.stdout:1/378: mknod d2/d4d/c7a 0 2024-09-21T12:20:20.710 INFO:tasks.workunit.client.1.smithi192.stdout:4/278: mknod d2/db/d34/d42/c5c 0 2024-09-21T12:20:20.713 INFO:tasks.workunit.client.1.smithi192.stdout:7/293: unlink d6/ff 0 2024-09-21T12:20:20.717 INFO:tasks.workunit.client.1.smithi192.stdout:4/279: readlink d2/db/d3e/d57/l3d 0 2024-09-21T12:20:20.719 INFO:tasks.workunit.client.1.smithi192.stdout:0/294: dwrite d3/d6/f3f [4194304,4194304] 0 2024-09-21T12:20:20.719 INFO:tasks.workunit.client.1.smithi192.stdout:7/294: stat d6/d9/f14 0 2024-09-21T12:20:20.726 INFO:tasks.workunit.client.1.smithi192.stdout:4/280: rmdir d2/d19/d4b 39 2024-09-21T12:20:20.729 INFO:tasks.workunit.client.1.smithi192.stdout:7/295: fsync d6/d9/d1f/f66 0 2024-09-21T12:20:20.729 INFO:tasks.workunit.client.1.smithi192.stdout:9/302: dwrite d5/d8/d2c/f4b [0,4194304] 0 2024-09-21T12:20:20.729 INFO:tasks.workunit.client.1.smithi192.stdout:0/295: symlink d3/de/l59 0 2024-09-21T12:20:20.735 INFO:tasks.workunit.client.1.smithi192.stdout:2/332: dwrite f15 [4194304,4194304] 0 2024-09-21T12:20:20.735 INFO:tasks.workunit.client.1.smithi192.stdout:6/254: dwrite da/d1f/d27/f28 [0,4194304] 0 2024-09-21T12:20:20.739 INFO:tasks.workunit.client.1.smithi192.stdout:6/255: mknod da/d1f/d48/c4f 0 2024-09-21T12:20:20.744 INFO:tasks.workunit.client.1.smithi192.stdout:6/256: mknod da/d1f/d27/c50 0 2024-09-21T12:20:20.745 INFO:tasks.workunit.client.1.smithi192.stdout:1/379: dwrite d2/d12/d2f/d51/d24/d65/d5a/f5d [0,4194304] 0 2024-09-21T12:20:20.748 INFO:tasks.workunit.client.1.smithi192.stdout:4/281: rename d2/d36/f4c to d2/df/f5d 0 2024-09-21T12:20:20.755 INFO:tasks.workunit.client.1.smithi192.stdout:1/380: mkdir d2/d12/d2f/d51/d24/d65/d7b 0 2024-09-21T12:20:20.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:20 smithi192 ceph-mon[35641]: pgmap v260: 65 pgs: 65 active+clean; 357 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 291 KiB/s rd, 16 MiB/s wr, 250 op/s 2024-09-21T12:20:20.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:20 smithi192 ceph-mon[35641]: from='client.14672 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:20:20.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:20 smithi192 ceph-mon[35641]: from='client.14676 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:20:20.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:20 smithi192 ceph-mon[35641]: from='client.? 172.21.15.3:0/521347410' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:20:20.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:20 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:20:20.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:20 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:20:20.758 INFO:tasks.workunit.client.1.smithi192.stdout:2/333: dwrite d1b/d1e/f2d [0,4194304] 0 2024-09-21T12:20:20.758 INFO:tasks.workunit.client.1.smithi192.stdout:0/296: dwrite d3/de/d43/f54 [0,4194304] 0 2024-09-21T12:20:20.759 INFO:tasks.workunit.client.1.smithi192.stdout:4/282: truncate d2/df/d52/f58 763785 0 2024-09-21T12:20:20.759 INFO:tasks.workunit.client.1.smithi192.stdout:5/485: sync 2024-09-21T12:20:20.760 INFO:tasks.workunit.client.1.smithi192.stdout:0/297: readlink d3/de/d33/l45 0 2024-09-21T12:20:20.760 INFO:tasks.workunit.client.1.smithi192.stdout:5/486: readlink d0/dc/l60 0 2024-09-21T12:20:20.762 INFO:tasks.workunit.client.1.smithi192.stdout:7/296: rename d6/d9/d2d/c43 to d6/c6a 0 2024-09-21T12:20:20.764 INFO:tasks.workunit.client.1.smithi192.stdout:9/303: rename d5/d8 to d5/d8/d11/d44/d5e 22 2024-09-21T12:20:20.765 INFO:tasks.workunit.client.1.smithi192.stdout:2/334: symlink d1b/l67 0 2024-09-21T12:20:20.768 INFO:tasks.workunit.client.1.smithi192.stdout:6/257: write da/f42 [1040802,52640] 0 2024-09-21T12:20:20.768 INFO:tasks.workunit.client.1.smithi192.stdout:9/304: stat d5/d21 0 2024-09-21T12:20:20.769 INFO:tasks.workunit.client.1.smithi192.stdout:9/305: readlink l4 0 2024-09-21T12:20:20.770 INFO:tasks.workunit.client.1.smithi192.stdout:7/297: symlink d6/d9/l6b 0 2024-09-21T12:20:20.771 INFO:tasks.workunit.client.1.smithi192.stdout:4/283: rename d2/db/d3e/d57/f2c to d2/db/d3e/d41/f5e 0 2024-09-21T12:20:20.774 INFO:tasks.workunit.client.1.smithi192.stdout:7/298: mknod d6/d9/d51/c6c 0 2024-09-21T12:20:20.775 INFO:tasks.workunit.client.1.smithi192.stdout:5/487: link d0/d65/d8e/d98/la2 d0/la3 0 2024-09-21T12:20:20.775 INFO:tasks.workunit.client.1.smithi192.stdout:6/258: rmdir da/d1f/d27/d47 0 2024-09-21T12:20:20.777 INFO:tasks.workunit.client.1.smithi192.stdout:0/298: dwrite d3/d5/d19/f4f [0,4194304] 0 2024-09-21T12:20:20.777 INFO:tasks.workunit.client.1.smithi192.stdout:9/306: read d5/d8/f22 [598951,76157] 0 2024-09-21T12:20:20.777 INFO:tasks.workunit.client.1.smithi192.stdout:7/299: mkdir d6/d3a/d6d 0 2024-09-21T12:20:20.780 INFO:tasks.workunit.client.1.smithi192.stdout:2/335: dwrite f14 [4194304,4194304] 0 2024-09-21T12:20:20.782 INFO:tasks.workunit.client.1.smithi192.stdout:0/299: creat d3/d6/f5a x:0 0 0 2024-09-21T12:20:20.783 INFO:tasks.workunit.client.1.smithi192.stdout:7/300: symlink d6/d9/d2d/d68/l6e 0 2024-09-21T12:20:20.785 INFO:tasks.workunit.client.1.smithi192.stdout:0/300: dread - d3/d5/d19/f3e zero size 2024-09-21T12:20:20.787 INFO:tasks.workunit.client.1.smithi192.stdout:0/301: stat d3/d6/d1d 0 2024-09-21T12:20:20.788 INFO:tasks.workunit.client.1.smithi192.stdout:2/336: rename d1b/d1e/l42 to d1b/d38/l68 0 2024-09-21T12:20:20.789 INFO:tasks.workunit.client.1.smithi192.stdout:0/302: fdatasync d3/d6/f3f 0 2024-09-21T12:20:20.790 INFO:tasks.workunit.client.1.smithi192.stdout:7/301: write d6/d9/d1f/d3e/f60 [2206503,22515] 0 2024-09-21T12:20:20.791 INFO:tasks.workunit.client.1.smithi192.stdout:6/259: dwrite da/d23/f34 [4194304,4194304] 0 2024-09-21T12:20:20.796 INFO:tasks.workunit.client.1.smithi192.stdout:7/302: stat d6/d9/l28 0 2024-09-21T12:20:20.799 INFO:tasks.workunit.client.1.smithi192.stdout:0/303: dread d3/d5/d19/f4f [0,4194304] 0 2024-09-21T12:20:20.800 INFO:tasks.workunit.client.1.smithi192.stdout:7/303: creat d6/d3a/d63/f6f x:0 0 0 2024-09-21T12:20:20.802 INFO:tasks.workunit.client.1.smithi192.stdout:1/381: dread d2/d12/d2f/d51/d24/d65/d5a/f75 [0,4194304] 0 2024-09-21T12:20:20.803 INFO:tasks.workunit.client.1.smithi192.stdout:1/382: stat d2/de 0 2024-09-21T12:20:20.804 INFO:tasks.workunit.client.1.smithi192.stdout:7/304: unlink d6/d3a/l50 0 2024-09-21T12:20:20.806 INFO:tasks.workunit.client.1.smithi192.stdout:7/305: readlink d6/d9/d2d/d68/l6e 0 2024-09-21T12:20:20.806 INFO:tasks.workunit.client.1.smithi192.stdout:9/307: dread d5/d8/f22 [0,4194304] 0 2024-09-21T12:20:20.807 INFO:tasks.workunit.client.1.smithi192.stdout:1/383: link d2/d12/d2f/d41/d61/f66 d2/d12/d2f/d51/f7c 0 2024-09-21T12:20:20.808 INFO:tasks.workunit.client.1.smithi192.stdout:9/308: write d5/dc/d40/f25 [4373283,2920] 0 2024-09-21T12:20:20.811 INFO:tasks.workunit.client.1.smithi192.stdout:7/306: mkdir d6/d9/d70 0 2024-09-21T12:20:20.818 INFO:tasks.workunit.client.1.smithi192.stdout:7/307: dread - d6/d9/f5d zero size 2024-09-21T12:20:20.820 INFO:tasks.workunit.client.1.smithi192.stdout:1/384: dwrite d2/d12/d2f/d51/d24/f4c [0,4194304] 0 2024-09-21T12:20:20.821 INFO:tasks.workunit.client.1.smithi192.stdout:9/309: creat d5/dc/f5f x:0 0 0 2024-09-21T12:20:20.821 INFO:tasks.workunit.client.1.smithi192.stdout:6/260: dread da/f13 [0,4194304] 0 2024-09-21T12:20:20.823 INFO:tasks.workunit.client.1.smithi192.stdout:7/308: mknod d6/d20/d69/c71 0 2024-09-21T12:20:20.823 INFO:tasks.workunit.client.1.smithi192.stdout:9/310: dread - d5/d8/d36/d3f/d4d/f47 zero size 2024-09-21T12:20:20.824 INFO:tasks.workunit.client.1.smithi192.stdout:1/385: mkdir d2/da/d6b/d7d 0 2024-09-21T12:20:20.825 INFO:tasks.workunit.client.1.smithi192.stdout:6/261: symlink da/l51 0 2024-09-21T12:20:20.826 INFO:tasks.workunit.client.1.smithi192.stdout:6/262: write f8 [3819793,39895] 0 2024-09-21T12:20:20.826 INFO:tasks.workunit.client.1.smithi192.stdout:7/309: read d6/d9/f17 [3320617,81184] 0 2024-09-21T12:20:20.827 INFO:tasks.workunit.client.1.smithi192.stdout:6/263: read da/f20 [3069430,119591] 0 2024-09-21T12:20:20.829 INFO:tasks.workunit.client.1.smithi192.stdout:9/311: creat d5/d21/f60 x:0 0 0 2024-09-21T12:20:20.829 INFO:tasks.workunit.client.1.smithi192.stdout:2/337: write f19 [3072708,33831] 0 2024-09-21T12:20:20.829 INFO:tasks.workunit.client.1.smithi192.stdout:6/264: chown da/f13 47440017 1 2024-09-21T12:20:20.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:20 smithi003 ceph-mon[28057]: pgmap v260: 65 pgs: 65 active+clean; 357 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 291 KiB/s rd, 16 MiB/s wr, 250 op/s 2024-09-21T12:20:20.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:20 smithi003 ceph-mon[28057]: from='client.14672 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:20:20.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:20 smithi003 ceph-mon[28057]: from='client.14676 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:20:20.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:20 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/521347410' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:20:20.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:20 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:20:20.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:20 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:20:20.830 INFO:tasks.workunit.client.1.smithi192.stdout:9/312: chown d5/d19 1213 1 2024-09-21T12:20:20.831 INFO:tasks.workunit.client.1.smithi192.stdout:1/386: symlink d2/da/d6b/d7d/l7e 0 2024-09-21T12:20:20.833 INFO:tasks.workunit.client.1.smithi192.stdout:7/310: rename d6/d9/f17 to d6/d9/d1f/f72 0 2024-09-21T12:20:20.833 INFO:tasks.workunit.client.1.smithi192.stdout:0/304: write d3/d5/f1b [5160731,52642] 0 2024-09-21T12:20:20.835 INFO:tasks.workunit.client.1.smithi192.stdout:0/305: stat d3/c1e 0 2024-09-21T12:20:20.835 INFO:tasks.workunit.client.1.smithi192.stdout:2/338: creat d1b/d1e/f69 x:0 0 0 2024-09-21T12:20:20.838 INFO:tasks.workunit.client.1.smithi192.stdout:1/387: rename d2/c5 to d2/d12/d2f/d51/d24/d65/d5a/c7f 0 2024-09-21T12:20:20.841 INFO:tasks.workunit.client.1.smithi192.stdout:9/313: dwrite d5/d8/d2c/f58 [0,4194304] 0 2024-09-21T12:20:20.841 INFO:tasks.workunit.client.1.smithi192.stdout:2/339: fdatasync d1b/d38/f4d 0 2024-09-21T12:20:20.845 INFO:tasks.workunit.client.1.smithi192.stdout:2/340: chown d1b/f3e 8235390 1 2024-09-21T12:20:20.845 INFO:tasks.workunit.client.1.smithi192.stdout:0/306: creat d3/d6/f5b x:0 0 0 2024-09-21T12:20:20.845 INFO:tasks.workunit.client.1.smithi192.stdout:7/311: link d6/d3a/c67 d6/d9/d2d/d68/c73 0 2024-09-21T12:20:20.847 INFO:tasks.workunit.client.1.smithi192.stdout:6/265: dread da/f20 [0,4194304] 0 2024-09-21T12:20:20.848 INFO:tasks.workunit.client.1.smithi192.stdout:1/388: write d2/de/f19 [785334,45607] 0 2024-09-21T12:20:20.852 INFO:tasks.workunit.client.1.smithi192.stdout:6/266: truncate da/d1f/f4c 704478 0 2024-09-21T12:20:20.853 INFO:tasks.workunit.client.1.smithi192.stdout:1/389: write d2/d12/d2f/d51/d24/f26 [1165890,121158] 0 2024-09-21T12:20:20.854 INFO:tasks.workunit.client.1.smithi192.stdout:7/312: creat d6/d9/f74 x:0 0 0 2024-09-21T12:20:20.855 INFO:tasks.workunit.client.1.smithi192.stdout:9/314: dwrite d5/d8/d36/f45 [0,4194304] 0 2024-09-21T12:20:20.856 INFO:tasks.workunit.client.1.smithi192.stdout:6/267: truncate da/d1f/f3c 217748 0 2024-09-21T12:20:20.858 INFO:tasks.workunit.client.1.smithi192.stdout:2/341: truncate d1b/d38/f49 789695 0 2024-09-21T12:20:20.859 INFO:tasks.workunit.client.1.smithi192.stdout:0/307: dwrite d3/d5/d19/f3e [0,4194304] 0 2024-09-21T12:20:20.862 INFO:tasks.workunit.client.1.smithi192.stdout:6/268: creat da/d23/f52 x:0 0 0 2024-09-21T12:20:20.863 INFO:tasks.workunit.client.1.smithi192.stdout:0/308: read d3/d5/f14 [7211796,117694] 0 2024-09-21T12:20:20.866 INFO:tasks.workunit.client.1.smithi192.stdout:2/342: creat d1b/f6a x:0 0 0 2024-09-21T12:20:20.867 INFO:tasks.workunit.client.1.smithi192.stdout:6/269: creat da/d1f/d48/f53 x:0 0 0 2024-09-21T12:20:20.868 INFO:tasks.workunit.client.1.smithi192.stdout:0/309: mknod d3/de/c5c 0 2024-09-21T12:20:20.868 INFO:tasks.workunit.client.1.smithi192.stdout:6/270: stat da/f20 0 2024-09-21T12:20:20.869 INFO:tasks.workunit.client.1.smithi192.stdout:0/310: write d3/de/d33/f4a [754137,75111] 0 2024-09-21T12:20:20.870 INFO:tasks.workunit.client.1.smithi192.stdout:2/343: creat d1b/f6b x:0 0 0 2024-09-21T12:20:20.872 INFO:tasks.workunit.client.1.smithi192.stdout:7/313: getdents d6/d9/d51 0 2024-09-21T12:20:20.872 INFO:tasks.workunit.client.1.smithi192.stdout:6/271: creat da/d1f/f54 x:0 0 0 2024-09-21T12:20:20.873 INFO:tasks.workunit.client.1.smithi192.stdout:7/314: rename d6/d3a to d6/d3a/d6d/d75 22 2024-09-21T12:20:20.875 INFO:tasks.workunit.client.1.smithi192.stdout:6/272: mknod da/c55 0 2024-09-21T12:20:20.876 INFO:tasks.workunit.client.1.smithi192.stdout:6/273: truncate da/d23/f26 2021257 0 2024-09-21T12:20:20.878 INFO:tasks.workunit.client.1.smithi192.stdout:0/311: truncate d3/d5/d28/d39/f41 912706 0 2024-09-21T12:20:20.879 INFO:tasks.workunit.client.1.smithi192.stdout:0/312: stat d3/d5/l29 0 2024-09-21T12:20:20.885 INFO:tasks.workunit.client.1.smithi192.stdout:8/399: sync 2024-09-21T12:20:20.885 INFO:tasks.workunit.client.1.smithi192.stdout:3/261: sync 2024-09-21T12:20:20.890 INFO:tasks.workunit.client.1.smithi192.stdout:3/262: creat db/f5c x:0 0 0 2024-09-21T12:20:20.891 INFO:tasks.workunit.client.1.smithi192.stdout:7/315: dread d6/d9/d1f/f72 [4194304,4194304] 0 2024-09-21T12:20:20.892 INFO:tasks.workunit.client.1.smithi192.stdout:3/263: fdatasync db/d2a/d2e/f56 0 2024-09-21T12:20:20.893 INFO:tasks.workunit.client.1.smithi192.stdout:3/264: write db/d16/f2c [4844616,39974] 0 2024-09-21T12:20:20.896 INFO:tasks.workunit.client.1.smithi192.stdout:2/344: read d1b/d38/f49 [743667,118482] 0 2024-09-21T12:20:20.898 INFO:tasks.workunit.client.1.smithi192.stdout:0/313: dread d3/de/f24 [0,4194304] 0 2024-09-21T12:20:20.898 INFO:tasks.workunit.client.1.smithi192.stdout:6/274: getdents da/d23 0 2024-09-21T12:20:20.900 INFO:tasks.workunit.client.1.smithi192.stdout:0/314: chown d3/d6/l15 318391 1 2024-09-21T12:20:20.900 INFO:tasks.workunit.client.1.smithi192.stdout:7/316: dwrite d6/d9/f5f [0,4194304] 0 2024-09-21T12:20:20.902 INFO:tasks.workunit.client.1.smithi192.stdout:7/317: dread - d6/d9/d51/f32 zero size 2024-09-21T12:20:20.902 INFO:tasks.workunit.client.1.smithi192.stdout:0/315: fsync d3/de/d33/f3c 0 2024-09-21T12:20:20.904 INFO:tasks.workunit.client.1.smithi192.stdout:6/275: mkdir da/d1f/d56 0 2024-09-21T12:20:20.907 INFO:tasks.workunit.client.1.smithi192.stdout:1/390: truncate d2/d12/d2f/d51/d24/d65/d5a/f75 3363045 0 2024-09-21T12:20:20.911 INFO:tasks.workunit.client.1.smithi192.stdout:7/318: mknod d6/d9/d51/c76 0 2024-09-21T12:20:20.913 INFO:tasks.workunit.client.1.smithi192.stdout:0/316: write d3/d5/d19/d51/f2b [2047142,12917] 0 2024-09-21T12:20:20.914 INFO:tasks.workunit.client.1.smithi192.stdout:0/317: stat d3/de 0 2024-09-21T12:20:20.915 INFO:tasks.workunit.client.1.smithi192.stdout:6/276: creat da/f57 x:0 0 0 2024-09-21T12:20:20.916 INFO:tasks.workunit.client.1.smithi192.stdout:0/318: fsync d3/d5/d19/f3e 0 2024-09-21T12:20:20.916 INFO:tasks.workunit.client.1.smithi192.stdout:3/265: creat db/d16/d18/d21/f5d x:0 0 0 2024-09-21T12:20:20.916 INFO:tasks.workunit.client.1.smithi192.stdout:1/391: dwrite d2/d12/f63 [0,4194304] 0 2024-09-21T12:20:20.930 INFO:tasks.workunit.client.1.smithi192.stdout:0/319: mknod d3/d5/c5d 0 2024-09-21T12:20:20.932 INFO:tasks.workunit.client.1.smithi192.stdout:1/392: unlink d2/da/f46 0 2024-09-21T12:20:20.932 INFO:tasks.workunit.client.1.smithi192.stdout:6/277: dwrite da/d23/f26 [0,4194304] 0 2024-09-21T12:20:20.934 INFO:tasks.workunit.client.1.smithi192.stdout:1/393: write d2/d12/d2f/d51/d24/d5e/f67 [978884,14047] 0 2024-09-21T12:20:20.935 INFO:tasks.workunit.client.1.smithi192.stdout:2/345: getdents d1b 0 2024-09-21T12:20:20.936 INFO:tasks.workunit.client.1.smithi192.stdout:1/394: read - d2/d12/d2f/d51/d24/f70 zero size 2024-09-21T12:20:20.937 INFO:tasks.workunit.client.1.smithi192.stdout:7/319: mkdir d6/d9/d70/d77 0 2024-09-21T12:20:20.938 INFO:tasks.workunit.client.1.smithi192.stdout:6/278: dread da/f20 [0,4194304] 0 2024-09-21T12:20:20.939 INFO:tasks.workunit.client.1.smithi192.stdout:6/279: fsync f8 0 2024-09-21T12:20:20.940 INFO:tasks.workunit.client.1.smithi192.stdout:8/400: write d14/d1a/f31 [1589668,60211] 0 2024-09-21T12:20:20.944 INFO:tasks.workunit.client.1.smithi192.stdout:0/320: creat d3/de/d33/f5e x:0 0 0 2024-09-21T12:20:20.947 INFO:tasks.workunit.client.1.smithi192.stdout:6/280: dwrite da/d23/d37/f33 [0,4194304] 0 2024-09-21T12:20:20.948 INFO:tasks.workunit.client.1.smithi192.stdout:3/266: creat db/d2a/f5e x:0 0 0 2024-09-21T12:20:20.957 INFO:tasks.workunit.client.1.smithi192.stdout:0/321: creat d3/de/d33/f5f x:0 0 0 2024-09-21T12:20:20.962 INFO:tasks.workunit.client.1.smithi192.stdout:7/320: creat d6/d3a/d6d/f78 x:0 0 0 2024-09-21T12:20:20.963 INFO:tasks.workunit.client.1.smithi192.stdout:6/281: dread da/fc [0,4194304] 0 2024-09-21T12:20:20.963 INFO:tasks.workunit.client.1.smithi192.stdout:3/267: creat db/d16/d18/d33/d4a/f5f x:0 0 0 2024-09-21T12:20:20.965 INFO:tasks.workunit.client.1.smithi192.stdout:8/401: mknod d14/d18/c7d 0 2024-09-21T12:20:20.965 INFO:tasks.workunit.client.1.smithi192.stdout:0/322: dread d3/d5/f9 [0,4194304] 0 2024-09-21T12:20:20.966 INFO:tasks.workunit.client.1.smithi192.stdout:0/323: stat d3/d6/f5a 0 2024-09-21T12:20:20.969 INFO:tasks.workunit.client.1.smithi192.stdout:6/282: creat da/d1f/d27/f58 x:0 0 0 2024-09-21T12:20:20.970 INFO:tasks.workunit.client.1.smithi192.stdout:6/283: read da/d23/f34 [7455909,100710] 0 2024-09-21T12:20:20.971 INFO:tasks.workunit.client.1.smithi192.stdout:3/268: mkdir db/d16/d18/d40/d60 0 2024-09-21T12:20:20.971 INFO:tasks.workunit.client.1.smithi192.stdout:6/284: fdatasync da/d23/f26 0 2024-09-21T12:20:20.973 INFO:tasks.workunit.client.1.smithi192.stdout:3/269: chown db/d16/d18/d33 19 1 2024-09-21T12:20:20.974 INFO:tasks.workunit.client.1.smithi192.stdout:0/324: creat d3/de/f60 x:0 0 0 2024-09-21T12:20:20.974 INFO:tasks.workunit.client.1.smithi192.stdout:7/321: dwrite d6/f52 [0,4194304] 0 2024-09-21T12:20:20.974 INFO:tasks.workunit.client.1.smithi192.stdout:3/270: dread - db/d2a/d2e/f56 zero size 2024-09-21T12:20:20.975 INFO:tasks.workunit.client.1.smithi192.stdout:3/271: chown db/f4f 235 1 2024-09-21T12:20:20.977 INFO:tasks.workunit.client.1.smithi192.stdout:3/272: chown db/l12 15880 1 2024-09-21T12:20:20.980 INFO:tasks.workunit.client.1.smithi192.stdout:8/402: mkdir d14/d1a/d1d/d46/d7e 0 2024-09-21T12:20:20.980 INFO:tasks.workunit.client.1.smithi192.stdout:6/285: rmdir da/d23/d37 39 2024-09-21T12:20:20.984 INFO:tasks.workunit.client.1.smithi192.stdout:0/325: dwrite d3/d5/d28/f56 [0,4194304] 0 2024-09-21T12:20:20.987 INFO:tasks.workunit.client.1.smithi192.stdout:7/322: creat d6/d9/d70/d77/f79 x:0 0 0 2024-09-21T12:20:20.997 INFO:tasks.workunit.client.1.smithi192.stdout:0/326: unlink d3/f1a 0 2024-09-21T12:20:20.999 INFO:tasks.workunit.client.1.smithi192.stdout:7/323: mkdir d6/d9/d1f/d3e/d7a 0 2024-09-21T12:20:21.001 INFO:tasks.workunit.client.1.smithi192.stdout:3/273: rename db/d2a to db/d16/d61 0 2024-09-21T12:20:21.003 INFO:tasks.workunit.client.1.smithi192.stdout:3/274: truncate db/d16/d18/d33/f48 4326303 0 2024-09-21T12:20:21.009 INFO:tasks.workunit.client.1.smithi192.stdout:7/324: mkdir d6/d9/d2d/d7b 0 2024-09-21T12:20:21.019 INFO:tasks.workunit.client.1.smithi192.stdout:7/325: unlink d6/d9/d2d/c4f 0 2024-09-21T12:20:21.023 INFO:tasks.workunit.client.1.smithi192.stdout:6/286: rename da/d1f/d27/f58 to da/d23/d37/f59 0 2024-09-21T12:20:21.025 INFO:tasks.workunit.client.1.smithi192.stdout:3/275: mknod db/d16/d61/c62 0 2024-09-21T12:20:21.026 INFO:tasks.workunit.client.1.smithi192.stdout:3/276: chown db/d16/d18/d33/l5a 386666400 1 2024-09-21T12:20:21.028 INFO:tasks.workunit.client.1.smithi192.stdout:7/326: unlink d6/d9/c12 0 2024-09-21T12:20:21.031 INFO:tasks.workunit.client.1.smithi192.stdout:6/287: mknod da/d1f/d48/c5a 0 2024-09-21T12:20:21.031 INFO:tasks.workunit.client.1.smithi192.stdout:6/288: fdatasync da/d1f/d27/f28 0 2024-09-21T12:20:21.032 INFO:tasks.workunit.client.1.smithi192.stdout:8/403: write d14/d1a/d1d/d46/d4e/f63 [954586,35485] 0 2024-09-21T12:20:21.034 INFO:tasks.workunit.client.1.smithi192.stdout:7/327: mknod d6/d9/d2d/d68/c7c 0 2024-09-21T12:20:21.040 INFO:tasks.workunit.client.1.smithi192.stdout:3/277: mknod db/d16/d18/d33/c63 0 2024-09-21T12:20:21.044 INFO:tasks.workunit.client.1.smithi192.stdout:7/328: rename d6/d20/l4c to d6/d20/d69/l7d 0 2024-09-21T12:20:21.045 INFO:tasks.workunit.client.1.smithi192.stdout:1/395: truncate d2/d12/d2f/d51/d24/d65/d5a/f75 1155078 0 2024-09-21T12:20:21.047 INFO:tasks.workunit.client.1.smithi192.stdout:1/396: fdatasync d2/d12/d2f/d51/f7c 0 2024-09-21T12:20:21.048 INFO:tasks.workunit.client.1.smithi192.stdout:3/278: mknod db/d16/d18/d40/c64 0 2024-09-21T12:20:21.048 INFO:tasks.workunit.client.1.smithi192.stdout:1/397: fdatasync d2/de/f19 0 2024-09-21T12:20:21.049 INFO:tasks.workunit.client.1.smithi192.stdout:8/404: truncate d14/d1a/d1d/f2b 2078078 0 2024-09-21T12:20:21.050 INFO:tasks.workunit.client.1.smithi192.stdout:0/327: truncate d3/d5/d28/f56 144859 0 2024-09-21T12:20:21.052 INFO:tasks.workunit.client.1.smithi192.stdout:7/329: dwrite d6/d9/f5d [0,4194304] 0 2024-09-21T12:20:21.052 INFO:tasks.workunit.client.1.smithi192.stdout:1/398: chown d2/d12/d2f/d51/d24/c25 125186 1 2024-09-21T12:20:21.052 INFO:tasks.workunit.client.1.smithi192.stdout:0/328: stat d3/d5/d19/d51 0 2024-09-21T12:20:21.054 INFO:tasks.workunit.client.1.smithi192.stdout:3/279: creat db/d16/d18/d33/d3b/f65 x:0 0 0 2024-09-21T12:20:21.056 INFO:tasks.workunit.client.1.smithi192.stdout:0/329: write d3/de/d33/f35 [590394,30254] 0 2024-09-21T12:20:21.056 INFO:tasks.workunit.client.1.smithi192.stdout:7/330: write d6/d9/d70/d77/f79 [224019,59294] 0 2024-09-21T12:20:21.057 INFO:tasks.workunit.client.1.smithi192.stdout:8/405: symlink d14/d1a/d1d/d46/d7e/l7f 0 2024-09-21T12:20:21.059 INFO:tasks.workunit.client.1.smithi192.stdout:7/331: readlink d6/d20/l34 0 2024-09-21T12:20:21.061 INFO:tasks.workunit.client.1.smithi192.stdout:8/406: chown d14/d1a/d1d/d46/l4c 1798437660 1 2024-09-21T12:20:21.062 INFO:tasks.workunit.client.1.smithi192.stdout:0/330: mknod d3/d5/d28/d39/d50/c61 0 2024-09-21T12:20:21.062 INFO:tasks.workunit.client.1.smithi192.stdout:7/332: write d6/d9/f5f [1619715,73539] 0 2024-09-21T12:20:21.064 INFO:tasks.workunit.client.1.smithi192.stdout:0/331: stat d3/de/d43/c44 0 2024-09-21T12:20:21.066 INFO:tasks.workunit.client.1.smithi192.stdout:3/280: dwrite db/d16/d61/f5e [0,4194304] 0 2024-09-21T12:20:21.069 INFO:tasks.workunit.client.1.smithi192.stdout:3/281: write db/d16/d18/d33/f48 [2543323,66078] 0 2024-09-21T12:20:21.069 INFO:tasks.workunit.client.1.smithi192.stdout:7/333: rmdir d6/d20 39 2024-09-21T12:20:21.069 INFO:tasks.workunit.client.1.smithi192.stdout:3/282: stat db/d16/d18/d33/d3b 0 2024-09-21T12:20:21.071 INFO:tasks.workunit.client.1.smithi192.stdout:4/284: sync 2024-09-21T12:20:21.072 INFO:tasks.workunit.client.1.smithi192.stdout:6/289: truncate da/f4b 3212768 0 2024-09-21T12:20:21.073 INFO:tasks.workunit.client.1.smithi192.stdout:0/332: rmdir d3/d5/d28/d39 39 2024-09-21T12:20:21.073 INFO:tasks.workunit.client.1.smithi192.stdout:4/285: write d2/d21/f3f [1285978,58241] 0 2024-09-21T12:20:21.074 INFO:tasks.workunit.client.1.smithi192.stdout:0/333: write d3/de/f11 [3728621,88961] 0 2024-09-21T12:20:21.075 INFO:tasks.workunit.client.1.smithi192.stdout:4/286: write d2/f5 [4666948,129186] 0 2024-09-21T12:20:21.077 INFO:tasks.workunit.client.1.smithi192.stdout:0/334: chown d3/d5/d28/c36 175355 1 2024-09-21T12:20:21.082 INFO:tasks.workunit.client.1.smithi192.stdout:6/290: dwrite da/d1f/d27/f28 [0,4194304] 0 2024-09-21T12:20:21.084 INFO:tasks.workunit.client.1.smithi192.stdout:6/291: write da/f3b [525103,130018] 0 2024-09-21T12:20:21.086 INFO:tasks.workunit.client.1.smithi192.stdout:0/335: dread d3/d6/f4c [0,4194304] 0 2024-09-21T12:20:21.090 INFO:tasks.workunit.client.1.smithi192.stdout:1/399: write d2/d12/d2f/d51/f37 [503768,80089] 0 2024-09-21T12:20:21.094 INFO:tasks.workunit.client.1.smithi192.stdout:3/283: truncate db/d16/d61/d2e/f45 275782 0 2024-09-21T12:20:21.095 INFO:tasks.workunit.client.1.smithi192.stdout:3/284: readlink db/d16/d18/d21/l4d 0 2024-09-21T12:20:21.097 INFO:tasks.workunit.client.1.smithi192.stdout:6/292: rename da/l46 to da/d23/d37/l5b 0 2024-09-21T12:20:21.099 INFO:tasks.workunit.client.1.smithi192.stdout:0/336: dread d3/d6/fd [0,4194304] 0 2024-09-21T12:20:21.100 INFO:tasks.workunit.client.1.smithi192.stdout:0/337: chown d3/d5/f14 1 1 2024-09-21T12:20:21.100 INFO:tasks.workunit.client.1.smithi192.stdout:0/338: read d3/d5/f1b [4924994,37162] 0 2024-09-21T12:20:21.101 INFO:tasks.workunit.client.1.smithi192.stdout:1/400: mknod d2/d4d/c80 0 2024-09-21T12:20:21.102 INFO:tasks.workunit.client.1.smithi192.stdout:8/407: write d14/d1a/f25 [619584,110909] 0 2024-09-21T12:20:21.103 INFO:tasks.workunit.client.1.smithi192.stdout:8/408: write f8 [6138209,52783] 0 2024-09-21T12:20:21.103 INFO:tasks.workunit.client.1.smithi192.stdout:3/285: mkdir db/d16/d18/d21/d23/d66 0 2024-09-21T12:20:21.106 INFO:tasks.workunit.client.1.smithi192.stdout:6/293: rename da/f3b to da/d1f/f5c 0 2024-09-21T12:20:21.109 INFO:tasks.workunit.client.1.smithi192.stdout:0/339: write d3/d5/f1b [5729214,111957] 0 2024-09-21T12:20:21.110 INFO:tasks.workunit.client.1.smithi192.stdout:1/401: mkdir d2/d12/d2f/d81 0 2024-09-21T12:20:21.115 INFO:tasks.workunit.client.1.smithi192.stdout:8/409: chown d14/d1a/d1d/d20/d5f 8 1 2024-09-21T12:20:21.116 INFO:tasks.workunit.client.1.smithi192.stdout:3/286: mknod db/d16/d18/d33/d4a/c67 0 2024-09-21T12:20:21.117 INFO:tasks.workunit.client.1.smithi192.stdout:3/287: fdatasync db/d16/d18/f36 0 2024-09-21T12:20:21.118 INFO:tasks.workunit.client.1.smithi192.stdout:7/334: dwrite d6/d9/d1f/f72 [0,4194304] 0 2024-09-21T12:20:21.121 INFO:tasks.workunit.client.1.smithi192.stdout:0/340: rename d3/d5/d28/c36 to d3/c62 0 2024-09-21T12:20:21.123 INFO:tasks.workunit.client.1.smithi192.stdout:1/402: unlink f1 0 2024-09-21T12:20:21.126 INFO:tasks.workunit.client.1.smithi192.stdout:3/288: dwrite db/d16/d18/d33/d4a/f5f [0,4194304] 0 2024-09-21T12:20:21.131 INFO:tasks.workunit.client.1.smithi192.stdout:7/335: creat d6/d3a/d6d/f7e x:0 0 0 2024-09-21T12:20:21.133 INFO:tasks.workunit.client.1.smithi192.stdout:1/403: dread d2/d12/f2b [0,4194304] 0 2024-09-21T12:20:21.138 INFO:tasks.workunit.client.1.smithi192.stdout:8/410: mkdir d14/d1a/d1d/d51/d80 0 2024-09-21T12:20:21.141 INFO:tasks.workunit.client.1.smithi192.stdout:1/404: rmdir d2/d12/d2f/d51 39 2024-09-21T12:20:21.142 INFO:tasks.workunit.client.1.smithi192.stdout:8/411: rename d14/d1a/d1d to d14/d1a/d1d/d39/d81 22 2024-09-21T12:20:21.144 INFO:tasks.workunit.client.1.smithi192.stdout:7/336: mknod d6/d9/c7f 0 2024-09-21T12:20:21.150 INFO:tasks.workunit.client.1.smithi192.stdout:8/412: mkdir d14/d1a/d82 0 2024-09-21T12:20:21.151 INFO:tasks.workunit.client.1.smithi192.stdout:8/413: read f11 [659414,122392] 0 2024-09-21T12:20:21.154 INFO:tasks.workunit.client.1.smithi192.stdout:0/341: getdents d3/d6 0 2024-09-21T12:20:21.155 INFO:tasks.workunit.client.1.smithi192.stdout:1/405: dread d2/d12/d2f/f40 [0,4194304] 0 2024-09-21T12:20:21.158 INFO:tasks.workunit.client.1.smithi192.stdout:8/414: mkdir d14/d1a/d1d/d46/d4e/d83 0 2024-09-21T12:20:21.165 INFO:tasks.workunit.client.1.smithi192.stdout:8/415: mknod d14/d1a/d1d/d20/c84 0 2024-09-21T12:20:21.166 INFO:tasks.workunit.client.1.smithi192.stdout:8/416: write d14/d18/f28 [698628,100175] 0 2024-09-21T12:20:21.169 INFO:tasks.workunit.client.1.smithi192.stdout:1/406: mkdir d2/d82 0 2024-09-21T12:20:21.171 INFO:tasks.workunit.client.1.smithi192.stdout:7/337: link d6/d20/l34 d6/d3a/d6d/l80 0 2024-09-21T12:20:21.174 INFO:tasks.workunit.client.1.smithi192.stdout:1/407: fdatasync d2/d12/d2f/d51/f37 0 2024-09-21T12:20:21.180 INFO:tasks.workunit.client.1.smithi192.stdout:0/342: write d3/d5/f14 [169982,94299] 0 2024-09-21T12:20:21.182 INFO:tasks.workunit.client.1.smithi192.stdout:1/408: creat d2/d12/d2f/d41/d5c/f83 x:0 0 0 2024-09-21T12:20:21.183 INFO:tasks.workunit.client.1.smithi192.stdout:1/409: dread - d2/d12/d2f/d51/d24/d65/f53 zero size 2024-09-21T12:20:21.187 INFO:tasks.workunit.client.1.smithi192.stdout:7/338: link d6/d20/c30 d6/d9/c81 0 2024-09-21T12:20:21.187 INFO:tasks.workunit.client.1.smithi192.stdout:7/339: stat d6/d3a/d6d/f78 0 2024-09-21T12:20:21.194 INFO:tasks.workunit.client.1.smithi192.stdout:8/417: truncate d14/d1a/d1d/d39/f4a 7241644 0 2024-09-21T12:20:21.194 INFO:tasks.workunit.client.1.smithi192.stdout:1/410: dwrite d2/d12/d2f/f40 [0,4194304] 0 2024-09-21T12:20:21.197 INFO:tasks.workunit.client.1.smithi192.stdout:1/411: creat d2/da/f84 x:0 0 0 2024-09-21T12:20:21.198 INFO:tasks.workunit.client.1.smithi192.stdout:7/340: dwrite d6/d9/d2d/f5e [0,4194304] 0 2024-09-21T12:20:21.198 INFO:tasks.workunit.client.1.smithi192.stdout:8/418: creat d14/f85 x:0 0 0 2024-09-21T12:20:21.201 INFO:tasks.workunit.client.1.smithi192.stdout:7/341: read d6/d20/f40 [1571911,32111] 0 2024-09-21T12:20:21.202 INFO:tasks.workunit.client.1.smithi192.stdout:8/419: rmdir d14 39 2024-09-21T12:20:21.203 INFO:tasks.workunit.client.1.smithi192.stdout:5/488: sync 2024-09-21T12:20:21.217 INFO:tasks.workunit.client.1.smithi192.stdout:1/412: dwrite d2/d12/f2b [0,4194304] 0 2024-09-21T12:20:21.219 INFO:tasks.workunit.client.1.smithi192.stdout:8/420: dread f11 [0,4194304] 0 2024-09-21T12:20:21.220 INFO:tasks.workunit.client.1.smithi192.stdout:3/289: dwrite db/d16/d61/d2e/f45 [0,4194304] 0 2024-09-21T12:20:21.228 INFO:tasks.workunit.client.1.smithi192.stdout:0/343: dwrite d3/d5/d19/d51/f34 [0,4194304] 0 2024-09-21T12:20:21.228 INFO:tasks.workunit.client.1.smithi192.stdout:1/413: truncate d2/d12/d2f/d51/f38 1034654 0 2024-09-21T12:20:21.229 INFO:tasks.workunit.client.1.smithi192.stdout:7/342: dwrite d6/d9/f5d [0,4194304] 0 2024-09-21T12:20:21.229 INFO:tasks.workunit.client.1.smithi192.stdout:8/421: chown d14/d18/d5a 99 1 2024-09-21T12:20:21.232 INFO:tasks.workunit.client.1.smithi192.stdout:1/414: readlink d2/d12/l42 0 2024-09-21T12:20:21.233 INFO:tasks.workunit.client.1.smithi192.stdout:0/344: write d3/de/d33/f3c [1127877,69187] 0 2024-09-21T12:20:21.235 INFO:tasks.workunit.client.1.smithi192.stdout:7/343: chown d6/d9/d51/f23 0 1 2024-09-21T12:20:21.241 INFO:tasks.workunit.client.1.smithi192.stdout:0/345: mknod d3/d5/d19/c63 0 2024-09-21T12:20:21.241 INFO:tasks.workunit.client.1.smithi192.stdout:3/290: dread db/f3c [0,4194304] 0 2024-09-21T12:20:21.243 INFO:tasks.workunit.client.1.smithi192.stdout:5/489: dwrite d0/d73/d44/d85/d97/d45/f2c [0,4194304] 0 2024-09-21T12:20:21.244 INFO:tasks.workunit.client.1.smithi192.stdout:7/344: creat d6/f82 x:0 0 0 2024-09-21T12:20:21.245 INFO:tasks.workunit.client.1.smithi192.stdout:3/291: write db/d16/d61/d2e/f45 [4981802,11411] 0 2024-09-21T12:20:21.248 INFO:tasks.workunit.client.1.smithi192.stdout:1/415: rename d2/de/l29 to d2/de/l85 0 2024-09-21T12:20:21.248 INFO:tasks.workunit.client.1.smithi192.stdout:3/292: chown db/d16/d18/f2f 3957208 1 2024-09-21T12:20:21.251 INFO:tasks.workunit.client.1.smithi192.stdout:1/416: mknod d2/d12/d2f/d51/c86 0 2024-09-21T12:20:21.251 INFO:tasks.workunit.client.1.smithi192.stdout:5/490: chown d0/d65/d6e/d91/c95 120585 1 2024-09-21T12:20:21.251 INFO:tasks.workunit.client.1.smithi192.stdout:3/293: mkdir db/d16/d18/d33/d3b/d68 0 2024-09-21T12:20:21.252 INFO:tasks.workunit.client.1.smithi192.stdout:8/422: dread ff [0,4194304] 0 2024-09-21T12:20:21.253 INFO:tasks.workunit.client.1.smithi192.stdout:0/346: creat d3/d5/d28/f64 x:0 0 0 2024-09-21T12:20:21.255 INFO:tasks.workunit.client.1.smithi192.stdout:5/491: dread - d0/d73/d44/d85/f94 zero size 2024-09-21T12:20:21.255 INFO:tasks.workunit.client.0.smithi003.stderr:++ readlink -f fsstress 2024-09-21T12:20:21.256 INFO:tasks.workunit.client.1.smithi192.stdout:1/417: write d2/d12/d2f/f4a [327729,8663] 0 2024-09-21T12:20:21.257 INFO:tasks.workunit.client.0.smithi003.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-21T12:20:21.257 INFO:tasks.workunit.client.0.smithi003.stderr:+ popd 2024-09-21T12:20:21.259 INFO:tasks.workunit.client.0.smithi003.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-21T12:20:21.259 INFO:tasks.workunit.client.0.smithi003.stderr:+ popd 2024-09-21T12:20:21.259 INFO:tasks.workunit.client.1.smithi192.stdout:7/345: dwrite d6/d9/d70/d77/f79 [0,4194304] 0 2024-09-21T12:20:21.259 INFO:tasks.workunit.client.1.smithi192.stdout:1/418: chown d2/d12/d2f/d51/d24/d65/d5a 1441 1 2024-09-21T12:20:21.259 INFO:tasks.workunit.client.1.smithi192.stdout:3/294: read db/d16/d18/f2f [1628093,72066] 0 2024-09-21T12:20:21.260 INFO:tasks.workunit.client.0.smithi003.stdout:~/cephtest/mnt.0/client.0/tmp 2024-09-21T12:20:21.260 INFO:tasks.workunit.client.0.smithi003.stderr:++ mktemp -d -p . 2024-09-21T12:20:21.263 INFO:tasks.workunit.client.1.smithi192.stdout:7/346: rename d6/le to d6/d9/d2d/l83 0 2024-09-21T12:20:21.264 INFO:tasks.workunit.client.1.smithi192.stdout:2/346: sync 2024-09-21T12:20:21.264 INFO:tasks.workunit.client.1.smithi192.stdout:9/315: sync 2024-09-21T12:20:21.264 INFO:tasks.workunit.client.1.smithi192.stdout:1/419: dread d2/da/f32 [0,4194304] 0 2024-09-21T12:20:21.264 INFO:tasks.workunit.client.0.smithi003.stderr:+ T=./tmp.YQwefhmTKg 2024-09-21T12:20:21.264 INFO:tasks.workunit.client.0.smithi003.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.YQwefhmTKg -l 1 -n 1000 -p 10 -v 2024-09-21T12:20:21.268 INFO:tasks.workunit.client.1.smithi192.stdout:2/347: fsync d1b/d38/f60 0 2024-09-21T12:20:21.272 INFO:tasks.workunit.client.1.smithi192.stdout:1/420: creat d2/da/d6b/d7d/f87 x:0 0 0 2024-09-21T12:20:21.273 INFO:tasks.workunit.client.1.smithi192.stdout:2/348: truncate d1b/d1e/f36 1149962 0 2024-09-21T12:20:21.273 INFO:tasks.workunit.client.0.smithi003.stdout:seed = 1726649239 2024-09-21T12:20:21.276 INFO:tasks.workunit.client.1.smithi192.stdout:2/349: rmdir d1b/d1e 39 2024-09-21T12:20:21.277 INFO:tasks.workunit.client.1.smithi192.stdout:7/347: dwrite d6/d9/f14 [0,4194304] 0 2024-09-21T12:20:21.278 INFO:tasks.workunit.client.1.smithi192.stdout:8/423: write d14/d18/f22 [318670,95637] 0 2024-09-21T12:20:21.278 INFO:tasks.workunit.client.0.smithi003.stdout:0/0: write - no filename 2024-09-21T12:20:21.278 INFO:tasks.workunit.client.0.smithi003.stdout:0/1: chown . 5382 1 2024-09-21T12:20:21.279 INFO:tasks.workunit.client.1.smithi192.stdout:7/348: fsync d6/d9/d51/f24 0 2024-09-21T12:20:21.279 INFO:tasks.workunit.client.1.smithi192.stdout:1/421: creat d2/d12/d2f/d51/d24/d58/f88 x:0 0 0 2024-09-21T12:20:21.283 INFO:tasks.workunit.client.0.smithi003.stdout:1/0: dread - no filename 2024-09-21T12:20:21.284 INFO:tasks.workunit.client.1.smithi192.stdout:0/347: dread d3/d6/f3f [0,4194304] 0 2024-09-21T12:20:21.285 INFO:tasks.workunit.client.1.smithi192.stdout:8/424: read f8 [4911937,29055] 0 2024-09-21T12:20:21.285 INFO:tasks.workunit.client.1.smithi192.stdout:7/349: dread d6/d9/f1c [0,4194304] 0 2024-09-21T12:20:21.287 INFO:tasks.workunit.client.0.smithi003.stdout:0/2: creat f0 x:0 0 0 2024-09-21T12:20:21.287 INFO:tasks.workunit.client.0.smithi003.stdout:2/0: read - no filename 2024-09-21T12:20:21.287 INFO:tasks.workunit.client.0.smithi003.stdout:2/1: rename - no filename 2024-09-21T12:20:21.288 INFO:tasks.workunit.client.1.smithi192.stdout:5/492: dread d0/dc/d13/d37/d38/f4c [0,4194304] 0 2024-09-21T12:20:21.288 INFO:tasks.workunit.client.1.smithi192.stdout:1/422: mkdir d2/da/d89 0 2024-09-21T12:20:21.288 INFO:tasks.workunit.client.1.smithi192.stdout:1/423: stat d2/d12/d2f 0 2024-09-21T12:20:21.289 INFO:tasks.workunit.client.1.smithi192.stdout:1/424: chown d2/d12/l39 6580485 1 2024-09-21T12:20:21.289 INFO:tasks.workunit.client.0.smithi003.stdout:3/0: dread - no filename 2024-09-21T12:20:21.289 INFO:tasks.workunit.client.0.smithi003.stdout:3/1: write - no filename 2024-09-21T12:20:21.290 INFO:tasks.workunit.client.0.smithi003.stdout:3/2: dwrite - no filename 2024-09-21T12:20:21.290 INFO:tasks.workunit.client.0.smithi003.stdout:3/3: unlink - no file 2024-09-21T12:20:21.290 INFO:tasks.workunit.client.0.smithi003.stdout:3/4: write - no filename 2024-09-21T12:20:21.290 INFO:tasks.workunit.client.0.smithi003.stdout:3/5: fdatasync - no filename 2024-09-21T12:20:21.290 INFO:tasks.workunit.client.0.smithi003.stdout:3/6: dread - no filename 2024-09-21T12:20:21.290 INFO:tasks.workunit.client.0.smithi003.stdout:3/7: dread - no filename 2024-09-21T12:20:21.290 INFO:tasks.workunit.client.0.smithi003.stdout:3/8: dwrite - no filename 2024-09-21T12:20:21.290 INFO:tasks.workunit.client.0.smithi003.stdout:3/9: write - no filename 2024-09-21T12:20:21.290 INFO:tasks.workunit.client.0.smithi003.stdout:3/10: dread - no filename 2024-09-21T12:20:21.291 INFO:tasks.workunit.client.0.smithi003.stdout:0/3: symlink l1 0 2024-09-21T12:20:21.291 INFO:tasks.workunit.client.1.smithi192.stdout:1/425: truncate d2/da/fc 9347568 0 2024-09-21T12:20:21.291 INFO:tasks.workunit.client.1.smithi192.stdout:7/350: symlink d6/d9/d1f/l84 0 2024-09-21T12:20:21.291 INFO:tasks.workunit.client.0.smithi003.stdout:1/1: creat f0 x:0 0 0 2024-09-21T12:20:21.294 INFO:tasks.workunit.client.0.smithi003.stdout:0/4: creat f2 x:0 0 0 2024-09-21T12:20:21.294 INFO:tasks.workunit.client.1.smithi192.stdout:8/425: symlink d14/d1a/d1d/d46/d4e/d83/l86 0 2024-09-21T12:20:21.295 INFO:tasks.workunit.client.0.smithi003.stdout:2/2: mkdir d0 0 2024-09-21T12:20:21.296 INFO:tasks.workunit.client.1.smithi192.stdout:2/350: dread f19 [0,4194304] 0 2024-09-21T12:20:21.296 INFO:tasks.workunit.client.0.smithi003.stdout:1/2: creat f1 x:0 0 0 2024-09-21T12:20:21.298 INFO:tasks.workunit.client.1.smithi192.stdout:1/426: rename d2/d12/d2f/d51/d24/d65/d7b to d2/d12/d2f/d41/d5c/d8a 0 2024-09-21T12:20:21.299 INFO:tasks.workunit.client.0.smithi003.stdout:5/0: dwrite - no filename 2024-09-21T12:20:21.301 INFO:tasks.workunit.client.0.smithi003.stdout:1/3: creat f2 x:0 0 0 2024-09-21T12:20:21.302 INFO:tasks.workunit.client.1.smithi192.stdout:8/426: unlink d14/d1a/d1d/d20/l24 0 2024-09-21T12:20:21.303 INFO:tasks.workunit.client.0.smithi003.stdout:4/0: mknod c0 0 2024-09-21T12:20:21.303 INFO:tasks.workunit.client.0.smithi003.stdout:4/1: write - no filename 2024-09-21T12:20:21.303 INFO:tasks.workunit.client.0.smithi003.stdout:0/5: dwrite f0 [0,4194304] 0 2024-09-21T12:20:21.303 INFO:tasks.workunit.client.1.smithi192.stdout:1/427: dwrite d2/d12/d2f/f4a [0,4194304] 0 2024-09-21T12:20:21.304 INFO:tasks.workunit.client.0.smithi003.stdout:0/6: dread - f2 zero size 2024-09-21T12:20:21.308 INFO:tasks.workunit.client.0.smithi003.stdout:2/3: symlink d0/l1 0 2024-09-21T12:20:21.308 INFO:tasks.workunit.client.0.smithi003.stdout:2/4: dread - no filename 2024-09-21T12:20:21.314 INFO:tasks.workunit.client.0.smithi003.stdout:1/4: unlink f0 0 2024-09-21T12:20:21.315 INFO:tasks.workunit.client.0.smithi003.stdout:1/5: dread - f2 zero size 2024-09-21T12:20:21.315 INFO:tasks.workunit.client.1.smithi192.stdout:0/348: getdents d3/d5/d28 0 2024-09-21T12:20:21.316 INFO:tasks.workunit.client.0.smithi003.stdout:0/7: dwrite f2 [0,4194304] 0 2024-09-21T12:20:21.316 INFO:tasks.workunit.client.0.smithi003.stdout:1/6: stat f1 0 2024-09-21T12:20:21.317 INFO:tasks.workunit.client.1.smithi192.stdout:8/427: creat d14/d1a/d1d/d46/d4e/d83/f87 x:0 0 0 2024-09-21T12:20:21.321 INFO:tasks.workunit.client.0.smithi003.stdout:7/0: dread - no filename 2024-09-21T12:20:21.321 INFO:tasks.workunit.client.0.smithi003.stdout:7/1: dread - no filename 2024-09-21T12:20:21.321 INFO:tasks.workunit.client.0.smithi003.stdout:7/2: stat - no entries 2024-09-21T12:20:21.321 INFO:tasks.workunit.client.0.smithi003.stdout:7/3: dread - no filename 2024-09-21T12:20:21.321 INFO:tasks.workunit.client.0.smithi003.stdout:7/4: dread - no filename 2024-09-21T12:20:21.322 INFO:tasks.workunit.client.0.smithi003.stdout:7/5: dwrite - no filename 2024-09-21T12:20:21.322 INFO:tasks.workunit.client.0.smithi003.stdout:7/6: fdatasync - no filename 2024-09-21T12:20:21.323 INFO:tasks.workunit.client.0.smithi003.stdout:2/5: unlink d0/l1 0 2024-09-21T12:20:21.327 INFO:tasks.workunit.client.1.smithi192.stdout:0/349: creat d3/d6/d1d/f65 x:0 0 0 2024-09-21T12:20:21.329 INFO:tasks.workunit.client.1.smithi192.stdout:7/351: getdents d6/d9/d51 0 2024-09-21T12:20:21.329 INFO:tasks.workunit.client.1.smithi192.stdout:7/352: read d6/d9/d2d/f5e [1834264,53652] 0 2024-09-21T12:20:21.330 INFO:tasks.workunit.client.0.smithi003.stdout:0/8: creat f3 x:0 0 0 2024-09-21T12:20:21.330 INFO:tasks.workunit.client.0.smithi003.stdout:0/9: rmdir - no directory 2024-09-21T12:20:21.330 INFO:tasks.workunit.client.1.smithi192.stdout:5/493: truncate d0/dc/d13/f53 2638161 0 2024-09-21T12:20:21.331 INFO:tasks.workunit.client.1.smithi192.stdout:7/353: write d6/d9/d1f/f37 [1194374,65048] 0 2024-09-21T12:20:21.331 INFO:tasks.workunit.client.0.smithi003.stdout:1/7: symlink l3 0 2024-09-21T12:20:21.333 INFO:tasks.workunit.client.1.smithi192.stdout:2/351: creat d1b/d1e/d62/f6c x:0 0 0 2024-09-21T12:20:21.333 INFO:tasks.workunit.client.0.smithi003.stdout:6/0: symlink l0 0 2024-09-21T12:20:21.333 INFO:tasks.workunit.client.0.smithi003.stdout:6/1: truncate - no filename 2024-09-21T12:20:21.333 INFO:tasks.workunit.client.0.smithi003.stdout:6/2: dwrite - no filename 2024-09-21T12:20:21.333 INFO:tasks.workunit.client.0.smithi003.stdout:6/3: truncate - no filename 2024-09-21T12:20:21.334 INFO:tasks.workunit.client.0.smithi003.stdout:6/4: truncate - no filename 2024-09-21T12:20:21.334 INFO:tasks.workunit.client.0.smithi003.stdout:6/5: dwrite - no filename 2024-09-21T12:20:21.334 INFO:tasks.workunit.client.0.smithi003.stdout:6/6: chown l0 16366070 1 2024-09-21T12:20:21.334 INFO:tasks.workunit.client.0.smithi003.stdout:6/7: stat l0 0 2024-09-21T12:20:21.334 INFO:tasks.workunit.client.1.smithi192.stdout:8/428: mkdir d14/d18/d88 0 2024-09-21T12:20:21.336 INFO:tasks.workunit.client.0.smithi003.stdout:8/0: chown . 257431 1 2024-09-21T12:20:21.337 INFO:tasks.workunit.client.0.smithi003.stdout:2/6: creat d0/f2 x:0 0 0 2024-09-21T12:20:21.338 INFO:tasks.workunit.client.1.smithi192.stdout:2/352: dwrite d1b/f6b [0,4194304] 0 2024-09-21T12:20:21.338 INFO:tasks.workunit.client.0.smithi003.stdout:2/7: write d0/f2 [150592,62849] 0 2024-09-21T12:20:21.340 INFO:tasks.workunit.client.0.smithi003.stdout:4/2: link c0 c1 0 2024-09-21T12:20:21.340 INFO:tasks.workunit.client.0.smithi003.stdout:4/3: truncate - no filename 2024-09-21T12:20:21.340 INFO:tasks.workunit.client.0.smithi003.stdout:4/4: dread - no filename 2024-09-21T12:20:21.342 INFO:tasks.workunit.client.0.smithi003.stdout:0/10: creat f4 x:0 0 0 2024-09-21T12:20:21.342 INFO:tasks.workunit.client.1.smithi192.stdout:5/494: creat d0/d73/d44/fa4 x:0 0 0 2024-09-21T12:20:21.344 INFO:tasks.workunit.client.1.smithi192.stdout:7/354: stat d6/d9/d2d/l83 0 2024-09-21T12:20:21.346 INFO:tasks.workunit.client.0.smithi003.stdout:1/8: mkdir d4 0 2024-09-21T12:20:21.347 INFO:tasks.workunit.client.1.smithi192.stdout:8/429: fdatasync d14/f43 0 2024-09-21T12:20:21.347 INFO:tasks.workunit.client.0.smithi003.stdout:1/9: write f2 [241926,8344] 0 2024-09-21T12:20:21.348 INFO:tasks.workunit.client.1.smithi192.stdout:8/430: chown d14/d1a/d1d/d46/d4e/l55 89044688 1 2024-09-21T12:20:21.351 INFO:tasks.workunit.client.0.smithi003.stdout:0/11: dwrite f3 [0,4194304] 0 2024-09-21T12:20:21.352 INFO:tasks.workunit.client.1.smithi192.stdout:7/355: dwrite d6/d9/d1f/f37 [0,4194304] 0 2024-09-21T12:20:21.353 INFO:tasks.workunit.client.1.smithi192.stdout:7/356: chown d6/f82 72 1 2024-09-21T12:20:21.355 INFO:tasks.workunit.client.1.smithi192.stdout:5/495: mkdir d0/d2/d7b/da5 0 2024-09-21T12:20:21.356 INFO:tasks.workunit.client.1.smithi192.stdout:7/357: dread d6/d9/d1f/f21 [0,4194304] 0 2024-09-21T12:20:21.360 INFO:tasks.workunit.client.0.smithi003.stdout:8/1: creat f0 x:0 0 0 2024-09-21T12:20:21.360 INFO:tasks.workunit.client.0.smithi003.stdout:1/10: dwrite f1 [0,4194304] 0 2024-09-21T12:20:21.362 INFO:tasks.workunit.client.0.smithi003.stdout:8/2: chown f0 16866491 1 2024-09-21T12:20:21.364 INFO:tasks.workunit.client.1.smithi192.stdout:5/496: rename d0/d73/d44/d85/d97/d45/f49 to d0/d73/d44/d85/fa6 0 2024-09-21T12:20:21.365 INFO:tasks.workunit.client.0.smithi003.stdout:0/12: dwrite f4 [0,4194304] 0 2024-09-21T12:20:21.367 INFO:tasks.workunit.client.1.smithi192.stdout:8/431: creat d14/d1a/d1d/d48/f89 x:0 0 0 2024-09-21T12:20:21.369 INFO:tasks.workunit.client.1.smithi192.stdout:8/432: write d14/d1a/d1d/d39/f71 [2011236,13752] 0 2024-09-21T12:20:21.369 INFO:tasks.workunit.client.0.smithi003.stdout:8/3: fsync f0 0 2024-09-21T12:20:21.370 INFO:tasks.workunit.client.1.smithi192.stdout:5/497: read d0/dc/f6f [2958,98933] 0 2024-09-21T12:20:21.370 INFO:tasks.workunit.client.0.smithi003.stdout:8/4: write f0 [317172,65202] 0 2024-09-21T12:20:21.371 INFO:tasks.workunit.client.0.smithi003.stdout:9/0: mknod c0 0 2024-09-21T12:20:21.371 INFO:tasks.workunit.client.0.smithi003.stdout:9/1: dread - no filename 2024-09-21T12:20:21.373 INFO:tasks.workunit.client.1.smithi192.stdout:5/498: truncate d0/dc/d13/d37/f5d 1009381 0 2024-09-21T12:20:21.374 INFO:tasks.workunit.client.0.smithi003.stdout:0/13: symlink l5 0 2024-09-21T12:20:21.374 INFO:tasks.workunit.client.0.smithi003.stdout:6/8: getdents . 0 2024-09-21T12:20:21.375 INFO:tasks.workunit.client.0.smithi003.stdout:6/9: dread - no filename 2024-09-21T12:20:21.375 INFO:tasks.workunit.client.0.smithi003.stdout:6/10: dwrite - no filename 2024-09-21T12:20:21.375 INFO:tasks.workunit.client.0.smithi003.stdout:6/11: read - no filename 2024-09-21T12:20:21.375 INFO:tasks.workunit.client.0.smithi003.stdout:6/12: dwrite - no filename 2024-09-21T12:20:21.375 INFO:tasks.workunit.client.0.smithi003.stdout:6/13: rmdir - no directory 2024-09-21T12:20:21.375 INFO:tasks.workunit.client.0.smithi003.stdout:6/14: dwrite - no filename 2024-09-21T12:20:21.376 INFO:tasks.workunit.client.1.smithi192.stdout:7/358: rename d6/d9/d1f/f55 to d6/d3a/d6d/f85 0 2024-09-21T12:20:21.378 INFO:tasks.workunit.client.1.smithi192.stdout:2/353: getdents d1b/d1e/d62 0 2024-09-21T12:20:21.379 INFO:tasks.workunit.client.0.smithi003.stdout:9/2: creat f1 x:0 0 0 2024-09-21T12:20:21.379 INFO:tasks.workunit.client.0.smithi003.stdout:9/3: readlink - no filename 2024-09-21T12:20:21.379 INFO:tasks.workunit.client.1.smithi192.stdout:8/433: dwrite d14/d1a/d1d/d48/f62 [0,4194304] 0 2024-09-21T12:20:21.379 INFO:tasks.workunit.client.0.smithi003.stdout:9/4: write f1 [153841,48955] 0 2024-09-21T12:20:21.381 INFO:tasks.workunit.client.0.smithi003.stdout:9/5: write f1 [689494,34430] 0 2024-09-21T12:20:21.381 INFO:tasks.workunit.client.1.smithi192.stdout:8/434: fdatasync d14/d1a/d1d/d48/f89 0 2024-09-21T12:20:21.385 INFO:tasks.workunit.client.1.smithi192.stdout:5/499: rename d0/d65/d6e/d99 to d0/d65/d6e/da7 0 2024-09-21T12:20:21.387 INFO:tasks.workunit.client.1.smithi192.stdout:1/428: dread d2/d12/d2f/d51/d24/f35 [0,4194304] 0 2024-09-21T12:20:21.388 INFO:tasks.workunit.client.1.smithi192.stdout:1/429: dread - d2/da/d6b/d7d/f87 zero size 2024-09-21T12:20:21.388 INFO:tasks.workunit.client.1.smithi192.stdout:2/354: creat d1b/d38/d53/f6d x:0 0 0 2024-09-21T12:20:21.389 INFO:tasks.workunit.client.1.smithi192.stdout:1/430: stat d2/d12/d2f/d41/d5c/f68 0 2024-09-21T12:20:21.389 INFO:tasks.workunit.client.0.smithi003.stdout:9/6: mkdir d2 0 2024-09-21T12:20:21.390 INFO:tasks.workunit.client.0.smithi003.stdout:0/14: truncate f4 896587 0 2024-09-21T12:20:21.391 INFO:tasks.workunit.client.0.smithi003.stdout:0/15: read f0 [657821,26564] 0 2024-09-21T12:20:21.392 INFO:tasks.workunit.client.1.smithi192.stdout:5/500: mkdir d0/dc/d13/d37/da8 0 2024-09-21T12:20:21.394 INFO:tasks.workunit.client.0.smithi003.stdout:9/7: mknod d2/c3 0 2024-09-21T12:20:21.396 INFO:tasks.workunit.client.1.smithi192.stdout:2/355: creat d1b/d65/f6e x:0 0 0 2024-09-21T12:20:21.397 INFO:tasks.workunit.client.0.smithi003.stdout:0/16: link f2 f6 0 2024-09-21T12:20:21.405 INFO:tasks.workunit.client.0.smithi003.stdout:9/8: symlink d2/l4 0 2024-09-21T12:20:21.406 INFO:tasks.workunit.client.1.smithi192.stdout:5/501: symlink d0/d65/d6e/la9 0 2024-09-21T12:20:21.407 INFO:tasks.workunit.client.1.smithi192.stdout:5/502: dread - d0/d73/d44/d85/f94 zero size 2024-09-21T12:20:21.408 INFO:tasks.workunit.client.1.smithi192.stdout:5/503: chown d0/d2/c2e 28680 1 2024-09-21T12:20:21.410 INFO:tasks.workunit.client.1.smithi192.stdout:6/294: sync 2024-09-21T12:20:21.410 INFO:tasks.workunit.client.1.smithi192.stdout:4/287: sync 2024-09-21T12:20:21.411 INFO:tasks.workunit.client.1.smithi192.stdout:7/359: truncate d6/d9/d1f/d3e/f60 1790254 0 2024-09-21T12:20:21.411 INFO:tasks.workunit.client.0.smithi003.stdout:0/17: mknod c7 0 2024-09-21T12:20:21.412 INFO:tasks.workunit.client.1.smithi192.stdout:7/360: chown d6/d20/l4e 840 1 2024-09-21T12:20:21.413 INFO:tasks.workunit.client.0.smithi003.stdout:2/8: dread d0/f2 [0,4194304] 0 2024-09-21T12:20:21.416 INFO:tasks.workunit.client.0.smithi003.stdout:0/18: dread f0 [0,4194304] 0 2024-09-21T12:20:21.417 INFO:tasks.workunit.client.1.smithi192.stdout:6/295: rename da/f13 to da/d1f/d56/f5d 0 2024-09-21T12:20:21.417 INFO:tasks.workunit.client.1.smithi192.stdout:6/296: chown da/d23/d37/f33 182 1 2024-09-21T12:20:21.419 INFO:tasks.workunit.client.1.smithi192.stdout:4/288: creat d2/db/d3e/d41/f5f x:0 0 0 2024-09-21T12:20:21.419 INFO:tasks.workunit.client.1.smithi192.stdout:8/435: truncate d14/d1a/d1d/f64 681464 0 2024-09-21T12:20:21.421 INFO:tasks.workunit.client.0.smithi003.stdout:2/9: link d0/f2 d0/f3 0 2024-09-21T12:20:21.421 INFO:tasks.workunit.client.1.smithi192.stdout:5/504: mkdir d0/dc/d13/d37/da8/daa 0 2024-09-21T12:20:21.422 INFO:tasks.workunit.client.0.smithi003.stdout:0/19: truncate f6 1263172 0 2024-09-21T12:20:21.422 INFO:tasks.workunit.client.1.smithi192.stdout:7/361: symlink d6/l86 0 2024-09-21T12:20:21.424 INFO:tasks.workunit.client.0.smithi003.stdout:2/10: symlink d0/l4 0 2024-09-21T12:20:21.424 INFO:tasks.workunit.client.1.smithi192.stdout:6/297: dread da/fc [0,4194304] 0 2024-09-21T12:20:21.424 INFO:tasks.workunit.client.1.smithi192.stdout:8/436: mkdir d14/d1a/d1d/d20/d5f/d8a 0 2024-09-21T12:20:21.426 INFO:tasks.workunit.client.0.smithi003.stdout:0/20: dread f3 [0,4194304] 0 2024-09-21T12:20:21.429 INFO:tasks.workunit.client.0.smithi003.stdout:8/5: dread f0 [0,4194304] 0 2024-09-21T12:20:21.429 INFO:tasks.workunit.client.0.smithi003.stdout:8/6: readlink - no filename 2024-09-21T12:20:21.430 INFO:tasks.workunit.client.0.smithi003.stdout:0/21: creat f8 x:0 0 0 2024-09-21T12:20:21.430 INFO:tasks.workunit.client.0.smithi003.stdout:9/9: dread f1 [0,4194304] 0 2024-09-21T12:20:21.430 INFO:tasks.workunit.client.1.smithi192.stdout:4/289: dread d2/db/d1a/f2b [0,4194304] 0 2024-09-21T12:20:21.432 INFO:tasks.workunit.client.0.smithi003.stdout:8/7: read f0 [155196,3190] 0 2024-09-21T12:20:21.432 INFO:tasks.workunit.client.0.smithi003.stdout:9/10: chown f1 1232184 1 2024-09-21T12:20:21.433 INFO:tasks.workunit.client.0.smithi003.stdout:0/22: unlink f3 0 2024-09-21T12:20:21.438 INFO:tasks.workunit.client.0.smithi003.stdout:2/11: dwrite d0/f2 [0,4194304] 0 2024-09-21T12:20:21.439 INFO:tasks.workunit.client.0.smithi003.stdout:2/12: read d0/f2 [2378831,11097] 0 2024-09-21T12:20:21.439 INFO:tasks.workunit.client.1.smithi192.stdout:5/505: dwrite d0/d73/d44/d85/d97/d45/f31 [0,4194304] 0 2024-09-21T12:20:21.440 INFO:tasks.workunit.client.1.smithi192.stdout:7/362: dwrite d6/d9/d51/f4b [0,4194304] 0 2024-09-21T12:20:21.445 INFO:tasks.workunit.client.0.smithi003.stdout:0/23: write f2 [405479,33230] 0 2024-09-21T12:20:21.447 INFO:tasks.workunit.client.0.smithi003.stdout:9/11: link d2/l4 d2/l5 0 2024-09-21T12:20:21.450 INFO:tasks.workunit.client.1.smithi192.stdout:5/506: creat d0/d2/d7b/fab x:0 0 0 2024-09-21T12:20:21.451 INFO:tasks.workunit.client.0.smithi003.stdout:2/13: link d0/f3 d0/f5 0 2024-09-21T12:20:21.452 INFO:tasks.workunit.client.1.smithi192.stdout:7/363: mknod d6/d3a/c87 0 2024-09-21T12:20:21.453 INFO:tasks.workunit.client.1.smithi192.stdout:2/356: dread d1b/d1e/f39 [0,4194304] 0 2024-09-21T12:20:21.454 INFO:tasks.workunit.client.0.smithi003.stdout:0/24: mkdir d9 0 2024-09-21T12:20:21.455 INFO:tasks.workunit.client.1.smithi192.stdout:2/357: chown f15 1598632 1 2024-09-21T12:20:21.456 INFO:tasks.workunit.client.0.smithi003.stdout:9/12: creat d2/f6 x:0 0 0 2024-09-21T12:20:21.457 INFO:tasks.workunit.client.1.smithi192.stdout:5/507: creat d0/d65/d6e/da7/fac x:0 0 0 2024-09-21T12:20:21.458 INFO:tasks.workunit.client.1.smithi192.stdout:2/358: read f14 [705500,108473] 0 2024-09-21T12:20:21.459 INFO:tasks.workunit.client.1.smithi192.stdout:7/364: creat d6/d3a/f88 x:0 0 0 2024-09-21T12:20:21.460 INFO:tasks.workunit.client.1.smithi192.stdout:8/437: write d14/d1a/f2e [753798,121116] 0 2024-09-21T12:20:21.462 INFO:tasks.workunit.client.1.smithi192.stdout:5/508: symlink d0/d73/d44/d85/d97/d45/lad 0 2024-09-21T12:20:21.464 INFO:tasks.workunit.client.0.smithi003.stdout:0/25: symlink d9/la 0 2024-09-21T12:20:21.464 INFO:tasks.workunit.client.0.smithi003.stdout:2/14: dwrite d0/f5 [0,4194304] 0 2024-09-21T12:20:21.465 INFO:tasks.workunit.client.1.smithi192.stdout:2/359: write d1b/d1e/f39 [1916629,81302] 0 2024-09-21T12:20:21.466 INFO:tasks.workunit.client.1.smithi192.stdout:2/360: chown d1b/f57 672555 1 2024-09-21T12:20:21.467 INFO:tasks.workunit.client.0.smithi003.stdout:9/13: rename d2/l5 to d2/l7 0 2024-09-21T12:20:21.467 INFO:tasks.workunit.client.1.smithi192.stdout:6/298: dwrite da/f16 [0,4194304] 0 2024-09-21T12:20:21.468 INFO:tasks.workunit.client.1.smithi192.stdout:4/290: write d2/f23 [1558378,25692] 0 2024-09-21T12:20:21.474 INFO:tasks.workunit.client.1.smithi192.stdout:2/361: symlink d1b/d38/l6f 0 2024-09-21T12:20:21.474 INFO:tasks.workunit.client.0.smithi003.stdout:9/14: write f1 [1477438,67193] 0 2024-09-21T12:20:21.476 INFO:tasks.workunit.client.1.smithi192.stdout:6/299: creat da/d1f/d48/f5e x:0 0 0 2024-09-21T12:20:21.478 INFO:tasks.workunit.client.0.smithi003.stdout:0/26: dwrite f0 [4194304,4194304] 0 2024-09-21T12:20:21.482 INFO:tasks.workunit.client.1.smithi192.stdout:8/438: link d14/d1a/d1d/d48/f6f d14/d1a/d1d/d39/f8b 0 2024-09-21T12:20:21.486 INFO:tasks.workunit.client.1.smithi192.stdout:2/362: rename d1b/d38/l59 to d1b/d1e/d3d/l70 0 2024-09-21T12:20:21.487 INFO:tasks.workunit.client.0.smithi003.stdout:0/27: creat d9/fb x:0 0 0 2024-09-21T12:20:21.488 INFO:tasks.workunit.client.0.smithi003.stdout:0/28: write f0 [5650863,56651] 0 2024-09-21T12:20:21.489 INFO:tasks.workunit.client.1.smithi192.stdout:6/300: creat da/d23/d37/f5f x:0 0 0 2024-09-21T12:20:21.490 INFO:tasks.workunit.client.1.smithi192.stdout:4/291: creat d2/d36/d55/f60 x:0 0 0 2024-09-21T12:20:21.492 INFO:tasks.workunit.client.1.smithi192.stdout:8/439: unlink d14/d1a/f79 0 2024-09-21T12:20:21.493 INFO:tasks.workunit.client.0.smithi003.stdout:2/15: fsync d0/f2 0 2024-09-21T12:20:21.493 INFO:tasks.workunit.client.0.smithi003.stdout:0/29: mknod d9/cc 0 2024-09-21T12:20:21.495 INFO:tasks.workunit.client.0.smithi003.stdout:9/15: chown d2/l7 237 1 2024-09-21T12:20:21.497 INFO:tasks.workunit.client.0.smithi003.stdout:2/16: creat d0/f6 x:0 0 0 2024-09-21T12:20:21.498 INFO:tasks.workunit.client.1.smithi192.stdout:4/292: rename d2/f20 to d2/d36/f61 0 2024-09-21T12:20:21.499 INFO:tasks.workunit.client.0.smithi003.stdout:0/30: creat d9/fd x:0 0 0 2024-09-21T12:20:21.499 INFO:tasks.workunit.client.0.smithi003.stdout:0/31: readlink l1 0 2024-09-21T12:20:21.500 INFO:tasks.workunit.client.0.smithi003.stdout:0/32: dread - d9/fb zero size 2024-09-21T12:20:21.500 INFO:tasks.workunit.client.0.smithi003.stdout:9/16: rmdir d2 39 2024-09-21T12:20:21.500 INFO:tasks.workunit.client.0.smithi003.stdout:0/33: write f6 [2276218,96405] 0 2024-09-21T12:20:21.501 INFO:tasks.workunit.client.1.smithi192.stdout:6/301: dwrite da/d1f/d48/f4d [0,4194304] 0 2024-09-21T12:20:21.502 INFO:tasks.workunit.client.1.smithi192.stdout:8/440: mknod d14/d1a/d1d/d46/c8c 0 2024-09-21T12:20:21.502 INFO:tasks.workunit.client.1.smithi192.stdout:7/365: dwrite d6/d3a/f3f [0,4194304] 0 2024-09-21T12:20:21.503 INFO:tasks.workunit.client.0.smithi003.stdout:2/17: rmdir d0 39 2024-09-21T12:20:21.505 INFO:tasks.workunit.client.1.smithi192.stdout:5/509: getdents d0/d2 0 2024-09-21T12:20:21.505 INFO:tasks.workunit.client.0.smithi003.stdout:0/34: dread f2 [0,4194304] 0 2024-09-21T12:20:21.507 INFO:tasks.workunit.client.1.smithi192.stdout:2/363: symlink d1b/l71 0 2024-09-21T12:20:21.507 INFO:tasks.workunit.client.1.smithi192.stdout:5/510: write d0/d65/d6e/da7/fac [294008,127628] 0 2024-09-21T12:20:21.510 INFO:tasks.workunit.client.0.smithi003.stdout:9/17: chown d2/c3 490827 1 2024-09-21T12:20:21.511 INFO:tasks.workunit.client.1.smithi192.stdout:7/366: dwrite f0 [0,4194304] 0 2024-09-21T12:20:21.512 INFO:tasks.workunit.client.0.smithi003.stdout:9/18: chown d2/c3 4260492 1 2024-09-21T12:20:21.513 INFO:tasks.workunit.client.0.smithi003.stdout:9/19: dread - d2/f6 zero size 2024-09-21T12:20:21.516 INFO:tasks.workunit.client.1.smithi192.stdout:6/302: fdatasync da/f20 0 2024-09-21T12:20:21.516 INFO:tasks.workunit.client.0.smithi003.stdout:0/35: dwrite f2 [0,4194304] 0 2024-09-21T12:20:21.517 INFO:tasks.workunit.client.0.smithi003.stdout:2/18: symlink d0/l7 0 2024-09-21T12:20:21.518 INFO:tasks.workunit.client.1.smithi192.stdout:8/441: mkdir d14/d1a/d1d/d46/d4e/d83/d8d 0 2024-09-21T12:20:21.520 INFO:tasks.workunit.client.0.smithi003.stdout:2/19: write d0/f5 [4460752,111525] 0 2024-09-21T12:20:21.521 INFO:tasks.workunit.client.1.smithi192.stdout:2/364: symlink d1b/d65/l72 0 2024-09-21T12:20:21.522 INFO:tasks.workunit.client.1.smithi192.stdout:2/365: write d1b/f52 [763789,80303] 0 2024-09-21T12:20:21.525 INFO:tasks.workunit.client.1.smithi192.stdout:7/367: unlink d6/d9/d1f/d3e/c58 0 2024-09-21T12:20:21.526 INFO:tasks.workunit.client.1.smithi192.stdout:6/303: mknod da/d1f/d48/c60 0 2024-09-21T12:20:21.527 INFO:tasks.workunit.client.0.smithi003.stdout:9/20: unlink d2/f6 0 2024-09-21T12:20:21.527 INFO:tasks.workunit.client.1.smithi192.stdout:7/368: read d6/d9/f11 [1265756,6648] 0 2024-09-21T12:20:21.527 INFO:tasks.workunit.client.1.smithi192.stdout:8/442: mkdir d14/d1a/d1d/d46/d7e/d8e 0 2024-09-21T12:20:21.529 INFO:tasks.workunit.client.0.smithi003.stdout:0/36: dwrite f8 [0,4194304] 0 2024-09-21T12:20:21.529 INFO:tasks.workunit.client.1.smithi192.stdout:5/511: creat d0/d65/d6e/da7/da0/fae x:0 0 0 2024-09-21T12:20:21.530 INFO:tasks.workunit.client.0.smithi003.stdout:9/21: write f1 [2576734,49019] 0 2024-09-21T12:20:21.530 INFO:tasks.workunit.client.1.smithi192.stdout:5/512: chown d0/d73 58 1 2024-09-21T12:20:21.530 INFO:tasks.workunit.client.0.smithi003.stdout:2/20: dread d0/f5 [0,4194304] 0 2024-09-21T12:20:21.534 INFO:tasks.workunit.client.1.smithi192.stdout:2/366: rename d1b/d1e/f66 to d1b/d38/d53/f73 0 2024-09-21T12:20:21.535 INFO:tasks.workunit.client.1.smithi192.stdout:2/367: truncate d1b/d38/f4d 1017603 0 2024-09-21T12:20:21.536 INFO:tasks.workunit.client.0.smithi003.stdout:0/37: dread f8 [0,4194304] 0 2024-09-21T12:20:21.538 INFO:tasks.workunit.client.0.smithi003.stdout:9/22: dwrite f1 [0,4194304] 0 2024-09-21T12:20:21.540 INFO:tasks.workunit.client.1.smithi192.stdout:8/443: creat d14/d1a/d1d/d39/f8f x:0 0 0 2024-09-21T12:20:21.544 INFO:tasks.workunit.client.1.smithi192.stdout:5/513: fdatasync d0/d73/d44/d85/d97/d35/d79/f46 0 2024-09-21T12:20:21.547 INFO:tasks.workunit.client.1.smithi192.stdout:7/369: dwrite d6/d9/d51/f32 [0,4194304] 0 2024-09-21T12:20:21.549 INFO:tasks.workunit.client.0.smithi003.stdout:0/38: dwrite d9/fb [0,4194304] 0 2024-09-21T12:20:21.550 INFO:tasks.workunit.client.0.smithi003.stdout:2/21: write d0/f5 [2250171,27555] 0 2024-09-21T12:20:21.550 INFO:tasks.workunit.client.1.smithi192.stdout:2/368: fsync d1b/f45 0 2024-09-21T12:20:21.551 INFO:tasks.workunit.client.0.smithi003.stdout:9/23: rmdir d2 39 2024-09-21T12:20:21.557 INFO:tasks.workunit.client.1.smithi192.stdout:7/370: dwrite d6/d3a/d6d/f78 [0,4194304] 0 2024-09-21T12:20:21.557 INFO:tasks.workunit.client.0.smithi003.stdout:0/39: write f4 [444790,36470] 0 2024-09-21T12:20:21.558 INFO:tasks.workunit.client.1.smithi192.stdout:3/295: sync 2024-09-21T12:20:21.560 INFO:tasks.workunit.client.1.smithi192.stdout:5/514: symlink d0/d73/d44/laf 0 2024-09-21T12:20:21.560 INFO:tasks.workunit.client.0.smithi003.stdout:2/22: creat d0/f8 x:0 0 0 2024-09-21T12:20:21.560 INFO:tasks.workunit.client.1.smithi192.stdout:5/515: stat d0/d73/d44/d85/d97/d45/lad 0 2024-09-21T12:20:21.561 INFO:tasks.workunit.client.1.smithi192.stdout:7/371: write d6/d3a/d6d/f78 [1099837,36066] 0 2024-09-21T12:20:21.562 INFO:tasks.workunit.client.1.smithi192.stdout:5/516: chown d0/dc/f61 233 1 2024-09-21T12:20:21.562 INFO:tasks.workunit.client.0.smithi003.stdout:2/23: write d0/f3 [3973676,122972] 0 2024-09-21T12:20:21.564 INFO:tasks.workunit.client.0.smithi003.stdout:2/24: dread d0/f5 [4194304,4194304] 0 2024-09-21T12:20:21.564 INFO:tasks.workunit.client.1.smithi192.stdout:6/304: rename da/d23/l43 to da/d23/d37/l61 0 2024-09-21T12:20:21.565 INFO:tasks.workunit.client.0.smithi003.stdout:2/25: dread - d0/f6 zero size 2024-09-21T12:20:21.572 INFO:tasks.workunit.client.1.smithi192.stdout:8/444: link d14/d18/f28 d14/d1a/d1d/d46/f90 0 2024-09-21T12:20:21.575 INFO:tasks.workunit.client.0.smithi003.stdout:2/26: dwrite d0/f8 [0,4194304] 0 2024-09-21T12:20:21.577 INFO:tasks.workunit.client.0.smithi003.stdout:2/27: stat d0/f5 0 2024-09-21T12:20:21.578 INFO:tasks.workunit.client.1.smithi192.stdout:7/372: dread d6/d20/f48 [0,4194304] 0 2024-09-21T12:20:21.579 INFO:tasks.workunit.client.1.smithi192.stdout:7/373: dread - d6/d3a/d6d/f85 zero size 2024-09-21T12:20:21.580 INFO:tasks.workunit.client.1.smithi192.stdout:7/374: readlink d6/l86 0 2024-09-21T12:20:21.584 INFO:tasks.workunit.client.0.smithi003.stdout:2/28: rename d0/l7 to d0/l9 0 2024-09-21T12:20:21.585 INFO:tasks.workunit.client.1.smithi192.stdout:7/375: dwrite d6/f15 [0,4194304] 0 2024-09-21T12:20:21.586 INFO:tasks.workunit.client.0.smithi003.stdout:9/24: link d2/l7 d2/l8 0 2024-09-21T12:20:21.586 INFO:tasks.workunit.client.0.smithi003.stdout:9/25: chown c0 1842295484 1 2024-09-21T12:20:21.587 INFO:tasks.workunit.client.0.smithi003.stdout:9/26: fdatasync f1 0 2024-09-21T12:20:21.588 INFO:tasks.workunit.client.1.smithi192.stdout:5/517: creat d0/d65/fb0 x:0 0 0 2024-09-21T12:20:21.588 INFO:tasks.workunit.client.0.smithi003.stdout:2/29: creat d0/fa x:0 0 0 2024-09-21T12:20:21.592 INFO:tasks.workunit.client.0.smithi003.stdout:9/27: mknod d2/c9 0 2024-09-21T12:20:21.594 INFO:tasks.workunit.client.0.smithi003.stdout:2/30: rename d0/l4 to d0/lb 0 2024-09-21T12:20:21.595 INFO:tasks.workunit.client.0.smithi003.stdout:2/31: chown d0/f3 6574247 1 2024-09-21T12:20:21.595 INFO:tasks.workunit.client.1.smithi192.stdout:6/305: creat da/d1f/d27/d3e/f62 x:0 0 0 2024-09-21T12:20:21.597 INFO:tasks.workunit.client.0.smithi003.stdout:9/28: mkdir d2/da 0 2024-09-21T12:20:21.597 INFO:tasks.workunit.client.1.smithi192.stdout:4/293: creat d2/d19/d4b/f62 x:0 0 0 2024-09-21T12:20:21.597 INFO:tasks.workunit.client.0.smithi003.stdout:9/29: fsync f1 0 2024-09-21T12:20:21.598 INFO:tasks.workunit.client.0.smithi003.stdout:9/30: stat c0 0 2024-09-21T12:20:21.598 INFO:tasks.workunit.client.1.smithi192.stdout:2/369: link d1b/d1e/l26 d1b/d38/d53/l74 0 2024-09-21T12:20:21.599 INFO:tasks.workunit.client.1.smithi192.stdout:5/518: symlink d0/d73/d44/d85/d97/d9e/lb1 0 2024-09-21T12:20:21.599 INFO:tasks.workunit.client.1.smithi192.stdout:2/370: fsync d1b/f2a 0 2024-09-21T12:20:21.600 INFO:tasks.workunit.client.1.smithi192.stdout:7/376: dwrite d6/f10 [0,4194304] 0 2024-09-21T12:20:21.602 INFO:tasks.workunit.client.1.smithi192.stdout:7/377: read d6/d9/d2d/f5a [11140917,79861] 0 2024-09-21T12:20:21.603 INFO:tasks.workunit.client.1.smithi192.stdout:5/519: creat d0/d2/fb2 x:0 0 0 2024-09-21T12:20:21.604 INFO:tasks.workunit.client.1.smithi192.stdout:7/378: fdatasync d6/d9/f5b 0 2024-09-21T12:20:21.604 INFO:tasks.workunit.client.0.smithi003.stdout:9/31: dwrite f1 [0,4194304] 0 2024-09-21T12:20:21.606 INFO:tasks.workunit.client.1.smithi192.stdout:7/379: dread - d6/d20/f4d zero size 2024-09-21T12:20:21.608 INFO:tasks.workunit.client.1.smithi192.stdout:2/371: mkdir d1b/d1e/d5e/d75 0 2024-09-21T12:20:21.609 INFO:tasks.workunit.client.1.smithi192.stdout:7/380: write d6/d9/d51/f4b [1223093,36278] 0 2024-09-21T12:20:21.610 INFO:tasks.workunit.client.0.smithi003.stdout:9/32: dread f1 [0,4194304] 0 2024-09-21T12:20:21.611 INFO:tasks.workunit.client.0.smithi003.stdout:9/33: chown d2/c9 99529 1 2024-09-21T12:20:21.611 INFO:tasks.workunit.client.0.smithi003.stdout:9/34: chown f1 861 1 2024-09-21T12:20:21.612 INFO:tasks.workunit.client.1.smithi192.stdout:4/294: dwrite d2/df/f5d [0,4194304] 0 2024-09-21T12:20:21.612 INFO:tasks.workunit.client.0.smithi003.stdout:9/35: read f1 [1015078,67139] 0 2024-09-21T12:20:21.614 INFO:tasks.workunit.client.1.smithi192.stdout:5/520: rename d0/dc/d13/f5b to d0/d65/d6e/fb3 0 2024-09-21T12:20:21.614 INFO:tasks.workunit.client.1.smithi192.stdout:3/296: write db/f13 [3182631,36426] 0 2024-09-21T12:20:21.617 INFO:tasks.workunit.client.0.smithi003.stdout:2/32: chown d0/lb 8 1 2024-09-21T12:20:21.618 INFO:tasks.workunit.client.1.smithi192.stdout:2/372: mknod d1b/d38/c76 0 2024-09-21T12:20:21.620 INFO:tasks.workunit.client.1.smithi192.stdout:6/306: dread da/d23/d37/f39 [0,4194304] 0 2024-09-21T12:20:21.621 INFO:tasks.workunit.client.1.smithi192.stdout:7/381: dwrite d6/d3a/d6d/f7e [0,4194304] 0 2024-09-21T12:20:21.625 INFO:tasks.workunit.client.0.smithi003.stdout:9/36: dwrite f1 [0,4194304] 0 2024-09-21T12:20:21.625 INFO:tasks.workunit.client.1.smithi192.stdout:5/521: mkdir d0/dc/d13/d37/db4 0 2024-09-21T12:20:21.627 INFO:tasks.workunit.client.0.smithi003.stdout:2/33: link d0/f3 d0/fc 0 2024-09-21T12:20:21.629 INFO:tasks.workunit.client.0.smithi003.stdout:9/37: readlink d2/l4 0 2024-09-21T12:20:21.630 INFO:tasks.workunit.client.0.smithi003.stdout:9/38: chown c0 18 1 2024-09-21T12:20:21.631 INFO:tasks.workunit.client.1.smithi192.stdout:2/373: mkdir d1b/d65/d77 0 2024-09-21T12:20:21.631 INFO:tasks.workunit.client.1.smithi192.stdout:2/374: readlink d1b/d1e/l58 0 2024-09-21T12:20:21.633 INFO:tasks.workunit.client.0.smithi003.stdout:2/34: mkdir d0/dd 0 2024-09-21T12:20:21.634 INFO:tasks.workunit.client.0.smithi003.stdout:2/35: write d0/fa [595960,97901] 0 2024-09-21T12:20:21.635 INFO:tasks.workunit.client.1.smithi192.stdout:2/375: dread d1b/d1e/f39 [0,4194304] 0 2024-09-21T12:20:21.636 INFO:tasks.workunit.client.1.smithi192.stdout:2/376: fsync d1b/d1e/f47 0 2024-09-21T12:20:21.637 INFO:tasks.workunit.client.1.smithi192.stdout:7/382: mknod d6/d9/d51/c89 0 2024-09-21T12:20:21.638 INFO:tasks.workunit.client.0.smithi003.stdout:9/39: dwrite f1 [0,4194304] 0 2024-09-21T12:20:21.640 INFO:tasks.workunit.client.1.smithi192.stdout:7/383: truncate d6/d9/f14 5463959 0 2024-09-21T12:20:21.644 INFO:tasks.workunit.client.1.smithi192.stdout:2/377: dwrite d1b/f24 [0,4194304] 0 2024-09-21T12:20:21.644 INFO:tasks.workunit.client.0.smithi003.stdout:9/40: dread f1 [0,4194304] 0 2024-09-21T12:20:21.645 INFO:tasks.workunit.client.0.smithi003.stdout:9/41: write f1 [310140,8293] 0 2024-09-21T12:20:21.646 INFO:tasks.workunit.client.1.smithi192.stdout:5/522: unlink d0/d73/d44/d85/d97/d45/l66 0 2024-09-21T12:20:21.648 INFO:tasks.workunit.client.1.smithi192.stdout:6/307: rename da/l14 to da/d1f/d48/l63 0 2024-09-21T12:20:21.650 INFO:tasks.workunit.client.0.smithi003.stdout:9/42: rename d2/c9 to d2/cb 0 2024-09-21T12:20:21.654 INFO:tasks.workunit.client.1.smithi192.stdout:5/523: creat d0/d65/d6e/da7/da0/fb5 x:0 0 0 2024-09-21T12:20:21.657 INFO:tasks.workunit.client.1.smithi192.stdout:6/308: chown da/d1f/d27/c40 37016477 1 2024-09-21T12:20:21.657 INFO:tasks.workunit.client.0.smithi003.stdout:9/43: dwrite f1 [4194304,4194304] 0 2024-09-21T12:20:21.658 INFO:tasks.workunit.client.1.smithi192.stdout:7/384: mkdir d6/d9/d1f/d3e/d7a/d8a 0 2024-09-21T12:20:21.658 INFO:tasks.workunit.client.1.smithi192.stdout:3/297: truncate f8 3781313 0 2024-09-21T12:20:21.658 INFO:tasks.workunit.client.0.smithi003.stdout:9/44: write f1 [3248480,26480] 0 2024-09-21T12:20:21.659 INFO:tasks.workunit.client.0.smithi003.stdout:2/36: write d0/f3 [457123,15979] 0 2024-09-21T12:20:21.660 INFO:tasks.workunit.client.0.smithi003.stdout:2/37: rename d0 to d0/de 22 2024-09-21T12:20:21.661 INFO:tasks.workunit.client.1.smithi192.stdout:2/378: rename c1 to d1b/d1e/c78 0 2024-09-21T12:20:21.663 INFO:tasks.workunit.client.1.smithi192.stdout:6/309: fsync da/f20 0 2024-09-21T12:20:21.664 INFO:tasks.workunit.client.1.smithi192.stdout:4/295: dwrite d2/db/d1a/f46 [0,4194304] 0 2024-09-21T12:20:21.666 INFO:tasks.workunit.client.0.smithi003.stdout:9/45: dwrite f1 [0,4194304] 0 2024-09-21T12:20:21.666 INFO:tasks.workunit.client.0.smithi003.stdout:2/38: link d0/f6 d0/ff 0 2024-09-21T12:20:21.667 INFO:tasks.workunit.client.1.smithi192.stdout:3/298: write db/f1e [2114450,47915] 0 2024-09-21T12:20:21.668 INFO:tasks.workunit.client.0.smithi003.stdout:2/39: write d0/f8 [3343055,103293] 0 2024-09-21T12:20:21.668 INFO:tasks.workunit.client.1.smithi192.stdout:2/379: creat d1b/d38/f79 x:0 0 0 2024-09-21T12:20:21.670 INFO:tasks.workunit.client.0.smithi003.stdout:9/46: creat d2/fc x:0 0 0 2024-09-21T12:20:21.673 INFO:tasks.workunit.client.1.smithi192.stdout:5/524: dwrite d0/d73/f69 [0,4194304] 0 2024-09-21T12:20:21.674 INFO:tasks.workunit.client.0.smithi003.stdout:9/47: creat d2/fd x:0 0 0 2024-09-21T12:20:21.679 INFO:tasks.workunit.client.1.smithi192.stdout:2/380: mknod d1b/d1e/d62/c7a 0 2024-09-21T12:20:21.679 INFO:tasks.workunit.client.1.smithi192.stdout:5/525: mknod d0/d2/cb6 0 2024-09-21T12:20:21.680 INFO:tasks.workunit.client.1.smithi192.stdout:6/310: dread da/f16 [0,4194304] 0 2024-09-21T12:20:21.680 INFO:tasks.workunit.client.1.smithi192.stdout:2/381: dread - d1b/d38/f79 zero size 2024-09-21T12:20:21.681 INFO:tasks.workunit.client.0.smithi003.stdout:2/40: dwrite d0/ff [0,4194304] 0 2024-09-21T12:20:21.682 INFO:tasks.workunit.client.0.smithi003.stdout:9/48: rename d2/c3 to d2/ce 0 2024-09-21T12:20:21.682 INFO:tasks.workunit.client.1.smithi192.stdout:3/299: dwrite db/d16/d61/f5e [0,4194304] 0 2024-09-21T12:20:21.683 INFO:tasks.workunit.client.0.smithi003.stdout:9/49: dread - d2/fd zero size 2024-09-21T12:20:21.683 INFO:tasks.workunit.client.1.smithi192.stdout:6/311: write da/d1f/f45 [1686516,35273] 0 2024-09-21T12:20:21.689 INFO:tasks.workunit.client.0.smithi003.stdout:2/41: rename d0/f3 to d0/f10 0 2024-09-21T12:20:21.693 INFO:tasks.workunit.client.0.smithi003.stdout:9/50: symlink d2/lf 0 2024-09-21T12:20:21.693 INFO:tasks.workunit.client.0.smithi003.stdout:9/51: dread - d2/fc zero size 2024-09-21T12:20:21.694 INFO:tasks.workunit.client.0.smithi003.stdout:9/52: chown d2/fc 67171997 1 2024-09-21T12:20:21.695 INFO:tasks.workunit.client.1.smithi192.stdout:2/382: rmdir d1b/d1e/d62 39 2024-09-21T12:20:21.698 INFO:tasks.workunit.client.1.smithi192.stdout:2/383: dread d1b/f52 [0,4194304] 0 2024-09-21T12:20:21.698 INFO:tasks.workunit.client.1.smithi192.stdout:2/384: write d1b/f57 [220505,31323] 0 2024-09-21T12:20:21.700 INFO:tasks.workunit.client.0.smithi003.stdout:9/53: unlink d2/l8 0 2024-09-21T12:20:21.701 INFO:tasks.workunit.client.0.smithi003.stdout:9/54: dread - d2/fd zero size 2024-09-21T12:20:21.702 INFO:tasks.workunit.client.1.smithi192.stdout:6/312: creat da/d1f/d48/f64 x:0 0 0 2024-09-21T12:20:21.702 INFO:tasks.workunit.client.0.smithi003.stdout:9/55: write f1 [5755274,41637] 0 2024-09-21T12:20:21.702 INFO:tasks.workunit.client.0.smithi003.stdout:2/42: creat d0/dd/f11 x:0 0 0 2024-09-21T12:20:21.705 INFO:tasks.workunit.client.1.smithi192.stdout:3/300: dwrite db/f3c [0,4194304] 0 2024-09-21T12:20:21.705 INFO:tasks.workunit.client.1.smithi192.stdout:6/313: symlink da/d1f/d48/l65 0 2024-09-21T12:20:21.706 INFO:tasks.workunit.client.0.smithi003.stdout:9/56: creat d2/f10 x:0 0 0 2024-09-21T12:20:21.707 INFO:tasks.workunit.client.1.smithi192.stdout:5/526: fdatasync d0/d73/f69 0 2024-09-21T12:20:21.707 INFO:tasks.workunit.client.1.smithi192.stdout:7/385: truncate d6/f52 3737395 0 2024-09-21T12:20:21.707 INFO:tasks.workunit.client.0.smithi003.stdout:2/43: fsync d0/ff 0 2024-09-21T12:20:21.710 INFO:tasks.workunit.client.1.smithi192.stdout:0/350: sync 2024-09-21T12:20:21.710 INFO:tasks.workunit.client.1.smithi192.stdout:9/316: sync 2024-09-21T12:20:21.711 INFO:tasks.workunit.client.0.smithi003.stdout:9/57: readlink d2/l7 0 2024-09-21T12:20:21.713 INFO:tasks.workunit.client.1.smithi192.stdout:7/386: mknod d6/d3a/c8b 0 2024-09-21T12:20:21.714 INFO:tasks.workunit.client.0.smithi003.stdout:9/58: readlink d2/l7 0 2024-09-21T12:20:21.716 INFO:tasks.workunit.client.1.smithi192.stdout:4/296: truncate d2/df/f29 2706168 0 2024-09-21T12:20:21.717 INFO:tasks.workunit.client.1.smithi192.stdout:4/297: dread - d2/db/d3e/d41/f5f zero size 2024-09-21T12:20:21.719 INFO:tasks.workunit.client.1.smithi192.stdout:7/387: write d6/d3a/f61 [388750,86292] 0 2024-09-21T12:20:21.720 INFO:tasks.workunit.client.1.smithi192.stdout:5/527: rename d0/dc/d13/d37/d38/c4a to d0/d2/cb7 0 2024-09-21T12:20:21.722 INFO:tasks.workunit.client.0.smithi003.stdout:9/59: link d2/fc d2/da/f11 0 2024-09-21T12:20:21.725 INFO:tasks.workunit.client.0.smithi003.stdout:9/60: readlink d2/l7 0 2024-09-21T12:20:21.730 INFO:tasks.workunit.client.0.smithi003.stdout:9/61: unlink d2/da/f11 0 2024-09-21T12:20:21.732 INFO:tasks.workunit.client.1.smithi192.stdout:5/528: rename d0/f10 to d0/d73/d44/d85/d97/d35/fb8 0 2024-09-21T12:20:21.736 INFO:tasks.workunit.client.1.smithi192.stdout:4/298: link d2/df/d52/f58 d2/db/d3e/d57/d28/f63 0 2024-09-21T12:20:21.738 INFO:tasks.workunit.client.0.smithi003.stdout:9/62: write d2/fc [320566,124372] 0 2024-09-21T12:20:21.738 INFO:tasks.workunit.client.1.smithi192.stdout:6/314: write da/d23/f34 [4914408,82020] 0 2024-09-21T12:20:21.739 INFO:tasks.workunit.client.1.smithi192.stdout:5/529: mkdir d0/d65/d8e/db9 0 2024-09-21T12:20:21.739 INFO:tasks.workunit.client.1.smithi192.stdout:9/317: link d5/l12 d5/d19/l61 0 2024-09-21T12:20:21.740 INFO:tasks.workunit.client.1.smithi192.stdout:6/315: dread da/d1f/f4c [0,4194304] 0 2024-09-21T12:20:21.740 INFO:tasks.workunit.client.1.smithi192.stdout:5/530: write d0/dc/f22 [1251010,123298] 0 2024-09-21T12:20:21.741 INFO:tasks.workunit.client.0.smithi003.stdout:9/63: chown d2/l4 113 1 2024-09-21T12:20:21.742 INFO:tasks.workunit.client.0.smithi003.stdout:9/64: write f1 [6218053,34224] 0 2024-09-21T12:20:21.742 INFO:tasks.workunit.client.1.smithi192.stdout:4/299: fsync d2/d36/f3c 0 2024-09-21T12:20:21.742 INFO:tasks.workunit.client.1.smithi192.stdout:6/316: write da/d23/d37/f5f [283298,41744] 0 2024-09-21T12:20:21.744 INFO:tasks.workunit.client.1.smithi192.stdout:4/300: dread d2/df/d52/f58 [0,4194304] 0 2024-09-21T12:20:21.748 INFO:tasks.workunit.client.1.smithi192.stdout:9/318: mknod d5/d8/d2c/c62 0 2024-09-21T12:20:21.750 INFO:tasks.workunit.client.0.smithi003.stdout:9/65: creat d2/da/f12 x:0 0 0 2024-09-21T12:20:21.751 INFO:tasks.workunit.client.1.smithi192.stdout:0/351: truncate d3/d5/d19/d51/f32 4051137 0 2024-09-21T12:20:21.752 INFO:tasks.workunit.client.1.smithi192.stdout:7/388: write d6/d9/d2d/f5e [1797196,24446] 0 2024-09-21T12:20:21.752 INFO:tasks.workunit.client.1.smithi192.stdout:5/531: mkdir d0/d65/d8e/d98/dba 0 2024-09-21T12:20:21.753 INFO:tasks.workunit.client.1.smithi192.stdout:5/532: dread - d0/f7c zero size 2024-09-21T12:20:21.754 INFO:tasks.workunit.client.0.smithi003.stdout:9/66: mknod d2/c13 0 2024-09-21T12:20:21.754 INFO:tasks.workunit.client.0.smithi003.stdout:9/67: read - d2/fd zero size 2024-09-21T12:20:21.757 INFO:tasks.workunit.client.0.smithi003.stdout:9/68: chown d2/cb 8065876 1 2024-09-21T12:20:21.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:21 smithi192 ceph-mon[35641]: from='client.14684 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:20:21.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:21 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:20:21.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:21 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:20:21.758 INFO:tasks.workunit.client.1.smithi192.stdout:4/301: creat d2/d19/d4b/f64 x:0 0 0 2024-09-21T12:20:21.759 INFO:tasks.workunit.client.1.smithi192.stdout:9/319: write d5/d8/d36/f43 [4514863,130726] 0 2024-09-21T12:20:21.760 INFO:tasks.workunit.client.1.smithi192.stdout:0/352: creat d3/de/d43/f66 x:0 0 0 2024-09-21T12:20:21.761 INFO:tasks.workunit.client.1.smithi192.stdout:7/389: creat d6/d9/d1f/d3e/f8c x:0 0 0 2024-09-21T12:20:21.762 INFO:tasks.workunit.client.1.smithi192.stdout:5/533: mknod d0/dc/d13/d37/cbb 0 2024-09-21T12:20:21.765 INFO:tasks.workunit.client.1.smithi192.stdout:4/302: dwrite d2/df/f30 [4194304,4194304] 0 2024-09-21T12:20:21.765 INFO:tasks.workunit.client.1.smithi192.stdout:9/320: symlink d5/d19/d32/l63 0 2024-09-21T12:20:21.766 INFO:tasks.workunit.client.1.smithi192.stdout:0/353: unlink d3/d5/f1b 0 2024-09-21T12:20:21.767 INFO:tasks.workunit.client.1.smithi192.stdout:6/317: link da/l24 da/d1f/l66 0 2024-09-21T12:20:21.768 INFO:tasks.workunit.client.1.smithi192.stdout:0/354: write d3/d6/f5a [52584,69526] 0 2024-09-21T12:20:21.771 INFO:tasks.workunit.client.1.smithi192.stdout:9/321: mkdir d5/dc/d64 0 2024-09-21T12:20:21.773 INFO:tasks.workunit.client.1.smithi192.stdout:4/303: dwrite d2/db/d3e/d41/f5b [0,4194304] 0 2024-09-21T12:20:21.774 INFO:tasks.workunit.client.1.smithi192.stdout:0/355: mknod d3/d5/c67 0 2024-09-21T12:20:21.776 INFO:tasks.workunit.client.1.smithi192.stdout:7/390: getdents d6/d9/d1f/d3e/d7a 0 2024-09-21T12:20:21.777 INFO:tasks.workunit.client.1.smithi192.stdout:6/318: rename da/d1f/f3f to da/d1f/d27/d3e/f67 0 2024-09-21T12:20:21.778 INFO:tasks.workunit.client.1.smithi192.stdout:1/431: sync 2024-09-21T12:20:21.778 INFO:tasks.workunit.client.0.smithi003.stdout:9/69: fsync d2/da/f12 0 2024-09-21T12:20:21.781 INFO:tasks.workunit.client.1.smithi192.stdout:0/356: truncate d3/de/d33/f5f 47750 0 2024-09-21T12:20:21.782 INFO:tasks.workunit.client.1.smithi192.stdout:6/319: mknod da/d1f/d56/c68 0 2024-09-21T12:20:21.783 INFO:tasks.workunit.client.0.smithi003.stdout:9/70: rename d2/fc to d2/da/f14 0 2024-09-21T12:20:21.785 INFO:tasks.workunit.client.0.smithi003.stdout:9/71: dread - d2/fd zero size 2024-09-21T12:20:21.786 INFO:tasks.workunit.client.1.smithi192.stdout:4/304: truncate d2/fa 1437464 0 2024-09-21T12:20:21.786 INFO:tasks.workunit.client.1.smithi192.stdout:9/322: dwrite d5/f2f [4194304,4194304] 0 2024-09-21T12:20:21.786 INFO:tasks.workunit.client.1.smithi192.stdout:4/305: readlink l1 0 2024-09-21T12:20:21.787 INFO:tasks.workunit.client.0.smithi003.stdout:9/72: rename d2/l4 to d2/l15 0 2024-09-21T12:20:21.787 INFO:tasks.workunit.client.1.smithi192.stdout:6/320: fdatasync da/f4b 0 2024-09-21T12:20:21.789 INFO:tasks.workunit.client.1.smithi192.stdout:1/432: mkdir d2/d12/d2f/d51/d24/d65/d8b 0 2024-09-21T12:20:21.790 INFO:tasks.workunit.client.0.smithi003.stdout:9/73: mknod d2/c16 0 2024-09-21T12:20:21.794 INFO:tasks.workunit.client.1.smithi192.stdout:9/323: dread d5/dc/d40/f25 [4194304,4194304] 0 2024-09-21T12:20:21.795 INFO:tasks.workunit.client.1.smithi192.stdout:6/321: write da/d23/d37/f39 [2843155,34513] 0 2024-09-21T12:20:21.797 INFO:tasks.workunit.client.1.smithi192.stdout:9/324: stat d5/f3b 0 2024-09-21T12:20:21.797 INFO:tasks.workunit.client.1.smithi192.stdout:5/534: dread d0/d73/d44/d85/fa6 [0,4194304] 0 2024-09-21T12:20:21.798 INFO:tasks.workunit.client.1.smithi192.stdout:6/322: symlink da/d1f/l69 0 2024-09-21T12:20:21.799 INFO:tasks.workunit.client.1.smithi192.stdout:1/433: dwrite d2/d12/f2b [0,4194304] 0 2024-09-21T12:20:21.799 INFO:tasks.workunit.client.0.smithi003.stdout:9/74: dwrite d2/da/f12 [0,4194304] 0 2024-09-21T12:20:21.799 INFO:tasks.workunit.client.1.smithi192.stdout:9/325: rename d5 to d5/dc/d65 22 2024-09-21T12:20:21.802 INFO:tasks.workunit.client.1.smithi192.stdout:5/535: unlink d0/d2/d7b/f82 0 2024-09-21T12:20:21.802 INFO:tasks.workunit.client.1.smithi192.stdout:9/326: write d5/d8/d36/f43 [766456,34606] 0 2024-09-21T12:20:21.805 INFO:tasks.workunit.client.1.smithi192.stdout:6/323: readlink da/d1f/l66 0 2024-09-21T12:20:21.810 INFO:tasks.workunit.client.0.smithi003.stdout:9/75: dwrite d2/f10 [0,4194304] 0 2024-09-21T12:20:21.812 INFO:tasks.workunit.client.1.smithi192.stdout:4/306: read d2/df/f29 [749709,88971] 0 2024-09-21T12:20:21.812 INFO:tasks.workunit.client.1.smithi192.stdout:7/391: dread d6/d9/f2b [0,4194304] 0 2024-09-21T12:20:21.813 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:21 smithi003 ceph-mon[28057]: from='client.14684 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:20:21.813 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:21 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:20:21.813 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:21 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:20:21.816 INFO:tasks.workunit.client.0.smithi003.stdout:9/76: dread d2/f10 [0,4194304] 0 2024-09-21T12:20:21.816 INFO:tasks.workunit.client.1.smithi192.stdout:9/327: rename d5/dc/d30 to d5/d21/d66 0 2024-09-21T12:20:21.816 INFO:tasks.workunit.client.1.smithi192.stdout:9/328: rename d5/d21/d66 to d5/d21/d66/d67 22 2024-09-21T12:20:21.820 INFO:tasks.workunit.client.1.smithi192.stdout:4/307: rmdir d2 39 2024-09-21T12:20:21.824 INFO:tasks.workunit.client.0.smithi003.stdout:9/77: dwrite d2/fd [0,4194304] 0 2024-09-21T12:20:21.825 INFO:tasks.workunit.client.0.smithi003.stdout:9/78: stat d2/fd 0 2024-09-21T12:20:21.825 INFO:tasks.workunit.client.1.smithi192.stdout:7/392: rename d6/d9/d1f/f66 to d6/d9/d1f/f8d 0 2024-09-21T12:20:21.826 INFO:tasks.workunit.client.1.smithi192.stdout:0/357: truncate d3/de/d43/f54 3695719 0 2024-09-21T12:20:21.827 INFO:tasks.workunit.client.1.smithi192.stdout:5/536: truncate d0/dc/d13/f53 3321899 0 2024-09-21T12:20:21.827 INFO:tasks.workunit.client.1.smithi192.stdout:0/358: write d3/d5/f14 [6580430,54735] 0 2024-09-21T12:20:21.829 INFO:tasks.workunit.client.1.smithi192.stdout:0/359: chown d3/c4 172143 1 2024-09-21T12:20:21.830 INFO:tasks.workunit.client.1.smithi192.stdout:6/324: dread da/f20 [0,4194304] 0 2024-09-21T12:20:21.830 INFO:tasks.workunit.client.1.smithi192.stdout:0/360: read d3/d6/f3f [1271211,26331] 0 2024-09-21T12:20:21.831 INFO:tasks.workunit.client.1.smithi192.stdout:6/325: fdatasync da/d1f/d48/f4d 0 2024-09-21T12:20:21.833 INFO:tasks.workunit.client.1.smithi192.stdout:6/326: write da/d1f/f3c [509694,105323] 0 2024-09-21T12:20:21.837 INFO:tasks.workunit.client.1.smithi192.stdout:5/537: write d0/d73/d44/d85/d97/f5c [1061435,75127] 0 2024-09-21T12:20:21.837 INFO:tasks.workunit.client.0.smithi003.stdout:9/79: dwrite d2/da/f14 [0,4194304] 0 2024-09-21T12:20:21.838 INFO:tasks.workunit.client.1.smithi192.stdout:5/538: write d0/d65/fb0 [631189,24734] 0 2024-09-21T12:20:21.838 INFO:tasks.workunit.client.1.smithi192.stdout:0/361: rmdir d3/d6/d1d 39 2024-09-21T12:20:21.839 INFO:tasks.workunit.client.1.smithi192.stdout:1/434: write d2/d12/d2f/d51/d24/d65/d5a/f75 [2114684,25805] 0 2024-09-21T12:20:21.843 INFO:tasks.workunit.client.0.smithi003.stdout:9/80: mkdir d2/da/d17 0 2024-09-21T12:20:21.845 INFO:tasks.workunit.client.1.smithi192.stdout:5/539: dwrite d0/d65/d6e/f29 [0,4194304] 0 2024-09-21T12:20:21.846 INFO:tasks.workunit.client.1.smithi192.stdout:6/327: creat da/f6a x:0 0 0 2024-09-21T12:20:21.849 INFO:tasks.workunit.client.1.smithi192.stdout:1/435: dwrite d2/d12/d2f/d51/d24/d65/f53 [0,4194304] 0 2024-09-21T12:20:21.850 INFO:tasks.workunit.client.1.smithi192.stdout:9/329: creat d5/dc/f68 x:0 0 0 2024-09-21T12:20:21.851 INFO:tasks.workunit.client.0.smithi003.stdout:9/81: dwrite f1 [0,4194304] 0 2024-09-21T12:20:21.854 INFO:tasks.workunit.client.1.smithi192.stdout:9/330: chown d5/d21/d3d/f54 1201 1 2024-09-21T12:20:21.854 INFO:tasks.workunit.client.0.smithi003.stdout:9/82: creat d2/f18 x:0 0 0 2024-09-21T12:20:21.856 INFO:tasks.workunit.client.1.smithi192.stdout:9/331: read d5/f2f [5803804,23549] 0 2024-09-21T12:20:21.858 INFO:tasks.workunit.client.1.smithi192.stdout:7/393: dwrite d6/d9/f2b [0,4194304] 0 2024-09-21T12:20:21.859 INFO:tasks.workunit.client.0.smithi003.stdout:9/83: symlink d2/da/d17/l19 0 2024-09-21T12:20:21.862 INFO:tasks.workunit.client.1.smithi192.stdout:1/436: rename d2/c1d to d2/d12/d2f/d51/d24/d58/c8c 0 2024-09-21T12:20:21.862 INFO:tasks.workunit.client.1.smithi192.stdout:0/362: stat d3/d6/d1d/c49 0 2024-09-21T12:20:21.864 INFO:tasks.workunit.client.1.smithi192.stdout:5/540: unlink d0/d73/d44/d85/d97/d45/l64 0 2024-09-21T12:20:21.865 INFO:tasks.workunit.client.1.smithi192.stdout:7/394: dread d6/d9/f1c [0,4194304] 0 2024-09-21T12:20:21.867 INFO:tasks.workunit.client.1.smithi192.stdout:6/328: truncate da/d23/f26 2274028 0 2024-09-21T12:20:21.867 INFO:tasks.workunit.client.1.smithi192.stdout:9/332: mknod d5/d8/d36/c69 0 2024-09-21T12:20:21.868 INFO:tasks.workunit.client.1.smithi192.stdout:5/541: chown d0/dc/d13/d37/d38/l47 70163801 1 2024-09-21T12:20:21.869 INFO:tasks.workunit.client.1.smithi192.stdout:1/437: rename d2/d12/l6e to d2/da/d89/l8d 0 2024-09-21T12:20:21.869 INFO:tasks.workunit.client.1.smithi192.stdout:9/333: stat d5/d8/d2c/c3e 0 2024-09-21T12:20:21.870 INFO:tasks.workunit.client.1.smithi192.stdout:1/438: chown d2/d12/d2f/d51/d24/f28 821655 1 2024-09-21T12:20:21.871 INFO:tasks.workunit.client.1.smithi192.stdout:0/363: dread d3/d5/d19/d51/f34 [0,4194304] 0 2024-09-21T12:20:21.872 INFO:tasks.workunit.client.1.smithi192.stdout:7/395: write d6/d9/d1f/f21 [4535329,119363] 0 2024-09-21T12:20:21.873 INFO:tasks.workunit.client.1.smithi192.stdout:7/396: read d6/d9/d1f/f21 [2899802,112572] 0 2024-09-21T12:20:21.873 INFO:tasks.workunit.client.1.smithi192.stdout:6/329: mkdir da/d1f/d27/d6b 0 2024-09-21T12:20:21.874 INFO:tasks.workunit.client.1.smithi192.stdout:6/330: fsync da/d1f/f54 0 2024-09-21T12:20:21.874 INFO:tasks.workunit.client.1.smithi192.stdout:5/542: mkdir d0/d65/d6e/dbc 0 2024-09-21T12:20:21.876 INFO:tasks.workunit.client.1.smithi192.stdout:8/445: sync 2024-09-21T12:20:21.876 INFO:tasks.workunit.client.1.smithi192.stdout:9/334: symlink d5/d8/d36/d55/l6a 0 2024-09-21T12:20:21.877 INFO:tasks.workunit.client.0.smithi003.stdout:9/84: dwrite d2/f10 [0,4194304] 0 2024-09-21T12:20:21.878 INFO:tasks.workunit.client.1.smithi192.stdout:8/446: write d14/d1a/d1d/d46/d4e/f76 [867864,121888] 0 2024-09-21T12:20:21.878 INFO:tasks.workunit.client.1.smithi192.stdout:1/439: mkdir d2/d12/d2f/d51/d24/d65/d8e 0 2024-09-21T12:20:21.881 INFO:tasks.workunit.client.1.smithi192.stdout:6/331: dwrite da/d23/d37/f33 [0,4194304] 0 2024-09-21T12:20:21.886 INFO:tasks.workunit.client.0.smithi003.stdout:9/85: dread d2/fd [0,4194304] 0 2024-09-21T12:20:21.888 INFO:tasks.workunit.client.1.smithi192.stdout:5/543: mknod d0/d65/d8e/d77/cbd 0 2024-09-21T12:20:21.890 INFO:tasks.workunit.client.1.smithi192.stdout:9/335: rename d5/dc/d40/f14 to d5/d19/f6b 0 2024-09-21T12:20:21.892 INFO:tasks.workunit.client.1.smithi192.stdout:0/364: chown d3/de/d33/c52 5 1 2024-09-21T12:20:21.894 INFO:tasks.workunit.client.1.smithi192.stdout:4/308: truncate d2/db/d3e/d57/d28/f39 1238358 0 2024-09-21T12:20:21.895 INFO:tasks.workunit.client.1.smithi192.stdout:4/309: chown d2/d36/d55/f60 6477 1 2024-09-21T12:20:21.898 INFO:tasks.workunit.client.1.smithi192.stdout:6/332: write da/d1f/d27/d3e/f67 [45564,114319] 0 2024-09-21T12:20:21.907 INFO:tasks.workunit.client.1.smithi192.stdout:6/333: read da/d1f/d56/f5d [228160,130419] 0 2024-09-21T12:20:21.907 INFO:tasks.workunit.client.1.smithi192.stdout:8/447: symlink d14/d1a/d1d/d20/d5f/d8a/l91 0 2024-09-21T12:20:21.908 INFO:tasks.workunit.client.1.smithi192.stdout:6/334: write da/f42 [1796525,30350] 0 2024-09-21T12:20:21.909 INFO:tasks.workunit.client.1.smithi192.stdout:1/440: link d2/d12/d2f/f4a d2/da/f8f 0 2024-09-21T12:20:21.913 INFO:tasks.workunit.client.1.smithi192.stdout:4/310: dread d2/db/d1a/f40 [0,4194304] 0 2024-09-21T12:20:21.914 INFO:tasks.workunit.client.1.smithi192.stdout:8/448: dwrite d14/d1a/d1d/f58 [0,4194304] 0 2024-09-21T12:20:21.915 INFO:tasks.workunit.client.1.smithi192.stdout:4/311: chown d2/d36/f61 25613 1 2024-09-21T12:20:21.916 INFO:tasks.workunit.client.1.smithi192.stdout:5/544: creat d0/d65/d8e/db9/fbe x:0 0 0 2024-09-21T12:20:21.919 INFO:tasks.workunit.client.1.smithi192.stdout:1/441: dwrite d2/da/d6b/d7d/f87 [0,4194304] 0 2024-09-21T12:20:21.930 INFO:tasks.workunit.client.1.smithi192.stdout:0/365: creat d3/d6/f68 x:0 0 0 2024-09-21T12:20:21.931 INFO:tasks.workunit.client.1.smithi192.stdout:0/366: chown d3/cc 0 1 2024-09-21T12:20:21.931 INFO:tasks.workunit.client.1.smithi192.stdout:7/397: dwrite d6/f52 [0,4194304] 0 2024-09-21T12:20:21.933 INFO:tasks.workunit.client.1.smithi192.stdout:0/367: dread - d3/d5/d28/f64 zero size 2024-09-21T12:20:21.935 INFO:tasks.workunit.client.1.smithi192.stdout:1/442: creat d2/da/d6b/d7d/f90 x:0 0 0 2024-09-21T12:20:21.936 INFO:tasks.workunit.client.1.smithi192.stdout:0/368: chown d3/d5/d19/d51/f34 873663106 1 2024-09-21T12:20:21.937 INFO:tasks.workunit.client.1.smithi192.stdout:4/312: mknod d2/d19/c65 0 2024-09-21T12:20:21.939 INFO:tasks.workunit.client.1.smithi192.stdout:8/449: mkdir d14/d1a/d1d/d46/d4e/d83/d8d/d92 0 2024-09-21T12:20:21.942 INFO:tasks.workunit.client.1.smithi192.stdout:7/398: creat d6/d9/d70/d77/f8e x:0 0 0 2024-09-21T12:20:21.943 INFO:tasks.workunit.client.1.smithi192.stdout:1/443: dwrite d2/d12/d2f/d51/f4f [0,4194304] 0 2024-09-21T12:20:21.943 INFO:tasks.workunit.client.1.smithi192.stdout:7/399: chown d6/d9/d51/f32 5291 1 2024-09-21T12:20:21.943 INFO:tasks.workunit.client.1.smithi192.stdout:0/369: mkdir d3/d5/d69 0 2024-09-21T12:20:21.949 INFO:tasks.workunit.client.1.smithi192.stdout:5/545: write d0/d65/d6e/da7/da0/fae [939138,34547] 0 2024-09-21T12:20:21.954 INFO:tasks.workunit.client.1.smithi192.stdout:1/444: creat d2/d12/d2f/d51/d24/d58/f91 x:0 0 0 2024-09-21T12:20:21.955 INFO:tasks.workunit.client.1.smithi192.stdout:0/370: dread - d3/de/f60 zero size 2024-09-21T12:20:21.956 INFO:tasks.workunit.client.1.smithi192.stdout:6/335: link da/d1f/l41 da/d23/l6c 0 2024-09-21T12:20:21.957 INFO:tasks.workunit.client.1.smithi192.stdout:6/336: chown da/d1f/d27/d3e/f62 13193050 1 2024-09-21T12:20:21.959 INFO:tasks.workunit.client.1.smithi192.stdout:5/546: mknod d0/d73/d44/cbf 0 2024-09-21T12:20:21.961 INFO:tasks.workunit.client.1.smithi192.stdout:7/400: symlink d6/d9/d1f/d3e/d7a/d8a/l8f 0 2024-09-21T12:20:21.963 INFO:tasks.workunit.client.1.smithi192.stdout:7/401: readlink d6/d9/d1f/d3e/l4a 0 2024-09-21T12:20:21.963 INFO:tasks.workunit.client.1.smithi192.stdout:4/313: creat d2/f66 x:0 0 0 2024-09-21T12:20:21.966 INFO:tasks.workunit.client.1.smithi192.stdout:8/450: dread d14/d1a/d1d/d39/f71 [0,4194304] 0 2024-09-21T12:20:21.967 INFO:tasks.workunit.client.1.smithi192.stdout:8/451: chown d14/d18/d5a 121 1 2024-09-21T12:20:21.970 INFO:tasks.workunit.client.1.smithi192.stdout:0/371: unlink d3/d6/f4c 0 2024-09-21T12:20:21.970 INFO:tasks.workunit.client.1.smithi192.stdout:0/372: chown d3/de 438128 1 2024-09-21T12:20:21.972 INFO:tasks.workunit.client.1.smithi192.stdout:7/402: mkdir d6/d20/d69/d90 0 2024-09-21T12:20:21.972 INFO:tasks.workunit.client.1.smithi192.stdout:1/445: dread d2/da/f27 [0,4194304] 0 2024-09-21T12:20:21.973 INFO:tasks.workunit.client.1.smithi192.stdout:7/403: write d6/d9/f2b [3338597,41181] 0 2024-09-21T12:20:21.973 INFO:tasks.workunit.client.1.smithi192.stdout:1/446: fdatasync d2/d12/f2b 0 2024-09-21T12:20:21.973 INFO:tasks.workunit.client.1.smithi192.stdout:7/404: stat d6 0 2024-09-21T12:20:21.975 INFO:tasks.workunit.client.1.smithi192.stdout:6/337: creat da/d1f/d27/d6b/f6d x:0 0 0 2024-09-21T12:20:21.977 INFO:tasks.workunit.client.1.smithi192.stdout:5/547: dread d0/d73/d44/d85/d97/f5c [4194304,4194304] 0 2024-09-21T12:20:21.985 INFO:tasks.workunit.client.1.smithi192.stdout:7/405: creat d6/d9/d70/d77/f91 x:0 0 0 2024-09-21T12:20:21.987 INFO:tasks.workunit.client.1.smithi192.stdout:1/447: dwrite d2/da/f27 [0,4194304] 0 2024-09-21T12:20:21.987 INFO:tasks.workunit.client.1.smithi192.stdout:6/338: mknod da/d1f/c6e 0 2024-09-21T12:20:21.989 INFO:tasks.workunit.client.1.smithi192.stdout:1/448: read d2/d12/d2f/f40 [1627287,24489] 0 2024-09-21T12:20:21.989 INFO:tasks.workunit.client.1.smithi192.stdout:1/449: read - d2/da/d6b/d7d/f90 zero size 2024-09-21T12:20:21.991 INFO:tasks.workunit.client.1.smithi192.stdout:7/406: mknod d6/d9/d1f/c92 0 2024-09-21T12:20:21.995 INFO:tasks.workunit.client.1.smithi192.stdout:1/450: dwrite d2/d12/d2f/d41/d61/f66 [4194304,4194304] 0 2024-09-21T12:20:21.996 INFO:tasks.workunit.client.1.smithi192.stdout:6/339: chown da/d1f/d48/l63 10 1 2024-09-21T12:20:21.998 INFO:tasks.workunit.client.1.smithi192.stdout:8/452: creat d14/d18/f93 x:0 0 0 2024-09-21T12:20:22.002 INFO:tasks.workunit.client.1.smithi192.stdout:1/451: creat d2/d12/f92 x:0 0 0 2024-09-21T12:20:22.004 INFO:tasks.workunit.client.1.smithi192.stdout:8/453: readlink d14/l36 0 2024-09-21T12:20:22.007 INFO:tasks.workunit.client.1.smithi192.stdout:7/407: mkdir d6/d9/d93 0 2024-09-21T12:20:22.009 INFO:tasks.workunit.client.1.smithi192.stdout:3/301: sync 2024-09-21T12:20:22.009 INFO:tasks.workunit.client.1.smithi192.stdout:2/385: sync 2024-09-21T12:20:22.009 INFO:tasks.workunit.client.1.smithi192.stdout:1/452: creat d2/d12/d2f/d41/d61/f93 x:0 0 0 2024-09-21T12:20:22.010 INFO:tasks.workunit.client.1.smithi192.stdout:4/314: dwrite d2/df/f5d [0,4194304] 0 2024-09-21T12:20:22.010 INFO:tasks.workunit.client.1.smithi192.stdout:3/302: chown db/f1e 3 1 2024-09-21T12:20:22.013 INFO:tasks.workunit.client.1.smithi192.stdout:1/453: creat d2/d12/f94 x:0 0 0 2024-09-21T12:20:22.014 INFO:tasks.workunit.client.1.smithi192.stdout:1/454: chown d2/d12/d2f/d51/d24/d65/d8b 138 1 2024-09-21T12:20:22.015 INFO:tasks.workunit.client.1.smithi192.stdout:8/454: mkdir d14/d18/d94 0 2024-09-21T12:20:22.016 INFO:tasks.workunit.client.1.smithi192.stdout:3/303: dread db/d16/d18/f3a [0,4194304] 0 2024-09-21T12:20:22.017 INFO:tasks.workunit.client.1.smithi192.stdout:8/455: write d14/d1a/d1d/d39/f3e [612729,17777] 0 2024-09-21T12:20:22.017 INFO:tasks.workunit.client.1.smithi192.stdout:4/315: symlink d2/d21/l67 0 2024-09-21T12:20:22.017 INFO:tasks.workunit.client.1.smithi192.stdout:4/316: dread - d2/f66 zero size 2024-09-21T12:20:22.019 INFO:tasks.workunit.client.1.smithi192.stdout:8/456: read d14/d1a/d1d/d20/d5f/f68 [674831,115343] 0 2024-09-21T12:20:22.020 INFO:tasks.workunit.client.1.smithi192.stdout:7/408: link d6/d20/f4d d6/d20/d69/d90/f94 0 2024-09-21T12:20:22.026 INFO:tasks.workunit.client.1.smithi192.stdout:1/455: rename d2/d12/f2b to d2/d12/d2f/d51/d24/d65/d5a/f95 0 2024-09-21T12:20:22.028 INFO:tasks.workunit.client.1.smithi192.stdout:4/317: dread d2/df/f17 [0,4194304] 0 2024-09-21T12:20:22.032 INFO:tasks.workunit.client.1.smithi192.stdout:3/304: mknod db/d16/d18/d21/c69 0 2024-09-21T12:20:22.033 INFO:tasks.workunit.client.1.smithi192.stdout:3/305: write db/d16/d18/f3e [2265455,66555] 0 2024-09-21T12:20:22.033 INFO:tasks.workunit.client.0.smithi003.stdout:9/86: mknod d2/c1a 0 2024-09-21T12:20:22.040 INFO:tasks.workunit.client.0.smithi003.stdout:9/87: dwrite d2/f18 [0,4194304] 0 2024-09-21T12:20:22.042 INFO:tasks.workunit.client.0.smithi003.stdout:9/88: write d2/da/f12 [1866501,129876] 0 2024-09-21T12:20:22.046 INFO:tasks.workunit.client.0.smithi003.stdout:9/89: creat d2/da/d17/f1b x:0 0 0 2024-09-21T12:20:22.047 INFO:tasks.workunit.client.0.smithi003.stdout:9/90: write d2/da/f12 [312935,19795] 0 2024-09-21T12:20:22.049 INFO:tasks.workunit.client.0.smithi003.stdout:9/91: symlink d2/l1c 0 2024-09-21T12:20:22.054 INFO:tasks.workunit.client.0.smithi003.stdout:9/92: dread d2/da/f14 [0,4194304] 0 2024-09-21T12:20:22.056 INFO:tasks.workunit.client.0.smithi003.stdout:9/93: mknod d2/da/d17/c1d 0 2024-09-21T12:20:22.057 INFO:tasks.workunit.client.0.smithi003.stdout:9/94: mknod d2/da/d17/c1e 0 2024-09-21T12:20:22.059 INFO:tasks.workunit.client.0.smithi003.stdout:9/95: link d2/c13 d2/da/c1f 0 2024-09-21T12:20:22.061 INFO:tasks.workunit.client.0.smithi003.stdout:9/96: mkdir d2/d20 0 2024-09-21T12:20:22.062 INFO:tasks.workunit.client.1.smithi192.stdout:2/386: getdents d1b 0 2024-09-21T12:20:22.064 INFO:tasks.workunit.client.1.smithi192.stdout:7/409: rmdir d6/d9/d93 0 2024-09-21T12:20:22.066 INFO:tasks.workunit.client.1.smithi192.stdout:2/387: rmdir d1b/d38/d53 39 2024-09-21T12:20:22.067 INFO:tasks.workunit.client.1.smithi192.stdout:3/306: dwrite db/d16/d18/f36 [0,4194304] 0 2024-09-21T12:20:22.067 INFO:tasks.workunit.client.1.smithi192.stdout:2/388: write d1b/f5b [62187,93953] 0 2024-09-21T12:20:22.068 INFO:tasks.workunit.client.0.smithi003.stdout:9/97: dwrite d2/da/f12 [0,4194304] 0 2024-09-21T12:20:22.069 INFO:tasks.workunit.client.1.smithi192.stdout:2/389: write fe [2570401,57944] 0 2024-09-21T12:20:22.069 INFO:tasks.workunit.client.1.smithi192.stdout:8/457: dread fd [0,4194304] 0 2024-09-21T12:20:22.070 INFO:tasks.workunit.client.1.smithi192.stdout:1/456: dread d2/d12/d2f/d51/d24/d65/d5a/f5d [0,4194304] 0 2024-09-21T12:20:22.074 INFO:tasks.workunit.client.0.smithi003.stdout:9/98: creat d2/d20/f21 x:0 0 0 2024-09-21T12:20:22.076 INFO:tasks.workunit.client.1.smithi192.stdout:7/410: creat d6/d20/d69/d90/f95 x:0 0 0 2024-09-21T12:20:22.076 INFO:tasks.workunit.client.1.smithi192.stdout:4/318: write d2/db/d1a/f40 [405718,55227] 0 2024-09-21T12:20:22.076 INFO:tasks.workunit.client.1.smithi192.stdout:8/458: creat d14/d1a/f95 x:0 0 0 2024-09-21T12:20:22.078 INFO:tasks.workunit.client.1.smithi192.stdout:8/459: dread - d14/f43 zero size 2024-09-21T12:20:22.078 INFO:tasks.workunit.client.1.smithi192.stdout:1/457: unlink d2/d12/d2f/l33 0 2024-09-21T12:20:22.080 INFO:tasks.workunit.client.0.smithi003.stdout:9/99: dread d2/fd [0,4194304] 0 2024-09-21T12:20:22.080 INFO:tasks.workunit.client.1.smithi192.stdout:2/390: mkdir d1b/d1e/d7b 0 2024-09-21T12:20:22.081 INFO:tasks.workunit.client.1.smithi192.stdout:1/458: write d2/d12/f94 [942447,93782] 0 2024-09-21T12:20:22.081 INFO:tasks.workunit.client.1.smithi192.stdout:4/319: mkdir d2/db/d3e/d57/d28/d68 0 2024-09-21T12:20:22.083 INFO:tasks.workunit.client.1.smithi192.stdout:3/307: rename db/d16/d18/d21/d23/c55 to db/d16/c6a 0 2024-09-21T12:20:22.084 INFO:tasks.workunit.client.1.smithi192.stdout:7/411: dwrite d6/d9/d51/f4b [0,4194304] 0 2024-09-21T12:20:22.084 INFO:tasks.workunit.client.1.smithi192.stdout:4/320: creat d2/db/d3e/d41/f69 x:0 0 0 2024-09-21T12:20:22.086 INFO:tasks.workunit.client.1.smithi192.stdout:3/308: write db/f1e [8665621,49960] 0 2024-09-21T12:20:22.088 INFO:tasks.workunit.client.0.smithi003.stdout:9/100: dwrite d2/da/d17/f1b [0,4194304] 0 2024-09-21T12:20:22.089 INFO:tasks.workunit.client.1.smithi192.stdout:3/309: readlink db/l46 0 2024-09-21T12:20:22.089 INFO:tasks.workunit.client.1.smithi192.stdout:7/412: mknod d6/d9/d1f/c96 0 2024-09-21T12:20:22.089 INFO:tasks.workunit.client.1.smithi192.stdout:4/321: fsync d2/d19/f2d 0 2024-09-21T12:20:22.091 INFO:tasks.workunit.client.1.smithi192.stdout:2/391: dwrite d1b/f1d [0,4194304] 0 2024-09-21T12:20:22.093 INFO:tasks.workunit.client.1.smithi192.stdout:3/310: write db/d16/d61/f5e [42825,66617] 0 2024-09-21T12:20:22.095 INFO:tasks.workunit.client.1.smithi192.stdout:4/322: write d2/db/d3e/d41/f69 [978100,19104] 0 2024-09-21T12:20:22.095 INFO:tasks.workunit.client.1.smithi192.stdout:4/323: stat l1 0 2024-09-21T12:20:22.098 INFO:tasks.workunit.client.1.smithi192.stdout:4/324: write d2/db/d34/f4a [981418,80115] 0 2024-09-21T12:20:22.100 INFO:tasks.workunit.client.0.smithi003.stdout:9/101: dwrite d2/da/f12 [4194304,4194304] 0 2024-09-21T12:20:22.100 INFO:tasks.workunit.client.1.smithi192.stdout:7/413: rename d6/d9/d70/d77/f8e to d6/d9/d2d/d7b/f97 0 2024-09-21T12:20:22.101 INFO:tasks.workunit.client.1.smithi192.stdout:7/414: write d6/d9/d51/f24 [1110596,114025] 0 2024-09-21T12:20:22.104 INFO:tasks.workunit.client.1.smithi192.stdout:9/336: sync 2024-09-21T12:20:22.105 INFO:tasks.workunit.client.1.smithi192.stdout:4/325: dwrite d2/db/d3e/d57/d28/f4d [0,4194304] 0 2024-09-21T12:20:22.106 INFO:tasks.workunit.client.1.smithi192.stdout:4/326: chown d2/d19/d4b/f5a 2023 1 2024-09-21T12:20:22.107 INFO:tasks.workunit.client.1.smithi192.stdout:3/311: rename db/d16/d18/d33/d4a/c67 to db/d16/d61/c6b 0 2024-09-21T12:20:22.108 INFO:tasks.workunit.client.1.smithi192.stdout:3/312: dread - db/f5c zero size 2024-09-21T12:20:22.108 INFO:tasks.workunit.client.1.smithi192.stdout:9/337: mknod d5/d21/d3d/c6c 0 2024-09-21T12:20:22.109 INFO:tasks.workunit.client.0.smithi003.stdout:9/102: dwrite d2/f18 [0,4194304] 0 2024-09-21T12:20:22.111 INFO:tasks.workunit.client.1.smithi192.stdout:3/313: fsync db/f22 0 2024-09-21T12:20:22.113 INFO:tasks.workunit.client.0.smithi003.stdout:9/103: write d2/da/d17/f1b [323058,37060] 0 2024-09-21T12:20:22.115 INFO:tasks.workunit.client.1.smithi192.stdout:3/314: stat db/d16/c6a 0 2024-09-21T12:20:22.115 INFO:tasks.workunit.client.1.smithi192.stdout:3/315: readlink db/ld 0 2024-09-21T12:20:22.117 INFO:tasks.workunit.client.1.smithi192.stdout:4/327: dwrite d2/db/d34/f4a [0,4194304] 0 2024-09-21T12:20:22.118 INFO:tasks.workunit.client.0.smithi003.stdout:9/104: getdents d2/da/d17 0 2024-09-21T12:20:22.119 INFO:tasks.workunit.client.1.smithi192.stdout:3/316: symlink db/d16/d18/d21/d23/l6c 0 2024-09-21T12:20:22.120 INFO:tasks.workunit.client.0.smithi003.stdout:9/105: mkdir d2/d20/d22 0 2024-09-21T12:20:22.122 INFO:tasks.workunit.client.1.smithi192.stdout:4/328: creat d2/db/d3e/d57/d32/d4f/f6a x:0 0 0 2024-09-21T12:20:22.123 INFO:tasks.workunit.client.1.smithi192.stdout:4/329: readlink d2/d21/l2f 0 2024-09-21T12:20:22.123 INFO:tasks.workunit.client.1.smithi192.stdout:4/330: chown d2/d19/f2d 4423544 1 2024-09-21T12:20:22.125 INFO:tasks.workunit.client.1.smithi192.stdout:4/331: fsync d2/db/d3e/f43 0 2024-09-21T12:20:22.125 INFO:tasks.workunit.client.0.smithi003.stdout:9/106: rename d2/ce to d2/d20/c23 0 2024-09-21T12:20:22.126 INFO:tasks.workunit.client.0.smithi003.stdout:9/107: write f1 [6472965,40419] 0 2024-09-21T12:20:22.126 INFO:tasks.workunit.client.0.smithi003.stdout:9/108: stat d2/d20/d22 0 2024-09-21T12:20:22.128 INFO:tasks.workunit.client.1.smithi192.stdout:2/392: write d1b/d1e/d3d/f4b [852202,72703] 0 2024-09-21T12:20:22.132 INFO:tasks.workunit.client.0.smithi003.stdout:9/109: unlink d2/l15 0 2024-09-21T12:20:22.134 INFO:tasks.workunit.client.1.smithi192.stdout:2/393: rename d1b/c3a to d1b/d65/d77/c7c 0 2024-09-21T12:20:22.135 INFO:tasks.workunit.client.0.smithi003.stdout:9/110: symlink d2/d20/l24 0 2024-09-21T12:20:22.138 INFO:tasks.workunit.client.1.smithi192.stdout:7/415: dread f3 [0,4194304] 0 2024-09-21T12:20:22.139 INFO:tasks.workunit.client.0.smithi003.stdout:9/111: getdents d2/da 0 2024-09-21T12:20:22.140 INFO:tasks.workunit.client.0.smithi003.stdout:9/112: dread - d2/d20/f21 zero size 2024-09-21T12:20:22.140 INFO:tasks.workunit.client.1.smithi192.stdout:3/317: getdents db/d16/d18/d33/d4a 0 2024-09-21T12:20:22.141 INFO:tasks.workunit.client.1.smithi192.stdout:7/416: symlink d6/d3a/d6d/l98 0 2024-09-21T12:20:22.144 INFO:tasks.workunit.client.1.smithi192.stdout:7/417: mkdir d6/d9/d1f/d99 0 2024-09-21T12:20:22.145 INFO:tasks.workunit.client.1.smithi192.stdout:3/318: getdents db/d16/d18/d40/d60 0 2024-09-21T12:20:22.146 INFO:tasks.workunit.client.0.smithi003.stdout:9/113: link c0 d2/c25 0 2024-09-21T12:20:22.148 INFO:tasks.workunit.client.1.smithi192.stdout:9/338: dwrite d5/d8/f2d [0,4194304] 0 2024-09-21T12:20:22.150 INFO:tasks.workunit.client.1.smithi192.stdout:9/339: dread - d5/d8/d11/d44/f51 zero size 2024-09-21T12:20:22.150 INFO:tasks.workunit.client.1.smithi192.stdout:7/418: dwrite d6/d9/d70/d77/f91 [0,4194304] 0 2024-09-21T12:20:22.151 INFO:tasks.workunit.client.1.smithi192.stdout:4/332: truncate d2/db/d3e/d57/d28/f4d 2404618 0 2024-09-21T12:20:22.152 INFO:tasks.workunit.client.1.smithi192.stdout:3/319: mknod db/d16/d18/d21/c6d 0 2024-09-21T12:20:22.152 INFO:tasks.workunit.client.1.smithi192.stdout:9/340: write d5/d8/d2c/f5d [420695,49592] 0 2024-09-21T12:20:22.152 INFO:tasks.workunit.client.1.smithi192.stdout:7/419: chown d6/d3a/d63/f6f 70350 1 2024-09-21T12:20:22.152 INFO:tasks.workunit.client.0.smithi003.stdout:9/114: dwrite d2/f10 [0,4194304] 0 2024-09-21T12:20:22.154 INFO:tasks.workunit.client.1.smithi192.stdout:7/420: fdatasync d6/d9/f5f 0 2024-09-21T12:20:22.154 INFO:tasks.workunit.client.1.smithi192.stdout:9/341: stat d5/d8/d2c/c62 0 2024-09-21T12:20:22.155 INFO:tasks.workunit.client.1.smithi192.stdout:4/333: write d2/db/f26 [3397630,42624] 0 2024-09-21T12:20:22.157 INFO:tasks.workunit.client.1.smithi192.stdout:9/342: dread - d5/d19/f3c zero size 2024-09-21T12:20:22.157 INFO:tasks.workunit.client.1.smithi192.stdout:9/343: stat d5/d8/f15 0 2024-09-21T12:20:22.162 INFO:tasks.workunit.client.1.smithi192.stdout:3/320: creat db/d16/d18/d40/f6e x:0 0 0 2024-09-21T12:20:22.163 INFO:tasks.workunit.client.1.smithi192.stdout:3/321: fsync db/f22 0 2024-09-21T12:20:22.164 INFO:tasks.workunit.client.0.smithi003.stdout:9/115: rename c0 to d2/d20/c26 0 2024-09-21T12:20:22.166 INFO:tasks.workunit.client.1.smithi192.stdout:7/421: creat d6/d9/d70/d77/f9a x:0 0 0 2024-09-21T12:20:22.167 INFO:tasks.workunit.client.1.smithi192.stdout:7/422: truncate d6/d9/d70/d77/f9a 1030387 0 2024-09-21T12:20:22.168 INFO:tasks.workunit.client.1.smithi192.stdout:3/322: rmdir db/d16/d18/d33/d4a 39 2024-09-21T12:20:22.169 INFO:tasks.workunit.client.1.smithi192.stdout:4/334: symlink d2/db/l6b 0 2024-09-21T12:20:22.170 INFO:tasks.workunit.client.1.smithi192.stdout:9/344: unlink d5/d19/l61 0 2024-09-21T12:20:22.170 INFO:tasks.workunit.client.1.smithi192.stdout:2/394: mkdir d1b/d38/d7d 0 2024-09-21T12:20:22.171 INFO:tasks.workunit.client.1.smithi192.stdout:9/345: write d5/dc/f5c [76524,100527] 0 2024-09-21T12:20:22.173 INFO:tasks.workunit.client.1.smithi192.stdout:3/323: symlink db/d16/d18/d21/d23/d66/l6f 0 2024-09-21T12:20:22.174 INFO:tasks.workunit.client.1.smithi192.stdout:7/423: getdents d6/d9/d1f/d3e/d7a 0 2024-09-21T12:20:22.174 INFO:tasks.workunit.client.1.smithi192.stdout:2/395: read - d1b/d1e/f5f zero size 2024-09-21T12:20:22.175 INFO:tasks.workunit.client.1.smithi192.stdout:3/324: symlink db/d16/d18/d40/l70 0 2024-09-21T12:20:22.176 INFO:tasks.workunit.client.1.smithi192.stdout:2/396: creat d1b/d38/f7e x:0 0 0 2024-09-21T12:20:22.177 INFO:tasks.workunit.client.1.smithi192.stdout:3/325: mkdir db/d16/d18/d21/d23/d71 0 2024-09-21T12:20:22.178 INFO:tasks.workunit.client.1.smithi192.stdout:3/326: creat db/d16/d61/d2e/f72 x:0 0 0 2024-09-21T12:20:22.179 INFO:tasks.workunit.client.1.smithi192.stdout:3/327: write db/d16/d18/f3e [1593790,17850] 0 2024-09-21T12:20:22.182 INFO:tasks.workunit.client.1.smithi192.stdout:3/328: mknod db/d16/d18/d33/d3b/c73 0 2024-09-21T12:20:22.183 INFO:tasks.workunit.client.1.smithi192.stdout:2/397: dwrite d1b/d38/d53/f73 [0,4194304] 0 2024-09-21T12:20:22.185 INFO:tasks.workunit.client.1.smithi192.stdout:2/398: chown d1b/l2b 2453905 1 2024-09-21T12:20:22.187 INFO:tasks.workunit.client.1.smithi192.stdout:3/329: creat db/d16/d18/f74 x:0 0 0 2024-09-21T12:20:22.190 INFO:tasks.workunit.client.1.smithi192.stdout:2/399: chown d1b/d1e/d62/c7a 1 1 2024-09-21T12:20:22.190 INFO:tasks.workunit.client.1.smithi192.stdout:3/330: rename db/d16/d18 to db/d16/d18/d40/d60/d75 22 2024-09-21T12:20:22.190 INFO:tasks.workunit.client.1.smithi192.stdout:2/400: readlink d1b/d1e/d3d/l50 0 2024-09-21T12:20:22.192 INFO:tasks.workunit.client.1.smithi192.stdout:2/401: fsync d1b/d1e/f31 0 2024-09-21T12:20:22.192 INFO:tasks.workunit.client.1.smithi192.stdout:2/402: read - d1b/d1e/f5f zero size 2024-09-21T12:20:22.193 INFO:tasks.workunit.client.1.smithi192.stdout:3/331: mkdir db/d16/d76 0 2024-09-21T12:20:22.199 INFO:tasks.workunit.client.1.smithi192.stdout:2/403: dwrite d1b/d1e/d62/f6c [0,4194304] 0 2024-09-21T12:20:22.201 INFO:tasks.workunit.client.1.smithi192.stdout:2/404: creat d1b/d1e/d62/f7f x:0 0 0 2024-09-21T12:20:22.202 INFO:tasks.workunit.client.1.smithi192.stdout:3/332: rename db/d16/d18/d21/d23/d66 to db/d16/d18/d21/d23/d71/d77 0 2024-09-21T12:20:22.203 INFO:tasks.workunit.client.1.smithi192.stdout:4/335: truncate d2/db/d34/f4a 2034077 0 2024-09-21T12:20:22.207 INFO:tasks.workunit.client.1.smithi192.stdout:3/333: truncate db/d16/d18/d33/f48 5187823 0 2024-09-21T12:20:22.208 INFO:tasks.workunit.client.1.smithi192.stdout:2/405: dwrite d1b/d38/d53/f61 [0,4194304] 0 2024-09-21T12:20:22.209 INFO:tasks.workunit.client.0.smithi003.stdout:9/116: creat d2/da/d17/f27 x:0 0 0 2024-09-21T12:20:22.210 INFO:tasks.workunit.client.1.smithi192.stdout:4/336: mkdir d2/db/d34/d56/d6c 0 2024-09-21T12:20:22.212 INFO:tasks.workunit.client.0.smithi003.stdout:9/117: mknod d2/da/d17/c28 0 2024-09-21T12:20:22.214 INFO:tasks.workunit.client.1.smithi192.stdout:3/334: rename db/d16/d61/d2e/l34 to db/d16/d18/d33/d3b/l78 0 2024-09-21T12:20:22.215 INFO:tasks.workunit.client.1.smithi192.stdout:2/406: dwrite fd [0,4194304] 0 2024-09-21T12:20:22.218 INFO:tasks.workunit.client.0.smithi003.stdout:9/118: readlink d2/d20/l24 0 2024-09-21T12:20:22.220 INFO:tasks.workunit.client.1.smithi192.stdout:2/407: stat d1b/d1e/d3d/l70 0 2024-09-21T12:20:22.221 INFO:tasks.workunit.client.1.smithi192.stdout:2/408: dread - d1b/d1e/d62/f7f zero size 2024-09-21T12:20:22.221 INFO:tasks.workunit.client.1.smithi192.stdout:4/337: creat d2/db/f6d x:0 0 0 2024-09-21T12:20:22.222 INFO:tasks.workunit.client.1.smithi192.stdout:4/338: read d2/df/f5d [3210022,62980] 0 2024-09-21T12:20:22.223 INFO:tasks.workunit.client.1.smithi192.stdout:3/335: creat db/d16/d61/f79 x:0 0 0 2024-09-21T12:20:22.224 INFO:tasks.workunit.client.1.smithi192.stdout:3/336: write db/d16/d18/f3a [597056,87494] 0 2024-09-21T12:20:22.225 INFO:tasks.workunit.client.1.smithi192.stdout:2/409: creat d1b/d1e/d7b/f80 x:0 0 0 2024-09-21T12:20:22.226 INFO:tasks.workunit.client.1.smithi192.stdout:4/339: fdatasync d2/df/d52/f59 0 2024-09-21T12:20:22.229 INFO:tasks.workunit.client.1.smithi192.stdout:2/410: mknod d1b/d1e/d3d/c81 0 2024-09-21T12:20:22.230 INFO:tasks.workunit.client.1.smithi192.stdout:4/340: dread d2/db/d3e/d41/f69 [0,4194304] 0 2024-09-21T12:20:22.232 INFO:tasks.workunit.client.1.smithi192.stdout:3/337: link db/d16/d61/l41 db/d16/d18/d40/d60/l7a 0 2024-09-21T12:20:22.233 INFO:tasks.workunit.client.1.smithi192.stdout:2/411: dread d1b/d38/f49 [0,4194304] 0 2024-09-21T12:20:22.235 INFO:tasks.workunit.client.1.smithi192.stdout:4/341: rename d2/fa to d2/db/d34/d56/d6c/f6e 0 2024-09-21T12:20:22.238 INFO:tasks.workunit.client.1.smithi192.stdout:3/338: mkdir db/d16/d18/d40/d60/d7b 0 2024-09-21T12:20:22.239 INFO:tasks.workunit.client.1.smithi192.stdout:2/412: creat d1b/d1e/d5e/d75/f82 x:0 0 0 2024-09-21T12:20:22.239 INFO:tasks.workunit.client.1.smithi192.stdout:2/413: chown d1b/d1e/l46 61674227 1 2024-09-21T12:20:22.241 INFO:tasks.workunit.client.1.smithi192.stdout:3/339: mkdir db/d16/d18/d40/d60/d7b/d7c 0 2024-09-21T12:20:22.243 INFO:tasks.workunit.client.1.smithi192.stdout:2/414: rename d1b/d1e/d3d/c48 to d1b/d1e/d62/c83 0 2024-09-21T12:20:22.245 INFO:tasks.workunit.client.1.smithi192.stdout:2/415: creat d1b/d1e/d5e/d75/f84 x:0 0 0 2024-09-21T12:20:22.248 INFO:tasks.workunit.client.1.smithi192.stdout:2/416: symlink d1b/d65/d77/l85 0 2024-09-21T12:20:22.252 INFO:tasks.workunit.client.1.smithi192.stdout:0/373: sync 2024-09-21T12:20:22.252 INFO:tasks.workunit.client.1.smithi192.stdout:5/548: sync 2024-09-21T12:20:22.255 INFO:tasks.workunit.client.1.smithi192.stdout:5/549: fsync d0/dc/d13/d37/f89 0 2024-09-21T12:20:22.255 INFO:tasks.workunit.client.1.smithi192.stdout:2/417: dwrite d1b/f4c [0,4194304] 0 2024-09-21T12:20:22.256 INFO:tasks.workunit.client.1.smithi192.stdout:0/374: dread d3/d6/fd [0,4194304] 0 2024-09-21T12:20:22.258 INFO:tasks.workunit.client.1.smithi192.stdout:2/418: dread - d1b/d1e/f30 zero size 2024-09-21T12:20:22.260 INFO:tasks.workunit.client.1.smithi192.stdout:0/375: creat d3/f6a x:0 0 0 2024-09-21T12:20:22.261 INFO:tasks.workunit.client.1.smithi192.stdout:2/419: write fd [5102156,20698] 0 2024-09-21T12:20:22.262 INFO:tasks.workunit.client.1.smithi192.stdout:2/420: stat d1b 0 2024-09-21T12:20:22.264 INFO:tasks.workunit.client.1.smithi192.stdout:4/342: dwrite d2/db/d3e/d57/d28/f63 [0,4194304] 0 2024-09-21T12:20:22.264 INFO:tasks.workunit.client.1.smithi192.stdout:2/421: write d1b/d1e/f47 [879924,8426] 0 2024-09-21T12:20:22.266 INFO:tasks.workunit.client.1.smithi192.stdout:5/550: rename d0/d73 to d0/d65/d6e/dc0 0 2024-09-21T12:20:22.266 INFO:tasks.workunit.client.1.smithi192.stdout:0/376: fsync d3/de/f24 0 2024-09-21T12:20:22.268 INFO:tasks.workunit.client.1.smithi192.stdout:2/422: dread d1b/d1e/d3d/f5a [0,4194304] 0 2024-09-21T12:20:22.268 INFO:tasks.workunit.client.1.smithi192.stdout:0/377: stat d3/d5/d19 0 2024-09-21T12:20:22.272 INFO:tasks.workunit.client.1.smithi192.stdout:4/343: truncate d2/db/f15 366029 0 2024-09-21T12:20:22.274 INFO:tasks.workunit.client.1.smithi192.stdout:2/423: dread d1b/f1d [0,4194304] 0 2024-09-21T12:20:22.275 INFO:tasks.workunit.client.1.smithi192.stdout:4/344: symlink d2/db/d1a/l6f 0 2024-09-21T12:20:22.277 INFO:tasks.workunit.client.1.smithi192.stdout:0/378: getdents d3/d5/d28/d39/d50 0 2024-09-21T12:20:22.280 INFO:tasks.workunit.client.1.smithi192.stdout:2/424: truncate f19 1763527 0 2024-09-21T12:20:22.282 INFO:tasks.workunit.client.1.smithi192.stdout:2/425: write d1b/d38/d53/f61 [439464,127848] 0 2024-09-21T12:20:22.283 INFO:tasks.workunit.client.1.smithi192.stdout:4/345: dwrite d2/d19/d4b/f62 [0,4194304] 0 2024-09-21T12:20:22.283 INFO:tasks.workunit.client.1.smithi192.stdout:2/426: fsync fd 0 2024-09-21T12:20:22.287 INFO:tasks.workunit.client.1.smithi192.stdout:2/427: write d1b/d1e/f36 [1981728,44740] 0 2024-09-21T12:20:22.291 INFO:tasks.workunit.client.1.smithi192.stdout:2/428: creat d1b/d1e/d62/f86 x:0 0 0 2024-09-21T12:20:22.295 INFO:tasks.workunit.client.1.smithi192.stdout:5/551: dread d0/d65/d6e/dc0/d44/d85/d97/d45/f2c [0,4194304] 0 2024-09-21T12:20:22.295 INFO:tasks.workunit.client.1.smithi192.stdout:4/346: truncate d2/d36/f61 2884070 0 2024-09-21T12:20:22.297 INFO:tasks.workunit.client.1.smithi192.stdout:5/552: fdatasync d0/dc/f6f 0 2024-09-21T12:20:22.298 INFO:tasks.workunit.client.1.smithi192.stdout:4/347: fsync d2/df/f29 0 2024-09-21T12:20:22.298 INFO:tasks.workunit.client.1.smithi192.stdout:2/429: dwrite d1b/f57 [0,4194304] 0 2024-09-21T12:20:22.299 INFO:tasks.workunit.client.1.smithi192.stdout:2/430: dread - d1b/d38/d53/f6d zero size 2024-09-21T12:20:22.300 INFO:tasks.workunit.client.1.smithi192.stdout:5/553: mknod d0/d65/d8e/d98/dba/cc1 0 2024-09-21T12:20:22.301 INFO:tasks.workunit.client.1.smithi192.stdout:4/348: creat d2/db/d3e/d41/f70 x:0 0 0 2024-09-21T12:20:22.302 INFO:tasks.workunit.client.1.smithi192.stdout:5/554: write d0/d2/fb2 [400185,1519] 0 2024-09-21T12:20:22.304 INFO:tasks.workunit.client.1.smithi192.stdout:0/379: dread d3/de/d43/f54 [0,4194304] 0 2024-09-21T12:20:22.305 INFO:tasks.workunit.client.1.smithi192.stdout:5/555: mknod d0/dc/d13/d37/cc2 0 2024-09-21T12:20:22.306 INFO:tasks.workunit.client.1.smithi192.stdout:2/431: getdents d1b/d38/d53 0 2024-09-21T12:20:22.306 INFO:tasks.workunit.client.1.smithi192.stdout:5/556: fsync d0/d65/d6e/dc0/d44/d85/d97/d35/d79/f46 0 2024-09-21T12:20:22.307 INFO:tasks.workunit.client.1.smithi192.stdout:5/557: stat d0/d65/d6e/dc0/d44 0 2024-09-21T12:20:22.307 INFO:tasks.workunit.client.1.smithi192.stdout:4/349: rename d2/db/d34/d42 to d2/db/d3e/d57/d32/d4f/d71 0 2024-09-21T12:20:22.308 INFO:tasks.workunit.client.1.smithi192.stdout:4/350: chown l1 20682734 1 2024-09-21T12:20:22.309 INFO:tasks.workunit.client.1.smithi192.stdout:0/380: mknod d3/de/c6b 0 2024-09-21T12:20:22.310 INFO:tasks.workunit.client.1.smithi192.stdout:1/459: sync 2024-09-21T12:20:22.310 INFO:tasks.workunit.client.1.smithi192.stdout:9/346: sync 2024-09-21T12:20:22.310 INFO:tasks.workunit.client.1.smithi192.stdout:8/460: sync 2024-09-21T12:20:22.310 INFO:tasks.workunit.client.1.smithi192.stdout:6/340: sync 2024-09-21T12:20:22.314 INFO:tasks.workunit.client.1.smithi192.stdout:6/341: creat da/d1f/d27/f6f x:0 0 0 2024-09-21T12:20:22.314 INFO:tasks.workunit.client.1.smithi192.stdout:5/558: truncate d0/d65/d6e/da7/da0/fae 1441737 0 2024-09-21T12:20:22.314 INFO:tasks.workunit.client.1.smithi192.stdout:9/347: truncate d5/f7 589294 0 2024-09-21T12:20:22.315 INFO:tasks.workunit.client.1.smithi192.stdout:1/460: write d2/d12/d2f/d51/d24/d65/d5a/f75 [1257748,88790] 0 2024-09-21T12:20:22.316 INFO:tasks.workunit.client.1.smithi192.stdout:9/348: chown d5/d8/d36/d55/l6a 8 1 2024-09-21T12:20:22.316 INFO:tasks.workunit.client.1.smithi192.stdout:8/461: rename d14/f2a to d14/d1a/f96 0 2024-09-21T12:20:22.317 INFO:tasks.workunit.client.1.smithi192.stdout:1/461: write d2/d12/d2f/d51/f20 [5680797,114078] 0 2024-09-21T12:20:22.318 INFO:tasks.workunit.client.1.smithi192.stdout:9/349: write d5/d21/f31 [236453,23429] 0 2024-09-21T12:20:22.319 INFO:tasks.workunit.client.1.smithi192.stdout:4/351: creat d2/db/d3e/d57/f72 x:0 0 0 2024-09-21T12:20:22.321 INFO:tasks.workunit.client.1.smithi192.stdout:0/381: write d3/d5/f9 [782162,68756] 0 2024-09-21T12:20:22.323 INFO:tasks.workunit.client.1.smithi192.stdout:4/352: rmdir d2/d19/d4b 39 2024-09-21T12:20:22.325 INFO:tasks.workunit.client.1.smithi192.stdout:9/350: read d5/d8/d2c/f4b [418567,9549] 0 2024-09-21T12:20:22.325 INFO:tasks.workunit.client.1.smithi192.stdout:4/353: readlink d2/d21/l67 0 2024-09-21T12:20:22.326 INFO:tasks.workunit.client.1.smithi192.stdout:5/559: getdents d0/d2 0 2024-09-21T12:20:22.326 INFO:tasks.workunit.client.1.smithi192.stdout:6/342: dwrite da/d1f/d27/d3e/f62 [0,4194304] 0 2024-09-21T12:20:22.328 INFO:tasks.workunit.client.1.smithi192.stdout:4/354: fdatasync d2/db/d3e/d41/f5f 0 2024-09-21T12:20:22.329 INFO:tasks.workunit.client.1.smithi192.stdout:0/382: symlink d3/d6/l6c 0 2024-09-21T12:20:22.330 INFO:tasks.workunit.client.1.smithi192.stdout:2/432: dwrite d1b/f1d [0,4194304] 0 2024-09-21T12:20:22.332 INFO:tasks.workunit.client.1.smithi192.stdout:2/433: stat d1b/d38/d7d 0 2024-09-21T12:20:22.333 INFO:tasks.workunit.client.1.smithi192.stdout:0/383: readlink d3/d5/d28/d39/d50/l53 0 2024-09-21T12:20:22.334 INFO:tasks.workunit.client.1.smithi192.stdout:0/384: fdatasync d3/f6a 0 2024-09-21T12:20:22.335 INFO:tasks.workunit.client.1.smithi192.stdout:6/343: dread da/d1f/f3c [0,4194304] 0 2024-09-21T12:20:22.337 INFO:tasks.workunit.client.1.smithi192.stdout:6/344: chown da/f35 577122 1 2024-09-21T12:20:22.337 INFO:tasks.workunit.client.1.smithi192.stdout:4/355: symlink d2/db/d3e/d57/d28/d68/l73 0 2024-09-21T12:20:22.338 INFO:tasks.workunit.client.1.smithi192.stdout:9/351: truncate d5/d21/f4c 1817058 0 2024-09-21T12:20:22.340 INFO:tasks.workunit.client.1.smithi192.stdout:0/385: write d3/d5/d19/d51/f34 [1144975,110268] 0 2024-09-21T12:20:22.340 INFO:tasks.workunit.client.1.smithi192.stdout:4/356: chown d2/f5 0 1 2024-09-21T12:20:22.340 INFO:tasks.workunit.client.1.smithi192.stdout:5/560: dwrite d0/d65/d6e/f34 [0,4194304] 0 2024-09-21T12:20:22.343 INFO:tasks.workunit.client.1.smithi192.stdout:6/345: unlink da/d1f/d27/d3e/f62 0 2024-09-21T12:20:22.343 INFO:tasks.workunit.client.1.smithi192.stdout:0/386: write d3/d6/f68 [679946,21760] 0 2024-09-21T12:20:22.345 INFO:tasks.workunit.client.1.smithi192.stdout:6/346: dread - da/d1f/d48/f5e zero size 2024-09-21T12:20:22.345 INFO:tasks.workunit.client.1.smithi192.stdout:2/434: dwrite d1b/f3e [0,4194304] 0 2024-09-21T12:20:22.346 INFO:tasks.workunit.client.1.smithi192.stdout:6/347: fsync da/d1f/d27/d3e/f4a 0 2024-09-21T12:20:22.351 INFO:tasks.workunit.client.1.smithi192.stdout:5/561: write d0/d65/d6e/dc0/d44/d85/fa6 [2700356,53678] 0 2024-09-21T12:20:22.354 INFO:tasks.workunit.client.1.smithi192.stdout:4/357: rename d2/d21/f3f to d2/db/d34/d56/d6c/f74 0 2024-09-21T12:20:22.355 INFO:tasks.workunit.client.1.smithi192.stdout:6/348: write da/f20 [916421,86173] 0 2024-09-21T12:20:22.356 INFO:tasks.workunit.client.1.smithi192.stdout:4/358: stat d2/db/d34/d56/d6c 0 2024-09-21T12:20:22.356 INFO:tasks.workunit.client.1.smithi192.stdout:2/435: creat d1b/f87 x:0 0 0 2024-09-21T12:20:22.360 INFO:tasks.workunit.client.1.smithi192.stdout:2/436: mkdir d1b/d1e/d5e/d88 0 2024-09-21T12:20:22.365 INFO:tasks.workunit.client.1.smithi192.stdout:6/349: write da/d1f/f4c [122076,66134] 0 2024-09-21T12:20:22.367 INFO:tasks.workunit.client.1.smithi192.stdout:5/562: truncate d0/d65/d6e/dc0/d44/d85/d97/d45/f2c 2489339 0 2024-09-21T12:20:22.367 INFO:tasks.workunit.client.1.smithi192.stdout:2/437: dread d1b/d1e/f47 [0,4194304] 0 2024-09-21T12:20:22.368 INFO:tasks.workunit.client.1.smithi192.stdout:6/350: creat da/d23/d37/f70 x:0 0 0 2024-09-21T12:20:22.368 INFO:tasks.workunit.client.1.smithi192.stdout:4/359: truncate d2/f5 920993 0 2024-09-21T12:20:22.368 INFO:tasks.workunit.client.1.smithi192.stdout:5/563: readlink d0/dc/d13/d37/l9b 0 2024-09-21T12:20:22.369 INFO:tasks.workunit.client.1.smithi192.stdout:5/564: dread - d0/d2/d7b/fab zero size 2024-09-21T12:20:22.369 INFO:tasks.workunit.client.1.smithi192.stdout:6/351: creat da/d1f/d27/f71 x:0 0 0 2024-09-21T12:20:22.371 INFO:tasks.workunit.client.1.smithi192.stdout:6/352: symlink da/l72 0 2024-09-21T12:20:22.372 INFO:tasks.workunit.client.1.smithi192.stdout:2/438: truncate d1b/d1e/f2f 2269358 0 2024-09-21T12:20:22.374 INFO:tasks.workunit.client.1.smithi192.stdout:5/565: creat d0/d65/d6e/da7/fc3 x:0 0 0 2024-09-21T12:20:22.377 INFO:tasks.workunit.client.1.smithi192.stdout:6/353: mkdir da/d1f/d56/d73 0 2024-09-21T12:20:22.381 INFO:tasks.workunit.client.1.smithi192.stdout:4/360: dwrite d2/df/f29 [0,4194304] 0 2024-09-21T12:20:22.385 INFO:tasks.workunit.client.1.smithi192.stdout:4/361: unlink d2/db/f15 0 2024-09-21T12:20:22.386 INFO:tasks.workunit.client.1.smithi192.stdout:4/362: stat d2/db/l18 0 2024-09-21T12:20:22.388 INFO:tasks.workunit.client.1.smithi192.stdout:6/354: dwrite da/d23/f26 [0,4194304] 0 2024-09-21T12:20:22.389 INFO:tasks.workunit.client.1.smithi192.stdout:6/355: dread - da/d1f/d48/f53 zero size 2024-09-21T12:20:22.392 INFO:tasks.workunit.client.1.smithi192.stdout:6/356: symlink da/d23/l74 0 2024-09-21T12:20:22.394 INFO:tasks.workunit.client.1.smithi192.stdout:6/357: write da/d1f/d56/f5d [197680,91293] 0 2024-09-21T12:20:22.397 INFO:tasks.workunit.client.1.smithi192.stdout:6/358: mkdir da/d23/d37/d75 0 2024-09-21T12:20:22.399 INFO:tasks.workunit.client.1.smithi192.stdout:6/359: creat da/d23/d37/d75/f76 x:0 0 0 2024-09-21T12:20:22.401 INFO:tasks.workunit.client.1.smithi192.stdout:6/360: mknod da/d23/d37/c77 0 2024-09-21T12:20:22.403 INFO:tasks.workunit.client.1.smithi192.stdout:6/361: mkdir da/d1f/d56/d78 0 2024-09-21T12:20:22.404 INFO:tasks.workunit.client.1.smithi192.stdout:6/362: write da/d1f/f3c [955397,47540] 0 2024-09-21T12:20:22.406 INFO:tasks.workunit.client.1.smithi192.stdout:6/363: mknod da/d23/d37/d75/c79 0 2024-09-21T12:20:22.406 INFO:tasks.workunit.client.1.smithi192.stdout:6/364: stat da/ce 0 2024-09-21T12:20:22.407 INFO:tasks.workunit.client.1.smithi192.stdout:6/365: mknod da/d23/c7a 0 2024-09-21T12:20:22.408 INFO:tasks.workunit.client.1.smithi192.stdout:6/366: write da/d23/d37/f33 [2396939,43210] 0 2024-09-21T12:20:22.409 INFO:tasks.workunit.client.1.smithi192.stdout:3/340: sync 2024-09-21T12:20:22.409 INFO:tasks.workunit.client.1.smithi192.stdout:7/424: sync 2024-09-21T12:20:22.410 INFO:tasks.workunit.client.1.smithi192.stdout:3/341: fsync db/d16/d18/f3e 0 2024-09-21T12:20:22.410 INFO:tasks.workunit.client.1.smithi192.stdout:7/425: fsync d6/d9/d1f/f72 0 2024-09-21T12:20:22.410 INFO:tasks.workunit.client.1.smithi192.stdout:6/367: mknod da/d1f/d27/d3e/c7b 0 2024-09-21T12:20:22.411 INFO:tasks.workunit.client.1.smithi192.stdout:7/426: rmdir d6/d3a/d63 39 2024-09-21T12:20:22.419 INFO:tasks.workunit.client.1.smithi192.stdout:4/363: dread d2/db/d1a/f2b [0,4194304] 0 2024-09-21T12:20:22.421 INFO:tasks.workunit.client.1.smithi192.stdout:3/342: dwrite db/d16/d18/d33/d3b/f3f [0,4194304] 0 2024-09-21T12:20:22.421 INFO:tasks.workunit.client.1.smithi192.stdout:6/368: dread da/d23/f26 [0,4194304] 0 2024-09-21T12:20:22.421 INFO:tasks.workunit.client.1.smithi192.stdout:7/427: rename d6/d9/l6b to d6/d9/d1f/l9b 0 2024-09-21T12:20:22.421 INFO:tasks.workunit.client.1.smithi192.stdout:4/364: rmdir d2/db/d1a 39 2024-09-21T12:20:22.425 INFO:tasks.workunit.client.1.smithi192.stdout:4/365: symlink d2/db/d3e/d57/l75 0 2024-09-21T12:20:22.426 INFO:tasks.workunit.client.1.smithi192.stdout:4/366: chown d2/db/d3e/d41 16353 1 2024-09-21T12:20:22.426 INFO:tasks.workunit.client.1.smithi192.stdout:7/428: unlink d6/d3a/d63/f6f 0 2024-09-21T12:20:22.427 INFO:tasks.workunit.client.1.smithi192.stdout:3/343: dwrite db/f3c [0,4194304] 0 2024-09-21T12:20:22.466 INFO:tasks.workunit.client.1.smithi192.stdout:7/429: symlink d6/d20/d69/l9c 0 2024-09-21T12:20:22.467 INFO:tasks.workunit.client.1.smithi192.stdout:4/367: mknod d2/db/d34/d56/c76 0 2024-09-21T12:20:22.467 INFO:tasks.workunit.client.1.smithi192.stdout:6/369: truncate da/d23/f34 2871768 0 2024-09-21T12:20:22.469 INFO:tasks.workunit.client.1.smithi192.stdout:3/344: mknod db/d16/d18/d33/d3b/c7d 0 2024-09-21T12:20:22.469 INFO:tasks.workunit.client.1.smithi192.stdout:6/370: write da/d23/d37/f39 [2922617,114803] 0 2024-09-21T12:20:22.469 INFO:tasks.workunit.client.1.smithi192.stdout:4/368: fdatasync d2/db/d3e/d41/f5e 0 2024-09-21T12:20:22.472 INFO:tasks.workunit.client.1.smithi192.stdout:4/369: chown d2/d36/f3c 395 1 2024-09-21T12:20:22.474 INFO:tasks.workunit.client.1.smithi192.stdout:3/345: rename db/d16/f2c to db/d16/d18/d40/f7e 0 2024-09-21T12:20:22.474 INFO:tasks.workunit.client.1.smithi192.stdout:7/430: dwrite d6/d9/f5b [0,4194304] 0 2024-09-21T12:20:22.478 INFO:tasks.workunit.client.1.smithi192.stdout:3/346: read db/d16/d18/f36 [2156497,130503] 0 2024-09-21T12:20:22.481 INFO:tasks.workunit.client.1.smithi192.stdout:6/371: dwrite da/d23/d37/f5f [0,4194304] 0 2024-09-21T12:20:22.483 INFO:tasks.workunit.client.1.smithi192.stdout:3/347: fsync db/d16/d18/d33/d4a/f5f 0 2024-09-21T12:20:22.485 INFO:tasks.workunit.client.1.smithi192.stdout:7/431: dwrite d6/d9/d1f/f37 [0,4194304] 0 2024-09-21T12:20:22.488 INFO:tasks.workunit.client.1.smithi192.stdout:3/348: rename db/f13 to db/d16/d18/d21/d23/d71/d77/f7f 0 2024-09-21T12:20:22.488 INFO:tasks.workunit.client.1.smithi192.stdout:4/370: link d2/db/d1a/f2b d2/db/d3e/d41/f77 0 2024-09-21T12:20:22.490 INFO:tasks.workunit.client.1.smithi192.stdout:7/432: rename d6/d9/d2d/l83 to d6/d9/d51/l9d 0 2024-09-21T12:20:22.491 INFO:tasks.workunit.client.1.smithi192.stdout:4/371: readlink d2/db/l1d 0 2024-09-21T12:20:22.495 INFO:tasks.workunit.client.1.smithi192.stdout:3/349: creat db/d16/d18/d21/d23/d71/d77/f80 x:0 0 0 2024-09-21T12:20:22.498 INFO:tasks.workunit.client.1.smithi192.stdout:4/372: dwrite d2/d21/f2e [4194304,4194304] 0 2024-09-21T12:20:22.498 INFO:tasks.workunit.client.1.smithi192.stdout:3/350: symlink db/d16/d18/d40/l81 0 2024-09-21T12:20:22.503 INFO:tasks.workunit.client.1.smithi192.stdout:3/351: rename db/ld to db/d16/d18/d21/d23/d71/l82 0 2024-09-21T12:20:22.503 INFO:tasks.workunit.client.1.smithi192.stdout:4/373: creat d2/db/d3e/d57/d28/d68/f78 x:0 0 0 2024-09-21T12:20:22.506 INFO:tasks.workunit.client.1.smithi192.stdout:4/374: truncate d2/db/f6d 394529 0 2024-09-21T12:20:22.509 INFO:tasks.workunit.client.1.smithi192.stdout:6/372: dread da/d1f/d56/f5d [0,4194304] 0 2024-09-21T12:20:22.509 INFO:tasks.workunit.client.1.smithi192.stdout:6/373: write da/f6a [740826,54098] 0 2024-09-21T12:20:22.510 INFO:tasks.workunit.client.1.smithi192.stdout:7/433: truncate d6/d9/f5b 927022 0 2024-09-21T12:20:22.513 INFO:tasks.workunit.client.1.smithi192.stdout:3/352: rename db/d16/d18/d21/d23/d71/d77/f80 to db/d16/d18/d33/f83 0 2024-09-21T12:20:22.514 INFO:tasks.workunit.client.1.smithi192.stdout:6/374: creat da/d1f/d56/d78/f7c x:0 0 0 2024-09-21T12:20:22.514 INFO:tasks.workunit.client.1.smithi192.stdout:6/375: stat da/d23/d37/f5f 0 2024-09-21T12:20:22.516 INFO:tasks.workunit.client.1.smithi192.stdout:3/353: write db/d16/d18/d21/d23/d71/d77/f7f [1276331,46350] 0 2024-09-21T12:20:22.517 INFO:tasks.workunit.client.1.smithi192.stdout:7/434: getdents d6/d3a 0 2024-09-21T12:20:22.518 INFO:tasks.workunit.client.1.smithi192.stdout:7/435: fsync d6/d3a/f88 0 2024-09-21T12:20:22.523 INFO:tasks.workunit.client.1.smithi192.stdout:4/375: dwrite d2/db/d3e/d41/f77 [0,4194304] 0 2024-09-21T12:20:22.525 INFO:tasks.workunit.client.1.smithi192.stdout:6/376: truncate da/d23/d37/f5f 91583 0 2024-09-21T12:20:22.528 INFO:tasks.workunit.client.1.smithi192.stdout:4/376: write d2/db/d3e/d41/f5f [360534,105587] 0 2024-09-21T12:20:22.530 INFO:tasks.workunit.client.1.smithi192.stdout:3/354: dwrite db/d16/d18/d40/f7e [4194304,4194304] 0 2024-09-21T12:20:22.530 INFO:tasks.workunit.client.1.smithi192.stdout:6/377: write da/d23/d37/f39 [4670121,76308] 0 2024-09-21T12:20:22.532 INFO:tasks.workunit.client.1.smithi192.stdout:7/436: dwrite d6/d9/d70/d77/f91 [0,4194304] 0 2024-09-21T12:20:22.533 INFO:tasks.workunit.client.1.smithi192.stdout:3/355: fsync db/d16/d61/d2e/f72 0 2024-09-21T12:20:22.533 INFO:tasks.workunit.client.1.smithi192.stdout:4/377: creat d2/df/d52/f79 x:0 0 0 2024-09-21T12:20:22.535 INFO:tasks.workunit.client.1.smithi192.stdout:6/378: mkdir da/d1f/d48/d7d 0 2024-09-21T12:20:22.535 INFO:tasks.workunit.client.1.smithi192.stdout:7/437: write d6/f38 [432419,21542] 0 2024-09-21T12:20:22.538 INFO:tasks.workunit.client.1.smithi192.stdout:6/379: symlink da/d1f/d56/l7e 0 2024-09-21T12:20:22.538 INFO:tasks.workunit.client.1.smithi192.stdout:6/380: chown f8 0 1 2024-09-21T12:20:22.539 INFO:tasks.workunit.client.1.smithi192.stdout:4/378: dread d2/db/d3e/d41/f77 [0,4194304] 0 2024-09-21T12:20:22.539 INFO:tasks.workunit.client.1.smithi192.stdout:3/356: creat db/d16/d61/f84 x:0 0 0 2024-09-21T12:20:22.539 INFO:tasks.workunit.client.1.smithi192.stdout:6/381: chown da/d23/d37/d75/f76 198 1 2024-09-21T12:20:22.544 INFO:tasks.workunit.client.1.smithi192.stdout:7/438: creat d6/d9/d2d/d7b/f9e x:0 0 0 2024-09-21T12:20:22.545 INFO:tasks.workunit.client.1.smithi192.stdout:4/379: creat d2/d21/f7a x:0 0 0 2024-09-21T12:20:22.550 INFO:tasks.workunit.client.1.smithi192.stdout:3/357: rename db/d16/d18/d21/d23/c47 to db/d16/d18/d33/d3b/c85 0 2024-09-21T12:20:22.551 INFO:tasks.workunit.client.1.smithi192.stdout:4/380: symlink d2/db/l7b 0 2024-09-21T12:20:22.552 INFO:tasks.workunit.client.1.smithi192.stdout:4/381: write d2/f66 [621809,60053] 0 2024-09-21T12:20:22.552 INFO:tasks.workunit.client.1.smithi192.stdout:6/382: link da/d23/d37/f39 da/d1f/d27/d6b/f7f 0 2024-09-21T12:20:22.557 INFO:tasks.workunit.client.1.smithi192.stdout:3/358: dwrite db/d16/d18/d21/d23/f50 [0,4194304] 0 2024-09-21T12:20:22.561 INFO:tasks.workunit.client.1.smithi192.stdout:4/382: dwrite d2/db/d1a/f46 [0,4194304] 0 2024-09-21T12:20:22.562 INFO:tasks.workunit.client.1.smithi192.stdout:6/383: dwrite da/d23/d37/d75/f76 [0,4194304] 0 2024-09-21T12:20:22.562 INFO:tasks.workunit.client.1.smithi192.stdout:4/383: readlink d2/df/l11 0 2024-09-21T12:20:22.567 INFO:tasks.workunit.client.1.smithi192.stdout:3/359: creat db/d16/d18/d33/d3b/d68/f86 x:0 0 0 2024-09-21T12:20:22.571 INFO:tasks.workunit.client.1.smithi192.stdout:4/384: write d2/d19/d4b/f64 [230779,60501] 0 2024-09-21T12:20:22.573 INFO:tasks.workunit.client.1.smithi192.stdout:3/360: creat db/d16/d18/d40/d60/f87 x:0 0 0 2024-09-21T12:20:22.574 INFO:tasks.workunit.client.1.smithi192.stdout:7/439: dwrite d6/d9/d1f/d3e/f60 [0,4194304] 0 2024-09-21T12:20:22.578 INFO:tasks.workunit.client.1.smithi192.stdout:7/440: symlink d6/d9/d2d/d68/l9f 0 2024-09-21T12:20:22.580 INFO:tasks.workunit.client.1.smithi192.stdout:4/385: link d2/db/d1a/f46 d2/d36/f7c 0 2024-09-21T12:20:22.582 INFO:tasks.workunit.client.1.smithi192.stdout:7/441: creat d6/d9/d1f/d3e/fa0 x:0 0 0 2024-09-21T12:20:22.582 INFO:tasks.workunit.client.1.smithi192.stdout:3/361: dwrite db/f22 [0,4194304] 0 2024-09-21T12:20:22.582 INFO:tasks.workunit.client.1.smithi192.stdout:4/386: chown d2/db/d3e/d41/f77 9 1 2024-09-21T12:20:22.586 INFO:tasks.workunit.client.1.smithi192.stdout:4/387: mknod d2/db/d34/d56/c7d 0 2024-09-21T12:20:22.590 INFO:tasks.workunit.client.1.smithi192.stdout:4/388: unlink d2/db/c22 0 2024-09-21T12:20:22.591 INFO:tasks.workunit.client.1.smithi192.stdout:7/442: dwrite d6/d9/d2d/d7b/f97 [0,4194304] 0 2024-09-21T12:20:22.593 INFO:tasks.workunit.client.1.smithi192.stdout:4/389: mkdir d2/d19/d7e 0 2024-09-21T12:20:22.595 INFO:tasks.workunit.client.1.smithi192.stdout:7/443: creat d6/d9/d2d/d7b/fa1 x:0 0 0 2024-09-21T12:20:22.597 INFO:tasks.workunit.client.1.smithi192.stdout:4/390: rename d2/db/d3e/d57/d28 to d2/d36/d7f 0 2024-09-21T12:20:22.602 INFO:tasks.workunit.client.1.smithi192.stdout:4/391: creat d2/d19/f80 x:0 0 0 2024-09-21T12:20:22.605 INFO:tasks.workunit.client.1.smithi192.stdout:4/392: truncate d2/d21/f38 2114678 0 2024-09-21T12:20:22.607 INFO:tasks.workunit.client.1.smithi192.stdout:4/393: symlink d2/db/d34/d56/d6c/l81 0 2024-09-21T12:20:22.608 INFO:tasks.workunit.client.1.smithi192.stdout:4/394: mkdir d2/db/d3e/d57/d32/d4f/d82 0 2024-09-21T12:20:22.609 INFO:tasks.workunit.client.1.smithi192.stdout:4/395: write d2/d36/d55/f60 [104551,83568] 0 2024-09-21T12:20:22.612 INFO:tasks.workunit.client.1.smithi192.stdout:4/396: unlink d2/db/d1a/f2b 0 2024-09-21T12:20:22.680 INFO:tasks.workunit.client.1.smithi192.stdout:8/462: sync 2024-09-21T12:20:22.683 INFO:tasks.workunit.client.1.smithi192.stdout:8/463: dread - d14/d1a/d1d/d48/f6f zero size 2024-09-21T12:20:22.684 INFO:tasks.workunit.client.1.smithi192.stdout:8/464: readlink d14/d1a/d1d/d46/d4e/l55 0 2024-09-21T12:20:22.687 INFO:tasks.workunit.client.1.smithi192.stdout:8/465: mknod d14/d1a/d1d/c97 0 2024-09-21T12:20:22.688 INFO:tasks.workunit.client.1.smithi192.stdout:4/397: dwrite d2/db/d3e/d41/f69 [0,4194304] 0 2024-09-21T12:20:22.729 INFO:tasks.workunit.client.1.smithi192.stdout:9/352: sync 2024-09-21T12:20:22.730 INFO:tasks.workunit.client.1.smithi192.stdout:0/387: sync 2024-09-21T12:20:22.730 INFO:tasks.workunit.client.1.smithi192.stdout:2/439: sync 2024-09-21T12:20:22.730 INFO:tasks.workunit.client.1.smithi192.stdout:1/462: sync 2024-09-21T12:20:22.730 INFO:tasks.workunit.client.1.smithi192.stdout:5/566: sync 2024-09-21T12:20:22.731 INFO:tasks.workunit.client.1.smithi192.stdout:8/466: write d14/d1a/d1d/d46/d4e/d83/f87 [823284,15805] 0 2024-09-21T12:20:22.731 INFO:tasks.workunit.client.1.smithi192.stdout:9/353: stat d5/d19 0 2024-09-21T12:20:22.736 INFO:tasks.workunit.client.1.smithi192.stdout:4/398: mkdir d2/db/d34/d56/d83 0 2024-09-21T12:20:22.737 INFO:tasks.workunit.client.1.smithi192.stdout:9/354: read d5/dc/d40/f25 [6568983,73082] 0 2024-09-21T12:20:22.737 INFO:tasks.workunit.client.1.smithi192.stdout:0/388: mknod d3/d5/d28/d39/c6d 0 2024-09-21T12:20:22.738 INFO:tasks.workunit.client.1.smithi192.stdout:9/355: chown d5/d8/f22 2 1 2024-09-21T12:20:22.738 INFO:tasks.workunit.client.1.smithi192.stdout:1/463: rename d2/d12/d2f/d41/l55 to d2/d12/d2f/d51/d24/d65/l96 0 2024-09-21T12:20:22.740 INFO:tasks.workunit.client.1.smithi192.stdout:8/467: unlink d14/d1a/d1d/d46/d4e/f63 0 2024-09-21T12:20:22.743 INFO:tasks.workunit.client.1.smithi192.stdout:0/389: dwrite d3/d5/f9 [0,4194304] 0 2024-09-21T12:20:22.745 INFO:tasks.workunit.client.1.smithi192.stdout:1/464: dwrite d2/da/f60 [4194304,4194304] 0 2024-09-21T12:20:22.751 INFO:tasks.workunit.client.1.smithi192.stdout:0/390: dwrite d3/d5/d28/d39/f41 [0,4194304] 0 2024-09-21T12:20:22.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:22 smithi192 ceph-mon[35641]: pgmap v261: 65 pgs: 65 active+clean; 606 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 6.4 MiB/s rd, 55 MiB/s wr, 336 op/s 2024-09-21T12:20:22.778 INFO:tasks.workunit.client.1.smithi192.stdout:5/567: rename d0/d65/d6e/dc0/d44/fa4 to d0/d65/d6e/dc0/fc4 0 2024-09-21T12:20:22.782 INFO:tasks.workunit.client.1.smithi192.stdout:1/465: chown d2/da/c30 1678 1 2024-09-21T12:20:22.783 INFO:tasks.workunit.client.1.smithi192.stdout:0/391: creat d3/de/d33/f6e x:0 0 0 2024-09-21T12:20:22.793 INFO:tasks.workunit.client.1.smithi192.stdout:8/468: symlink d14/d18/d88/l98 0 2024-09-21T12:20:22.793 INFO:tasks.workunit.client.1.smithi192.stdout:8/469: chown l9 16004161 1 2024-09-21T12:20:22.796 INFO:tasks.workunit.client.1.smithi192.stdout:6/384: sync 2024-09-21T12:20:22.796 INFO:tasks.workunit.client.1.smithi192.stdout:2/440: getdents d1b 0 2024-09-21T12:20:22.798 INFO:tasks.workunit.client.1.smithi192.stdout:0/392: unlink d3/d6/d1d/l2d 0 2024-09-21T12:20:22.801 INFO:tasks.workunit.client.1.smithi192.stdout:5/568: mkdir d0/dc/d13/d37/da8/daa/dc5 0 2024-09-21T12:20:22.803 INFO:tasks.workunit.client.1.smithi192.stdout:1/466: symlink d2/d12/d2f/d51/d24/d65/d8b/l97 0 2024-09-21T12:20:22.803 INFO:tasks.workunit.client.1.smithi192.stdout:4/399: dwrite d2/db/d3e/d41/f70 [0,4194304] 0 2024-09-21T12:20:22.805 INFO:tasks.workunit.client.1.smithi192.stdout:8/470: mkdir d14/d1a/d1d/d46/d4e/d83/d8d/d99 0 2024-09-21T12:20:22.806 INFO:tasks.workunit.client.1.smithi192.stdout:6/385: mknod da/d1f/c80 0 2024-09-21T12:20:22.807 INFO:tasks.workunit.client.1.smithi192.stdout:2/441: symlink d1b/d1e/d5e/d75/l89 0 2024-09-21T12:20:22.808 INFO:tasks.workunit.client.1.smithi192.stdout:2/442: readlink d1b/d1e/l2e 0 2024-09-21T12:20:22.808 INFO:tasks.workunit.client.1.smithi192.stdout:6/386: write da/d1f/d27/f71 [980204,116119] 0 2024-09-21T12:20:22.809 INFO:tasks.workunit.client.1.smithi192.stdout:6/387: chown da/d1f/d27 56 1 2024-09-21T12:20:22.810 INFO:tasks.workunit.client.1.smithi192.stdout:5/569: symlink d0/d65/d8e/db9/lc6 0 2024-09-21T12:20:22.818 INFO:tasks.workunit.client.1.smithi192.stdout:5/570: mknod d0/d65/d8e/d98/cc7 0 2024-09-21T12:20:22.819 INFO:tasks.workunit.client.1.smithi192.stdout:5/571: chown d0/d65/d6e/dc0/d44/d85/f94 500 1 2024-09-21T12:20:22.820 INFO:tasks.workunit.client.1.smithi192.stdout:5/572: write d0/f7c [325730,50237] 0 2024-09-21T12:20:22.822 INFO:tasks.workunit.client.1.smithi192.stdout:5/573: truncate d0/d65/d6e/dc0/d44/d85/f93 359651 0 2024-09-21T12:20:22.822 INFO:tasks.workunit.client.1.smithi192.stdout:8/471: mkdir d14/d1a/d1d/d51/d80/d9a 0 2024-09-21T12:20:22.826 INFO:tasks.workunit.client.1.smithi192.stdout:8/472: symlink d14/d1a/d1d/d20/d5f/d8a/l9b 0 2024-09-21T12:20:22.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:22 smithi003 ceph-mon[28057]: pgmap v261: 65 pgs: 65 active+clean; 606 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 6.4 MiB/s rd, 55 MiB/s wr, 336 op/s 2024-09-21T12:20:22.837 INFO:tasks.workunit.client.1.smithi192.stdout:8/473: dread d14/d1a/d1d/d39/f3e [0,4194304] 0 2024-09-21T12:20:22.839 INFO:tasks.workunit.client.1.smithi192.stdout:5/574: dread d0/dc/d13/d37/f56 [0,4194304] 0 2024-09-21T12:20:22.839 INFO:tasks.workunit.client.1.smithi192.stdout:8/474: fsync d14/d1a/d1d/d20/d5f/f68 0 2024-09-21T12:20:22.839 INFO:tasks.workunit.client.1.smithi192.stdout:5/575: dread - d0/dc/d13/d37/f71 zero size 2024-09-21T12:20:22.840 INFO:tasks.workunit.client.1.smithi192.stdout:5/576: dread - d0/d65/d6e/dc0/d44/d85/f94 zero size 2024-09-21T12:20:22.846 INFO:tasks.workunit.client.1.smithi192.stdout:5/577: mkdir d0/d65/d6e/dbc/dc8 0 2024-09-21T12:20:22.848 INFO:tasks.workunit.client.1.smithi192.stdout:5/578: chown d0/d65/d6e/fb3 4888 1 2024-09-21T12:20:22.854 INFO:tasks.workunit.client.1.smithi192.stdout:5/579: rename d0/d65/d6e/dc0/d44/d85/d97/l30 to d0/d65/d6e/lc9 0 2024-09-21T12:20:22.854 INFO:tasks.workunit.client.1.smithi192.stdout:5/580: stat d0/dc/d13/d37/d38 0 2024-09-21T12:20:22.860 INFO:tasks.workunit.client.1.smithi192.stdout:9/356: truncate d5/d8/d2c/f58 1760542 0 2024-09-21T12:20:22.862 INFO:tasks.workunit.client.1.smithi192.stdout:3/362: sync 2024-09-21T12:20:22.862 INFO:tasks.workunit.client.1.smithi192.stdout:7/444: sync 2024-09-21T12:20:22.864 INFO:tasks.workunit.client.1.smithi192.stdout:3/363: truncate db/d16/d61/d2e/f56 786966 0 2024-09-21T12:20:22.866 INFO:tasks.workunit.client.1.smithi192.stdout:7/445: fsync d6/d9/f5b 0 2024-09-21T12:20:22.866 INFO:tasks.workunit.client.1.smithi192.stdout:3/364: readlink db/d16/d18/d21/d23/l6c 0 2024-09-21T12:20:22.866 INFO:tasks.workunit.client.1.smithi192.stdout:9/357: dwrite d5/d8/f22 [0,4194304] 0 2024-09-21T12:20:22.866 INFO:tasks.workunit.client.1.smithi192.stdout:9/358: chown d5/f2f 8 1 2024-09-21T12:20:22.870 INFO:tasks.workunit.client.1.smithi192.stdout:9/359: write d5/d19/f6b [3609640,19618] 0 2024-09-21T12:20:22.871 INFO:tasks.workunit.client.1.smithi192.stdout:7/446: mkdir d6/d9/d1f/d3e/d7a/d8a/da2 0 2024-09-21T12:20:22.873 INFO:tasks.workunit.client.1.smithi192.stdout:9/360: mkdir d5/d8/d36/d3f/d4d/d6d 0 2024-09-21T12:20:22.879 INFO:tasks.workunit.client.1.smithi192.stdout:9/361: dwrite d5/d8/f15 [4194304,4194304] 0 2024-09-21T12:20:22.879 INFO:tasks.workunit.client.1.smithi192.stdout:0/393: truncate d3/de/d33/f35 329832 0 2024-09-21T12:20:22.880 INFO:tasks.workunit.client.1.smithi192.stdout:0/394: fdatasync d3/d5/d28/f64 0 2024-09-21T12:20:22.881 INFO:tasks.workunit.client.1.smithi192.stdout:2/443: write d1b/d38/f49 [260044,69450] 0 2024-09-21T12:20:22.881 INFO:tasks.workunit.client.1.smithi192.stdout:7/447: getdents d6/d3a/d63 0 2024-09-21T12:20:22.889 INFO:tasks.workunit.client.1.smithi192.stdout:2/444: creat d1b/d1e/d7b/f8a x:0 0 0 2024-09-21T12:20:22.890 INFO:tasks.workunit.client.1.smithi192.stdout:4/400: creat d2/f84 x:0 0 0 2024-09-21T12:20:22.891 INFO:tasks.workunit.client.1.smithi192.stdout:9/362: mkdir d5/d21/d66/d53/d6e 0 2024-09-21T12:20:22.894 INFO:tasks.workunit.client.1.smithi192.stdout:2/445: dread fd [0,4194304] 0 2024-09-21T12:20:22.894 INFO:tasks.workunit.client.1.smithi192.stdout:1/467: unlink d2/c3 0 2024-09-21T12:20:22.897 INFO:tasks.workunit.client.1.smithi192.stdout:1/468: dread d2/da/f27 [0,4194304] 0 2024-09-21T12:20:22.907 INFO:tasks.workunit.client.1.smithi192.stdout:4/401: rmdir d2/d36 39 2024-09-21T12:20:22.909 INFO:tasks.workunit.client.1.smithi192.stdout:9/363: mkdir d5/dc/d6f 0 2024-09-21T12:20:22.910 INFO:tasks.workunit.client.1.smithi192.stdout:9/364: dread - d5/d8/d36/d3f/d4d/f47 zero size 2024-09-21T12:20:22.911 INFO:tasks.workunit.client.1.smithi192.stdout:9/365: readlink d5/dc/l27 0 2024-09-21T12:20:22.912 INFO:tasks.workunit.client.1.smithi192.stdout:8/475: dwrite d14/d18/f28 [0,4194304] 0 2024-09-21T12:20:22.915 INFO:tasks.workunit.client.1.smithi192.stdout:1/469: dread d2/d12/d2f/d51/d24/f35 [0,4194304] 0 2024-09-21T12:20:22.917 INFO:tasks.workunit.client.1.smithi192.stdout:9/366: dread d5/d8/f2d [0,4194304] 0 2024-09-21T12:20:22.917 INFO:tasks.workunit.client.1.smithi192.stdout:1/470: fdatasync d2/d12/d2f/d51/d24/d65/d5a/f75 0 2024-09-21T12:20:22.919 INFO:tasks.workunit.client.1.smithi192.stdout:6/388: mknod da/c81 0 2024-09-21T12:20:22.920 INFO:tasks.workunit.client.1.smithi192.stdout:8/476: mkdir d14/d1a/d1d/d46/d4e/d83/d8d/d9c 0 2024-09-21T12:20:22.923 INFO:tasks.workunit.client.1.smithi192.stdout:0/395: unlink d3/d5/f9 0 2024-09-21T12:20:22.924 INFO:tasks.workunit.client.1.smithi192.stdout:4/402: mknod d2/d36/d7f/c85 0 2024-09-21T12:20:22.928 INFO:tasks.workunit.client.1.smithi192.stdout:9/367: mkdir d5/d8/d36/d55/d70 0 2024-09-21T12:20:22.929 INFO:tasks.workunit.client.1.smithi192.stdout:0/396: dwrite d3/de/d33/f6e [0,4194304] 0 2024-09-21T12:20:22.932 INFO:tasks.workunit.client.1.smithi192.stdout:1/471: mknod d2/da/d6b/d7d/c98 0 2024-09-21T12:20:22.934 INFO:tasks.workunit.client.1.smithi192.stdout:6/389: mknod da/d1f/d48/c82 0 2024-09-21T12:20:22.936 INFO:tasks.workunit.client.1.smithi192.stdout:8/477: mknod d14/d1a/c9d 0 2024-09-21T12:20:22.939 INFO:tasks.workunit.client.1.smithi192.stdout:5/581: mknod d0/d65/d6e/dc0/d44/d85/d97/cca 0 2024-09-21T12:20:22.942 INFO:tasks.workunit.client.1.smithi192.stdout:4/403: dread d2/db/d3e/d41/f70 [0,4194304] 0 2024-09-21T12:20:22.942 INFO:tasks.workunit.client.1.smithi192.stdout:4/404: stat d2/f66 0 2024-09-21T12:20:22.947 INFO:tasks.workunit.client.1.smithi192.stdout:9/368: dread d5/dc/f18 [0,4194304] 0 2024-09-21T12:20:22.947 INFO:tasks.workunit.client.1.smithi192.stdout:1/472: mkdir d2/d12/d2f/d41/d5c/d99 0 2024-09-21T12:20:22.948 INFO:tasks.workunit.client.1.smithi192.stdout:1/473: fdatasync d2/de/f19 0 2024-09-21T12:20:22.949 INFO:tasks.workunit.client.1.smithi192.stdout:1/474: write d2/d12/d2f/d51/d24/f4c [4232723,72676] 0 2024-09-21T12:20:22.949 INFO:tasks.workunit.client.1.smithi192.stdout:7/448: truncate d6/d9/d51/f4b 2374575 0 2024-09-21T12:20:22.950 INFO:tasks.workunit.client.1.smithi192.stdout:1/475: readlink d2/d12/l3a 0 2024-09-21T12:20:22.950 INFO:tasks.workunit.client.1.smithi192.stdout:6/390: creat da/d1f/d56/f83 x:0 0 0 2024-09-21T12:20:22.950 INFO:tasks.workunit.client.1.smithi192.stdout:7/449: write f0 [4334014,122142] 0 2024-09-21T12:20:22.952 INFO:tasks.workunit.client.1.smithi192.stdout:8/478: symlink d14/d1a/d1d/d46/d7e/l9e 0 2024-09-21T12:20:22.954 INFO:tasks.workunit.client.1.smithi192.stdout:8/479: dread - d14/d1a/d1d/d48/f6f zero size 2024-09-21T12:20:22.956 INFO:tasks.workunit.client.1.smithi192.stdout:5/582: creat d0/d65/d6e/dc0/fcb x:0 0 0 2024-09-21T12:20:22.957 INFO:tasks.workunit.client.1.smithi192.stdout:8/480: write d14/d1a/f31 [3144809,47703] 0 2024-09-21T12:20:22.959 INFO:tasks.workunit.client.1.smithi192.stdout:6/391: dread da/d1f/f45 [0,4194304] 0 2024-09-21T12:20:22.959 INFO:tasks.workunit.client.1.smithi192.stdout:1/476: dwrite d2/da/d6b/d7d/f90 [0,4194304] 0 2024-09-21T12:20:22.961 INFO:tasks.workunit.client.1.smithi192.stdout:1/477: write d2/d12/f63 [3317741,84992] 0 2024-09-21T12:20:22.962 INFO:tasks.workunit.client.1.smithi192.stdout:0/397: mknod d3/de/c6f 0 2024-09-21T12:20:22.962 INFO:tasks.workunit.client.1.smithi192.stdout:2/446: truncate d1b/f4c 240311 0 2024-09-21T12:20:22.966 INFO:tasks.workunit.client.1.smithi192.stdout:9/369: fdatasync d5/dc/f18 0 2024-09-21T12:20:22.966 INFO:tasks.workunit.client.1.smithi192.stdout:2/447: dread - d1b/d38/d53/f6d zero size 2024-09-21T12:20:22.970 INFO:tasks.workunit.client.1.smithi192.stdout:6/392: dwrite da/d23/f52 [0,4194304] 0 2024-09-21T12:20:22.971 INFO:tasks.workunit.client.1.smithi192.stdout:2/448: truncate d1b/d1e/d62/f86 808894 0 2024-09-21T12:20:22.975 INFO:tasks.workunit.client.1.smithi192.stdout:7/450: write d6/d9/d1f/f21 [3743442,69736] 0 2024-09-21T12:20:22.975 INFO:tasks.workunit.client.1.smithi192.stdout:0/398: dwrite d3/de/d43/f66 [0,4194304] 0 2024-09-21T12:20:22.975 INFO:tasks.workunit.client.1.smithi192.stdout:0/399: read - d3/f6a zero size 2024-09-21T12:20:22.976 INFO:tasks.workunit.client.1.smithi192.stdout:7/451: chown d6/d9/d2d/d68/l9f 25522253 1 2024-09-21T12:20:22.981 INFO:tasks.workunit.client.1.smithi192.stdout:5/583: read d0/d65/f67 [121681,66012] 0 2024-09-21T12:20:22.981 INFO:tasks.workunit.client.1.smithi192.stdout:4/405: fdatasync d2/d21/f38 0 2024-09-21T12:20:22.983 INFO:tasks.workunit.client.1.smithi192.stdout:3/365: sync 2024-09-21T12:20:22.985 INFO:tasks.workunit.client.1.smithi192.stdout:8/481: unlink d14/d1a/f95 0 2024-09-21T12:20:22.989 INFO:tasks.workunit.client.1.smithi192.stdout:3/366: dwrite db/d16/d61/d2e/f56 [0,4194304] 0 2024-09-21T12:20:22.991 INFO:tasks.workunit.client.1.smithi192.stdout:3/367: dread - db/d16/d61/f79 zero size 2024-09-21T12:20:22.996 INFO:tasks.workunit.client.1.smithi192.stdout:9/370: rename d5/d8/d2c/c3e to d5/d8/d36/d3f/c71 0 2024-09-21T12:20:22.997 INFO:tasks.workunit.client.1.smithi192.stdout:9/371: dread - d5/d19/f3c zero size 2024-09-21T12:20:22.998 INFO:tasks.workunit.client.1.smithi192.stdout:2/449: chown d1b/d1e/c78 14 1 2024-09-21T12:20:23.002 INFO:tasks.workunit.client.1.smithi192.stdout:8/482: dread d14/d1a/f31 [0,4194304] 0 2024-09-21T12:20:23.006 INFO:tasks.workunit.client.1.smithi192.stdout:7/452: creat d6/d9/d2d/d68/fa3 x:0 0 0 2024-09-21T12:20:23.011 INFO:tasks.workunit.client.1.smithi192.stdout:5/584: mknod d0/d2/ccc 0 2024-09-21T12:20:23.017 INFO:tasks.workunit.client.1.smithi192.stdout:4/406: creat d2/db/d34/f86 x:0 0 0 2024-09-21T12:20:23.025 INFO:tasks.workunit.client.1.smithi192.stdout:1/478: creat d2/d82/f9a x:0 0 0 2024-09-21T12:20:23.026 INFO:tasks.workunit.client.1.smithi192.stdout:1/479: write d2/d12/d2f/d51/d24/f26 [1113637,69926] 0 2024-09-21T12:20:23.028 INFO:tasks.workunit.client.1.smithi192.stdout:1/480: read d2/d12/d2f/f4a [2064581,111647] 0 2024-09-21T12:20:23.029 INFO:tasks.workunit.client.1.smithi192.stdout:2/450: mkdir d1b/d38/d53/d8b 0 2024-09-21T12:20:23.029 INFO:tasks.workunit.client.1.smithi192.stdout:1/481: fsync d2/d12/d2f/d51/f37 0 2024-09-21T12:20:23.030 INFO:tasks.workunit.client.1.smithi192.stdout:1/482: chown d2/da/f27 810413480 1 2024-09-21T12:20:23.030 INFO:tasks.workunit.client.1.smithi192.stdout:6/393: symlink da/d1f/d56/d73/l84 0 2024-09-21T12:20:23.031 INFO:tasks.workunit.client.1.smithi192.stdout:6/394: chown da/d23/d37/f70 156 1 2024-09-21T12:20:23.032 INFO:tasks.workunit.client.1.smithi192.stdout:8/483: symlink d14/d1a/d1d/d20/l9f 0 2024-09-21T12:20:23.034 INFO:tasks.workunit.client.1.smithi192.stdout:8/484: write d14/d1a/d1d/d46/d4e/f5b [37408,59172] 0 2024-09-21T12:20:23.036 INFO:tasks.workunit.client.1.smithi192.stdout:1/483: dwrite d2/de/f48 [4194304,4194304] 0 2024-09-21T12:20:23.038 INFO:tasks.workunit.client.1.smithi192.stdout:7/453: creat d6/d20/fa4 x:0 0 0 2024-09-21T12:20:23.043 INFO:tasks.workunit.client.1.smithi192.stdout:1/484: dwrite d2/d12/d2f/d41/d5c/f83 [0,4194304] 0 2024-09-21T12:20:23.043 INFO:tasks.workunit.client.1.smithi192.stdout:1/485: chown d2/da/f27 89253 1 2024-09-21T12:20:23.046 INFO:tasks.workunit.client.1.smithi192.stdout:3/368: mkdir db/d16/d18/d33/d88 0 2024-09-21T12:20:23.050 INFO:tasks.workunit.client.1.smithi192.stdout:1/486: dwrite d2/d12/d2f/d41/d61/f66 [0,4194304] 0 2024-09-21T12:20:23.051 INFO:tasks.workunit.client.1.smithi192.stdout:1/487: write d2/d12/d2f/d51/f20 [5374349,47862] 0 2024-09-21T12:20:23.053 INFO:tasks.workunit.client.1.smithi192.stdout:9/372: truncate d5/dc/f18 3647474 0 2024-09-21T12:20:23.057 INFO:tasks.workunit.client.1.smithi192.stdout:2/451: creat d1b/d1e/d5e/d75/f8c x:0 0 0 2024-09-21T12:20:23.064 INFO:tasks.workunit.client.1.smithi192.stdout:8/485: rename d14/d1a/c9d to d14/d18/d88/ca0 0 2024-09-21T12:20:23.065 INFO:tasks.workunit.client.1.smithi192.stdout:5/585: symlink d0/d65/d6e/dbc/dc8/lcd 0 2024-09-21T12:20:23.066 INFO:tasks.workunit.client.1.smithi192.stdout:4/407: dread d2/d19/f25 [0,4194304] 0 2024-09-21T12:20:23.067 INFO:tasks.workunit.client.1.smithi192.stdout:5/586: write d0/d65/d8e/db9/fbe [162760,71763] 0 2024-09-21T12:20:23.076 INFO:tasks.workunit.client.1.smithi192.stdout:9/373: mknod d5/d19/d32/c72 0 2024-09-21T12:20:23.076 INFO:tasks.workunit.client.1.smithi192.stdout:0/400: truncate d3/de/d33/f6e 1594812 0 2024-09-21T12:20:23.089 INFO:tasks.workunit.client.1.smithi192.stdout:9/374: read d5/dc/f18 [3533642,70701] 0 2024-09-21T12:20:23.094 INFO:tasks.workunit.client.1.smithi192.stdout:5/587: rename d0/dc/f22 to d0/d65/d6e/fce 0 2024-09-21T12:20:23.095 INFO:tasks.workunit.client.1.smithi192.stdout:3/369: getdents db/d16 0 2024-09-21T12:20:23.095 INFO:tasks.workunit.client.1.smithi192.stdout:5/588: stat d0/d2/c20 0 2024-09-21T12:20:23.096 INFO:tasks.workunit.client.1.smithi192.stdout:3/370: fsync db/d16/d61/f5e 0 2024-09-21T12:20:23.097 INFO:tasks.workunit.client.1.smithi192.stdout:9/375: truncate d5/d8/d2c/f58 260427 0 2024-09-21T12:20:23.098 INFO:tasks.workunit.client.1.smithi192.stdout:3/371: write db/d16/d18/d40/f7e [2385299,22375] 0 2024-09-21T12:20:23.098 INFO:tasks.workunit.client.1.smithi192.stdout:3/372: stat db/d16/d18/c44 0 2024-09-21T12:20:23.104 INFO:tasks.workunit.client.1.smithi192.stdout:3/373: dwrite db/f1e [8388608,4194304] 0 2024-09-21T12:20:23.104 INFO:tasks.workunit.client.1.smithi192.stdout:4/408: dread d2/df/f5d [0,4194304] 0 2024-09-21T12:20:23.104 INFO:tasks.workunit.client.1.smithi192.stdout:9/376: mknod d5/d8/c73 0 2024-09-21T12:20:23.105 INFO:tasks.workunit.client.1.smithi192.stdout:9/377: write d5/d21/f31 [4679178,95379] 0 2024-09-21T12:20:23.108 INFO:tasks.workunit.client.1.smithi192.stdout:4/409: mknod d2/db/d3e/d57/d32/d4f/d71/c87 0 2024-09-21T12:20:23.110 INFO:tasks.workunit.client.1.smithi192.stdout:3/374: rename db/d16/d18/d21/d23/d71/d77/l6f to db/d16/d18/d33/d88/l89 0 2024-09-21T12:20:23.112 INFO:tasks.workunit.client.1.smithi192.stdout:6/395: write da/d23/d37/f5f [971703,6541] 0 2024-09-21T12:20:23.114 INFO:tasks.workunit.client.1.smithi192.stdout:6/396: dread - da/d1f/d48/f53 zero size 2024-09-21T12:20:23.114 INFO:tasks.workunit.client.1.smithi192.stdout:4/410: mkdir d2/df/d52/d88 0 2024-09-21T12:20:23.114 INFO:tasks.workunit.client.1.smithi192.stdout:8/486: write d14/d1a/d1d/d39/f8b [144335,35404] 0 2024-09-21T12:20:23.116 INFO:tasks.workunit.client.1.smithi192.stdout:9/378: creat d5/d8/d36/d3f/d4d/d6d/f74 x:0 0 0 2024-09-21T12:20:23.116 INFO:tasks.workunit.client.1.smithi192.stdout:7/454: truncate d6/d3a/f46 1747630 0 2024-09-21T12:20:23.116 INFO:tasks.workunit.client.1.smithi192.stdout:6/397: readlink da/d1f/d48/l65 0 2024-09-21T12:20:23.117 INFO:tasks.workunit.client.1.smithi192.stdout:2/452: dwrite f14 [0,4194304] 0 2024-09-21T12:20:23.118 INFO:tasks.workunit.client.1.smithi192.stdout:9/379: dread - d5/d8/d36/d3f/d4d/d6d/f74 zero size 2024-09-21T12:20:23.119 INFO:tasks.workunit.client.1.smithi192.stdout:3/375: unlink db/d16/d18/l27 0 2024-09-21T12:20:23.120 INFO:tasks.workunit.client.1.smithi192.stdout:4/411: fsync d2/d19/f2d 0 2024-09-21T12:20:23.122 INFO:tasks.workunit.client.1.smithi192.stdout:9/380: write d5/dc/f68 [1005342,81700] 0 2024-09-21T12:20:23.124 INFO:tasks.workunit.client.1.smithi192.stdout:8/487: symlink d14/d1a/d1d/d46/d7e/la1 0 2024-09-21T12:20:23.125 INFO:tasks.workunit.client.1.smithi192.stdout:6/398: creat da/d1f/d27/d6b/f85 x:0 0 0 2024-09-21T12:20:23.126 INFO:tasks.workunit.client.1.smithi192.stdout:9/381: write d5/dc/f68 [1892855,60496] 0 2024-09-21T12:20:23.127 INFO:tasks.workunit.client.1.smithi192.stdout:8/488: stat d14/d1a/d1d/d20/f44 0 2024-09-21T12:20:23.130 INFO:tasks.workunit.client.1.smithi192.stdout:7/455: creat d6/d9/d1f/d3e/d7a/d8a/da2/fa5 x:0 0 0 2024-09-21T12:20:23.130 INFO:tasks.workunit.client.1.smithi192.stdout:1/488: dwrite d2/da/f31 [0,4194304] 0 2024-09-21T12:20:23.133 INFO:tasks.workunit.client.1.smithi192.stdout:1/489: chown d2/d12/d2f/c43 31 1 2024-09-21T12:20:23.133 INFO:tasks.workunit.client.1.smithi192.stdout:5/589: dwrite d0/dc/d13/d37/f56 [0,4194304] 0 2024-09-21T12:20:23.134 INFO:tasks.workunit.client.1.smithi192.stdout:6/399: rename da/d1f/d56/f5d to da/d1f/f86 0 2024-09-21T12:20:23.138 INFO:tasks.workunit.client.1.smithi192.stdout:7/456: unlink d6/d3a/c87 0 2024-09-21T12:20:23.138 INFO:tasks.workunit.client.1.smithi192.stdout:7/457: stat d6/d9/d70/d77/f9a 0 2024-09-21T12:20:23.138 INFO:tasks.workunit.client.1.smithi192.stdout:8/489: fsync d14/d18/f32 0 2024-09-21T12:20:23.140 INFO:tasks.workunit.client.1.smithi192.stdout:0/401: truncate d3/de/d33/f6e 1563730 0 2024-09-21T12:20:23.142 INFO:tasks.workunit.client.1.smithi192.stdout:9/382: creat d5/d8/d11/d5a/f75 x:0 0 0 2024-09-21T12:20:23.142 INFO:tasks.workunit.client.1.smithi192.stdout:3/376: dread db/d16/d18/f3e [0,4194304] 0 2024-09-21T12:20:23.143 INFO:tasks.workunit.client.1.smithi192.stdout:3/377: dread - db/d16/d18/d40/f6e zero size 2024-09-21T12:20:23.144 INFO:tasks.workunit.client.1.smithi192.stdout:3/378: fsync db/d16/d18/d33/d3b/d68/f86 0 2024-09-21T12:20:23.145 INFO:tasks.workunit.client.1.smithi192.stdout:1/490: symlink d2/da/d6b/d7d/l9b 0 2024-09-21T12:20:23.148 INFO:tasks.workunit.client.1.smithi192.stdout:4/412: getdents d2/db/d3e/d57/d32/d4f 0 2024-09-21T12:20:23.148 INFO:tasks.workunit.client.1.smithi192.stdout:4/413: fdatasync d2/d19/d4b/f5a 0 2024-09-21T12:20:23.149 INFO:tasks.workunit.client.1.smithi192.stdout:6/400: mknod da/d1f/d27/d3e/c87 0 2024-09-21T12:20:23.150 INFO:tasks.workunit.client.1.smithi192.stdout:4/414: chown d2/df/d52/f79 16306629 1 2024-09-21T12:20:23.152 INFO:tasks.workunit.client.1.smithi192.stdout:6/401: chown da/d1f/f54 5469 1 2024-09-21T12:20:23.153 INFO:tasks.workunit.client.1.smithi192.stdout:6/402: write da/f57 [583842,95542] 0 2024-09-21T12:20:23.153 INFO:tasks.workunit.client.1.smithi192.stdout:8/490: dread f11 [0,4194304] 0 2024-09-21T12:20:23.156 INFO:tasks.workunit.client.1.smithi192.stdout:4/415: readlink d2/d21/l2f 0 2024-09-21T12:20:23.158 INFO:tasks.workunit.client.1.smithi192.stdout:8/491: fdatasync d14/d1a/d1d/f58 0 2024-09-21T12:20:23.158 INFO:tasks.workunit.client.1.smithi192.stdout:6/403: read da/d23/f26 [1985591,85886] 0 2024-09-21T12:20:23.159 INFO:tasks.workunit.client.1.smithi192.stdout:3/379: creat db/d16/d18/d40/d60/f8a x:0 0 0 2024-09-21T12:20:23.160 INFO:tasks.workunit.client.1.smithi192.stdout:1/491: creat d2/d45/f9c x:0 0 0 2024-09-21T12:20:23.160 INFO:tasks.workunit.client.1.smithi192.stdout:2/453: dwrite d1b/d1e/f2f [0,4194304] 0 2024-09-21T12:20:23.160 INFO:tasks.workunit.client.1.smithi192.stdout:5/590: rename d0/d65/d6e/dc0/d44/d85/d97/d9e/f9f to d0/d65/d8e/d77/fcf 0 2024-09-21T12:20:23.161 INFO:tasks.workunit.client.1.smithi192.stdout:4/416: readlink d2/db/d3e/d57/d32/d4f/l51 0 2024-09-21T12:20:23.168 INFO:tasks.workunit.client.1.smithi192.stdout:9/383: creat d5/dc/f76 x:0 0 0 2024-09-21T12:20:23.171 INFO:tasks.workunit.client.1.smithi192.stdout:0/402: write d3/d5/d19/d51/f32 [846598,20038] 0 2024-09-21T12:20:23.171 INFO:tasks.workunit.client.1.smithi192.stdout:7/458: link d6/d9/d51/l9d d6/d3a/la6 0 2024-09-21T12:20:23.173 INFO:tasks.workunit.client.1.smithi192.stdout:8/492: dread d14/d1a/d1d/d46/f90 [0,4194304] 0 2024-09-21T12:20:23.174 INFO:tasks.workunit.client.1.smithi192.stdout:1/492: mkdir d2/d12/d2f/d51/d24/d65/d8e/d9d 0 2024-09-21T12:20:23.174 INFO:tasks.workunit.client.1.smithi192.stdout:8/493: truncate d14/f85 921732 0 2024-09-21T12:20:23.175 INFO:tasks.workunit.client.1.smithi192.stdout:9/384: rename d5/d8/l39 to d5/d19/d32/l77 0 2024-09-21T12:20:23.177 INFO:tasks.workunit.client.1.smithi192.stdout:9/385: dread - d5/d19/f3c zero size 2024-09-21T12:20:23.177 INFO:tasks.workunit.client.1.smithi192.stdout:7/459: fsync f3 0 2024-09-21T12:20:23.181 INFO:tasks.workunit.client.1.smithi192.stdout:0/403: symlink d3/d5/d19/l70 0 2024-09-21T12:20:23.182 INFO:tasks.workunit.client.1.smithi192.stdout:0/404: fsync d3/de/f60 0 2024-09-21T12:20:23.183 INFO:tasks.workunit.client.1.smithi192.stdout:8/494: rename d14/d1a/d1d/d46/f90 to d14/d1a/d1d/d51/fa2 0 2024-09-21T12:20:23.183 INFO:tasks.workunit.client.1.smithi192.stdout:6/404: dread f8 [0,4194304] 0 2024-09-21T12:20:23.185 INFO:tasks.workunit.client.1.smithi192.stdout:1/493: dwrite d2/d12/d2f/d41/d5c/f83 [0,4194304] 0 2024-09-21T12:20:23.185 INFO:tasks.workunit.client.1.smithi192.stdout:9/386: rmdir d5/d19/d32 39 2024-09-21T12:20:23.188 INFO:tasks.workunit.client.1.smithi192.stdout:4/417: getdents d2/d21 0 2024-09-21T12:20:23.189 INFO:tasks.workunit.client.1.smithi192.stdout:9/387: readlink d5/d19/l24 0 2024-09-21T12:20:23.189 INFO:tasks.workunit.client.1.smithi192.stdout:7/460: mkdir d6/d20/d69/d90/da7 0 2024-09-21T12:20:23.190 INFO:tasks.workunit.client.1.smithi192.stdout:8/495: read d14/d1a/d1d/d39/f71 [867049,55063] 0 2024-09-21T12:20:23.190 INFO:tasks.workunit.client.1.smithi192.stdout:6/405: mkdir da/d1f/d27/d88 0 2024-09-21T12:20:23.192 INFO:tasks.workunit.client.1.smithi192.stdout:5/591: write d0/d65/d6e/dc0/d44/d85/d97/d45/f2c [1173228,100690] 0 2024-09-21T12:20:23.194 INFO:tasks.workunit.client.1.smithi192.stdout:1/494: creat d2/d82/f9e x:0 0 0 2024-09-21T12:20:23.195 INFO:tasks.workunit.client.1.smithi192.stdout:2/454: dread d1b/d1e/d62/f6c [0,4194304] 0 2024-09-21T12:20:23.197 INFO:tasks.workunit.client.1.smithi192.stdout:7/461: fsync d6/d3a/d63/f65 0 2024-09-21T12:20:23.197 INFO:tasks.workunit.client.1.smithi192.stdout:4/418: mkdir d2/d36/d55/d89 0 2024-09-21T12:20:23.197 INFO:tasks.workunit.client.1.smithi192.stdout:0/405: truncate d3/de/d43/f54 369440 0 2024-09-21T12:20:23.200 INFO:tasks.workunit.client.1.smithi192.stdout:9/388: mkdir d5/d8/d36/d3f/d4d/d78 0 2024-09-21T12:20:23.201 INFO:tasks.workunit.client.1.smithi192.stdout:0/406: rmdir d3/d5 39 2024-09-21T12:20:23.201 INFO:tasks.workunit.client.1.smithi192.stdout:8/496: write d14/d1a/d1d/f49 [2749169,113045] 0 2024-09-21T12:20:23.201 INFO:tasks.workunit.client.1.smithi192.stdout:2/455: mkdir d1b/d1e/d5e/d75/d8d 0 2024-09-21T12:20:23.203 INFO:tasks.workunit.client.1.smithi192.stdout:7/462: creat d6/d3a/fa8 x:0 0 0 2024-09-21T12:20:23.203 INFO:tasks.workunit.client.1.smithi192.stdout:4/419: symlink d2/d19/d4b/l8a 0 2024-09-21T12:20:23.204 INFO:tasks.workunit.client.1.smithi192.stdout:5/592: creat d0/d65/d6e/d91/fd0 x:0 0 0 2024-09-21T12:20:23.204 INFO:tasks.workunit.client.1.smithi192.stdout:6/406: dread da/f20 [0,4194304] 0 2024-09-21T12:20:23.210 INFO:tasks.workunit.client.1.smithi192.stdout:1/495: dwrite d2/d82/f9a [0,4194304] 0 2024-09-21T12:20:23.211 INFO:tasks.workunit.client.1.smithi192.stdout:9/389: dread d5/f7 [0,4194304] 0 2024-09-21T12:20:23.213 INFO:tasks.workunit.client.1.smithi192.stdout:8/497: creat d14/d1a/d1d/d20/d5f/fa3 x:0 0 0 2024-09-21T12:20:23.214 INFO:tasks.workunit.client.1.smithi192.stdout:6/407: write da/f35 [1342765,25002] 0 2024-09-21T12:20:23.214 INFO:tasks.workunit.client.1.smithi192.stdout:7/463: fdatasync d6/f52 0 2024-09-21T12:20:23.214 INFO:tasks.workunit.client.1.smithi192.stdout:9/390: readlink d5/d8/d36/d55/l6a 0 2024-09-21T12:20:23.217 INFO:tasks.workunit.client.1.smithi192.stdout:6/408: truncate da/d1f/d27/f6f 642034 0 2024-09-21T12:20:23.218 INFO:tasks.workunit.client.1.smithi192.stdout:2/456: dwrite d1b/d38/f49 [0,4194304] 0 2024-09-21T12:20:23.218 INFO:tasks.workunit.client.1.smithi192.stdout:9/391: chown d5/dc/d40/l41 183354 1 2024-09-21T12:20:23.221 INFO:tasks.workunit.client.1.smithi192.stdout:0/407: write d3/d5/d28/f56 [143639,35536] 0 2024-09-21T12:20:23.223 INFO:tasks.workunit.client.1.smithi192.stdout:1/496: rename d2/d12/d2f/d51/d24/d5e to d2/da/d9f 0 2024-09-21T12:20:23.223 INFO:tasks.workunit.client.1.smithi192.stdout:5/593: dwrite d0/d65/d6e/dc0/d44/d85/d97/d45/f2c [0,4194304] 0 2024-09-21T12:20:23.227 INFO:tasks.workunit.client.1.smithi192.stdout:6/409: rename da/c81 to da/d1f/c89 0 2024-09-21T12:20:23.227 INFO:tasks.workunit.client.1.smithi192.stdout:5/594: dread - d0/d65/d6e/dc0/fcb zero size 2024-09-21T12:20:23.229 INFO:tasks.workunit.client.1.smithi192.stdout:1/497: rmdir d2/da/d6b 39 2024-09-21T12:20:23.230 INFO:tasks.workunit.client.1.smithi192.stdout:7/464: dwrite d6/d9/d51/f24 [0,4194304] 0 2024-09-21T12:20:23.230 INFO:tasks.workunit.client.1.smithi192.stdout:2/457: creat d1b/d38/d7d/f8e x:0 0 0 2024-09-21T12:20:23.231 INFO:tasks.workunit.client.1.smithi192.stdout:6/410: mknod da/d1f/d56/d78/c8a 0 2024-09-21T12:20:23.232 INFO:tasks.workunit.client.1.smithi192.stdout:5/595: symlink d0/d65/ld1 0 2024-09-21T12:20:23.234 INFO:tasks.workunit.client.1.smithi192.stdout:6/411: write da/d1f/d27/d3e/f67 [1084893,88838] 0 2024-09-21T12:20:23.235 INFO:tasks.workunit.client.1.smithi192.stdout:4/420: truncate d2/d36/d7f/f63 2971328 0 2024-09-21T12:20:23.237 INFO:tasks.workunit.client.1.smithi192.stdout:0/408: dwrite d3/d6/f68 [0,4194304] 0 2024-09-21T12:20:23.240 INFO:tasks.workunit.client.1.smithi192.stdout:5/596: rmdir d0/dc/d13 39 2024-09-21T12:20:23.241 INFO:tasks.workunit.client.1.smithi192.stdout:1/498: mknod d2/da/d6b/d7d/ca0 0 2024-09-21T12:20:23.244 INFO:tasks.workunit.client.1.smithi192.stdout:5/597: dread - d0/d65/d6e/dc0/fc4 zero size 2024-09-21T12:20:23.247 INFO:tasks.workunit.client.1.smithi192.stdout:6/412: link da/d1f/d48/c4f da/d1f/d56/c8b 0 2024-09-21T12:20:23.248 INFO:tasks.workunit.client.1.smithi192.stdout:4/421: dwrite d2/db/d3e/f43 [0,4194304] 0 2024-09-21T12:20:23.250 INFO:tasks.workunit.client.1.smithi192.stdout:5/598: truncate d0/f7c 1200275 0 2024-09-21T12:20:23.250 INFO:tasks.workunit.client.1.smithi192.stdout:8/498: dread d14/d1a/d1d/f2b [0,4194304] 0 2024-09-21T12:20:23.254 INFO:tasks.workunit.client.1.smithi192.stdout:5/599: write d0/d65/d6e/da7/da0/fae [1782489,41949] 0 2024-09-21T12:20:23.255 INFO:tasks.workunit.client.1.smithi192.stdout:4/422: symlink d2/db/d3e/d57/d32/d4f/l8b 0 2024-09-21T12:20:23.255 INFO:tasks.workunit.client.1.smithi192.stdout:9/392: dwrite d5/f3b [0,4194304] 0 2024-09-21T12:20:23.256 INFO:tasks.workunit.client.1.smithi192.stdout:6/413: read da/d1f/d27/d6b/f7f [2551508,48401] 0 2024-09-21T12:20:23.257 INFO:tasks.workunit.client.1.smithi192.stdout:9/393: readlink l1 0 2024-09-21T12:20:23.260 INFO:tasks.workunit.client.1.smithi192.stdout:8/499: dread d14/d1a/d1d/d46/d4e/d83/f87 [0,4194304] 0 2024-09-21T12:20:23.261 INFO:tasks.workunit.client.1.smithi192.stdout:6/414: unlink da/c1d 0 2024-09-21T12:20:23.264 INFO:tasks.workunit.client.1.smithi192.stdout:9/394: rename d5/d8/d36 to d5/d8/d11/d44/d79 0 2024-09-21T12:20:23.266 INFO:tasks.workunit.client.1.smithi192.stdout:8/500: dread d14/d1a/d1d/d39/f3e [0,4194304] 0 2024-09-21T12:20:23.267 INFO:tasks.workunit.client.1.smithi192.stdout:6/415: creat da/d1f/d27/d6b/f8c x:0 0 0 2024-09-21T12:20:23.268 INFO:tasks.workunit.client.1.smithi192.stdout:5/600: creat d0/d65/d6e/dc0/d44/d85/d97/fd2 x:0 0 0 2024-09-21T12:20:23.268 INFO:tasks.workunit.client.1.smithi192.stdout:9/395: rmdir d5/d8/d11/d44 39 2024-09-21T12:20:23.269 INFO:tasks.workunit.client.1.smithi192.stdout:8/501: mkdir d14/d18/d94/da4 0 2024-09-21T12:20:23.271 INFO:tasks.workunit.client.1.smithi192.stdout:5/601: chown d0/d65/d6e/f32 1 1 2024-09-21T12:20:23.271 INFO:tasks.workunit.client.1.smithi192.stdout:7/465: dread d6/d3a/f3f [0,4194304] 0 2024-09-21T12:20:23.273 INFO:tasks.workunit.client.1.smithi192.stdout:5/602: symlink d0/d65/d8e/ld3 0 2024-09-21T12:20:23.276 INFO:tasks.workunit.client.1.smithi192.stdout:5/603: creat d0/d65/d8e/d98/fd4 x:0 0 0 2024-09-21T12:20:23.279 INFO:tasks.workunit.client.1.smithi192.stdout:8/502: dwrite d14/d1a/d1d/d46/d4e/f76 [0,4194304] 0 2024-09-21T12:20:23.282 INFO:tasks.workunit.client.1.smithi192.stdout:5/604: mkdir d0/d65/d6e/dc0/d44/d85/d97/d9e/dd5 0 2024-09-21T12:20:23.283 INFO:tasks.workunit.client.1.smithi192.stdout:0/409: dread d3/d6/f3f [4194304,4194304] 0 2024-09-21T12:20:23.284 INFO:tasks.workunit.client.1.smithi192.stdout:5/605: chown d0/d65/d6e/da7 695822 1 2024-09-21T12:20:23.286 INFO:tasks.workunit.client.1.smithi192.stdout:9/396: dwrite d5/d8/f2d [0,4194304] 0 2024-09-21T12:20:23.286 INFO:tasks.workunit.client.1.smithi192.stdout:5/606: stat d0/dc/f6f 0 2024-09-21T12:20:23.286 INFO:tasks.workunit.client.1.smithi192.stdout:4/423: dread d2/db/f26 [0,4194304] 0 2024-09-21T12:20:23.288 INFO:tasks.workunit.client.1.smithi192.stdout:0/410: symlink d3/d5/d28/d39/d50/l71 0 2024-09-21T12:20:23.291 INFO:tasks.workunit.client.1.smithi192.stdout:4/424: creat d2/df/d52/f8c x:0 0 0 2024-09-21T12:20:23.292 INFO:tasks.workunit.client.1.smithi192.stdout:8/503: dwrite f8 [0,4194304] 0 2024-09-21T12:20:23.292 INFO:tasks.workunit.client.1.smithi192.stdout:9/397: symlink d5/d8/l7a 0 2024-09-21T12:20:23.297 INFO:tasks.workunit.client.1.smithi192.stdout:0/411: mkdir d3/d6/d72 0 2024-09-21T12:20:23.298 INFO:tasks.workunit.client.1.smithi192.stdout:5/607: dread d0/dc/d13/d37/f5d [0,4194304] 0 2024-09-21T12:20:23.299 INFO:tasks.workunit.client.1.smithi192.stdout:6/416: dread da/d1f/d27/d6b/f7f [0,4194304] 0 2024-09-21T12:20:23.299 INFO:tasks.workunit.client.1.smithi192.stdout:8/504: dread d14/f85 [0,4194304] 0 2024-09-21T12:20:23.300 INFO:tasks.workunit.client.1.smithi192.stdout:4/425: mknod d2/d36/d7f/d68/c8d 0 2024-09-21T12:20:23.300 INFO:tasks.workunit.client.1.smithi192.stdout:9/398: rmdir d5/d8/d11 39 2024-09-21T12:20:23.302 INFO:tasks.workunit.client.1.smithi192.stdout:6/417: rmdir da/d1f 39 2024-09-21T12:20:23.302 INFO:tasks.workunit.client.1.smithi192.stdout:5/608: write d0/d65/d8e/d77/fcf [422436,48552] 0 2024-09-21T12:20:23.303 INFO:tasks.workunit.client.1.smithi192.stdout:8/505: dread d14/d1a/d1d/d39/f8b [0,4194304] 0 2024-09-21T12:20:23.305 INFO:tasks.workunit.client.1.smithi192.stdout:4/426: unlink d2/c9 0 2024-09-21T12:20:23.307 INFO:tasks.workunit.client.1.smithi192.stdout:8/506: creat d14/d1a/d1d/d46/d4e/fa5 x:0 0 0 2024-09-21T12:20:23.308 INFO:tasks.workunit.client.1.smithi192.stdout:5/609: read d0/d65/d6e/f29 [4253840,44114] 0 2024-09-21T12:20:23.312 INFO:tasks.workunit.client.1.smithi192.stdout:9/399: dwrite d5/d21/d3d/f54 [0,4194304] 0 2024-09-21T12:20:23.312 INFO:tasks.workunit.client.1.smithi192.stdout:8/507: mknod d14/d1a/d1d/d20/d5f/ca6 0 2024-09-21T12:20:23.315 INFO:tasks.workunit.client.1.smithi192.stdout:4/427: dread d2/d21/f38 [0,4194304] 0 2024-09-21T12:20:23.316 INFO:tasks.workunit.client.1.smithi192.stdout:8/508: readlink d14/d1a/d1d/d20/l53 0 2024-09-21T12:20:23.316 INFO:tasks.workunit.client.1.smithi192.stdout:6/418: dwrite da/d1f/f4c [0,4194304] 0 2024-09-21T12:20:23.317 INFO:tasks.workunit.client.1.smithi192.stdout:9/400: symlink d5/d21/d3d/l7b 0 2024-09-21T12:20:23.319 INFO:tasks.workunit.client.1.smithi192.stdout:6/419: dread - da/d1f/d56/d78/f7c zero size 2024-09-21T12:20:23.319 INFO:tasks.workunit.client.1.smithi192.stdout:5/610: symlink d0/dc/d13/d37/da8/daa/dc5/ld6 0 2024-09-21T12:20:23.319 INFO:tasks.workunit.client.1.smithi192.stdout:9/401: write d5/d21/d3d/f54 [3330384,6162] 0 2024-09-21T12:20:23.323 INFO:tasks.workunit.client.1.smithi192.stdout:9/402: mknod d5/d8/d2c/c7c 0 2024-09-21T12:20:23.324 INFO:tasks.workunit.client.1.smithi192.stdout:8/509: symlink d14/d1a/d1d/d46/d7e/d8e/la7 0 2024-09-21T12:20:23.324 INFO:tasks.workunit.client.1.smithi192.stdout:8/510: chown d14/d18/c7d 107310 1 2024-09-21T12:20:23.326 INFO:tasks.workunit.client.1.smithi192.stdout:6/420: rename da/f20 to da/d1f/d27/d88/f8d 0 2024-09-21T12:20:23.326 INFO:tasks.workunit.client.1.smithi192.stdout:5/611: dread d0/d65/d6e/dc0/d44/d85/d97/d45/f5a [0,4194304] 0 2024-09-21T12:20:23.331 INFO:tasks.workunit.client.1.smithi192.stdout:6/421: fdatasync da/d23/f34 0 2024-09-21T12:20:23.333 INFO:tasks.workunit.client.1.smithi192.stdout:8/511: getdents d14/d1a/d1d/d39 0 2024-09-21T12:20:23.335 INFO:tasks.workunit.client.1.smithi192.stdout:6/422: creat da/d23/d37/f8e x:0 0 0 2024-09-21T12:20:23.336 INFO:tasks.workunit.client.1.smithi192.stdout:5/612: dwrite d0/d65/d8e/db9/fbe [0,4194304] 0 2024-09-21T12:20:23.338 INFO:tasks.workunit.client.1.smithi192.stdout:9/403: dwrite d5/d8/d11/f17 [0,4194304] 0 2024-09-21T12:20:23.338 INFO:tasks.workunit.client.1.smithi192.stdout:6/423: symlink da/d1f/d56/l8f 0 2024-09-21T12:20:23.339 INFO:tasks.workunit.client.1.smithi192.stdout:9/404: fsync d5/d8/f22 0 2024-09-21T12:20:23.341 INFO:tasks.workunit.client.1.smithi192.stdout:6/424: mkdir da/d23/d37/d75/d90 0 2024-09-21T12:20:23.343 INFO:tasks.workunit.client.1.smithi192.stdout:6/425: rename da/d23 to da/d23/d91 22 2024-09-21T12:20:23.346 INFO:tasks.workunit.client.1.smithi192.stdout:6/426: mknod da/d1f/d27/d3e/c92 0 2024-09-21T12:20:23.348 INFO:tasks.workunit.client.1.smithi192.stdout:6/427: fsync da/d1f/d27/d3e/f4a 0 2024-09-21T12:20:23.348 INFO:tasks.workunit.client.1.smithi192.stdout:9/405: dread d5/f3b [0,4194304] 0 2024-09-21T12:20:23.349 INFO:tasks.workunit.client.1.smithi192.stdout:6/428: mknod da/d1f/d56/d78/c93 0 2024-09-21T12:20:23.350 INFO:tasks.workunit.client.1.smithi192.stdout:9/406: mknod d5/d8/d2c/c7d 0 2024-09-21T12:20:23.351 INFO:tasks.workunit.client.1.smithi192.stdout:9/407: write d5/dc/f5f [605396,93416] 0 2024-09-21T12:20:23.353 INFO:tasks.workunit.client.1.smithi192.stdout:9/408: symlink d5/d19/d32/l7e 0 2024-09-21T12:20:23.353 INFO:tasks.workunit.client.1.smithi192.stdout:6/429: read da/d23/d37/f33 [2621852,57449] 0 2024-09-21T12:20:23.354 INFO:tasks.workunit.client.1.smithi192.stdout:6/430: chown da/f4b 38869 1 2024-09-21T12:20:23.354 INFO:tasks.workunit.client.1.smithi192.stdout:6/431: dread - da/d1f/d48/f5e zero size 2024-09-21T12:20:23.355 INFO:tasks.workunit.client.1.smithi192.stdout:9/409: creat d5/d19/f7f x:0 0 0 2024-09-21T12:20:23.357 INFO:tasks.workunit.client.1.smithi192.stdout:9/410: getdents d5/dc/d64 0 2024-09-21T12:20:23.362 INFO:tasks.workunit.client.1.smithi192.stdout:6/432: dwrite da/d1f/f86 [0,4194304] 0 2024-09-21T12:20:23.362 INFO:tasks.workunit.client.1.smithi192.stdout:9/411: rename d5/d8/d11 to d5/dc/d80 0 2024-09-21T12:20:23.364 INFO:tasks.workunit.client.1.smithi192.stdout:6/433: creat da/d1f/d27/d3e/f94 x:0 0 0 2024-09-21T12:20:23.368 INFO:tasks.workunit.client.1.smithi192.stdout:5/613: dread d0/f3b [0,4194304] 0 2024-09-21T12:20:23.372 INFO:tasks.workunit.client.1.smithi192.stdout:5/614: creat d0/dc/d13/d37/fd7 x:0 0 0 2024-09-21T12:20:23.372 INFO:tasks.workunit.client.1.smithi192.stdout:6/434: dwrite da/f42 [0,4194304] 0 2024-09-21T12:20:23.374 INFO:tasks.workunit.client.1.smithi192.stdout:6/435: chown da/d1f/d56/d78/c8a 257985 1 2024-09-21T12:20:23.375 INFO:tasks.workunit.client.1.smithi192.stdout:5/615: chown d0/d65/d6e/dc0/d44/d85/d97/d9e/c7a 65943 1 2024-09-21T12:20:23.375 INFO:tasks.workunit.client.1.smithi192.stdout:9/412: dread d5/fa [0,4194304] 0 2024-09-21T12:20:23.375 INFO:tasks.workunit.client.1.smithi192.stdout:5/616: fdatasync d0/d65/d8e/d77/fcf 0 2024-09-21T12:20:23.378 INFO:tasks.workunit.client.1.smithi192.stdout:5/617: rmdir d0/d65/d6e/dc0/d44/d85 39 2024-09-21T12:20:23.380 INFO:tasks.workunit.client.1.smithi192.stdout:6/436: link da/d1f/d48/f5e da/f95 0 2024-09-21T12:20:23.381 INFO:tasks.workunit.client.1.smithi192.stdout:5/618: write d0/d65/d6e/dc0/d44/d85/d97/d45/f2c [1523791,85938] 0 2024-09-21T12:20:23.382 INFO:tasks.workunit.client.1.smithi192.stdout:6/437: creat da/d1f/d48/f96 x:0 0 0 2024-09-21T12:20:23.384 INFO:tasks.workunit.client.1.smithi192.stdout:5/619: symlink d0/d2/ld8 0 2024-09-21T12:20:23.384 INFO:tasks.workunit.client.1.smithi192.stdout:6/438: symlink da/d1f/d56/l97 0 2024-09-21T12:20:23.385 INFO:tasks.workunit.client.1.smithi192.stdout:5/620: truncate d0/dc/d13/d37/f71 697958 0 2024-09-21T12:20:23.387 INFO:tasks.workunit.client.1.smithi192.stdout:5/621: creat d0/d65/d8e/d98/dba/fd9 x:0 0 0 2024-09-21T12:20:23.388 INFO:tasks.workunit.client.1.smithi192.stdout:6/439: link da/l51 da/d23/l98 0 2024-09-21T12:20:23.389 INFO:tasks.workunit.client.1.smithi192.stdout:5/622: truncate d0/d65/d6e/dc0/d44/d85/f94 330927 0 2024-09-21T12:20:23.390 INFO:tasks.workunit.client.1.smithi192.stdout:6/440: write da/d1f/d48/f5e [204697,62221] 0 2024-09-21T12:20:23.391 INFO:tasks.workunit.client.1.smithi192.stdout:5/623: read d0/d65/d6e/f92 [667699,29764] 0 2024-09-21T12:20:23.391 INFO:tasks.workunit.client.1.smithi192.stdout:6/441: write da/d23/d37/f8e [922899,100228] 0 2024-09-21T12:20:23.392 INFO:tasks.workunit.client.1.smithi192.stdout:6/442: chown da/l72 122 1 2024-09-21T12:20:23.401 INFO:tasks.workunit.client.1.smithi192.stdout:9/413: dread d5/d8/f22 [0,4194304] 0 2024-09-21T12:20:23.402 INFO:tasks.workunit.client.1.smithi192.stdout:5/624: write d0/f3b [3858830,116991] 0 2024-09-21T12:20:23.404 INFO:tasks.workunit.client.1.smithi192.stdout:5/625: fdatasync d0/d65/d6e/dc0/fcb 0 2024-09-21T12:20:23.405 INFO:tasks.workunit.client.1.smithi192.stdout:5/626: fsync d0/d65/d6e/dc0/d44/d85/d97/d45/f31 0 2024-09-21T12:20:23.406 INFO:tasks.workunit.client.1.smithi192.stdout:9/414: rename d5/dc/d40/l20 to d5/dc/d80/d44/d79/d3f/d4d/d6d/l81 0 2024-09-21T12:20:23.406 INFO:tasks.workunit.client.1.smithi192.stdout:5/627: chown d0/d65/c8a 426293454 1 2024-09-21T12:20:23.407 INFO:tasks.workunit.client.1.smithi192.stdout:9/415: write d5/d8/f15 [7471413,129941] 0 2024-09-21T12:20:23.408 INFO:tasks.workunit.client.1.smithi192.stdout:9/416: truncate d5/dc/f5f 1244256 0 2024-09-21T12:20:23.410 INFO:tasks.workunit.client.1.smithi192.stdout:5/628: truncate d0/d65/d6e/dc0/d44/d85/d97/f76 4697769 0 2024-09-21T12:20:23.412 INFO:tasks.workunit.client.1.smithi192.stdout:5/629: symlink d0/d65/d8e/d98/dba/lda 0 2024-09-21T12:20:23.415 INFO:tasks.workunit.client.1.smithi192.stdout:6/443: dread da/d23/d37/f33 [0,4194304] 0 2024-09-21T12:20:23.415 INFO:tasks.workunit.client.1.smithi192.stdout:5/630: unlink d0/d65/d6e/ca1 0 2024-09-21T12:20:23.415 INFO:tasks.workunit.client.1.smithi192.stdout:6/444: dread - da/d1f/d56/d78/f7c zero size 2024-09-21T12:20:23.416 INFO:tasks.workunit.client.1.smithi192.stdout:5/631: truncate d0/dc/d13/d37/fd7 665401 0 2024-09-21T12:20:23.417 INFO:tasks.workunit.client.1.smithi192.stdout:6/445: creat da/d1f/d27/d3e/f99 x:0 0 0 2024-09-21T12:20:23.420 INFO:tasks.workunit.client.1.smithi192.stdout:5/632: dread d0/f3b [0,4194304] 0 2024-09-21T12:20:23.420 INFO:tasks.workunit.client.1.smithi192.stdout:5/633: chown d0/dc/d13/c24 1520885119 1 2024-09-21T12:20:23.422 INFO:tasks.workunit.client.1.smithi192.stdout:5/634: fsync d0/d65/d6e/dc0/d44/d85/d97/d45/f31 0 2024-09-21T12:20:23.422 INFO:tasks.workunit.client.1.smithi192.stdout:9/417: dread f2 [4194304,4194304] 0 2024-09-21T12:20:23.422 INFO:tasks.workunit.client.1.smithi192.stdout:5/635: readlink d0/dc/l60 0 2024-09-21T12:20:23.426 INFO:tasks.workunit.client.1.smithi192.stdout:6/446: truncate da/fc 912514 0 2024-09-21T12:20:23.427 INFO:tasks.workunit.client.1.smithi192.stdout:9/418: creat d5/dc/d80/d44/d79/f82 x:0 0 0 2024-09-21T12:20:23.428 INFO:tasks.workunit.client.1.smithi192.stdout:6/447: truncate da/d1f/f45 183127 0 2024-09-21T12:20:23.431 INFO:tasks.workunit.client.1.smithi192.stdout:6/448: unlink da/d23/d37/d75/f76 0 2024-09-21T12:20:23.433 INFO:tasks.workunit.client.1.smithi192.stdout:5/636: truncate d0/d65/d6e/dc0/d44/d85/f93 261358 0 2024-09-21T12:20:23.435 INFO:tasks.workunit.client.1.smithi192.stdout:9/419: dread d5/f33 [0,4194304] 0 2024-09-21T12:20:23.435 INFO:tasks.workunit.client.1.smithi192.stdout:5/637: mknod d0/d65/d8e/d98/dba/cdb 0 2024-09-21T12:20:23.438 INFO:tasks.workunit.client.1.smithi192.stdout:9/420: rename d5/dc/d6f to d5/dc/d80/d5a/d83 0 2024-09-21T12:20:23.441 INFO:tasks.workunit.client.1.smithi192.stdout:5/638: rmdir d0/d65/d6e/dc0/d44/d85 39 2024-09-21T12:20:23.443 INFO:tasks.workunit.client.1.smithi192.stdout:6/449: truncate da/f42 1439416 0 2024-09-21T12:20:23.444 INFO:tasks.workunit.client.1.smithi192.stdout:6/450: truncate da/d1f/f3c 1882886 0 2024-09-21T12:20:23.444 INFO:tasks.workunit.client.1.smithi192.stdout:9/421: symlink d5/d21/d66/d53/d6e/l84 0 2024-09-21T12:20:23.444 INFO:tasks.workunit.client.1.smithi192.stdout:6/451: write da/d23/d37/f8e [1259796,96673] 0 2024-09-21T12:20:23.445 INFO:tasks.workunit.client.1.smithi192.stdout:5/639: mknod d0/dc/d13/cdc 0 2024-09-21T12:20:23.446 INFO:tasks.workunit.client.1.smithi192.stdout:5/640: write d0/d65/d6e/da7/fc3 [722522,125385] 0 2024-09-21T12:20:23.447 INFO:tasks.workunit.client.1.smithi192.stdout:9/422: creat d5/d21/d66/d53/d6e/f85 x:0 0 0 2024-09-21T12:20:23.448 INFO:tasks.workunit.client.1.smithi192.stdout:6/452: mkdir da/d1f/d48/d7d/d9a 0 2024-09-21T12:20:23.449 INFO:tasks.workunit.client.1.smithi192.stdout:6/453: chown da/d1f/d27/d3e/f94 134 1 2024-09-21T12:20:23.450 INFO:tasks.workunit.client.1.smithi192.stdout:6/454: readlink da/d1f/d56/l8f 0 2024-09-21T12:20:23.451 INFO:tasks.workunit.client.1.smithi192.stdout:5/641: getdents d0/dc 0 2024-09-21T12:20:23.454 INFO:tasks.workunit.client.1.smithi192.stdout:5/642: mkdir d0/dc/d13/d37/da8/daa/dc5/ddd 0 2024-09-21T12:20:23.455 INFO:tasks.workunit.client.1.smithi192.stdout:6/455: dwrite da/d1f/d27/d6b/f8c [0,4194304] 0 2024-09-21T12:20:23.456 INFO:tasks.workunit.client.1.smithi192.stdout:9/423: write d5/d8/d2c/f4b [4028714,25930] 0 2024-09-21T12:20:23.457 INFO:tasks.workunit.client.1.smithi192.stdout:6/456: rmdir da/d1f/d48 39 2024-09-21T12:20:23.458 INFO:tasks.workunit.client.1.smithi192.stdout:5/643: creat d0/dc/d13/d37/da8/daa/dc5/ddd/fde x:0 0 0 2024-09-21T12:20:23.460 INFO:tasks.workunit.client.1.smithi192.stdout:6/457: creat da/d1f/d27/d6b/f9b x:0 0 0 2024-09-21T12:20:23.460 INFO:tasks.workunit.client.1.smithi192.stdout:9/424: mknod d5/dc/d80/d44/d79/d55/d70/c86 0 2024-09-21T12:20:23.460 INFO:tasks.workunit.client.1.smithi192.stdout:6/458: fdatasync da/f6a 0 2024-09-21T12:20:23.462 INFO:tasks.workunit.client.1.smithi192.stdout:6/459: write da/d1f/d27/d6b/f9b [170167,117868] 0 2024-09-21T12:20:23.463 INFO:tasks.workunit.client.1.smithi192.stdout:5/644: creat d0/d65/fdf x:0 0 0 2024-09-21T12:20:23.464 INFO:tasks.workunit.client.1.smithi192.stdout:5/645: readlink d0/dc/d13/d37/d38/l47 0 2024-09-21T12:20:23.467 INFO:tasks.workunit.client.1.smithi192.stdout:5/646: chown d0/d65/d6e/dc0/d44/d85/d97/d45/lad 1897 1 2024-09-21T12:20:23.469 INFO:tasks.workunit.client.1.smithi192.stdout:3/380: sync 2024-09-21T12:20:23.471 INFO:tasks.workunit.client.1.smithi192.stdout:5/647: creat d0/d65/d6e/dc0/d44/d85/d97/fe0 x:0 0 0 2024-09-21T12:20:23.472 INFO:tasks.workunit.client.1.smithi192.stdout:3/381: creat db/d16/d18/d33/d88/f8b x:0 0 0 2024-09-21T12:20:23.473 INFO:tasks.workunit.client.1.smithi192.stdout:3/382: truncate db/d16/d18/d40/f51 1774000 0 2024-09-21T12:20:23.474 INFO:tasks.workunit.client.1.smithi192.stdout:3/383: fsync db/f22 0 2024-09-21T12:20:23.474 INFO:tasks.workunit.client.1.smithi192.stdout:9/425: write f2 [2556494,118006] 0 2024-09-21T12:20:23.478 INFO:tasks.workunit.client.1.smithi192.stdout:9/426: mknod d5/dc/d80/d5a/c87 0 2024-09-21T12:20:23.479 INFO:tasks.workunit.client.1.smithi192.stdout:5/648: dwrite d0/d65/d6e/dc0/d44/d85/fa6 [4194304,4194304] 0 2024-09-21T12:20:23.483 INFO:tasks.workunit.client.1.smithi192.stdout:6/460: dwrite da/d1f/f45 [0,4194304] 0 2024-09-21T12:20:23.486 INFO:tasks.workunit.client.1.smithi192.stdout:6/461: chown da/d1f/f54 26506 1 2024-09-21T12:20:23.486 INFO:tasks.workunit.client.1.smithi192.stdout:5/649: mknod d0/dc/d13/d37/da8/daa/dc5/ce1 0 2024-09-21T12:20:23.487 INFO:tasks.workunit.client.1.smithi192.stdout:9/427: creat d5/dc/d80/d44/d79/d3f/d4d/d6d/f88 x:0 0 0 2024-09-21T12:20:23.489 INFO:tasks.workunit.client.1.smithi192.stdout:5/650: chown d0/f6a 91123468 1 2024-09-21T12:20:23.489 INFO:tasks.workunit.client.1.smithi192.stdout:3/384: dwrite db/d16/d18/d33/d88/f8b [0,4194304] 0 2024-09-21T12:20:23.491 INFO:tasks.workunit.client.1.smithi192.stdout:3/385: dread - db/d16/d18/d21/f5d zero size 2024-09-21T12:20:23.492 INFO:tasks.workunit.client.1.smithi192.stdout:6/462: write da/d1f/d48/f64 [685905,102451] 0 2024-09-21T12:20:23.493 INFO:tasks.workunit.client.1.smithi192.stdout:5/651: creat d0/d2/d7b/fe2 x:0 0 0 2024-09-21T12:20:23.493 INFO:tasks.workunit.client.1.smithi192.stdout:9/428: mknod d5/dc/d80/d44/d79/d55/d70/c89 0 2024-09-21T12:20:23.494 INFO:tasks.workunit.client.1.smithi192.stdout:9/429: chown d5/dc/d80/d5a/f75 6632 1 2024-09-21T12:20:23.495 INFO:tasks.workunit.client.1.smithi192.stdout:6/463: creat da/d1f/d27/d6b/f9c x:0 0 0 2024-09-21T12:20:23.496 INFO:tasks.workunit.client.1.smithi192.stdout:6/464: write da/d1f/d27/d3e/f94 [585351,116869] 0 2024-09-21T12:20:23.496 INFO:tasks.workunit.client.1.smithi192.stdout:5/652: mkdir d0/d65/d6e/dbc/de3 0 2024-09-21T12:20:23.498 INFO:tasks.workunit.client.1.smithi192.stdout:3/386: mkdir db/d16/d18/d40/d60/d7b/d7c/d8c 0 2024-09-21T12:20:23.498 INFO:tasks.workunit.client.1.smithi192.stdout:6/465: write da/d1f/d27/d3e/f94 [1520853,49161] 0 2024-09-21T12:20:23.501 INFO:tasks.workunit.client.1.smithi192.stdout:5/653: mkdir d0/dc/d13/d37/da8/daa/de4 0 2024-09-21T12:20:23.503 INFO:tasks.workunit.client.1.smithi192.stdout:9/430: dwrite d5/dc/f5f [0,4194304] 0 2024-09-21T12:20:23.503 INFO:tasks.workunit.client.1.smithi192.stdout:3/387: creat db/d16/d18/d40/d60/d7b/d7c/d8c/f8d x:0 0 0 2024-09-21T12:20:23.503 INFO:tasks.workunit.client.1.smithi192.stdout:5/654: stat d0/dc/d13/d37/l3c 0 2024-09-21T12:20:23.505 INFO:tasks.workunit.client.1.smithi192.stdout:6/466: dread da/f57 [0,4194304] 0 2024-09-21T12:20:23.506 INFO:tasks.workunit.client.1.smithi192.stdout:9/431: mknod d5/d21/d66/d53/d6e/c8a 0 2024-09-21T12:20:23.506 INFO:tasks.workunit.client.1.smithi192.stdout:3/388: write db/d16/d18/d40/d60/f8a [397453,76625] 0 2024-09-21T12:20:23.508 INFO:tasks.workunit.client.1.smithi192.stdout:6/467: chown da/d1f/d48/f53 8185982 1 2024-09-21T12:20:23.511 INFO:tasks.workunit.client.1.smithi192.stdout:6/468: write da/d1f/d27/f28 [1589159,50348] 0 2024-09-21T12:20:23.511 INFO:tasks.workunit.client.1.smithi192.stdout:9/432: creat d5/dc/d80/d44/d79/d3f/d4d/f8b x:0 0 0 2024-09-21T12:20:23.512 INFO:tasks.workunit.client.1.smithi192.stdout:5/655: link d0/dc/d13/d37/da8/daa/dc5/ce1 d0/dc/ce5 0 2024-09-21T12:20:23.515 INFO:tasks.workunit.client.1.smithi192.stdout:9/433: creat d5/dc/d80/d44/f8c x:0 0 0 2024-09-21T12:20:23.515 INFO:tasks.workunit.client.1.smithi192.stdout:5/656: fsync d0/d65/d6e/dc0/d44/d85/d97/d45/f5a 0 2024-09-21T12:20:23.516 INFO:tasks.workunit.client.1.smithi192.stdout:3/389: dwrite db/d16/d18/d40/f51 [0,4194304] 0 2024-09-21T12:20:23.517 INFO:tasks.workunit.client.1.smithi192.stdout:9/434: dread - d5/dc/d80/d5a/f75 zero size 2024-09-21T12:20:23.520 INFO:tasks.workunit.client.1.smithi192.stdout:9/435: fsync d5/d21/d3d/f54 0 2024-09-21T12:20:23.520 INFO:tasks.workunit.client.1.smithi192.stdout:3/390: symlink db/d16/d18/d21/d23/d71/l8e 0 2024-09-21T12:20:23.521 INFO:tasks.workunit.client.1.smithi192.stdout:6/469: dwrite da/d23/f26 [0,4194304] 0 2024-09-21T12:20:23.523 INFO:tasks.workunit.client.1.smithi192.stdout:6/470: chown da/d23/d37/d75/c79 0 1 2024-09-21T12:20:23.525 INFO:tasks.workunit.client.1.smithi192.stdout:9/436: symlink d5/dc/d80/d44/l8d 0 2024-09-21T12:20:23.526 INFO:tasks.workunit.client.1.smithi192.stdout:3/391: mknod db/d16/d18/d40/d60/d7b/c8f 0 2024-09-21T12:20:23.527 INFO:tasks.workunit.client.1.smithi192.stdout:3/392: readlink l0 0 2024-09-21T12:20:23.527 INFO:tasks.workunit.client.1.smithi192.stdout:9/437: truncate d5/d19/f3c 259279 0 2024-09-21T12:20:23.528 INFO:tasks.workunit.client.1.smithi192.stdout:9/438: stat d5/dc/d40/l41 0 2024-09-21T12:20:23.530 INFO:tasks.workunit.client.1.smithi192.stdout:6/471: dwrite da/d23/d37/f8e [0,4194304] 0 2024-09-21T12:20:23.531 INFO:tasks.workunit.client.1.smithi192.stdout:6/472: readlink da/d1f/l69 0 2024-09-21T12:20:23.534 INFO:tasks.workunit.client.1.smithi192.stdout:6/473: symlink da/d1f/d27/d3e/l9d 0 2024-09-21T12:20:23.536 INFO:tasks.workunit.client.1.smithi192.stdout:6/474: stat da/d1f/d56/d78 0 2024-09-21T12:20:23.537 INFO:tasks.workunit.client.1.smithi192.stdout:3/393: dwrite db/f4f [0,4194304] 0 2024-09-21T12:20:23.539 INFO:tasks.workunit.client.1.smithi192.stdout:6/475: mkdir da/d1f/d48/d7d/d9a/d9e 0 2024-09-21T12:20:23.540 INFO:tasks.workunit.client.1.smithi192.stdout:6/476: chown da/d23/f34 7 1 2024-09-21T12:20:23.540 INFO:tasks.workunit.client.1.smithi192.stdout:3/394: symlink db/d16/d18/d21/d23/d71/d77/l90 0 2024-09-21T12:20:23.542 INFO:tasks.workunit.client.1.smithi192.stdout:6/477: mkdir da/d1f/d48/d9f 0 2024-09-21T12:20:23.542 INFO:tasks.workunit.client.1.smithi192.stdout:3/395: write db/d16/d18/d33/f48 [4374437,89910] 0 2024-09-21T12:20:23.543 INFO:tasks.workunit.client.1.smithi192.stdout:6/478: stat da/d1f/d27/d3e/l9d 0 2024-09-21T12:20:23.553 INFO:tasks.workunit.client.1.smithi192.stdout:3/396: link db/d16/d18/d33/d3b/l5b db/l91 0 2024-09-21T12:20:23.555 INFO:tasks.workunit.client.1.smithi192.stdout:6/479: dwrite da/d1f/d27/d3e/f99 [0,4194304] 0 2024-09-21T12:20:23.556 INFO:tasks.workunit.client.1.smithi192.stdout:5/657: dread d0/d2/f48 [0,4194304] 0 2024-09-21T12:20:23.556 INFO:tasks.workunit.client.1.smithi192.stdout:3/397: chown db/d16/d18/d40/d60/d7b/c8f 301 1 2024-09-21T12:20:23.557 INFO:tasks.workunit.client.1.smithi192.stdout:6/480: fdatasync da/d1f/f86 0 2024-09-21T12:20:23.558 INFO:tasks.workunit.client.1.smithi192.stdout:9/439: dread d5/d21/f4c [0,4194304] 0 2024-09-21T12:20:23.560 INFO:tasks.workunit.client.1.smithi192.stdout:9/440: fsync d5/d19/f6b 0 2024-09-21T12:20:23.560 INFO:tasks.workunit.client.1.smithi192.stdout:6/481: chown da/d1f/d27/d6b/f85 1 1 2024-09-21T12:20:23.562 INFO:tasks.workunit.client.1.smithi192.stdout:3/398: rename db/d16/d18/d40/d60/d7b/c8f to db/d16/d18/d40/c92 0 2024-09-21T12:20:23.564 INFO:tasks.workunit.client.1.smithi192.stdout:3/399: fsync db/d16/d18/d33/d3b/f58 0 2024-09-21T12:20:23.567 INFO:tasks.workunit.client.1.smithi192.stdout:6/482: dwrite da/d1f/d27/d6b/f6d [0,4194304] 0 2024-09-21T12:20:23.568 INFO:tasks.workunit.client.1.smithi192.stdout:3/400: mknod db/d16/d18/d21/d23/d71/d77/c93 0 2024-09-21T12:20:23.568 INFO:tasks.workunit.client.1.smithi192.stdout:5/658: write d0/d65/d6e/dc0/d44/d85/d97/d35/f54 [348991,102794] 0 2024-09-21T12:20:23.568 INFO:tasks.workunit.client.1.smithi192.stdout:7/466: sync 2024-09-21T12:20:23.569 INFO:tasks.workunit.client.1.smithi192.stdout:1/499: sync 2024-09-21T12:20:23.569 INFO:tasks.workunit.client.1.smithi192.stdout:2/458: sync 2024-09-21T12:20:23.570 INFO:tasks.workunit.client.1.smithi192.stdout:1/500: write d2/d4d/f6f [691176,47205] 0 2024-09-21T12:20:23.575 INFO:tasks.workunit.client.1.smithi192.stdout:5/659: chown d0/d65/d6e/d84 5872 1 2024-09-21T12:20:23.575 INFO:tasks.workunit.client.1.smithi192.stdout:6/483: write da/d23/d37/f59 [487984,64913] 0 2024-09-21T12:20:23.576 INFO:tasks.workunit.client.1.smithi192.stdout:3/401: write db/d16/d18/f2f [2172874,8861] 0 2024-09-21T12:20:23.576 INFO:tasks.workunit.client.1.smithi192.stdout:2/459: chown d1b/d1e/d62/c83 39732603 1 2024-09-21T12:20:23.578 INFO:tasks.workunit.client.1.smithi192.stdout:7/467: dwrite d6/d9/d70/d77/f91 [0,4194304] 0 2024-09-21T12:20:23.579 INFO:tasks.workunit.client.1.smithi192.stdout:3/402: rmdir db/d16/d18/d33/d3b/d68 39 2024-09-21T12:20:23.581 INFO:tasks.workunit.client.1.smithi192.stdout:2/460: creat d1b/d1e/d5e/d75/f8f x:0 0 0 2024-09-21T12:20:23.581 INFO:tasks.workunit.client.1.smithi192.stdout:5/660: mkdir d0/d65/d6e/de6 0 2024-09-21T12:20:23.583 INFO:tasks.workunit.client.1.smithi192.stdout:5/661: write d0/f6a [3063547,5734] 0 2024-09-21T12:20:23.584 INFO:tasks.workunit.client.1.smithi192.stdout:7/468: symlink d6/d9/d51/la9 0 2024-09-21T12:20:23.585 INFO:tasks.workunit.client.1.smithi192.stdout:9/441: dread d5/dc/d80/d44/d79/f45 [0,4194304] 0 2024-09-21T12:20:23.589 INFO:tasks.workunit.client.1.smithi192.stdout:2/461: rename l18 to d1b/d38/d53/l90 0 2024-09-21T12:20:23.590 INFO:tasks.workunit.client.1.smithi192.stdout:6/484: truncate da/d1f/d27/f6f 30795 0 2024-09-21T12:20:23.591 INFO:tasks.workunit.client.1.smithi192.stdout:1/501: link d2/d45/c59 d2/d12/d2f/d51/d24/d65/d8e/ca1 0 2024-09-21T12:20:23.592 INFO:tasks.workunit.client.1.smithi192.stdout:5/662: dwrite d0/d65/d6e/dc0/d44/d85/d97/d45/f31 [0,4194304] 0 2024-09-21T12:20:23.593 INFO:tasks.workunit.client.1.smithi192.stdout:3/403: getdents db/d16/d61/d2e 0 2024-09-21T12:20:23.594 INFO:tasks.workunit.client.1.smithi192.stdout:9/442: dread d5/dc/d80/d44/d79/f45 [0,4194304] 0 2024-09-21T12:20:23.594 INFO:tasks.workunit.client.1.smithi192.stdout:2/462: symlink d1b/d1e/d5e/d75/d8d/l91 0 2024-09-21T12:20:23.595 INFO:tasks.workunit.client.1.smithi192.stdout:7/469: read d6/d9/d2d/f5a [5693319,72168] 0 2024-09-21T12:20:23.595 INFO:tasks.workunit.client.1.smithi192.stdout:6/485: dread da/f42 [0,4194304] 0 2024-09-21T12:20:23.597 INFO:tasks.workunit.client.1.smithi192.stdout:6/486: write da/d23/d37/f70 [241742,19329] 0 2024-09-21T12:20:23.598 INFO:tasks.workunit.client.1.smithi192.stdout:6/487: fsync da/d23/d37/f8e 0 2024-09-21T12:20:23.598 INFO:tasks.workunit.client.1.smithi192.stdout:6/488: chown da/d1f/d27/d88 323100729 1 2024-09-21T12:20:23.599 INFO:tasks.workunit.client.1.smithi192.stdout:6/489: fdatasync da/d1f/d27/d6b/f9c 0 2024-09-21T12:20:23.603 INFO:tasks.workunit.client.1.smithi192.stdout:2/463: unlink d1b/d1e/c4a 0 2024-09-21T12:20:23.604 INFO:tasks.workunit.client.1.smithi192.stdout:9/443: mkdir d5/dc/d80/d44/d8e 0 2024-09-21T12:20:23.605 INFO:tasks.workunit.client.1.smithi192.stdout:1/502: rename d2/d12/d2f/d41/c56 to d2/d12/d2f/d41/d5c/d99/ca2 0 2024-09-21T12:20:23.606 INFO:tasks.workunit.client.1.smithi192.stdout:7/470: fdatasync d6/d9/f14 0 2024-09-21T12:20:23.607 INFO:tasks.workunit.client.1.smithi192.stdout:6/490: symlink da/d1f/d56/la0 0 2024-09-21T12:20:23.608 INFO:tasks.workunit.client.1.smithi192.stdout:7/471: dread d6/d9/d70/d77/f9a [0,4194304] 0 2024-09-21T12:20:23.609 INFO:tasks.workunit.client.1.smithi192.stdout:2/464: unlink d1b/c54 0 2024-09-21T12:20:23.611 INFO:tasks.workunit.client.1.smithi192.stdout:9/444: mkdir d5/dc/d80/d44/d79/d3f/d8f 0 2024-09-21T12:20:23.612 INFO:tasks.workunit.client.1.smithi192.stdout:9/445: fdatasync d5/d8/f2d 0 2024-09-21T12:20:23.615 INFO:tasks.workunit.client.1.smithi192.stdout:3/404: link c6 db/c94 0 2024-09-21T12:20:23.616 INFO:tasks.workunit.client.1.smithi192.stdout:0/412: sync 2024-09-21T12:20:23.616 INFO:tasks.workunit.client.1.smithi192.stdout:4/428: sync 2024-09-21T12:20:23.617 INFO:tasks.workunit.client.1.smithi192.stdout:8/512: sync 2024-09-21T12:20:23.617 INFO:tasks.workunit.client.1.smithi192.stdout:6/491: fdatasync da/d23/d37/f39 0 2024-09-21T12:20:23.620 INFO:tasks.workunit.client.1.smithi192.stdout:5/663: link d0/d2/cb7 d0/d65/d8e/d98/ce7 0 2024-09-21T12:20:23.621 INFO:tasks.workunit.client.1.smithi192.stdout:9/446: rmdir d5/dc/d80/d44/d79/d3f/d4d/d6d 39 2024-09-21T12:20:23.621 INFO:tasks.workunit.client.1.smithi192.stdout:5/664: readlink d0/d65/d6e/dc0/d44/d85/d97/d45/l2f 0 2024-09-21T12:20:23.625 INFO:tasks.workunit.client.1.smithi192.stdout:3/405: creat db/d16/d18/d21/d23/f95 x:0 0 0 2024-09-21T12:20:23.625 INFO:tasks.workunit.client.1.smithi192.stdout:3/406: readlink db/d16/d18/l24 0 2024-09-21T12:20:23.627 INFO:tasks.workunit.client.1.smithi192.stdout:8/513: creat d14/d1a/d1d/d46/d4e/fa8 x:0 0 0 2024-09-21T12:20:23.629 INFO:tasks.workunit.client.1.smithi192.stdout:7/472: link d6/d9/d1f/d3e/fa0 d6/d3a/faa 0 2024-09-21T12:20:23.630 INFO:tasks.workunit.client.1.smithi192.stdout:5/665: write d0/d65/d6e/f32 [1723117,16734] 0 2024-09-21T12:20:23.631 INFO:tasks.workunit.client.1.smithi192.stdout:6/492: dread da/d23/f52 [0,4194304] 0 2024-09-21T12:20:23.631 INFO:tasks.workunit.client.1.smithi192.stdout:1/503: rename d2/d12/d2f/d51/d24/d65/d5a/f95 to d2/d12/d2f/d41/d61/fa3 0 2024-09-21T12:20:23.632 INFO:tasks.workunit.client.1.smithi192.stdout:1/504: stat d2/de/f19 0 2024-09-21T12:20:23.636 INFO:tasks.workunit.client.1.smithi192.stdout:9/447: unlink d5/d19/d32/l77 0 2024-09-21T12:20:23.638 INFO:tasks.workunit.client.1.smithi192.stdout:4/429: rename d2/db/d3e/f43 to d2/db/d3e/d57/d32/d4f/d71/f8e 0 2024-09-21T12:20:23.638 INFO:tasks.workunit.client.1.smithi192.stdout:6/493: symlink da/d1f/d56/d73/la1 0 2024-09-21T12:20:23.639 INFO:tasks.workunit.client.1.smithi192.stdout:6/494: write da/d1f/f3c [760193,27013] 0 2024-09-21T12:20:23.639 INFO:tasks.workunit.client.1.smithi192.stdout:8/514: mkdir d14/d1a/d82/da9 0 2024-09-21T12:20:23.642 INFO:tasks.workunit.client.1.smithi192.stdout:9/448: creat d5/dc/d80/d44/f90 x:0 0 0 2024-09-21T12:20:23.642 INFO:tasks.workunit.client.1.smithi192.stdout:9/449: stat d5/d8/d2c/c7c 0 2024-09-21T12:20:23.644 INFO:tasks.workunit.client.1.smithi192.stdout:9/450: write d5/d19/f6b [2720492,88610] 0 2024-09-21T12:20:23.644 INFO:tasks.workunit.client.1.smithi192.stdout:4/430: fsync d2/f23 0 2024-09-21T12:20:23.645 INFO:tasks.workunit.client.1.smithi192.stdout:0/413: getdents d3/de 0 2024-09-21T12:20:23.646 INFO:tasks.workunit.client.1.smithi192.stdout:0/414: truncate d3/de/f60 310909 0 2024-09-21T12:20:23.647 INFO:tasks.workunit.client.1.smithi192.stdout:0/415: write d3/d5/d28/d39/f41 [3018666,118850] 0 2024-09-21T12:20:23.647 INFO:tasks.workunit.client.1.smithi192.stdout:6/495: mkdir da/d1f/d27/da2 0 2024-09-21T12:20:23.649 INFO:tasks.workunit.client.1.smithi192.stdout:7/473: write d6/d9/d51/f4b [2686750,123233] 0 2024-09-21T12:20:23.649 INFO:tasks.workunit.client.1.smithi192.stdout:8/515: read d14/d1a/d1d/d48/f6f [5159,50265] 0 2024-09-21T12:20:23.650 INFO:tasks.workunit.client.1.smithi192.stdout:5/666: creat d0/dc/d13/d37/d38/fe8 x:0 0 0 2024-09-21T12:20:23.650 INFO:tasks.workunit.client.1.smithi192.stdout:3/407: rename db/d16/d61/l41 to db/d16/d18/d40/d60/d7b/l96 0 2024-09-21T12:20:23.652 INFO:tasks.workunit.client.1.smithi192.stdout:5/667: stat d0/d65/d8e/ld3 0 2024-09-21T12:20:23.654 INFO:tasks.workunit.client.1.smithi192.stdout:1/505: getdents d2/d12/d2f/d51/d24/d65 0 2024-09-21T12:20:23.654 INFO:tasks.workunit.client.1.smithi192.stdout:4/431: creat d2/d36/d55/d89/f8f x:0 0 0 2024-09-21T12:20:23.654 INFO:tasks.workunit.client.1.smithi192.stdout:8/516: symlink d14/d18/d88/laa 0 2024-09-21T12:20:23.656 INFO:tasks.workunit.client.1.smithi192.stdout:7/474: creat d6/d9/d1f/d3e/d7a/d8a/fab x:0 0 0 2024-09-21T12:20:23.656 INFO:tasks.workunit.client.1.smithi192.stdout:0/416: dread d3/de/d33/f35 [0,4194304] 0 2024-09-21T12:20:23.657 INFO:tasks.workunit.client.1.smithi192.stdout:3/408: fsync db/d16/d18/d33/d3b/d68/f86 0 2024-09-21T12:20:23.658 INFO:tasks.workunit.client.1.smithi192.stdout:0/417: readlink d3/de/l59 0 2024-09-21T12:20:23.658 INFO:tasks.workunit.client.1.smithi192.stdout:2/465: rename c10 to d1b/d65/d77/c92 0 2024-09-21T12:20:23.659 INFO:tasks.workunit.client.1.smithi192.stdout:6/496: link da/d1f/d56/d78/c8a da/d1f/d27/ca3 0 2024-09-21T12:20:23.660 INFO:tasks.workunit.client.1.smithi192.stdout:8/517: fsync d14/d18/f28 0 2024-09-21T12:20:23.660 INFO:tasks.workunit.client.1.smithi192.stdout:5/668: symlink d0/d2/d7b/da5/le9 0 2024-09-21T12:20:23.662 INFO:tasks.workunit.client.1.smithi192.stdout:9/451: dread f2 [0,4194304] 0 2024-09-21T12:20:23.662 INFO:tasks.workunit.client.1.smithi192.stdout:6/497: read da/d1f/d27/f71 [103698,60487] 0 2024-09-21T12:20:23.662 INFO:tasks.workunit.client.1.smithi192.stdout:0/418: truncate d3/d6/f68 4952548 0 2024-09-21T12:20:23.663 INFO:tasks.workunit.client.1.smithi192.stdout:5/669: dread - d0/dc/d13/d37/d38/fe8 zero size 2024-09-21T12:20:23.666 INFO:tasks.workunit.client.1.smithi192.stdout:4/432: truncate d2/d36/d7f/f39 350800 0 2024-09-21T12:20:23.667 INFO:tasks.workunit.client.1.smithi192.stdout:0/419: chown d3/c62 14354 1 2024-09-21T12:20:23.668 INFO:tasks.workunit.client.1.smithi192.stdout:0/420: write d3/d5/d19/d51/f34 [1594328,33168] 0 2024-09-21T12:20:23.669 INFO:tasks.workunit.client.1.smithi192.stdout:6/498: unlink da/d1f/d48/f96 0 2024-09-21T12:20:23.670 INFO:tasks.workunit.client.1.smithi192.stdout:6/499: fdatasync da/d1f/d27/d6b/f9c 0 2024-09-21T12:20:23.671 INFO:tasks.workunit.client.1.smithi192.stdout:9/452: creat d5/dc/d80/d5a/d83/f91 x:0 0 0 2024-09-21T12:20:23.672 INFO:tasks.workunit.client.1.smithi192.stdout:1/506: dread d2/da/d6b/d7d/f87 [0,4194304] 0 2024-09-21T12:20:23.672 INFO:tasks.workunit.client.1.smithi192.stdout:3/409: link db/d16/d18/l24 db/d16/d18/d40/l97 0 2024-09-21T12:20:23.673 INFO:tasks.workunit.client.1.smithi192.stdout:4/433: dread - d2/db/d3e/d41/f5e zero size 2024-09-21T12:20:23.675 INFO:tasks.workunit.client.1.smithi192.stdout:0/421: symlink d3/de/l73 0 2024-09-21T12:20:23.676 INFO:tasks.workunit.client.1.smithi192.stdout:8/518: symlink d14/d1a/d1d/d46/d4e/d83/d8d/d9c/lab 0 2024-09-21T12:20:23.676 INFO:tasks.workunit.client.1.smithi192.stdout:9/453: dread d5/dc/f5f [0,4194304] 0 2024-09-21T12:20:23.676 INFO:tasks.workunit.client.1.smithi192.stdout:7/475: truncate d6/f27 2403780 0 2024-09-21T12:20:23.678 INFO:tasks.workunit.client.1.smithi192.stdout:5/670: write d0/dc/f61 [4492558,108271] 0 2024-09-21T12:20:23.679 INFO:tasks.workunit.client.1.smithi192.stdout:1/507: dwrite d2/da/d9f/f67 [0,4194304] 0 2024-09-21T12:20:23.679 INFO:tasks.workunit.client.1.smithi192.stdout:4/434: mknod d2/d19/d4b/c90 0 2024-09-21T12:20:23.680 INFO:tasks.workunit.client.1.smithi192.stdout:8/519: truncate d14/d1a/d1d/d20/d5f/fa3 58322 0 2024-09-21T12:20:23.683 INFO:tasks.workunit.client.1.smithi192.stdout:8/520: chown d14/d1a/d1d/d20/d5f/ca6 70 1 2024-09-21T12:20:23.684 INFO:tasks.workunit.client.1.smithi192.stdout:8/521: chown d14/d18/f32 18360869 1 2024-09-21T12:20:23.684 INFO:tasks.workunit.client.1.smithi192.stdout:7/476: creat d6/d9/d2d/d68/fac x:0 0 0 2024-09-21T12:20:23.685 INFO:tasks.workunit.client.1.smithi192.stdout:4/435: dread d2/d19/d4b/f64 [0,4194304] 0 2024-09-21T12:20:23.687 INFO:tasks.workunit.client.1.smithi192.stdout:1/508: creat d2/d45/fa4 x:0 0 0 2024-09-21T12:20:23.687 INFO:tasks.workunit.client.1.smithi192.stdout:5/671: fsync d0/d65/d6e/dc0/d44/d85/d97/f6c 0 2024-09-21T12:20:23.691 INFO:tasks.workunit.client.1.smithi192.stdout:6/500: rmdir da/d1f/d27/da2 0 2024-09-21T12:20:23.692 INFO:tasks.workunit.client.1.smithi192.stdout:6/501: chown da/d1f/d27/d6b/f7f 3490 1 2024-09-21T12:20:23.692 INFO:tasks.workunit.client.1.smithi192.stdout:8/522: fsync f11 0 2024-09-21T12:20:23.693 INFO:tasks.workunit.client.1.smithi192.stdout:8/523: write d14/d18/f28 [1797749,286] 0 2024-09-21T12:20:23.693 INFO:tasks.workunit.client.1.smithi192.stdout:8/524: readlink d14/d1a/l50 0 2024-09-21T12:20:23.695 INFO:tasks.workunit.client.1.smithi192.stdout:7/477: rename d6/d9/d51/f41 to d6/d9/d51/fad 0 2024-09-21T12:20:23.695 INFO:tasks.workunit.client.1.smithi192.stdout:7/478: dread - d6/d3a/faa zero size 2024-09-21T12:20:23.697 INFO:tasks.workunit.client.1.smithi192.stdout:1/509: creat d2/d12/fa5 x:0 0 0 2024-09-21T12:20:23.700 INFO:tasks.workunit.client.1.smithi192.stdout:9/454: rmdir d5/dc/d80/d44/d79/d3f/d8f 0 2024-09-21T12:20:23.701 INFO:tasks.workunit.client.1.smithi192.stdout:3/410: truncate db/d16/d18/d40/d60/f8a 112564 0 2024-09-21T12:20:23.701 INFO:tasks.workunit.client.1.smithi192.stdout:4/436: mknod d2/db/d3e/d57/d32/d4f/d82/c91 0 2024-09-21T12:20:23.703 INFO:tasks.workunit.client.1.smithi192.stdout:5/672: dwrite d0/d2/f14 [4194304,4194304] 0 2024-09-21T12:20:23.704 INFO:tasks.workunit.client.1.smithi192.stdout:7/479: rmdir d6/d9/d1f/d3e/d7a/d8a/da2 39 2024-09-21T12:20:23.704 INFO:tasks.workunit.client.1.smithi192.stdout:4/437: write d2/db/d34/f86 [466284,30247] 0 2024-09-21T12:20:23.706 INFO:tasks.workunit.client.1.smithi192.stdout:1/510: symlink d2/de/la6 0 2024-09-21T12:20:23.708 INFO:tasks.workunit.client.1.smithi192.stdout:7/480: write d6/d9/d1f/f21 [4369119,74094] 0 2024-09-21T12:20:23.709 INFO:tasks.workunit.client.1.smithi192.stdout:8/525: dwrite d14/d1a/d1d/d46/d4e/d83/f87 [0,4194304] 0 2024-09-21T12:20:23.711 INFO:tasks.workunit.client.1.smithi192.stdout:4/438: write d2/d36/d7f/f4d [1173502,17122] 0 2024-09-21T12:20:23.715 INFO:tasks.workunit.client.1.smithi192.stdout:5/673: symlink d0/dc/d13/d37/da8/daa/dc5/lea 0 2024-09-21T12:20:23.716 INFO:tasks.workunit.client.1.smithi192.stdout:3/411: dwrite db/d16/d18/d33/d4a/f5f [0,4194304] 0 2024-09-21T12:20:23.717 INFO:tasks.workunit.client.1.smithi192.stdout:8/526: truncate d14/d1a/f96 787547 0 2024-09-21T12:20:23.720 INFO:tasks.workunit.client.1.smithi192.stdout:9/455: rename d5/d21/d3d/c6c to d5/d8/c92 0 2024-09-21T12:20:23.722 INFO:tasks.workunit.client.1.smithi192.stdout:3/412: write db/d16/d18/d33/d88/f8b [1720174,108461] 0 2024-09-21T12:20:23.723 INFO:tasks.workunit.client.1.smithi192.stdout:5/674: creat d0/d65/d6e/dc0/d44/d85/feb x:0 0 0 2024-09-21T12:20:23.725 INFO:tasks.workunit.client.1.smithi192.stdout:1/511: dwrite d2/de/f48 [0,4194304] 0 2024-09-21T12:20:23.725 INFO:tasks.workunit.client.1.smithi192.stdout:8/527: fdatasync d14/d1a/d1d/d51/fa2 0 2024-09-21T12:20:23.726 INFO:tasks.workunit.client.1.smithi192.stdout:7/481: rename d6/d20/fa4 to d6/d9/d2d/fae 0 2024-09-21T12:20:23.730 INFO:tasks.workunit.client.1.smithi192.stdout:4/439: getdents d2/db 0 2024-09-21T12:20:23.734 INFO:tasks.workunit.client.1.smithi192.stdout:5/675: dwrite d0/dc/d13/d37/f56 [4194304,4194304] 0 2024-09-21T12:20:23.737 INFO:tasks.workunit.client.1.smithi192.stdout:3/413: symlink db/d16/d18/d40/d60/d7b/l98 0 2024-09-21T12:20:23.738 INFO:tasks.workunit.client.1.smithi192.stdout:8/528: mkdir d14/d1a/d1d/d48/dac 0 2024-09-21T12:20:23.739 INFO:tasks.workunit.client.1.smithi192.stdout:7/482: creat d6/d9/d1f/d3e/d7a/faf x:0 0 0 2024-09-21T12:20:23.743 INFO:tasks.workunit.client.1.smithi192.stdout:1/512: mknod d2/d12/d2f/d51/d24/d65/d5a/ca7 0 2024-09-21T12:20:23.745 INFO:tasks.workunit.client.1.smithi192.stdout:9/456: rmdir d5/dc/d80/d44/d79/d3f/d4d/d78 0 2024-09-21T12:20:23.746 INFO:tasks.workunit.client.1.smithi192.stdout:5/676: symlink d0/dc/d13/lec 0 2024-09-21T12:20:23.746 INFO:tasks.workunit.client.1.smithi192.stdout:9/457: read d5/dc/f68 [1488370,99006] 0 2024-09-21T12:20:23.747 INFO:tasks.workunit.client.1.smithi192.stdout:3/414: mkdir db/d16/d18/d33/d3b/d99 0 2024-09-21T12:20:23.750 INFO:tasks.workunit.client.1.smithi192.stdout:8/529: unlink d14/d18/d88/ca0 0 2024-09-21T12:20:23.751 INFO:tasks.workunit.client.1.smithi192.stdout:1/513: unlink d2/d12/d2f/f40 0 2024-09-21T12:20:23.753 INFO:tasks.workunit.client.1.smithi192.stdout:1/514: read - d2/d12/fa5 zero size 2024-09-21T12:20:23.753 INFO:tasks.workunit.client.1.smithi192.stdout:9/458: mkdir d5/dc/d80/d44/d79/d55/d93 0 2024-09-21T12:20:23.754 INFO:tasks.workunit.client.1.smithi192.stdout:3/415: rename db/d16/d18 to db/d16/d18/d33/d3b/d9a 22 2024-09-21T12:20:23.759 INFO:tasks.workunit.client.1.smithi192.stdout:1/515: chown d2/da/d89/l8d 750922 1 2024-09-21T12:20:23.759 INFO:tasks.workunit.client.1.smithi192.stdout:5/677: rmdir d0/d65/d6e/de6 0 2024-09-21T12:20:23.762 INFO:tasks.workunit.client.1.smithi192.stdout:8/530: dwrite d14/d1a/d1d/d51/fa2 [0,4194304] 0 2024-09-21T12:20:23.764 INFO:tasks.workunit.client.1.smithi192.stdout:5/678: readlink d0/dc/d13/d37/l6d 0 2024-09-21T12:20:23.764 INFO:tasks.workunit.client.1.smithi192.stdout:4/440: dread d2/d36/f3c [0,4194304] 0 2024-09-21T12:20:23.767 INFO:tasks.workunit.client.1.smithi192.stdout:4/441: stat d2/db/d3e/d41 0 2024-09-21T12:20:23.768 INFO:tasks.workunit.client.1.smithi192.stdout:9/459: dwrite d5/dc/d80/d44/f51 [0,4194304] 0 2024-09-21T12:20:23.771 INFO:tasks.workunit.client.1.smithi192.stdout:8/531: mknod d14/d18/d5a/cad 0 2024-09-21T12:20:23.775 INFO:tasks.workunit.client.1.smithi192.stdout:7/483: dread d6/d9/d2d/d7b/f97 [0,4194304] 0 2024-09-21T12:20:23.777 INFO:tasks.workunit.client.1.smithi192.stdout:4/442: mkdir d2/df/d52/d88/d92 0 2024-09-21T12:20:23.777 INFO:tasks.workunit.client.1.smithi192.stdout:9/460: mknod d5/dc/d80/d44/d79/d3f/c94 0 2024-09-21T12:20:23.778 INFO:tasks.workunit.client.1.smithi192.stdout:8/532: stat d14/d1a/d1d/d46/d4e/d83/d8d/d9c/lab 0 2024-09-21T12:20:23.779 INFO:tasks.workunit.client.1.smithi192.stdout:5/679: truncate d0/dc/d13/d37/da8/daa/dc5/ddd/fde 485732 0 2024-09-21T12:20:23.780 INFO:tasks.workunit.client.1.smithi192.stdout:7/484: creat d6/d9/d70/d77/fb0 x:0 0 0 2024-09-21T12:20:23.780 INFO:tasks.workunit.client.1.smithi192.stdout:3/416: dread db/d16/d18/d33/f43 [0,4194304] 0 2024-09-21T12:20:23.781 INFO:tasks.workunit.client.1.smithi192.stdout:1/516: dwrite d2/da/d6b/d7d/f87 [0,4194304] 0 2024-09-21T12:20:23.782 INFO:tasks.workunit.client.1.smithi192.stdout:7/485: fsync f3 0 2024-09-21T12:20:23.785 INFO:tasks.workunit.client.1.smithi192.stdout:3/417: rmdir db/d16/d18/d40/d60/d7b/d7c/d8c 39 2024-09-21T12:20:23.785 INFO:tasks.workunit.client.1.smithi192.stdout:9/461: dread d5/d8/f22 [0,4194304] 0 2024-09-21T12:20:23.785 INFO:tasks.workunit.client.1.smithi192.stdout:9/462: chown d5/f7 252318948 1 2024-09-21T12:20:23.790 INFO:tasks.workunit.client.1.smithi192.stdout:5/680: getdents d0/dc/d13/d37 0 2024-09-21T12:20:23.790 INFO:tasks.workunit.client.1.smithi192.stdout:5/681: stat d0/d2/d7b 0 2024-09-21T12:20:23.791 INFO:tasks.workunit.client.1.smithi192.stdout:7/486: symlink d6/d9/d1f/d3e/d7a/d8a/da2/lb1 0 2024-09-21T12:20:23.792 INFO:tasks.workunit.client.1.smithi192.stdout:9/463: creat d5/d8/d2c/f95 x:0 0 0 2024-09-21T12:20:23.793 INFO:tasks.workunit.client.1.smithi192.stdout:1/517: creat d2/d12/d2f/d51/d24/d65/d8e/d9d/fa8 x:0 0 0 2024-09-21T12:20:23.793 INFO:tasks.workunit.client.1.smithi192.stdout:9/464: stat d5/dc/d80/d44/d79/c69 0 2024-09-21T12:20:23.794 INFO:tasks.workunit.client.1.smithi192.stdout:1/518: write d2/d12/d2f/d41/d5c/f83 [1590700,47748] 0 2024-09-21T12:20:23.795 INFO:tasks.workunit.client.1.smithi192.stdout:7/487: readlink d6/d3a/la6 0 2024-09-21T12:20:23.796 INFO:tasks.workunit.client.1.smithi192.stdout:5/682: symlink d0/dc/d13/led 0 2024-09-21T12:20:23.797 INFO:tasks.workunit.client.1.smithi192.stdout:1/519: chown d2/d4d/l78 168182252 1 2024-09-21T12:20:23.797 INFO:tasks.workunit.client.1.smithi192.stdout:7/488: read - d6/d9/d2d/d7b/f9e zero size 2024-09-21T12:20:23.849 INFO:tasks.workunit.client.1.smithi192.stdout:9/465: rename d5/dc/d80/d44/f51 to d5/dc/d80/d44/d79/d55/d93/f96 0 2024-09-21T12:20:23.850 INFO:tasks.workunit.client.1.smithi192.stdout:5/683: chown d0/d65/d8e/ld3 29519054 1 2024-09-21T12:20:23.850 INFO:tasks.workunit.client.1.smithi192.stdout:3/418: truncate db/f4f 2628771 0 2024-09-21T12:20:23.852 INFO:tasks.workunit.client.1.smithi192.stdout:5/684: mkdir d0/d65/d6e/da7/dee 0 2024-09-21T12:20:23.854 INFO:tasks.workunit.client.1.smithi192.stdout:1/520: getdents d2/d12/d2f/d51/d24/d65/d8e/d9d 0 2024-09-21T12:20:23.855 INFO:tasks.workunit.client.1.smithi192.stdout:9/466: getdents d5/d21/d66 0 2024-09-21T12:20:23.856 INFO:tasks.workunit.client.1.smithi192.stdout:5/685: unlink d0/dc/d13/d37/f5d 0 2024-09-21T12:20:23.857 INFO:tasks.workunit.client.1.smithi192.stdout:7/489: dwrite d6/d9/f2b [0,4194304] 0 2024-09-21T12:20:23.857 INFO:tasks.workunit.client.1.smithi192.stdout:7/490: chown d6/d3a/f61 31970433 1 2024-09-21T12:20:23.859 INFO:tasks.workunit.client.1.smithi192.stdout:1/521: creat d2/d12/d2f/d51/d24/fa9 x:0 0 0 2024-09-21T12:20:23.865 INFO:tasks.workunit.client.1.smithi192.stdout:5/686: truncate d0/dc/d13/d37/d38/f4c 4021353 0 2024-09-21T12:20:23.866 INFO:tasks.workunit.client.1.smithi192.stdout:9/467: dwrite d5/d21/f60 [0,4194304] 0 2024-09-21T12:20:23.868 INFO:tasks.workunit.client.1.smithi192.stdout:3/419: dread db/f3c [0,4194304] 0 2024-09-21T12:20:23.869 INFO:tasks.workunit.client.1.smithi192.stdout:1/522: dread d2/da/d9f/f67 [0,4194304] 0 2024-09-21T12:20:23.869 INFO:tasks.workunit.client.1.smithi192.stdout:9/468: write d5/dc/d80/d44/f90 [644142,7445] 0 2024-09-21T12:20:23.870 INFO:tasks.workunit.client.1.smithi192.stdout:5/687: mknod d0/d65/d6e/dc0/d44/d85/d97/cef 0 2024-09-21T12:20:23.871 INFO:tasks.workunit.client.1.smithi192.stdout:9/469: write d5/d21/d66/d53/d6e/f85 [450572,123969] 0 2024-09-21T12:20:23.874 INFO:tasks.workunit.client.1.smithi192.stdout:1/523: symlink d2/d12/d2f/d51/d24/laa 0 2024-09-21T12:20:23.876 INFO:tasks.workunit.client.1.smithi192.stdout:9/470: mkdir d5/dc/d40/d97 0 2024-09-21T12:20:23.876 INFO:tasks.workunit.client.1.smithi192.stdout:7/491: dwrite f3 [0,4194304] 0 2024-09-21T12:20:23.877 INFO:tasks.workunit.client.1.smithi192.stdout:3/420: rename db/d16/d18/l24 to db/d16/d18/d21/d23/d71/l9b 0 2024-09-21T12:20:23.878 INFO:tasks.workunit.client.1.smithi192.stdout:9/471: write d5/dc/d80/d44/d79/d3f/d4d/f8b [66167,104868] 0 2024-09-21T12:20:23.881 INFO:tasks.workunit.client.1.smithi192.stdout:5/688: dread d0/d65/d6e/dc0/d44/d85/f93 [0,4194304] 0 2024-09-21T12:20:23.881 INFO:tasks.workunit.client.1.smithi192.stdout:9/472: chown d5/dc/d80/d44/d79/d3f/d4d/f47 4393022 1 2024-09-21T12:20:23.883 INFO:tasks.workunit.client.1.smithi192.stdout:5/689: read d0/dc/d13/d37/fd7 [75684,78600] 0 2024-09-21T12:20:23.884 INFO:tasks.workunit.client.1.smithi192.stdout:7/492: rename d6/f52 to d6/d20/d69/d90/fb2 0 2024-09-21T12:20:23.885 INFO:tasks.workunit.client.1.smithi192.stdout:3/421: dwrite db/d16/d18/d40/f51 [0,4194304] 0 2024-09-21T12:20:23.886 INFO:tasks.workunit.client.1.smithi192.stdout:7/493: fdatasync d6/d9/d2d/d68/fac 0 2024-09-21T12:20:23.887 INFO:tasks.workunit.client.1.smithi192.stdout:7/494: chown d6/d9/d70/d77 203030 1 2024-09-21T12:20:23.888 INFO:tasks.workunit.client.1.smithi192.stdout:9/473: dread d5/dc/d80/d44/d79/d55/d93/f96 [0,4194304] 0 2024-09-21T12:20:23.897 INFO:tasks.workunit.client.1.smithi192.stdout:9/474: dwrite d5/f2f [0,4194304] 0 2024-09-21T12:20:23.903 INFO:tasks.workunit.client.1.smithi192.stdout:3/422: dread db/d16/d18/f36 [0,4194304] 0 2024-09-21T12:20:23.905 INFO:tasks.workunit.client.1.smithi192.stdout:9/475: link d5/dc/d80/d5a/d83/f91 d5/dc/d80/d44/d8e/f98 0 2024-09-21T12:20:23.906 INFO:tasks.workunit.client.1.smithi192.stdout:9/476: fsync d5/d19/f7f 0 2024-09-21T12:20:23.931 INFO:tasks.workunit.client.1.smithi192.stdout:5/690: write d0/dc/d13/f53 [181635,42525] 0 2024-09-21T12:20:23.933 INFO:tasks.workunit.client.1.smithi192.stdout:5/691: read - d0/d2/d7b/fe2 zero size 2024-09-21T12:20:23.935 INFO:tasks.workunit.client.1.smithi192.stdout:7/495: dwrite d6/d9/f5b [0,4194304] 0 2024-09-21T12:20:23.969 INFO:tasks.workunit.client.1.smithi192.stdout:2/466: sync 2024-09-21T12:20:23.969 INFO:tasks.workunit.client.1.smithi192.stdout:0/422: sync 2024-09-21T12:20:23.969 INFO:tasks.workunit.client.1.smithi192.stdout:5/692: symlink d0/d65/d6e/da7/da0/lf0 0 2024-09-21T12:20:23.970 INFO:tasks.workunit.client.1.smithi192.stdout:9/477: write d5/f7 [1472630,122757] 0 2024-09-21T12:20:23.971 INFO:tasks.workunit.client.1.smithi192.stdout:0/423: chown d3/d6/f68 492 1 2024-09-21T12:20:23.971 INFO:tasks.workunit.client.1.smithi192.stdout:5/693: dread - d0/d65/d6e/dc0/fcb zero size 2024-09-21T12:20:23.973 INFO:tasks.workunit.client.1.smithi192.stdout:9/478: unlink f2 0 2024-09-21T12:20:23.974 INFO:tasks.workunit.client.1.smithi192.stdout:5/694: write d0/d65/d6e/f32 [2661927,115087] 0 2024-09-21T12:20:23.974 INFO:tasks.workunit.client.1.smithi192.stdout:9/479: chown l4 9273 1 2024-09-21T12:20:23.975 INFO:tasks.workunit.client.1.smithi192.stdout:7/496: dread d6/d9/f5b [0,4194304] 0 2024-09-21T12:20:23.978 INFO:tasks.workunit.client.1.smithi192.stdout:3/423: dread db/d16/d18/d21/d23/f50 [0,4194304] 0 2024-09-21T12:20:23.978 INFO:tasks.workunit.client.1.smithi192.stdout:5/695: stat d0/d65/d6e/dc0/d44/d85/d97/cef 0 2024-09-21T12:20:23.981 INFO:tasks.workunit.client.1.smithi192.stdout:2/467: dwrite d1b/d1e/d7b/f80 [0,4194304] 0 2024-09-21T12:20:23.982 INFO:tasks.workunit.client.1.smithi192.stdout:0/424: dwrite d3/d5/d19/d51/f2b [0,4194304] 0 2024-09-21T12:20:23.984 INFO:tasks.workunit.client.1.smithi192.stdout:5/696: mknod d0/dc/d13/d37/da8/daa/dc5/cf1 0 2024-09-21T12:20:23.984 INFO:tasks.workunit.client.1.smithi192.stdout:0/425: mknod d3/d5/d19/c74 0 2024-09-21T12:20:23.984 INFO:tasks.workunit.client.1.smithi192.stdout:9/480: dwrite d5/f7 [0,4194304] 0 2024-09-21T12:20:23.986 INFO:tasks.workunit.client.1.smithi192.stdout:5/697: truncate d0/dc/d13/f53 3955111 0 2024-09-21T12:20:23.987 INFO:tasks.workunit.client.1.smithi192.stdout:0/426: chown d3/d6/f5a 5389042 1 2024-09-21T12:20:23.987 INFO:tasks.workunit.client.1.smithi192.stdout:5/698: chown d0/dc/d13/c24 248598 1 2024-09-21T12:20:23.993 INFO:tasks.workunit.client.1.smithi192.stdout:9/481: dwrite d5/d8/d2c/f95 [0,4194304] 0 2024-09-21T12:20:23.996 INFO:tasks.workunit.client.1.smithi192.stdout:0/427: symlink d3/de/d43/l75 0 2024-09-21T12:20:23.997 INFO:tasks.workunit.client.1.smithi192.stdout:5/699: dwrite d0/d65/d6e/dc0/f69 [0,4194304] 0 2024-09-21T12:20:23.999 INFO:tasks.workunit.client.1.smithi192.stdout:0/428: fdatasync d3/d6/f68 0 2024-09-21T12:20:23.999 INFO:tasks.workunit.client.1.smithi192.stdout:9/482: truncate d5/dc/d80/d5a/d83/f91 345796 0 2024-09-21T12:20:24.006 INFO:tasks.workunit.client.1.smithi192.stdout:5/700: rename d0/d65/d6e/da7/dee to d0/dc/d13/d37/d38/df2 0 2024-09-21T12:20:24.006 INFO:tasks.workunit.client.1.smithi192.stdout:0/429: read d3/d5/d28/d39/f41 [2795121,77177] 0 2024-09-21T12:20:24.007 INFO:tasks.workunit.client.1.smithi192.stdout:9/483: unlink d5/dc/d80/d44/d79/d3f/d4d/f8b 0 2024-09-21T12:20:24.007 INFO:tasks.workunit.client.1.smithi192.stdout:9/484: fsync d5/dc/f5c 0 2024-09-21T12:20:24.008 INFO:tasks.workunit.client.1.smithi192.stdout:9/485: chown d5/d19/d32 3176 1 2024-09-21T12:20:24.009 INFO:tasks.workunit.client.1.smithi192.stdout:5/701: truncate d0/d65/d6e/dc0/d44/d85/d97/f78 1255517 0 2024-09-21T12:20:24.010 INFO:tasks.workunit.client.1.smithi192.stdout:0/430: creat d3/d5/d19/d51/f76 x:0 0 0 2024-09-21T12:20:24.011 INFO:tasks.workunit.client.1.smithi192.stdout:5/702: creat d0/d65/d8e/d77/ff3 x:0 0 0 2024-09-21T12:20:24.015 INFO:tasks.workunit.client.1.smithi192.stdout:5/703: truncate d0/d65/d6e/dc0/d44/d85/d97/d35/f87 517623 0 2024-09-21T12:20:24.015 INFO:tasks.workunit.client.1.smithi192.stdout:9/486: rename d5/dc/d80/d44/d79/d3f/d4d/d6d/l81 to d5/dc/l99 0 2024-09-21T12:20:24.015 INFO:tasks.workunit.client.1.smithi192.stdout:0/431: dread d3/d5/d19/d51/f3b [0,4194304] 0 2024-09-21T12:20:24.016 INFO:tasks.workunit.client.1.smithi192.stdout:5/704: write d0/d2/fb2 [1191861,95358] 0 2024-09-21T12:20:24.018 INFO:tasks.workunit.client.1.smithi192.stdout:5/705: symlink d0/d65/d8e/lf4 0 2024-09-21T12:20:24.020 INFO:tasks.workunit.client.1.smithi192.stdout:9/487: dread d5/d8/f22 [0,4194304] 0 2024-09-21T12:20:24.022 INFO:tasks.workunit.client.1.smithi192.stdout:0/432: dwrite d3/d5/d19/f58 [0,4194304] 0 2024-09-21T12:20:24.025 INFO:tasks.workunit.client.1.smithi192.stdout:0/433: write d3/d5/d19/d51/f34 [1301743,108545] 0 2024-09-21T12:20:24.026 INFO:tasks.workunit.client.1.smithi192.stdout:9/488: dwrite d5/d8/f15 [0,4194304] 0 2024-09-21T12:20:24.027 INFO:tasks.workunit.client.1.smithi192.stdout:0/434: readlink d3/de/d33/l45 0 2024-09-21T12:20:24.028 INFO:tasks.workunit.client.1.smithi192.stdout:0/435: stat d3/d5/d19/c1f 0 2024-09-21T12:20:24.030 INFO:tasks.workunit.client.1.smithi192.stdout:9/489: chown d5/c6 84 1 2024-09-21T12:20:24.034 INFO:tasks.workunit.client.1.smithi192.stdout:5/706: write d0/f26 [1228573,81832] 0 2024-09-21T12:20:24.058 INFO:tasks.workunit.client.1.smithi192.stdout:4/443: sync 2024-09-21T12:20:24.058 INFO:tasks.workunit.client.1.smithi192.stdout:6/502: sync 2024-09-21T12:20:24.074 INFO:tasks.workunit.client.1.smithi192.stdout:0/436: getdents d3/de/d33 0 2024-09-21T12:20:24.076 INFO:tasks.workunit.client.1.smithi192.stdout:5/707: rename d0/f7f to d0/d65/d6e/dc0/d44/d85/d97/d35/ff5 0 2024-09-21T12:20:24.116 INFO:tasks.workunit.client.1.smithi192.stdout:6/503: symlink da/d23/d37/d75/d90/la4 0 2024-09-21T12:20:24.116 INFO:tasks.workunit.client.1.smithi192.stdout:9/490: truncate d5/dc/d80/d44/d79/f45 2003003 0 2024-09-21T12:20:24.118 INFO:tasks.workunit.client.1.smithi192.stdout:4/444: dwrite d2/d36/d7f/d68/f78 [0,4194304] 0 2024-09-21T12:20:24.118 INFO:tasks.workunit.client.1.smithi192.stdout:5/708: write d0/d65/d6e/da7/da0/fae [72505,18002] 0 2024-09-21T12:20:24.119 INFO:tasks.workunit.client.1.smithi192.stdout:6/504: dread da/f42 [0,4194304] 0 2024-09-21T12:20:24.122 INFO:tasks.workunit.client.1.smithi192.stdout:6/505: dread da/f57 [0,4194304] 0 2024-09-21T12:20:24.123 INFO:tasks.workunit.client.1.smithi192.stdout:5/709: creat d0/d65/d6e/da7/da0/ff6 x:0 0 0 2024-09-21T12:20:24.123 INFO:tasks.workunit.client.1.smithi192.stdout:4/445: mkdir d2/db/d34/d56/d83/d93 0 2024-09-21T12:20:24.124 INFO:tasks.workunit.client.1.smithi192.stdout:6/506: write da/f4b [698227,71967] 0 2024-09-21T12:20:24.124 INFO:tasks.workunit.client.1.smithi192.stdout:5/710: stat d0/d65/d6e/d91/c95 0 2024-09-21T12:20:24.126 INFO:tasks.workunit.client.1.smithi192.stdout:5/711: write d0/d65/d6e/f34 [1263079,35503] 0 2024-09-21T12:20:24.126 INFO:tasks.workunit.client.1.smithi192.stdout:4/446: creat d2/db/d34/f94 x:0 0 0 2024-09-21T12:20:24.127 INFO:tasks.workunit.client.1.smithi192.stdout:6/507: mknod da/d1f/d48/ca5 0 2024-09-21T12:20:24.127 INFO:tasks.workunit.client.1.smithi192.stdout:5/712: write d0/d65/d6e/f34 [3656979,35059] 0 2024-09-21T12:20:24.129 INFO:tasks.workunit.client.1.smithi192.stdout:6/508: write da/d1f/d56/f83 [262165,66612] 0 2024-09-21T12:20:24.130 INFO:tasks.workunit.client.1.smithi192.stdout:0/437: dread d3/d5/d19/d51/f32 [0,4194304] 0 2024-09-21T12:20:24.130 INFO:tasks.workunit.client.1.smithi192.stdout:6/509: read da/f57 [342193,91832] 0 2024-09-21T12:20:24.131 INFO:tasks.workunit.client.1.smithi192.stdout:5/713: read d0/d65/d6e/dc0/d44/d85/d97/d35/ff5 [1161020,102104] 0 2024-09-21T12:20:24.132 INFO:tasks.workunit.client.1.smithi192.stdout:6/510: write da/f4b [3806326,116020] 0 2024-09-21T12:20:24.132 INFO:tasks.workunit.client.1.smithi192.stdout:5/714: dread - d0/d65/d6e/dc0/fc4 zero size 2024-09-21T12:20:24.132 INFO:tasks.workunit.client.1.smithi192.stdout:6/511: fsync da/d1f/d56/f83 0 2024-09-21T12:20:24.133 INFO:tasks.workunit.client.1.smithi192.stdout:0/438: creat d3/d5/f77 x:0 0 0 2024-09-21T12:20:24.134 INFO:tasks.workunit.client.1.smithi192.stdout:0/439: stat d3/d6/f3f 0 2024-09-21T12:20:24.135 INFO:tasks.workunit.client.1.smithi192.stdout:5/715: symlink d0/dc/d13/d37/lf7 0 2024-09-21T12:20:24.135 INFO:tasks.workunit.client.1.smithi192.stdout:0/440: chown d3/d5/d19/d51/f3b 3100 1 2024-09-21T12:20:24.138 INFO:tasks.workunit.client.1.smithi192.stdout:5/716: chown d0/d65/d6e/dc0/d44/d85/d97/f76 1683363062 1 2024-09-21T12:20:24.139 INFO:tasks.workunit.client.1.smithi192.stdout:6/512: dwrite da/f35 [0,4194304] 0 2024-09-21T12:20:24.139 INFO:tasks.workunit.client.1.smithi192.stdout:4/447: truncate d2/f66 658378 0 2024-09-21T12:20:24.141 INFO:tasks.workunit.client.1.smithi192.stdout:6/513: truncate da/d1f/d27/d6b/f85 182595 0 2024-09-21T12:20:24.142 INFO:tasks.workunit.client.1.smithi192.stdout:5/717: rename d0/d65/c7d to d0/dc/d13/d37/da8/daa/dc5/ddd/cf8 0 2024-09-21T12:20:24.144 INFO:tasks.workunit.client.1.smithi192.stdout:6/514: creat da/d1f/d27/d6b/fa6 x:0 0 0 2024-09-21T12:20:24.146 INFO:tasks.workunit.client.1.smithi192.stdout:4/448: dwrite d2/db/d3e/d57/d32/d4f/f6a [0,4194304] 0 2024-09-21T12:20:24.146 INFO:tasks.workunit.client.1.smithi192.stdout:5/718: mkdir d0/df9 0 2024-09-21T12:20:24.148 INFO:tasks.workunit.client.1.smithi192.stdout:5/719: chown d0/d2/f48 5 1 2024-09-21T12:20:24.150 INFO:tasks.workunit.client.1.smithi192.stdout:8/533: sync 2024-09-21T12:20:24.150 INFO:tasks.workunit.client.1.smithi192.stdout:1/524: sync 2024-09-21T12:20:24.150 INFO:tasks.workunit.client.1.smithi192.stdout:4/449: chown d2/db/d3e/d57/l75 30962068 1 2024-09-21T12:20:24.151 INFO:tasks.workunit.client.1.smithi192.stdout:0/441: dwrite d3/de/d33/f6e [0,4194304] 0 2024-09-21T12:20:24.153 INFO:tasks.workunit.client.1.smithi192.stdout:4/450: truncate d2/d21/f7a 538201 0 2024-09-21T12:20:24.157 INFO:tasks.workunit.client.1.smithi192.stdout:5/720: read d0/d65/d6e/dc0/d44/d85/d97/d35/d79/f46 [135602,123562] 0 2024-09-21T12:20:24.158 INFO:tasks.workunit.client.1.smithi192.stdout:1/525: creat d2/d12/d2f/d81/fab x:0 0 0 2024-09-21T12:20:24.159 INFO:tasks.workunit.client.1.smithi192.stdout:8/534: truncate d14/d1a/d1d/d39/f72 982769 0 2024-09-21T12:20:24.161 INFO:tasks.workunit.client.1.smithi192.stdout:6/515: dwrite da/d1f/d27/d88/f8d [4194304,4194304] 0 2024-09-21T12:20:24.161 INFO:tasks.workunit.client.1.smithi192.stdout:1/526: chown d2/da/f31 67322 1 2024-09-21T12:20:24.161 INFO:tasks.workunit.client.1.smithi192.stdout:5/721: fdatasync d0/d65/d8e/d98/dba/fd9 0 2024-09-21T12:20:24.161 INFO:tasks.workunit.client.1.smithi192.stdout:0/442: creat d3/f78 x:0 0 0 2024-09-21T12:20:24.163 INFO:tasks.workunit.client.1.smithi192.stdout:4/451: getdents d2/db/d34/d56 0 2024-09-21T12:20:24.164 INFO:tasks.workunit.client.1.smithi192.stdout:0/443: write d3/de/d33/f6e [3610274,96291] 0 2024-09-21T12:20:24.164 INFO:tasks.workunit.client.1.smithi192.stdout:6/516: write da/d23/d37/f8e [4949712,96741] 0 2024-09-21T12:20:24.165 INFO:tasks.workunit.client.1.smithi192.stdout:4/452: write d2/f23 [1734570,22701] 0 2024-09-21T12:20:24.165 INFO:tasks.workunit.client.1.smithi192.stdout:5/722: write d0/d65/d6e/dc0/d44/d85/fa6 [6356670,102147] 0 2024-09-21T12:20:24.165 INFO:tasks.workunit.client.1.smithi192.stdout:1/527: write d2/d12/d2f/d41/d5c/f83 [1875135,15942] 0 2024-09-21T12:20:24.168 INFO:tasks.workunit.client.1.smithi192.stdout:1/528: write d2/d12/f3c [868168,104752] 0 2024-09-21T12:20:24.169 INFO:tasks.workunit.client.1.smithi192.stdout:4/453: write d2/df/d52/f8c [365438,114157] 0 2024-09-21T12:20:24.169 INFO:tasks.workunit.client.1.smithi192.stdout:5/723: fsync d0/d65/d6e/dc0/d44/d85/d97/fe0 0 2024-09-21T12:20:24.170 INFO:tasks.workunit.client.1.smithi192.stdout:6/517: mkdir da/d1f/d48/d7d/da7 0 2024-09-21T12:20:24.173 INFO:tasks.workunit.client.1.smithi192.stdout:5/724: fsync d0/d65/d6e/f32 0 2024-09-21T12:20:24.173 INFO:tasks.workunit.client.1.smithi192.stdout:0/444: truncate d3/d6/f5b 866137 0 2024-09-21T12:20:24.174 INFO:tasks.workunit.client.1.smithi192.stdout:1/529: chown d2/l3d 986 1 2024-09-21T12:20:24.174 INFO:tasks.workunit.client.1.smithi192.stdout:4/454: chown d2/d19/f80 0 1 2024-09-21T12:20:24.175 INFO:tasks.workunit.client.1.smithi192.stdout:8/535: dread d14/d1a/d1d/f2b [0,4194304] 0 2024-09-21T12:20:24.176 INFO:tasks.workunit.client.1.smithi192.stdout:6/518: stat da/d23/d37/l5b 0 2024-09-21T12:20:24.179 INFO:tasks.workunit.client.1.smithi192.stdout:4/455: creat d2/db/d34/d56/d83/f95 x:0 0 0 2024-09-21T12:20:24.180 INFO:tasks.workunit.client.1.smithi192.stdout:8/536: mknod d14/d1a/d1d/cae 0 2024-09-21T12:20:24.180 INFO:tasks.workunit.client.1.smithi192.stdout:5/725: dread d0/f7c [0,4194304] 0 2024-09-21T12:20:24.181 INFO:tasks.workunit.client.1.smithi192.stdout:0/445: rename d3/de/d33/c52 to d3/d6/c79 0 2024-09-21T12:20:24.184 INFO:tasks.workunit.client.1.smithi192.stdout:6/519: rename da/d23/d37/c25 to da/d1f/d48/d7d/da7/ca8 0 2024-09-21T12:20:24.184 INFO:tasks.workunit.client.1.smithi192.stdout:5/726: chown d0/d65/d6e/dc0/d44/d85/d97/d35/fb8 1908126 1 2024-09-21T12:20:24.185 INFO:tasks.workunit.client.1.smithi192.stdout:0/446: mkdir d3/d6/d72/d7a 0 2024-09-21T12:20:24.186 INFO:tasks.workunit.client.1.smithi192.stdout:1/530: dwrite d2/d12/d2f/d51/d24/f26 [0,4194304] 0 2024-09-21T12:20:24.188 INFO:tasks.workunit.client.1.smithi192.stdout:8/537: dread d14/d1a/f2e [0,4194304] 0 2024-09-21T12:20:24.188 INFO:tasks.workunit.client.1.smithi192.stdout:4/456: rename d2/df/d52 to d2/db/d3e/d41/d96 0 2024-09-21T12:20:24.190 INFO:tasks.workunit.client.1.smithi192.stdout:5/727: creat d0/d65/d6e/dc0/d44/d85/d97/d45/ffa x:0 0 0 2024-09-21T12:20:24.190 INFO:tasks.workunit.client.1.smithi192.stdout:8/538: chown d14/d1a/d1d/d46/d7e 18898 1 2024-09-21T12:20:24.190 INFO:tasks.workunit.client.1.smithi192.stdout:1/531: mknod d2/d12/d2f/d51/cac 0 2024-09-21T12:20:24.195 INFO:tasks.workunit.client.1.smithi192.stdout:1/532: read d2/da/f31 [2373316,109389] 0 2024-09-21T12:20:24.195 INFO:tasks.workunit.client.1.smithi192.stdout:0/447: dwrite d3/d5/d19/d51/f76 [0,4194304] 0 2024-09-21T12:20:24.196 INFO:tasks.workunit.client.1.smithi192.stdout:6/520: dread da/d1f/d48/f5e [0,4194304] 0 2024-09-21T12:20:24.199 INFO:tasks.workunit.client.1.smithi192.stdout:1/533: dread d2/d4d/f6f [0,4194304] 0 2024-09-21T12:20:24.199 INFO:tasks.workunit.client.1.smithi192.stdout:0/448: mknod d3/d6/d1d/c7b 0 2024-09-21T12:20:24.200 INFO:tasks.workunit.client.1.smithi192.stdout:0/449: chown d3/d5/d28/f56 21829 1 2024-09-21T12:20:24.200 INFO:tasks.workunit.client.1.smithi192.stdout:6/521: mkdir da/d1f/d56/da9 0 2024-09-21T12:20:24.201 INFO:tasks.workunit.client.1.smithi192.stdout:5/728: creat d0/d65/d6e/dc0/d44/ffb x:0 0 0 2024-09-21T12:20:24.202 INFO:tasks.workunit.client.1.smithi192.stdout:5/729: chown d0/dc/d13/d37/fd7 1931649 1 2024-09-21T12:20:24.203 INFO:tasks.workunit.client.1.smithi192.stdout:2/468: sync 2024-09-21T12:20:24.203 INFO:tasks.workunit.client.1.smithi192.stdout:3/424: sync 2024-09-21T12:20:24.203 INFO:tasks.workunit.client.1.smithi192.stdout:7/497: sync 2024-09-21T12:20:24.204 INFO:tasks.workunit.client.1.smithi192.stdout:6/522: mkdir da/d1f/d48/d7d/daa 0 2024-09-21T12:20:24.205 INFO:tasks.workunit.client.1.smithi192.stdout:0/450: symlink d3/d6/l7c 0 2024-09-21T12:20:24.206 INFO:tasks.workunit.client.1.smithi192.stdout:6/523: chown da/d23/d37/c77 4187 1 2024-09-21T12:20:24.208 INFO:tasks.workunit.client.1.smithi192.stdout:1/534: creat d2/da/fad x:0 0 0 2024-09-21T12:20:24.209 INFO:tasks.workunit.client.1.smithi192.stdout:2/469: dwrite f19 [0,4194304] 0 2024-09-21T12:20:24.209 INFO:tasks.workunit.client.1.smithi192.stdout:3/425: rmdir db/d16/d18/d40/d60/d7b 39 2024-09-21T12:20:24.210 INFO:tasks.workunit.client.1.smithi192.stdout:0/451: rmdir d3/d6/d72 39 2024-09-21T12:20:24.210 INFO:tasks.workunit.client.1.smithi192.stdout:2/470: chown fe 6 1 2024-09-21T12:20:24.213 INFO:tasks.workunit.client.1.smithi192.stdout:5/730: write d0/d65/d6e/dc0/d44/d85/d97/f5c [1528431,114066] 0 2024-09-21T12:20:24.215 INFO:tasks.workunit.client.1.smithi192.stdout:7/498: mkdir d6/d20/d69/d90/da7/db3 0 2024-09-21T12:20:24.218 INFO:tasks.workunit.client.1.smithi192.stdout:1/535: truncate d2/da/f27 2623537 0 2024-09-21T12:20:24.220 INFO:tasks.workunit.client.1.smithi192.stdout:2/471: read d1b/f2a [1077252,24903] 0 2024-09-21T12:20:24.220 INFO:tasks.workunit.client.1.smithi192.stdout:3/426: readlink db/d16/d18/d33/d88/l89 0 2024-09-21T12:20:24.222 INFO:tasks.workunit.client.1.smithi192.stdout:0/452: unlink d3/d5/d28/l57 0 2024-09-21T12:20:24.224 INFO:tasks.workunit.client.1.smithi192.stdout:5/731: rmdir d0/d65/d6e/dc0/d44/d85/d97 39 2024-09-21T12:20:24.225 INFO:tasks.workunit.client.1.smithi192.stdout:7/499: symlink d6/d9/d1f/d3e/d7a/d8a/da2/lb4 0 2024-09-21T12:20:24.226 INFO:tasks.workunit.client.1.smithi192.stdout:4/457: write d2/df/f5d [4894299,7034] 0 2024-09-21T12:20:24.227 INFO:tasks.workunit.client.1.smithi192.stdout:2/472: dwrite f19 [0,4194304] 0 2024-09-21T12:20:24.229 INFO:tasks.workunit.client.1.smithi192.stdout:3/427: write db/d16/d18/d33/f83 [780120,49222] 0 2024-09-21T12:20:24.230 INFO:tasks.workunit.client.1.smithi192.stdout:4/458: dread d2/d21/f7a [0,4194304] 0 2024-09-21T12:20:24.230 INFO:tasks.workunit.client.1.smithi192.stdout:5/732: mknod d0/d2/d7b/da5/cfc 0 2024-09-21T12:20:24.233 INFO:tasks.workunit.client.1.smithi192.stdout:2/473: chown d1b/f52 1006135272 1 2024-09-21T12:20:24.233 INFO:tasks.workunit.client.1.smithi192.stdout:3/428: rename db to db/d16/d18/d21/d23/d71/d77/d9c 22 2024-09-21T12:20:24.238 INFO:tasks.workunit.client.1.smithi192.stdout:6/524: link da/fc da/d1f/fab 0 2024-09-21T12:20:24.238 INFO:tasks.workunit.client.1.smithi192.stdout:8/539: dwrite d14/d1a/d1d/f64 [0,4194304] 0 2024-09-21T12:20:24.239 INFO:tasks.workunit.client.1.smithi192.stdout:0/453: creat d3/f7d x:0 0 0 2024-09-21T12:20:24.240 INFO:tasks.workunit.client.1.smithi192.stdout:5/733: creat d0/dc/d13/d37/db4/ffd x:0 0 0 2024-09-21T12:20:24.241 INFO:tasks.workunit.client.1.smithi192.stdout:4/459: truncate d2/f66 535654 0 2024-09-21T12:20:24.241 INFO:tasks.workunit.client.1.smithi192.stdout:3/429: mknod db/d16/d18/d40/d60/c9d 0 2024-09-21T12:20:24.242 INFO:tasks.workunit.client.1.smithi192.stdout:6/525: write da/d1f/d27/d6b/f9c [118020,117017] 0 2024-09-21T12:20:24.243 INFO:tasks.workunit.client.1.smithi192.stdout:1/536: dread d2/da/fc [0,4194304] 0 2024-09-21T12:20:24.243 INFO:tasks.workunit.client.1.smithi192.stdout:8/540: mkdir d14/d18/daf 0 2024-09-21T12:20:24.246 INFO:tasks.workunit.client.1.smithi192.stdout:1/537: chown d2/d12/d2f/d41/d5c/d8a 0 1 2024-09-21T12:20:24.246 INFO:tasks.workunit.client.1.smithi192.stdout:0/454: truncate d3/f78 251717 0 2024-09-21T12:20:24.247 INFO:tasks.workunit.client.1.smithi192.stdout:2/474: dwrite d1b/d1e/d7b/f8a [0,4194304] 0 2024-09-21T12:20:24.247 INFO:tasks.workunit.client.1.smithi192.stdout:5/734: creat d0/d2/d7b/da5/ffe x:0 0 0 2024-09-21T12:20:24.266 INFO:tasks.workunit.client.1.smithi192.stdout:6/526: symlink da/lac 0 2024-09-21T12:20:24.267 INFO:tasks.workunit.client.1.smithi192.stdout:3/430: write db/d16/d61/d2e/f72 [228342,96276] 0 2024-09-21T12:20:24.268 INFO:tasks.workunit.client.1.smithi192.stdout:7/500: truncate d6/d9/d51/f4b 1339437 0 2024-09-21T12:20:24.270 INFO:tasks.workunit.client.1.smithi192.stdout:8/541: truncate d14/d18/f33 3790657 0 2024-09-21T12:20:24.270 INFO:tasks.workunit.client.1.smithi192.stdout:0/455: unlink d3/de/d33/f35 0 2024-09-21T12:20:24.271 INFO:tasks.workunit.client.1.smithi192.stdout:5/735: mknod d0/d2/cff 0 2024-09-21T12:20:24.274 INFO:tasks.workunit.client.1.smithi192.stdout:2/475: mkdir d1b/d1e/d5e/d75/d93 0 2024-09-21T12:20:24.279 INFO:tasks.workunit.client.1.smithi192.stdout:7/501: creat d6/d9/d1f/d3e/d7a/d8a/da2/fb5 x:0 0 0 2024-09-21T12:20:24.283 INFO:tasks.workunit.client.1.smithi192.stdout:5/736: read d0/d65/d6e/dc0/d44/d85/d97/f76 [881839,120797] 0 2024-09-21T12:20:24.284 INFO:tasks.workunit.client.1.smithi192.stdout:6/527: dwrite da/f42 [0,4194304] 0 2024-09-21T12:20:24.285 INFO:tasks.workunit.client.1.smithi192.stdout:7/502: creat d6/d20/d69/fb6 x:0 0 0 2024-09-21T12:20:24.286 INFO:tasks.workunit.client.1.smithi192.stdout:8/542: mkdir d14/d1a/d1d/d51/d80/d9a/db0 0 2024-09-21T12:20:24.287 INFO:tasks.workunit.client.1.smithi192.stdout:8/543: dread d14/d1a/d1d/d48/f6f [0,4194304] 0 2024-09-21T12:20:24.288 INFO:tasks.workunit.client.1.smithi192.stdout:0/456: rename d3/d5/d19/f4f to d3/d6/d72/d7a/f7e 0 2024-09-21T12:20:24.291 INFO:tasks.workunit.client.1.smithi192.stdout:1/538: rmdir d2/d12/d2f/d41/d5c/d8a 0 2024-09-21T12:20:24.291 INFO:tasks.workunit.client.1.smithi192.stdout:8/544: dread d14/d18/f28 [0,4194304] 0 2024-09-21T12:20:24.294 INFO:tasks.workunit.client.1.smithi192.stdout:3/431: truncate db/d16/d18/d33/f83 651002 0 2024-09-21T12:20:24.294 INFO:tasks.workunit.client.1.smithi192.stdout:3/432: fdatasync db/d16/d18/f74 0 2024-09-21T12:20:24.294 INFO:tasks.workunit.client.1.smithi192.stdout:5/737: dread d0/f7c [0,4194304] 0 2024-09-21T12:20:24.295 INFO:tasks.workunit.client.1.smithi192.stdout:6/528: creat da/d1f/d48/d7d/da7/fad x:0 0 0 2024-09-21T12:20:24.295 INFO:tasks.workunit.client.1.smithi192.stdout:3/433: fdatasync db/d16/d18/f3a 0 2024-09-21T12:20:24.296 INFO:tasks.workunit.client.1.smithi192.stdout:3/434: chown db/d16/l4b 4 1 2024-09-21T12:20:24.300 INFO:tasks.workunit.client.1.smithi192.stdout:2/476: rename d1b/d38/d53/f73 to d1b/d1e/d5e/d75/d8d/f94 0 2024-09-21T12:20:24.307 INFO:tasks.workunit.client.1.smithi192.stdout:7/503: dwrite d6/d9/d2d/f5a [8388608,4194304] 0 2024-09-21T12:20:24.308 INFO:tasks.workunit.client.1.smithi192.stdout:3/435: creat db/d16/d18/d33/d3b/d68/f9e x:0 0 0 2024-09-21T12:20:24.309 INFO:tasks.workunit.client.1.smithi192.stdout:6/529: write da/d1f/f5c [3039660,80638] 0 2024-09-21T12:20:24.310 INFO:tasks.workunit.client.1.smithi192.stdout:9/491: sync 2024-09-21T12:20:24.311 INFO:tasks.workunit.client.1.smithi192.stdout:9/492: chown d5/f33 47 1 2024-09-21T12:20:24.311 INFO:tasks.workunit.client.1.smithi192.stdout:2/477: truncate d1b/f1d 4620065 0 2024-09-21T12:20:24.313 INFO:tasks.workunit.client.1.smithi192.stdout:1/539: mkdir d2/dae 0 2024-09-21T12:20:24.317 INFO:tasks.workunit.client.1.smithi192.stdout:7/504: rename d6/d3a/d6d/f7e to d6/d9/d70/d77/fb7 0 2024-09-21T12:20:24.319 INFO:tasks.workunit.client.1.smithi192.stdout:7/505: write d6/d9/d70/d77/f91 [1375543,17706] 0 2024-09-21T12:20:24.321 INFO:tasks.workunit.client.1.smithi192.stdout:2/478: write d1b/f27 [1036727,107393] 0 2024-09-21T12:20:24.321 INFO:tasks.workunit.client.1.smithi192.stdout:0/457: truncate d3/f78 120915 0 2024-09-21T12:20:24.322 INFO:tasks.workunit.client.1.smithi192.stdout:8/545: write d14/d1a/d1d/d46/f73 [1012942,21382] 0 2024-09-21T12:20:24.323 INFO:tasks.workunit.client.1.smithi192.stdout:8/546: fdatasync d14/d1a/d1d/f58 0 2024-09-21T12:20:24.325 INFO:tasks.workunit.client.1.smithi192.stdout:9/493: rename d5/dc/d80/d5a/d83/f91 to d5/dc/d80/d44/d79/d3f/f9a 0 2024-09-21T12:20:24.325 INFO:tasks.workunit.client.1.smithi192.stdout:9/494: chown d5/d19/d32/l63 2 1 2024-09-21T12:20:24.326 INFO:tasks.workunit.client.1.smithi192.stdout:6/530: creat da/d1f/d48/d9f/fae x:0 0 0 2024-09-21T12:20:24.334 INFO:tasks.workunit.client.1.smithi192.stdout:5/738: getdents d0/dc/d13/d37/d38 0 2024-09-21T12:20:24.336 INFO:tasks.workunit.client.1.smithi192.stdout:8/547: creat d14/d1a/d1d/d46/d7e/d8e/fb1 x:0 0 0 2024-09-21T12:20:24.338 INFO:tasks.workunit.client.1.smithi192.stdout:7/506: dread d6/d9/d51/f32 [0,4194304] 0 2024-09-21T12:20:24.338 INFO:tasks.workunit.client.1.smithi192.stdout:9/495: unlink d5/dc/d80/d44/d79/d3f/d4d/d6d/f88 0 2024-09-21T12:20:24.340 INFO:tasks.workunit.client.1.smithi192.stdout:6/531: creat da/d1f/d56/d78/faf x:0 0 0 2024-09-21T12:20:24.345 INFO:tasks.workunit.client.1.smithi192.stdout:8/548: mknod d14/d1a/d1d/d51/d80/d9a/cb2 0 2024-09-21T12:20:24.346 INFO:tasks.workunit.client.1.smithi192.stdout:7/507: symlink d6/d9/d70/d77/lb8 0 2024-09-21T12:20:24.349 INFO:tasks.workunit.client.1.smithi192.stdout:6/532: rmdir da/d1f/d27/d88 39 2024-09-21T12:20:24.349 INFO:tasks.workunit.client.1.smithi192.stdout:3/436: link db/d16/d18/d33/d3b/l5b db/d16/d18/d21/d23/l9f 0 2024-09-21T12:20:24.350 INFO:tasks.workunit.client.1.smithi192.stdout:1/540: getdents d2/d4d 0 2024-09-21T12:20:24.351 INFO:tasks.workunit.client.1.smithi192.stdout:0/458: creat d3/f7f x:0 0 0 2024-09-21T12:20:24.352 INFO:tasks.workunit.client.1.smithi192.stdout:4/460: sync 2024-09-21T12:20:24.352 INFO:tasks.workunit.client.1.smithi192.stdout:2/479: rmdir d1b/d1e/d5e/d75/d93 0 2024-09-21T12:20:24.353 INFO:tasks.workunit.client.1.smithi192.stdout:7/508: unlink d6/d3a/d6d/l98 0 2024-09-21T12:20:24.354 INFO:tasks.workunit.client.1.smithi192.stdout:9/496: mknod d5/dc/d64/c9b 0 2024-09-21T12:20:24.355 INFO:tasks.workunit.client.1.smithi192.stdout:0/459: creat d3/d5/f80 x:0 0 0 2024-09-21T12:20:24.355 INFO:tasks.workunit.client.1.smithi192.stdout:8/549: symlink d14/d1a/d1d/lb3 0 2024-09-21T12:20:24.356 INFO:tasks.workunit.client.1.smithi192.stdout:2/480: rmdir d1b/d1e/d5e 39 2024-09-21T12:20:24.357 INFO:tasks.workunit.client.1.smithi192.stdout:5/739: dwrite d0/f7c [0,4194304] 0 2024-09-21T12:20:24.358 INFO:tasks.workunit.client.1.smithi192.stdout:9/497: stat d5/d21/d66/d53/d6e/l84 0 2024-09-21T12:20:24.358 INFO:tasks.workunit.client.1.smithi192.stdout:1/541: link d2/f3e d2/d12/d2f/d41/d61/faf 0 2024-09-21T12:20:24.358 INFO:tasks.workunit.client.1.smithi192.stdout:2/481: read - d1b/d1e/f30 zero size 2024-09-21T12:20:24.359 INFO:tasks.workunit.client.1.smithi192.stdout:7/509: fdatasync d6/d9/d2d/d7b/f97 0 2024-09-21T12:20:24.360 INFO:tasks.workunit.client.1.smithi192.stdout:3/437: dread db/d16/d18/d21/d23/f50 [0,4194304] 0 2024-09-21T12:20:24.360 INFO:tasks.workunit.client.1.smithi192.stdout:8/550: chown d14/d1a/d1d/d46/d7e/d8e/la7 7 1 2024-09-21T12:20:24.361 INFO:tasks.workunit.client.1.smithi192.stdout:6/533: link da/cb da/d1f/d56/cb0 0 2024-09-21T12:20:24.362 INFO:tasks.workunit.client.1.smithi192.stdout:4/461: rename d2/db/d34/d56/d6c/l81 to d2/db/d3e/d41/d96/d88/d92/l97 0 2024-09-21T12:20:24.364 INFO:tasks.workunit.client.1.smithi192.stdout:7/510: write d6/d9/f1c [6413121,95832] 0 2024-09-21T12:20:24.365 INFO:tasks.workunit.client.1.smithi192.stdout:7/511: read - d6/d9/d2d/d7b/fa1 zero size 2024-09-21T12:20:24.366 INFO:tasks.workunit.client.1.smithi192.stdout:5/740: symlink d0/d65/d6e/dbc/dc8/l100 0 2024-09-21T12:20:24.368 INFO:tasks.workunit.client.1.smithi192.stdout:8/551: readlink d14/d1a/d1d/l61 0 2024-09-21T12:20:24.370 INFO:tasks.workunit.client.1.smithi192.stdout:1/542: rename d2/da/f84 to d2/d12/d2f/d41/fb0 0 2024-09-21T12:20:24.372 INFO:tasks.workunit.client.1.smithi192.stdout:7/512: dwrite d6/f10 [4194304,4194304] 0 2024-09-21T12:20:24.374 INFO:tasks.workunit.client.1.smithi192.stdout:4/462: mknod d2/d19/c98 0 2024-09-21T12:20:24.374 INFO:tasks.workunit.client.1.smithi192.stdout:0/460: getdents d3 0 2024-09-21T12:20:24.375 INFO:tasks.workunit.client.1.smithi192.stdout:6/534: getdents da/d1f/d56/da9 0 2024-09-21T12:20:24.376 INFO:tasks.workunit.client.1.smithi192.stdout:4/463: read d2/d36/d7f/d68/f78 [1732516,110030] 0 2024-09-21T12:20:24.376 INFO:tasks.workunit.client.1.smithi192.stdout:9/498: rmdir d5/dc/d40/d97 0 2024-09-21T12:20:24.378 INFO:tasks.workunit.client.1.smithi192.stdout:5/741: unlink d0/dc/d13/c5f 0 2024-09-21T12:20:24.378 INFO:tasks.workunit.client.1.smithi192.stdout:0/461: truncate d3/de/d33/f5e 3568 0 2024-09-21T12:20:24.378 INFO:tasks.workunit.client.1.smithi192.stdout:7/513: rmdir d6/d20/d69/d90/da7 39 2024-09-21T12:20:24.378 INFO:tasks.workunit.client.1.smithi192.stdout:4/464: chown d2/db/d3e/d57/f72 10125079 1 2024-09-21T12:20:24.379 INFO:tasks.workunit.client.1.smithi192.stdout:8/552: mkdir d14/d1a/d1d/db4 0 2024-09-21T12:20:24.381 INFO:tasks.workunit.client.1.smithi192.stdout:3/438: symlink db/d16/d18/d40/d60/d7b/d7c/d8c/la0 0 2024-09-21T12:20:24.382 INFO:tasks.workunit.client.1.smithi192.stdout:1/543: mknod d2/da/cb1 0 2024-09-21T12:20:24.383 INFO:tasks.workunit.client.1.smithi192.stdout:9/499: rmdir d5/d8/d2c 39 2024-09-21T12:20:24.383 INFO:tasks.workunit.client.1.smithi192.stdout:9/500: stat d5/dc 0 2024-09-21T12:20:24.386 INFO:tasks.workunit.client.1.smithi192.stdout:6/535: stat da/d1f/d48/l63 0 2024-09-21T12:20:24.386 INFO:tasks.workunit.client.1.smithi192.stdout:4/465: mkdir d2/db/d3e/d41/d96/d99 0 2024-09-21T12:20:24.388 INFO:tasks.workunit.client.1.smithi192.stdout:2/482: truncate d1b/f57 363742 0 2024-09-21T12:20:24.388 INFO:tasks.workunit.client.1.smithi192.stdout:8/553: unlink d14/l78 0 2024-09-21T12:20:24.389 INFO:tasks.workunit.client.1.smithi192.stdout:5/742: dread d0/dc/f6f [0,4194304] 0 2024-09-21T12:20:24.390 INFO:tasks.workunit.client.1.smithi192.stdout:1/544: dwrite d2/d12/d2f/d41/d5c/f83 [0,4194304] 0 2024-09-21T12:20:24.390 INFO:tasks.workunit.client.1.smithi192.stdout:3/439: rmdir db 39 2024-09-21T12:20:24.391 INFO:tasks.workunit.client.1.smithi192.stdout:1/545: write d2/d12/f3c [1312845,100820] 0 2024-09-21T12:20:24.392 INFO:tasks.workunit.client.1.smithi192.stdout:8/554: dread d14/d1a/d1d/d46/f4f [0,4194304] 0 2024-09-21T12:20:24.393 INFO:tasks.workunit.client.1.smithi192.stdout:9/501: creat d5/d21/d66/f9c x:0 0 0 2024-09-21T12:20:24.397 INFO:tasks.workunit.client.1.smithi192.stdout:2/483: fsync d1b/f6b 0 2024-09-21T12:20:24.398 INFO:tasks.workunit.client.1.smithi192.stdout:9/502: fdatasync d5/dc/d80/d44/d79/f43 0 2024-09-21T12:20:24.398 INFO:tasks.workunit.client.1.smithi192.stdout:8/555: truncate d14/d1a/d1d/d20/f44 2212201 0 2024-09-21T12:20:24.400 INFO:tasks.workunit.client.1.smithi192.stdout:5/743: dwrite d0/d2/fb2 [0,4194304] 0 2024-09-21T12:20:24.402 INFO:tasks.workunit.client.1.smithi192.stdout:0/462: unlink d3/d5/d28/d39/d50/l71 0 2024-09-21T12:20:24.403 INFO:tasks.workunit.client.1.smithi192.stdout:0/463: chown d3/de/d43/c44 3035 1 2024-09-21T12:20:24.405 INFO:tasks.workunit.client.1.smithi192.stdout:4/466: link d2/d36/d55/d89/f8f d2/db/d34/d56/f9a 0 2024-09-21T12:20:24.432 INFO:tasks.workunit.client.1.smithi192.stdout:1/546: dwrite d2/d12/d2f/d51/d24/f35 [0,4194304] 0 2024-09-21T12:20:24.432 INFO:tasks.workunit.client.1.smithi192.stdout:7/514: truncate d6/d9/d2d/f5a 1747253 0 2024-09-21T12:20:24.436 INFO:tasks.workunit.client.1.smithi192.stdout:5/744: readlink d0/d65/d6e/l9d 0 2024-09-21T12:20:24.436 INFO:tasks.workunit.client.1.smithi192.stdout:1/547: fsync d2/d12/d2f/d51/d24/d65/f53 0 2024-09-21T12:20:24.437 INFO:tasks.workunit.client.1.smithi192.stdout:4/467: creat d2/db/d3e/d41/d96/d88/d92/f9b x:0 0 0 2024-09-21T12:20:24.437 INFO:tasks.workunit.client.1.smithi192.stdout:7/515: rmdir d6/d20/d69/d90 39 2024-09-21T12:20:24.438 INFO:tasks.workunit.client.1.smithi192.stdout:6/536: getdents da/d1f/d27/d3e 0 2024-09-21T12:20:24.438 INFO:tasks.workunit.client.1.smithi192.stdout:0/464: dread d3/d5/d19/f58 [0,4194304] 0 2024-09-21T12:20:24.439 INFO:tasks.workunit.client.1.smithi192.stdout:6/537: fsync f8 0 2024-09-21T12:20:24.439 INFO:tasks.workunit.client.1.smithi192.stdout:7/516: dread - d6/d20/f4d zero size 2024-09-21T12:20:24.444 INFO:tasks.workunit.client.1.smithi192.stdout:2/484: mkdir d1b/d1e/d5e/d88/d95 0 2024-09-21T12:20:24.446 INFO:tasks.workunit.client.1.smithi192.stdout:1/548: dwrite d2/d12/f94 [0,4194304] 0 2024-09-21T12:20:24.446 INFO:tasks.workunit.client.1.smithi192.stdout:3/440: rename db/d16/d61/f5e to db/d16/d18/d33/fa1 0 2024-09-21T12:20:24.450 INFO:tasks.workunit.client.1.smithi192.stdout:7/517: mkdir d6/d9/d1f/db9 0 2024-09-21T12:20:24.450 INFO:tasks.workunit.client.1.smithi192.stdout:4/468: mkdir d2/d19/d9c 0 2024-09-21T12:20:24.453 INFO:tasks.workunit.client.1.smithi192.stdout:3/441: chown f8 732376 1 2024-09-21T12:20:24.453 INFO:tasks.workunit.client.1.smithi192.stdout:5/745: rename d0/dc/d13/d37/d38 to d0/dc/d13/d37/da8/daa/d101 0 2024-09-21T12:20:24.454 INFO:tasks.workunit.client.1.smithi192.stdout:6/538: dwrite da/d1f/d48/f64 [0,4194304] 0 2024-09-21T12:20:24.455 INFO:tasks.workunit.client.1.smithi192.stdout:9/503: dwrite d5/dc/d80/d44/d79/f45 [0,4194304] 0 2024-09-21T12:20:24.456 INFO:tasks.workunit.client.1.smithi192.stdout:7/518: write d6/d9/d2d/d7b/f9e [1042140,69106] 0 2024-09-21T12:20:24.458 INFO:tasks.workunit.client.1.smithi192.stdout:1/549: truncate d2/d12/d2f/f4a 1524515 0 2024-09-21T12:20:24.460 INFO:tasks.workunit.client.1.smithi192.stdout:0/465: dread d3/d5/d28/f56 [0,4194304] 0 2024-09-21T12:20:24.460 INFO:tasks.workunit.client.1.smithi192.stdout:1/550: chown d2/d82 12452 1 2024-09-21T12:20:24.460 INFO:tasks.workunit.client.1.smithi192.stdout:4/469: mkdir d2/db/d3e/d57/d32/d4f/d71/d9d 0 2024-09-21T12:20:24.463 INFO:tasks.workunit.client.1.smithi192.stdout:9/504: rmdir d5/d19/d32 39 2024-09-21T12:20:24.463 INFO:tasks.workunit.client.1.smithi192.stdout:4/470: chown d2/db/d34/d56/d6c/f6e 9212186 1 2024-09-21T12:20:24.464 INFO:tasks.workunit.client.1.smithi192.stdout:7/519: rmdir d6/d9/d70/d77 39 2024-09-21T12:20:24.470 INFO:tasks.workunit.client.1.smithi192.stdout:0/466: mkdir d3/d6/d72/d81 0 2024-09-21T12:20:24.471 INFO:tasks.workunit.client.1.smithi192.stdout:0/467: read d3/d5/d19/d51/f3b [348,125468] 0 2024-09-21T12:20:24.472 INFO:tasks.workunit.client.1.smithi192.stdout:7/520: mkdir d6/d3a/dba 0 2024-09-21T12:20:24.475 INFO:tasks.workunit.client.1.smithi192.stdout:2/485: rename d1b/f1d to d1b/d38/f96 0 2024-09-21T12:20:24.476 INFO:tasks.workunit.client.1.smithi192.stdout:1/551: symlink d2/lb2 0 2024-09-21T12:20:24.477 INFO:tasks.workunit.client.1.smithi192.stdout:6/539: creat da/d1f/d27/fb1 x:0 0 0 2024-09-21T12:20:24.477 INFO:tasks.workunit.client.1.smithi192.stdout:4/471: mkdir d2/d19/d9c/d9e 0 2024-09-21T12:20:24.478 INFO:tasks.workunit.client.1.smithi192.stdout:3/442: creat db/d16/d18/d40/d60/d7b/d7c/fa2 x:0 0 0 2024-09-21T12:20:24.479 INFO:tasks.workunit.client.1.smithi192.stdout:4/472: write d2/db/d3e/d41/d96/f8c [52022,40185] 0 2024-09-21T12:20:24.479 INFO:tasks.workunit.client.1.smithi192.stdout:7/521: fsync d6/d9/d70/d77/fb0 0 2024-09-21T12:20:24.480 INFO:tasks.workunit.client.1.smithi192.stdout:4/473: chown d2/db/d34/d56/c76 506739 1 2024-09-21T12:20:24.481 INFO:tasks.workunit.client.1.smithi192.stdout:5/746: rename d0/dc/d13/d37/f56 to d0/d65/d6e/dc0/f102 0 2024-09-21T12:20:24.482 INFO:tasks.workunit.client.1.smithi192.stdout:9/505: creat d5/f9d x:0 0 0 2024-09-21T12:20:24.489 INFO:tasks.workunit.client.1.smithi192.stdout:1/552: rename d2/d12/d2f/d51/d24/c3f to d2/d4d/cb3 0 2024-09-21T12:20:24.489 INFO:tasks.workunit.client.1.smithi192.stdout:5/747: rmdir d0/d2/d7b/da5 39 2024-09-21T12:20:24.491 INFO:tasks.workunit.client.1.smithi192.stdout:9/506: creat d5/dc/d80/d5a/f9e x:0 0 0 2024-09-21T12:20:24.497 INFO:tasks.workunit.client.1.smithi192.stdout:5/748: symlink d0/d65/d6e/dc0/l103 0 2024-09-21T12:20:24.497 INFO:tasks.workunit.client.1.smithi192.stdout:5/749: dread - d0/d65/fdf zero size 2024-09-21T12:20:24.498 INFO:tasks.workunit.client.1.smithi192.stdout:9/507: creat d5/d21/f9f x:0 0 0 2024-09-21T12:20:24.498 INFO:tasks.workunit.client.1.smithi192.stdout:0/468: link d3/de/d43/f54 d3/d5/d19/d51/f82 0 2024-09-21T12:20:24.501 INFO:tasks.workunit.client.1.smithi192.stdout:1/553: mknod d2/dae/cb4 0 2024-09-21T12:20:24.502 INFO:tasks.workunit.client.1.smithi192.stdout:6/540: getdents da/d1f/d27 0 2024-09-21T12:20:24.502 INFO:tasks.workunit.client.1.smithi192.stdout:9/508: dread d5/dc/d80/d44/f90 [0,4194304] 0 2024-09-21T12:20:24.503 INFO:tasks.workunit.client.1.smithi192.stdout:4/474: getdents d2/db/d3e/d41 0 2024-09-21T12:20:24.505 INFO:tasks.workunit.client.1.smithi192.stdout:6/541: readlink da/d1f/d56/la0 0 2024-09-21T12:20:24.505 INFO:tasks.workunit.client.1.smithi192.stdout:1/554: mknod d2/da/d89/cb5 0 2024-09-21T12:20:24.507 INFO:tasks.workunit.client.1.smithi192.stdout:2/486: truncate d1b/f45 3671433 0 2024-09-21T12:20:24.510 INFO:tasks.workunit.client.1.smithi192.stdout:3/443: dwrite db/d16/d18/d33/f83 [0,4194304] 0 2024-09-21T12:20:24.514 INFO:tasks.workunit.client.1.smithi192.stdout:4/475: creat d2/db/d3e/d57/f9f x:0 0 0 2024-09-21T12:20:24.514 INFO:tasks.workunit.client.1.smithi192.stdout:6/542: mknod da/d1f/d48/d7d/daa/cb2 0 2024-09-21T12:20:24.519 INFO:tasks.workunit.client.1.smithi192.stdout:5/750: dwrite d0/d65/d6e/fb3 [0,4194304] 0 2024-09-21T12:20:24.520 INFO:tasks.workunit.client.1.smithi192.stdout:2/487: chown d1b/d1e/d5e/d75/d8d/l91 208 1 2024-09-21T12:20:24.520 INFO:tasks.workunit.client.1.smithi192.stdout:0/469: dwrite d3/de/f11 [0,4194304] 0 2024-09-21T12:20:24.521 INFO:tasks.workunit.client.1.smithi192.stdout:4/476: chown d2/db/d34/d56 5 1 2024-09-21T12:20:24.524 INFO:tasks.workunit.client.1.smithi192.stdout:9/509: dwrite d5/d8/f22 [0,4194304] 0 2024-09-21T12:20:24.524 INFO:tasks.workunit.client.1.smithi192.stdout:3/444: truncate db/d16/d18/d40/f51 5182703 0 2024-09-21T12:20:24.525 INFO:tasks.workunit.client.1.smithi192.stdout:6/543: mknod da/d1f/d27/d3e/cb3 0 2024-09-21T12:20:24.526 INFO:tasks.workunit.client.1.smithi192.stdout:0/470: chown d3/d6/d72/d81 1199 1 2024-09-21T12:20:24.527 INFO:tasks.workunit.client.1.smithi192.stdout:5/751: readlink d0/dc/d13/d37/da8/daa/dc5/ld6 0 2024-09-21T12:20:24.529 INFO:tasks.workunit.client.1.smithi192.stdout:2/488: symlink d1b/d1e/d5e/d75/d8d/l97 0 2024-09-21T12:20:24.531 INFO:tasks.workunit.client.1.smithi192.stdout:4/477: symlink d2/db/d3e/d57/d32/d4f/d71/la0 0 2024-09-21T12:20:24.531 INFO:tasks.workunit.client.1.smithi192.stdout:0/471: write d3/d5/f80 [345162,50666] 0 2024-09-21T12:20:24.531 INFO:tasks.workunit.client.1.smithi192.stdout:1/555: dwrite d2/da/d9f/f67 [4194304,4194304] 0 2024-09-21T12:20:24.532 INFO:tasks.workunit.client.1.smithi192.stdout:3/445: creat db/d16/d18/d40/fa3 x:0 0 0 2024-09-21T12:20:24.533 INFO:tasks.workunit.client.1.smithi192.stdout:9/510: mkdir d5/dc/d80/d44/d79/d55/d70/da0 0 2024-09-21T12:20:24.534 INFO:tasks.workunit.client.1.smithi192.stdout:5/752: rmdir d0/d65/d6e/dc0/d44 39 2024-09-21T12:20:24.536 INFO:tasks.workunit.client.1.smithi192.stdout:3/446: write db/d16/d61/d2e/f72 [776673,98315] 0 2024-09-21T12:20:24.540 INFO:tasks.workunit.client.1.smithi192.stdout:4/478: creat d2/db/d3e/d57/d32/d4f/d82/fa1 x:0 0 0 2024-09-21T12:20:24.541 INFO:tasks.workunit.client.1.smithi192.stdout:6/544: link da/d23/d37/c38 da/d23/d37/d75/d90/cb4 0 2024-09-21T12:20:24.543 INFO:tasks.workunit.client.1.smithi192.stdout:1/556: mkdir d2/d12/d2f/d51/d24/d65/d8e/d9d/db6 0 2024-09-21T12:20:24.544 INFO:tasks.workunit.client.1.smithi192.stdout:4/479: stat d2/d19/l48 0 2024-09-21T12:20:24.546 INFO:tasks.workunit.client.1.smithi192.stdout:3/447: write db/d16/d18/d40/f6e [6594,16397] 0 2024-09-21T12:20:24.547 INFO:tasks.workunit.client.1.smithi192.stdout:5/753: dread d0/d65/d6e/f92 [0,4194304] 0 2024-09-21T12:20:24.556 INFO:tasks.workunit.client.1.smithi192.stdout:0/472: dwrite d3/f7d [0,4194304] 0 2024-09-21T12:20:24.557 INFO:tasks.workunit.client.1.smithi192.stdout:6/545: creat da/d23/d37/fb5 x:0 0 0 2024-09-21T12:20:24.557 INFO:tasks.workunit.client.1.smithi192.stdout:9/511: dwrite d5/d19/f7f [0,4194304] 0 2024-09-21T12:20:24.559 INFO:tasks.workunit.client.1.smithi192.stdout:0/473: stat d3/d5/d19/c1f 0 2024-09-21T12:20:24.559 INFO:tasks.workunit.client.1.smithi192.stdout:4/480: mknod d2/db/d34/d56/d6c/ca2 0 2024-09-21T12:20:24.562 INFO:tasks.workunit.client.1.smithi192.stdout:6/546: rename da/ce to da/d1f/d48/d7d/cb6 0 2024-09-21T12:20:24.562 INFO:tasks.workunit.client.1.smithi192.stdout:4/481: chown d2/db/d34/d56/d83/d93 56133 1 2024-09-21T12:20:24.563 INFO:tasks.workunit.client.1.smithi192.stdout:3/448: creat db/d16/d18/d33/fa4 x:0 0 0 2024-09-21T12:20:24.563 INFO:tasks.workunit.client.1.smithi192.stdout:9/512: rmdir d5/dc/d80/d44/d79/d3f/d4d 39 2024-09-21T12:20:24.564 INFO:tasks.workunit.client.1.smithi192.stdout:1/557: getdents d2/d12/d2f/d41 0 2024-09-21T12:20:24.565 INFO:tasks.workunit.client.1.smithi192.stdout:0/474: mkdir d3/d6/d83 0 2024-09-21T12:20:24.566 INFO:tasks.workunit.client.1.smithi192.stdout:3/449: chown db/d16/d18/d33/d3b/f3f 1 1 2024-09-21T12:20:24.567 INFO:tasks.workunit.client.1.smithi192.stdout:9/513: write d5/dc/d80/d44/d79/f45 [4276924,80163] 0 2024-09-21T12:20:24.571 INFO:tasks.workunit.client.1.smithi192.stdout:6/547: creat da/d1f/fb7 x:0 0 0 2024-09-21T12:20:24.575 INFO:tasks.workunit.client.1.smithi192.stdout:3/450: dwrite db/d16/d18/d40/d60/d7b/d7c/d8c/f8d [0,4194304] 0 2024-09-21T12:20:24.576 INFO:tasks.workunit.client.1.smithi192.stdout:5/754: rename d0/d65/d6e/dc0/d44/d85/d97/d35/d79 to d0/dc/d104 0 2024-09-21T12:20:24.578 INFO:tasks.workunit.client.1.smithi192.stdout:0/475: getdents d3/de 0 2024-09-21T12:20:24.580 INFO:tasks.workunit.client.1.smithi192.stdout:0/476: dread d3/f78 [0,4194304] 0 2024-09-21T12:20:24.580 INFO:tasks.workunit.client.1.smithi192.stdout:5/755: fdatasync d0/d65/d8e/d77/ff3 0 2024-09-21T12:20:24.581 INFO:tasks.workunit.client.1.smithi192.stdout:6/548: dwrite da/d23/d37/f5f [0,4194304] 0 2024-09-21T12:20:24.582 INFO:tasks.workunit.client.1.smithi192.stdout:5/756: readlink d0/d65/d6e/dc0/d44/d85/d97/d35/l57 0 2024-09-21T12:20:24.583 INFO:tasks.workunit.client.1.smithi192.stdout:9/514: link d5/dc/d80/d44/d79/d3f/c28 d5/dc/d80/d44/d79/d3f/ca1 0 2024-09-21T12:20:24.584 INFO:tasks.workunit.client.1.smithi192.stdout:9/515: read d5/dc/d80/d44/d79/d55/d93/f96 [2489446,91136] 0 2024-09-21T12:20:24.585 INFO:tasks.workunit.client.1.smithi192.stdout:3/451: link db/d16/d18/d40/c64 db/d16/ca5 0 2024-09-21T12:20:24.590 INFO:tasks.workunit.client.1.smithi192.stdout:5/757: rename d0/d2/d7b/fab to d0/df9/f105 0 2024-09-21T12:20:24.591 INFO:tasks.workunit.client.1.smithi192.stdout:0/477: mknod d3/d6/d83/c84 0 2024-09-21T12:20:24.594 INFO:tasks.workunit.client.1.smithi192.stdout:4/482: truncate d2/db/d3e/d41/f69 341211 0 2024-09-21T12:20:24.596 INFO:tasks.workunit.client.1.smithi192.stdout:1/558: dwrite d2/f3e [0,4194304] 0 2024-09-21T12:20:24.598 INFO:tasks.workunit.client.1.smithi192.stdout:4/483: creat d2/db/d3e/d41/fa3 x:0 0 0 2024-09-21T12:20:24.598 INFO:tasks.workunit.client.1.smithi192.stdout:6/549: getdents da/d1f/d27/d3e 0 2024-09-21T12:20:24.599 INFO:tasks.workunit.client.1.smithi192.stdout:0/478: dread d3/de/d33/f6e [0,4194304] 0 2024-09-21T12:20:24.601 INFO:tasks.workunit.client.1.smithi192.stdout:4/484: dread - d2/d19/d4b/f5a zero size 2024-09-21T12:20:24.604 INFO:tasks.workunit.client.1.smithi192.stdout:5/758: dwrite d0/d65/d6e/f29 [4194304,4194304] 0 2024-09-21T12:20:24.608 INFO:tasks.workunit.client.1.smithi192.stdout:4/485: mkdir d2/db/da4 0 2024-09-21T12:20:24.613 INFO:tasks.workunit.client.1.smithi192.stdout:1/559: dwrite d2/d12/d2f/d51/d24/f35 [0,4194304] 0 2024-09-21T12:20:24.615 INFO:tasks.workunit.client.1.smithi192.stdout:0/479: write d3/de/f24 [6719488,40194] 0 2024-09-21T12:20:24.618 INFO:tasks.workunit.client.1.smithi192.stdout:6/550: dwrite da/d23/d37/f33 [4194304,4194304] 0 2024-09-21T12:20:24.618 INFO:tasks.workunit.client.1.smithi192.stdout:9/516: dwrite d5/dc/f5f [0,4194304] 0 2024-09-21T12:20:24.619 INFO:tasks.workunit.client.1.smithi192.stdout:5/759: dread d0/d65/d6e/dc0/d44/d85/d97/f78 [0,4194304] 0 2024-09-21T12:20:24.626 INFO:tasks.workunit.client.1.smithi192.stdout:3/452: dwrite db/d16/d18/f74 [0,4194304] 0 2024-09-21T12:20:24.626 INFO:tasks.workunit.client.1.smithi192.stdout:5/760: dread - d0/d65/d6e/da7/da0/fb5 zero size 2024-09-21T12:20:24.627 INFO:tasks.workunit.client.1.smithi192.stdout:8/556: sync 2024-09-21T12:20:24.628 INFO:tasks.workunit.client.1.smithi192.stdout:6/551: creat da/d1f/d56/d73/fb8 x:0 0 0 2024-09-21T12:20:24.630 INFO:tasks.workunit.client.1.smithi192.stdout:0/480: link d3/d5/d19/f58 d3/d6/d83/f85 0 2024-09-21T12:20:24.631 INFO:tasks.workunit.client.1.smithi192.stdout:1/560: creat d2/d12/d2f/d51/d24/d65/d8e/d9d/db6/fb7 x:0 0 0 2024-09-21T12:20:24.632 INFO:tasks.workunit.client.1.smithi192.stdout:9/517: mkdir d5/dc/d80/d44/d79/d55/d70/da0/da2 0 2024-09-21T12:20:24.632 INFO:tasks.workunit.client.1.smithi192.stdout:6/552: write da/d1f/d48/f64 [2896567,70482] 0 2024-09-21T12:20:24.635 INFO:tasks.workunit.client.1.smithi192.stdout:4/486: dwrite d2/db/d3e/d41/d96/f79 [0,4194304] 0 2024-09-21T12:20:24.637 INFO:tasks.workunit.client.1.smithi192.stdout:1/561: creat d2/d4d/fb8 x:0 0 0 2024-09-21T12:20:24.638 INFO:tasks.workunit.client.1.smithi192.stdout:1/562: readlink d2/d12/d2f/d51/l6a 0 2024-09-21T12:20:24.641 INFO:tasks.workunit.client.1.smithi192.stdout:8/557: rename d14/d1a/d1d/d46/d4e/d83/d8d/d92 to d14/d1a/d1d/d46/d4e/db5 0 2024-09-21T12:20:24.641 INFO:tasks.workunit.client.1.smithi192.stdout:6/553: mknod da/cb9 0 2024-09-21T12:20:24.643 INFO:tasks.workunit.client.1.smithi192.stdout:0/481: mknod d3/d6/d72/d81/c86 0 2024-09-21T12:20:24.646 INFO:tasks.workunit.client.1.smithi192.stdout:5/761: creat d0/d65/d6e/f106 x:0 0 0 2024-09-21T12:20:24.646 INFO:tasks.workunit.client.1.smithi192.stdout:1/563: dwrite d2/da/f60 [0,4194304] 0 2024-09-21T12:20:24.647 INFO:tasks.workunit.client.1.smithi192.stdout:5/762: chown d0/d65/d6e/f92 871 1 2024-09-21T12:20:24.647 INFO:tasks.workunit.client.1.smithi192.stdout:6/554: rmdir da/d1f/d48/d7d/daa 39 2024-09-21T12:20:24.649 INFO:tasks.workunit.client.1.smithi192.stdout:8/558: mkdir d14/d1a/d1d/db6 0 2024-09-21T12:20:24.650 INFO:tasks.workunit.client.1.smithi192.stdout:6/555: symlink da/d1f/d56/lba 0 2024-09-21T12:20:24.651 INFO:tasks.workunit.client.1.smithi192.stdout:5/763: dread - d0/d65/d6e/dc0/d44/ffb zero size 2024-09-21T12:20:24.653 INFO:tasks.workunit.client.1.smithi192.stdout:0/482: dwrite d3/f7d [4194304,4194304] 0 2024-09-21T12:20:24.656 INFO:tasks.workunit.client.1.smithi192.stdout:6/556: creat da/d1f/d27/d88/fbb x:0 0 0 2024-09-21T12:20:24.661 INFO:tasks.workunit.client.1.smithi192.stdout:5/764: mkdir d0/dc/d13/d37/da8/daa/dc5/ddd/d107 0 2024-09-21T12:20:24.661 INFO:tasks.workunit.client.1.smithi192.stdout:1/564: dwrite d2/d12/d2f/d51/d24/d65/f53 [4194304,4194304] 0 2024-09-21T12:20:24.662 INFO:tasks.workunit.client.1.smithi192.stdout:6/557: truncate da/d1f/d27/d6b/fa6 424726 0 2024-09-21T12:20:24.666 INFO:tasks.workunit.client.1.smithi192.stdout:6/558: mknod da/d1f/d48/d7d/cbc 0 2024-09-21T12:20:24.666 INFO:tasks.workunit.client.1.smithi192.stdout:8/559: dread d14/d1a/d1d/d46/d4e/f65 [4194304,4194304] 0 2024-09-21T12:20:24.667 INFO:tasks.workunit.client.1.smithi192.stdout:6/559: dread - da/d1f/d27/d88/fbb zero size 2024-09-21T12:20:24.668 INFO:tasks.workunit.client.1.smithi192.stdout:6/560: chown da/l72 1 1 2024-09-21T12:20:24.668 INFO:tasks.workunit.client.1.smithi192.stdout:6/561: chown da/d1f/d48/l63 26977739 1 2024-09-21T12:20:24.669 INFO:tasks.workunit.client.1.smithi192.stdout:6/562: write da/d1f/d27/d88/f8d [6854013,100688] 0 2024-09-21T12:20:24.670 INFO:tasks.workunit.client.1.smithi192.stdout:8/560: symlink d14/d1a/d1d/d51/d80/lb7 0 2024-09-21T12:20:24.672 INFO:tasks.workunit.client.1.smithi192.stdout:0/483: rename d3/d6/d72/d81 to d3/d6/d83/d87 0 2024-09-21T12:20:24.674 INFO:tasks.workunit.client.1.smithi192.stdout:9/518: truncate d5/dc/f18 1974500 0 2024-09-21T12:20:24.675 INFO:tasks.workunit.client.1.smithi192.stdout:0/484: unlink d3/d6/d1d/l20 0 2024-09-21T12:20:24.676 INFO:tasks.workunit.client.1.smithi192.stdout:0/485: write d3/d6/f3f [2983719,101305] 0 2024-09-21T12:20:24.678 INFO:tasks.workunit.client.1.smithi192.stdout:9/519: getdents d5/dc/d80/d44 0 2024-09-21T12:20:24.679 INFO:tasks.workunit.client.1.smithi192.stdout:0/486: symlink d3/d5/l88 0 2024-09-21T12:20:24.681 INFO:tasks.workunit.client.1.smithi192.stdout:9/520: symlink d5/dc/d80/d44/d79/d55/d93/la3 0 2024-09-21T12:20:24.681 INFO:tasks.workunit.client.1.smithi192.stdout:0/487: mkdir d3/d6/d1d/d89 0 2024-09-21T12:20:24.682 INFO:tasks.workunit.client.1.smithi192.stdout:0/488: chown d3/d5/d28/d39/l55 94601081 1 2024-09-21T12:20:24.683 INFO:tasks.workunit.client.1.smithi192.stdout:9/521: creat d5/dc/fa4 x:0 0 0 2024-09-21T12:20:24.685 INFO:tasks.workunit.client.1.smithi192.stdout:0/489: write d3/d5/d28/f56 [309962,98150] 0 2024-09-21T12:20:24.685 INFO:tasks.workunit.client.1.smithi192.stdout:6/563: truncate da/d1f/d27/f71 944400 0 2024-09-21T12:20:24.688 INFO:tasks.workunit.client.1.smithi192.stdout:0/490: creat d3/d5/d28/d39/f8a x:0 0 0 2024-09-21T12:20:24.689 INFO:tasks.workunit.client.1.smithi192.stdout:8/561: dread d14/d1a/d1d/f58 [0,4194304] 0 2024-09-21T12:20:24.692 INFO:tasks.workunit.client.1.smithi192.stdout:9/522: dwrite d5/f33 [0,4194304] 0 2024-09-21T12:20:24.695 INFO:tasks.workunit.client.1.smithi192.stdout:8/562: creat d14/d1a/d1d/db6/fb8 x:0 0 0 2024-09-21T12:20:24.696 INFO:tasks.workunit.client.1.smithi192.stdout:0/491: dwrite d3/d5/d19/d51/f76 [0,4194304] 0 2024-09-21T12:20:24.697 INFO:tasks.workunit.client.1.smithi192.stdout:8/563: stat d14/d1a/d1d/d46/d4e/fa5 0 2024-09-21T12:20:24.701 INFO:tasks.workunit.client.1.smithi192.stdout:6/564: dread da/d1f/d27/f71 [0,4194304] 0 2024-09-21T12:20:24.701 INFO:tasks.workunit.client.1.smithi192.stdout:8/564: rmdir d14/d1a/d1d/d20/d5f/d8a 39 2024-09-21T12:20:24.707 INFO:tasks.workunit.client.1.smithi192.stdout:9/523: dwrite d5/dc/d80/d44/f90 [0,4194304] 0 2024-09-21T12:20:24.708 INFO:tasks.workunit.client.1.smithi192.stdout:0/492: dwrite d3/d5/d28/d39/f8a [0,4194304] 0 2024-09-21T12:20:24.709 INFO:tasks.workunit.client.1.smithi192.stdout:6/565: creat da/d1f/d56/d78/fbd x:0 0 0 2024-09-21T12:20:24.710 INFO:tasks.workunit.client.1.smithi192.stdout:6/566: stat da/d1f/l69 0 2024-09-21T12:20:24.710 INFO:tasks.workunit.client.1.smithi192.stdout:8/565: creat d14/d1a/d1d/d46/d4e/d83/d8d/fb9 x:0 0 0 2024-09-21T12:20:24.711 INFO:tasks.workunit.client.1.smithi192.stdout:6/567: fdatasync f8 0 2024-09-21T12:20:24.712 INFO:tasks.workunit.client.1.smithi192.stdout:0/493: readlink d3/d6/l15 0 2024-09-21T12:20:24.713 INFO:tasks.workunit.client.1.smithi192.stdout:0/494: chown d3/c1c 5527 1 2024-09-21T12:20:24.714 INFO:tasks.workunit.client.1.smithi192.stdout:6/568: write da/d1f/d27/d6b/f85 [581092,120244] 0 2024-09-21T12:20:24.715 INFO:tasks.workunit.client.1.smithi192.stdout:8/566: mkdir d14/d1a/d1d/d51/d80/d9a/dba 0 2024-09-21T12:20:24.717 INFO:tasks.workunit.client.1.smithi192.stdout:0/495: creat d3/d6/d83/f8b x:0 0 0 2024-09-21T12:20:24.720 INFO:tasks.workunit.client.1.smithi192.stdout:8/567: creat d14/d1a/d1d/d46/d4e/d83/d8d/fbb x:0 0 0 2024-09-21T12:20:24.721 INFO:tasks.workunit.client.1.smithi192.stdout:6/569: mkdir da/d1f/d48/d7d/d9a/d9e/dbe 0 2024-09-21T12:20:24.724 INFO:tasks.workunit.client.1.smithi192.stdout:0/496: dwrite d3/de/d43/f66 [0,4194304] 0 2024-09-21T12:20:24.724 INFO:tasks.workunit.client.1.smithi192.stdout:6/570: write da/d1f/d56/d73/fb8 [730931,65138] 0 2024-09-21T12:20:24.725 INFO:tasks.workunit.client.1.smithi192.stdout:9/524: truncate d5/dc/d40/f25 5670406 0 2024-09-21T12:20:24.728 INFO:tasks.workunit.client.1.smithi192.stdout:6/571: write da/d1f/d27/d6b/f6d [2520221,973] 0 2024-09-21T12:20:24.729 INFO:tasks.workunit.client.1.smithi192.stdout:0/497: mkdir d3/d6/d83/d8c 0 2024-09-21T12:20:24.730 INFO:tasks.workunit.client.1.smithi192.stdout:0/498: read - d3/d5/f77 zero size 2024-09-21T12:20:24.730 INFO:tasks.workunit.client.1.smithi192.stdout:8/568: dwrite d14/d1a/d1d/d46/d4e/fa8 [0,4194304] 0 2024-09-21T12:20:24.735 INFO:tasks.workunit.client.1.smithi192.stdout:9/525: symlink d5/dc/d80/d44/d79/d3f/la5 0 2024-09-21T12:20:24.739 INFO:tasks.workunit.client.1.smithi192.stdout:8/569: link d14/d1a/d1d/d39/c7a d14/d1a/d1d/d51/d80/cbc 0 2024-09-21T12:20:24.741 INFO:tasks.workunit.client.1.smithi192.stdout:9/526: unlink d5/d8/d2c/f95 0 2024-09-21T12:20:24.741 INFO:tasks.workunit.client.1.smithi192.stdout:0/499: dwrite d3/d5/f80 [0,4194304] 0 2024-09-21T12:20:24.742 INFO:tasks.workunit.client.1.smithi192.stdout:0/500: read d3/f7d [8321000,84210] 0 2024-09-21T12:20:24.745 INFO:tasks.workunit.client.1.smithi192.stdout:8/570: dread d14/d1a/d1d/d51/fa2 [0,4194304] 0 2024-09-21T12:20:24.747 INFO:tasks.workunit.client.1.smithi192.stdout:0/501: creat d3/de/f8d x:0 0 0 2024-09-21T12:20:24.749 INFO:tasks.workunit.client.1.smithi192.stdout:9/527: creat d5/d8/fa6 x:0 0 0 2024-09-21T12:20:24.754 INFO:tasks.workunit.client.1.smithi192.stdout:8/571: symlink d14/d1a/d1d/d20/d5f/lbd 0 2024-09-21T12:20:24.755 INFO:tasks.workunit.client.1.smithi192.stdout:9/528: rmdir d5/d19/d32 39 2024-09-21T12:20:24.756 INFO:tasks.workunit.client.1.smithi192.stdout:8/572: rmdir d14/d18/d88 39 2024-09-21T12:20:24.756 INFO:tasks.workunit.client.1.smithi192.stdout:9/529: write d5/d21/d3d/f54 [3731051,91108] 0 2024-09-21T12:20:24.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:24 smithi192 ceph-mon[35641]: pgmap v262: 65 pgs: 65 active+clean; 858 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 14 MiB/s rd, 99 MiB/s wr, 333 op/s 2024-09-21T12:20:24.758 INFO:tasks.workunit.client.1.smithi192.stdout:8/573: dread d14/d1a/f2e [0,4194304] 0 2024-09-21T12:20:24.759 INFO:tasks.workunit.client.1.smithi192.stdout:9/530: mknod d5/dc/d80/d44/d79/d3f/ca7 0 2024-09-21T12:20:24.761 INFO:tasks.workunit.client.1.smithi192.stdout:8/574: rename d14/d1a/d1d/d51/d80/d9a/db0 to d14/d1a/d1d/d46/d4e/d83/d8d/d9c/dbe 0 2024-09-21T12:20:24.762 INFO:tasks.workunit.client.1.smithi192.stdout:6/572: dread da/d1f/d48/f4d [0,4194304] 0 2024-09-21T12:20:24.766 INFO:tasks.workunit.client.1.smithi192.stdout:6/573: rename da/d1f/d48/d9f/fae to da/d1f/d48/d7d/fbf 0 2024-09-21T12:20:24.768 INFO:tasks.workunit.client.1.smithi192.stdout:6/574: symlink da/d1f/lc0 0 2024-09-21T12:20:24.769 INFO:tasks.workunit.client.1.smithi192.stdout:6/575: dread da/d1f/d27/f6f [0,4194304] 0 2024-09-21T12:20:24.776 INFO:tasks.workunit.client.1.smithi192.stdout:6/576: rename da/d1f/d48/d7d/da7/ca8 to da/d1f/d48/d7d/d9a/d9e/dbe/cc1 0 2024-09-21T12:20:24.778 INFO:tasks.workunit.client.1.smithi192.stdout:9/531: truncate d5/dc/d80/d44/d8e/f98 88626 0 2024-09-21T12:20:24.779 INFO:tasks.workunit.client.1.smithi192.stdout:9/532: fdatasync d5/dc/d80/d5a/f9e 0 2024-09-21T12:20:24.780 INFO:tasks.workunit.client.1.smithi192.stdout:8/575: write d14/d1a/d1d/d48/f6f [852050,83629] 0 2024-09-21T12:20:24.781 INFO:tasks.workunit.client.1.smithi192.stdout:6/577: unlink da/d23/d37/fb5 0 2024-09-21T12:20:24.786 INFO:tasks.workunit.client.1.smithi192.stdout:9/533: rename d5/f3b to d5/d19/fa8 0 2024-09-21T12:20:24.786 INFO:tasks.workunit.client.1.smithi192.stdout:6/578: symlink da/lc2 0 2024-09-21T12:20:24.786 INFO:tasks.workunit.client.1.smithi192.stdout:8/576: dwrite d14/d1a/d1d/db6/fb8 [0,4194304] 0 2024-09-21T12:20:24.788 INFO:tasks.workunit.client.1.smithi192.stdout:6/579: truncate da/d1f/f54 745350 0 2024-09-21T12:20:24.794 INFO:tasks.workunit.client.1.smithi192.stdout:8/577: write d14/d1a/d1d/d46/d4e/f5b [3818012,108945] 0 2024-09-21T12:20:24.798 INFO:tasks.workunit.client.1.smithi192.stdout:9/534: dwrite d5/dc/d80/d5a/f75 [0,4194304] 0 2024-09-21T12:20:24.798 INFO:tasks.workunit.client.1.smithi192.stdout:6/580: rename da/l51 to da/d1f/d48/d7d/da7/lc3 0 2024-09-21T12:20:24.798 INFO:tasks.workunit.client.1.smithi192.stdout:0/502: dwrite d3/de/d43/f54 [0,4194304] 0 2024-09-21T12:20:24.800 INFO:tasks.workunit.client.1.smithi192.stdout:6/581: write da/d1f/d27/d88/fbb [804507,68996] 0 2024-09-21T12:20:24.801 INFO:tasks.workunit.client.1.smithi192.stdout:8/578: creat d14/d1a/d1d/d46/d4e/d83/fbf x:0 0 0 2024-09-21T12:20:24.807 INFO:tasks.workunit.client.1.smithi192.stdout:9/535: truncate d5/dc/d80/d44/d79/d3f/f9a 1067476 0 2024-09-21T12:20:24.808 INFO:tasks.workunit.client.1.smithi192.stdout:0/503: dread d3/de/f11 [0,4194304] 0 2024-09-21T12:20:24.810 INFO:tasks.workunit.client.1.smithi192.stdout:7/522: sync 2024-09-21T12:20:24.813 INFO:tasks.workunit.client.1.smithi192.stdout:0/504: symlink d3/de/d33/l8e 0 2024-09-21T12:20:24.814 INFO:tasks.workunit.client.1.smithi192.stdout:8/579: dwrite d14/d1a/d1d/d46/d4e/d83/d8d/fbb [0,4194304] 0 2024-09-21T12:20:24.819 INFO:tasks.workunit.client.1.smithi192.stdout:8/580: rename d14/d1a/f25 to d14/d18/d5a/fc0 0 2024-09-21T12:20:24.819 INFO:tasks.workunit.client.1.smithi192.stdout:0/505: dread d3/de/f60 [0,4194304] 0 2024-09-21T12:20:24.821 INFO:tasks.workunit.client.1.smithi192.stdout:8/581: readlink d14/d1a/d1d/d46/l4c 0 2024-09-21T12:20:24.822 INFO:tasks.workunit.client.1.smithi192.stdout:9/536: dwrite d5/dc/d80/d5a/f9e [0,4194304] 0 2024-09-21T12:20:24.823 INFO:tasks.workunit.client.1.smithi192.stdout:6/582: truncate da/d1f/f4c 1883579 0 2024-09-21T12:20:24.824 INFO:tasks.workunit.client.1.smithi192.stdout:6/583: chown da/d1f/d56/l97 21 1 2024-09-21T12:20:24.825 INFO:tasks.workunit.client.1.smithi192.stdout:9/537: mknod d5/d21/d3d/ca9 0 2024-09-21T12:20:24.826 INFO:tasks.workunit.client.1.smithi192.stdout:0/506: dread d3/de/d43/f54 [0,4194304] 0 2024-09-21T12:20:24.826 INFO:tasks.workunit.client.1.smithi192.stdout:8/582: creat d14/d18/d94/da4/fc1 x:0 0 0 2024-09-21T12:20:24.829 INFO:tasks.workunit.client.1.smithi192.stdout:6/584: creat da/d23/d37/d75/d90/fc4 x:0 0 0 2024-09-21T12:20:24.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:24 smithi003 ceph-mon[28057]: pgmap v262: 65 pgs: 65 active+clean; 858 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 14 MiB/s rd, 99 MiB/s wr, 333 op/s 2024-09-21T12:20:24.831 INFO:tasks.workunit.client.1.smithi192.stdout:0/507: rename d3/d5/c5d to d3/d5/d28/d39/c8f 0 2024-09-21T12:20:24.833 INFO:tasks.workunit.client.1.smithi192.stdout:8/583: symlink d14/lc2 0 2024-09-21T12:20:24.833 INFO:tasks.workunit.client.1.smithi192.stdout:9/538: dwrite d5/dc/f76 [0,4194304] 0 2024-09-21T12:20:24.835 INFO:tasks.workunit.client.1.smithi192.stdout:6/585: read da/d23/d37/f33 [1005716,118946] 0 2024-09-21T12:20:24.837 INFO:tasks.workunit.client.1.smithi192.stdout:7/523: dread d6/d9/f5b [0,4194304] 0 2024-09-21T12:20:24.838 INFO:tasks.workunit.client.1.smithi192.stdout:6/586: chown da/d1f/d56/f83 4853 1 2024-09-21T12:20:24.842 INFO:tasks.workunit.client.1.smithi192.stdout:9/539: chown d5/dc/d80/d44/d79/d3f/d4d/d6d/f74 1 1 2024-09-21T12:20:24.843 INFO:tasks.workunit.client.1.smithi192.stdout:6/587: write da/d1f/d27/d3e/f4a [145475,84078] 0 2024-09-21T12:20:24.848 INFO:tasks.workunit.client.1.smithi192.stdout:8/584: dwrite d14/d1a/d1d/f58 [4194304,4194304] 0 2024-09-21T12:20:24.848 INFO:tasks.workunit.client.1.smithi192.stdout:9/540: read d5/f7 [2539803,43411] 0 2024-09-21T12:20:24.849 INFO:tasks.workunit.client.1.smithi192.stdout:6/588: unlink da/d1f/d56/cb0 0 2024-09-21T12:20:24.853 INFO:tasks.workunit.client.1.smithi192.stdout:8/585: mkdir d14/d18/d94/dc3 0 2024-09-21T12:20:24.855 INFO:tasks.workunit.client.1.smithi192.stdout:6/589: mkdir da/d23/d37/dc5 0 2024-09-21T12:20:24.855 INFO:tasks.workunit.client.1.smithi192.stdout:0/508: dwrite d3/d6/fd [0,4194304] 0 2024-09-21T12:20:24.857 INFO:tasks.workunit.client.1.smithi192.stdout:7/524: dwrite d6/d9/d1f/d3e/d7a/d8a/fab [0,4194304] 0 2024-09-21T12:20:24.857 INFO:tasks.workunit.client.1.smithi192.stdout:9/541: rename d5/dc/f5f to d5/d21/d66/d53/d6e/faa 0 2024-09-21T12:20:24.859 INFO:tasks.workunit.client.1.smithi192.stdout:7/525: fsync d6/f38 0 2024-09-21T12:20:24.860 INFO:tasks.workunit.client.1.smithi192.stdout:0/509: rename d3/c4 to d3/d6/d72/c90 0 2024-09-21T12:20:24.862 INFO:tasks.workunit.client.1.smithi192.stdout:7/526: creat d6/d20/fbb x:0 0 0 2024-09-21T12:20:24.863 INFO:tasks.workunit.client.1.smithi192.stdout:6/590: link da/d1f/d56/d73/fb8 da/d1f/d48/d7d/da7/fc6 0 2024-09-21T12:20:24.864 INFO:tasks.workunit.client.1.smithi192.stdout:7/527: truncate d6/d3a/f61 540525 0 2024-09-21T12:20:24.868 INFO:tasks.workunit.client.1.smithi192.stdout:0/510: getdents d3/d6/d83/d87 0 2024-09-21T12:20:24.869 INFO:tasks.workunit.client.1.smithi192.stdout:7/528: creat d6/d9/d1f/d3e/d7a/d8a/fbc x:0 0 0 2024-09-21T12:20:24.871 INFO:tasks.workunit.client.1.smithi192.stdout:6/591: dwrite da/d1f/d48/f53 [0,4194304] 0 2024-09-21T12:20:24.871 INFO:tasks.workunit.client.1.smithi192.stdout:7/529: creat d6/d9/d2d/d7b/fbd x:0 0 0 2024-09-21T12:20:24.873 INFO:tasks.workunit.client.1.smithi192.stdout:0/511: rename d3/de/d43/c44 to d3/d5/d69/c91 0 2024-09-21T12:20:24.875 INFO:tasks.workunit.client.1.smithi192.stdout:6/592: read da/d1f/d27/d6b/f7f [2890975,89624] 0 2024-09-21T12:20:24.876 INFO:tasks.workunit.client.1.smithi192.stdout:7/530: mknod d6/d20/d69/d90/da7/cbe 0 2024-09-21T12:20:24.877 INFO:tasks.workunit.client.1.smithi192.stdout:6/593: creat da/d1f/d56/d73/fc7 x:0 0 0 2024-09-21T12:20:24.878 INFO:tasks.workunit.client.1.smithi192.stdout:0/512: rmdir d3/d6/d83/d8c 0 2024-09-21T12:20:24.880 INFO:tasks.workunit.client.1.smithi192.stdout:6/594: mkdir da/d1f/d48/d7d/da7/dc8 0 2024-09-21T12:20:24.896 INFO:tasks.workunit.client.1.smithi192.stdout:9/542: write d5/dc/d40/f25 [464540,20894] 0 2024-09-21T12:20:24.897 INFO:tasks.workunit.client.1.smithi192.stdout:9/543: stat d5/d19/l24 0 2024-09-21T12:20:24.898 INFO:tasks.workunit.client.1.smithi192.stdout:9/544: chown d5/dc/d40/l41 1 1 2024-09-21T12:20:24.898 INFO:tasks.workunit.client.1.smithi192.stdout:6/595: dread da/d23/f49 [0,4194304] 0 2024-09-21T12:20:24.899 INFO:tasks.workunit.client.1.smithi192.stdout:6/596: read da/d1f/d48/f4d [741789,89609] 0 2024-09-21T12:20:24.902 INFO:tasks.workunit.client.1.smithi192.stdout:7/531: truncate d6/d9/d51/f23 2435217 0 2024-09-21T12:20:24.906 INFO:tasks.workunit.client.1.smithi192.stdout:9/545: dwrite d5/dc/d80/d44/d79/d3f/d4d/d6d/f74 [0,4194304] 0 2024-09-21T12:20:24.908 INFO:tasks.workunit.client.1.smithi192.stdout:6/597: dwrite da/d1f/d56/d78/f7c [0,4194304] 0 2024-09-21T12:20:24.908 INFO:tasks.workunit.client.1.smithi192.stdout:7/532: truncate d6/d9/d70/d77/fb0 843576 0 2024-09-21T12:20:24.909 INFO:tasks.workunit.client.1.smithi192.stdout:9/546: write d5/d21/f60 [263030,116540] 0 2024-09-21T12:20:24.911 INFO:tasks.workunit.client.1.smithi192.stdout:6/598: chown da/f16 0 1 2024-09-21T12:20:24.912 INFO:tasks.workunit.client.1.smithi192.stdout:0/513: dwrite d3/d5/d19/f58 [0,4194304] 0 2024-09-21T12:20:24.914 INFO:tasks.workunit.client.1.smithi192.stdout:6/599: write da/d1f/d48/f64 [3010205,99602] 0 2024-09-21T12:20:24.919 INFO:tasks.workunit.client.1.smithi192.stdout:7/533: unlink d6/d9/d1f/d3e/d7a/d8a/da2/lb4 0 2024-09-21T12:20:24.922 INFO:tasks.workunit.client.1.smithi192.stdout:9/547: creat d5/dc/d80/d44/d79/d3f/d4d/d6d/fab x:0 0 0 2024-09-21T12:20:24.928 INFO:tasks.workunit.client.1.smithi192.stdout:0/514: rename d3/d5/d19 to d3/d6/d1d/d92 0 2024-09-21T12:20:24.931 INFO:tasks.workunit.client.1.smithi192.stdout:0/515: write d3/d6/d1d/d92/d51/f3b [627069,69961] 0 2024-09-21T12:20:24.932 INFO:tasks.workunit.client.1.smithi192.stdout:0/516: stat d3/d6/l7c 0 2024-09-21T12:20:24.932 INFO:tasks.workunit.client.1.smithi192.stdout:6/600: unlink da/d23/d37/c4e 0 2024-09-21T12:20:24.935 INFO:tasks.workunit.client.1.smithi192.stdout:6/601: rmdir da/d1f/d56/d73 39 2024-09-21T12:20:24.935 INFO:tasks.workunit.client.1.smithi192.stdout:6/602: write da/d1f/f45 [2656420,129468] 0 2024-09-21T12:20:24.937 INFO:tasks.workunit.client.1.smithi192.stdout:6/603: write da/d1f/fb7 [862789,40992] 0 2024-09-21T12:20:24.940 INFO:tasks.workunit.client.1.smithi192.stdout:6/604: rmdir da/d1f 39 2024-09-21T12:20:24.945 INFO:tasks.workunit.client.1.smithi192.stdout:6/605: symlink da/d1f/d48/d7d/d9a/d9e/dbe/lc9 0 2024-09-21T12:20:24.948 INFO:tasks.workunit.client.1.smithi192.stdout:9/548: dread d5/f7 [0,4194304] 0 2024-09-21T12:20:24.949 INFO:tasks.workunit.client.1.smithi192.stdout:9/549: write d5/dc/d80/d44/d79/f43 [1988977,101437] 0 2024-09-21T12:20:24.949 INFO:tasks.workunit.client.1.smithi192.stdout:2/489: sync 2024-09-21T12:20:24.951 INFO:tasks.workunit.client.1.smithi192.stdout:0/517: dread d3/d6/d72/d7a/f7e [0,4194304] 0 2024-09-21T12:20:24.956 INFO:tasks.workunit.client.1.smithi192.stdout:9/550: dread d5/dc/d80/d44/d79/d3f/f9a [0,4194304] 0 2024-09-21T12:20:24.957 INFO:tasks.workunit.client.1.smithi192.stdout:9/551: readlink d5/d19/l24 0 2024-09-21T12:20:24.957 INFO:tasks.workunit.client.1.smithi192.stdout:0/518: creat d3/f93 x:0 0 0 2024-09-21T12:20:24.958 INFO:tasks.workunit.client.1.smithi192.stdout:6/606: getdents da/d1f/d56/d78 0 2024-09-21T12:20:24.959 INFO:tasks.workunit.client.1.smithi192.stdout:6/607: readlink da/d1f/d56/la0 0 2024-09-21T12:20:24.960 INFO:tasks.workunit.client.1.smithi192.stdout:2/490: mknod d1b/d1e/c98 0 2024-09-21T12:20:24.961 INFO:tasks.workunit.client.1.smithi192.stdout:0/519: dread d3/de/d33/f6e [0,4194304] 0 2024-09-21T12:20:24.961 INFO:tasks.workunit.client.1.smithi192.stdout:2/491: write d1b/d1e/d5e/d75/f84 [9900,46461] 0 2024-09-21T12:20:24.964 INFO:tasks.workunit.client.1.smithi192.stdout:6/608: dread da/d1f/d56/d78/f7c [0,4194304] 0 2024-09-21T12:20:24.965 INFO:tasks.workunit.client.1.smithi192.stdout:6/609: read da/d1f/d27/f71 [121398,84808] 0 2024-09-21T12:20:24.966 INFO:tasks.workunit.client.1.smithi192.stdout:2/492: mkdir d1b/d1e/d62/d99 0 2024-09-21T12:20:24.969 INFO:tasks.workunit.client.1.smithi192.stdout:9/552: getdents d5/dc/d80/d44/d79/d55/d93 0 2024-09-21T12:20:24.972 INFO:tasks.workunit.client.1.smithi192.stdout:2/493: fdatasync d1b/d38/f79 0 2024-09-21T12:20:24.974 INFO:tasks.workunit.client.1.smithi192.stdout:0/520: creat d3/de/f94 x:0 0 0 2024-09-21T12:20:24.976 INFO:tasks.workunit.client.1.smithi192.stdout:9/553: unlink d5/dc/d80/f17 0 2024-09-21T12:20:24.985 INFO:tasks.workunit.client.1.smithi192.stdout:2/494: symlink d1b/l9a 0 2024-09-21T12:20:24.988 INFO:tasks.workunit.client.1.smithi192.stdout:9/554: rename d5/dc/f18 to d5/dc/d80/d44/d79/d55/d70/fac 0 2024-09-21T12:20:24.989 INFO:tasks.workunit.client.1.smithi192.stdout:6/610: link da/d1f/d48/c4f da/d1f/d27/d6b/cca 0 2024-09-21T12:20:24.990 INFO:tasks.workunit.client.1.smithi192.stdout:2/495: dread - d1b/f87 zero size 2024-09-21T12:20:24.992 INFO:tasks.workunit.client.1.smithi192.stdout:9/555: rename d5/d21/d66 to d5/dc/d40/dad 0 2024-09-21T12:20:24.996 INFO:tasks.workunit.client.1.smithi192.stdout:6/611: rename da/d1f/d48/f64 to da/d23/d37/fcb 0 2024-09-21T12:20:24.996 INFO:tasks.workunit.client.1.smithi192.stdout:0/521: write d3/f78 [325703,119948] 0 2024-09-21T12:20:24.998 INFO:tasks.workunit.client.1.smithi192.stdout:0/522: truncate d3/d5/d28/f56 691288 0 2024-09-21T12:20:24.998 INFO:tasks.workunit.client.1.smithi192.stdout:2/496: mknod d1b/d38/d7d/c9b 0 2024-09-21T12:20:24.999 INFO:tasks.workunit.client.1.smithi192.stdout:0/523: dread - d3/f6a zero size 2024-09-21T12:20:25.007 INFO:tasks.workunit.client.1.smithi192.stdout:6/612: unlink da/d1f/d56/d73/la1 0 2024-09-21T12:20:25.010 INFO:tasks.workunit.client.1.smithi192.stdout:6/613: dread da/d1f/fb7 [0,4194304] 0 2024-09-21T12:20:25.013 INFO:tasks.workunit.client.1.smithi192.stdout:2/497: mkdir d1b/d1e/d5e/d88/d95/d9c 0 2024-09-21T12:20:25.017 INFO:tasks.workunit.client.1.smithi192.stdout:0/524: dread d3/de/d33/f3c [0,4194304] 0 2024-09-21T12:20:25.018 INFO:tasks.workunit.client.1.smithi192.stdout:6/614: dwrite da/d1f/d27/fb1 [0,4194304] 0 2024-09-21T12:20:25.019 INFO:tasks.workunit.client.1.smithi192.stdout:9/556: dwrite d5/dc/d80/d44/d8e/f98 [0,4194304] 0 2024-09-21T12:20:25.020 INFO:tasks.workunit.client.1.smithi192.stdout:0/525: write d3/d5/d28/d39/f41 [2475440,111893] 0 2024-09-21T12:20:25.021 INFO:tasks.workunit.client.1.smithi192.stdout:2/498: symlink d1b/d1e/d5e/d88/d95/d9c/l9d 0 2024-09-21T12:20:25.021 INFO:tasks.workunit.client.1.smithi192.stdout:6/615: read - da/d1f/d48/d7d/da7/fad zero size 2024-09-21T12:20:25.024 INFO:tasks.workunit.client.1.smithi192.stdout:0/526: chown d3/d6/f3f 0 1 2024-09-21T12:20:25.025 INFO:tasks.workunit.client.1.smithi192.stdout:0/527: truncate d3/f6a 74653 0 2024-09-21T12:20:25.027 INFO:tasks.workunit.client.1.smithi192.stdout:9/557: mknod d5/dc/d80/d44/d79/d55/d70/cae 0 2024-09-21T12:20:25.028 INFO:tasks.workunit.client.1.smithi192.stdout:2/499: write d1b/d1e/f47 [1021020,41658] 0 2024-09-21T12:20:25.029 INFO:tasks.workunit.client.1.smithi192.stdout:0/528: rmdir d3/d5/d69 39 2024-09-21T12:20:25.029 INFO:tasks.workunit.client.1.smithi192.stdout:2/500: truncate fe 5021398 0 2024-09-21T12:20:25.029 INFO:tasks.workunit.client.1.smithi192.stdout:0/529: fdatasync d3/d6/d83/f85 0 2024-09-21T12:20:25.030 INFO:tasks.workunit.client.1.smithi192.stdout:2/501: dread - d1b/d38/f7e zero size 2024-09-21T12:20:25.034 INFO:tasks.workunit.client.1.smithi192.stdout:9/558: mkdir d5/dc/d80/d44/d79/d55/d70/da0/da2/daf 0 2024-09-21T12:20:25.034 INFO:tasks.workunit.client.1.smithi192.stdout:2/502: fdatasync d1b/d1e/d5e/d75/d8d/f94 0 2024-09-21T12:20:25.034 INFO:tasks.workunit.client.1.smithi192.stdout:9/559: write d5/dc/f5c [726037,101569] 0 2024-09-21T12:20:25.035 INFO:tasks.workunit.client.1.smithi192.stdout:0/530: creat d3/de/d43/f95 x:0 0 0 2024-09-21T12:20:25.036 INFO:tasks.workunit.client.1.smithi192.stdout:0/531: fsync d3/d6/f5b 0 2024-09-21T12:20:25.037 INFO:tasks.workunit.client.1.smithi192.stdout:2/503: mkdir d1b/d9e 0 2024-09-21T12:20:25.037 INFO:tasks.workunit.client.1.smithi192.stdout:2/504: chown d1b/d1e/c33 461202630 1 2024-09-21T12:20:25.038 INFO:tasks.workunit.client.1.smithi192.stdout:9/560: creat d5/dc/d80/d44/d79/fb0 x:0 0 0 2024-09-21T12:20:25.041 INFO:tasks.workunit.client.1.smithi192.stdout:9/561: creat d5/dc/d80/d44/d79/fb1 x:0 0 0 2024-09-21T12:20:25.042 INFO:tasks.workunit.client.1.smithi192.stdout:9/562: write d5/dc/f5c [107205,69901] 0 2024-09-21T12:20:25.043 INFO:tasks.workunit.client.1.smithi192.stdout:2/505: dwrite d1b/d38/f49 [0,4194304] 0 2024-09-21T12:20:25.052 INFO:tasks.workunit.client.1.smithi192.stdout:6/616: write da/d1f/d48/d7d/da7/fc6 [1740209,19935] 0 2024-09-21T12:20:25.053 INFO:tasks.workunit.client.1.smithi192.stdout:6/617: readlink da/d23/d37/d75/d90/la4 0 2024-09-21T12:20:25.054 INFO:tasks.workunit.client.1.smithi192.stdout:6/618: readlink da/d1f/d56/l8f 0 2024-09-21T12:20:25.057 INFO:tasks.workunit.client.1.smithi192.stdout:6/619: link da/c55 da/d1f/d48/d7d/da7/dc8/ccc 0 2024-09-21T12:20:25.060 INFO:tasks.workunit.client.1.smithi192.stdout:2/506: dwrite d1b/f4c [0,4194304] 0 2024-09-21T12:20:25.060 INFO:tasks.workunit.client.1.smithi192.stdout:2/507: stat lb 0 2024-09-21T12:20:25.062 INFO:tasks.workunit.client.1.smithi192.stdout:6/620: getdents da/d1f/d48/d7d/da7/dc8 0 2024-09-21T12:20:25.063 INFO:tasks.workunit.client.1.smithi192.stdout:2/508: mknod d1b/d9e/c9f 0 2024-09-21T12:20:25.065 INFO:tasks.workunit.client.1.smithi192.stdout:6/621: mkdir da/d1f/d56/da9/dcd 0 2024-09-21T12:20:25.066 INFO:tasks.workunit.client.1.smithi192.stdout:2/509: write d1b/d1e/d5e/d75/d8d/f94 [5238846,23562] 0 2024-09-21T12:20:25.067 INFO:tasks.workunit.client.1.smithi192.stdout:9/563: dread d5/d21/f60 [0,4194304] 0 2024-09-21T12:20:25.068 INFO:tasks.workunit.client.1.smithi192.stdout:2/510: chown d1b/d1e/c98 248 1 2024-09-21T12:20:25.068 INFO:tasks.workunit.client.1.smithi192.stdout:6/622: mkdir da/d1f/d48/d7d/d9a/d9e/dbe/dce 0 2024-09-21T12:20:25.076 INFO:tasks.workunit.client.1.smithi192.stdout:9/564: dwrite d5/dc/fa4 [0,4194304] 0 2024-09-21T12:20:25.078 INFO:tasks.workunit.client.1.smithi192.stdout:2/511: dwrite d1b/f87 [0,4194304] 0 2024-09-21T12:20:25.080 INFO:tasks.workunit.client.1.smithi192.stdout:6/623: dwrite da/d23/d37/f70 [0,4194304] 0 2024-09-21T12:20:25.081 INFO:tasks.workunit.client.1.smithi192.stdout:2/512: write d1b/d1e/d5e/d75/d8d/f94 [3663927,30292] 0 2024-09-21T12:20:25.090 INFO:tasks.workunit.client.1.smithi192.stdout:6/624: creat da/d1f/d48/d7d/daa/fcf x:0 0 0 2024-09-21T12:20:25.090 INFO:tasks.workunit.client.1.smithi192.stdout:6/625: chown da/d23/f49 331614185 1 2024-09-21T12:20:25.091 INFO:tasks.workunit.client.1.smithi192.stdout:6/626: fsync da/d1f/d27/d88/fbb 0 2024-09-21T12:20:25.104 INFO:tasks.workunit.client.1.smithi192.stdout:5/765: sync 2024-09-21T12:20:25.104 INFO:tasks.workunit.client.1.smithi192.stdout:3/453: sync 2024-09-21T12:20:25.115 INFO:tasks.workunit.client.1.smithi192.stdout:6/627: mkdir da/d23/d37/d75/dd0 0 2024-09-21T12:20:25.115 INFO:tasks.workunit.client.1.smithi192.stdout:2/513: truncate fe 2044496 0 2024-09-21T12:20:25.115 INFO:tasks.workunit.client.1.smithi192.stdout:3/454: fdatasync db/d16/d18/f74 0 2024-09-21T12:20:25.117 INFO:tasks.workunit.client.1.smithi192.stdout:5/766: write d0/d65/d6e/dc0/d44/ffb [887396,79735] 0 2024-09-21T12:20:25.117 INFO:tasks.workunit.client.1.smithi192.stdout:3/455: write db/f1e [1920744,61580] 0 2024-09-21T12:20:25.119 INFO:tasks.workunit.client.1.smithi192.stdout:3/456: write db/d16/d18/d33/fa4 [524256,20077] 0 2024-09-21T12:20:25.119 INFO:tasks.workunit.client.1.smithi192.stdout:6/628: creat da/d1f/d48/d7d/d9a/d9e/fd1 x:0 0 0 2024-09-21T12:20:25.120 INFO:tasks.workunit.client.1.smithi192.stdout:2/514: mkdir d1b/d38/d53/d8b/da0 0 2024-09-21T12:20:25.120 INFO:tasks.workunit.client.1.smithi192.stdout:2/515: readlink d1b/d1e/l58 0 2024-09-21T12:20:25.121 INFO:tasks.workunit.client.1.smithi192.stdout:2/516: write d1b/d1e/d5e/d75/f84 [111593,33179] 0 2024-09-21T12:20:25.123 INFO:tasks.workunit.client.1.smithi192.stdout:3/457: symlink db/la6 0 2024-09-21T12:20:25.127 INFO:tasks.workunit.client.1.smithi192.stdout:2/517: truncate d1b/f3e 4661920 0 2024-09-21T12:20:25.129 INFO:tasks.workunit.client.1.smithi192.stdout:5/767: truncate d0/d2/f6b 643573 0 2024-09-21T12:20:25.129 INFO:tasks.workunit.client.1.smithi192.stdout:5/768: stat d0/dc/d104/f46 0 2024-09-21T12:20:25.129 INFO:tasks.workunit.client.1.smithi192.stdout:6/629: creat da/d1f/d56/fd2 x:0 0 0 2024-09-21T12:20:25.129 INFO:tasks.workunit.client.1.smithi192.stdout:2/518: rmdir d1b/d1e/d7b 39 2024-09-21T12:20:25.130 INFO:tasks.workunit.client.1.smithi192.stdout:2/519: readlink d1b/d1e/l1f 0 2024-09-21T12:20:25.131 INFO:tasks.workunit.client.1.smithi192.stdout:5/769: write d0/d65/d6e/dc0/d44/d85/d97/fd2 [836927,21777] 0 2024-09-21T12:20:25.133 INFO:tasks.workunit.client.1.smithi192.stdout:6/630: dread da/f95 [0,4194304] 0 2024-09-21T12:20:25.134 INFO:tasks.workunit.client.1.smithi192.stdout:5/770: chown d0/d65/d8e/d98 0 1 2024-09-21T12:20:25.136 INFO:tasks.workunit.client.1.smithi192.stdout:6/631: stat da/d1f/d56/d73/l84 0 2024-09-21T12:20:25.137 INFO:tasks.workunit.client.1.smithi192.stdout:3/458: dwrite f8 [0,4194304] 0 2024-09-21T12:20:25.138 INFO:tasks.workunit.client.1.smithi192.stdout:5/771: dread d0/dc/d13/d37/f71 [0,4194304] 0 2024-09-21T12:20:25.139 INFO:tasks.workunit.client.1.smithi192.stdout:6/632: chown da/d1f/d27/d3e/f94 4554932 1 2024-09-21T12:20:25.140 INFO:tasks.workunit.client.1.smithi192.stdout:3/459: write db/d16/d18/d33/d88/f8b [360315,10429] 0 2024-09-21T12:20:25.146 INFO:tasks.workunit.client.1.smithi192.stdout:3/460: write db/d16/d61/d2e/f45 [3099937,92159] 0 2024-09-21T12:20:25.148 INFO:tasks.workunit.client.1.smithi192.stdout:3/461: readlink db/d16/d18/d33/d88/l89 0 2024-09-21T12:20:25.149 INFO:tasks.workunit.client.1.smithi192.stdout:6/633: dwrite da/d23/d37/f8e [4194304,4194304] 0 2024-09-21T12:20:25.150 INFO:tasks.workunit.client.1.smithi192.stdout:5/772: dwrite d0/d65/d6e/dc0/f102 [0,4194304] 0 2024-09-21T12:20:25.150 INFO:tasks.workunit.client.1.smithi192.stdout:2/520: dread d1b/d1e/f2d [0,4194304] 0 2024-09-21T12:20:25.152 INFO:tasks.workunit.client.1.smithi192.stdout:5/773: dread - d0/d65/d6e/d91/fd0 zero size 2024-09-21T12:20:25.152 INFO:tasks.workunit.client.1.smithi192.stdout:3/462: mkdir db/d16/d18/da7 0 2024-09-21T12:20:25.155 INFO:tasks.workunit.client.1.smithi192.stdout:2/521: getdents d1b/d1e/d5e/d75/d8d 0 2024-09-21T12:20:25.158 INFO:tasks.workunit.client.1.smithi192.stdout:3/463: creat db/d16/fa8 x:0 0 0 2024-09-21T12:20:25.160 INFO:tasks.workunit.client.1.smithi192.stdout:6/634: dwrite da/d1f/d27/d88/fbb [0,4194304] 0 2024-09-21T12:20:25.161 INFO:tasks.workunit.client.1.smithi192.stdout:2/522: chown d1b/l2b 53 1 2024-09-21T12:20:25.165 INFO:tasks.workunit.client.1.smithi192.stdout:2/523: mkdir d1b/d1e/d5e/d75/da1 0 2024-09-21T12:20:25.165 INFO:tasks.workunit.client.1.smithi192.stdout:6/635: creat da/d1f/fd3 x:0 0 0 2024-09-21T12:20:25.166 INFO:tasks.workunit.client.1.smithi192.stdout:5/774: dwrite d0/dc/d13/d37/da8/daa/d101/fe8 [0,4194304] 0 2024-09-21T12:20:25.168 INFO:tasks.workunit.client.1.smithi192.stdout:2/524: fsync d1b/d1e/d7b/f8a 0 2024-09-21T12:20:25.169 INFO:tasks.workunit.client.1.smithi192.stdout:5/775: fdatasync d0/d65/d6e/dc0/fc4 0 2024-09-21T12:20:25.169 INFO:tasks.workunit.client.1.smithi192.stdout:3/464: dread db/d16/d18/f74 [0,4194304] 0 2024-09-21T12:20:25.169 INFO:tasks.workunit.client.1.smithi192.stdout:6/636: mknod da/d1f/d27/d88/cd4 0 2024-09-21T12:20:25.171 INFO:tasks.workunit.client.1.smithi192.stdout:5/776: rmdir d0/d65/d6e/dc0/d44 39 2024-09-21T12:20:25.171 INFO:tasks.workunit.client.1.smithi192.stdout:2/525: dread - d1b/d65/f6e zero size 2024-09-21T12:20:25.173 INFO:tasks.workunit.client.1.smithi192.stdout:6/637: creat da/d1f/d48/d7d/da7/dc8/fd5 x:0 0 0 2024-09-21T12:20:25.177 INFO:tasks.workunit.client.1.smithi192.stdout:3/465: dwrite db/f1e [8388608,4194304] 0 2024-09-21T12:20:25.180 INFO:tasks.workunit.client.1.smithi192.stdout:6/638: getdents da/d1f/d48/d7d/d9a 0 2024-09-21T12:20:25.180 INFO:tasks.workunit.client.1.smithi192.stdout:3/466: symlink db/d16/d18/d40/la9 0 2024-09-21T12:20:25.182 INFO:tasks.workunit.client.1.smithi192.stdout:5/777: dread d0/dc/d13/d37/da8/daa/d101/fe8 [0,4194304] 0 2024-09-21T12:20:25.184 INFO:tasks.workunit.client.1.smithi192.stdout:3/467: symlink db/d16/d18/d40/d60/d7b/d7c/laa 0 2024-09-21T12:20:25.185 INFO:tasks.workunit.client.1.smithi192.stdout:5/778: rmdir d0/d65/d8e 39 2024-09-21T12:20:25.186 INFO:tasks.workunit.client.1.smithi192.stdout:6/639: dwrite da/d1f/d56/d78/fbd [0,4194304] 0 2024-09-21T12:20:25.186 INFO:tasks.workunit.client.1.smithi192.stdout:1/565: sync 2024-09-21T12:20:25.187 INFO:tasks.workunit.client.1.smithi192.stdout:4/487: sync 2024-09-21T12:20:25.189 INFO:tasks.workunit.client.1.smithi192.stdout:3/468: chown db/d16/d18/d40/d60/l7a 60 1 2024-09-21T12:20:25.190 INFO:tasks.workunit.client.1.smithi192.stdout:3/469: stat db/d16/d18/d40/d60/d7b/d7c/laa 0 2024-09-21T12:20:25.190 INFO:tasks.workunit.client.1.smithi192.stdout:5/779: creat d0/dc/d13/d37/da8/daa/f108 x:0 0 0 2024-09-21T12:20:25.193 INFO:tasks.workunit.client.1.smithi192.stdout:6/640: mknod da/d1f/d48/d7d/cd6 0 2024-09-21T12:20:25.198 INFO:tasks.workunit.client.1.smithi192.stdout:3/470: mknod db/d16/d18/da7/cab 0 2024-09-21T12:20:25.199 INFO:tasks.workunit.client.1.smithi192.stdout:6/641: mkdir da/d1f/d48/d7d/daa/dd7 0 2024-09-21T12:20:25.202 INFO:tasks.workunit.client.1.smithi192.stdout:4/488: dread d2/db/d3e/d41/f69 [0,4194304] 0 2024-09-21T12:20:25.208 INFO:tasks.workunit.client.1.smithi192.stdout:6/642: dwrite da/d1f/d48/d7d/fbf [0,4194304] 0 2024-09-21T12:20:25.212 INFO:tasks.workunit.client.1.smithi192.stdout:6/643: mknod da/d1f/d27/d3e/cd8 0 2024-09-21T12:20:25.216 INFO:tasks.workunit.client.1.smithi192.stdout:9/565: sync 2024-09-21T12:20:25.216 INFO:tasks.workunit.client.1.smithi192.stdout:8/586: sync 2024-09-21T12:20:25.216 INFO:tasks.workunit.client.1.smithi192.stdout:0/532: sync 2024-09-21T12:20:25.216 INFO:tasks.workunit.client.1.smithi192.stdout:7/534: sync 2024-09-21T12:20:25.217 INFO:tasks.workunit.client.1.smithi192.stdout:3/471: dread db/d16/d18/d33/d4a/f5f [0,4194304] 0 2024-09-21T12:20:25.217 INFO:tasks.workunit.client.1.smithi192.stdout:6/644: link da/d23/f34 da/d23/d37/fd9 0 2024-09-21T12:20:25.219 INFO:tasks.workunit.client.1.smithi192.stdout:8/587: chown d14/d1a/f31 457 1 2024-09-21T12:20:25.220 INFO:tasks.workunit.client.1.smithi192.stdout:4/489: write d2/f66 [593491,112489] 0 2024-09-21T12:20:25.221 INFO:tasks.workunit.client.1.smithi192.stdout:3/472: creat db/d16/d18/d40/fac x:0 0 0 2024-09-21T12:20:25.224 INFO:tasks.workunit.client.1.smithi192.stdout:2/526: dwrite d1b/d1e/f39 [0,4194304] 0 2024-09-21T12:20:25.317 INFO:tasks.workunit.client.1.smithi192.stdout:8/588: unlink d14/d1a/d1d/f2b 0 2024-09-21T12:20:25.318 INFO:tasks.workunit.client.1.smithi192.stdout:7/535: truncate d6/d9/d2d/fae 551862 0 2024-09-21T12:20:25.320 INFO:tasks.workunit.client.1.smithi192.stdout:1/566: dread d2/d12/d2f/d51/d24/f4c [0,4194304] 0 2024-09-21T12:20:25.321 INFO:tasks.workunit.client.1.smithi192.stdout:0/533: rename d3/d5/d28/l46 to d3/de/l96 0 2024-09-21T12:20:25.321 INFO:tasks.workunit.client.1.smithi192.stdout:7/536: fsync d6/d9/d70/d77/f79 0 2024-09-21T12:20:25.321 INFO:tasks.workunit.client.1.smithi192.stdout:4/490: symlink d2/db/d3e/d57/d32/d4f/la5 0 2024-09-21T12:20:25.322 INFO:tasks.workunit.client.1.smithi192.stdout:9/566: getdents d5/dc/d80/d44/d79/d55/d70/da0/da2/daf 0 2024-09-21T12:20:25.322 INFO:tasks.workunit.client.1.smithi192.stdout:3/473: symlink db/d16/d18/d33/d4a/lad 0 2024-09-21T12:20:25.322 INFO:tasks.workunit.client.1.smithi192.stdout:5/780: dread d0/d65/d6e/dc0/f69 [0,4194304] 0 2024-09-21T12:20:25.323 INFO:tasks.workunit.client.1.smithi192.stdout:2/527: mkdir d1b/d38/d53/d8b/da2 0 2024-09-21T12:20:25.326 INFO:tasks.workunit.client.1.smithi192.stdout:1/567: fsync d2/d12/d2f/d51/d24/f4c 0 2024-09-21T12:20:25.327 INFO:tasks.workunit.client.1.smithi192.stdout:4/491: chown d2/db/l18 40943912 1 2024-09-21T12:20:25.328 INFO:tasks.workunit.client.1.smithi192.stdout:0/534: mknod d3/de/d43/c97 0 2024-09-21T12:20:25.330 INFO:tasks.workunit.client.1.smithi192.stdout:9/567: creat d5/dc/d40/fb2 x:0 0 0 2024-09-21T12:20:25.331 INFO:tasks.workunit.client.1.smithi192.stdout:5/781: symlink d0/dc/d13/d37/l109 0 2024-09-21T12:20:25.333 INFO:tasks.workunit.client.1.smithi192.stdout:2/528: dwrite d1b/d38/d7d/f8e [0,4194304] 0 2024-09-21T12:20:25.335 INFO:tasks.workunit.client.1.smithi192.stdout:7/537: dwrite d6/d9/d70/d77/fb7 [0,4194304] 0 2024-09-21T12:20:25.337 INFO:tasks.workunit.client.1.smithi192.stdout:3/474: mknod db/d16/d18/d40/d60/d7b/d7c/cae 0 2024-09-21T12:20:25.337 INFO:tasks.workunit.client.1.smithi192.stdout:9/568: mkdir d5/dc/d80/d44/db3 0 2024-09-21T12:20:25.338 INFO:tasks.workunit.client.1.smithi192.stdout:8/589: rmdir d14/d1a/d82/da9 0 2024-09-21T12:20:25.339 INFO:tasks.workunit.client.1.smithi192.stdout:9/569: chown d5/d8/f22 6262 1 2024-09-21T12:20:25.339 INFO:tasks.workunit.client.1.smithi192.stdout:2/529: fdatasync d1b/f24 0 2024-09-21T12:20:25.340 INFO:tasks.workunit.client.1.smithi192.stdout:5/782: rmdir d0/dc/d13/d37/da8/daa/dc5/ddd 39 2024-09-21T12:20:25.342 INFO:tasks.workunit.client.1.smithi192.stdout:0/535: mknod d3/d6/d1d/d89/c98 0 2024-09-21T12:20:25.343 INFO:tasks.workunit.client.1.smithi192.stdout:3/475: write db/d16/d18/d33/f43 [1071806,16274] 0 2024-09-21T12:20:25.345 INFO:tasks.workunit.client.1.smithi192.stdout:8/590: mknod d14/d1a/d1d/db6/cc4 0 2024-09-21T12:20:25.347 INFO:tasks.workunit.client.1.smithi192.stdout:2/530: creat d1b/d65/d77/fa3 x:0 0 0 2024-09-21T12:20:25.349 INFO:tasks.workunit.client.1.smithi192.stdout:7/538: creat d6/d9/d1f/d99/fbf x:0 0 0 2024-09-21T12:20:25.349 INFO:tasks.workunit.client.1.smithi192.stdout:4/492: getdents d2/d36/d7f 0 2024-09-21T12:20:25.350 INFO:tasks.workunit.client.1.smithi192.stdout:8/591: unlink d14/d1a/d1d/d46/d4e/d83/d8d/d9c/lab 0 2024-09-21T12:20:25.351 INFO:tasks.workunit.client.1.smithi192.stdout:9/570: mkdir d5/dc/d80/d44/db3/db4 0 2024-09-21T12:20:25.353 INFO:tasks.workunit.client.1.smithi192.stdout:0/536: rename d3/d6/c40 to d3/d6/d72/d7a/c99 0 2024-09-21T12:20:25.354 INFO:tasks.workunit.client.1.smithi192.stdout:3/476: dwrite db/d16/d18/f3a [0,4194304] 0 2024-09-21T12:20:25.354 INFO:tasks.workunit.client.1.smithi192.stdout:2/531: creat d1b/d1e/d62/fa4 x:0 0 0 2024-09-21T12:20:25.360 INFO:tasks.workunit.client.1.smithi192.stdout:9/571: mkdir d5/dc/d80/d5a/d83/db5 0 2024-09-21T12:20:25.360 INFO:tasks.workunit.client.1.smithi192.stdout:7/539: symlink d6/d9/d70/lc0 0 2024-09-21T12:20:25.365 INFO:tasks.workunit.client.1.smithi192.stdout:7/540: fdatasync d6/d20/f40 0 2024-09-21T12:20:25.368 INFO:tasks.workunit.client.1.smithi192.stdout:1/568: dread d2/d12/d2f/d51/d24/d65/f53 [4194304,4194304] 0 2024-09-21T12:20:25.370 INFO:tasks.workunit.client.1.smithi192.stdout:5/783: dwrite d0/d65/d8e/d98/dba/fd9 [0,4194304] 0 2024-09-21T12:20:25.370 INFO:tasks.workunit.client.1.smithi192.stdout:3/477: unlink db/d16/d18/d21/c31 0 2024-09-21T12:20:25.374 INFO:tasks.workunit.client.1.smithi192.stdout:0/537: link d3/d5/f80 d3/de/d43/f9a 0 2024-09-21T12:20:25.375 INFO:tasks.workunit.client.1.smithi192.stdout:9/572: unlink d5/dc/d80/d44/d79/d55/d70/c89 0 2024-09-21T12:20:25.375 INFO:tasks.workunit.client.1.smithi192.stdout:4/493: dwrite d2/db/d3e/d41/d96/f8c [0,4194304] 0 2024-09-21T12:20:25.378 INFO:tasks.workunit.client.1.smithi192.stdout:1/569: symlink d2/dae/lb9 0 2024-09-21T12:20:25.380 INFO:tasks.workunit.client.1.smithi192.stdout:2/532: dwrite d1b/d1e/d5e/d75/d8d/f94 [0,4194304] 0 2024-09-21T12:20:25.381 INFO:tasks.workunit.client.1.smithi192.stdout:8/592: dwrite d14/d1a/d1d/d39/f3e [4194304,4194304] 0 2024-09-21T12:20:25.383 INFO:tasks.workunit.client.1.smithi192.stdout:7/541: rename d6/d9/d2d/d68 to d6/d20/d69/d90/da7/dc1 0 2024-09-21T12:20:25.384 INFO:tasks.workunit.client.1.smithi192.stdout:1/570: write d2/d12/d2f/d51/f38 [199146,66508] 0 2024-09-21T12:20:25.389 INFO:tasks.workunit.client.1.smithi192.stdout:0/538: mkdir d3/de/d9b 0 2024-09-21T12:20:25.391 INFO:tasks.workunit.client.1.smithi192.stdout:2/533: truncate d1b/f27 1734013 0 2024-09-21T12:20:25.391 INFO:tasks.workunit.client.1.smithi192.stdout:7/542: unlink d6/d20/fbb 0 2024-09-21T12:20:25.392 INFO:tasks.workunit.client.1.smithi192.stdout:0/539: write d3/de/d33/f5f [508168,5668] 0 2024-09-21T12:20:25.395 INFO:tasks.workunit.client.1.smithi192.stdout:9/573: dwrite d5/d8/d2c/f4b [0,4194304] 0 2024-09-21T12:20:25.398 INFO:tasks.workunit.client.1.smithi192.stdout:9/574: fsync d5/dc/d80/d44/d79/d3f/f9a 0 2024-09-21T12:20:25.399 INFO:tasks.workunit.client.1.smithi192.stdout:6/645: sync 2024-09-21T12:20:25.399 INFO:tasks.workunit.client.1.smithi192.stdout:3/478: getdents db/d16/d18/d21/d23 0 2024-09-21T12:20:25.400 INFO:tasks.workunit.client.1.smithi192.stdout:2/534: symlink d1b/d1e/la5 0 2024-09-21T12:20:25.401 INFO:tasks.workunit.client.1.smithi192.stdout:7/543: dwrite d6/d9/d1f/f21 [0,4194304] 0 2024-09-21T12:20:25.403 INFO:tasks.workunit.client.1.smithi192.stdout:7/544: write d6/d9/d70/d77/fb0 [1574978,79733] 0 2024-09-21T12:20:25.407 INFO:tasks.workunit.client.1.smithi192.stdout:9/575: dwrite d5/dc/d80/d44/d79/f82 [0,4194304] 0 2024-09-21T12:20:25.407 INFO:tasks.workunit.client.1.smithi192.stdout:9/576: readlink d5/d21/d3d/l7b 0 2024-09-21T12:20:25.408 INFO:tasks.workunit.client.1.smithi192.stdout:5/784: write d0/d65/d6e/dc0/d44/d85/d97/f78 [1651791,99606] 0 2024-09-21T12:20:25.411 INFO:tasks.workunit.client.1.smithi192.stdout:7/545: unlink d6/d9/f1c 0 2024-09-21T12:20:25.414 INFO:tasks.workunit.client.1.smithi192.stdout:2/535: mknod d1b/ca6 0 2024-09-21T12:20:25.415 INFO:tasks.workunit.client.1.smithi192.stdout:0/540: rename d3/d5/d28/d39/c8f to d3/d5/c9c 0 2024-09-21T12:20:25.418 INFO:tasks.workunit.client.1.smithi192.stdout:5/785: chown d0/d65/d6e/dc0/d44/d85/d97/f76 3197008 1 2024-09-21T12:20:25.418 INFO:tasks.workunit.client.1.smithi192.stdout:1/571: write d2/da/f27 [402273,118451] 0 2024-09-21T12:20:25.418 INFO:tasks.workunit.client.1.smithi192.stdout:0/541: chown d3/d5/f80 230828 1 2024-09-21T12:20:25.419 INFO:tasks.workunit.client.1.smithi192.stdout:3/479: creat db/d16/d18/d33/d3b/faf x:0 0 0 2024-09-21T12:20:25.420 INFO:tasks.workunit.client.1.smithi192.stdout:8/593: dwrite d14/d1a/d1d/d46/d4e/f76 [4194304,4194304] 0 2024-09-21T12:20:25.420 INFO:tasks.workunit.client.1.smithi192.stdout:2/536: stat d1b/d1e/l26 0 2024-09-21T12:20:25.421 INFO:tasks.workunit.client.1.smithi192.stdout:8/594: chown d14/lc2 26428 1 2024-09-21T12:20:25.421 INFO:tasks.workunit.client.1.smithi192.stdout:1/572: read d2/d12/d2f/d51/d24/d65/f53 [5515352,37409] 0 2024-09-21T12:20:25.422 INFO:tasks.workunit.client.1.smithi192.stdout:7/546: symlink d6/d20/d69/d90/da7/lc2 0 2024-09-21T12:20:25.422 INFO:tasks.workunit.client.1.smithi192.stdout:4/494: truncate d2/db/f26 3091009 0 2024-09-21T12:20:25.423 INFO:tasks.workunit.client.1.smithi192.stdout:6/646: rename da/d23/d37/fcb to da/d23/d37/d75/fda 0 2024-09-21T12:20:25.425 INFO:tasks.workunit.client.1.smithi192.stdout:2/537: mkdir d1b/d38/d53/d8b/da7 0 2024-09-21T12:20:25.425 INFO:tasks.workunit.client.1.smithi192.stdout:8/595: write d14/d1a/d1d/db6/fb8 [1578985,96256] 0 2024-09-21T12:20:25.426 INFO:tasks.workunit.client.1.smithi192.stdout:7/547: chown d6/d3a/l56 44491212 1 2024-09-21T12:20:25.428 INFO:tasks.workunit.client.1.smithi192.stdout:0/542: dread d3/d5/d28/f56 [0,4194304] 0 2024-09-21T12:20:25.428 INFO:tasks.workunit.client.1.smithi192.stdout:1/573: mknod d2/da/d9f/cba 0 2024-09-21T12:20:25.430 INFO:tasks.workunit.client.1.smithi192.stdout:4/495: write d2/db/d3e/d41/f77 [3704000,69392] 0 2024-09-21T12:20:25.430 INFO:tasks.workunit.client.1.smithi192.stdout:5/786: creat d0/dc/d13/f10a x:0 0 0 2024-09-21T12:20:25.433 INFO:tasks.workunit.client.1.smithi192.stdout:1/574: rename d2/lb2 to d2/d12/d2f/d51/lbb 0 2024-09-21T12:20:25.434 INFO:tasks.workunit.client.1.smithi192.stdout:3/480: rmdir db/d16/d76 0 2024-09-21T12:20:25.436 INFO:tasks.workunit.client.1.smithi192.stdout:6/647: dwrite da/d1f/d56/d78/faf [0,4194304] 0 2024-09-21T12:20:25.437 INFO:tasks.workunit.client.1.smithi192.stdout:9/577: write d5/fa [95668,112516] 0 2024-09-21T12:20:25.438 INFO:tasks.workunit.client.1.smithi192.stdout:1/575: dread - d2/d12/d2f/d51/d24/fa9 zero size 2024-09-21T12:20:25.438 INFO:tasks.workunit.client.1.smithi192.stdout:3/481: rename db/d16 to db/d16/d18/d33/d4a/db0 22 2024-09-21T12:20:25.438 INFO:tasks.workunit.client.1.smithi192.stdout:7/548: creat d6/d9/d1f/db9/fc3 x:0 0 0 2024-09-21T12:20:25.439 INFO:tasks.workunit.client.1.smithi192.stdout:0/543: truncate d3/d5/f80 3217809 0 2024-09-21T12:20:25.441 INFO:tasks.workunit.client.1.smithi192.stdout:7/549: write d6/d3a/fa8 [910929,109207] 0 2024-09-21T12:20:25.442 INFO:tasks.workunit.client.1.smithi192.stdout:7/550: fdatasync d6/d9/d2d/f5e 0 2024-09-21T12:20:25.443 INFO:tasks.workunit.client.1.smithi192.stdout:3/482: write db/d16/d18/d40/d60/d7b/d7c/d8c/f8d [4275262,62576] 0 2024-09-21T12:20:25.444 INFO:tasks.workunit.client.1.smithi192.stdout:6/648: truncate da/d1f/d48/d7d/da7/dc8/fd5 295899 0 2024-09-21T12:20:25.446 INFO:tasks.workunit.client.1.smithi192.stdout:1/576: write d2/da/f32 [224520,68874] 0 2024-09-21T12:20:25.447 INFO:tasks.workunit.client.1.smithi192.stdout:2/538: getdents d1b/d38/d53 0 2024-09-21T12:20:25.447 INFO:tasks.workunit.client.1.smithi192.stdout:6/649: chown da/d1f/d48/d7d/cd6 3254 1 2024-09-21T12:20:25.448 INFO:tasks.workunit.client.1.smithi192.stdout:6/650: stat da/d1f/d48/ca5 0 2024-09-21T12:20:25.448 INFO:tasks.workunit.client.1.smithi192.stdout:1/577: chown d2/d12/d2f/d51/d24/f35 403 1 2024-09-21T12:20:25.450 INFO:tasks.workunit.client.1.smithi192.stdout:0/544: rename d3/f6a to d3/d6/d1d/d89/f9d 0 2024-09-21T12:20:25.453 INFO:tasks.workunit.client.1.smithi192.stdout:7/551: mkdir d6/d9/d2d/dc4 0 2024-09-21T12:20:25.456 INFO:tasks.workunit.client.1.smithi192.stdout:0/545: read d3/d6/f5a [39320,89020] 0 2024-09-21T12:20:25.458 INFO:tasks.workunit.client.1.smithi192.stdout:4/496: write d2/d36/d7f/f39 [982061,41391] 0 2024-09-21T12:20:25.458 INFO:tasks.workunit.client.1.smithi192.stdout:5/787: link d0/d65/d6e/dc0/d44/d85/d97/d35/l8b d0/dc/d13/d37/da8/daa/d101/l10b 0 2024-09-21T12:20:25.462 INFO:tasks.workunit.client.1.smithi192.stdout:5/788: readlink d0/dc/d13/d37/l3c 0 2024-09-21T12:20:25.462 INFO:tasks.workunit.client.1.smithi192.stdout:9/578: dread d5/dc/d80/d44/f90 [0,4194304] 0 2024-09-21T12:20:25.463 INFO:tasks.workunit.client.1.smithi192.stdout:6/651: rename da/d1f/f5c to da/d1f/d48/fdb 0 2024-09-21T12:20:25.463 INFO:tasks.workunit.client.1.smithi192.stdout:9/579: truncate d5/d19/f3c 1232530 0 2024-09-21T12:20:25.469 INFO:tasks.workunit.client.1.smithi192.stdout:4/497: mkdir d2/d36/d55/d89/da6 0 2024-09-21T12:20:25.469 INFO:tasks.workunit.client.1.smithi192.stdout:3/483: dread db/d16/d18/d33/d88/f8b [0,4194304] 0 2024-09-21T12:20:25.471 INFO:tasks.workunit.client.1.smithi192.stdout:5/789: unlink d0/d65/ld1 0 2024-09-21T12:20:25.473 INFO:tasks.workunit.client.1.smithi192.stdout:6/652: rename da/d1f/d27/d6b/f9b to da/d23/d37/d75/d90/fdc 0 2024-09-21T12:20:25.474 INFO:tasks.workunit.client.1.smithi192.stdout:6/653: write da/f16 [4663040,66710] 0 2024-09-21T12:20:25.477 INFO:tasks.workunit.client.1.smithi192.stdout:0/546: dread d3/de/f24 [4194304,4194304] 0 2024-09-21T12:20:25.478 INFO:tasks.workunit.client.1.smithi192.stdout:1/578: dread d2/d12/d2f/d51/d24/d65/d5a/f75 [0,4194304] 0 2024-09-21T12:20:25.480 INFO:tasks.workunit.client.1.smithi192.stdout:3/484: fsync db/d16/d18/d33/fa1 0 2024-09-21T12:20:25.481 INFO:tasks.workunit.client.1.smithi192.stdout:9/580: symlink d5/dc/d80/lb6 0 2024-09-21T12:20:25.483 INFO:tasks.workunit.client.1.smithi192.stdout:4/498: dwrite d2/db/d3e/d41/f5e [0,4194304] 0 2024-09-21T12:20:25.483 INFO:tasks.workunit.client.1.smithi192.stdout:2/539: link d1b/l71 d1b/d38/d53/d8b/la8 0 2024-09-21T12:20:25.484 INFO:tasks.workunit.client.1.smithi192.stdout:0/547: mknod d3/d6/d83/d87/c9e 0 2024-09-21T12:20:25.485 INFO:tasks.workunit.client.1.smithi192.stdout:1/579: creat d2/d12/fbc x:0 0 0 2024-09-21T12:20:25.535 INFO:tasks.workunit.client.1.smithi192.stdout:7/552: link d6/d9/d51/fad d6/d9/d1f/fc5 0 2024-09-21T12:20:25.535 INFO:tasks.workunit.client.1.smithi192.stdout:4/499: rmdir d2/db/d3e/d41/d96/d88 39 2024-09-21T12:20:25.536 INFO:tasks.workunit.client.1.smithi192.stdout:5/790: creat d0/d65/f10c x:0 0 0 2024-09-21T12:20:25.536 INFO:tasks.workunit.client.1.smithi192.stdout:0/548: creat d3/d6/d1d/f9f x:0 0 0 2024-09-21T12:20:25.536 INFO:tasks.workunit.client.1.smithi192.stdout:3/485: mkdir db/d16/d18/d33/d3b/db1 0 2024-09-21T12:20:25.537 INFO:tasks.workunit.client.1.smithi192.stdout:2/540: dread d1b/d1e/d5e/d75/d8d/f94 [0,4194304] 0 2024-09-21T12:20:25.539 INFO:tasks.workunit.client.1.smithi192.stdout:6/654: creat da/d1f/d48/d7d/fdd x:0 0 0 2024-09-21T12:20:25.539 INFO:tasks.workunit.client.1.smithi192.stdout:1/580: creat d2/d12/d2f/d51/d24/d65/d8e/d9d/db6/fbd x:0 0 0 2024-09-21T12:20:25.540 INFO:tasks.workunit.client.1.smithi192.stdout:5/791: creat d0/d65/d8e/db9/f10d x:0 0 0 2024-09-21T12:20:25.541 INFO:tasks.workunit.client.1.smithi192.stdout:5/792: readlink d0/d65/d6e/dc0/d44/d85/d97/d35/l4e 0 2024-09-21T12:20:25.542 INFO:tasks.workunit.client.1.smithi192.stdout:7/553: rename d6/d20/d69/d90/da7/db3 to d6/d9/d2d/d7b/dc6 0 2024-09-21T12:20:25.545 INFO:tasks.workunit.client.1.smithi192.stdout:6/655: rmdir da/d1f/d48 39 2024-09-21T12:20:25.549 INFO:tasks.workunit.client.1.smithi192.stdout:5/793: dwrite d0/d65/fdf [0,4194304] 0 2024-09-21T12:20:25.551 INFO:tasks.workunit.client.1.smithi192.stdout:7/554: dwrite d6/d9/f5d [0,4194304] 0 2024-09-21T12:20:25.555 INFO:tasks.workunit.client.1.smithi192.stdout:2/541: link d1b/f6b d1b/d9e/fa9 0 2024-09-21T12:20:25.562 INFO:tasks.workunit.client.1.smithi192.stdout:0/549: truncate d3/d6/d1d/d92/f3e 285232 0 2024-09-21T12:20:25.562 INFO:tasks.workunit.client.1.smithi192.stdout:6/656: rmdir da/d1f/d56/da9 39 2024-09-21T12:20:25.562 INFO:tasks.workunit.client.1.smithi192.stdout:5/794: creat d0/d65/d6e/d91/f10e x:0 0 0 2024-09-21T12:20:25.563 INFO:tasks.workunit.client.1.smithi192.stdout:7/555: unlink d6/d9/d2d/f5e 0 2024-09-21T12:20:25.564 INFO:tasks.workunit.client.1.smithi192.stdout:3/486: creat db/d16/d18/d40/d60/d7b/d7c/fb2 x:0 0 0 2024-09-21T12:20:25.565 INFO:tasks.workunit.client.1.smithi192.stdout:0/550: write d3/d5/f14 [7154653,7149] 0 2024-09-21T12:20:25.565 INFO:tasks.workunit.client.1.smithi192.stdout:1/581: dread d2/d12/d2f/d41/d5c/f68 [0,4194304] 0 2024-09-21T12:20:25.566 INFO:tasks.workunit.client.1.smithi192.stdout:2/542: truncate d1b/f5b 1013008 0 2024-09-21T12:20:25.567 INFO:tasks.workunit.client.1.smithi192.stdout:5/795: read d0/d65/d6e/dc0/d44/d85/d97/d35/f87 [20060,26806] 0 2024-09-21T12:20:25.569 INFO:tasks.workunit.client.1.smithi192.stdout:3/487: rmdir db/d16/d18/d33/d88 39 2024-09-21T12:20:25.569 INFO:tasks.workunit.client.1.smithi192.stdout:4/500: dwrite d2/db/d3e/d41/d96/f58 [0,4194304] 0 2024-09-21T12:20:25.572 INFO:tasks.workunit.client.1.smithi192.stdout:0/551: unlink d3/de/d33/f4a 0 2024-09-21T12:20:25.576 INFO:tasks.workunit.client.1.smithi192.stdout:0/552: readlink d3/d5/l29 0 2024-09-21T12:20:25.576 INFO:tasks.workunit.client.1.smithi192.stdout:7/556: mknod d6/d9/d70/cc7 0 2024-09-21T12:20:25.578 INFO:tasks.workunit.client.1.smithi192.stdout:2/543: fsync f19 0 2024-09-21T12:20:25.580 INFO:tasks.workunit.client.1.smithi192.stdout:6/657: symlink da/d1f/d48/d9f/lde 0 2024-09-21T12:20:25.582 INFO:tasks.workunit.client.1.smithi192.stdout:5/796: dwrite d0/d65/d6e/dc0/d44/d85/fa6 [0,4194304] 0 2024-09-21T12:20:25.582 INFO:tasks.workunit.client.1.smithi192.stdout:3/488: dwrite db/d16/d18/d40/f7e [4194304,4194304] 0 2024-09-21T12:20:25.583 INFO:tasks.workunit.client.1.smithi192.stdout:1/582: mkdir d2/d12/d2f/d51/d24/d65/d5a/dbe 0 2024-09-21T12:20:25.585 INFO:tasks.workunit.client.1.smithi192.stdout:6/658: unlink da/d1f/d48/c82 0 2024-09-21T12:20:25.590 INFO:tasks.workunit.client.1.smithi192.stdout:2/544: dwrite d1b/d65/d77/fa3 [0,4194304] 0 2024-09-21T12:20:25.590 INFO:tasks.workunit.client.1.smithi192.stdout:1/583: creat d2/d82/fbf x:0 0 0 2024-09-21T12:20:25.595 INFO:tasks.workunit.client.1.smithi192.stdout:6/659: fdatasync da/f57 0 2024-09-21T12:20:25.596 INFO:tasks.workunit.client.1.smithi192.stdout:5/797: dread d0/d2/f6b [0,4194304] 0 2024-09-21T12:20:25.597 INFO:tasks.workunit.client.1.smithi192.stdout:6/660: fdatasync da/d1f/d27/d6b/f9c 0 2024-09-21T12:20:25.598 INFO:tasks.workunit.client.1.smithi192.stdout:6/661: fdatasync da/d23/d37/f59 0 2024-09-21T12:20:25.599 INFO:tasks.workunit.client.1.smithi192.stdout:4/501: dread d2/db/d34/d56/d6c/f74 [0,4194304] 0 2024-09-21T12:20:25.600 INFO:tasks.workunit.client.1.smithi192.stdout:6/662: fdatasync da/f4b 0 2024-09-21T12:20:25.600 INFO:tasks.workunit.client.1.smithi192.stdout:0/553: getdents d3 0 2024-09-21T12:20:25.601 INFO:tasks.workunit.client.1.smithi192.stdout:4/502: fdatasync d2/db/d3e/d57/f72 0 2024-09-21T12:20:25.601 INFO:tasks.workunit.client.1.smithi192.stdout:1/584: creat d2/da/d89/fc0 x:0 0 0 2024-09-21T12:20:25.602 INFO:tasks.workunit.client.1.smithi192.stdout:2/545: creat d1b/d1e/d5e/d88/faa x:0 0 0 2024-09-21T12:20:25.603 INFO:tasks.workunit.client.1.smithi192.stdout:4/503: write d2/df/f30 [5308749,58861] 0 2024-09-21T12:20:25.604 INFO:tasks.workunit.client.1.smithi192.stdout:0/554: truncate d3/de/d43/f66 4610758 0 2024-09-21T12:20:25.604 INFO:tasks.workunit.client.1.smithi192.stdout:0/555: stat d3/de 0 2024-09-21T12:20:25.605 INFO:tasks.workunit.client.1.smithi192.stdout:3/489: creat db/d16/fb3 x:0 0 0 2024-09-21T12:20:25.606 INFO:tasks.workunit.client.1.smithi192.stdout:3/490: write db/d16/fb3 [264266,22219] 0 2024-09-21T12:20:25.607 INFO:tasks.workunit.client.1.smithi192.stdout:3/491: read - db/d16/d18/d33/d3b/f65 zero size 2024-09-21T12:20:25.607 INFO:tasks.workunit.client.1.smithi192.stdout:1/585: symlink d2/d45/lc1 0 2024-09-21T12:20:25.608 INFO:tasks.workunit.client.1.smithi192.stdout:1/586: write d2/da/d9f/f67 [7965579,117490] 0 2024-09-21T12:20:25.608 INFO:tasks.workunit.client.1.smithi192.stdout:2/546: mkdir d1b/d1e/d5e/d75/dab 0 2024-09-21T12:20:25.610 INFO:tasks.workunit.client.1.smithi192.stdout:0/556: creat d3/d6/d1d/d89/fa0 x:0 0 0 2024-09-21T12:20:25.611 INFO:tasks.workunit.client.1.smithi192.stdout:6/663: unlink da/d23/d37/d75/d90/cb4 0 2024-09-21T12:20:25.613 INFO:tasks.workunit.client.1.smithi192.stdout:1/587: rmdir d2/d12/d2f/d51/d24/d65/d8e/d9d/db6 39 2024-09-21T12:20:25.614 INFO:tasks.workunit.client.1.smithi192.stdout:0/557: fsync d3/d6/d1d/d92/d51/f82 0 2024-09-21T12:20:25.615 INFO:tasks.workunit.client.1.smithi192.stdout:1/588: chown d2/da/f27 6 1 2024-09-21T12:20:25.617 INFO:tasks.workunit.client.1.smithi192.stdout:0/558: write d3/d6/d1d/f4d [726251,86463] 0 2024-09-21T12:20:25.617 INFO:tasks.workunit.client.1.smithi192.stdout:3/492: rename db/d16/d18/d40/d60/d7b/d7c to db/d16/db4 0 2024-09-21T12:20:25.619 INFO:tasks.workunit.client.1.smithi192.stdout:6/664: dwrite da/d1f/d56/d78/fbd [0,4194304] 0 2024-09-21T12:20:25.621 INFO:tasks.workunit.client.1.smithi192.stdout:0/559: write d3/de/f11 [2718187,118754] 0 2024-09-21T12:20:25.621 INFO:tasks.workunit.client.1.smithi192.stdout:6/665: read da/d1f/f3c [1483165,91611] 0 2024-09-21T12:20:25.622 INFO:tasks.workunit.client.1.smithi192.stdout:1/589: creat d2/d12/d2f/fc2 x:0 0 0 2024-09-21T12:20:25.623 INFO:tasks.workunit.client.1.smithi192.stdout:0/560: read d3/d6/d1d/d92/d51/f32 [2652899,90532] 0 2024-09-21T12:20:25.623 INFO:tasks.workunit.client.1.smithi192.stdout:3/493: mknod db/d16/db4/cb5 0 2024-09-21T12:20:25.625 INFO:tasks.workunit.client.1.smithi192.stdout:6/666: mknod da/d1f/d48/d7d/daa/cdf 0 2024-09-21T12:20:25.630 INFO:tasks.workunit.client.1.smithi192.stdout:1/590: dwrite d2/d12/d2f/d51/f20 [0,4194304] 0 2024-09-21T12:20:25.630 INFO:tasks.workunit.client.1.smithi192.stdout:2/547: dread d1b/d1e/d62/f6c [0,4194304] 0 2024-09-21T12:20:25.631 INFO:tasks.workunit.client.1.smithi192.stdout:6/667: unlink da/f16 0 2024-09-21T12:20:25.632 INFO:tasks.workunit.client.1.smithi192.stdout:3/494: symlink db/d16/d18/d33/d3b/lb6 0 2024-09-21T12:20:25.636 INFO:tasks.workunit.client.1.smithi192.stdout:2/548: creat d1b/d9e/fac x:0 0 0 2024-09-21T12:20:25.637 INFO:tasks.workunit.client.1.smithi192.stdout:5/798: truncate d0/dc/f61 4270185 0 2024-09-21T12:20:25.639 INFO:tasks.workunit.client.1.smithi192.stdout:1/591: chown d2/d12/d2f/d51/d24/d65/d8e/d9d/db6/fb7 5064925 1 2024-09-21T12:20:25.641 INFO:tasks.workunit.client.1.smithi192.stdout:8/596: sync 2024-09-21T12:20:25.641 INFO:tasks.workunit.client.1.smithi192.stdout:9/581: sync 2024-09-21T12:20:25.642 INFO:tasks.workunit.client.1.smithi192.stdout:7/557: sync 2024-09-21T12:20:25.644 INFO:tasks.workunit.client.1.smithi192.stdout:6/668: creat da/d1f/d48/d7d/daa/dd7/fe0 x:0 0 0 2024-09-21T12:20:25.645 INFO:tasks.workunit.client.1.smithi192.stdout:3/495: rmdir db/d16/d18/d33/d88 39 2024-09-21T12:20:25.650 INFO:tasks.workunit.client.1.smithi192.stdout:6/669: truncate da/d1f/d56/f83 611199 0 2024-09-21T12:20:25.650 INFO:tasks.workunit.client.1.smithi192.stdout:4/504: dwrite d2/db/d3e/d41/f70 [0,4194304] 0 2024-09-21T12:20:25.652 INFO:tasks.workunit.client.1.smithi192.stdout:7/558: dread d6/d9/d70/d77/fb7 [0,4194304] 0 2024-09-21T12:20:25.653 INFO:tasks.workunit.client.1.smithi192.stdout:2/549: creat d1b/d1e/fad x:0 0 0 2024-09-21T12:20:25.653 INFO:tasks.workunit.client.1.smithi192.stdout:6/670: read da/d1f/f86 [334572,33237] 0 2024-09-21T12:20:25.653 INFO:tasks.workunit.client.1.smithi192.stdout:9/582: dwrite d5/dc/d80/d44/d79/fb1 [0,4194304] 0 2024-09-21T12:20:25.660 INFO:tasks.workunit.client.1.smithi192.stdout:5/799: creat d0/d65/d6e/dc0/d44/d85/d97/d9e/dd5/f10f x:0 0 0 2024-09-21T12:20:25.660 INFO:tasks.workunit.client.1.smithi192.stdout:1/592: rmdir d2/d12/d2f/d51/d24/d65/d5a/dbe 0 2024-09-21T12:20:25.660 INFO:tasks.workunit.client.1.smithi192.stdout:3/496: creat db/d16/d18/d33/d3b/d68/fb7 x:0 0 0 2024-09-21T12:20:25.661 INFO:tasks.workunit.client.1.smithi192.stdout:9/583: write d5/dc/d80/d44/d79/f82 [3283026,89939] 0 2024-09-21T12:20:25.662 INFO:tasks.workunit.client.1.smithi192.stdout:7/559: creat d6/d9/d1f/d3e/d7a/fc8 x:0 0 0 2024-09-21T12:20:25.663 INFO:tasks.workunit.client.1.smithi192.stdout:5/800: fdatasync d0/d65/d8e/d98/dba/fd9 0 2024-09-21T12:20:25.664 INFO:tasks.workunit.client.1.smithi192.stdout:9/584: stat d5/dc/d80/d44/f90 0 2024-09-21T12:20:25.665 INFO:tasks.workunit.client.1.smithi192.stdout:0/561: dwrite d3/de/d43/f9a [0,4194304] 0 2024-09-21T12:20:25.667 INFO:tasks.workunit.client.1.smithi192.stdout:8/597: getdents d14/d1a/d1d/db6 0 2024-09-21T12:20:25.668 INFO:tasks.workunit.client.1.smithi192.stdout:8/598: readlink d14/d1a/d1d/d39/l56 0 2024-09-21T12:20:25.671 INFO:tasks.workunit.client.1.smithi192.stdout:0/562: dread d3/f78 [0,4194304] 0 2024-09-21T12:20:25.674 INFO:tasks.workunit.client.1.smithi192.stdout:2/550: creat d1b/d1e/d5e/d75/dab/fae x:0 0 0 2024-09-21T12:20:25.675 INFO:tasks.workunit.client.1.smithi192.stdout:2/551: write f15 [8613216,129044] 0 2024-09-21T12:20:25.680 INFO:tasks.workunit.client.1.smithi192.stdout:3/497: dread db/d16/d61/d2e/f45 [4194304,4194304] 0 2024-09-21T12:20:25.681 INFO:tasks.workunit.client.1.smithi192.stdout:1/593: creat d2/fc3 x:0 0 0 2024-09-21T12:20:25.683 INFO:tasks.workunit.client.1.smithi192.stdout:5/801: symlink d0/d65/d6e/dc0/d44/d85/l110 0 2024-09-21T12:20:25.686 INFO:tasks.workunit.client.1.smithi192.stdout:6/671: creat da/d1f/d48/d7d/fe1 x:0 0 0 2024-09-21T12:20:25.688 INFO:tasks.workunit.client.1.smithi192.stdout:2/552: mkdir d1b/d1e/d5e/d75/da1/daf 0 2024-09-21T12:20:25.688 INFO:tasks.workunit.client.1.smithi192.stdout:3/498: mkdir db/d16/d61/d2e/db8 0 2024-09-21T12:20:25.689 INFO:tasks.workunit.client.1.smithi192.stdout:4/505: write d2/d36/d55/d89/f8f [1116,44914] 0 2024-09-21T12:20:25.689 INFO:tasks.workunit.client.1.smithi192.stdout:1/594: write d2/d12/d2f/d51/d24/d65/d5a/f75 [5065595,47368] 0 2024-09-21T12:20:25.690 INFO:tasks.workunit.client.1.smithi192.stdout:9/585: rename d5/dc/d80/d44/d79/d3f/c94 to d5/dc/d80/d44/d79/cb7 0 2024-09-21T12:20:25.691 INFO:tasks.workunit.client.1.smithi192.stdout:4/506: stat d2/db 0 2024-09-21T12:20:25.692 INFO:tasks.workunit.client.1.smithi192.stdout:7/560: dread d6/d3a/d6d/f78 [0,4194304] 0 2024-09-21T12:20:25.693 INFO:tasks.workunit.client.1.smithi192.stdout:8/599: creat d14/fc5 x:0 0 0 2024-09-21T12:20:25.694 INFO:tasks.workunit.client.1.smithi192.stdout:5/802: symlink d0/d65/d6e/dc0/d44/l111 0 2024-09-21T12:20:25.694 INFO:tasks.workunit.client.1.smithi192.stdout:4/507: mknod d2/d19/d9c/ca7 0 2024-09-21T12:20:25.694 INFO:tasks.workunit.client.1.smithi192.stdout:3/499: chown db/d16/d18/d33/d3b/l78 40 1 2024-09-21T12:20:25.695 INFO:tasks.workunit.client.1.smithi192.stdout:7/561: fdatasync d6/d3a/d63/f65 0 2024-09-21T12:20:25.696 INFO:tasks.workunit.client.1.smithi192.stdout:0/563: dread d3/d6/fd [0,4194304] 0 2024-09-21T12:20:25.696 INFO:tasks.workunit.client.1.smithi192.stdout:1/595: write d2/d12/d2f/d51/d24/d65/f53 [5314502,14873] 0 2024-09-21T12:20:25.696 INFO:tasks.workunit.client.1.smithi192.stdout:6/672: mkdir da/d23/d37/d75/de2 0 2024-09-21T12:20:25.697 INFO:tasks.workunit.client.1.smithi192.stdout:8/600: write f7 [1304438,123410] 0 2024-09-21T12:20:25.700 INFO:tasks.workunit.client.1.smithi192.stdout:9/586: getdents d5/dc/d40/dad/d53 0 2024-09-21T12:20:25.701 INFO:tasks.workunit.client.1.smithi192.stdout:1/596: write d2/da/fad [604128,115283] 0 2024-09-21T12:20:25.701 INFO:tasks.workunit.client.1.smithi192.stdout:4/508: dread d2/db/d3e/d41/f69 [0,4194304] 0 2024-09-21T12:20:25.701 INFO:tasks.workunit.client.1.smithi192.stdout:2/553: link c11 d1b/d1e/d5e/d75/da1/daf/cb0 0 2024-09-21T12:20:25.704 INFO:tasks.workunit.client.1.smithi192.stdout:5/803: truncate d0/dc/f6f 1563431 0 2024-09-21T12:20:25.705 INFO:tasks.workunit.client.1.smithi192.stdout:0/564: rename d3/de/c6f to d3/d6/d1d/ca1 0 2024-09-21T12:20:25.708 INFO:tasks.workunit.client.1.smithi192.stdout:9/587: creat d5/fb8 x:0 0 0 2024-09-21T12:20:25.709 INFO:tasks.workunit.client.1.smithi192.stdout:2/554: creat d1b/d1e/d5e/d75/d8d/fb1 x:0 0 0 2024-09-21T12:20:25.713 INFO:tasks.workunit.client.1.smithi192.stdout:3/500: dwrite db/d16/d18/d40/d60/f87 [0,4194304] 0 2024-09-21T12:20:25.714 INFO:tasks.workunit.client.1.smithi192.stdout:7/562: dwrite d6/d9/f5f [0,4194304] 0 2024-09-21T12:20:25.715 INFO:tasks.workunit.client.1.smithi192.stdout:1/597: rename d2/d12/d2f/d51/l54 to d2/da/lc4 0 2024-09-21T12:20:25.716 INFO:tasks.workunit.client.1.smithi192.stdout:4/509: rename d2/db/d3e/d41/d96 to d2/db/d3e/d41/da8 0 2024-09-21T12:20:25.721 INFO:tasks.workunit.client.1.smithi192.stdout:2/555: truncate d1b/d1e/d5e/d88/faa 878589 0 2024-09-21T12:20:25.721 INFO:tasks.workunit.client.1.smithi192.stdout:9/588: creat d5/dc/d80/d44/d8e/fb9 x:0 0 0 2024-09-21T12:20:25.723 INFO:tasks.workunit.client.1.smithi192.stdout:6/673: dread da/d1f/d27/f28 [0,4194304] 0 2024-09-21T12:20:25.724 INFO:tasks.workunit.client.1.smithi192.stdout:0/565: dwrite d3/de/f8d [0,4194304] 0 2024-09-21T12:20:25.724 INFO:tasks.workunit.client.1.smithi192.stdout:8/601: rename d14/d1a/d1d/d20/d5f/d8a/l91 to d14/d1a/d1d/d51/d80/d9a/dba/lc6 0 2024-09-21T12:20:25.727 INFO:tasks.workunit.client.1.smithi192.stdout:8/602: read - d14/d1a/d1d/d46/d4e/d83/d8d/fb9 zero size 2024-09-21T12:20:25.729 INFO:tasks.workunit.client.1.smithi192.stdout:3/501: rename db/d16/d18/f3a to db/d16/db4/d8c/fb9 0 2024-09-21T12:20:25.732 INFO:tasks.workunit.client.1.smithi192.stdout:0/566: dwrite d3/d5/f14 [0,4194304] 0 2024-09-21T12:20:25.736 INFO:tasks.workunit.client.1.smithi192.stdout:1/598: rename d2/d12/d2f/d51/d24/fa9 to d2/da/d6b/d7d/fc5 0 2024-09-21T12:20:25.738 INFO:tasks.workunit.client.1.smithi192.stdout:6/674: creat da/fe3 x:0 0 0 2024-09-21T12:20:25.738 INFO:tasks.workunit.client.1.smithi192.stdout:4/510: link d2/db/d3e/d57/d32/d4f/d71/la0 d2/d19/d9c/d9e/la9 0 2024-09-21T12:20:25.739 INFO:tasks.workunit.client.1.smithi192.stdout:8/603: mknod d14/d18/d7b/cc7 0 2024-09-21T12:20:25.742 INFO:tasks.workunit.client.1.smithi192.stdout:0/567: readlink d3/de/l4e 0 2024-09-21T12:20:25.743 INFO:tasks.workunit.client.1.smithi192.stdout:0/568: write d3/f93 [845058,36742] 0 2024-09-21T12:20:25.748 INFO:tasks.workunit.client.1.smithi192.stdout:9/589: rename d5/d19/d32/c72 to d5/dc/d80/d44/d79/d55/d70/da0/cba 0 2024-09-21T12:20:25.750 INFO:tasks.workunit.client.1.smithi192.stdout:1/599: read d2/da/f8f [428119,31231] 0 2024-09-21T12:20:25.752 INFO:tasks.workunit.client.1.smithi192.stdout:9/590: dread - d5/dc/d80/d44/d79/d3f/d4d/d6d/fab zero size 2024-09-21T12:20:25.753 INFO:tasks.workunit.client.1.smithi192.stdout:0/569: dwrite d3/d6/d1d/d92/d51/f3b [0,4194304] 0 2024-09-21T12:20:25.755 INFO:tasks.workunit.client.1.smithi192.stdout:2/556: dread d1b/d1e/f47 [0,4194304] 0 2024-09-21T12:20:25.757 INFO:tasks.workunit.client.1.smithi192.stdout:0/570: stat d3/l10 0 2024-09-21T12:20:25.764 INFO:tasks.workunit.client.1.smithi192.stdout:9/591: write d5/dc/d80/d44/d79/f43 [4395924,61577] 0 2024-09-21T12:20:25.765 INFO:tasks.workunit.client.1.smithi192.stdout:5/804: dread d0/d65/d6e/dc0/d44/d85/d97/f76 [0,4194304] 0 2024-09-21T12:20:25.766 INFO:tasks.workunit.client.1.smithi192.stdout:7/563: dwrite d6/d3a/f46 [0,4194304] 0 2024-09-21T12:20:25.768 INFO:tasks.workunit.client.1.smithi192.stdout:2/557: mkdir d1b/d1e/d62/db2 0 2024-09-21T12:20:25.774 INFO:tasks.workunit.client.1.smithi192.stdout:2/558: readlink lb 0 2024-09-21T12:20:25.775 INFO:tasks.workunit.client.1.smithi192.stdout:4/511: dwrite d2/db/d1a/f46 [0,4194304] 0 2024-09-21T12:20:25.778 INFO:tasks.workunit.client.1.smithi192.stdout:7/564: write d6/d3a/f3f [379495,98099] 0 2024-09-21T12:20:25.782 INFO:tasks.workunit.client.1.smithi192.stdout:1/600: truncate d2/d82/f9a 2682925 0 2024-09-21T12:20:25.782 INFO:tasks.workunit.client.1.smithi192.stdout:3/502: dwrite db/f4f [0,4194304] 0 2024-09-21T12:20:25.785 INFO:tasks.workunit.client.1.smithi192.stdout:9/592: write d5/dc/f68 [2961514,4841] 0 2024-09-21T12:20:25.786 INFO:tasks.workunit.client.1.smithi192.stdout:7/565: fdatasync d6/d20/f4d 0 2024-09-21T12:20:25.787 INFO:tasks.workunit.client.1.smithi192.stdout:8/604: dwrite fc [4194304,4194304] 0 2024-09-21T12:20:25.787 INFO:tasks.workunit.client.1.smithi192.stdout:2/559: unlink d1b/c55 0 2024-09-21T12:20:25.789 INFO:tasks.workunit.client.1.smithi192.stdout:4/512: symlink d2/d19/laa 0 2024-09-21T12:20:25.792 INFO:tasks.workunit.client.1.smithi192.stdout:6/675: dread da/f35 [0,4194304] 0 2024-09-21T12:20:25.793 INFO:tasks.workunit.client.1.smithi192.stdout:5/805: dwrite d0/d65/d6e/f34 [0,4194304] 0 2024-09-21T12:20:25.794 INFO:tasks.workunit.client.1.smithi192.stdout:9/593: chown d5/dc/f76 183178 1 2024-09-21T12:20:25.795 INFO:tasks.workunit.client.1.smithi192.stdout:2/560: mknod d1b/d1e/d7b/cb3 0 2024-09-21T12:20:25.797 INFO:tasks.workunit.client.1.smithi192.stdout:7/566: rename d6/d9/d2d/d7b/dc6 to d6/d20/dc9 0 2024-09-21T12:20:25.802 INFO:tasks.workunit.client.1.smithi192.stdout:6/676: chown da/d1f/d48/f53 60865611 1 2024-09-21T12:20:25.802 INFO:tasks.workunit.client.1.smithi192.stdout:7/567: write d6/d9/f5d [507085,119173] 0 2024-09-21T12:20:25.803 INFO:tasks.workunit.client.1.smithi192.stdout:2/561: unlink d1b/d38/l4e 0 2024-09-21T12:20:25.805 INFO:tasks.workunit.client.1.smithi192.stdout:3/503: dread db/d16/d18/d33/d4a/f5f [0,4194304] 0 2024-09-21T12:20:25.805 INFO:tasks.workunit.client.1.smithi192.stdout:2/562: readlink lb 0 2024-09-21T12:20:25.808 INFO:tasks.workunit.client.1.smithi192.stdout:7/568: chown d6/c1a 57890 1 2024-09-21T12:20:25.809 INFO:tasks.workunit.client.1.smithi192.stdout:4/513: dread d2/db/d3e/d41/da8/f58 [0,4194304] 0 2024-09-21T12:20:25.814 INFO:tasks.workunit.client.1.smithi192.stdout:3/504: chown db/d16/d18/d33/d3b/lb6 49672857 1 2024-09-21T12:20:25.815 INFO:tasks.workunit.client.1.smithi192.stdout:8/605: dwrite d14/d1a/d1d/d39/f8b [0,4194304] 0 2024-09-21T12:20:25.815 INFO:tasks.workunit.client.1.smithi192.stdout:9/594: dwrite d5/dc/d80/d44/d79/f43 [0,4194304] 0 2024-09-21T12:20:25.815 INFO:tasks.workunit.client.1.smithi192.stdout:5/806: dread d0/d65/d6e/f34 [0,4194304] 0 2024-09-21T12:20:25.816 INFO:tasks.workunit.client.1.smithi192.stdout:9/595: chown d5/d8/d2c/f5d 71468387 1 2024-09-21T12:20:25.818 INFO:tasks.workunit.client.1.smithi192.stdout:9/596: fdatasync d5/d8/f2d 0 2024-09-21T12:20:25.819 INFO:tasks.workunit.client.1.smithi192.stdout:9/597: read - d5/dc/d40/dad/f9c zero size 2024-09-21T12:20:25.822 INFO:tasks.workunit.client.1.smithi192.stdout:4/514: creat d2/d19/d9c/fab x:0 0 0 2024-09-21T12:20:25.827 INFO:tasks.workunit.client.1.smithi192.stdout:5/807: mknod d0/dc/d13/d37/da8/daa/de4/c112 0 2024-09-21T12:20:25.828 INFO:tasks.workunit.client.1.smithi192.stdout:2/563: link d1b/d1e/d3d/l70 d1b/d1e/d5e/d88/lb4 0 2024-09-21T12:20:25.829 INFO:tasks.workunit.client.1.smithi192.stdout:2/564: write d1b/d1e/f31 [990436,14963] 0 2024-09-21T12:20:25.830 INFO:tasks.workunit.client.1.smithi192.stdout:4/515: creat d2/db/d34/d56/d83/d93/fac x:0 0 0 2024-09-21T12:20:25.830 INFO:tasks.workunit.client.1.smithi192.stdout:2/565: chown d1b/d1e/c25 1183 1 2024-09-21T12:20:25.831 INFO:tasks.workunit.client.1.smithi192.stdout:3/505: rename db/d16/d18/d33/c63 to db/d16/d18/d33/d3b/cba 0 2024-09-21T12:20:25.832 INFO:tasks.workunit.client.1.smithi192.stdout:4/516: write d2/db/d3e/d41/da8/f79 [2870583,80009] 0 2024-09-21T12:20:25.833 INFO:tasks.workunit.client.1.smithi192.stdout:8/606: rename d14/d1a/d1d/d46/d4e/d83/f87 to d14/d1a/d1d/d46/d4e/d83/d8d/d9c/dbe/fc8 0 2024-09-21T12:20:25.834 INFO:tasks.workunit.client.1.smithi192.stdout:4/517: write d2/d36/d55/f60 [987802,89364] 0 2024-09-21T12:20:25.837 INFO:tasks.workunit.client.1.smithi192.stdout:9/598: rename d5/d21 to d5/dc/d64/dbb 0 2024-09-21T12:20:25.839 INFO:tasks.workunit.client.1.smithi192.stdout:8/607: creat d14/d18/d88/fc9 x:0 0 0 2024-09-21T12:20:25.839 INFO:tasks.workunit.client.1.smithi192.stdout:2/566: link c11 d1b/d1e/d62/d99/cb5 0 2024-09-21T12:20:25.839 INFO:tasks.workunit.client.1.smithi192.stdout:7/569: dread d6/d9/f14 [0,4194304] 0 2024-09-21T12:20:25.840 INFO:tasks.workunit.client.1.smithi192.stdout:9/599: symlink d5/dc/d80/d5a/lbc 0 2024-09-21T12:20:25.841 INFO:tasks.workunit.client.1.smithi192.stdout:7/570: chown d6/d3a/c8b 3401 1 2024-09-21T12:20:25.841 INFO:tasks.workunit.client.1.smithi192.stdout:2/567: write d1b/d1e/d62/fa4 [955012,22889] 0 2024-09-21T12:20:25.842 INFO:tasks.workunit.client.1.smithi192.stdout:2/568: stat d1b/d1e/d3d/c81 0 2024-09-21T12:20:25.842 INFO:tasks.workunit.client.1.smithi192.stdout:9/600: creat d5/dc/d40/fbd x:0 0 0 2024-09-21T12:20:25.843 INFO:tasks.workunit.client.1.smithi192.stdout:7/571: mknod d6/d9/d2d/d7b/cca 0 2024-09-21T12:20:25.843 INFO:tasks.workunit.client.1.smithi192.stdout:9/601: write d5/f2f [3797819,21798] 0 2024-09-21T12:20:25.844 INFO:tasks.workunit.client.1.smithi192.stdout:2/569: rmdir d1b/d1e/d5e/d75/dab 39 2024-09-21T12:20:25.851 INFO:tasks.workunit.client.1.smithi192.stdout:2/570: dwrite d1b/d1e/f69 [0,4194304] 0 2024-09-21T12:20:25.857 INFO:tasks.workunit.client.1.smithi192.stdout:8/608: dread d14/d1a/d1d/d51/fa2 [0,4194304] 0 2024-09-21T12:20:25.859 INFO:tasks.workunit.client.1.smithi192.stdout:8/609: write d14/d1a/d1d/f57 [2438441,96829] 0 2024-09-21T12:20:25.859 INFO:tasks.workunit.client.1.smithi192.stdout:9/602: dread d5/dc/f76 [0,4194304] 0 2024-09-21T12:20:25.862 INFO:tasks.workunit.client.1.smithi192.stdout:9/603: creat d5/dc/d80/d44/d79/d55/d70/da0/da2/fbe x:0 0 0 2024-09-21T12:20:26.011 INFO:tasks.workunit.client.1.smithi192.stdout:0/571: sync 2024-09-21T12:20:26.011 INFO:tasks.workunit.client.1.smithi192.stdout:1/601: sync 2024-09-21T12:20:26.011 INFO:tasks.workunit.client.1.smithi192.stdout:7/572: sync 2024-09-21T12:20:26.011 INFO:tasks.workunit.client.1.smithi192.stdout:5/808: sync 2024-09-21T12:20:26.012 INFO:tasks.workunit.client.1.smithi192.stdout:1/602: fsync d2/d12/d2f/d51/f37 0 2024-09-21T12:20:26.012 INFO:tasks.workunit.client.1.smithi192.stdout:7/573: rmdir d6/d9/d1f 39 2024-09-21T12:20:26.014 INFO:tasks.workunit.client.1.smithi192.stdout:5/809: unlink d0/d65/d6e/dc0/f69 0 2024-09-21T12:20:26.014 INFO:tasks.workunit.client.1.smithi192.stdout:0/572: mknod d3/d6/d1d/d92/d51/ca2 0 2024-09-21T12:20:26.015 INFO:tasks.workunit.client.1.smithi192.stdout:7/574: symlink d6/d9/d2d/lcb 0 2024-09-21T12:20:26.015 INFO:tasks.workunit.client.1.smithi192.stdout:1/603: mkdir d2/d12/d2f/d51/d24/d65/d8e/d9d/db6/dc6 0 2024-09-21T12:20:26.016 INFO:tasks.workunit.client.1.smithi192.stdout:0/573: mknod d3/d6/d1d/d89/ca3 0 2024-09-21T12:20:26.017 INFO:tasks.workunit.client.1.smithi192.stdout:0/574: stat d3/d6/f68 0 2024-09-21T12:20:26.018 INFO:tasks.workunit.client.1.smithi192.stdout:1/604: symlink d2/da/d6b/d7d/lc7 0 2024-09-21T12:20:26.019 INFO:tasks.workunit.client.1.smithi192.stdout:5/810: dread d0/dc/f6f [0,4194304] 0 2024-09-21T12:20:26.020 INFO:tasks.workunit.client.1.smithi192.stdout:5/811: fdatasync d0/dc/d104/f46 0 2024-09-21T12:20:26.021 INFO:tasks.workunit.client.1.smithi192.stdout:5/812: truncate d0/d65/d6e/da7/da0/fb5 749279 0 2024-09-21T12:20:26.022 INFO:tasks.workunit.client.1.smithi192.stdout:5/813: write d0/d65/d6e/da7/da0/ff6 [400506,126727] 0 2024-09-21T12:20:26.026 INFO:tasks.workunit.client.1.smithi192.stdout:5/814: link d0/dc/d13/d37/c90 d0/d65/d6e/dc0/d44/c113 0 2024-09-21T12:20:26.170 INFO:tasks.workunit.client.1.smithi192.stdout:6/677: dread da/d23/d37/f33 [4194304,4194304] 0 2024-09-21T12:20:26.173 INFO:tasks.workunit.client.1.smithi192.stdout:6/678: creat da/d1f/d27/d3e/fe4 x:0 0 0 2024-09-21T12:20:26.176 INFO:tasks.workunit.client.1.smithi192.stdout:4/518: rename d2/d19 to d2/db/d3e/d57/d32/d4f/d71/d9d/dad 0 2024-09-21T12:20:26.176 INFO:tasks.workunit.client.1.smithi192.stdout:6/679: rmdir da/d1f/d48/d7d 39 2024-09-21T12:20:26.178 INFO:tasks.workunit.client.1.smithi192.stdout:8/610: rename d14/f85 to d14/d1a/fca 0 2024-09-21T12:20:26.181 INFO:tasks.workunit.client.1.smithi192.stdout:4/519: dread d2/db/d3e/d57/d32/d4f/d71/d9d/dad/d4b/f64 [0,4194304] 0 2024-09-21T12:20:26.181 INFO:tasks.workunit.client.1.smithi192.stdout:9/604: rename d5/dc/d40/dad/d53/d6e/c8a to d5/dc/d80/d44/d79/d55/d70/da0/da2/cbf 0 2024-09-21T12:20:26.182 INFO:tasks.workunit.client.1.smithi192.stdout:9/605: fdatasync d5/dc/d64/dbb/f9f 0 2024-09-21T12:20:26.184 INFO:tasks.workunit.client.1.smithi192.stdout:1/605: rename d2/d12/d2f/d41/d61 to d2/da/d6b/dc8 0 2024-09-21T12:20:26.186 INFO:tasks.workunit.client.1.smithi192.stdout:6/680: link da/f6a da/d1f/d27/fe5 0 2024-09-21T12:20:26.188 INFO:tasks.workunit.client.1.smithi192.stdout:3/506: truncate db/f4f 1557183 0 2024-09-21T12:20:26.189 INFO:tasks.workunit.client.1.smithi192.stdout:3/507: chown db/d16/d61/d2e/f45 239682258 1 2024-09-21T12:20:26.189 INFO:tasks.workunit.client.1.smithi192.stdout:3/508: fsync db/d16/d18/d40/f6e 0 2024-09-21T12:20:26.192 INFO:tasks.workunit.client.1.smithi192.stdout:6/681: truncate da/d1f/d27/f6f 549221 0 2024-09-21T12:20:26.194 INFO:tasks.workunit.client.1.smithi192.stdout:5/815: rename d0/d65/d6e/dc0/d44/d85/d97/l1b to d0/dc/d13/d37/da8/daa/dc5/ddd/d107/l114 0 2024-09-21T12:20:26.199 INFO:tasks.workunit.client.1.smithi192.stdout:2/571: truncate d1b/d38/d7d/f8e 3522434 0 2024-09-21T12:20:26.199 INFO:tasks.workunit.client.1.smithi192.stdout:5/816: creat d0/d65/d6e/dc0/d44/d85/d97/d9e/f115 x:0 0 0 2024-09-21T12:20:26.200 INFO:tasks.workunit.client.1.smithi192.stdout:4/520: getdents d2/db/d3e/d57/d32/d4f/d71/d9d/dad/d9c/d9e 0 2024-09-21T12:20:26.200 INFO:tasks.workunit.client.1.smithi192.stdout:4/521: chown d2/d36/d7f/d68 23381500 1 2024-09-21T12:20:26.201 INFO:tasks.workunit.client.1.smithi192.stdout:3/509: creat db/d16/d18/d33/d3b/db1/fbb x:0 0 0 2024-09-21T12:20:26.202 INFO:tasks.workunit.client.1.smithi192.stdout:6/682: mkdir da/d1f/de6 0 2024-09-21T12:20:26.204 INFO:tasks.workunit.client.1.smithi192.stdout:8/611: rename d14/d1a/d1d/d51/d80/d9a/dba/lc6 to d14/d1a/d1d/d46/d4e/d83/d8d/d99/lcb 0 2024-09-21T12:20:26.205 INFO:tasks.workunit.client.1.smithi192.stdout:8/612: chown d14/d1a/d1d/d51/d80/lb7 493 1 2024-09-21T12:20:26.207 INFO:tasks.workunit.client.1.smithi192.stdout:4/522: symlink d2/db/d3e/d57/d32/d4f/d71/d9d/dad/d9c/lae 0 2024-09-21T12:20:26.209 INFO:tasks.workunit.client.1.smithi192.stdout:2/572: mknod d1b/d38/d53/d8b/da7/cb6 0 2024-09-21T12:20:26.209 INFO:tasks.workunit.client.1.smithi192.stdout:0/575: write d3/d5/d28/f56 [486801,103127] 0 2024-09-21T12:20:26.210 INFO:tasks.workunit.client.1.smithi192.stdout:9/606: rename d5/dc/d80/d44/db3/db4 to d5/d19/d32/dc0 0 2024-09-21T12:20:26.212 INFO:tasks.workunit.client.1.smithi192.stdout:8/613: fdatasync d14/d1a/d1d/d46/f4f 0 2024-09-21T12:20:26.213 INFO:tasks.workunit.client.1.smithi192.stdout:7/575: dwrite d6/d20/d69/d90/f94 [0,4194304] 0 2024-09-21T12:20:26.220 INFO:tasks.workunit.client.1.smithi192.stdout:0/576: unlink d3/d5/d28/d39/l42 0 2024-09-21T12:20:26.225 INFO:tasks.workunit.client.1.smithi192.stdout:1/606: write d2/da/f31 [3771703,87620] 0 2024-09-21T12:20:26.226 INFO:tasks.workunit.client.1.smithi192.stdout:7/576: mkdir d6/d20/dcc 0 2024-09-21T12:20:26.227 INFO:tasks.workunit.client.1.smithi192.stdout:9/607: dwrite d5/dc/d80/d44/f90 [0,4194304] 0 2024-09-21T12:20:26.228 INFO:tasks.workunit.client.1.smithi192.stdout:1/607: truncate d2/d12/d2f/fc2 849843 0 2024-09-21T12:20:26.229 INFO:tasks.workunit.client.1.smithi192.stdout:0/577: mknod d3/d6/d83/d87/ca4 0 2024-09-21T12:20:26.230 INFO:tasks.workunit.client.1.smithi192.stdout:5/817: link d0/dc/d13/c74 d0/df9/c116 0 2024-09-21T12:20:26.231 INFO:tasks.workunit.client.1.smithi192.stdout:8/614: dread fd [0,4194304] 0 2024-09-21T12:20:26.233 INFO:tasks.workunit.client.1.smithi192.stdout:8/615: stat d14/d1a/d1d/d46/d7e 0 2024-09-21T12:20:26.249 INFO:tasks.workunit.client.1.smithi192.stdout:3/510: rename db/d16/d18/f36 to db/d16/d18/d33/fbc 0 2024-09-21T12:20:26.249 INFO:tasks.workunit.client.1.smithi192.stdout:5/818: dread - d0/d65/d6e/d91/fd0 zero size 2024-09-21T12:20:26.249 INFO:tasks.workunit.client.1.smithi192.stdout:6/683: rename da/d1f/d27/d3e to da/d1f/d27/d3e/de7 22 2024-09-21T12:20:26.250 INFO:tasks.workunit.client.1.smithi192.stdout:1/608: dread d2/d12/d2f/d51/f20 [0,4194304] 0 2024-09-21T12:20:26.253 INFO:tasks.workunit.client.1.smithi192.stdout:4/523: rename d2/db/d3e/d57/d32/d4f/l8b to d2/db/d34/laf 0 2024-09-21T12:20:26.253 INFO:tasks.workunit.client.1.smithi192.stdout:6/684: write da/d1f/d48/d7d/fe1 [100936,89392] 0 2024-09-21T12:20:26.256 INFO:tasks.workunit.client.1.smithi192.stdout:5/819: unlink d0/d65/d6e/dc0/l103 0 2024-09-21T12:20:26.256 INFO:tasks.workunit.client.1.smithi192.stdout:9/608: link d5/l2b d5/dc/d80/d44/db3/lc1 0 2024-09-21T12:20:26.257 INFO:tasks.workunit.client.1.smithi192.stdout:0/578: dwrite d3/d6/d1d/d92/d51/f3b [4194304,4194304] 0 2024-09-21T12:20:26.257 INFO:tasks.workunit.client.1.smithi192.stdout:1/609: creat d2/d12/d2f/d41/d5c/fc9 x:0 0 0 2024-09-21T12:20:26.261 INFO:tasks.workunit.client.1.smithi192.stdout:9/609: write d5/dc/d80/d44/d79/d55/d70/da0/da2/fbe [141098,102989] 0 2024-09-21T12:20:26.261 INFO:tasks.workunit.client.1.smithi192.stdout:6/685: dread da/d1f/d56/d73/fb8 [0,4194304] 0 2024-09-21T12:20:26.265 INFO:tasks.workunit.client.1.smithi192.stdout:3/511: getdents db/d16/d18/d40/d60 0 2024-09-21T12:20:26.266 INFO:tasks.workunit.client.1.smithi192.stdout:6/686: dread da/f35 [0,4194304] 0 2024-09-21T12:20:26.267 INFO:tasks.workunit.client.1.smithi192.stdout:3/512: fdatasync db/d16/d18/d33/d3b/d68/f86 0 2024-09-21T12:20:26.267 INFO:tasks.workunit.client.1.smithi192.stdout:2/573: rename d1b/d38/f60 to d1b/fb7 0 2024-09-21T12:20:26.268 INFO:tasks.workunit.client.1.smithi192.stdout:5/820: creat d0/d2/d7b/f117 x:0 0 0 2024-09-21T12:20:26.270 INFO:tasks.workunit.client.1.smithi192.stdout:9/610: mkdir d5/dc/dc2 0 2024-09-21T12:20:26.271 INFO:tasks.workunit.client.1.smithi192.stdout:3/513: creat db/d16/d18/da7/fbd x:0 0 0 2024-09-21T12:20:26.272 INFO:tasks.workunit.client.1.smithi192.stdout:6/687: creat da/d1f/d27/d88/fe8 x:0 0 0 2024-09-21T12:20:26.273 INFO:tasks.workunit.client.1.smithi192.stdout:6/688: chown da/d1f/d48/d7d/da7/dc8 171262 1 2024-09-21T12:20:26.273 INFO:tasks.workunit.client.1.smithi192.stdout:8/616: rename f11 to d14/d18/d94/dc3/fcc 0 2024-09-21T12:20:26.275 INFO:tasks.workunit.client.1.smithi192.stdout:2/574: readlink d1b/d38/d53/l5c 0 2024-09-21T12:20:26.278 INFO:tasks.workunit.client.1.smithi192.stdout:5/821: write d0/dc/d13/d37/da8/daa/d101/fe8 [257660,15449] 0 2024-09-21T12:20:26.282 INFO:tasks.workunit.client.1.smithi192.stdout:5/822: stat d0/dc/d13/lec 0 2024-09-21T12:20:26.282 INFO:tasks.workunit.client.1.smithi192.stdout:2/575: dread d1b/f5b [0,4194304] 0 2024-09-21T12:20:26.282 INFO:tasks.workunit.client.1.smithi192.stdout:8/617: unlink d14/d1a/l4d 0 2024-09-21T12:20:26.283 INFO:tasks.workunit.client.1.smithi192.stdout:4/524: dread d2/db/f26 [0,4194304] 0 2024-09-21T12:20:26.284 INFO:tasks.workunit.client.1.smithi192.stdout:6/689: link da/d1f/d27/fb1 da/d23/fe9 0 2024-09-21T12:20:26.285 INFO:tasks.workunit.client.1.smithi192.stdout:9/611: rename l4 to d5/dc/d80/d44/d79/d3f/d4d/lc3 0 2024-09-21T12:20:26.286 INFO:tasks.workunit.client.1.smithi192.stdout:8/618: symlink d14/d1a/lcd 0 2024-09-21T12:20:26.286 INFO:tasks.workunit.client.1.smithi192.stdout:0/579: dread d3/d6/d1d/d92/d51/f82 [0,4194304] 0 2024-09-21T12:20:26.287 INFO:tasks.workunit.client.1.smithi192.stdout:4/525: chown d2/db/d34/d56/c76 31 1 2024-09-21T12:20:26.287 INFO:tasks.workunit.client.1.smithi192.stdout:1/610: dwrite d2/d12/d2f/d51/d24/f28 [0,4194304] 0 2024-09-21T12:20:26.287 INFO:tasks.workunit.client.1.smithi192.stdout:9/612: dread - d5/dc/d40/fb2 zero size 2024-09-21T12:20:26.288 INFO:tasks.workunit.client.1.smithi192.stdout:2/576: getdents d1b/d38/d53/d8b/da0 0 2024-09-21T12:20:26.289 INFO:tasks.workunit.client.1.smithi192.stdout:6/690: mknod da/d1f/d56/da9/cea 0 2024-09-21T12:20:26.292 INFO:tasks.workunit.client.1.smithi192.stdout:4/526: mknod d2/db/d1a/cb0 0 2024-09-21T12:20:26.293 INFO:tasks.workunit.client.1.smithi192.stdout:4/527: readlink d2/d36/d7f/d68/l73 0 2024-09-21T12:20:26.295 INFO:tasks.workunit.client.1.smithi192.stdout:9/613: creat d5/dc/d80/d44/fc4 x:0 0 0 2024-09-21T12:20:26.295 INFO:tasks.workunit.client.1.smithi192.stdout:0/580: dwrite d3/d6/f3f [0,4194304] 0 2024-09-21T12:20:26.298 INFO:tasks.workunit.client.1.smithi192.stdout:2/577: creat d1b/d1e/d5e/d88/d95/fb8 x:0 0 0 2024-09-21T12:20:26.301 INFO:tasks.workunit.client.1.smithi192.stdout:4/528: dread d2/db/d3e/d41/f5e [0,4194304] 0 2024-09-21T12:20:26.303 INFO:tasks.workunit.client.1.smithi192.stdout:5/823: write d0/d65/d6e/f92 [156426,60078] 0 2024-09-21T12:20:26.423 INFO:tasks.workunit.client.1.smithi192.stdout:2/578: dwrite ff [4194304,4194304] 0 2024-09-21T12:20:26.423 INFO:tasks.workunit.client.1.smithi192.stdout:1/611: getdents d2/da/d6b/dc8 0 2024-09-21T12:20:26.425 INFO:tasks.workunit.client.1.smithi192.stdout:5/824: creat d0/d65/d6e/dbc/dc8/f118 x:0 0 0 2024-09-21T12:20:26.427 INFO:tasks.workunit.client.1.smithi192.stdout:6/691: dwrite da/d1f/d27/d6b/f7f [4194304,4194304] 0 2024-09-21T12:20:26.427 INFO:tasks.workunit.client.1.smithi192.stdout:4/529: mknod d2/db/d3e/d41/da8/d88/cb1 0 2024-09-21T12:20:26.428 INFO:tasks.workunit.client.1.smithi192.stdout:0/581: creat d3/d5/fa5 x:0 0 0 2024-09-21T12:20:26.430 INFO:tasks.workunit.client.1.smithi192.stdout:8/619: dwrite d14/d1a/d1d/d20/d5f/f67 [0,4194304] 0 2024-09-21T12:20:26.431 INFO:tasks.workunit.client.1.smithi192.stdout:2/579: fsync d1b/d65/d77/fa3 0 2024-09-21T12:20:26.432 INFO:tasks.workunit.client.1.smithi192.stdout:1/612: symlink d2/d12/d2f/d51/d24/d65/d8e/lca 0 2024-09-21T12:20:26.437 INFO:tasks.workunit.client.1.smithi192.stdout:9/614: dread d5/d19/f7f [0,4194304] 0 2024-09-21T12:20:26.438 INFO:tasks.workunit.client.1.smithi192.stdout:6/692: mknod da/d1f/d56/d73/ceb 0 2024-09-21T12:20:26.439 INFO:tasks.workunit.client.1.smithi192.stdout:8/620: read f7 [3974782,17726] 0 2024-09-21T12:20:26.440 INFO:tasks.workunit.client.1.smithi192.stdout:1/613: write d2/da/d6b/dc8/f93 [808484,117056] 0 2024-09-21T12:20:26.441 INFO:tasks.workunit.client.1.smithi192.stdout:0/582: rename d3/de/f8d to d3/d6/fa6 0 2024-09-21T12:20:26.445 INFO:tasks.workunit.client.1.smithi192.stdout:5/825: dwrite d0/d65/d6e/da7/fc3 [0,4194304] 0 2024-09-21T12:20:26.447 INFO:tasks.workunit.client.1.smithi192.stdout:1/614: symlink d2/da/d9f/lcb 0 2024-09-21T12:20:26.448 INFO:tasks.workunit.client.1.smithi192.stdout:8/621: creat d14/d1a/d1d/d46/d7e/d8e/fce x:0 0 0 2024-09-21T12:20:26.449 INFO:tasks.workunit.client.1.smithi192.stdout:9/615: dread d5/dc/f76 [0,4194304] 0 2024-09-21T12:20:26.450 INFO:tasks.workunit.client.1.smithi192.stdout:0/583: creat d3/d6/d72/fa7 x:0 0 0 2024-09-21T12:20:26.451 INFO:tasks.workunit.client.1.smithi192.stdout:4/530: write d2/db/d34/f4a [2814317,130657] 0 2024-09-21T12:20:26.452 INFO:tasks.workunit.client.1.smithi192.stdout:6/693: truncate da/d23/d37/f59 416807 0 2024-09-21T12:20:26.453 INFO:tasks.workunit.client.1.smithi192.stdout:0/584: stat d3/d6/l7c 0 2024-09-21T12:20:26.456 INFO:tasks.workunit.client.1.smithi192.stdout:9/616: unlink d5/d8/d2c/f4f 0 2024-09-21T12:20:26.461 INFO:tasks.workunit.client.1.smithi192.stdout:9/617: stat d5/dc/d80/d44/d79/d55/d93/f96 0 2024-09-21T12:20:26.462 INFO:tasks.workunit.client.1.smithi192.stdout:4/531: rename d2/df/f29 to d2/db/d3e/d41/da8/d88/fb2 0 2024-09-21T12:20:26.462 INFO:tasks.workunit.client.1.smithi192.stdout:2/580: truncate d1b/d1e/d62/f6c 3142202 0 2024-09-21T12:20:26.463 INFO:tasks.workunit.client.1.smithi192.stdout:5/826: dwrite d0/d65/d8e/d98/fd4 [0,4194304] 0 2024-09-21T12:20:26.467 INFO:tasks.workunit.client.1.smithi192.stdout:6/694: getdents da/d1f/d48/d7d/d9a/d9e/dbe 0 2024-09-21T12:20:26.467 INFO:tasks.workunit.client.1.smithi192.stdout:8/622: dread d14/d1a/d1d/d20/f44 [0,4194304] 0 2024-09-21T12:20:26.467 INFO:tasks.workunit.client.1.smithi192.stdout:4/532: chown d2/db/d3e/d57/d32/d4f/d71/d9d 411 1 2024-09-21T12:20:26.467 INFO:tasks.workunit.client.1.smithi192.stdout:2/581: dread - d1b/d1e/d5e/d88/d95/fb8 zero size 2024-09-21T12:20:26.468 INFO:tasks.workunit.client.1.smithi192.stdout:5/827: chown d0/cf 4 1 2024-09-21T12:20:26.469 INFO:tasks.workunit.client.1.smithi192.stdout:9/618: mknod d5/dc/d80/d44/cc5 0 2024-09-21T12:20:26.469 INFO:tasks.workunit.client.1.smithi192.stdout:0/585: dwrite d3/d6/f5b [0,4194304] 0 2024-09-21T12:20:26.472 INFO:tasks.workunit.client.1.smithi192.stdout:7/577: sync 2024-09-21T12:20:26.472 INFO:tasks.workunit.client.1.smithi192.stdout:8/623: dread - d14/d1a/d1d/d39/f8f zero size 2024-09-21T12:20:26.475 INFO:tasks.workunit.client.1.smithi192.stdout:5/828: symlink d0/d65/d6e/d91/l119 0 2024-09-21T12:20:26.475 INFO:tasks.workunit.client.1.smithi192.stdout:4/533: truncate d2/db/d3e/d41/da8/f59 621539 0 2024-09-21T12:20:26.475 INFO:tasks.workunit.client.1.smithi192.stdout:8/624: chown d14/f43 14324 1 2024-09-21T12:20:26.476 INFO:tasks.workunit.client.1.smithi192.stdout:6/695: mkdir da/d23/d37/d75/de2/dec 0 2024-09-21T12:20:26.477 INFO:tasks.workunit.client.1.smithi192.stdout:0/586: rename d3/d6/fa6 to d3/de/d9b/fa8 0 2024-09-21T12:20:26.479 INFO:tasks.workunit.client.1.smithi192.stdout:1/615: dread d2/d12/d2f/d51/d24/f26 [0,4194304] 0 2024-09-21T12:20:26.482 INFO:tasks.workunit.client.1.smithi192.stdout:8/625: symlink d14/d1a/d1d/d46/d4e/d83/lcf 0 2024-09-21T12:20:26.484 INFO:tasks.workunit.client.1.smithi192.stdout:5/829: symlink d0/d65/d6e/dc0/d44/d85/l11a 0 2024-09-21T12:20:26.485 INFO:tasks.workunit.client.1.smithi192.stdout:6/696: mknod da/d23/d37/d75/d90/ced 0 2024-09-21T12:20:26.488 INFO:tasks.workunit.client.1.smithi192.stdout:0/587: write d3/d6/d1d/d92/d51/f32 [780506,55735] 0 2024-09-21T12:20:26.490 INFO:tasks.workunit.client.1.smithi192.stdout:1/616: creat d2/da/d6b/dc8/fcc x:0 0 0 2024-09-21T12:20:26.490 INFO:tasks.workunit.client.1.smithi192.stdout:6/697: fsync da/d23/d37/f8e 0 2024-09-21T12:20:26.491 INFO:tasks.workunit.client.1.smithi192.stdout:8/626: rename d14/d1a/d1d/d46/d7e to d14/d1a/d1d/d46/d4e/d83/d8d/d9c/dd0 0 2024-09-21T12:20:26.491 INFO:tasks.workunit.client.1.smithi192.stdout:0/588: fdatasync d3/d6/f68 0 2024-09-21T12:20:26.491 INFO:tasks.workunit.client.1.smithi192.stdout:4/534: dwrite d2/db/d3e/d41/f5e [0,4194304] 0 2024-09-21T12:20:26.492 INFO:tasks.workunit.client.1.smithi192.stdout:5/830: truncate d0/dc/d13/f10a 11642 0 2024-09-21T12:20:26.493 INFO:tasks.workunit.client.1.smithi192.stdout:1/617: rmdir d2/d12/d2f 39 2024-09-21T12:20:26.493 INFO:tasks.workunit.client.1.smithi192.stdout:6/698: rmdir da/d1f/d56 39 2024-09-21T12:20:26.495 INFO:tasks.workunit.client.1.smithi192.stdout:4/535: mknod d2/d36/d7f/d68/cb3 0 2024-09-21T12:20:26.496 INFO:tasks.workunit.client.1.smithi192.stdout:8/627: rename d14/d1a/f31 to d14/d18/d94/da4/fd1 0 2024-09-21T12:20:26.497 INFO:tasks.workunit.client.1.smithi192.stdout:8/628: fsync d14/d1a/d1d/d20/d5f/f68 0 2024-09-21T12:20:26.498 INFO:tasks.workunit.client.1.smithi192.stdout:1/618: creat d2/fcd x:0 0 0 2024-09-21T12:20:26.498 INFO:tasks.workunit.client.1.smithi192.stdout:8/629: chown d14/d1a/d1d/db6/cc4 338158 1 2024-09-21T12:20:26.499 INFO:tasks.workunit.client.1.smithi192.stdout:5/831: symlink d0/d65/d6e/dc0/l11b 0 2024-09-21T12:20:26.500 INFO:tasks.workunit.client.1.smithi192.stdout:1/619: chown d2/d45/lc1 633 1 2024-09-21T12:20:26.501 INFO:tasks.workunit.client.1.smithi192.stdout:4/536: chown d2/db/f6d 0 1 2024-09-21T12:20:26.502 INFO:tasks.workunit.client.1.smithi192.stdout:0/589: getdents d3 0 2024-09-21T12:20:26.502 INFO:tasks.workunit.client.1.smithi192.stdout:1/620: fsync d2/da/fad 0 2024-09-21T12:20:26.505 INFO:tasks.workunit.client.1.smithi192.stdout:5/832: rename d0/d65/d8e/d77/ff3 to d0/d65/d6e/dbc/f11c 0 2024-09-21T12:20:26.505 INFO:tasks.workunit.client.1.smithi192.stdout:9/619: dread d5/dc/d64/dbb/d3d/f54 [0,4194304] 0 2024-09-21T12:20:26.505 INFO:tasks.workunit.client.1.smithi192.stdout:8/630: write d14/d1a/d1d/d46/d4e/d83/d8d/d9c/dd0/d8e/fce [149523,20212] 0 2024-09-21T12:20:26.508 INFO:tasks.workunit.client.1.smithi192.stdout:1/621: mkdir d2/da/d9f/dce 0 2024-09-21T12:20:26.508 INFO:tasks.workunit.client.1.smithi192.stdout:5/833: fsync d0/d65/d6e/da7/fc3 0 2024-09-21T12:20:26.510 INFO:tasks.workunit.client.1.smithi192.stdout:9/620: write d5/d19/f6b [1906097,112207] 0 2024-09-21T12:20:26.511 INFO:tasks.workunit.client.1.smithi192.stdout:0/590: creat d3/de/fa9 x:0 0 0 2024-09-21T12:20:26.514 INFO:tasks.workunit.client.1.smithi192.stdout:6/699: dread f8 [0,4194304] 0 2024-09-21T12:20:26.515 INFO:tasks.workunit.client.1.smithi192.stdout:4/537: dwrite d2/db/d3e/d57/f72 [0,4194304] 0 2024-09-21T12:20:26.515 INFO:tasks.workunit.client.1.smithi192.stdout:9/621: write d5/dc/d64/dbb/f9f [424986,78037] 0 2024-09-21T12:20:26.536 INFO:tasks.workunit.client.1.smithi192.stdout:8/631: dread d14/d1a/d1d/d48/f62 [0,4194304] 0 2024-09-21T12:20:26.537 INFO:tasks.workunit.client.1.smithi192.stdout:8/632: dread - d14/d18/d94/da4/fc1 zero size 2024-09-21T12:20:26.537 INFO:tasks.workunit.client.1.smithi192.stdout:5/834: creat d0/d65/d6e/da7/da0/f11d x:0 0 0 2024-09-21T12:20:26.538 INFO:tasks.workunit.client.1.smithi192.stdout:0/591: stat d3/d6/d1d/ca1 0 2024-09-21T12:20:26.539 INFO:tasks.workunit.client.1.smithi192.stdout:0/592: chown d3/d6/d83/f8b 197015850 1 2024-09-21T12:20:26.541 INFO:tasks.workunit.client.1.smithi192.stdout:6/700: dread da/d23/d37/f5f [0,4194304] 0 2024-09-21T12:20:26.542 INFO:tasks.workunit.client.1.smithi192.stdout:6/701: write da/d23/d37/d75/d90/fc4 [823651,110514] 0 2024-09-21T12:20:26.542 INFO:tasks.workunit.client.1.smithi192.stdout:4/538: unlink d2/d36/d55/d89/f8f 0 2024-09-21T12:20:26.543 INFO:tasks.workunit.client.1.smithi192.stdout:6/702: stat da/d1f/d27/d6b/f6d 0 2024-09-21T12:20:26.545 INFO:tasks.workunit.client.1.smithi192.stdout:4/539: truncate d2/db/d3e/d57/d32/d4f/f6a 4241791 0 2024-09-21T12:20:26.546 INFO:tasks.workunit.client.1.smithi192.stdout:0/593: creat d3/d6/d83/d87/faa x:0 0 0 2024-09-21T12:20:26.549 INFO:tasks.workunit.client.1.smithi192.stdout:1/622: rmdir d2/da/d9f/dce 0 2024-09-21T12:20:26.550 INFO:tasks.workunit.client.1.smithi192.stdout:4/540: rmdir d2/db/d34 39 2024-09-21T12:20:26.553 INFO:tasks.workunit.client.1.smithi192.stdout:0/594: symlink d3/d6/d83/lab 0 2024-09-21T12:20:26.553 INFO:tasks.workunit.client.1.smithi192.stdout:6/703: dread da/d1f/fb7 [0,4194304] 0 2024-09-21T12:20:26.553 INFO:tasks.workunit.client.1.smithi192.stdout:9/622: rename d5/d19/c38 to d5/dc/d80/cc6 0 2024-09-21T12:20:26.557 INFO:tasks.workunit.client.1.smithi192.stdout:0/595: dread d3/d6/d1d/d92/d51/f82 [0,4194304] 0 2024-09-21T12:20:26.558 INFO:tasks.workunit.client.1.smithi192.stdout:5/835: truncate d0/d65/d6e/da7/fc3 529378 0 2024-09-21T12:20:26.559 INFO:tasks.workunit.client.1.smithi192.stdout:6/704: creat da/d1f/d27/fee x:0 0 0 2024-09-21T12:20:26.560 INFO:tasks.workunit.client.1.smithi192.stdout:8/633: getdents d14/d1a/d1d/d46/d4e/d83/d8d 0 2024-09-21T12:20:26.560 INFO:tasks.workunit.client.1.smithi192.stdout:5/836: truncate d0/dc/d104/f46 1229964 0 2024-09-21T12:20:26.561 INFO:tasks.workunit.client.1.smithi192.stdout:6/705: read da/d1f/d48/d7d/da7/dc8/fd5 [193850,75556] 0 2024-09-21T12:20:26.565 INFO:tasks.workunit.client.1.smithi192.stdout:9/623: mkdir d5/d8/dc7 0 2024-09-21T12:20:26.566 INFO:tasks.workunit.client.1.smithi192.stdout:0/596: creat d3/d5/d28/d39/d50/fac x:0 0 0 2024-09-21T12:20:26.566 INFO:tasks.workunit.client.1.smithi192.stdout:8/634: rmdir d14/d18/d7b 39 2024-09-21T12:20:26.568 INFO:tasks.workunit.client.1.smithi192.stdout:9/624: chown d5/dc/d64/c9b 158428655 1 2024-09-21T12:20:26.569 INFO:tasks.workunit.client.1.smithi192.stdout:1/623: dread d2/da/f32 [0,4194304] 0 2024-09-21T12:20:26.571 INFO:tasks.workunit.client.1.smithi192.stdout:8/635: truncate d14/d1a/d1d/d39/f8f 252218 0 2024-09-21T12:20:26.571 INFO:tasks.workunit.client.1.smithi192.stdout:1/624: fsync d2/d45/f9c 0 2024-09-21T12:20:26.573 INFO:tasks.workunit.client.1.smithi192.stdout:6/706: dwrite da/fe3 [0,4194304] 0 2024-09-21T12:20:26.575 INFO:tasks.workunit.client.1.smithi192.stdout:5/837: creat d0/d65/d6e/da7/da0/f11e x:0 0 0 2024-09-21T12:20:26.576 INFO:tasks.workunit.client.1.smithi192.stdout:0/597: creat d3/d6/d1d/d92/d51/fad x:0 0 0 2024-09-21T12:20:26.579 INFO:tasks.workunit.client.1.smithi192.stdout:8/636: creat d14/d1a/d1d/d46/d4e/db5/fd2 x:0 0 0 2024-09-21T12:20:26.583 INFO:tasks.workunit.client.1.smithi192.stdout:4/541: dread d2/db/d3e/d41/da8/f8c [0,4194304] 0 2024-09-21T12:20:26.584 INFO:tasks.workunit.client.1.smithi192.stdout:8/637: unlink d14/d1a/d1d/d46/d4e/d83/d8d/fb9 0 2024-09-21T12:20:26.585 INFO:tasks.workunit.client.1.smithi192.stdout:9/625: link d5/d19/l24 d5/dc/d40/lc8 0 2024-09-21T12:20:26.587 INFO:tasks.workunit.client.1.smithi192.stdout:5/838: truncate d0/d65/d6e/dc0/d44/d85/d97/d35/fb8 1934531 0 2024-09-21T12:20:26.589 INFO:tasks.workunit.client.1.smithi192.stdout:1/625: getdents d2/d12/d2f/d51/d24/d65/d8e/d9d 0 2024-09-21T12:20:26.590 INFO:tasks.workunit.client.1.smithi192.stdout:9/626: write d5/dc/f76 [1998480,114490] 0 2024-09-21T12:20:26.590 INFO:tasks.workunit.client.1.smithi192.stdout:5/839: fdatasync d0/d65/d6e/d91/fd0 0 2024-09-21T12:20:26.592 INFO:tasks.workunit.client.1.smithi192.stdout:0/598: dwrite d3/de/d33/f3c [0,4194304] 0 2024-09-21T12:20:26.592 INFO:tasks.workunit.client.1.smithi192.stdout:6/707: dwrite da/f42 [0,4194304] 0 2024-09-21T12:20:26.594 INFO:tasks.workunit.client.1.smithi192.stdout:3/514: sync 2024-09-21T12:20:26.596 INFO:tasks.workunit.client.1.smithi192.stdout:9/627: symlink d5/dc/d40/lc9 0 2024-09-21T12:20:26.597 INFO:tasks.workunit.client.1.smithi192.stdout:3/515: chown db/d16/d61/d2e/f45 474 1 2024-09-21T12:20:26.598 INFO:tasks.workunit.client.1.smithi192.stdout:6/708: symlink da/d23/d37/lef 0 2024-09-21T12:20:26.599 INFO:tasks.workunit.client.1.smithi192.stdout:8/638: dread ff [0,4194304] 0 2024-09-21T12:20:26.602 INFO:tasks.workunit.client.1.smithi192.stdout:9/628: fdatasync d5/d8/d2c/f58 0 2024-09-21T12:20:26.604 INFO:tasks.workunit.client.1.smithi192.stdout:3/516: unlink db/d16/d18/d33/d88/f8b 0 2024-09-21T12:20:26.606 INFO:tasks.workunit.client.1.smithi192.stdout:3/517: stat db/d16/d61/d2e 0 2024-09-21T12:20:26.608 INFO:tasks.workunit.client.1.smithi192.stdout:9/629: symlink d5/dc/d80/d5a/d83/lca 0 2024-09-21T12:20:26.610 INFO:tasks.workunit.client.1.smithi192.stdout:6/709: dwrite da/d1f/d56/d73/fb8 [0,4194304] 0 2024-09-21T12:20:26.611 INFO:tasks.workunit.client.1.smithi192.stdout:4/542: dread d2/db/d3e/d57/d32/d4f/d71/f8e [0,4194304] 0 2024-09-21T12:20:26.613 INFO:tasks.workunit.client.1.smithi192.stdout:8/639: link d14/d1a/d1d/d46/d4e/d83/d8d/d9c/dd0/l7f d14/d18/daf/ld3 0 2024-09-21T12:20:26.617 INFO:tasks.workunit.client.1.smithi192.stdout:8/640: write d14/d1a/d1d/d20/d5f/fa3 [232493,49642] 0 2024-09-21T12:20:26.618 INFO:tasks.workunit.client.1.smithi192.stdout:6/710: creat da/d23/d37/d75/de2/dec/ff0 x:0 0 0 2024-09-21T12:20:26.620 INFO:tasks.workunit.client.1.smithi192.stdout:9/630: dwrite d5/dc/d40/fb2 [0,4194304] 0 2024-09-21T12:20:26.621 INFO:tasks.workunit.client.1.smithi192.stdout:6/711: readlink da/d1f/d48/l63 0 2024-09-21T12:20:26.621 INFO:tasks.workunit.client.1.smithi192.stdout:8/641: readlink d14/d1a/d1d/d46/d4e/d83/l86 0 2024-09-21T12:20:26.623 INFO:tasks.workunit.client.1.smithi192.stdout:6/712: chown da/d1f/c6e 806 1 2024-09-21T12:20:26.628 INFO:tasks.workunit.client.1.smithi192.stdout:4/543: dwrite d2/db/d34/f4a [0,4194304] 0 2024-09-21T12:20:26.628 INFO:tasks.workunit.client.1.smithi192.stdout:6/713: creat da/d23/d37/d75/ff1 x:0 0 0 2024-09-21T12:20:26.636 INFO:tasks.workunit.client.1.smithi192.stdout:5/840: truncate d0/d65/d6e/dc0/d44/d85/d97/d35/fb8 502275 0 2024-09-21T12:20:26.638 INFO:tasks.workunit.client.1.smithi192.stdout:8/642: dwrite d14/d1a/f2e [0,4194304] 0 2024-09-21T12:20:26.638 INFO:tasks.workunit.client.1.smithi192.stdout:4/544: write d2/db/d34/d56/d83/f95 [257129,128871] 0 2024-09-21T12:20:26.639 INFO:tasks.workunit.client.1.smithi192.stdout:6/714: write da/d23/d37/f59 [728712,97186] 0 2024-09-21T12:20:26.641 INFO:tasks.workunit.client.1.smithi192.stdout:3/518: dread db/d16/d18/d33/f43 [0,4194304] 0 2024-09-21T12:20:26.641 INFO:tasks.workunit.client.1.smithi192.stdout:5/841: write d0/d65/d6e/dc0/d44/ffb [134471,92259] 0 2024-09-21T12:20:26.642 INFO:tasks.workunit.client.1.smithi192.stdout:8/643: write d14/d18/d94/da4/fc1 [409154,111697] 0 2024-09-21T12:20:26.644 INFO:tasks.workunit.client.1.smithi192.stdout:3/519: write db/d16/d18/d40/fac [302618,63532] 0 2024-09-21T12:20:26.645 INFO:tasks.workunit.client.1.smithi192.stdout:3/520: chown db/c39 3790 1 2024-09-21T12:20:26.648 INFO:tasks.workunit.client.1.smithi192.stdout:8/644: mknod d14/d1a/d1d/d46/d4e/d83/d8d/d9c/dbe/cd4 0 2024-09-21T12:20:26.649 INFO:tasks.workunit.client.1.smithi192.stdout:5/842: creat d0/d65/f11f x:0 0 0 2024-09-21T12:20:26.650 INFO:tasks.workunit.client.1.smithi192.stdout:9/631: dread d5/d8/f15 [0,4194304] 0 2024-09-21T12:20:26.651 INFO:tasks.workunit.client.1.smithi192.stdout:8/645: stat d14/d1a/d1d/d20/d5f/d8a/l9b 0 2024-09-21T12:20:26.651 INFO:tasks.workunit.client.1.smithi192.stdout:4/545: write d2/db/d3e/d57/d32/d4f/d71/d9d/dad/f25 [3666940,110463] 0 2024-09-21T12:20:26.653 INFO:tasks.workunit.client.1.smithi192.stdout:3/521: rename db/d16/d18/d33/d3b/f3f to db/fbe 0 2024-09-21T12:20:26.655 INFO:tasks.workunit.client.1.smithi192.stdout:3/522: chown db/d16/d18/da7/fbd 20976211 1 2024-09-21T12:20:26.655 INFO:tasks.workunit.client.1.smithi192.stdout:8/646: mknod d14/d18/cd5 0 2024-09-21T12:20:26.659 INFO:tasks.workunit.client.1.smithi192.stdout:9/632: rename d5/dc/d80/d44/d79/d3f/l26 to d5/dc/d64/dbb/d3d/lcb 0 2024-09-21T12:20:26.661 INFO:tasks.workunit.client.1.smithi192.stdout:5/843: link d0/dc/d13/c24 d0/d2/d7b/da5/c120 0 2024-09-21T12:20:26.662 INFO:tasks.workunit.client.1.smithi192.stdout:5/844: write d0/f7c [836479,112897] 0 2024-09-21T12:20:26.664 INFO:tasks.workunit.client.1.smithi192.stdout:4/546: write d2/db/f26 [1363924,100238] 0 2024-09-21T12:20:26.665 INFO:tasks.workunit.client.1.smithi192.stdout:5/845: write d0/f7c [1538917,49666] 0 2024-09-21T12:20:26.667 INFO:tasks.workunit.client.1.smithi192.stdout:9/633: dread d5/dc/d40/dad/d53/d6e/f85 [0,4194304] 0 2024-09-21T12:20:26.668 INFO:tasks.workunit.client.1.smithi192.stdout:6/715: dread da/d23/f52 [0,4194304] 0 2024-09-21T12:20:26.668 INFO:tasks.workunit.client.1.smithi192.stdout:6/716: dread - da/d1f/d48/d7d/fdd zero size 2024-09-21T12:20:26.674 INFO:tasks.workunit.client.1.smithi192.stdout:6/717: dwrite da/d1f/f54 [0,4194304] 0 2024-09-21T12:20:26.684 INFO:tasks.workunit.client.0.smithi003.stdout:3/11: sync 2024-09-21T12:20:26.729 INFO:tasks.workunit.client.1.smithi192.stdout:3/523: rename f8 to db/d16/d18/fbf 0 2024-09-21T12:20:26.732 INFO:tasks.workunit.client.1.smithi192.stdout:9/634: chown d5/dc/d80/d44/db3/lc1 10435 1 2024-09-21T12:20:26.733 INFO:tasks.workunit.client.0.smithi003.stdout:3/12: mkdir d0 0 2024-09-21T12:20:26.736 INFO:tasks.workunit.client.1.smithi192.stdout:3/524: mkdir db/d16/d18/d40/d60/d7b/dc0 0 2024-09-21T12:20:26.737 INFO:tasks.workunit.client.0.smithi003.stdout:3/13: mknod d0/c1 0 2024-09-21T12:20:26.742 INFO:tasks.workunit.client.0.smithi003.stdout:3/14: creat d0/f2 x:0 0 0 2024-09-21T12:20:26.743 INFO:tasks.workunit.client.0.smithi003.stdout:3/15: chown d0/f2 4519765 1 2024-09-21T12:20:26.743 INFO:tasks.workunit.client.0.smithi003.stdout:3/16: write d0/f2 [266422,110426] 0 2024-09-21T12:20:26.745 INFO:tasks.workunit.client.1.smithi192.stdout:3/525: unlink db/d16/d18/d33/fa4 0 2024-09-21T12:20:26.747 INFO:tasks.workunit.client.1.smithi192.stdout:9/635: dread d5/dc/d40/dad/d53/d6e/faa [0,4194304] 0 2024-09-21T12:20:26.748 INFO:tasks.workunit.client.1.smithi192.stdout:6/718: creat da/d1f/ff2 x:0 0 0 2024-09-21T12:20:26.749 INFO:tasks.workunit.client.1.smithi192.stdout:5/846: truncate d0/d65/d6e/f92 147925 0 2024-09-21T12:20:26.750 INFO:tasks.workunit.client.1.smithi192.stdout:9/636: truncate d5/dc/d64/dbb/f9f 588053 0 2024-09-21T12:20:26.751 INFO:tasks.workunit.client.0.smithi003.stdout:3/17: dwrite d0/f2 [0,4194304] 0 2024-09-21T12:20:26.751 INFO:tasks.workunit.client.0.smithi003.stdout:3/18: chown d0 59 1 2024-09-21T12:20:26.751 INFO:tasks.workunit.client.1.smithi192.stdout:4/547: getdents d2/db/d3e/d57/d32/d4f/d71/d9d/dad 0 2024-09-21T12:20:26.753 INFO:tasks.workunit.client.1.smithi192.stdout:3/526: dwrite db/d16/d18/d21/f5d [0,4194304] 0 2024-09-21T12:20:26.753 INFO:tasks.workunit.client.1.smithi192.stdout:6/719: symlink da/d1f/d27/d6b/lf3 0 2024-09-21T12:20:26.754 INFO:tasks.workunit.client.1.smithi192.stdout:4/548: write d2/db/d3e/d57/d32/d4f/d71/d9d/dad/f25 [5584208,91214] 0 2024-09-21T12:20:26.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:26 smithi192 ceph-mon[35641]: pgmap v263: 65 pgs: 65 active+clean; 932 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 17 MiB/s rd, 110 MiB/s wr, 303 op/s 2024-09-21T12:20:26.757 INFO:tasks.workunit.client.1.smithi192.stdout:3/527: write db/d16/d18/d33/fa1 [1416371,74722] 0 2024-09-21T12:20:26.760 INFO:tasks.workunit.client.0.smithi003.stdout:3/19: dwrite d0/f2 [0,4194304] 0 2024-09-21T12:20:26.762 INFO:tasks.workunit.client.1.smithi192.stdout:6/720: symlink da/d1f/d48/d7d/d9a/lf4 0 2024-09-21T12:20:26.765 INFO:tasks.workunit.client.0.smithi003.stdout:3/20: symlink d0/l3 0 2024-09-21T12:20:26.770 INFO:tasks.workunit.client.1.smithi192.stdout:9/637: rename d5/dc/d40/l46 to d5/dc/d80/d44/d79/lcc 0 2024-09-21T12:20:26.770 INFO:tasks.workunit.client.1.smithi192.stdout:3/528: dwrite db/d16/db4/d8c/fb9 [0,4194304] 0 2024-09-21T12:20:26.771 INFO:tasks.workunit.client.1.smithi192.stdout:6/721: mknod da/d1f/d56/da9/cf5 0 2024-09-21T12:20:26.773 INFO:tasks.workunit.client.1.smithi192.stdout:4/549: mkdir d2/db/d1a/db4 0 2024-09-21T12:20:26.774 INFO:tasks.workunit.client.1.smithi192.stdout:9/638: rmdir d5/d8/d2c 39 2024-09-21T12:20:26.776 INFO:tasks.workunit.client.1.smithi192.stdout:3/529: write db/d16/d18/d33/f43 [4169854,129766] 0 2024-09-21T12:20:26.776 INFO:tasks.workunit.client.1.smithi192.stdout:4/550: rename d2/db/d3e/d57/d32/d4f/d71/d9d/dad to d2/db/d3e/d57/d32/d4f/d71/d9d/dad/d7e/db5 22 2024-09-21T12:20:26.778 INFO:tasks.workunit.client.1.smithi192.stdout:6/722: creat da/d1f/d48/d7d/daa/dd7/ff6 x:0 0 0 2024-09-21T12:20:26.778 INFO:tasks.workunit.client.1.smithi192.stdout:9/639: stat d5/dc/d80/d44/d79/d3f/c71 0 2024-09-21T12:20:26.780 INFO:tasks.workunit.client.1.smithi192.stdout:4/551: write d2/db/d3e/d57/d32/d4f/d71/d9d/dad/d9c/fab [491198,41102] 0 2024-09-21T12:20:26.782 INFO:tasks.workunit.client.1.smithi192.stdout:3/530: mkdir db/d16/dc1 0 2024-09-21T12:20:26.783 INFO:tasks.workunit.client.1.smithi192.stdout:9/640: mkdir d5/d8/dcd 0 2024-09-21T12:20:26.785 INFO:tasks.workunit.client.1.smithi192.stdout:3/531: creat db/d16/db4/d8c/fc2 x:0 0 0 2024-09-21T12:20:26.786 INFO:tasks.workunit.client.1.smithi192.stdout:9/641: creat d5/dc/d80/d44/db3/fce x:0 0 0 2024-09-21T12:20:26.786 INFO:tasks.workunit.client.1.smithi192.stdout:6/723: dread da/f6a [0,4194304] 0 2024-09-21T12:20:26.786 INFO:tasks.workunit.client.1.smithi192.stdout:4/552: symlink d2/db/d34/d56/d6c/lb6 0 2024-09-21T12:20:26.789 INFO:tasks.workunit.client.1.smithi192.stdout:4/553: write d2/df/f17 [224106,20322] 0 2024-09-21T12:20:26.793 INFO:tasks.workunit.client.1.smithi192.stdout:9/642: dwrite d5/fa [0,4194304] 0 2024-09-21T12:20:26.795 INFO:tasks.workunit.client.1.smithi192.stdout:3/532: getdents db/d16 0 2024-09-21T12:20:26.799 INFO:tasks.workunit.client.1.smithi192.stdout:3/533: creat db/d16/d61/d2e/fc3 x:0 0 0 2024-09-21T12:20:26.802 INFO:tasks.workunit.client.1.smithi192.stdout:2/582: sync 2024-09-21T12:20:26.802 INFO:tasks.workunit.client.1.smithi192.stdout:7/578: sync 2024-09-21T12:20:26.803 INFO:tasks.workunit.client.1.smithi192.stdout:9/643: getdents d5/dc/d80/d44/d79/d3f 0 2024-09-21T12:20:26.804 INFO:tasks.workunit.client.1.smithi192.stdout:2/583: chown d1b/d38/c3b 2 1 2024-09-21T12:20:26.805 INFO:tasks.workunit.client.1.smithi192.stdout:4/554: dwrite d2/db/d3e/d41/f69 [0,4194304] 0 2024-09-21T12:20:26.807 INFO:tasks.workunit.client.1.smithi192.stdout:9/644: write d5/d8/f2d [4744101,115103] 0 2024-09-21T12:20:26.810 INFO:tasks.workunit.client.1.smithi192.stdout:6/724: dread da/d1f/f86 [0,4194304] 0 2024-09-21T12:20:26.811 INFO:tasks.workunit.client.1.smithi192.stdout:7/579: truncate d6/d9/f2b 3808934 0 2024-09-21T12:20:26.813 INFO:tasks.workunit.client.1.smithi192.stdout:7/580: stat d6/d20/f48 0 2024-09-21T12:20:26.813 INFO:tasks.workunit.client.1.smithi192.stdout:3/534: dwrite db/d16/d18/f74 [0,4194304] 0 2024-09-21T12:20:26.814 INFO:tasks.workunit.client.1.smithi192.stdout:7/581: fdatasync d6/d20/f48 0 2024-09-21T12:20:26.814 INFO:tasks.workunit.client.1.smithi192.stdout:3/535: stat db/d16/d61/d2e 0 2024-09-21T12:20:26.816 INFO:tasks.workunit.client.1.smithi192.stdout:9/645: rename d5/dc/f5c to d5/dc/d80/d44/d79/d3f/d4d/fcf 0 2024-09-21T12:20:26.816 INFO:tasks.workunit.client.1.smithi192.stdout:2/584: getdents d1b/d1e/d5e/d75 0 2024-09-21T12:20:26.816 INFO:tasks.workunit.client.1.smithi192.stdout:4/555: rename d2/db to d2/db/d3e/d57/d32/d4f/d71/d9d/dad/d7e/db7 22 2024-09-21T12:20:26.817 INFO:tasks.workunit.client.1.smithi192.stdout:4/556: readlink d2/df/l11 0 2024-09-21T12:20:26.819 INFO:tasks.workunit.client.1.smithi192.stdout:7/582: fdatasync d6/f27 0 2024-09-21T12:20:26.820 INFO:tasks.workunit.client.1.smithi192.stdout:9/646: mknod d5/dc/d80/d44/d79/d55/d70/da0/cd0 0 2024-09-21T12:20:26.821 INFO:tasks.workunit.client.1.smithi192.stdout:9/647: stat d5/c6 0 2024-09-21T12:20:26.823 INFO:tasks.workunit.client.1.smithi192.stdout:9/648: fdatasync d5/dc/d80/d5a/f9e 0 2024-09-21T12:20:26.826 INFO:tasks.workunit.client.1.smithi192.stdout:2/585: dwrite d1b/d38/f79 [0,4194304] 0 2024-09-21T12:20:26.826 INFO:tasks.workunit.client.1.smithi192.stdout:3/536: read db/f22 [205709,117608] 0 2024-09-21T12:20:26.829 INFO:tasks.workunit.client.1.smithi192.stdout:7/583: readlink d6/d9/d1f/l9b 0 2024-09-21T12:20:26.829 INFO:tasks.workunit.client.1.smithi192.stdout:6/725: rename da/d1f/d27/ca3 to da/d1f/d48/cf7 0 2024-09-21T12:20:26.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:26 smithi003 ceph-mon[28057]: pgmap v263: 65 pgs: 65 active+clean; 932 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 17 MiB/s rd, 110 MiB/s wr, 303 op/s 2024-09-21T12:20:26.831 INFO:tasks.workunit.client.1.smithi192.stdout:3/537: creat db/d16/d61/d2e/fc4 x:0 0 0 2024-09-21T12:20:26.832 INFO:tasks.workunit.client.1.smithi192.stdout:9/649: mkdir d5/dc/dc2/dd1 0 2024-09-21T12:20:26.832 INFO:tasks.workunit.client.0.smithi003.stdout:7/7: sync 2024-09-21T12:20:26.832 INFO:tasks.workunit.client.0.smithi003.stdout:5/1: sync 2024-09-21T12:20:26.832 INFO:tasks.workunit.client.0.smithi003.stdout:7/8: write - no filename 2024-09-21T12:20:26.833 INFO:tasks.workunit.client.0.smithi003.stdout:7/9: stat - no entries 2024-09-21T12:20:26.833 INFO:tasks.workunit.client.0.smithi003.stdout:7/10: stat - no entries 2024-09-21T12:20:26.833 INFO:tasks.workunit.client.0.smithi003.stdout:7/11: chown . 438598 1 2024-09-21T12:20:26.833 INFO:tasks.workunit.client.0.smithi003.stdout:7/12: readlink - no filename 2024-09-21T12:20:26.833 INFO:tasks.workunit.client.0.smithi003.stdout:7/13: write - no filename 2024-09-21T12:20:26.833 INFO:tasks.workunit.client.0.smithi003.stdout:7/14: readlink - no filename 2024-09-21T12:20:26.833 INFO:tasks.workunit.client.0.smithi003.stdout:7/15: rename - no filename 2024-09-21T12:20:26.833 INFO:tasks.workunit.client.1.smithi192.stdout:2/586: creat d1b/d38/d53/d8b/da0/fb9 x:0 0 0 2024-09-21T12:20:26.834 INFO:tasks.workunit.client.1.smithi192.stdout:4/557: rename d2/db/d3e/d41/da8 to d2/db/d34/d56/d6c/db8 0 2024-09-21T12:20:26.835 INFO:tasks.workunit.client.1.smithi192.stdout:3/538: dread - db/d16/d18/d21/d23/f95 zero size 2024-09-21T12:20:26.835 INFO:tasks.workunit.client.1.smithi192.stdout:2/587: chown d1b/d38/d53/d8b/da0/fb9 579829 1 2024-09-21T12:20:26.836 INFO:tasks.workunit.client.1.smithi192.stdout:9/650: truncate d5/dc/d80/d44/f8c 760205 0 2024-09-21T12:20:26.837 INFO:tasks.workunit.client.1.smithi192.stdout:3/539: write db/d16/db4/d8c/f8d [81313,5923] 0 2024-09-21T12:20:26.838 INFO:tasks.workunit.client.0.smithi003.stdout:5/2: mknod c0 0 2024-09-21T12:20:26.839 INFO:tasks.workunit.client.0.smithi003.stdout:7/16: creat f0 x:0 0 0 2024-09-21T12:20:26.842 INFO:tasks.workunit.client.0.smithi003.stdout:7/17: rename f0 to f1 0 2024-09-21T12:20:26.844 INFO:tasks.workunit.client.1.smithi192.stdout:4/558: unlink d2/db/l7b 0 2024-09-21T12:20:26.846 INFO:tasks.workunit.client.1.smithi192.stdout:7/584: dread d6/f27 [0,4194304] 0 2024-09-21T12:20:26.847 INFO:tasks.workunit.client.1.smithi192.stdout:0/599: sync 2024-09-21T12:20:26.847 INFO:tasks.workunit.client.1.smithi192.stdout:1/626: sync 2024-09-21T12:20:26.848 INFO:tasks.workunit.client.1.smithi192.stdout:7/585: write d6/d9/d1f/d3e/d7a/d8a/da2/fa5 [463924,118048] 0 2024-09-21T12:20:26.848 INFO:tasks.workunit.client.1.smithi192.stdout:1/627: stat d2/d12/d2f/d51/cac 0 2024-09-21T12:20:26.850 INFO:tasks.workunit.client.0.smithi003.stdout:5/3: getdents . 0 2024-09-21T12:20:26.851 INFO:tasks.workunit.client.1.smithi192.stdout:4/559: mknod d2/db/d3e/d57/d32/cb9 0 2024-09-21T12:20:26.852 INFO:tasks.workunit.client.0.smithi003.stdout:5/4: unlink c0 0 2024-09-21T12:20:26.854 INFO:tasks.workunit.client.0.smithi003.stdout:7/18: rename f1 to f2 0 2024-09-21T12:20:26.855 INFO:tasks.workunit.client.1.smithi192.stdout:6/726: dwrite da/d1f/d27/fe5 [0,4194304] 0 2024-09-21T12:20:26.855 INFO:tasks.workunit.client.0.smithi003.stdout:7/19: dread - f2 zero size 2024-09-21T12:20:26.855 INFO:tasks.workunit.client.0.smithi003.stdout:5/5: creat f1 x:0 0 0 2024-09-21T12:20:26.856 INFO:tasks.workunit.client.1.smithi192.stdout:6/727: fdatasync da/d1f/d56/d78/fbd 0 2024-09-21T12:20:26.856 INFO:tasks.workunit.client.1.smithi192.stdout:9/651: dread d5/dc/d80/d5a/f75 [0,4194304] 0 2024-09-21T12:20:26.857 INFO:tasks.workunit.client.1.smithi192.stdout:1/628: mkdir d2/de/dcf 0 2024-09-21T12:20:26.857 INFO:tasks.workunit.client.0.smithi003.stdout:7/20: write f2 [346863,125637] 0 2024-09-21T12:20:26.858 INFO:tasks.workunit.client.1.smithi192.stdout:4/560: creat d2/d36/fba x:0 0 0 2024-09-21T12:20:26.859 INFO:tasks.workunit.client.0.smithi003.stdout:5/6: unlink f1 0 2024-09-21T12:20:26.859 INFO:tasks.workunit.client.0.smithi003.stdout:5/7: dwrite - no filename 2024-09-21T12:20:26.859 INFO:tasks.workunit.client.0.smithi003.stdout:5/8: read - no filename 2024-09-21T12:20:26.859 INFO:tasks.workunit.client.0.smithi003.stdout:5/9: fsync - no filename 2024-09-21T12:20:26.859 INFO:tasks.workunit.client.0.smithi003.stdout:5/10: fsync - no filename 2024-09-21T12:20:26.863 INFO:tasks.workunit.client.1.smithi192.stdout:2/588: getdents d1b/d38 0 2024-09-21T12:20:26.864 INFO:tasks.workunit.client.0.smithi003.stdout:5/11: mknod c2 0 2024-09-21T12:20:26.864 INFO:tasks.workunit.client.0.smithi003.stdout:5/12: write - no filename 2024-09-21T12:20:26.865 INFO:tasks.workunit.client.1.smithi192.stdout:9/652: mkdir d5/d19/d32/dc0/dd2 0 2024-09-21T12:20:26.865 INFO:tasks.workunit.client.1.smithi192.stdout:6/728: mknod da/d1f/d56/d78/cf8 0 2024-09-21T12:20:26.867 INFO:tasks.workunit.client.0.smithi003.stdout:5/13: unlink c2 0 2024-09-21T12:20:26.867 INFO:tasks.workunit.client.0.smithi003.stdout:5/14: unlink - no file 2024-09-21T12:20:26.867 INFO:tasks.workunit.client.0.smithi003.stdout:5/15: stat - no entries 2024-09-21T12:20:26.868 INFO:tasks.workunit.client.1.smithi192.stdout:4/561: creat d2/d36/d7f/fbb x:0 0 0 2024-09-21T12:20:26.869 INFO:tasks.workunit.client.0.smithi003.stdout:7/21: fsync f2 0 2024-09-21T12:20:26.870 INFO:tasks.workunit.client.1.smithi192.stdout:3/540: rename l7 to db/d16/d18/d33/d3b/lc5 0 2024-09-21T12:20:26.871 INFO:tasks.workunit.client.0.smithi003.stdout:5/16: symlink l3 0 2024-09-21T12:20:26.871 INFO:tasks.workunit.client.0.smithi003.stdout:5/17: chown l3 41607653 1 2024-09-21T12:20:26.871 INFO:tasks.workunit.client.0.smithi003.stdout:5/18: write - no filename 2024-09-21T12:20:26.872 INFO:tasks.workunit.client.0.smithi003.stdout:5/19: readlink l3 0 2024-09-21T12:20:26.872 INFO:tasks.workunit.client.0.smithi003.stdout:5/20: rmdir - no directory 2024-09-21T12:20:26.872 INFO:tasks.workunit.client.0.smithi003.stdout:5/21: fsync - no filename 2024-09-21T12:20:26.872 INFO:tasks.workunit.client.1.smithi192.stdout:4/562: read d2/d36/f3c [4576948,84858] 0 2024-09-21T12:20:26.872 INFO:tasks.workunit.client.1.smithi192.stdout:1/629: symlink d2/ld0 0 2024-09-21T12:20:26.873 INFO:tasks.workunit.client.0.smithi003.stdout:7/22: symlink l3 0 2024-09-21T12:20:26.875 INFO:tasks.workunit.client.1.smithi192.stdout:6/729: unlink da/d23/c7a 0 2024-09-21T12:20:26.875 INFO:tasks.workunit.client.1.smithi192.stdout:6/730: write da/d1f/d48/f53 [2884100,62028] 0 2024-09-21T12:20:26.876 INFO:tasks.workunit.client.0.smithi003.stdout:5/22: mknod c4 0 2024-09-21T12:20:26.876 INFO:tasks.workunit.client.0.smithi003.stdout:5/23: chown l3 0 1 2024-09-21T12:20:26.877 INFO:tasks.workunit.client.1.smithi192.stdout:7/586: rename d6/d9/d1f/db9 to d6/d9/d70/d77/dcd 0 2024-09-21T12:20:26.880 INFO:tasks.workunit.client.0.smithi003.stdout:7/23: dwrite f2 [0,4194304] 0 2024-09-21T12:20:26.880 INFO:tasks.workunit.client.0.smithi003.stdout:7/24: readlink l3 0 2024-09-21T12:20:26.882 INFO:tasks.workunit.client.1.smithi192.stdout:6/731: dwrite da/d1f/d48/fdb [0,4194304] 0 2024-09-21T12:20:26.884 INFO:tasks.workunit.client.1.smithi192.stdout:6/732: chown da/d23/d37/f33 1 1 2024-09-21T12:20:26.884 INFO:tasks.workunit.client.1.smithi192.stdout:3/541: getdents db/d16/d18/d40/d60/d7b/dc0 0 2024-09-21T12:20:26.885 INFO:tasks.workunit.client.0.smithi003.stdout:5/24: link c4 c5 0 2024-09-21T12:20:26.885 INFO:tasks.workunit.client.1.smithi192.stdout:6/733: chown da/d1f/d56/fd2 47662 1 2024-09-21T12:20:26.886 INFO:tasks.workunit.client.1.smithi192.stdout:1/630: dwrite d2/d12/d2f/d51/d24/f26 [0,4194304] 0 2024-09-21T12:20:26.887 INFO:tasks.workunit.client.1.smithi192.stdout:6/734: readlink da/d23/d37/l30 0 2024-09-21T12:20:26.887 INFO:tasks.workunit.client.1.smithi192.stdout:2/589: rename d1b/d38/f7e to d1b/d38/d53/d8b/da0/fba 0 2024-09-21T12:20:26.889 INFO:tasks.workunit.client.0.smithi003.stdout:5/25: creat f6 x:0 0 0 2024-09-21T12:20:26.891 INFO:tasks.workunit.client.1.smithi192.stdout:7/587: creat d6/d9/d2d/d7b/fce x:0 0 0 2024-09-21T12:20:26.894 INFO:tasks.workunit.client.1.smithi192.stdout:2/590: dwrite d1b/d1e/d5e/d75/dab/fae [0,4194304] 0 2024-09-21T12:20:26.897 INFO:tasks.workunit.client.1.smithi192.stdout:1/631: rmdir d2/d12/d2f/d81 39 2024-09-21T12:20:26.898 INFO:tasks.workunit.client.0.smithi003.stdout:7/25: fsync f2 0 2024-09-21T12:20:26.900 INFO:tasks.workunit.client.0.smithi003.stdout:1/11: sync 2024-09-21T12:20:26.900 INFO:tasks.workunit.client.0.smithi003.stdout:6/15: sync 2024-09-21T12:20:26.900 INFO:tasks.workunit.client.0.smithi003.stdout:4/5: sync 2024-09-21T12:20:26.901 INFO:tasks.workunit.client.1.smithi192.stdout:3/542: rename db/d16/db4/d8c/fc2 to db/d16/dc1/fc6 0 2024-09-21T12:20:26.908 INFO:tasks.workunit.client.1.smithi192.stdout:7/588: creat d6/d3a/d63/fcf x:0 0 0 2024-09-21T12:20:26.911 INFO:tasks.workunit.client.1.smithi192.stdout:1/632: unlink d2/d45/fa4 0 2024-09-21T12:20:26.914 INFO:tasks.workunit.client.1.smithi192.stdout:6/735: symlink da/d23/d37/dc5/lf9 0 2024-09-21T12:20:26.915 INFO:tasks.workunit.client.1.smithi192.stdout:7/589: mkdir d6/d9/d2d/dd0 0 2024-09-21T12:20:26.916 INFO:tasks.workunit.client.1.smithi192.stdout:1/633: mknod d2/d12/d2f/d51/d24/cd1 0 2024-09-21T12:20:26.917 INFO:tasks.workunit.client.1.smithi192.stdout:3/543: symlink db/d16/d61/d2e/db8/lc7 0 2024-09-21T12:20:26.919 INFO:tasks.workunit.client.1.smithi192.stdout:7/590: creat d6/d20/d69/d90/da7/fd1 x:0 0 0 2024-09-21T12:20:26.920 INFO:tasks.workunit.client.1.smithi192.stdout:7/591: write d6/d20/d69/d90/fb2 [3284435,69963] 0 2024-09-21T12:20:26.920 INFO:tasks.workunit.client.0.smithi003.stdout:1/12: write f2 [125168,95063] 0 2024-09-21T12:20:26.921 INFO:tasks.workunit.client.0.smithi003.stdout:4/6: symlink l2 0 2024-09-21T12:20:26.921 INFO:tasks.workunit.client.0.smithi003.stdout:4/7: truncate - no filename 2024-09-21T12:20:26.921 INFO:tasks.workunit.client.0.smithi003.stdout:4/8: dread - no filename 2024-09-21T12:20:26.921 INFO:tasks.workunit.client.0.smithi003.stdout:4/9: read - no filename 2024-09-21T12:20:26.922 INFO:tasks.workunit.client.0.smithi003.stdout:6/16: creat f1 x:0 0 0 2024-09-21T12:20:26.923 INFO:tasks.workunit.client.1.smithi192.stdout:4/563: truncate d2/f23 454225 0 2024-09-21T12:20:26.924 INFO:tasks.workunit.client.0.smithi003.stdout:5/26: link c5 c7 0 2024-09-21T12:20:26.925 INFO:tasks.workunit.client.0.smithi003.stdout:5/27: dread - f6 zero size 2024-09-21T12:20:26.926 INFO:tasks.workunit.client.1.smithi192.stdout:7/592: dwrite d6/d9/d51/f24 [0,4194304] 0 2024-09-21T12:20:26.928 INFO:tasks.workunit.client.1.smithi192.stdout:3/544: symlink db/d16/d61/lc8 0 2024-09-21T12:20:26.928 INFO:tasks.workunit.client.1.smithi192.stdout:3/545: chown db/d16/c37 3 1 2024-09-21T12:20:26.929 INFO:tasks.workunit.client.0.smithi003.stdout:7/26: rename f2 to f4 0 2024-09-21T12:20:26.931 INFO:tasks.workunit.client.1.smithi192.stdout:1/634: creat d2/da/fd2 x:0 0 0 2024-09-21T12:20:26.932 INFO:tasks.workunit.client.1.smithi192.stdout:7/593: dwrite d6/d20/d69/d90/fb2 [0,4194304] 0 2024-09-21T12:20:26.934 INFO:tasks.workunit.client.0.smithi003.stdout:6/17: symlink l2 0 2024-09-21T12:20:26.934 INFO:tasks.workunit.client.0.smithi003.stdout:5/28: dwrite f6 [0,4194304] 0 2024-09-21T12:20:26.939 INFO:tasks.workunit.client.0.smithi003.stdout:7/27: symlink l5 0 2024-09-21T12:20:26.943 INFO:tasks.workunit.client.0.smithi003.stdout:1/13: symlink d4/l5 0 2024-09-21T12:20:26.944 INFO:tasks.workunit.client.1.smithi192.stdout:2/591: mkdir d1b/d38/d53/d8b/da7/dbb 0 2024-09-21T12:20:26.945 INFO:tasks.workunit.client.0.smithi003.stdout:5/29: dread f6 [0,4194304] 0 2024-09-21T12:20:26.947 INFO:tasks.workunit.client.0.smithi003.stdout:6/18: dwrite f1 [0,4194304] 0 2024-09-21T12:20:26.949 INFO:tasks.workunit.client.1.smithi192.stdout:7/594: read d6/d9/d2d/f5a [1688451,4198] 0 2024-09-21T12:20:26.950 INFO:tasks.workunit.client.1.smithi192.stdout:7/595: fsync d6/f15 0 2024-09-21T12:20:26.952 INFO:tasks.workunit.client.1.smithi192.stdout:4/564: truncate d2/d36/f3c 4062642 0 2024-09-21T12:20:26.952 INFO:tasks.workunit.client.1.smithi192.stdout:4/565: stat d2/db/d1a 0 2024-09-21T12:20:26.954 INFO:tasks.workunit.client.0.smithi003.stdout:1/14: fdatasync f1 0 2024-09-21T12:20:26.954 INFO:tasks.workunit.client.0.smithi003.stdout:1/15: chown l3 91 1 2024-09-21T12:20:26.955 INFO:tasks.workunit.client.1.smithi192.stdout:2/592: symlink d1b/d1e/d5e/d75/lbc 0 2024-09-21T12:20:26.956 INFO:tasks.workunit.client.1.smithi192.stdout:2/593: dread - d1b/d9e/fac zero size 2024-09-21T12:20:26.958 INFO:tasks.workunit.client.0.smithi003.stdout:5/30: mknod c8 0 2024-09-21T12:20:26.961 INFO:tasks.workunit.client.0.smithi003.stdout:0/40: sync 2024-09-21T12:20:26.961 INFO:tasks.workunit.client.0.smithi003.stdout:3/21: sync 2024-09-21T12:20:26.961 INFO:tasks.workunit.client.0.smithi003.stdout:2/44: sync 2024-09-21T12:20:26.961 INFO:tasks.workunit.client.0.smithi003.stdout:8/8: sync 2024-09-21T12:20:26.961 INFO:tasks.workunit.client.0.smithi003.stdout:9/119: sync 2024-09-21T12:20:26.964 INFO:tasks.workunit.client.0.smithi003.stdout:6/19: creat f3 x:0 0 0 2024-09-21T12:20:26.965 INFO:tasks.workunit.client.0.smithi003.stdout:6/20: chown f1 5 1 2024-09-21T12:20:26.966 INFO:tasks.workunit.client.1.smithi192.stdout:1/635: fsync d2/da/fd2 0 2024-09-21T12:20:26.966 INFO:tasks.workunit.client.1.smithi192.stdout:4/566: dread d2/db/d34/d56/f9a [0,4194304] 0 2024-09-21T12:20:26.967 INFO:tasks.workunit.client.0.smithi003.stdout:1/16: creat d4/f6 x:0 0 0 2024-09-21T12:20:26.969 INFO:tasks.workunit.client.0.smithi003.stdout:7/28: link l3 l6 0 2024-09-21T12:20:26.973 INFO:tasks.workunit.client.0.smithi003.stdout:7/29: dread f4 [0,4194304] 0 2024-09-21T12:20:26.973 INFO:tasks.workunit.client.1.smithi192.stdout:1/636: dread d2/d12/d2f/f4a [0,4194304] 0 2024-09-21T12:20:26.974 INFO:tasks.workunit.client.0.smithi003.stdout:8/9: creat f1 x:0 0 0 2024-09-21T12:20:26.976 INFO:tasks.workunit.client.0.smithi003.stdout:3/22: creat d0/f4 x:0 0 0 2024-09-21T12:20:26.978 INFO:tasks.workunit.client.0.smithi003.stdout:6/21: mkdir d4 0 2024-09-21T12:20:26.979 INFO:tasks.workunit.client.0.smithi003.stdout:6/22: write f3 [191716,61632] 0 2024-09-21T12:20:26.980 INFO:tasks.workunit.client.0.smithi003.stdout:6/23: truncate f3 844542 0 2024-09-21T12:20:26.980 INFO:tasks.workunit.client.0.smithi003.stdout:1/17: creat d4/f7 x:0 0 0 2024-09-21T12:20:26.981 INFO:tasks.workunit.client.0.smithi003.stdout:6/24: truncate f3 1357527 0 2024-09-21T12:20:26.982 INFO:tasks.workunit.client.0.smithi003.stdout:5/31: unlink c4 0 2024-09-21T12:20:26.985 INFO:tasks.workunit.client.0.smithi003.stdout:9/120: mkdir d2/d29 0 2024-09-21T12:20:26.989 INFO:tasks.workunit.client.0.smithi003.stdout:7/30: chown l3 401967 1 2024-09-21T12:20:26.990 INFO:tasks.workunit.client.0.smithi003.stdout:8/10: truncate f0 886686 0 2024-09-21T12:20:26.991 INFO:tasks.workunit.client.0.smithi003.stdout:0/41: dwrite f4 [0,4194304] 0 2024-09-21T12:20:26.992 INFO:tasks.workunit.client.0.smithi003.stdout:1/18: creat d4/f8 x:0 0 0 2024-09-21T12:20:26.993 INFO:tasks.workunit.client.0.smithi003.stdout:1/19: write d4/f8 [786265,25030] 0 2024-09-21T12:20:26.994 INFO:tasks.workunit.client.0.smithi003.stdout:1/20: dread - d4/f6 zero size 2024-09-21T12:20:26.995 INFO:tasks.workunit.client.0.smithi003.stdout:1/21: fdatasync f2 0 2024-09-21T12:20:26.999 INFO:tasks.workunit.client.0.smithi003.stdout:7/31: symlink l7 0 2024-09-21T12:20:27.002 INFO:tasks.workunit.client.0.smithi003.stdout:6/25: link f3 d4/f5 0 2024-09-21T12:20:27.003 INFO:tasks.workunit.client.0.smithi003.stdout:9/121: mkdir d2/da/d2a 0 2024-09-21T12:20:27.005 INFO:tasks.workunit.client.0.smithi003.stdout:5/32: dwrite f6 [0,4194304] 0 2024-09-21T12:20:27.007 INFO:tasks.workunit.client.0.smithi003.stdout:7/32: dread f4 [0,4194304] 0 2024-09-21T12:20:27.008 INFO:tasks.workunit.client.0.smithi003.stdout:9/122: write d2/f10 [101817,37931] 0 2024-09-21T12:20:27.009 INFO:tasks.workunit.client.0.smithi003.stdout:3/23: getdents d0 0 2024-09-21T12:20:27.013 INFO:tasks.workunit.client.0.smithi003.stdout:3/24: write d0/f4 [804876,93449] 0 2024-09-21T12:20:27.018 INFO:tasks.workunit.client.0.smithi003.stdout:3/25: mkdir d0/d5 0 2024-09-21T12:20:27.020 INFO:tasks.workunit.client.0.smithi003.stdout:9/123: getdents d2/da/d2a 0 2024-09-21T12:20:27.021 INFO:tasks.workunit.client.0.smithi003.stdout:6/26: dwrite d4/f5 [0,4194304] 0 2024-09-21T12:20:27.021 INFO:tasks.workunit.client.0.smithi003.stdout:7/33: dread f4 [0,4194304] 0 2024-09-21T12:20:27.021 INFO:tasks.workunit.client.0.smithi003.stdout:5/33: dread f6 [0,4194304] 0 2024-09-21T12:20:27.035 INFO:tasks.workunit.client.1.smithi192.stdout:5/847: sync 2024-09-21T12:20:27.036 INFO:tasks.workunit.client.1.smithi192.stdout:8/647: sync 2024-09-21T12:20:27.045 INFO:tasks.workunit.client.1.smithi192.stdout:4/567: link d2/d21/f38 d2/d36/d55/d89/fbc 0 2024-09-21T12:20:27.045 INFO:tasks.workunit.client.1.smithi192.stdout:2/594: truncate d1b/d38/f49 3259791 0 2024-09-21T12:20:27.046 INFO:tasks.workunit.client.1.smithi192.stdout:7/596: dwrite d6/d9/f14 [0,4194304] 0 2024-09-21T12:20:27.060 INFO:tasks.workunit.client.0.smithi003.stdout:3/26: truncate d0/f2 4600134 0 2024-09-21T12:20:27.061 INFO:tasks.workunit.client.0.smithi003.stdout:7/34: mkdir d8 0 2024-09-21T12:20:27.064 INFO:tasks.workunit.client.0.smithi003.stdout:8/11: write f0 [983356,20340] 0 2024-09-21T12:20:27.066 INFO:tasks.workunit.client.0.smithi003.stdout:3/27: rename d0/f4 to d0/f6 0 2024-09-21T12:20:27.067 INFO:tasks.workunit.client.0.smithi003.stdout:9/124: creat d2/f2b x:0 0 0 2024-09-21T12:20:27.070 INFO:tasks.workunit.client.0.smithi003.stdout:0/42: dwrite d9/fd [0,4194304] 0 2024-09-21T12:20:27.071 INFO:tasks.workunit.client.0.smithi003.stdout:8/12: mknod c2 0 2024-09-21T12:20:27.072 INFO:tasks.workunit.client.0.smithi003.stdout:7/35: write f4 [1563192,73340] 0 2024-09-21T12:20:27.074 INFO:tasks.workunit.client.0.smithi003.stdout:3/28: rmdir d0 39 2024-09-21T12:20:27.075 INFO:tasks.workunit.client.0.smithi003.stdout:7/36: fdatasync f4 0 2024-09-21T12:20:27.076 INFO:tasks.workunit.client.0.smithi003.stdout:5/34: rename l3 to l9 0 2024-09-21T12:20:27.077 INFO:tasks.workunit.client.0.smithi003.stdout:6/27: truncate d4/f5 1698168 0 2024-09-21T12:20:27.079 INFO:tasks.workunit.client.0.smithi003.stdout:8/13: creat f3 x:0 0 0 2024-09-21T12:20:27.081 INFO:tasks.workunit.client.0.smithi003.stdout:3/29: fdatasync d0/f2 0 2024-09-21T12:20:27.081 INFO:tasks.workunit.client.0.smithi003.stdout:9/125: unlink d2/c25 0 2024-09-21T12:20:27.084 INFO:tasks.workunit.client.0.smithi003.stdout:7/37: rename f4 to d8/f9 0 2024-09-21T12:20:27.088 INFO:tasks.workunit.client.0.smithi003.stdout:6/28: mkdir d4/d6 0 2024-09-21T12:20:27.089 INFO:tasks.workunit.client.0.smithi003.stdout:7/38: read d8/f9 [341732,5580] 0 2024-09-21T12:20:27.089 INFO:tasks.workunit.client.0.smithi003.stdout:0/43: dwrite f8 [0,4194304] 0 2024-09-21T12:20:27.093 INFO:tasks.workunit.client.0.smithi003.stdout:6/29: chown l0 428938 1 2024-09-21T12:20:27.097 INFO:tasks.workunit.client.0.smithi003.stdout:0/44: chown f4 113133120 1 2024-09-21T12:20:27.098 INFO:tasks.workunit.client.0.smithi003.stdout:8/14: dwrite f3 [0,4194304] 0 2024-09-21T12:20:27.101 INFO:tasks.workunit.client.0.smithi003.stdout:9/126: dread d2/da/d17/f1b [0,4194304] 0 2024-09-21T12:20:27.107 INFO:tasks.workunit.client.0.smithi003.stdout:8/15: creat f4 x:0 0 0 2024-09-21T12:20:27.107 INFO:tasks.workunit.client.0.smithi003.stdout:5/35: dwrite f6 [0,4194304] 0 2024-09-21T12:20:27.108 INFO:tasks.workunit.client.0.smithi003.stdout:3/30: dwrite d0/f2 [0,4194304] 0 2024-09-21T12:20:27.108 INFO:tasks.workunit.client.0.smithi003.stdout:8/16: chown f4 15411478 1 2024-09-21T12:20:27.108 INFO:tasks.workunit.client.0.smithi003.stdout:7/39: dread d8/f9 [0,4194304] 0 2024-09-21T12:20:27.108 INFO:tasks.workunit.client.0.smithi003.stdout:5/36: chown c5 1 1 2024-09-21T12:20:27.115 INFO:tasks.workunit.client.0.smithi003.stdout:0/45: getdents d9 0 2024-09-21T12:20:27.116 INFO:tasks.workunit.client.0.smithi003.stdout:3/31: write d0/f6 [786457,114275] 0 2024-09-21T12:20:27.125 INFO:tasks.workunit.client.0.smithi003.stdout:9/127: dwrite d2/da/d17/f27 [0,4194304] 0 2024-09-21T12:20:27.131 INFO:tasks.workunit.client.0.smithi003.stdout:8/17: dwrite f1 [0,4194304] 0 2024-09-21T12:20:27.131 INFO:tasks.workunit.client.0.smithi003.stdout:5/37: dread f6 [0,4194304] 0 2024-09-21T12:20:27.133 INFO:tasks.workunit.client.1.smithi192.stdout:7/597: mknod d6/d20/d69/cd2 0 2024-09-21T12:20:27.134 INFO:tasks.workunit.client.0.smithi003.stdout:8/18: symlink l5 0 2024-09-21T12:20:27.134 INFO:tasks.workunit.client.0.smithi003.stdout:8/19: rmdir - no directory 2024-09-21T12:20:27.137 INFO:tasks.workunit.client.1.smithi192.stdout:7/598: write d6/f38 [961876,32523] 0 2024-09-21T12:20:27.138 INFO:tasks.workunit.client.0.smithi003.stdout:7/40: dwrite d8/f9 [0,4194304] 0 2024-09-21T12:20:27.140 INFO:tasks.workunit.client.1.smithi192.stdout:2/595: link d1b/f5b d1b/d1e/fbd 0 2024-09-21T12:20:27.141 INFO:tasks.workunit.client.0.smithi003.stdout:8/20: chown f3 206723208 1 2024-09-21T12:20:27.142 INFO:tasks.workunit.client.1.smithi192.stdout:5/848: dwrite d0/dc/d13/d37/db4/ffd [0,4194304] 0 2024-09-21T12:20:27.142 INFO:tasks.workunit.client.0.smithi003.stdout:3/32: dread d0/f2 [0,4194304] 0 2024-09-21T12:20:27.144 INFO:tasks.workunit.client.1.smithi192.stdout:4/568: dwrite d2/db/d3e/d57/d32/d4f/d71/d9d/dad/f25 [0,4194304] 0 2024-09-21T12:20:27.145 INFO:tasks.workunit.client.0.smithi003.stdout:0/46: write f0 [4774172,86468] 0 2024-09-21T12:20:27.146 INFO:tasks.workunit.client.0.smithi003.stdout:8/21: mknod c6 0 2024-09-21T12:20:27.147 INFO:tasks.workunit.client.1.smithi192.stdout:8/648: dwrite d14/d1a/d1d/d46/d4e/d83/d8d/d9c/dbe/fc8 [4194304,4194304] 0 2024-09-21T12:20:27.149 INFO:tasks.workunit.client.1.smithi192.stdout:5/849: creat d0/dc/d13/d37/da8/daa/de4/f121 x:0 0 0 2024-09-21T12:20:27.151 INFO:tasks.workunit.client.0.smithi003.stdout:8/22: mkdir d7 0 2024-09-21T12:20:27.154 INFO:tasks.workunit.client.1.smithi192.stdout:8/649: mkdir d14/d1a/d1d/d46/d4e/d83/d8d/d9c/dd6 0 2024-09-21T12:20:27.154 INFO:tasks.workunit.client.0.smithi003.stdout:3/33: rename d0/l3 to d0/l7 0 2024-09-21T12:20:27.155 INFO:tasks.workunit.client.1.smithi192.stdout:2/596: dwrite d1b/d38/d53/f61 [0,4194304] 0 2024-09-21T12:20:27.155 INFO:tasks.workunit.client.1.smithi192.stdout:4/569: truncate d2/d21/f7a 489892 0 2024-09-21T12:20:27.155 INFO:tasks.workunit.client.1.smithi192.stdout:5/850: chown d0/d65/d6e/lc9 941649110 1 2024-09-21T12:20:27.157 INFO:tasks.workunit.client.1.smithi192.stdout:5/851: chown d0/d65/d6e/dc0/d44/d85/d97/fd2 187917170 1 2024-09-21T12:20:27.158 INFO:tasks.workunit.client.0.smithi003.stdout:7/41: dwrite d8/f9 [4194304,4194304] 0 2024-09-21T12:20:27.159 INFO:tasks.workunit.client.1.smithi192.stdout:8/650: symlink d14/d18/d7b/ld7 0 2024-09-21T12:20:27.164 INFO:tasks.workunit.client.1.smithi192.stdout:2/597: dwrite d1b/f27 [0,4194304] 0 2024-09-21T12:20:27.165 INFO:tasks.workunit.client.1.smithi192.stdout:8/651: mkdir d14/d1a/d1d/d46/d4e/d83/d8d/dd8 0 2024-09-21T12:20:27.166 INFO:tasks.workunit.client.1.smithi192.stdout:8/652: readlink d14/d18/d88/laa 0 2024-09-21T12:20:27.167 INFO:tasks.workunit.client.0.smithi003.stdout:8/23: creat d7/f8 x:0 0 0 2024-09-21T12:20:27.167 INFO:tasks.workunit.client.1.smithi192.stdout:8/653: stat d14/d1a/d1d/d20/l53 0 2024-09-21T12:20:27.172 INFO:tasks.workunit.client.0.smithi003.stdout:6/30: dwrite d4/f5 [0,4194304] 0 2024-09-21T12:20:27.172 INFO:tasks.workunit.client.0.smithi003.stdout:3/34: creat d0/f8 x:0 0 0 2024-09-21T12:20:27.172 INFO:tasks.workunit.client.0.smithi003.stdout:0/47: dwrite f0 [8388608,4194304] 0 2024-09-21T12:20:27.172 INFO:tasks.workunit.client.1.smithi192.stdout:2/598: mkdir d1b/d1e/d5e/d88/d95/dbe 0 2024-09-21T12:20:27.174 INFO:tasks.workunit.client.1.smithi192.stdout:2/599: read - d1b/d65/f6e zero size 2024-09-21T12:20:27.174 INFO:tasks.workunit.client.1.smithi192.stdout:8/654: dwrite d14/d1a/d1d/d39/f72 [0,4194304] 0 2024-09-21T12:20:27.177 INFO:tasks.workunit.client.0.smithi003.stdout:1/22: sync 2024-09-21T12:20:27.177 INFO:tasks.workunit.client.0.smithi003.stdout:2/45: sync 2024-09-21T12:20:27.178 INFO:tasks.workunit.client.0.smithi003.stdout:4/10: sync 2024-09-21T12:20:27.178 INFO:tasks.workunit.client.0.smithi003.stdout:4/11: write - no filename 2024-09-21T12:20:27.178 INFO:tasks.workunit.client.0.smithi003.stdout:6/31: chown d4/f5 1 1 2024-09-21T12:20:27.179 INFO:tasks.workunit.client.1.smithi192.stdout:4/570: getdents d2/db/d3e/d57 0 2024-09-21T12:20:27.181 INFO:tasks.workunit.client.1.smithi192.stdout:5/852: getdents d0/dc/d13/d37/da8/daa/dc5/ddd/d107 0 2024-09-21T12:20:27.181 INFO:tasks.workunit.client.0.smithi003.stdout:0/48: write f8 [4121319,21557] 0 2024-09-21T12:20:27.185 INFO:tasks.workunit.client.0.smithi003.stdout:5/38: dwrite f6 [0,4194304] 0 2024-09-21T12:20:27.188 INFO:tasks.workunit.client.0.smithi003.stdout:6/32: write d4/f5 [2293426,102137] 0 2024-09-21T12:20:27.189 INFO:tasks.workunit.client.1.smithi192.stdout:8/655: rename d14/d1a/d1d/d46/d4e/fa8 to d14/d18/d94/dc3/fd9 0 2024-09-21T12:20:27.192 INFO:tasks.workunit.client.1.smithi192.stdout:8/656: read d14/d1a/d1d/d48/f6f [1792220,38421] 0 2024-09-21T12:20:27.192 INFO:tasks.workunit.client.1.smithi192.stdout:8/657: chown d14/d1a/d1d/d46 229515853 1 2024-09-21T12:20:27.193 INFO:tasks.workunit.client.0.smithi003.stdout:2/46: chown d0/f6 164196 1 2024-09-21T12:20:27.194 INFO:tasks.workunit.client.1.smithi192.stdout:4/571: creat d2/db/d3e/d57/d32/d4f/fbd x:0 0 0 2024-09-21T12:20:27.195 INFO:tasks.workunit.client.0.smithi003.stdout:8/24: dread f0 [0,4194304] 0 2024-09-21T12:20:27.195 INFO:tasks.workunit.client.1.smithi192.stdout:4/572: fdatasync d2/db/f26 0 2024-09-21T12:20:27.196 INFO:tasks.workunit.client.0.smithi003.stdout:1/23: rename f1 to d4/f9 0 2024-09-21T12:20:27.196 INFO:tasks.workunit.client.0.smithi003.stdout:6/33: chown l0 29897 1 2024-09-21T12:20:27.198 INFO:tasks.workunit.client.1.smithi192.stdout:5/853: creat d0/dc/d13/d37/da8/daa/f122 x:0 0 0 2024-09-21T12:20:27.199 INFO:tasks.workunit.client.0.smithi003.stdout:4/12: mknod c3 0 2024-09-21T12:20:27.203 INFO:tasks.workunit.client.0.smithi003.stdout:8/25: dread - d7/f8 zero size 2024-09-21T12:20:27.203 INFO:tasks.workunit.client.0.smithi003.stdout:9/128: dwrite d2/fd [0,4194304] 0 2024-09-21T12:20:27.204 INFO:tasks.workunit.client.0.smithi003.stdout:0/49: mknod d9/ce 0 2024-09-21T12:20:27.208 INFO:tasks.workunit.client.0.smithi003.stdout:2/47: creat d0/dd/f12 x:0 0 0 2024-09-21T12:20:27.210 INFO:tasks.workunit.client.0.smithi003.stdout:3/35: dwrite d0/f8 [0,4194304] 0 2024-09-21T12:20:27.211 INFO:tasks.workunit.client.1.smithi192.stdout:5/854: mkdir d0/d65/d8e/d98/d123 0 2024-09-21T12:20:27.212 INFO:tasks.workunit.client.0.smithi003.stdout:1/24: creat d4/fa x:0 0 0 2024-09-21T12:20:27.214 INFO:tasks.workunit.client.0.smithi003.stdout:7/42: dwrite d8/f9 [4194304,4194304] 0 2024-09-21T12:20:27.214 INFO:tasks.workunit.client.0.smithi003.stdout:6/34: creat d4/f7 x:0 0 0 2024-09-21T12:20:27.217 INFO:tasks.workunit.client.0.smithi003.stdout:1/25: write d4/f6 [486428,128366] 0 2024-09-21T12:20:27.218 INFO:tasks.workunit.client.1.smithi192.stdout:5/855: dwrite d0/d65/d6e/fb3 [4194304,4194304] 0 2024-09-21T12:20:27.220 INFO:tasks.workunit.client.0.smithi003.stdout:6/35: write f3 [2452968,111946] 0 2024-09-21T12:20:27.220 INFO:tasks.workunit.client.1.smithi192.stdout:8/658: link d14/d1a/c41 d14/d1a/d1d/d48/cda 0 2024-09-21T12:20:27.222 INFO:tasks.workunit.client.1.smithi192.stdout:5/856: symlink d0/d2/d7b/da5/l124 0 2024-09-21T12:20:27.223 INFO:tasks.workunit.client.0.smithi003.stdout:0/50: dread f8 [0,4194304] 0 2024-09-21T12:20:27.223 INFO:tasks.workunit.client.0.smithi003.stdout:9/129: truncate d2/f18 4528478 0 2024-09-21T12:20:27.224 INFO:tasks.workunit.client.1.smithi192.stdout:4/573: getdents d2/db/d3e/d57/d32/d4f/d71/d9d/dad/d9c 0 2024-09-21T12:20:27.226 INFO:tasks.workunit.client.0.smithi003.stdout:3/36: fdatasync d0/f2 0 2024-09-21T12:20:27.227 INFO:tasks.workunit.client.0.smithi003.stdout:9/130: write d2/fd [4695370,31174] 0 2024-09-21T12:20:27.229 INFO:tasks.workunit.client.1.smithi192.stdout:8/659: rmdir d14/d18/daf 39 2024-09-21T12:20:27.229 INFO:tasks.workunit.client.1.smithi192.stdout:5/857: mknod d0/dc/d13/d37/da8/c125 0 2024-09-21T12:20:27.230 INFO:tasks.workunit.client.1.smithi192.stdout:5/858: chown d0/d65/d8e/db9/f10d 46916 1 2024-09-21T12:20:27.231 INFO:tasks.workunit.client.0.smithi003.stdout:0/51: dread f4 [0,4194304] 0 2024-09-21T12:20:27.235 INFO:tasks.workunit.client.0.smithi003.stdout:7/43: creat d8/fa x:0 0 0 2024-09-21T12:20:27.239 INFO:tasks.workunit.client.0.smithi003.stdout:1/26: unlink d4/f6 0 2024-09-21T12:20:27.240 INFO:tasks.workunit.client.1.smithi192.stdout:8/660: unlink d14/d1a/d1d/d51/d80/d9a/cb2 0 2024-09-21T12:20:27.246 INFO:tasks.workunit.client.1.smithi192.stdout:8/661: creat d14/d1a/d1d/d46/fdb x:0 0 0 2024-09-21T12:20:27.249 INFO:tasks.workunit.client.1.smithi192.stdout:8/662: dread d14/d18/d94/da4/fc1 [0,4194304] 0 2024-09-21T12:20:27.251 INFO:tasks.workunit.client.0.smithi003.stdout:4/13: link c1 c4 0 2024-09-21T12:20:27.296 INFO:tasks.workunit.client.1.smithi192.stdout:8/663: dwrite d14/d18/d5a/fc0 [0,4194304] 0 2024-09-21T12:20:27.296 INFO:tasks.workunit.client.1.smithi192.stdout:8/664: mknod d14/d1a/d1d/d46/cdc 0 2024-09-21T12:20:27.297 INFO:tasks.workunit.client.1.smithi192.stdout:2/600: write d1b/fb7 [2660980,49614] 0 2024-09-21T12:20:27.297 INFO:tasks.workunit.client.1.smithi192.stdout:2/601: truncate d1b/d65/f6e 462002 0 2024-09-21T12:20:27.297 INFO:tasks.workunit.client.1.smithi192.stdout:8/665: dread d14/d1a/d1d/db6/fb8 [0,4194304] 0 2024-09-21T12:20:27.297 INFO:tasks.workunit.client.1.smithi192.stdout:2/602: truncate d1b/d1e/d5e/d75/f82 811882 0 2024-09-21T12:20:27.297 INFO:tasks.workunit.client.1.smithi192.stdout:8/666: dread - d14/d1a/d1d/d46/d4e/db5/fd2 zero size 2024-09-21T12:20:27.297 INFO:tasks.workunit.client.1.smithi192.stdout:2/603: mkdir d1b/d65/d77/dbf 0 2024-09-21T12:20:27.297 INFO:tasks.workunit.client.1.smithi192.stdout:8/667: truncate d14/d18/f32 1442911 0 2024-09-21T12:20:27.297 INFO:tasks.workunit.client.1.smithi192.stdout:2/604: dread - d1b/d1e/d5e/d75/f8f zero size 2024-09-21T12:20:27.297 INFO:tasks.workunit.client.1.smithi192.stdout:9/653: sync 2024-09-21T12:20:27.297 INFO:tasks.workunit.client.1.smithi192.stdout:0/600: sync 2024-09-21T12:20:27.297 INFO:tasks.workunit.client.1.smithi192.stdout:9/654: chown d5/d8 140506 1 2024-09-21T12:20:27.297 INFO:tasks.workunit.client.1.smithi192.stdout:8/668: mkdir d14/d18/daf/ddd 0 2024-09-21T12:20:27.297 INFO:tasks.workunit.client.1.smithi192.stdout:0/601: stat d3/d6/fd 0 2024-09-21T12:20:27.297 INFO:tasks.workunit.client.1.smithi192.stdout:0/602: truncate d3/d5/f77 847062 0 2024-09-21T12:20:27.298 INFO:tasks.workunit.client.1.smithi192.stdout:2/605: readlink d1b/d1e/d5e/d88/lb4 0 2024-09-21T12:20:27.298 INFO:tasks.workunit.client.1.smithi192.stdout:0/603: fsync d3/d6/d1d/d92/d51/f82 0 2024-09-21T12:20:27.298 INFO:tasks.workunit.client.1.smithi192.stdout:4/574: write d2/d36/f3c [5067398,62482] 0 2024-09-21T12:20:27.298 INFO:tasks.workunit.client.1.smithi192.stdout:9/655: creat d5/dc/d80/d44/d79/d3f/d4d/d6d/fd3 x:0 0 0 2024-09-21T12:20:27.298 INFO:tasks.workunit.client.1.smithi192.stdout:0/604: mkdir d3/de/d33/dae 0 2024-09-21T12:20:27.298 INFO:tasks.workunit.client.1.smithi192.stdout:5/859: dwrite d0/dc/f61 [0,4194304] 0 2024-09-21T12:20:27.298 INFO:tasks.workunit.client.0.smithi003.stdout:0/52: symlink d9/lf 0 2024-09-21T12:20:27.298 INFO:tasks.workunit.client.0.smithi003.stdout:5/39: link c8 ca 0 2024-09-21T12:20:27.298 INFO:tasks.workunit.client.0.smithi003.stdout:7/44: mkdir d8/db 0 2024-09-21T12:20:27.298 INFO:tasks.workunit.client.0.smithi003.stdout:0/53: dwrite f0 [8388608,4194304] 0 2024-09-21T12:20:27.298 INFO:tasks.workunit.client.0.smithi003.stdout:8/26: getdents d7 0 2024-09-21T12:20:27.298 INFO:tasks.workunit.client.0.smithi003.stdout:3/37: mkdir d0/d5/d9 0 2024-09-21T12:20:27.298 INFO:tasks.workunit.client.0.smithi003.stdout:3/38: stat d0/c1 0 2024-09-21T12:20:27.299 INFO:tasks.workunit.client.0.smithi003.stdout:9/131: getdents d2/d29 0 2024-09-21T12:20:27.299 INFO:tasks.workunit.client.0.smithi003.stdout:7/45: creat d8/fc x:0 0 0 2024-09-21T12:20:27.299 INFO:tasks.workunit.client.0.smithi003.stdout:7/46: truncate d8/fc 281885 0 2024-09-21T12:20:27.299 INFO:tasks.workunit.client.0.smithi003.stdout:1/27: rename d4/f9 to d4/fb 0 2024-09-21T12:20:27.299 INFO:tasks.workunit.client.0.smithi003.stdout:0/54: mkdir d9/d10 0 2024-09-21T12:20:27.299 INFO:tasks.workunit.client.0.smithi003.stdout:2/48: getdents d0/dd 0 2024-09-21T12:20:27.299 INFO:tasks.workunit.client.0.smithi003.stdout:2/49: chown d0/f6 911092321 1 2024-09-21T12:20:27.299 INFO:tasks.workunit.client.0.smithi003.stdout:2/50: chown d0/f8 2656283 1 2024-09-21T12:20:27.299 INFO:tasks.workunit.client.0.smithi003.stdout:2/51: write d0/dd/f12 [141925,34306] 0 2024-09-21T12:20:27.299 INFO:tasks.workunit.client.0.smithi003.stdout:8/27: creat d7/f9 x:0 0 0 2024-09-21T12:20:27.299 INFO:tasks.workunit.client.0.smithi003.stdout:6/36: rmdir d4/d6 0 2024-09-21T12:20:27.299 INFO:tasks.workunit.client.0.smithi003.stdout:3/39: mkdir d0/d5/da 0 2024-09-21T12:20:27.299 INFO:tasks.workunit.client.0.smithi003.stdout:4/14: chown c4 24 1 2024-09-21T12:20:27.299 INFO:tasks.workunit.client.0.smithi003.stdout:5/40: mknod cb 0 2024-09-21T12:20:27.300 INFO:tasks.workunit.client.0.smithi003.stdout:3/40: dwrite d0/f6 [0,4194304] 0 2024-09-21T12:20:27.300 INFO:tasks.workunit.client.0.smithi003.stdout:3/41: stat d0 0 2024-09-21T12:20:27.300 INFO:tasks.workunit.client.1.smithi192.stdout:4/575: dread d2/db/f6d [0,4194304] 0 2024-09-21T12:20:27.300 INFO:tasks.workunit.client.1.smithi192.stdout:9/656: write d5/d8/f15 [4050896,74839] 0 2024-09-21T12:20:27.301 INFO:tasks.workunit.client.1.smithi192.stdout:9/657: chown d5/dc/d64/dbb/f31 1 1 2024-09-21T12:20:27.304 INFO:tasks.workunit.client.0.smithi003.stdout:8/28: mknod d7/ca 0 2024-09-21T12:20:27.305 INFO:tasks.workunit.client.0.smithi003.stdout:0/55: dread f6 [0,4194304] 0 2024-09-21T12:20:27.306 INFO:tasks.workunit.client.0.smithi003.stdout:0/56: fdatasync f0 0 2024-09-21T12:20:27.306 INFO:tasks.workunit.client.0.smithi003.stdout:6/37: rename l2 to d4/l8 0 2024-09-21T12:20:27.309 INFO:tasks.workunit.client.1.smithi192.stdout:5/860: rename d0/dc to d0/d65/d6e/d84/d126 0 2024-09-21T12:20:27.310 INFO:tasks.workunit.client.0.smithi003.stdout:4/15: creat f5 x:0 0 0 2024-09-21T12:20:27.311 INFO:tasks.workunit.client.0.smithi003.stdout:4/16: readlink l2 0 2024-09-21T12:20:27.313 INFO:tasks.workunit.client.0.smithi003.stdout:4/17: chown c0 13 1 2024-09-21T12:20:27.313 INFO:tasks.workunit.client.0.smithi003.stdout:0/57: dread f2 [0,4194304] 0 2024-09-21T12:20:27.314 INFO:tasks.workunit.client.0.smithi003.stdout:4/18: dread - f5 zero size 2024-09-21T12:20:27.314 INFO:tasks.workunit.client.1.smithi192.stdout:9/658: write d5/dc/d40/dad/d53/d6e/faa [40914,88601] 0 2024-09-21T12:20:27.316 INFO:tasks.workunit.client.0.smithi003.stdout:6/38: dwrite f1 [0,4194304] 0 2024-09-21T12:20:27.316 INFO:tasks.workunit.client.1.smithi192.stdout:0/605: creat d3/d5/d69/faf x:0 0 0 2024-09-21T12:20:27.316 INFO:tasks.workunit.client.0.smithi003.stdout:6/39: chown l0 3 1 2024-09-21T12:20:27.317 INFO:tasks.workunit.client.0.smithi003.stdout:8/29: rmdir d7 39 2024-09-21T12:20:27.317 INFO:tasks.workunit.client.0.smithi003.stdout:6/40: chown d4/f5 1 1 2024-09-21T12:20:27.323 INFO:tasks.workunit.client.1.smithi192.stdout:4/576: mknod d2/db/da4/cbe 0 2024-09-21T12:20:27.325 INFO:tasks.workunit.client.0.smithi003.stdout:5/41: unlink c7 0 2024-09-21T12:20:27.325 INFO:tasks.workunit.client.1.smithi192.stdout:8/669: getdents d14/d1a/d1d/d46/d4e/d83/d8d/d9c/dd0/d8e 0 2024-09-21T12:20:27.326 INFO:tasks.workunit.client.0.smithi003.stdout:3/42: creat d0/d5/d9/fb x:0 0 0 2024-09-21T12:20:27.327 INFO:tasks.workunit.client.1.smithi192.stdout:9/659: readlink d5/dc/l99 0 2024-09-21T12:20:27.329 INFO:tasks.workunit.client.1.smithi192.stdout:6/736: sync 2024-09-21T12:20:27.329 INFO:tasks.workunit.client.1.smithi192.stdout:7/599: sync 2024-09-21T12:20:27.329 INFO:tasks.workunit.client.1.smithi192.stdout:3/546: sync 2024-09-21T12:20:27.329 INFO:tasks.workunit.client.1.smithi192.stdout:1/637: sync 2024-09-21T12:20:27.331 INFO:tasks.workunit.client.0.smithi003.stdout:0/58: truncate f6 1903059 0 2024-09-21T12:20:27.333 INFO:tasks.workunit.client.1.smithi192.stdout:2/606: write d1b/f45 [4601768,61411] 0 2024-09-21T12:20:27.334 INFO:tasks.workunit.client.0.smithi003.stdout:6/41: mkdir d4/d9 0 2024-09-21T12:20:27.335 INFO:tasks.workunit.client.1.smithi192.stdout:4/577: mknod d2/db/d1a/cbf 0 2024-09-21T12:20:27.337 INFO:tasks.workunit.client.1.smithi192.stdout:4/578: readlink d2/db/d3e/d57/d32/d4f/d71/d9d/dad/d9c/lae 0 2024-09-21T12:20:27.337 INFO:tasks.workunit.client.0.smithi003.stdout:6/42: chown d4/f7 8882 1 2024-09-21T12:20:27.338 INFO:tasks.workunit.client.1.smithi192.stdout:4/579: truncate d2/db/d3e/d57/d32/d4f/fbd 344875 0 2024-09-21T12:20:27.339 INFO:tasks.workunit.client.1.smithi192.stdout:4/580: chown d2/db/d3e/d57/d32/d4f/fbd 10 1 2024-09-21T12:20:27.339 INFO:tasks.workunit.client.0.smithi003.stdout:2/52: dwrite d0/ff [0,4194304] 0 2024-09-21T12:20:27.339 INFO:tasks.workunit.client.0.smithi003.stdout:3/43: unlink d0/f6 0 2024-09-21T12:20:27.340 INFO:tasks.workunit.client.1.smithi192.stdout:4/581: read d2/db/d34/d56/d83/f95 [314540,32827] 0 2024-09-21T12:20:27.340 INFO:tasks.workunit.client.1.smithi192.stdout:8/670: dread d14/d1a/d1d/d46/d4e/d83/d8d/d9c/dbe/fc8 [0,4194304] 0 2024-09-21T12:20:27.341 INFO:tasks.workunit.client.0.smithi003.stdout:4/19: fsync f5 0 2024-09-21T12:20:27.341 INFO:tasks.workunit.client.1.smithi192.stdout:8/671: fsync f8 0 2024-09-21T12:20:27.341 INFO:tasks.workunit.client.1.smithi192.stdout:4/582: chown d2/db/d3e/d57/d32/c4e 152896 1 2024-09-21T12:20:27.342 INFO:tasks.workunit.client.0.smithi003.stdout:9/132: truncate d2/da/d17/f1b 2472479 0 2024-09-21T12:20:27.345 INFO:tasks.workunit.client.0.smithi003.stdout:7/47: truncate d8/f9 8306768 0 2024-09-21T12:20:27.346 INFO:tasks.workunit.client.0.smithi003.stdout:8/30: dwrite d7/f9 [0,4194304] 0 2024-09-21T12:20:27.347 INFO:tasks.workunit.client.0.smithi003.stdout:5/42: mkdir dc 0 2024-09-21T12:20:27.347 INFO:tasks.workunit.client.0.smithi003.stdout:8/31: chown d7/ca 10589 1 2024-09-21T12:20:27.349 INFO:tasks.workunit.client.0.smithi003.stdout:6/43: dread d4/f5 [0,4194304] 0 2024-09-21T12:20:27.350 INFO:tasks.workunit.client.1.smithi192.stdout:3/547: unlink db/d16/d18/d21/d23/l6c 0 2024-09-21T12:20:27.351 INFO:tasks.workunit.client.1.smithi192.stdout:3/548: write db/d16/d18/d40/f7e [8751022,9386] 0 2024-09-21T12:20:27.352 INFO:tasks.workunit.client.1.smithi192.stdout:7/600: rename d6/d20/d69/d90/f95 to d6/d9/d1f/fd3 0 2024-09-21T12:20:27.352 INFO:tasks.workunit.client.1.smithi192.stdout:3/549: write db/d16/d18/d33/fa1 [3887263,35679] 0 2024-09-21T12:20:27.356 INFO:tasks.workunit.client.1.smithi192.stdout:5/861: link d0/d65/d6e/dc0/d44/d85/d97/f5c d0/d65/d8e/d77/f127 0 2024-09-21T12:20:27.357 INFO:tasks.workunit.client.1.smithi192.stdout:0/606: write d3/d6/d1d/f65 [264464,54477] 0 2024-09-21T12:20:27.357 INFO:tasks.workunit.client.0.smithi003.stdout:2/53: fsync d0/ff 0 2024-09-21T12:20:27.358 INFO:tasks.workunit.client.1.smithi192.stdout:5/862: readlink d0/d65/d6e/lc9 0 2024-09-21T12:20:27.358 INFO:tasks.workunit.client.1.smithi192.stdout:2/607: chown d1b/d1e/d5e/d75/f84 15882139 1 2024-09-21T12:20:27.359 INFO:tasks.workunit.client.0.smithi003.stdout:0/59: getdents d9/d10 0 2024-09-21T12:20:27.360 INFO:tasks.workunit.client.1.smithi192.stdout:5/863: write d0/d65/f11f [203014,47748] 0 2024-09-21T12:20:27.361 INFO:tasks.workunit.client.1.smithi192.stdout:7/601: dwrite d6/d9/d2d/d7b/fce [0,4194304] 0 2024-09-21T12:20:27.362 INFO:tasks.workunit.client.0.smithi003.stdout:4/20: creat f6 x:0 0 0 2024-09-21T12:20:27.363 INFO:tasks.workunit.client.0.smithi003.stdout:4/21: dread - f6 zero size 2024-09-21T12:20:27.363 INFO:tasks.workunit.client.0.smithi003.stdout:4/22: chown f6 7784 1 2024-09-21T12:20:27.364 INFO:tasks.workunit.client.0.smithi003.stdout:4/23: chown c0 2940 1 2024-09-21T12:20:27.365 INFO:tasks.workunit.client.0.smithi003.stdout:4/24: dread - f5 zero size 2024-09-21T12:20:27.365 INFO:tasks.workunit.client.0.smithi003.stdout:4/25: rmdir - no directory 2024-09-21T12:20:27.366 INFO:tasks.workunit.client.0.smithi003.stdout:9/133: rename d2/fd to d2/da/d17/f2c 0 2024-09-21T12:20:27.366 INFO:tasks.workunit.client.0.smithi003.stdout:4/26: truncate f5 458117 0 2024-09-21T12:20:27.372 INFO:tasks.workunit.client.1.smithi192.stdout:8/672: unlink d14/d1a/d1d/d39/f71 0 2024-09-21T12:20:27.376 INFO:tasks.workunit.client.0.smithi003.stdout:8/32: symlink d7/lb 0 2024-09-21T12:20:27.377 INFO:tasks.workunit.client.1.smithi192.stdout:6/737: mkdir da/d1f/d48/dfa 0 2024-09-21T12:20:27.378 INFO:tasks.workunit.client.0.smithi003.stdout:6/44: creat d4/fa x:0 0 0 2024-09-21T12:20:27.380 INFO:tasks.workunit.client.0.smithi003.stdout:8/33: dread f1 [0,4194304] 0 2024-09-21T12:20:27.381 INFO:tasks.workunit.client.0.smithi003.stdout:8/34: write f3 [3999424,52243] 0 2024-09-21T12:20:27.381 INFO:tasks.workunit.client.0.smithi003.stdout:8/35: readlink l5 0 2024-09-21T12:20:27.383 INFO:tasks.workunit.client.0.smithi003.stdout:8/36: dread f0 [0,4194304] 0 2024-09-21T12:20:27.384 INFO:tasks.workunit.client.0.smithi003.stdout:8/37: chown f1 148165779 1 2024-09-21T12:20:27.385 INFO:tasks.workunit.client.1.smithi192.stdout:3/550: creat db/d16/d61/d2e/fc9 x:0 0 0 2024-09-21T12:20:27.387 INFO:tasks.workunit.client.0.smithi003.stdout:8/38: dread f1 [0,4194304] 0 2024-09-21T12:20:27.390 INFO:tasks.workunit.client.0.smithi003.stdout:3/44: mknod d0/d5/da/cc 0 2024-09-21T12:20:27.391 INFO:tasks.workunit.client.1.smithi192.stdout:4/583: write d2/db/d3e/d57/d32/d4f/d71/d9d/dad/d4b/f64 [491743,5434] 0 2024-09-21T12:20:27.392 INFO:tasks.workunit.client.0.smithi003.stdout:7/48: mknod d8/db/cd 0 2024-09-21T12:20:27.393 INFO:tasks.workunit.client.0.smithi003.stdout:3/45: write d0/d5/d9/fb [575125,45669] 0 2024-09-21T12:20:27.393 INFO:tasks.workunit.client.0.smithi003.stdout:7/49: stat d8/fa 0 2024-09-21T12:20:27.394 INFO:tasks.workunit.client.1.smithi192.stdout:7/602: creat d6/d9/d2d/fd4 x:0 0 0 2024-09-21T12:20:27.394 INFO:tasks.workunit.client.0.smithi003.stdout:9/134: dwrite d2/d20/f21 [0,4194304] 0 2024-09-21T12:20:27.395 INFO:tasks.workunit.client.0.smithi003.stdout:5/43: mknod dc/cd 0 2024-09-21T12:20:27.395 INFO:tasks.workunit.client.0.smithi003.stdout:3/46: fsync d0/f2 0 2024-09-21T12:20:27.396 INFO:tasks.workunit.client.0.smithi003.stdout:7/50: chown d8/db/cd 205754 1 2024-09-21T12:20:27.398 INFO:tasks.workunit.client.0.smithi003.stdout:7/51: write d8/fa [1012524,34115] 0 2024-09-21T12:20:27.400 INFO:tasks.workunit.client.0.smithi003.stdout:6/45: creat d4/fb x:0 0 0 2024-09-21T12:20:27.401 INFO:tasks.workunit.client.0.smithi003.stdout:0/60: write d9/fb [1257420,28743] 0 2024-09-21T12:20:27.401 INFO:tasks.workunit.client.0.smithi003.stdout:6/46: truncate f1 4694451 0 2024-09-21T12:20:27.408 INFO:tasks.workunit.client.0.smithi003.stdout:7/52: dwrite d8/fc [0,4194304] 0 2024-09-21T12:20:27.450 INFO:tasks.workunit.client.1.smithi192.stdout:0/607: rename d3/de/l37 to d3/d6/d1d/lb0 0 2024-09-21T12:20:27.450 INFO:tasks.workunit.client.1.smithi192.stdout:4/584: rename d2 to d2/db/d34/d56/d83/d93/dc0 22 2024-09-21T12:20:27.450 INFO:tasks.workunit.client.0.smithi003.stdout:8/39: symlink d7/lc 0 2024-09-21T12:20:27.451 INFO:tasks.workunit.client.1.smithi192.stdout:2/608: mknod d1b/d65/d77/dbf/cc0 0 2024-09-21T12:20:27.451 INFO:tasks.workunit.client.1.smithi192.stdout:4/585: dread - d2/d36/d7f/fbb zero size 2024-09-21T12:20:27.453 INFO:tasks.workunit.client.1.smithi192.stdout:5/864: dwrite d0/d65/d6e/d84/d126/d13/d37/f71 [0,4194304] 0 2024-09-21T12:20:27.453 INFO:tasks.workunit.client.1.smithi192.stdout:5/865: chown d0/d65/fdf 2238 1 2024-09-21T12:20:27.454 INFO:tasks.workunit.client.0.smithi003.stdout:8/40: dread f3 [0,4194304] 0 2024-09-21T12:20:27.455 INFO:tasks.workunit.client.0.smithi003.stdout:5/44: mknod dc/ce 0 2024-09-21T12:20:27.456 INFO:tasks.workunit.client.0.smithi003.stdout:5/45: write f6 [703244,28089] 0 2024-09-21T12:20:27.456 INFO:tasks.workunit.client.1.smithi192.stdout:9/660: getdents d5/dc/d80/d5a 0 2024-09-21T12:20:27.457 INFO:tasks.workunit.client.0.smithi003.stdout:3/47: mkdir d0/d5/d9/dd 0 2024-09-21T12:20:27.458 INFO:tasks.workunit.client.1.smithi192.stdout:8/673: mknod d14/d1a/d1d/db4/cde 0 2024-09-21T12:20:27.459 INFO:tasks.workunit.client.1.smithi192.stdout:8/674: chown d14/d1a/l50 119996 1 2024-09-21T12:20:27.460 INFO:tasks.workunit.client.1.smithi192.stdout:6/738: dwrite da/d1f/f3c [0,4194304] 0 2024-09-21T12:20:27.464 INFO:tasks.workunit.client.0.smithi003.stdout:5/46: dwrite f6 [0,4194304] 0 2024-09-21T12:20:27.466 INFO:tasks.workunit.client.0.smithi003.stdout:0/61: truncate f4 917177 0 2024-09-21T12:20:27.468 INFO:tasks.workunit.client.1.smithi192.stdout:2/609: fsync d1b/d1e/d5e/d75/d8d/fb1 0 2024-09-21T12:20:27.469 INFO:tasks.workunit.client.0.smithi003.stdout:7/53: creat d8/fe x:0 0 0 2024-09-21T12:20:27.470 INFO:tasks.workunit.client.1.smithi192.stdout:4/586: dread d2/d21/f38 [0,4194304] 0 2024-09-21T12:20:27.472 INFO:tasks.workunit.client.0.smithi003.stdout:7/54: chown d8/fc 7706776 1 2024-09-21T12:20:27.472 INFO:tasks.workunit.client.0.smithi003.stdout:4/27: link c3 c7 0 2024-09-21T12:20:27.473 INFO:tasks.workunit.client.1.smithi192.stdout:9/661: unlink d5/d8/c73 0 2024-09-21T12:20:27.474 INFO:tasks.workunit.client.0.smithi003.stdout:8/41: symlink d7/ld 0 2024-09-21T12:20:27.475 INFO:tasks.workunit.client.0.smithi003.stdout:5/47: dwrite f6 [0,4194304] 0 2024-09-21T12:20:27.475 INFO:tasks.workunit.client.0.smithi003.stdout:4/28: dread f5 [0,4194304] 0 2024-09-21T12:20:27.478 INFO:tasks.workunit.client.0.smithi003.stdout:3/48: chown d0/l7 20788 1 2024-09-21T12:20:27.479 INFO:tasks.workunit.client.0.smithi003.stdout:3/49: chown d0/d5 63 1 2024-09-21T12:20:27.480 INFO:tasks.workunit.client.1.smithi192.stdout:3/551: link db/d16/fb3 db/d16/d18/d33/d3b/fca 0 2024-09-21T12:20:27.483 INFO:tasks.workunit.client.1.smithi192.stdout:0/608: link d3/f93 d3/d6/d83/d87/fb1 0 2024-09-21T12:20:27.486 INFO:tasks.workunit.client.0.smithi003.stdout:3/50: dwrite d0/f8 [0,4194304] 0 2024-09-21T12:20:27.488 INFO:tasks.workunit.client.1.smithi192.stdout:1/638: sync 2024-09-21T12:20:27.488 INFO:tasks.workunit.client.0.smithi003.stdout:0/62: symlink d9/l11 0 2024-09-21T12:20:27.488 INFO:tasks.workunit.client.0.smithi003.stdout:3/51: truncate d0/d5/d9/fb 697692 0 2024-09-21T12:20:27.491 INFO:tasks.workunit.client.0.smithi003.stdout:5/48: fsync f6 0 2024-09-21T12:20:27.494 INFO:tasks.workunit.client.0.smithi003.stdout:7/55: creat d8/db/ff x:0 0 0 2024-09-21T12:20:27.496 INFO:tasks.workunit.client.0.smithi003.stdout:5/49: dread f6 [0,4194304] 0 2024-09-21T12:20:27.496 INFO:tasks.workunit.client.1.smithi192.stdout:1/639: dwrite d2/d12/fbc [0,4194304] 0 2024-09-21T12:20:27.500 INFO:tasks.workunit.client.0.smithi003.stdout:8/42: mkdir d7/de 0 2024-09-21T12:20:27.503 INFO:tasks.workunit.client.0.smithi003.stdout:5/50: dread f6 [0,4194304] 0 2024-09-21T12:20:27.503 INFO:tasks.workunit.client.0.smithi003.stdout:7/56: dwrite d8/fc [0,4194304] 0 2024-09-21T12:20:27.504 INFO:tasks.workunit.client.1.smithi192.stdout:0/609: chown d3/d6/c79 1087626 1 2024-09-21T12:20:27.504 INFO:tasks.workunit.client.0.smithi003.stdout:7/57: chown d8 272 1 2024-09-21T12:20:27.504 INFO:tasks.workunit.client.1.smithi192.stdout:8/675: write d14/d18/f28 [2602200,89858] 0 2024-09-21T12:20:27.506 INFO:tasks.workunit.client.1.smithi192.stdout:2/610: fdatasync d1b/d38/f4d 0 2024-09-21T12:20:27.507 INFO:tasks.workunit.client.1.smithi192.stdout:2/611: fdatasync d1b/d38/d53/f6d 0 2024-09-21T12:20:27.507 INFO:tasks.workunit.client.0.smithi003.stdout:9/135: link d2/da/d17/l19 d2/da/d2a/l2d 0 2024-09-21T12:20:27.511 INFO:tasks.workunit.client.0.smithi003.stdout:6/47: link f3 d4/fc 0 2024-09-21T12:20:27.512 INFO:tasks.workunit.client.0.smithi003.stdout:6/48: read - d4/fb zero size 2024-09-21T12:20:27.512 INFO:tasks.workunit.client.1.smithi192.stdout:7/603: link d6/d9/d2d/c64 d6/cd5 0 2024-09-21T12:20:27.512 INFO:tasks.workunit.client.1.smithi192.stdout:2/612: dwrite d1b/f27 [0,4194304] 0 2024-09-21T12:20:27.516 INFO:tasks.workunit.client.0.smithi003.stdout:7/58: dwrite d8/fc [0,4194304] 0 2024-09-21T12:20:27.516 INFO:tasks.workunit.client.0.smithi003.stdout:3/52: creat d0/d5/d9/fe x:0 0 0 2024-09-21T12:20:27.518 INFO:tasks.workunit.client.0.smithi003.stdout:7/59: write d8/db/ff [882526,85254] 0 2024-09-21T12:20:27.518 INFO:tasks.workunit.client.0.smithi003.stdout:3/53: write d0/f8 [342203,4205] 0 2024-09-21T12:20:27.525 INFO:tasks.workunit.client.0.smithi003.stdout:8/43: mkdir d7/df 0 2024-09-21T12:20:27.526 INFO:tasks.workunit.client.0.smithi003.stdout:8/44: read - f4 zero size 2024-09-21T12:20:27.531 INFO:tasks.workunit.client.0.smithi003.stdout:9/136: mknod d2/da/c2e 0 2024-09-21T12:20:27.536 INFO:tasks.workunit.client.0.smithi003.stdout:6/49: rename f1 to d4/d9/fd 0 2024-09-21T12:20:27.537 INFO:tasks.workunit.client.0.smithi003.stdout:7/60: creat d8/f10 x:0 0 0 2024-09-21T12:20:27.538 INFO:tasks.workunit.client.0.smithi003.stdout:7/61: read - d8/fe zero size 2024-09-21T12:20:27.538 INFO:tasks.workunit.client.0.smithi003.stdout:7/62: stat l6 0 2024-09-21T12:20:27.538 INFO:tasks.workunit.client.1.smithi192.stdout:9/662: mknod d5/dc/dc2/dd1/cd4 0 2024-09-21T12:20:27.539 INFO:tasks.workunit.client.1.smithi192.stdout:6/739: link da/d1f/d56/d78/c93 da/d1f/d56/d73/cfb 0 2024-09-21T12:20:27.539 INFO:tasks.workunit.client.1.smithi192.stdout:3/552: symlink db/d16/d18/d33/d3b/lcb 0 2024-09-21T12:20:27.539 INFO:tasks.workunit.client.0.smithi003.stdout:7/63: write d8/f10 [543025,70161] 0 2024-09-21T12:20:27.540 INFO:tasks.workunit.client.1.smithi192.stdout:8/676: mknod d14/d1a/d1d/d46/d4e/db5/cdf 0 2024-09-21T12:20:27.541 INFO:tasks.workunit.client.1.smithi192.stdout:7/604: truncate d6/d20/d69/d90/da7/dc1/fa3 694807 0 2024-09-21T12:20:27.541 INFO:tasks.workunit.client.1.smithi192.stdout:5/866: getdents d0/d65/d6e/d84 0 2024-09-21T12:20:27.542 INFO:tasks.workunit.client.0.smithi003.stdout:5/51: truncate f6 2941999 0 2024-09-21T12:20:27.543 INFO:tasks.workunit.client.1.smithi192.stdout:2/613: mknod d1b/d1e/d7b/cc1 0 2024-09-21T12:20:27.543 INFO:tasks.workunit.client.0.smithi003.stdout:0/63: truncate d9/fb 2246096 0 2024-09-21T12:20:27.543 INFO:tasks.workunit.client.1.smithi192.stdout:3/553: chown db/d16/d18/d33/l5a 1 1 2024-09-21T12:20:27.544 INFO:tasks.workunit.client.0.smithi003.stdout:0/64: fdatasync f0 0 2024-09-21T12:20:27.545 INFO:tasks.workunit.client.1.smithi192.stdout:8/677: write d14/d1a/d1d/f57 [5865564,84306] 0 2024-09-21T12:20:27.546 INFO:tasks.workunit.client.1.smithi192.stdout:1/640: dread d2/de/f19 [4194304,4194304] 0 2024-09-21T12:20:27.547 INFO:tasks.workunit.client.0.smithi003.stdout:7/64: dwrite d8/fc [0,4194304] 0 2024-09-21T12:20:27.548 INFO:tasks.workunit.client.1.smithi192.stdout:4/587: dwrite d2/db/f6d [0,4194304] 0 2024-09-21T12:20:27.548 INFO:tasks.workunit.client.1.smithi192.stdout:3/554: write db/d16/d18/da7/fbd [664550,57864] 0 2024-09-21T12:20:27.550 INFO:tasks.workunit.client.0.smithi003.stdout:6/50: rename d4/f7 to d4/fe 0 2024-09-21T12:20:27.550 INFO:tasks.workunit.client.0.smithi003.stdout:6/51: rename d4/d9 to d4/d9/df 22 2024-09-21T12:20:27.553 INFO:tasks.workunit.client.0.smithi003.stdout:8/45: creat d7/de/f10 x:0 0 0 2024-09-21T12:20:27.554 INFO:tasks.workunit.client.0.smithi003.stdout:4/29: getdents . 0 2024-09-21T12:20:27.554 INFO:tasks.workunit.client.0.smithi003.stdout:8/46: readlink d7/lc 0 2024-09-21T12:20:27.555 INFO:tasks.workunit.client.1.smithi192.stdout:5/867: dwrite d0/d65/d6e/dc0/d44/d85/f94 [0,4194304] 0 2024-09-21T12:20:27.556 INFO:tasks.workunit.client.1.smithi192.stdout:6/740: mkdir da/dfc 0 2024-09-21T12:20:27.557 INFO:tasks.workunit.client.1.smithi192.stdout:5/868: dread - d0/d2/d7b/fe2 zero size 2024-09-21T12:20:27.559 INFO:tasks.workunit.client.1.smithi192.stdout:7/605: dwrite d6/d3a/d6d/f85 [0,4194304] 0 2024-09-21T12:20:27.559 INFO:tasks.workunit.client.1.smithi192.stdout:7/606: chown d6/f27 11336070 1 2024-09-21T12:20:27.560 INFO:tasks.workunit.client.0.smithi003.stdout:8/47: dread f1 [0,4194304] 0 2024-09-21T12:20:27.563 INFO:tasks.workunit.client.1.smithi192.stdout:2/614: mknod d1b/d1e/d5e/cc2 0 2024-09-21T12:20:27.566 INFO:tasks.workunit.client.0.smithi003.stdout:9/137: creat d2/d20/d22/f2f x:0 0 0 2024-09-21T12:20:27.569 INFO:tasks.workunit.client.1.smithi192.stdout:8/678: mkdir d14/d1a/d82/de0 0 2024-09-21T12:20:27.569 INFO:tasks.workunit.client.1.smithi192.stdout:4/588: symlink d2/db/d34/d56/d6c/lc1 0 2024-09-21T12:20:27.571 INFO:tasks.workunit.client.0.smithi003.stdout:7/65: symlink d8/db/l11 0 2024-09-21T12:20:27.572 INFO:tasks.workunit.client.0.smithi003.stdout:7/66: truncate d8/fe 363225 0 2024-09-21T12:20:27.573 INFO:tasks.workunit.client.0.smithi003.stdout:7/67: chown d8/db/l11 264802 1 2024-09-21T12:20:27.574 INFO:tasks.workunit.client.1.smithi192.stdout:8/679: read d14/d1a/d1d/f57 [2207245,104556] 0 2024-09-21T12:20:27.575 INFO:tasks.workunit.client.0.smithi003.stdout:4/30: creat f8 x:0 0 0 2024-09-21T12:20:27.576 INFO:tasks.workunit.client.0.smithi003.stdout:8/48: mkdir d7/de/d11 0 2024-09-21T12:20:27.577 INFO:tasks.workunit.client.1.smithi192.stdout:6/741: mknod da/d23/d37/dc5/cfd 0 2024-09-21T12:20:27.577 INFO:tasks.workunit.client.1.smithi192.stdout:6/742: read f8 [3494715,90819] 0 2024-09-21T12:20:27.578 INFO:tasks.workunit.client.1.smithi192.stdout:6/743: write da/d1f/d27/d6b/f8c [1593271,38510] 0 2024-09-21T12:20:27.580 INFO:tasks.workunit.client.1.smithi192.stdout:2/615: stat d1b/d38/d7d/c9b 0 2024-09-21T12:20:27.581 INFO:tasks.workunit.client.0.smithi003.stdout:6/52: fsync f3 0 2024-09-21T12:20:27.581 INFO:tasks.workunit.client.1.smithi192.stdout:2/616: dread - d1b/d38/d53/f6d zero size 2024-09-21T12:20:27.582 INFO:tasks.workunit.client.0.smithi003.stdout:7/68: dwrite d8/fa [0,4194304] 0 2024-09-21T12:20:27.584 INFO:tasks.workunit.client.0.smithi003.stdout:7/69: truncate d8/fe 574918 0 2024-09-21T12:20:27.586 INFO:tasks.workunit.client.0.smithi003.stdout:9/138: rename d2/da/d17/f1b to d2/d29/f30 0 2024-09-21T12:20:27.590 INFO:tasks.workunit.client.0.smithi003.stdout:7/70: symlink d8/l12 0 2024-09-21T12:20:27.594 INFO:tasks.workunit.client.0.smithi003.stdout:7/71: mkdir d8/db/d13 0 2024-09-21T12:20:27.595 INFO:tasks.workunit.client.0.smithi003.stdout:6/53: dwrite d4/fe [0,4194304] 0 2024-09-21T12:20:27.595 INFO:tasks.workunit.client.0.smithi003.stdout:7/72: stat d8/fa 0 2024-09-21T12:20:27.598 INFO:tasks.workunit.client.1.smithi192.stdout:7/607: dread d6/d9/d1f/f21 [0,4194304] 0 2024-09-21T12:20:27.600 INFO:tasks.workunit.client.0.smithi003.stdout:6/54: creat d4/f10 x:0 0 0 2024-09-21T12:20:27.601 INFO:tasks.workunit.client.0.smithi003.stdout:6/55: chown d4/d9 9016 1 2024-09-21T12:20:27.603 INFO:tasks.workunit.client.0.smithi003.stdout:9/139: getdents d2/da/d2a 0 2024-09-21T12:20:27.605 INFO:tasks.workunit.client.0.smithi003.stdout:7/73: dwrite d8/fc [0,4194304] 0 2024-09-21T12:20:27.605 INFO:tasks.workunit.client.0.smithi003.stdout:6/56: mkdir d4/d11 0 2024-09-21T12:20:27.606 INFO:tasks.workunit.client.0.smithi003.stdout:6/57: read d4/f5 [2637756,15131] 0 2024-09-21T12:20:27.607 INFO:tasks.workunit.client.0.smithi003.stdout:8/49: fsync d7/de/f10 0 2024-09-21T12:20:27.612 INFO:tasks.workunit.client.0.smithi003.stdout:6/58: symlink d4/l12 0 2024-09-21T12:20:27.614 INFO:tasks.workunit.client.1.smithi192.stdout:1/641: rename d2/da/d6b/c72 to d2/d12/d2f/d51/d24/d65/d8b/cd3 0 2024-09-21T12:20:27.618 INFO:tasks.workunit.client.1.smithi192.stdout:0/610: sync 2024-09-21T12:20:27.619 INFO:tasks.workunit.client.1.smithi192.stdout:4/589: creat d2/db/d34/d56/d83/fc2 x:0 0 0 2024-09-21T12:20:27.620 INFO:tasks.workunit.client.0.smithi003.stdout:6/59: dwrite d4/f10 [0,4194304] 0 2024-09-21T12:20:27.622 INFO:tasks.workunit.client.1.smithi192.stdout:8/680: mkdir d14/d1a/d1d/d48/de1 0 2024-09-21T12:20:27.623 INFO:tasks.workunit.client.1.smithi192.stdout:9/663: truncate d5/dc/f68 2090218 0 2024-09-21T12:20:27.625 INFO:tasks.workunit.client.0.smithi003.stdout:4/31: getdents . 0 2024-09-21T12:20:27.626 INFO:tasks.workunit.client.0.smithi003.stdout:5/52: write f6 [1859538,67639] 0 2024-09-21T12:20:27.628 INFO:tasks.workunit.client.0.smithi003.stdout:5/53: truncate f6 3578453 0 2024-09-21T12:20:27.629 INFO:tasks.workunit.client.0.smithi003.stdout:8/50: link d7/f9 d7/df/f12 0 2024-09-21T12:20:27.629 INFO:tasks.workunit.client.1.smithi192.stdout:8/681: dwrite d14/d1a/d1d/d20/d5f/fa3 [0,4194304] 0 2024-09-21T12:20:27.631 INFO:tasks.workunit.client.0.smithi003.stdout:6/60: dwrite d4/fa [0,4194304] 0 2024-09-21T12:20:27.633 INFO:tasks.workunit.client.1.smithi192.stdout:6/744: rmdir da/d23/d37/dc5 39 2024-09-21T12:20:27.633 INFO:tasks.workunit.client.0.smithi003.stdout:5/54: fdatasync f6 0 2024-09-21T12:20:27.639 INFO:tasks.workunit.client.1.smithi192.stdout:7/608: creat d6/d3a/d6d/fd6 x:0 0 0 2024-09-21T12:20:27.640 INFO:tasks.workunit.client.1.smithi192.stdout:6/745: dwrite da/d1f/d27/d3e/f94 [0,4194304] 0 2024-09-21T12:20:27.643 INFO:tasks.workunit.client.0.smithi003.stdout:9/140: dread d2/d29/f30 [0,4194304] 0 2024-09-21T12:20:27.644 INFO:tasks.workunit.client.1.smithi192.stdout:3/555: rename db/d16/d61 to db/d16/d18/d21/d23/d71/d77/dcc 0 2024-09-21T12:20:27.645 INFO:tasks.workunit.client.0.smithi003.stdout:6/61: mkdir d4/d13 0 2024-09-21T12:20:27.646 INFO:tasks.workunit.client.1.smithi192.stdout:1/642: rmdir d2/d45 39 2024-09-21T12:20:27.648 INFO:tasks.workunit.client.0.smithi003.stdout:5/55: readlink l9 0 2024-09-21T12:20:27.648 INFO:tasks.workunit.client.0.smithi003.stdout:9/141: dread d2/da/d17/f2c [0,4194304] 0 2024-09-21T12:20:27.649 INFO:tasks.workunit.client.0.smithi003.stdout:8/51: mknod d7/de/d11/c13 0 2024-09-21T12:20:27.651 INFO:tasks.workunit.client.1.smithi192.stdout:0/611: mkdir d3/d5/d69/db2 0 2024-09-21T12:20:27.653 INFO:tasks.workunit.client.0.smithi003.stdout:5/56: dread f6 [0,4194304] 0 2024-09-21T12:20:27.653 INFO:tasks.workunit.client.1.smithi192.stdout:4/590: mknod d2/db/d3e/d57/cc3 0 2024-09-21T12:20:27.655 INFO:tasks.workunit.client.0.smithi003.stdout:9/142: dread d2/da/f14 [0,4194304] 0 2024-09-21T12:20:27.655 INFO:tasks.workunit.client.0.smithi003.stdout:8/52: rename d7/de/f10 to d7/f14 0 2024-09-21T12:20:27.657 INFO:tasks.workunit.client.1.smithi192.stdout:0/612: dwrite d3/d5/d28/d39/f41 [0,4194304] 0 2024-09-21T12:20:27.657 INFO:tasks.workunit.client.0.smithi003.stdout:8/53: chown d7/ca 8138 1 2024-09-21T12:20:27.657 INFO:tasks.workunit.client.0.smithi003.stdout:6/62: symlink d4/d13/l14 0 2024-09-21T12:20:27.657 INFO:tasks.workunit.client.0.smithi003.stdout:8/54: read - d7/f14 zero size 2024-09-21T12:20:27.658 INFO:tasks.workunit.client.0.smithi003.stdout:5/57: dread f6 [0,4194304] 0 2024-09-21T12:20:27.658 INFO:tasks.workunit.client.1.smithi192.stdout:8/682: mkdir d14/d1a/d1d/d48/de2 0 2024-09-21T12:20:27.659 INFO:tasks.workunit.client.0.smithi003.stdout:8/55: rename d7 to d7/de/d11/d15 22 2024-09-21T12:20:27.659 INFO:tasks.workunit.client.0.smithi003.stdout:5/58: write f6 [1792228,19737] 0 2024-09-21T12:20:27.660 INFO:tasks.workunit.client.0.smithi003.stdout:6/63: write d4/fe [4684558,11583] 0 2024-09-21T12:20:27.661 INFO:tasks.workunit.client.1.smithi192.stdout:5/869: creat d0/d65/d6e/f128 x:0 0 0 2024-09-21T12:20:27.666 INFO:tasks.workunit.client.1.smithi192.stdout:2/617: creat d1b/d38/d53/d8b/da7/dbb/fc3 x:0 0 0 2024-09-21T12:20:27.669 INFO:tasks.workunit.client.0.smithi003.stdout:8/56: rmdir d7 39 2024-09-21T12:20:27.669 INFO:tasks.workunit.client.1.smithi192.stdout:6/746: readlink da/d23/l98 0 2024-09-21T12:20:27.671 INFO:tasks.workunit.client.1.smithi192.stdout:3/556: rmdir db 39 2024-09-21T12:20:27.671 INFO:tasks.workunit.client.0.smithi003.stdout:5/59: dwrite f6 [0,4194304] 0 2024-09-21T12:20:27.671 INFO:tasks.workunit.client.0.smithi003.stdout:8/57: write f4 [787612,75553] 0 2024-09-21T12:20:27.672 INFO:tasks.workunit.client.0.smithi003.stdout:6/64: dwrite d4/fb [0,4194304] 0 2024-09-21T12:20:27.673 INFO:tasks.workunit.client.0.smithi003.stdout:6/65: fdatasync d4/fe 0 2024-09-21T12:20:27.678 INFO:tasks.workunit.client.1.smithi192.stdout:1/643: dread d2/d12/d2f/d51/d24/f4c [0,4194304] 0 2024-09-21T12:20:27.680 INFO:tasks.workunit.client.0.smithi003.stdout:5/60: chown c5 318083 1 2024-09-21T12:20:27.682 INFO:tasks.workunit.client.0.smithi003.stdout:7/74: write d8/f9 [924386,108752] 0 2024-09-21T12:20:27.683 INFO:tasks.workunit.client.0.smithi003.stdout:7/75: fsync d8/f10 0 2024-09-21T12:20:27.685 INFO:tasks.workunit.client.0.smithi003.stdout:9/143: link d2/da/c2e d2/d29/c31 0 2024-09-21T12:20:27.687 INFO:tasks.workunit.client.0.smithi003.stdout:8/58: dread d7/f9 [0,4194304] 0 2024-09-21T12:20:27.689 INFO:tasks.workunit.client.0.smithi003.stdout:7/76: dread d8/fc [0,4194304] 0 2024-09-21T12:20:27.691 INFO:tasks.workunit.client.1.smithi192.stdout:2/618: symlink d1b/d38/d53/lc4 0 2024-09-21T12:20:27.692 INFO:tasks.workunit.client.0.smithi003.stdout:5/61: mkdir dc/df 0 2024-09-21T12:20:27.698 INFO:tasks.workunit.client.0.smithi003.stdout:9/144: readlink d2/l7 0 2024-09-21T12:20:27.698 INFO:tasks.workunit.client.0.smithi003.stdout:9/145: chown d2/da 423956780 1 2024-09-21T12:20:27.699 INFO:tasks.workunit.client.0.smithi003.stdout:0/65: truncate d9/fb 1861144 0 2024-09-21T12:20:27.701 INFO:tasks.workunit.client.1.smithi192.stdout:1/644: mkdir d2/d12/d2f/d51/d24/d65/dd4 0 2024-09-21T12:20:27.703 INFO:tasks.workunit.client.0.smithi003.stdout:8/59: fdatasync f3 0 2024-09-21T12:20:27.703 INFO:tasks.workunit.client.0.smithi003.stdout:8/60: chown d7/ld 72348 1 2024-09-21T12:20:27.704 INFO:tasks.workunit.client.1.smithi192.stdout:1/645: dread d2/d12/d2f/d51/d24/f26 [0,4194304] 0 2024-09-21T12:20:27.705 INFO:tasks.workunit.client.0.smithi003.stdout:7/77: mknod d8/c14 0 2024-09-21T12:20:27.706 INFO:tasks.workunit.client.1.smithi192.stdout:8/683: creat d14/d18/daf/ddd/fe3 x:0 0 0 2024-09-21T12:20:27.712 INFO:tasks.workunit.client.0.smithi003.stdout:9/146: creat d2/d20/f32 x:0 0 0 2024-09-21T12:20:27.716 INFO:tasks.workunit.client.1.smithi192.stdout:9/664: rename d5/dc/d80/d44/d79/d3f to d5/d19/dd5 0 2024-09-21T12:20:27.718 INFO:tasks.workunit.client.1.smithi192.stdout:0/613: dwrite d3/f93 [0,4194304] 0 2024-09-21T12:20:27.718 INFO:tasks.workunit.client.1.smithi192.stdout:7/609: write d6/d9/f2b [4434856,92838] 0 2024-09-21T12:20:27.719 INFO:tasks.workunit.client.0.smithi003.stdout:7/78: symlink d8/db/l15 0 2024-09-21T12:20:27.720 INFO:tasks.workunit.client.0.smithi003.stdout:6/66: link d4/fc d4/d9/f15 0 2024-09-21T12:20:27.720 INFO:tasks.workunit.client.1.smithi192.stdout:7/610: truncate d6/d3a/f61 965116 0 2024-09-21T12:20:27.723 INFO:tasks.workunit.client.1.smithi192.stdout:1/646: unlink d2/d12/l3a 0 2024-09-21T12:20:27.725 INFO:tasks.workunit.client.1.smithi192.stdout:8/684: creat d14/d18/d94/dc3/fe4 x:0 0 0 2024-09-21T12:20:27.726 INFO:tasks.workunit.client.1.smithi192.stdout:8/685: chown d14/d1a/d82 32639611 1 2024-09-21T12:20:27.727 INFO:tasks.workunit.client.1.smithi192.stdout:5/870: write d0/d65/d6e/dc0/d44/d85/d97/d45/f72 [1386958,127239] 0 2024-09-21T12:20:27.728 INFO:tasks.workunit.client.1.smithi192.stdout:2/619: creat d1b/d1e/d5e/d88/d95/dbe/fc5 x:0 0 0 2024-09-21T12:20:27.730 INFO:tasks.workunit.client.1.smithi192.stdout:5/871: chown d0/d65/d6e/d84/d126/d13/cdc 58298 1 2024-09-21T12:20:27.732 INFO:tasks.workunit.client.1.smithi192.stdout:8/686: dwrite d14/d1a/d1d/d20/d5f/f67 [4194304,4194304] 0 2024-09-21T12:20:27.735 INFO:tasks.workunit.client.0.smithi003.stdout:7/79: creat d8/db/f16 x:0 0 0 2024-09-21T12:20:27.737 INFO:tasks.workunit.client.0.smithi003.stdout:6/67: rmdir d4/d13 39 2024-09-21T12:20:27.738 INFO:tasks.workunit.client.1.smithi192.stdout:9/665: mkdir d5/dc/d80/d44/d8e/dd6 0 2024-09-21T12:20:27.738 INFO:tasks.workunit.client.1.smithi192.stdout:9/666: stat d5/d19/f3c 0 2024-09-21T12:20:27.741 INFO:tasks.workunit.client.0.smithi003.stdout:5/62: rmdir dc/df 0 2024-09-21T12:20:27.742 INFO:tasks.workunit.client.0.smithi003.stdout:2/54: sync 2024-09-21T12:20:27.742 INFO:tasks.workunit.client.0.smithi003.stdout:1/28: sync 2024-09-21T12:20:27.742 INFO:tasks.workunit.client.0.smithi003.stdout:3/54: sync 2024-09-21T12:20:27.742 INFO:tasks.workunit.client.0.smithi003.stdout:5/63: fdatasync f6 0 2024-09-21T12:20:27.743 INFO:tasks.workunit.client.0.smithi003.stdout:1/29: dread - d4/fa zero size 2024-09-21T12:20:27.744 INFO:tasks.workunit.client.0.smithi003.stdout:2/55: chown d0/f6 50945624 1 2024-09-21T12:20:27.744 INFO:tasks.workunit.client.0.smithi003.stdout:6/68: dread d4/fa [0,4194304] 0 2024-09-21T12:20:27.746 INFO:tasks.workunit.client.0.smithi003.stdout:1/30: write f2 [1079629,102509] 0 2024-09-21T12:20:27.754 INFO:tasks.workunit.client.0.smithi003.stdout:2/56: dread d0/f6 [0,4194304] 0 2024-09-21T12:20:27.755 INFO:tasks.workunit.client.0.smithi003.stdout:3/55: dwrite d0/d5/d9/fe [0,4194304] 0 2024-09-21T12:20:27.770 INFO:tasks.workunit.client.0.smithi003.stdout:4/32: sync 2024-09-21T12:20:27.777 INFO:tasks.workunit.client.1.smithi192.stdout:0/614: symlink d3/d5/d69/lb3 0 2024-09-21T12:20:27.781 INFO:tasks.workunit.client.1.smithi192.stdout:4/591: symlink d2/db/d3e/d57/d32/d4f/d71/d9d/dad/d4b/lc4 0 2024-09-21T12:20:27.783 INFO:tasks.workunit.client.0.smithi003.stdout:0/66: rmdir d9/d10 0 2024-09-21T12:20:27.783 INFO:tasks.workunit.client.0.smithi003.stdout:0/67: readlink l5 0 2024-09-21T12:20:27.784 INFO:tasks.workunit.client.0.smithi003.stdout:0/68: chown d9/lf 100966 1 2024-09-21T12:20:27.785 INFO:tasks.workunit.client.1.smithi192.stdout:7/611: creat d6/d20/d69/d90/da7/fd7 x:0 0 0 2024-09-21T12:20:27.788 INFO:tasks.workunit.client.1.smithi192.stdout:1/647: mkdir d2/d12/d2f/d51/d24/d65/d8b/dd5 0 2024-09-21T12:20:27.791 INFO:tasks.workunit.client.0.smithi003.stdout:7/80: creat d8/f17 x:0 0 0 2024-09-21T12:20:27.801 INFO:tasks.workunit.client.0.smithi003.stdout:7/81: dwrite d8/f17 [0,4194304] 0 2024-09-21T12:20:27.805 INFO:tasks.workunit.client.0.smithi003.stdout:5/64: creat dc/f10 x:0 0 0 2024-09-21T12:20:27.806 INFO:tasks.workunit.client.0.smithi003.stdout:5/65: read f6 [3100196,3112] 0 2024-09-21T12:20:27.810 INFO:tasks.workunit.client.0.smithi003.stdout:1/31: mkdir d4/dc 0 2024-09-21T12:20:27.812 INFO:tasks.workunit.client.0.smithi003.stdout:7/82: dwrite d8/db/f16 [0,4194304] 0 2024-09-21T12:20:27.816 INFO:tasks.workunit.client.1.smithi192.stdout:9/667: dwrite d5/dc/d64/dbb/d3d/f54 [0,4194304] 0 2024-09-21T12:20:27.817 INFO:tasks.workunit.client.1.smithi192.stdout:4/592: mkdir d2/db/da4/dc5 0 2024-09-21T12:20:27.818 INFO:tasks.workunit.client.0.smithi003.stdout:4/33: mkdir d9 0 2024-09-21T12:20:27.823 INFO:tasks.workunit.client.1.smithi192.stdout:1/648: chown d2/d4d/cb3 45 1 2024-09-21T12:20:27.825 INFO:tasks.workunit.client.0.smithi003.stdout:8/61: getdents d7 0 2024-09-21T12:20:27.826 INFO:tasks.workunit.client.1.smithi192.stdout:6/747: link da/fc da/d23/ffe 0 2024-09-21T12:20:27.826 INFO:tasks.workunit.client.1.smithi192.stdout:6/748: dread - da/d1f/d56/d73/fc7 zero size 2024-09-21T12:20:27.836 INFO:tasks.workunit.client.1.smithi192.stdout:3/557: symlink db/d16/d18/lcd 0 2024-09-21T12:20:27.837 INFO:tasks.workunit.client.0.smithi003.stdout:6/69: fdatasync d4/fc 0 2024-09-21T12:20:27.839 INFO:tasks.workunit.client.1.smithi192.stdout:8/687: creat d14/d1a/d1d/d46/d4e/d83/d8d/dd8/fe5 x:0 0 0 2024-09-21T12:20:27.842 INFO:tasks.workunit.client.1.smithi192.stdout:0/615: mkdir d3/de/d33/dae/db4 0 2024-09-21T12:20:27.843 INFO:tasks.workunit.client.1.smithi192.stdout:0/616: write d3/d6/d83/d87/faa [842161,46811] 0 2024-09-21T12:20:27.845 INFO:tasks.workunit.client.1.smithi192.stdout:9/668: unlink d5/dc/d64/dbb/d3d/ca9 0 2024-09-21T12:20:27.848 INFO:tasks.workunit.client.0.smithi003.stdout:0/69: truncate f6 2908190 0 2024-09-21T12:20:27.851 INFO:tasks.workunit.client.1.smithi192.stdout:4/593: dwrite d2/db/d34/d56/d6c/db8/f58 [0,4194304] 0 2024-09-21T12:20:27.854 INFO:tasks.workunit.client.0.smithi003.stdout:5/66: unlink ca 0 2024-09-21T12:20:27.854 INFO:tasks.workunit.client.0.smithi003.stdout:5/67: dread - dc/f10 zero size 2024-09-21T12:20:27.857 INFO:tasks.workunit.client.1.smithi192.stdout:6/749: chown da/l24 2227 1 2024-09-21T12:20:27.858 INFO:tasks.workunit.client.1.smithi192.stdout:6/750: write da/d1f/d56/d73/fc7 [13526,11203] 0 2024-09-21T12:20:27.860 INFO:tasks.workunit.client.1.smithi192.stdout:6/751: chown da/d1f/d56/lba 3716 1 2024-09-21T12:20:27.860 INFO:tasks.workunit.client.0.smithi003.stdout:1/32: fdatasync d4/fb 0 2024-09-21T12:20:27.864 INFO:tasks.workunit.client.1.smithi192.stdout:8/688: creat d14/d18/daf/fe6 x:0 0 0 2024-09-21T12:20:27.867 INFO:tasks.workunit.client.0.smithi003.stdout:4/34: mkdir d9/da 0 2024-09-21T12:20:27.870 INFO:tasks.workunit.client.1.smithi192.stdout:9/669: unlink d5/dc/d80/d44/d79/f43 0 2024-09-21T12:20:27.870 INFO:tasks.workunit.client.1.smithi192.stdout:0/617: dwrite d3/de/f24 [0,4194304] 0 2024-09-21T12:20:27.871 INFO:tasks.workunit.client.1.smithi192.stdout:0/618: dread d3/d6/d1d/d89/f9d [0,4194304] 0 2024-09-21T12:20:27.873 INFO:tasks.workunit.client.0.smithi003.stdout:2/57: rename d0/f8 to d0/f13 0 2024-09-21T12:20:27.875 INFO:tasks.workunit.client.1.smithi192.stdout:5/872: getdents d0/d65/d6e/da7 0 2024-09-21T12:20:27.875 INFO:tasks.workunit.client.1.smithi192.stdout:0/619: dread d3/f93 [0,4194304] 0 2024-09-21T12:20:27.875 INFO:tasks.workunit.client.1.smithi192.stdout:5/873: read - d0/d65/d6e/dc0/fc4 zero size 2024-09-21T12:20:27.877 INFO:tasks.workunit.client.0.smithi003.stdout:5/68: symlink dc/l11 0 2024-09-21T12:20:27.879 INFO:tasks.workunit.client.0.smithi003.stdout:6/70: symlink d4/l16 0 2024-09-21T12:20:27.883 INFO:tasks.workunit.client.0.smithi003.stdout:1/33: mknod d4/cd 0 2024-09-21T12:20:27.884 INFO:tasks.workunit.client.1.smithi192.stdout:6/752: dwrite da/f57 [0,4194304] 0 2024-09-21T12:20:27.886 INFO:tasks.workunit.client.1.smithi192.stdout:4/594: link d2/d36/d7f/f39 d2/d21/fc6 0 2024-09-21T12:20:27.886 INFO:tasks.workunit.client.1.smithi192.stdout:3/558: creat db/d16/d18/d40/d60/fce x:0 0 0 2024-09-21T12:20:27.887 INFO:tasks.workunit.client.1.smithi192.stdout:4/595: fsync d2/df/f17 0 2024-09-21T12:20:27.890 INFO:tasks.workunit.client.0.smithi003.stdout:2/58: creat d0/f14 x:0 0 0 2024-09-21T12:20:27.891 INFO:tasks.workunit.client.1.smithi192.stdout:6/753: dread da/f57 [0,4194304] 0 2024-09-21T12:20:27.892 INFO:tasks.workunit.client.0.smithi003.stdout:5/69: rename l9 to dc/l12 0 2024-09-21T12:20:27.893 INFO:tasks.workunit.client.0.smithi003.stdout:5/70: truncate dc/f10 60669 0 2024-09-21T12:20:27.895 INFO:tasks.workunit.client.0.smithi003.stdout:5/71: write f6 [626073,102804] 0 2024-09-21T12:20:27.895 INFO:tasks.workunit.client.0.smithi003.stdout:6/71: fdatasync d4/d9/f15 0 2024-09-21T12:20:27.896 INFO:tasks.workunit.client.0.smithi003.stdout:1/34: rmdir d4 39 2024-09-21T12:20:27.896 INFO:tasks.workunit.client.0.smithi003.stdout:6/72: read d4/d9/f15 [11579,41949] 0 2024-09-21T12:20:27.899 INFO:tasks.workunit.client.0.smithi003.stdout:9/147: truncate d2/da/f12 7779589 0 2024-09-21T12:20:27.900 INFO:tasks.workunit.client.0.smithi003.stdout:4/35: unlink c0 0 2024-09-21T12:20:27.901 INFO:tasks.workunit.client.1.smithi192.stdout:9/670: truncate d5/d8/d2c/f5d 1167695 0 2024-09-21T12:20:27.902 INFO:tasks.workunit.client.0.smithi003.stdout:3/56: sync 2024-09-21T12:20:27.903 INFO:tasks.workunit.client.0.smithi003.stdout:2/59: fsync d0/f2 0 2024-09-21T12:20:27.906 INFO:tasks.workunit.client.1.smithi192.stdout:3/559: mkdir db/d16/d18/d33/d4a/dcf 0 2024-09-21T12:20:27.906 INFO:tasks.workunit.client.0.smithi003.stdout:5/72: mknod dc/c13 0 2024-09-21T12:20:27.907 INFO:tasks.workunit.client.1.smithi192.stdout:3/560: write db/d16/d18/d33/f43 [53049,37124] 0 2024-09-21T12:20:27.909 INFO:tasks.workunit.client.1.smithi192.stdout:4/596: creat d2/db/d3e/d57/d32/d4f/d71/d9d/dad/d9c/d9e/fc7 x:0 0 0 2024-09-21T12:20:27.910 INFO:tasks.workunit.client.0.smithi003.stdout:1/35: fdatasync d4/f7 0 2024-09-21T12:20:27.911 INFO:tasks.workunit.client.0.smithi003.stdout:5/73: dread f6 [0,4194304] 0 2024-09-21T12:20:27.913 INFO:tasks.workunit.client.1.smithi192.stdout:6/754: creat da/d1f/d48/d7d/d9a/d9e/dbe/fff x:0 0 0 2024-09-21T12:20:27.914 INFO:tasks.workunit.client.0.smithi003.stdout:1/36: dread d4/f8 [0,4194304] 0 2024-09-21T12:20:27.914 INFO:tasks.workunit.client.0.smithi003.stdout:1/37: readlink d4/l5 0 2024-09-21T12:20:27.915 INFO:tasks.workunit.client.0.smithi003.stdout:1/38: fsync d4/f7 0 2024-09-21T12:20:27.916 INFO:tasks.workunit.client.1.smithi192.stdout:5/874: truncate d0/d65/d8e/d98/dba/fd9 3986946 0 2024-09-21T12:20:27.917 INFO:tasks.workunit.client.1.smithi192.stdout:5/875: chown d0/df9 252930671 1 2024-09-21T12:20:27.921 INFO:tasks.workunit.client.0.smithi003.stdout:1/39: dread f2 [0,4194304] 0 2024-09-21T12:20:27.923 INFO:tasks.workunit.client.0.smithi003.stdout:0/70: getdents d9 0 2024-09-21T12:20:27.924 INFO:tasks.workunit.client.0.smithi003.stdout:3/57: creat d0/d5/da/ff x:0 0 0 2024-09-21T12:20:27.925 INFO:tasks.workunit.client.0.smithi003.stdout:9/148: dwrite d2/da/d17/f2c [0,4194304] 0 2024-09-21T12:20:27.926 INFO:tasks.workunit.client.0.smithi003.stdout:9/149: truncate d2/d20/f32 509494 0 2024-09-21T12:20:27.927 INFO:tasks.workunit.client.1.smithi192.stdout:3/561: mkdir db/d16/d18/d21/d23/d71/d77/dcc/d2e/db8/dd0 0 2024-09-21T12:20:27.930 INFO:tasks.workunit.client.0.smithi003.stdout:2/60: symlink d0/l15 0 2024-09-21T12:20:27.932 INFO:tasks.workunit.client.1.smithi192.stdout:0/620: link d3/d5/d28/d39/d50/l53 d3/d5/d69/lb5 0 2024-09-21T12:20:27.935 INFO:tasks.workunit.client.0.smithi003.stdout:5/74: mknod dc/c14 0 2024-09-21T12:20:27.937 INFO:tasks.workunit.client.1.smithi192.stdout:5/876: fsync d0/d65/d6e/d84/d126/f6f 0 2024-09-21T12:20:27.939 INFO:tasks.workunit.client.0.smithi003.stdout:6/73: mkdir d4/d11/d17 0 2024-09-21T12:20:27.940 INFO:tasks.workunit.client.1.smithi192.stdout:4/597: dread d2/db/d34/d56/d83/f95 [0,4194304] 0 2024-09-21T12:20:27.943 INFO:tasks.workunit.client.0.smithi003.stdout:1/40: rename d4/cd to d4/dc/ce 0 2024-09-21T12:20:27.945 INFO:tasks.workunit.client.0.smithi003.stdout:0/71: mkdir d9/d12 0 2024-09-21T12:20:27.947 INFO:tasks.workunit.client.1.smithi192.stdout:4/598: dwrite d2/db/d3e/d57/d32/d4f/d82/fa1 [0,4194304] 0 2024-09-21T12:20:27.948 INFO:tasks.workunit.client.0.smithi003.stdout:3/58: creat d0/d5/f10 x:0 0 0 2024-09-21T12:20:27.949 INFO:tasks.workunit.client.0.smithi003.stdout:3/59: fdatasync d0/d5/f10 0 2024-09-21T12:20:27.949 INFO:tasks.workunit.client.0.smithi003.stdout:9/150: fsync d2/da/d17/f2c 0 2024-09-21T12:20:27.950 INFO:tasks.workunit.client.0.smithi003.stdout:3/60: chown d0/d5/f10 233 1 2024-09-21T12:20:27.951 INFO:tasks.workunit.client.1.smithi192.stdout:0/621: dwrite d3/f93 [0,4194304] 0 2024-09-21T12:20:27.952 INFO:tasks.workunit.client.1.smithi192.stdout:5/877: rename d0/d65/d6e/dc0/d44/d85/d97/d35/fb8 to d0/d65/d6e/d84/d126/d104/f129 0 2024-09-21T12:20:27.954 INFO:tasks.workunit.client.0.smithi003.stdout:2/61: mkdir d0/dd/d16 0 2024-09-21T12:20:27.955 INFO:tasks.workunit.client.1.smithi192.stdout:9/671: getdents d5/dc/d80/d5a 0 2024-09-21T12:20:27.955 INFO:tasks.workunit.client.1.smithi192.stdout:9/672: readlink d5/d8/l7a 0 2024-09-21T12:20:27.956 INFO:tasks.workunit.client.1.smithi192.stdout:9/673: chown d5/dc/d80/d5a 112209517 1 2024-09-21T12:20:27.957 INFO:tasks.workunit.client.1.smithi192.stdout:9/674: write d5/fa [2478029,13901] 0 2024-09-21T12:20:27.958 INFO:tasks.workunit.client.1.smithi192.stdout:9/675: chown d5/dc/d40/fbd 54567 1 2024-09-21T12:20:27.959 INFO:tasks.workunit.client.1.smithi192.stdout:2/620: truncate d1b/d1e/f2f 2271941 0 2024-09-21T12:20:27.959 INFO:tasks.workunit.client.1.smithi192.stdout:9/676: readlink d5/dc/d80/d44/d79/d55/l6a 0 2024-09-21T12:20:27.961 INFO:tasks.workunit.client.0.smithi003.stdout:5/75: mkdir dc/d15 0 2024-09-21T12:20:27.966 INFO:tasks.workunit.client.1.smithi192.stdout:4/599: rename d2/db/da4/dc5 to d2/d36/d55/d89/dc8 0 2024-09-21T12:20:27.969 INFO:tasks.workunit.client.1.smithi192.stdout:5/878: unlink d0/d2/fb2 0 2024-09-21T12:20:27.972 INFO:tasks.workunit.client.0.smithi003.stdout:1/41: mkdir d4/df 0 2024-09-21T12:20:27.974 INFO:tasks.workunit.client.0.smithi003.stdout:3/61: mkdir d0/d5/d9/d11 0 2024-09-21T12:20:27.975 INFO:tasks.workunit.client.0.smithi003.stdout:3/62: truncate d0/d5/f10 142545 0 2024-09-21T12:20:27.976 INFO:tasks.workunit.client.1.smithi192.stdout:2/621: creat d1b/d1e/d5e/d75/d8d/fc6 x:0 0 0 2024-09-21T12:20:27.976 INFO:tasks.workunit.client.0.smithi003.stdout:3/63: read d0/f8 [2585320,25791] 0 2024-09-21T12:20:27.978 INFO:tasks.workunit.client.0.smithi003.stdout:9/151: rename d2/d29/f30 to d2/da/d2a/f33 0 2024-09-21T12:20:27.979 INFO:tasks.workunit.client.1.smithi192.stdout:9/677: dread d5/dc/f68 [0,4194304] 0 2024-09-21T12:20:27.980 INFO:tasks.workunit.client.1.smithi192.stdout:0/622: unlink d3/d5/d69/lb5 0 2024-09-21T12:20:27.980 INFO:tasks.workunit.client.0.smithi003.stdout:3/64: dread d0/f8 [0,4194304] 0 2024-09-21T12:20:27.981 INFO:tasks.workunit.client.0.smithi003.stdout:3/65: stat d0/c1 0 2024-09-21T12:20:27.981 INFO:tasks.workunit.client.1.smithi192.stdout:7/612: truncate d6/d9/d51/f24 1394824 0 2024-09-21T12:20:27.981 INFO:tasks.workunit.client.1.smithi192.stdout:9/678: dread - d5/d8/fa6 zero size 2024-09-21T12:20:27.981 INFO:tasks.workunit.client.1.smithi192.stdout:0/623: fsync d3/d6/d1d/d92/f58 0 2024-09-21T12:20:27.982 INFO:tasks.workunit.client.0.smithi003.stdout:6/74: symlink d4/l18 0 2024-09-21T12:20:27.985 INFO:tasks.workunit.client.0.smithi003.stdout:4/36: link f5 d9/da/fb 0 2024-09-21T12:20:27.986 INFO:tasks.workunit.client.0.smithi003.stdout:8/62: dwrite d7/df/f12 [0,4194304] 0 2024-09-21T12:20:27.988 INFO:tasks.workunit.client.0.smithi003.stdout:1/42: creat d4/dc/f10 x:0 0 0 2024-09-21T12:20:27.988 INFO:tasks.workunit.client.1.smithi192.stdout:5/879: unlink d0/c9a 0 2024-09-21T12:20:27.989 INFO:tasks.workunit.client.0.smithi003.stdout:7/83: truncate d8/db/ff 165675 0 2024-09-21T12:20:27.993 INFO:tasks.workunit.client.1.smithi192.stdout:8/689: mknod d14/d1a/d1d/d46/d4e/ce7 0 2024-09-21T12:20:27.994 INFO:tasks.workunit.client.1.smithi192.stdout:0/624: fdatasync d3/f78 0 2024-09-21T12:20:27.995 INFO:tasks.workunit.client.0.smithi003.stdout:9/152: symlink d2/d20/l34 0 2024-09-21T12:20:27.995 INFO:tasks.workunit.client.1.smithi192.stdout:0/625: dread - d3/f7f zero size 2024-09-21T12:20:28.000 INFO:tasks.workunit.client.0.smithi003.stdout:3/66: unlink d0/f2 0 2024-09-21T12:20:28.000 INFO:tasks.workunit.client.0.smithi003.stdout:3/67: stat d0/d5/d9/dd 0 2024-09-21T12:20:28.007 INFO:tasks.workunit.client.0.smithi003.stdout:1/43: mkdir d4/d11 0 2024-09-21T12:20:28.007 INFO:tasks.workunit.client.1.smithi192.stdout:8/690: dread fd [0,4194304] 0 2024-09-21T12:20:28.009 INFO:tasks.workunit.client.0.smithi003.stdout:7/84: symlink d8/db/l18 0 2024-09-21T12:20:28.009 INFO:tasks.workunit.client.0.smithi003.stdout:1/44: chown f2 30 1 2024-09-21T12:20:28.010 INFO:tasks.workunit.client.1.smithi192.stdout:3/562: mkdir db/d16/d18/d40/dd1 0 2024-09-21T12:20:28.010 INFO:tasks.workunit.client.0.smithi003.stdout:3/68: dwrite d0/d5/da/ff [0,4194304] 0 2024-09-21T12:20:28.011 INFO:tasks.workunit.client.1.smithi192.stdout:9/679: mkdir d5/d8/dc7/dd7 0 2024-09-21T12:20:28.011 INFO:tasks.workunit.client.0.smithi003.stdout:7/85: rename d8 to d8/db/d19 22 2024-09-21T12:20:28.014 INFO:tasks.workunit.client.0.smithi003.stdout:3/69: stat d0/d5/d9 0 2024-09-21T12:20:28.016 INFO:tasks.workunit.client.0.smithi003.stdout:9/153: mkdir d2/da/d35 0 2024-09-21T12:20:28.017 INFO:tasks.workunit.client.0.smithi003.stdout:8/63: dwrite f0 [0,4194304] 0 2024-09-21T12:20:28.018 INFO:tasks.workunit.client.0.smithi003.stdout:5/76: link dc/ce dc/d15/c16 0 2024-09-21T12:20:28.019 INFO:tasks.workunit.client.1.smithi192.stdout:0/626: dwrite d3/de/d9b/fa8 [0,4194304] 0 2024-09-21T12:20:28.020 INFO:tasks.workunit.client.0.smithi003.stdout:7/86: dread d8/f9 [0,4194304] 0 2024-09-21T12:20:28.021 INFO:tasks.workunit.client.1.smithi192.stdout:4/600: rmdir d2/db/d3e/d57/d32/d4f/d71/d9d/dad/d7e 0 2024-09-21T12:20:28.023 INFO:tasks.workunit.client.1.smithi192.stdout:8/691: symlink d14/d1a/d1d/d46/d4e/d83/d8d/dd8/le8 0 2024-09-21T12:20:28.024 INFO:tasks.workunit.client.0.smithi003.stdout:4/37: unlink c1 0 2024-09-21T12:20:28.029 INFO:tasks.workunit.client.1.smithi192.stdout:7/613: link d6/d9/d70/cc7 d6/d20/d69/d90/da7/cd8 0 2024-09-21T12:20:28.030 INFO:tasks.workunit.client.1.smithi192.stdout:7/614: write d6/d9/d2d/d7b/fce [3933609,83504] 0 2024-09-21T12:20:28.031 INFO:tasks.workunit.client.1.smithi192.stdout:0/627: creat d3/fb6 x:0 0 0 2024-09-21T12:20:28.032 INFO:tasks.workunit.client.1.smithi192.stdout:0/628: stat d3/de/l73 0 2024-09-21T12:20:28.034 INFO:tasks.workunit.client.1.smithi192.stdout:0/629: write d3/de/fa9 [741930,2644] 0 2024-09-21T12:20:28.036 INFO:tasks.workunit.client.0.smithi003.stdout:9/154: readlink d2/l1c 0 2024-09-21T12:20:28.037 INFO:tasks.workunit.client.0.smithi003.stdout:9/155: write d2/f18 [4991355,107513] 0 2024-09-21T12:20:28.039 INFO:tasks.workunit.client.1.smithi192.stdout:0/630: dread d3/de/f24 [0,4194304] 0 2024-09-21T12:20:28.041 INFO:tasks.workunit.client.0.smithi003.stdout:5/77: fsync f6 0 2024-09-21T12:20:28.044 INFO:tasks.workunit.client.1.smithi192.stdout:7/615: mkdir d6/d9/d70/d77/dd9 0 2024-09-21T12:20:28.046 INFO:tasks.workunit.client.0.smithi003.stdout:1/45: mkdir d4/df/d12 0 2024-09-21T12:20:28.050 INFO:tasks.workunit.client.1.smithi192.stdout:7/616: dwrite d6/d20/f40 [4194304,4194304] 0 2024-09-21T12:20:28.053 INFO:tasks.workunit.client.1.smithi192.stdout:0/631: rename d3/d5/l29 to d3/d6/d1d/d92/d51/lb7 0 2024-09-21T12:20:28.053 INFO:tasks.workunit.client.0.smithi003.stdout:3/70: getdents d0/d5/d9/d11 0 2024-09-21T12:20:28.054 INFO:tasks.workunit.client.1.smithi192.stdout:0/632: truncate d3/d5/d28/f56 1193581 0 2024-09-21T12:20:28.055 INFO:tasks.workunit.client.1.smithi192.stdout:0/633: chown d3/d6/d1d/d92/d51 17575959 1 2024-09-21T12:20:28.056 INFO:tasks.workunit.client.1.smithi192.stdout:7/617: dwrite d6/d20/f40 [0,4194304] 0 2024-09-21T12:20:28.056 INFO:tasks.workunit.client.0.smithi003.stdout:3/71: write d0/d5/f10 [469373,42672] 0 2024-09-21T12:20:28.058 INFO:tasks.workunit.client.0.smithi003.stdout:3/72: chown d0/d5/f10 21170 1 2024-09-21T12:20:28.059 INFO:tasks.workunit.client.0.smithi003.stdout:9/156: dwrite d2/da/f14 [0,4194304] 0 2024-09-21T12:20:28.061 INFO:tasks.workunit.client.1.smithi192.stdout:4/601: creat d2/fc9 x:0 0 0 2024-09-21T12:20:28.062 INFO:tasks.workunit.client.0.smithi003.stdout:5/78: rmdir dc/d15 39 2024-09-21T12:20:28.063 INFO:tasks.workunit.client.1.smithi192.stdout:6/755: write da/d23/f34 [122558,19815] 0 2024-09-21T12:20:28.064 INFO:tasks.workunit.client.1.smithi192.stdout:6/756: fsync da/d1f/fd3 0 2024-09-21T12:20:28.068 INFO:tasks.workunit.client.1.smithi192.stdout:9/680: getdents d5/dc/d64/dbb/d3d 0 2024-09-21T12:20:28.069 INFO:tasks.workunit.client.1.smithi192.stdout:9/681: write d5/dc/d64/dbb/f31 [3608349,50320] 0 2024-09-21T12:20:28.073 INFO:tasks.workunit.client.0.smithi003.stdout:1/46: creat d4/f13 x:0 0 0 2024-09-21T12:20:28.073 INFO:tasks.workunit.client.0.smithi003.stdout:1/47: readlink d4/l5 0 2024-09-21T12:20:28.074 INFO:tasks.workunit.client.1.smithi192.stdout:5/880: creat d0/d65/d6e/f12a x:0 0 0 2024-09-21T12:20:28.075 INFO:tasks.workunit.client.0.smithi003.stdout:1/48: write d4/f13 [388309,5005] 0 2024-09-21T12:20:28.075 INFO:tasks.workunit.client.0.smithi003.stdout:1/49: stat d4/l5 0 2024-09-21T12:20:28.075 INFO:tasks.workunit.client.0.smithi003.stdout:1/50: stat d4/dc 0 2024-09-21T12:20:28.078 INFO:tasks.workunit.client.1.smithi192.stdout:0/634: rename d3/d5/f77 to d3/d6/d72/d7a/fb8 0 2024-09-21T12:20:28.079 INFO:tasks.workunit.client.1.smithi192.stdout:0/635: read d3/d6/d72/d7a/fb8 [93037,36851] 0 2024-09-21T12:20:28.080 INFO:tasks.workunit.client.0.smithi003.stdout:9/157: mkdir d2/d20/d22/d36 0 2024-09-21T12:20:28.082 INFO:tasks.workunit.client.1.smithi192.stdout:4/602: mknod d2/db/d1a/cca 0 2024-09-21T12:20:28.082 INFO:tasks.workunit.client.1.smithi192.stdout:5/881: dwrite d0/d65/d6e/da7/da0/f11d [0,4194304] 0 2024-09-21T12:20:28.084 INFO:tasks.workunit.client.1.smithi192.stdout:6/757: unlink da/d1f/d48/d7d/daa/cdf 0 2024-09-21T12:20:28.085 INFO:tasks.workunit.client.0.smithi003.stdout:5/79: chown c8 723506 1 2024-09-21T12:20:28.086 INFO:tasks.workunit.client.0.smithi003.stdout:5/80: write dc/f10 [140406,69124] 0 2024-09-21T12:20:28.087 INFO:tasks.workunit.client.1.smithi192.stdout:0/636: dread d3/f93 [0,4194304] 0 2024-09-21T12:20:28.087 INFO:tasks.workunit.client.1.smithi192.stdout:1/649: unlink d2/d12/d2f/d51/d24/f26 0 2024-09-21T12:20:28.087 INFO:tasks.workunit.client.1.smithi192.stdout:6/758: truncate da/d1f/d27/fee 192975 0 2024-09-21T12:20:28.089 INFO:tasks.workunit.client.1.smithi192.stdout:6/759: fdatasync da/d1f/d27/d6b/f7f 0 2024-09-21T12:20:28.090 INFO:tasks.workunit.client.0.smithi003.stdout:6/75: getdents d4/d13 0 2024-09-21T12:20:28.090 INFO:tasks.workunit.client.1.smithi192.stdout:0/637: write d3/de/fa9 [1089966,54264] 0 2024-09-21T12:20:28.090 INFO:tasks.workunit.client.0.smithi003.stdout:5/81: dread dc/f10 [0,4194304] 0 2024-09-21T12:20:28.091 INFO:tasks.workunit.client.0.smithi003.stdout:5/82: fsync dc/f10 0 2024-09-21T12:20:28.091 INFO:tasks.workunit.client.1.smithi192.stdout:6/760: chown da/d1f/d48/d7d/d9a/d9e/fd1 0 1 2024-09-21T12:20:28.092 INFO:tasks.workunit.client.1.smithi192.stdout:6/761: write da/d1f/d48/d7d/daa/fcf [475107,101616] 0 2024-09-21T12:20:28.093 INFO:tasks.workunit.client.1.smithi192.stdout:6/762: write da/d1f/f45 [861580,18137] 0 2024-09-21T12:20:28.095 INFO:tasks.workunit.client.0.smithi003.stdout:1/51: stat d4/dc/ce 0 2024-09-21T12:20:28.098 INFO:tasks.workunit.client.0.smithi003.stdout:3/73: symlink d0/d5/d9/dd/l12 0 2024-09-21T12:20:28.099 INFO:tasks.workunit.client.1.smithi192.stdout:7/618: mkdir d6/d9/d70/dda 0 2024-09-21T12:20:28.099 INFO:tasks.workunit.client.0.smithi003.stdout:3/74: readlink d0/l7 0 2024-09-21T12:20:28.101 INFO:tasks.workunit.client.0.smithi003.stdout:5/83: dwrite dc/f10 [0,4194304] 0 2024-09-21T12:20:28.105 INFO:tasks.workunit.client.0.smithi003.stdout:9/158: dread d2/da/d2a/f33 [0,4194304] 0 2024-09-21T12:20:28.107 INFO:tasks.workunit.client.0.smithi003.stdout:5/84: dread dc/f10 [0,4194304] 0 2024-09-21T12:20:28.109 INFO:tasks.workunit.client.1.smithi192.stdout:5/882: rename d0/d2/d7b to d0/d65/d6e/dc0/d44/d85/d97/d45/d12b 0 2024-09-21T12:20:28.113 INFO:tasks.workunit.client.1.smithi192.stdout:1/650: mknod d2/d4d/cd6 0 2024-09-21T12:20:28.113 INFO:tasks.workunit.client.0.smithi003.stdout:4/38: truncate d9/da/fb 1052921 0 2024-09-21T12:20:28.116 INFO:tasks.workunit.client.0.smithi003.stdout:3/75: mknod d0/d5/c13 0 2024-09-21T12:20:28.117 INFO:tasks.workunit.client.1.smithi192.stdout:4/603: dread d2/d36/d7f/d68/f78 [0,4194304] 0 2024-09-21T12:20:28.117 INFO:tasks.workunit.client.1.smithi192.stdout:2/622: dwrite d1b/d9e/fa9 [0,4194304] 0 2024-09-21T12:20:28.118 INFO:tasks.workunit.client.1.smithi192.stdout:9/682: mkdir d5/dc/d80/d44/d8e/dd6/dd8 0 2024-09-21T12:20:28.118 INFO:tasks.workunit.client.1.smithi192.stdout:2/623: chown d1b/d1e/f2d 5 1 2024-09-21T12:20:28.118 INFO:tasks.workunit.client.1.smithi192.stdout:2/624: readlink d1b/d1e/l46 0 2024-09-21T12:20:28.121 INFO:tasks.workunit.client.0.smithi003.stdout:9/159: readlink d2/da/d17/l19 0 2024-09-21T12:20:28.122 INFO:tasks.workunit.client.1.smithi192.stdout:7/619: mknod d6/d3a/cdb 0 2024-09-21T12:20:28.125 INFO:tasks.workunit.client.0.smithi003.stdout:6/76: getdents d4/d13 0 2024-09-21T12:20:28.126 INFO:tasks.workunit.client.1.smithi192.stdout:2/625: dwrite d1b/f24 [0,4194304] 0 2024-09-21T12:20:28.127 INFO:tasks.workunit.client.0.smithi003.stdout:3/76: dwrite d0/d5/f10 [0,4194304] 0 2024-09-21T12:20:28.127 INFO:tasks.workunit.client.0.smithi003.stdout:3/77: stat d0/l7 0 2024-09-21T12:20:28.128 INFO:tasks.workunit.client.1.smithi192.stdout:0/638: rename d3/d6/c79 to d3/d6/d1d/cb9 0 2024-09-21T12:20:28.129 INFO:tasks.workunit.client.1.smithi192.stdout:0/639: read - d3/de/f94 zero size 2024-09-21T12:20:28.131 INFO:tasks.workunit.client.0.smithi003.stdout:1/52: mkdir d4/d11/d14 0 2024-09-21T12:20:28.135 INFO:tasks.workunit.client.1.smithi192.stdout:1/651: creat d2/d12/d2f/d51/d24/d65/d8b/fd7 x:0 0 0 2024-09-21T12:20:28.136 INFO:tasks.workunit.client.1.smithi192.stdout:4/604: mknod d2/db/d3e/d57/d32/d4f/d71/d9d/dad/d4b/ccb 0 2024-09-21T12:20:28.136 INFO:tasks.workunit.client.0.smithi003.stdout:5/85: mknod dc/c17 0 2024-09-21T12:20:28.136 INFO:tasks.workunit.client.0.smithi003.stdout:5/86: stat dc/cd 0 2024-09-21T12:20:28.138 INFO:tasks.workunit.client.1.smithi192.stdout:8/692: write d14/d18/d94/da4/fc1 [131005,90056] 0 2024-09-21T12:20:28.138 INFO:tasks.workunit.client.1.smithi192.stdout:2/626: dwrite d1b/d38/d53/f6d [0,4194304] 0 2024-09-21T12:20:28.139 INFO:tasks.workunit.client.0.smithi003.stdout:9/160: rename d2/d20/f32 to d2/d20/d22/d36/f37 0 2024-09-21T12:20:28.140 INFO:tasks.workunit.client.0.smithi003.stdout:3/78: rename d0/d5/d9/d11 to d0/d5/d9/d11/d14 22 2024-09-21T12:20:28.140 INFO:tasks.workunit.client.0.smithi003.stdout:9/161: chown d2/l1c 113422655 1 2024-09-21T12:20:28.144 INFO:tasks.workunit.client.1.smithi192.stdout:2/627: dwrite d1b/f4c [0,4194304] 0 2024-09-21T12:20:28.150 INFO:tasks.workunit.client.0.smithi003.stdout:9/162: dwrite d2/f18 [0,4194304] 0 2024-09-21T12:20:28.152 INFO:tasks.workunit.client.0.smithi003.stdout:9/163: write d2/da/d17/f27 [3526646,122902] 0 2024-09-21T12:20:28.152 INFO:tasks.workunit.client.0.smithi003.stdout:1/53: truncate d4/f8 66080 0 2024-09-21T12:20:28.153 INFO:tasks.workunit.client.0.smithi003.stdout:8/64: truncate f4 613761 0 2024-09-21T12:20:28.153 INFO:tasks.workunit.client.0.smithi003.stdout:9/164: stat d2/da/d17 0 2024-09-21T12:20:28.155 INFO:tasks.workunit.client.0.smithi003.stdout:1/54: truncate d4/f13 1331369 0 2024-09-21T12:20:28.156 INFO:tasks.workunit.client.0.smithi003.stdout:1/55: chown d4/d11 0 1 2024-09-21T12:20:28.157 INFO:tasks.workunit.client.0.smithi003.stdout:5/87: fsync dc/f10 0 2024-09-21T12:20:28.157 INFO:tasks.workunit.client.1.smithi192.stdout:1/652: symlink d2/dae/ld8 0 2024-09-21T12:20:28.158 INFO:tasks.workunit.client.0.smithi003.stdout:1/56: fsync d4/dc/f10 0 2024-09-21T12:20:28.161 INFO:tasks.workunit.client.1.smithi192.stdout:4/605: creat d2/db/d34/d56/d6c/fcc x:0 0 0 2024-09-21T12:20:28.161 INFO:tasks.workunit.client.0.smithi003.stdout:9/165: dread d2/d20/f21 [0,4194304] 0 2024-09-21T12:20:28.162 INFO:tasks.workunit.client.1.smithi192.stdout:1/653: dread d2/d12/fbc [0,4194304] 0 2024-09-21T12:20:28.163 INFO:tasks.workunit.client.0.smithi003.stdout:3/79: mknod d0/d5/d9/dd/c15 0 2024-09-21T12:20:28.166 INFO:tasks.workunit.client.0.smithi003.stdout:5/88: dwrite f6 [4194304,4194304] 0 2024-09-21T12:20:28.167 INFO:tasks.workunit.client.0.smithi003.stdout:6/77: getdents d4/d13 0 2024-09-21T12:20:28.168 INFO:tasks.workunit.client.0.smithi003.stdout:5/89: write dc/f10 [1757134,7946] 0 2024-09-21T12:20:28.169 INFO:tasks.workunit.client.1.smithi192.stdout:8/693: dwrite f7 [4194304,4194304] 0 2024-09-21T12:20:28.170 INFO:tasks.workunit.client.1.smithi192.stdout:1/654: dwrite d2/d12/fa5 [0,4194304] 0 2024-09-21T12:20:28.172 INFO:tasks.workunit.client.1.smithi192.stdout:0/640: symlink d3/d5/d69/db2/lba 0 2024-09-21T12:20:28.177 INFO:tasks.workunit.client.1.smithi192.stdout:1/655: truncate d2/da/d89/fc0 1040581 0 2024-09-21T12:20:28.178 INFO:tasks.workunit.client.1.smithi192.stdout:1/656: stat d2/da/d6b/dc8/f69 0 2024-09-21T12:20:28.178 INFO:tasks.workunit.client.1.smithi192.stdout:6/763: link da/f4b da/d23/d37/d75/de2/f100 0 2024-09-21T12:20:28.185 INFO:tasks.workunit.client.0.smithi003.stdout:6/78: mkdir d4/d13/d19 0 2024-09-21T12:20:28.187 INFO:tasks.workunit.client.1.smithi192.stdout:2/628: creat d1b/d1e/d5e/d75/dab/fc7 x:0 0 0 2024-09-21T12:20:28.189 INFO:tasks.workunit.client.1.smithi192.stdout:8/694: rmdir d14/d1a/d1d/d51/d80 39 2024-09-21T12:20:28.189 INFO:tasks.workunit.client.1.smithi192.stdout:8/695: stat d14/d18/c7d 0 2024-09-21T12:20:28.191 INFO:tasks.workunit.client.1.smithi192.stdout:2/629: dread d1b/f4c [0,4194304] 0 2024-09-21T12:20:28.191 INFO:tasks.workunit.client.0.smithi003.stdout:6/79: dread f3 [0,4194304] 0 2024-09-21T12:20:28.192 INFO:tasks.workunit.client.1.smithi192.stdout:0/641: symlink d3/d6/d72/d7a/lbb 0 2024-09-21T12:20:28.193 INFO:tasks.workunit.client.1.smithi192.stdout:0/642: chown d3/d6/d83/d87 95 1 2024-09-21T12:20:28.194 INFO:tasks.workunit.client.1.smithi192.stdout:0/643: write d3/de/d33/f3c [2803564,8656] 0 2024-09-21T12:20:28.195 INFO:tasks.workunit.client.1.smithi192.stdout:6/764: symlink da/d1f/d27/d88/l101 0 2024-09-21T12:20:28.201 INFO:tasks.workunit.client.1.smithi192.stdout:8/696: mkdir d14/d1a/de9 0 2024-09-21T12:20:28.202 INFO:tasks.workunit.client.1.smithi192.stdout:8/697: fdatasync d14/d1a/d1d/d20/d5f/fa3 0 2024-09-21T12:20:28.202 INFO:tasks.workunit.client.1.smithi192.stdout:7/620: write d6/d3a/f88 [408811,265] 0 2024-09-21T12:20:28.203 INFO:tasks.workunit.client.1.smithi192.stdout:4/606: dread d2/d36/f61 [0,4194304] 0 2024-09-21T12:20:28.203 INFO:tasks.workunit.client.1.smithi192.stdout:5/883: truncate d0/d65/d6e/dc0/f102 3474146 0 2024-09-21T12:20:28.204 INFO:tasks.workunit.client.1.smithi192.stdout:5/884: chown d0/cf 651 1 2024-09-21T12:20:28.204 INFO:tasks.workunit.client.1.smithi192.stdout:0/644: mknod d3/de/d33/cbc 0 2024-09-21T12:20:28.204 INFO:tasks.workunit.client.1.smithi192.stdout:6/765: write da/d23/f52 [1945811,1823] 0 2024-09-21T12:20:28.205 INFO:tasks.workunit.client.1.smithi192.stdout:1/657: creat d2/d12/d2f/d51/d24/d65/dd4/fd9 x:0 0 0 2024-09-21T12:20:28.206 INFO:tasks.workunit.client.1.smithi192.stdout:0/645: fsync d3/d6/d72/fa7 0 2024-09-21T12:20:28.214 INFO:tasks.workunit.client.1.smithi192.stdout:5/885: creat d0/d65/d6e/d84/d126/d13/d37/da8/daa/dc5/ddd/d107/f12c x:0 0 0 2024-09-21T12:20:28.216 INFO:tasks.workunit.client.1.smithi192.stdout:7/621: mkdir d6/d20/d69/ddc 0 2024-09-21T12:20:28.218 INFO:tasks.workunit.client.1.smithi192.stdout:2/630: dread ff [0,4194304] 0 2024-09-21T12:20:28.222 INFO:tasks.workunit.client.1.smithi192.stdout:5/886: creat d0/d65/d8e/d98/dba/f12d x:0 0 0 2024-09-21T12:20:28.225 INFO:tasks.workunit.client.1.smithi192.stdout:0/646: dread d3/de/d43/f9a [0,4194304] 0 2024-09-21T12:20:28.225 INFO:tasks.workunit.client.1.smithi192.stdout:7/622: symlink d6/ldd 0 2024-09-21T12:20:28.226 INFO:tasks.workunit.client.1.smithi192.stdout:5/887: dread d0/d65/d6e/d84/d126/d13/d37/da8/daa/dc5/ddd/fde [0,4194304] 0 2024-09-21T12:20:28.227 INFO:tasks.workunit.client.1.smithi192.stdout:6/766: link da/d1f/d56/d73/fb8 da/d1f/d48/d7d/f102 0 2024-09-21T12:20:28.228 INFO:tasks.workunit.client.1.smithi192.stdout:2/631: mknod d1b/d38/cc8 0 2024-09-21T12:20:28.229 INFO:tasks.workunit.client.1.smithi192.stdout:2/632: truncate d1b/d65/f6e 667378 0 2024-09-21T12:20:28.230 INFO:tasks.workunit.client.1.smithi192.stdout:0/647: creat d3/de/d33/fbd x:0 0 0 2024-09-21T12:20:28.231 INFO:tasks.workunit.client.1.smithi192.stdout:0/648: truncate d3/de/d43/f95 60708 0 2024-09-21T12:20:28.231 INFO:tasks.workunit.client.1.smithi192.stdout:5/888: unlink d0/d65/fdf 0 2024-09-21T12:20:28.232 INFO:tasks.workunit.client.1.smithi192.stdout:1/658: getdents d2/d12/d2f/d51/d24/d58 0 2024-09-21T12:20:28.232 INFO:tasks.workunit.client.1.smithi192.stdout:6/767: mkdir da/d23/d37/d75/d90/d103 0 2024-09-21T12:20:28.233 INFO:tasks.workunit.client.1.smithi192.stdout:1/659: fdatasync d2/d12/d2f/d41/d5c/fc9 0 2024-09-21T12:20:28.236 INFO:tasks.workunit.client.0.smithi003.stdout:4/39: truncate f5 740692 0 2024-09-21T12:20:28.236 INFO:tasks.workunit.client.0.smithi003.stdout:5/90: symlink dc/l18 0 2024-09-21T12:20:28.236 INFO:tasks.workunit.client.1.smithi192.stdout:1/660: write d2/d12/d2f/d51/d24/f28 [1905536,17289] 0 2024-09-21T12:20:28.238 INFO:tasks.workunit.client.0.smithi003.stdout:9/166: write d2/da/d2a/f33 [1020452,66794] 0 2024-09-21T12:20:28.239 INFO:tasks.workunit.client.1.smithi192.stdout:0/649: write d3/d5/d28/f64 [491771,100789] 0 2024-09-21T12:20:28.239 INFO:tasks.workunit.client.1.smithi192.stdout:5/889: dwrite d0/d65/d6e/dbc/dc8/f118 [0,4194304] 0 2024-09-21T12:20:28.240 INFO:tasks.workunit.client.0.smithi003.stdout:9/167: truncate d2/f2b 1027106 0 2024-09-21T12:20:28.241 INFO:tasks.workunit.client.1.smithi192.stdout:6/768: mkdir da/d23/d37/d75/de2/d104 0 2024-09-21T12:20:28.243 INFO:tasks.workunit.client.0.smithi003.stdout:5/91: dread dc/f10 [0,4194304] 0 2024-09-21T12:20:28.244 INFO:tasks.workunit.client.0.smithi003.stdout:5/92: chown dc/f10 0 1 2024-09-21T12:20:28.245 INFO:tasks.workunit.client.0.smithi003.stdout:5/93: write dc/f10 [1954331,121958] 0 2024-09-21T12:20:28.246 INFO:tasks.workunit.client.0.smithi003.stdout:4/40: chown f6 6300 1 2024-09-21T12:20:28.248 INFO:tasks.workunit.client.0.smithi003.stdout:6/80: dread d4/fa [0,4194304] 0 2024-09-21T12:20:28.248 INFO:tasks.workunit.client.0.smithi003.stdout:6/81: chown d4/l18 109159 1 2024-09-21T12:20:28.249 INFO:tasks.workunit.client.0.smithi003.stdout:8/65: getdents d7/df 0 2024-09-21T12:20:28.252 INFO:tasks.workunit.client.1.smithi192.stdout:1/661: chown d2/d12/d2f/d51/d24/d65/d5a/f5d 59831260 1 2024-09-21T12:20:28.253 INFO:tasks.workunit.client.1.smithi192.stdout:8/698: truncate d14/d1a/d1d/f49 7164886 0 2024-09-21T12:20:28.255 INFO:tasks.workunit.client.0.smithi003.stdout:9/168: dread d2/d20/f21 [0,4194304] 0 2024-09-21T12:20:28.256 INFO:tasks.workunit.client.0.smithi003.stdout:9/169: rename d2 to d2/da/d17/d38 22 2024-09-21T12:20:28.256 INFO:tasks.workunit.client.1.smithi192.stdout:4/607: dwrite d2/f23 [0,4194304] 0 2024-09-21T12:20:28.257 INFO:tasks.workunit.client.1.smithi192.stdout:0/650: rename d3/d6/d1d to d3/d6/d72/d7a/dbe 0 2024-09-21T12:20:28.258 INFO:tasks.workunit.client.0.smithi003.stdout:5/94: creat dc/d15/f19 x:0 0 0 2024-09-21T12:20:28.262 INFO:tasks.workunit.client.1.smithi192.stdout:4/608: dwrite d2/db/d34/d56/d6c/db8/d88/d92/f9b [0,4194304] 0 2024-09-21T12:20:28.265 INFO:tasks.workunit.client.1.smithi192.stdout:7/623: getdents d6/d9/d70/d77/dcd 0 2024-09-21T12:20:28.265 INFO:tasks.workunit.client.1.smithi192.stdout:4/609: dread d2/db/d3e/d57/d32/d4f/fbd [0,4194304] 0 2024-09-21T12:20:28.267 INFO:tasks.workunit.client.0.smithi003.stdout:8/66: fdatasync d7/f14 0 2024-09-21T12:20:28.269 INFO:tasks.workunit.client.1.smithi192.stdout:5/890: symlink d0/d65/d6e/l12e 0 2024-09-21T12:20:28.270 INFO:tasks.workunit.client.0.smithi003.stdout:0/72: sync 2024-09-21T12:20:28.270 INFO:tasks.workunit.client.0.smithi003.stdout:2/62: sync 2024-09-21T12:20:28.271 INFO:tasks.workunit.client.0.smithi003.stdout:7/87: sync 2024-09-21T12:20:28.271 INFO:tasks.workunit.client.0.smithi003.stdout:0/73: write f0 [3600340,94158] 0 2024-09-21T12:20:28.272 INFO:tasks.workunit.client.0.smithi003.stdout:9/170: creat d2/d20/f39 x:0 0 0 2024-09-21T12:20:28.276 INFO:tasks.workunit.client.1.smithi192.stdout:0/651: mkdir d3/d5/d69/dbf 0 2024-09-21T12:20:28.276 INFO:tasks.workunit.client.1.smithi192.stdout:0/652: chown d3/d5/d28/d39/l55 570 1 2024-09-21T12:20:28.277 INFO:tasks.workunit.client.0.smithi003.stdout:6/82: symlink d4/d11/d17/l1a 0 2024-09-21T12:20:28.279 INFO:tasks.workunit.client.0.smithi003.stdout:0/74: dwrite d9/fd [0,4194304] 0 2024-09-21T12:20:28.280 INFO:tasks.workunit.client.0.smithi003.stdout:8/67: mkdir d7/df/d16 0 2024-09-21T12:20:28.280 INFO:tasks.workunit.client.0.smithi003.stdout:8/68: fdatasync d7/f8 0 2024-09-21T12:20:28.283 INFO:tasks.workunit.client.1.smithi192.stdout:6/769: dwrite da/f95 [0,4194304] 0 2024-09-21T12:20:28.284 INFO:tasks.workunit.client.1.smithi192.stdout:2/633: link fd d1b/d38/fc9 0 2024-09-21T12:20:28.289 INFO:tasks.workunit.client.0.smithi003.stdout:8/69: dwrite f0 [0,4194304] 0 2024-09-21T12:20:28.290 INFO:tasks.workunit.client.0.smithi003.stdout:8/70: stat d7/f8 0 2024-09-21T12:20:28.290 INFO:tasks.workunit.client.1.smithi192.stdout:4/610: creat d2/db/d3e/fcd x:0 0 0 2024-09-21T12:20:28.295 INFO:tasks.workunit.client.1.smithi192.stdout:8/699: dwrite d14/d18/f93 [0,4194304] 0 2024-09-21T12:20:28.296 INFO:tasks.workunit.client.0.smithi003.stdout:6/83: unlink d4/d11/d17/l1a 0 2024-09-21T12:20:28.296 INFO:tasks.workunit.client.1.smithi192.stdout:8/700: stat d14/d1a/d1d/d20/d5f/f68 0 2024-09-21T12:20:28.299 INFO:tasks.workunit.client.1.smithi192.stdout:8/701: readlink d14/d1a/d1d/d46/d4e/d83/d8d/d9c/dd0/d8e/la7 0 2024-09-21T12:20:28.299 INFO:tasks.workunit.client.1.smithi192.stdout:5/891: unlink d0/d65/d8e/ld3 0 2024-09-21T12:20:28.300 INFO:tasks.workunit.client.1.smithi192.stdout:5/892: chown d0/d2/f48 0 1 2024-09-21T12:20:28.302 INFO:tasks.workunit.client.1.smithi192.stdout:1/662: symlink d2/d12/d2f/d51/d24/d65/d5a/lda 0 2024-09-21T12:20:28.303 INFO:tasks.workunit.client.1.smithi192.stdout:1/663: readlink d2/dae/ld8 0 2024-09-21T12:20:28.304 INFO:tasks.workunit.client.1.smithi192.stdout:1/664: truncate d2/d12/d2f/fc2 894493 0 2024-09-21T12:20:28.308 INFO:tasks.workunit.client.1.smithi192.stdout:2/634: mkdir d1b/d1e/d5e/d88/dca 0 2024-09-21T12:20:28.310 INFO:tasks.workunit.client.1.smithi192.stdout:6/770: write da/d23/d37/d75/d90/fdc [898095,104098] 0 2024-09-21T12:20:28.311 INFO:tasks.workunit.client.0.smithi003.stdout:8/71: dread f4 [0,4194304] 0 2024-09-21T12:20:28.312 INFO:tasks.workunit.client.0.smithi003.stdout:8/72: readlink d7/ld 0 2024-09-21T12:20:28.313 INFO:tasks.workunit.client.1.smithi192.stdout:3/563: sync 2024-09-21T12:20:28.313 INFO:tasks.workunit.client.1.smithi192.stdout:9/683: sync 2024-09-21T12:20:28.313 INFO:tasks.workunit.client.0.smithi003.stdout:0/75: creat d9/d12/f13 x:0 0 0 2024-09-21T12:20:28.314 INFO:tasks.workunit.client.1.smithi192.stdout:3/564: readlink db/d16/d18/d21/d23/d71/d77/dcc/lc8 0 2024-09-21T12:20:28.315 INFO:tasks.workunit.client.0.smithi003.stdout:5/95: getdents dc 0 2024-09-21T12:20:28.315 INFO:tasks.workunit.client.1.smithi192.stdout:9/684: truncate d5/dc/d64/dbb/d3d/f54 5146759 0 2024-09-21T12:20:28.315 INFO:tasks.workunit.client.1.smithi192.stdout:8/702: truncate d14/d1a/d1d/d48/f6f 2927254 0 2024-09-21T12:20:28.316 INFO:tasks.workunit.client.1.smithi192.stdout:8/703: stat d14/d18/d7b/cc7 0 2024-09-21T12:20:28.316 INFO:tasks.workunit.client.0.smithi003.stdout:6/84: mknod d4/d13/d19/c1b 0 2024-09-21T12:20:28.317 INFO:tasks.workunit.client.1.smithi192.stdout:1/665: creat d2/d12/d2f/d51/fdb x:0 0 0 2024-09-21T12:20:28.319 INFO:tasks.workunit.client.0.smithi003.stdout:5/96: dread dc/f10 [0,4194304] 0 2024-09-21T12:20:28.320 INFO:tasks.workunit.client.0.smithi003.stdout:6/85: rename d4/l18 to d4/d11/d17/l1c 0 2024-09-21T12:20:28.321 INFO:tasks.workunit.client.1.smithi192.stdout:5/893: dwrite d0/d65/d6e/dc0/d44/d85/d97/fe0 [0,4194304] 0 2024-09-21T12:20:28.322 INFO:tasks.workunit.client.1.smithi192.stdout:7/624: rename d6/d3a/fa8 to d6/fde 0 2024-09-21T12:20:28.323 INFO:tasks.workunit.client.0.smithi003.stdout:8/73: creat d7/df/d16/f17 x:0 0 0 2024-09-21T12:20:28.323 INFO:tasks.workunit.client.1.smithi192.stdout:5/894: dread - d0/d65/d8e/d98/dba/f12d zero size 2024-09-21T12:20:28.324 INFO:tasks.workunit.client.1.smithi192.stdout:4/611: creat d2/d36/d55/d89/da6/fce x:0 0 0 2024-09-21T12:20:28.326 INFO:tasks.workunit.client.0.smithi003.stdout:0/76: truncate f2 607983 0 2024-09-21T12:20:28.328 INFO:tasks.workunit.client.1.smithi192.stdout:6/771: creat da/d1f/d48/d7d/da7/dc8/f105 x:0 0 0 2024-09-21T12:20:28.329 INFO:tasks.workunit.client.0.smithi003.stdout:6/86: dwrite d4/f10 [4194304,4194304] 0 2024-09-21T12:20:28.330 INFO:tasks.workunit.client.0.smithi003.stdout:5/97: creat dc/f1a x:0 0 0 2024-09-21T12:20:28.335 INFO:tasks.workunit.client.0.smithi003.stdout:6/87: dread d4/f10 [0,4194304] 0 2024-09-21T12:20:28.336 INFO:tasks.workunit.client.1.smithi192.stdout:2/635: creat d1b/d38/d7d/fcb x:0 0 0 2024-09-21T12:20:28.337 INFO:tasks.workunit.client.0.smithi003.stdout:6/88: stat l0 0 2024-09-21T12:20:28.338 INFO:tasks.workunit.client.0.smithi003.stdout:8/74: creat d7/f18 x:0 0 0 2024-09-21T12:20:28.340 INFO:tasks.workunit.client.1.smithi192.stdout:1/666: creat d2/d12/d2f/d51/d24/d65/d8e/d9d/db6/fdc x:0 0 0 2024-09-21T12:20:28.341 INFO:tasks.workunit.client.0.smithi003.stdout:9/171: truncate d2/f18 4087150 0 2024-09-21T12:20:28.343 INFO:tasks.workunit.client.0.smithi003.stdout:0/77: creat d9/d12/f14 x:0 0 0 2024-09-21T12:20:28.344 INFO:tasks.workunit.client.0.smithi003.stdout:4/41: dwrite f5 [0,4194304] 0 2024-09-21T12:20:28.348 INFO:tasks.workunit.client.0.smithi003.stdout:8/75: dwrite f0 [0,4194304] 0 2024-09-21T12:20:28.350 INFO:tasks.workunit.client.1.smithi192.stdout:0/653: rename d3/de/d43/f66 to d3/de/d33/dae/db4/fc0 0 2024-09-21T12:20:28.350 INFO:tasks.workunit.client.0.smithi003.stdout:6/89: mkdir d4/d11/d1d 0 2024-09-21T12:20:28.351 INFO:tasks.workunit.client.1.smithi192.stdout:0/654: chown d3/d6/d83/d87/ca4 845787272 1 2024-09-21T12:20:28.352 INFO:tasks.workunit.client.1.smithi192.stdout:0/655: readlink d3/d5/l3a 0 2024-09-21T12:20:28.353 INFO:tasks.workunit.client.1.smithi192.stdout:7/625: creat d6/d20/d69/d90/da7/dc1/fdf x:0 0 0 2024-09-21T12:20:28.355 INFO:tasks.workunit.client.1.smithi192.stdout:7/626: chown d6/d9/f74 82 1 2024-09-21T12:20:28.359 INFO:tasks.workunit.client.1.smithi192.stdout:4/612: mkdir d2/db/d3e/d57/d32/d4f/d71/d9d/dad/d9c/d9e/dcf 0 2024-09-21T12:20:28.360 INFO:tasks.workunit.client.1.smithi192.stdout:4/613: read - d2/db/d34/f94 zero size 2024-09-21T12:20:28.362 INFO:tasks.workunit.client.1.smithi192.stdout:6/772: unlink da/d23/d37/f5f 0 2024-09-21T12:20:28.362 INFO:tasks.workunit.client.1.smithi192.stdout:5/895: dread d0/d65/d8e/d77/f127 [4194304,4194304] 0 2024-09-21T12:20:28.363 INFO:tasks.workunit.client.0.smithi003.stdout:4/42: fdatasync d9/da/fb 0 2024-09-21T12:20:28.365 INFO:tasks.workunit.client.0.smithi003.stdout:0/78: rmdir d9 39 2024-09-21T12:20:28.366 INFO:tasks.workunit.client.1.smithi192.stdout:0/656: dread d3/d6/d72/d7a/dbe/f4d [0,4194304] 0 2024-09-21T12:20:28.369 INFO:tasks.workunit.client.0.smithi003.stdout:4/43: dread d9/da/fb [0,4194304] 0 2024-09-21T12:20:28.377 INFO:tasks.workunit.client.0.smithi003.stdout:9/172: unlink d2/f18 0 2024-09-21T12:20:28.378 INFO:tasks.workunit.client.1.smithi192.stdout:3/565: rename db/d16/d18/d21/d23/d71/d77/dcc to db/d16/d18/d21/d23/dd2 0 2024-09-21T12:20:28.378 INFO:tasks.workunit.client.0.smithi003.stdout:9/173: write d2/da/d17/f2c [2425772,53353] 0 2024-09-21T12:20:28.379 INFO:tasks.workunit.client.0.smithi003.stdout:0/79: chown d9 0 1 2024-09-21T12:20:28.379 INFO:tasks.workunit.client.0.smithi003.stdout:9/174: fdatasync d2/da/d17/f27 0 2024-09-21T12:20:28.380 INFO:tasks.workunit.client.0.smithi003.stdout:0/80: dread - d9/d12/f13 zero size 2024-09-21T12:20:28.381 INFO:tasks.workunit.client.0.smithi003.stdout:0/81: readlink d9/la 0 2024-09-21T12:20:28.381 INFO:tasks.workunit.client.0.smithi003.stdout:9/175: write d2/d20/f39 [988023,90701] 0 2024-09-21T12:20:28.382 INFO:tasks.workunit.client.1.smithi192.stdout:7/627: chown d6/d20/l42 66948371 1 2024-09-21T12:20:28.383 INFO:tasks.workunit.client.0.smithi003.stdout:9/176: write d2/da/d17/f27 [2754960,91932] 0 2024-09-21T12:20:28.384 INFO:tasks.workunit.client.0.smithi003.stdout:4/44: creat d9/fc x:0 0 0 2024-09-21T12:20:28.389 INFO:tasks.workunit.client.1.smithi192.stdout:6/773: stat da/d1f/d27/d6b/cca 0 2024-09-21T12:20:28.391 INFO:tasks.workunit.client.0.smithi003.stdout:5/98: unlink dc/l11 0 2024-09-21T12:20:28.393 INFO:tasks.workunit.client.1.smithi192.stdout:8/704: creat d14/d1a/d1d/d20/d5f/fea x:0 0 0 2024-09-21T12:20:28.395 INFO:tasks.workunit.client.0.smithi003.stdout:0/82: mkdir d9/d12/d15 0 2024-09-21T12:20:28.396 INFO:tasks.workunit.client.1.smithi192.stdout:5/896: mkdir d0/d65/d8e/d12f 0 2024-09-21T12:20:28.397 INFO:tasks.workunit.client.1.smithi192.stdout:1/667: write d2/da/f8f [2472725,103004] 0 2024-09-21T12:20:28.398 INFO:tasks.workunit.client.1.smithi192.stdout:0/657: rmdir d3/de/d33 39 2024-09-21T12:20:28.399 INFO:tasks.workunit.client.1.smithi192.stdout:2/636: symlink d1b/d38/d53/d8b/da0/lcc 0 2024-09-21T12:20:28.400 INFO:tasks.workunit.client.0.smithi003.stdout:6/90: link d4/d13/l14 d4/d11/d1d/l1e 0 2024-09-21T12:20:28.403 INFO:tasks.workunit.client.1.smithi192.stdout:0/658: dwrite d3/d6/d72/d7a/dbe/d92/d51/f82 [0,4194304] 0 2024-09-21T12:20:28.404 INFO:tasks.workunit.client.1.smithi192.stdout:9/685: rename d5/dc/d80/d5a/d83 to d5/d19/dd5/d4d/d6d/dd9 0 2024-09-21T12:20:28.405 INFO:tasks.workunit.client.1.smithi192.stdout:0/659: chown d3/d6/d72/d7a/dbe/d92/d51/f82 2049 1 2024-09-21T12:20:28.406 INFO:tasks.workunit.client.0.smithi003.stdout:4/45: dwrite f8 [0,4194304] 0 2024-09-21T12:20:28.408 INFO:tasks.workunit.client.0.smithi003.stdout:9/177: rename d2/c16 to d2/d20/c3a 0 2024-09-21T12:20:28.408 INFO:tasks.workunit.client.0.smithi003.stdout:5/99: dread dc/f10 [0,4194304] 0 2024-09-21T12:20:28.408 INFO:tasks.workunit.client.0.smithi003.stdout:9/178: chown d2/da/d17/l19 1358 1 2024-09-21T12:20:28.409 INFO:tasks.workunit.client.1.smithi192.stdout:4/614: unlink d2/db/d3e/d57/l3d 0 2024-09-21T12:20:28.410 INFO:tasks.workunit.client.1.smithi192.stdout:4/615: truncate d2/db/d34/f4a 4584818 0 2024-09-21T12:20:28.412 INFO:tasks.workunit.client.0.smithi003.stdout:6/91: mkdir d4/d11/d1f 0 2024-09-21T12:20:28.415 INFO:tasks.workunit.client.1.smithi192.stdout:8/705: write d14/d1a/d1d/d48/f62 [533387,46912] 0 2024-09-21T12:20:28.416 INFO:tasks.workunit.client.1.smithi192.stdout:8/706: dread - d14/d1a/d1d/d39/f3d zero size 2024-09-21T12:20:28.417 INFO:tasks.workunit.client.1.smithi192.stdout:5/897: creat d0/d65/d6e/dc0/d44/d85/d97/d35/f130 x:0 0 0 2024-09-21T12:20:28.418 INFO:tasks.workunit.client.1.smithi192.stdout:1/668: rmdir d2/d12/d2f/d51/d24/d65/d8b 39 2024-09-21T12:20:28.418 INFO:tasks.workunit.client.1.smithi192.stdout:5/898: write d0/d65/d8e/db9/fbe [3065324,105182] 0 2024-09-21T12:20:28.420 INFO:tasks.workunit.client.1.smithi192.stdout:5/899: chown d0/d65/d6e/dc0/d44/d85/f93 1 1 2024-09-21T12:20:28.420 INFO:tasks.workunit.client.0.smithi003.stdout:9/179: creat d2/da/f3b x:0 0 0 2024-09-21T12:20:28.421 INFO:tasks.workunit.client.1.smithi192.stdout:5/900: stat d0/d65/d6e/d84/d126/d13/d37/l109 0 2024-09-21T12:20:28.422 INFO:tasks.workunit.client.1.smithi192.stdout:7/628: rename d6/d9/d1f/d3e/l4a to d6/d9/d70/d77/le0 0 2024-09-21T12:20:28.422 INFO:tasks.workunit.client.0.smithi003.stdout:1/57: sync 2024-09-21T12:20:28.423 INFO:tasks.workunit.client.1.smithi192.stdout:3/566: mkdir db/d16/d18/d21/d23/dd2/d2e/db8/dd0/dd3 0 2024-09-21T12:20:28.423 INFO:tasks.workunit.client.1.smithi192.stdout:5/901: fdatasync d0/d65/d6e/dc0/d44/d85/d97/d45/ffa 0 2024-09-21T12:20:28.424 INFO:tasks.workunit.client.0.smithi003.stdout:1/58: write d4/f13 [2029757,36414] 0 2024-09-21T12:20:28.425 INFO:tasks.workunit.client.0.smithi003.stdout:4/46: link d9/fc d9/da/fd 0 2024-09-21T12:20:28.425 INFO:tasks.workunit.client.0.smithi003.stdout:4/47: stat d9/da 0 2024-09-21T12:20:28.425 INFO:tasks.workunit.client.0.smithi003.stdout:4/48: stat d9/da/fd 0 2024-09-21T12:20:28.425 INFO:tasks.workunit.client.0.smithi003.stdout:5/100: symlink dc/d15/l1b 0 2024-09-21T12:20:28.426 INFO:tasks.workunit.client.1.smithi192.stdout:0/660: dread d3/d6/f5a [0,4194304] 0 2024-09-21T12:20:28.426 INFO:tasks.workunit.client.1.smithi192.stdout:4/616: dread - d2/db/d3e/d57/f9f zero size 2024-09-21T12:20:28.428 INFO:tasks.workunit.client.0.smithi003.stdout:9/180: rename d2/d20/d22/d36 to d2/da/d2a/d3c 0 2024-09-21T12:20:28.429 INFO:tasks.workunit.client.0.smithi003.stdout:4/49: dread d9/da/fb [0,4194304] 0 2024-09-21T12:20:28.430 INFO:tasks.workunit.client.1.smithi192.stdout:6/774: creat da/d1f/d56/da9/dcd/f106 x:0 0 0 2024-09-21T12:20:28.431 INFO:tasks.workunit.client.1.smithi192.stdout:6/775: stat da/d1f/d27/d3e/f99 0 2024-09-21T12:20:28.432 INFO:tasks.workunit.client.1.smithi192.stdout:0/661: dwrite d3/d6/d72/d7a/dbe/d92/d51/f34 [0,4194304] 0 2024-09-21T12:20:28.432 INFO:tasks.workunit.client.1.smithi192.stdout:8/707: chown d14/d1a/d1d/d51/d80/d9a/dba 78 1 2024-09-21T12:20:28.433 INFO:tasks.workunit.client.1.smithi192.stdout:0/662: chown d3/de/d43/l75 163 1 2024-09-21T12:20:28.434 INFO:tasks.workunit.client.0.smithi003.stdout:1/59: symlink d4/d11/l15 0 2024-09-21T12:20:28.437 INFO:tasks.workunit.client.1.smithi192.stdout:1/669: truncate d2/d45/f9c 865555 0 2024-09-21T12:20:28.437 INFO:tasks.workunit.client.0.smithi003.stdout:5/101: mkdir dc/d15/d1c 0 2024-09-21T12:20:28.439 INFO:tasks.workunit.client.0.smithi003.stdout:0/83: getdents d9/d12 0 2024-09-21T12:20:28.440 INFO:tasks.workunit.client.0.smithi003.stdout:9/181: mknod d2/da/d2a/c3d 0 2024-09-21T12:20:28.440 INFO:tasks.workunit.client.0.smithi003.stdout:0/84: write f0 [4499711,26869] 0 2024-09-21T12:20:28.441 INFO:tasks.workunit.client.0.smithi003.stdout:0/85: dread - d9/d12/f14 zero size 2024-09-21T12:20:28.442 INFO:tasks.workunit.client.1.smithi192.stdout:9/686: rename d5/dc/d80/d44/d79/c59 to d5/d19/dd5/d4d/d6d/dd9/db5/cda 0 2024-09-21T12:20:28.443 INFO:tasks.workunit.client.1.smithi192.stdout:1/670: dwrite d2/da/fad [0,4194304] 0 2024-09-21T12:20:28.443 INFO:tasks.workunit.client.0.smithi003.stdout:4/50: mknod d9/ce 0 2024-09-21T12:20:28.444 INFO:tasks.workunit.client.1.smithi192.stdout:1/671: chown d2/d12/d2f/d51/d24/f28 221265024 1 2024-09-21T12:20:28.444 INFO:tasks.workunit.client.1.smithi192.stdout:1/672: chown d2/dae 92 1 2024-09-21T12:20:28.446 INFO:tasks.workunit.client.0.smithi003.stdout:1/60: creat d4/dc/f16 x:0 0 0 2024-09-21T12:20:28.447 INFO:tasks.workunit.client.0.smithi003.stdout:1/61: write d4/dc/f16 [709480,55436] 0 2024-09-21T12:20:28.448 INFO:tasks.workunit.client.0.smithi003.stdout:1/62: dread - d4/fa zero size 2024-09-21T12:20:28.450 INFO:tasks.workunit.client.1.smithi192.stdout:5/902: creat d0/d65/d8e/d98/dba/f131 x:0 0 0 2024-09-21T12:20:28.451 INFO:tasks.workunit.client.1.smithi192.stdout:5/903: fdatasync d0/d65/d6e/f32 0 2024-09-21T12:20:28.454 INFO:tasks.workunit.client.0.smithi003.stdout:0/86: rmdir d9/d12 39 2024-09-21T12:20:28.456 INFO:tasks.workunit.client.1.smithi192.stdout:4/617: mkdir d2/db/d34/d56/d6c/db8/d88/dd0 0 2024-09-21T12:20:28.459 INFO:tasks.workunit.client.1.smithi192.stdout:6/776: mknod da/d1f/d56/d73/c107 0 2024-09-21T12:20:28.460 INFO:tasks.workunit.client.0.smithi003.stdout:5/102: getdents dc/d15/d1c 0 2024-09-21T12:20:28.461 INFO:tasks.workunit.client.0.smithi003.stdout:5/103: read - dc/d15/f19 zero size 2024-09-21T12:20:28.462 INFO:tasks.workunit.client.1.smithi192.stdout:8/708: creat d14/d1a/d1d/d51/d80/d9a/dba/feb x:0 0 0 2024-09-21T12:20:28.462 INFO:tasks.workunit.client.0.smithi003.stdout:5/104: write dc/f1a [743729,45509] 0 2024-09-21T12:20:28.464 INFO:tasks.workunit.client.0.smithi003.stdout:1/63: mknod d4/dc/c17 0 2024-09-21T12:20:28.464 INFO:tasks.workunit.client.0.smithi003.stdout:1/64: chown d4 713475040 1 2024-09-21T12:20:28.465 INFO:tasks.workunit.client.1.smithi192.stdout:0/663: creat d3/d5/d28/d39/d50/fc1 x:0 0 0 2024-09-21T12:20:28.465 INFO:tasks.workunit.client.1.smithi192.stdout:0/664: dread - d3/d5/d69/faf zero size 2024-09-21T12:20:28.467 INFO:tasks.workunit.client.1.smithi192.stdout:2/637: link d1b/f2a d1b/d65/d77/fcd 0 2024-09-21T12:20:28.468 INFO:tasks.workunit.client.1.smithi192.stdout:2/638: readlink d1b/d1e/l26 0 2024-09-21T12:20:28.468 INFO:tasks.workunit.client.0.smithi003.stdout:9/182: rename d2/c1a to d2/da/d35/c3e 0 2024-09-21T12:20:28.474 INFO:tasks.workunit.client.1.smithi192.stdout:9/687: rename d5/dc/d80/d44/f8c to d5/dc/d40/fdb 0 2024-09-21T12:20:28.475 INFO:tasks.workunit.client.1.smithi192.stdout:9/688: chown d5/dc/d40/fbd 5573486 1 2024-09-21T12:20:28.476 INFO:tasks.workunit.client.1.smithi192.stdout:7/629: mknod d6/d9/d70/ce1 0 2024-09-21T12:20:28.476 INFO:tasks.workunit.client.0.smithi003.stdout:9/183: dwrite d2/d20/f39 [0,4194304] 0 2024-09-21T12:20:28.477 INFO:tasks.workunit.client.0.smithi003.stdout:1/65: mknod d4/d11/c18 0 2024-09-21T12:20:28.478 INFO:tasks.workunit.client.0.smithi003.stdout:9/184: chown d2/f10 10180809 1 2024-09-21T12:20:28.479 INFO:tasks.workunit.client.1.smithi192.stdout:1/673: mknod d2/d12/d2f/d41/d5c/d99/cdd 0 2024-09-21T12:20:28.485 INFO:tasks.workunit.client.0.smithi003.stdout:4/51: dwrite d9/da/fd [0,4194304] 0 2024-09-21T12:20:28.487 INFO:tasks.workunit.client.0.smithi003.stdout:0/87: rename d9/d12/f14 to d9/d12/f16 0 2024-09-21T12:20:28.489 INFO:tasks.workunit.client.1.smithi192.stdout:8/709: symlink d14/d1a/d1d/d20/d5f/d8a/lec 0 2024-09-21T12:20:28.491 INFO:tasks.workunit.client.0.smithi003.stdout:1/66: mkdir d4/df/d19 0 2024-09-21T12:20:28.492 INFO:tasks.workunit.client.1.smithi192.stdout:0/665: rmdir d3/d5/d28/d39 39 2024-09-21T12:20:28.497 INFO:tasks.workunit.client.1.smithi192.stdout:4/618: rename d2/db/d1a/db4 to d2/d36/d55/d89/da6/dd1 0 2024-09-21T12:20:28.498 INFO:tasks.workunit.client.1.smithi192.stdout:4/619: write d2/d36/d55/d89/da6/fce [95961,8341] 0 2024-09-21T12:20:28.499 INFO:tasks.workunit.client.0.smithi003.stdout:0/88: dread f4 [0,4194304] 0 2024-09-21T12:20:28.503 INFO:tasks.workunit.client.0.smithi003.stdout:1/67: creat d4/df/f1a x:0 0 0 2024-09-21T12:20:28.504 INFO:tasks.workunit.client.1.smithi192.stdout:1/674: unlink d2/d12/d2f/d51/d24/d65/d8e/lca 0 2024-09-21T12:20:28.504 INFO:tasks.workunit.client.1.smithi192.stdout:9/689: dwrite d5/dc/d40/fdb [0,4194304] 0 2024-09-21T12:20:28.505 INFO:tasks.workunit.client.1.smithi192.stdout:9/690: fdatasync d5/d8/d2c/f4b 0 2024-09-21T12:20:28.506 INFO:tasks.workunit.client.1.smithi192.stdout:1/675: fsync d2/d12/d2f/d51/d24/f28 0 2024-09-21T12:20:28.506 INFO:tasks.workunit.client.0.smithi003.stdout:9/185: unlink d2/d20/c23 0 2024-09-21T12:20:28.507 INFO:tasks.workunit.client.1.smithi192.stdout:1/676: chown d2/d12/d2f/d51/d24/c25 393405 1 2024-09-21T12:20:28.508 INFO:tasks.workunit.client.1.smithi192.stdout:3/567: link db/d16/d18/d21/d23/dd2/d2e/f56 db/d16/db4/d8c/fd4 0 2024-09-21T12:20:28.509 INFO:tasks.workunit.client.0.smithi003.stdout:5/105: getdents dc/d15 0 2024-09-21T12:20:28.510 INFO:tasks.workunit.client.1.smithi192.stdout:5/904: truncate d0/d65/d6e/f92 73699 0 2024-09-21T12:20:28.511 INFO:tasks.workunit.client.1.smithi192.stdout:9/691: dwrite d5/d19/f6b [0,4194304] 0 2024-09-21T12:20:28.512 INFO:tasks.workunit.client.0.smithi003.stdout:0/89: mkdir d9/d12/d17 0 2024-09-21T12:20:28.513 INFO:tasks.workunit.client.1.smithi192.stdout:9/692: dread - d5/dc/d40/dad/f9c zero size 2024-09-21T12:20:28.514 INFO:tasks.workunit.client.1.smithi192.stdout:7/630: write d6/d9/d1f/f37 [1562899,1461] 0 2024-09-21T12:20:28.514 INFO:tasks.workunit.client.0.smithi003.stdout:9/186: mkdir d2/d20/d22/d3f 0 2024-09-21T12:20:28.515 INFO:tasks.workunit.client.0.smithi003.stdout:5/106: mknod dc/d15/c1d 0 2024-09-21T12:20:28.516 INFO:tasks.workunit.client.0.smithi003.stdout:9/187: write d2/da/d17/f2c [2840521,75550] 0 2024-09-21T12:20:28.517 INFO:tasks.workunit.client.0.smithi003.stdout:5/107: chown c8 6 1 2024-09-21T12:20:28.519 INFO:tasks.workunit.client.0.smithi003.stdout:5/108: write dc/d15/f19 [946137,124160] 0 2024-09-21T12:20:28.526 INFO:tasks.workunit.client.0.smithi003.stdout:9/188: mkdir d2/da/d17/d40 0 2024-09-21T12:20:28.528 INFO:tasks.workunit.client.1.smithi192.stdout:6/777: truncate da/d1f/d27/d3e/f67 555778 0 2024-09-21T12:20:28.532 INFO:tasks.workunit.client.1.smithi192.stdout:1/677: symlink d2/d12/d2f/d51/d24/d65/dd4/lde 0 2024-09-21T12:20:28.533 INFO:tasks.workunit.client.1.smithi192.stdout:1/678: dread - d2/da/d6b/dc8/f69 zero size 2024-09-21T12:20:28.534 INFO:tasks.workunit.client.0.smithi003.stdout:9/189: mknod d2/d20/d22/d3f/c41 0 2024-09-21T12:20:28.535 INFO:tasks.workunit.client.1.smithi192.stdout:5/905: unlink d0/d65/d6e/d84/d126/d13/led 0 2024-09-21T12:20:28.537 INFO:tasks.workunit.client.1.smithi192.stdout:9/693: unlink d5/d8/d2c/c52 0 2024-09-21T12:20:28.537 INFO:tasks.workunit.client.0.smithi003.stdout:9/190: write d2/da/d2a/f33 [1696886,63480] 0 2024-09-21T12:20:28.538 INFO:tasks.workunit.client.1.smithi192.stdout:8/710: getdents d14/d1a/de9 0 2024-09-21T12:20:28.538 INFO:tasks.workunit.client.0.smithi003.stdout:0/90: dwrite d9/fb [0,4194304] 0 2024-09-21T12:20:28.539 INFO:tasks.workunit.client.0.smithi003.stdout:5/109: dread dc/d15/f19 [0,4194304] 0 2024-09-21T12:20:28.539 INFO:tasks.workunit.client.1.smithi192.stdout:1/679: dwrite d2/d12/d2f/d51/d24/d65/f53 [0,4194304] 0 2024-09-21T12:20:28.540 INFO:tasks.workunit.client.1.smithi192.stdout:9/694: truncate d5/dc/d80/d5a/f75 4604630 0 2024-09-21T12:20:28.540 INFO:tasks.workunit.client.1.smithi192.stdout:1/680: chown d2/da 31584 1 2024-09-21T12:20:28.542 INFO:tasks.workunit.client.1.smithi192.stdout:2/639: rename d1b/d38/fc9 to d1b/d1e/d5e/d88/d95/d9c/fce 0 2024-09-21T12:20:28.542 INFO:tasks.workunit.client.0.smithi003.stdout:9/191: mkdir d2/d20/d42 0 2024-09-21T12:20:28.543 INFO:tasks.workunit.client.0.smithi003.stdout:5/110: fdatasync dc/f10 0 2024-09-21T12:20:28.547 INFO:tasks.workunit.client.1.smithi192.stdout:3/568: mkdir db/d16/dc1/dd5 0 2024-09-21T12:20:28.548 INFO:tasks.workunit.client.0.smithi003.stdout:9/192: rename d2/d20/l34 to d2/da/d2a/d3c/l43 0 2024-09-21T12:20:28.549 INFO:tasks.workunit.client.1.smithi192.stdout:3/569: write db/d16/d18/d21/d23/dd2/d2e/fc9 [78756,95392] 0 2024-09-21T12:20:28.550 INFO:tasks.workunit.client.0.smithi003.stdout:0/91: creat d9/d12/d17/f18 x:0 0 0 2024-09-21T12:20:28.551 INFO:tasks.workunit.client.1.smithi192.stdout:1/681: dread d2/da/fad [0,4194304] 0 2024-09-21T12:20:28.552 INFO:tasks.workunit.client.1.smithi192.stdout:1/682: fdatasync d2/d12/d2f/d51/fdb 0 2024-09-21T12:20:28.552 INFO:tasks.workunit.client.0.smithi003.stdout:5/111: mknod dc/c1e 0 2024-09-21T12:20:28.553 INFO:tasks.workunit.client.1.smithi192.stdout:3/570: write db/d16/d18/d40/f6e [871823,79634] 0 2024-09-21T12:20:28.553 INFO:tasks.workunit.client.1.smithi192.stdout:7/631: mknod d6/d3a/dba/ce2 0 2024-09-21T12:20:28.558 INFO:tasks.workunit.client.0.smithi003.stdout:0/92: dread f2 [0,4194304] 0 2024-09-21T12:20:28.559 INFO:tasks.workunit.client.0.smithi003.stdout:5/112: creat dc/d15/f1f x:0 0 0 2024-09-21T12:20:28.560 INFO:tasks.workunit.client.1.smithi192.stdout:7/632: dwrite d6/d20/f4d [0,4194304] 0 2024-09-21T12:20:28.561 INFO:tasks.workunit.client.1.smithi192.stdout:4/620: mknod d2/db/d3e/d57/d32/d4f/d71/d9d/dad/d9c/d9e/dcf/cd2 0 2024-09-21T12:20:28.561 INFO:tasks.workunit.client.1.smithi192.stdout:7/633: chown d6/d9/d1f/d3e/d7a/d8a/fbc 15977181 1 2024-09-21T12:20:28.562 INFO:tasks.workunit.client.0.smithi003.stdout:9/193: creat d2/da/d17/d40/f44 x:0 0 0 2024-09-21T12:20:28.564 INFO:tasks.workunit.client.1.smithi192.stdout:0/666: rename d3/d6/d72/d7a/dbe/c49 to d3/d5/d69/db2/cc2 0 2024-09-21T12:20:28.565 INFO:tasks.workunit.client.1.smithi192.stdout:6/778: write da/d1f/d27/fb1 [2520420,95331] 0 2024-09-21T12:20:28.566 INFO:tasks.workunit.client.0.smithi003.stdout:0/93: dwrite d9/fd [0,4194304] 0 2024-09-21T12:20:28.572 INFO:tasks.workunit.client.0.smithi003.stdout:9/194: dwrite d2/f10 [0,4194304] 0 2024-09-21T12:20:28.574 INFO:tasks.workunit.client.0.smithi003.stdout:0/94: creat d9/d12/d17/f19 x:0 0 0 2024-09-21T12:20:28.575 INFO:tasks.workunit.client.0.smithi003.stdout:0/95: read - d9/d12/d17/f18 zero size 2024-09-21T12:20:28.576 INFO:tasks.workunit.client.1.smithi192.stdout:5/906: symlink d0/d65/d6e/d84/d126/l132 0 2024-09-21T12:20:28.576 INFO:tasks.workunit.client.1.smithi192.stdout:6/779: stat da/d23/f34 0 2024-09-21T12:20:28.577 INFO:tasks.workunit.client.1.smithi192.stdout:4/621: dwrite d2/d36/d7f/f4d [0,4194304] 0 2024-09-21T12:20:28.581 INFO:tasks.workunit.client.1.smithi192.stdout:0/667: write d3/d6/d72/d7a/dbe/d92/d51/f82 [2657277,115066] 0 2024-09-21T12:20:28.583 INFO:tasks.workunit.client.0.smithi003.stdout:0/96: unlink d9/cc 0 2024-09-21T12:20:28.584 INFO:tasks.workunit.client.1.smithi192.stdout:0/668: readlink d3/de/l4e 0 2024-09-21T12:20:28.584 INFO:tasks.workunit.client.1.smithi192.stdout:2/640: dread d1b/f3e [0,4194304] 0 2024-09-21T12:20:28.584 INFO:tasks.workunit.client.1.smithi192.stdout:9/695: dread d5/dc/d80/d44/d79/f82 [0,4194304] 0 2024-09-21T12:20:28.585 INFO:tasks.workunit.client.1.smithi192.stdout:4/622: chown d2/db/d3e/d57/d32/d4f/d71/d9d/dad/d4b/f62 7 1 2024-09-21T12:20:28.586 INFO:tasks.workunit.client.1.smithi192.stdout:9/696: fdatasync d5/dc/d80/d44/d79/fb0 0 2024-09-21T12:20:28.588 INFO:tasks.workunit.client.0.smithi003.stdout:9/195: mknod d2/c45 0 2024-09-21T12:20:28.589 INFO:tasks.workunit.client.0.smithi003.stdout:5/113: link dc/cd dc/d15/d1c/c20 0 2024-09-21T12:20:28.590 INFO:tasks.workunit.client.0.smithi003.stdout:9/196: symlink d2/da/l46 0 2024-09-21T12:20:28.591 INFO:tasks.workunit.client.0.smithi003.stdout:5/114: mkdir dc/d15/d21 0 2024-09-21T12:20:28.592 INFO:tasks.workunit.client.0.smithi003.stdout:9/197: symlink d2/d20/d22/l47 0 2024-09-21T12:20:28.593 INFO:tasks.workunit.client.0.smithi003.stdout:5/115: stat dc/c17 0 2024-09-21T12:20:28.596 INFO:tasks.workunit.client.0.smithi003.stdout:9/198: fsync d2/da/f12 0 2024-09-21T12:20:28.597 INFO:tasks.workunit.client.0.smithi003.stdout:5/116: mknod dc/c22 0 2024-09-21T12:20:28.600 INFO:tasks.workunit.client.0.smithi003.stdout:3/80: sync 2024-09-21T12:20:28.601 INFO:tasks.workunit.client.0.smithi003.stdout:3/81: stat d0/d5 0 2024-09-21T12:20:28.601 INFO:tasks.workunit.client.0.smithi003.stdout:5/117: write dc/d15/f19 [999126,80404] 0 2024-09-21T12:20:28.603 INFO:tasks.workunit.client.0.smithi003.stdout:3/82: write d0/d5/da/ff [758901,113975] 0 2024-09-21T12:20:28.609 INFO:tasks.workunit.client.0.smithi003.stdout:3/83: fsync d0/f8 0 2024-09-21T12:20:28.611 INFO:tasks.workunit.client.0.smithi003.stdout:3/84: write d0/d5/f10 [1990340,82748] 0 2024-09-21T12:20:28.612 INFO:tasks.workunit.client.0.smithi003.stdout:5/118: creat dc/d15/d1c/f23 x:0 0 0 2024-09-21T12:20:28.621 INFO:tasks.workunit.client.0.smithi003.stdout:5/119: creat dc/d15/d21/f24 x:0 0 0 2024-09-21T12:20:28.624 INFO:tasks.workunit.client.1.smithi192.stdout:5/907: fdatasync d0/d2/f6b 0 2024-09-21T12:20:28.625 INFO:tasks.workunit.client.0.smithi003.stdout:9/199: dwrite d2/da/f12 [4194304,4194304] 0 2024-09-21T12:20:28.625 INFO:tasks.workunit.client.0.smithi003.stdout:5/120: dread dc/d15/f19 [0,4194304] 0 2024-09-21T12:20:28.629 INFO:tasks.workunit.client.1.smithi192.stdout:8/711: creat d14/d18/fed x:0 0 0 2024-09-21T12:20:28.633 INFO:tasks.workunit.client.1.smithi192.stdout:2/641: mknod d1b/d1e/d5e/d88/d95/ccf 0 2024-09-21T12:20:28.636 INFO:tasks.workunit.client.1.smithi192.stdout:0/669: symlink d3/d6/d72/d7a/dbe/d92/d51/lc3 0 2024-09-21T12:20:28.639 INFO:tasks.workunit.client.0.smithi003.stdout:3/85: dwrite d0/f8 [0,4194304] 0 2024-09-21T12:20:28.640 INFO:tasks.workunit.client.0.smithi003.stdout:3/86: chown d0/d5/f10 0 1 2024-09-21T12:20:28.642 INFO:tasks.workunit.client.1.smithi192.stdout:7/634: mknod d6/d20/dcc/ce3 0 2024-09-21T12:20:28.643 INFO:tasks.workunit.client.0.smithi003.stdout:5/121: getdents dc/d15 0 2024-09-21T12:20:28.645 INFO:tasks.workunit.client.0.smithi003.stdout:5/122: symlink dc/d15/d21/l25 0 2024-09-21T12:20:28.646 INFO:tasks.workunit.client.0.smithi003.stdout:5/123: readlink dc/d15/d21/l25 0 2024-09-21T12:20:28.648 INFO:tasks.workunit.client.1.smithi192.stdout:8/712: rename d14/d1a/d1d/d51 to d14/d1a/d1d/d46/d4e/d83/d8d/d9c/dee 0 2024-09-21T12:20:28.650 INFO:tasks.workunit.client.0.smithi003.stdout:9/200: truncate d2/da/d2a/f33 132920 0 2024-09-21T12:20:28.651 INFO:tasks.workunit.client.0.smithi003.stdout:9/201: readlink d2/da/l46 0 2024-09-21T12:20:28.652 INFO:tasks.workunit.client.0.smithi003.stdout:5/124: mkdir dc/d15/d26 0 2024-09-21T12:20:28.652 INFO:tasks.workunit.client.0.smithi003.stdout:5/125: fdatasync f6 0 2024-09-21T12:20:28.653 INFO:tasks.workunit.client.1.smithi192.stdout:6/780: dwrite da/d1f/d48/d7d/da7/dc8/fd5 [0,4194304] 0 2024-09-21T12:20:28.655 INFO:tasks.workunit.client.0.smithi003.stdout:5/126: mknod dc/d15/c27 0 2024-09-21T12:20:28.656 INFO:tasks.workunit.client.1.smithi192.stdout:3/571: mknod db/d16/d18/d40/d60/d7b/dc0/cd6 0 2024-09-21T12:20:28.656 INFO:tasks.workunit.client.0.smithi003.stdout:5/127: stat dc/d15/c1d 0 2024-09-21T12:20:28.657 INFO:tasks.workunit.client.1.smithi192.stdout:5/908: truncate d0/d65/d8e/d98/dba/fd9 4680581 0 2024-09-21T12:20:28.660 INFO:tasks.workunit.client.1.smithi192.stdout:3/572: chown db/d16/dc1/dd5 117876551 1 2024-09-21T12:20:28.660 INFO:tasks.workunit.client.1.smithi192.stdout:1/683: link d2/d45/l4e d2/d12/d2f/d81/ldf 0 2024-09-21T12:20:28.660 INFO:tasks.workunit.client.1.smithi192.stdout:2/642: dread d1b/d1e/d3d/f4b [0,4194304] 0 2024-09-21T12:20:28.660 INFO:tasks.workunit.client.0.smithi003.stdout:9/202: getdents d2 0 2024-09-21T12:20:28.664 INFO:tasks.workunit.client.0.smithi003.stdout:9/203: dread d2/d20/f39 [0,4194304] 0 2024-09-21T12:20:28.666 INFO:tasks.workunit.client.1.smithi192.stdout:4/623: creat d2/df/fd3 x:0 0 0 2024-09-21T12:20:28.666 INFO:tasks.workunit.client.1.smithi192.stdout:9/697: dwrite d5/d8/d2c/f58 [0,4194304] 0 2024-09-21T12:20:28.667 INFO:tasks.workunit.client.0.smithi003.stdout:5/128: truncate dc/f10 2189731 0 2024-09-21T12:20:28.668 INFO:tasks.workunit.client.1.smithi192.stdout:0/670: dwrite d3/de/d33/f3c [0,4194304] 0 2024-09-21T12:20:28.670 INFO:tasks.workunit.client.1.smithi192.stdout:4/624: read d2/d21/fc6 [796932,102215] 0 2024-09-21T12:20:28.672 INFO:tasks.workunit.client.0.smithi003.stdout:9/204: rmdir d2/da/d2a 39 2024-09-21T12:20:28.672 INFO:tasks.workunit.client.0.smithi003.stdout:9/205: readlink d2/l1c 0 2024-09-21T12:20:28.674 INFO:tasks.workunit.client.1.smithi192.stdout:7/635: mkdir d6/de4 0 2024-09-21T12:20:28.674 INFO:tasks.workunit.client.1.smithi192.stdout:6/781: rename da/d1f/d27/d88/l101 to da/d1f/de6/l108 0 2024-09-21T12:20:28.676 INFO:tasks.workunit.client.0.smithi003.stdout:9/206: dread d2/d20/f21 [0,4194304] 0 2024-09-21T12:20:28.678 INFO:tasks.workunit.client.1.smithi192.stdout:7/636: stat d6/d9/l18 0 2024-09-21T12:20:28.680 INFO:tasks.workunit.client.1.smithi192.stdout:5/909: dwrite d0/d65/d6e/dbc/dc8/f118 [0,4194304] 0 2024-09-21T12:20:28.682 INFO:tasks.workunit.client.1.smithi192.stdout:7/637: fsync d6/d9/d1f/d3e/d7a/d8a/da2/fa5 0 2024-09-21T12:20:28.682 INFO:tasks.workunit.client.1.smithi192.stdout:6/782: truncate da/d23/d37/d75/ff1 285650 0 2024-09-21T12:20:28.683 INFO:tasks.workunit.client.1.smithi192.stdout:5/910: chown d0/d65/d6e/d84/d126/d13/d37 3007 1 2024-09-21T12:20:28.686 INFO:tasks.workunit.client.1.smithi192.stdout:5/911: fsync d0/d65/d6e/f128 0 2024-09-21T12:20:28.686 INFO:tasks.workunit.client.1.smithi192.stdout:7/638: write d6/d9/f2b [4226541,71286] 0 2024-09-21T12:20:28.687 INFO:tasks.workunit.client.0.smithi003.stdout:5/129: getdents dc/d15/d1c 0 2024-09-21T12:20:28.688 INFO:tasks.workunit.client.1.smithi192.stdout:0/671: dwrite d3/de/d33/f3c [0,4194304] 0 2024-09-21T12:20:28.688 INFO:tasks.workunit.client.0.smithi003.stdout:5/130: write dc/d15/d21/f24 [931527,14964] 0 2024-09-21T12:20:28.689 INFO:tasks.workunit.client.1.smithi192.stdout:8/713: dread d14/d1a/d1d/d46/d4e/d83/d8d/fbb [0,4194304] 0 2024-09-21T12:20:28.690 INFO:tasks.workunit.client.1.smithi192.stdout:0/672: write d3/d6/f5b [3132849,22877] 0 2024-09-21T12:20:28.692 INFO:tasks.workunit.client.1.smithi192.stdout:3/573: symlink db/d16/dc1/dd5/ld7 0 2024-09-21T12:20:28.692 INFO:tasks.workunit.client.0.smithi003.stdout:5/131: mkdir dc/d15/d21/d28 0 2024-09-21T12:20:28.694 INFO:tasks.workunit.client.0.smithi003.stdout:5/132: write dc/d15/d21/f24 [1581147,37774] 0 2024-09-21T12:20:28.694 INFO:tasks.workunit.client.1.smithi192.stdout:0/673: dread d3/d6/d72/d7a/dbe/d89/f9d [0,4194304] 0 2024-09-21T12:20:28.697 INFO:tasks.workunit.client.1.smithi192.stdout:5/912: creat d0/d65/d8e/d98/f133 x:0 0 0 2024-09-21T12:20:28.698 INFO:tasks.workunit.client.1.smithi192.stdout:0/674: write d3/d6/d72/d7a/dbe/d92/f58 [1501316,8804] 0 2024-09-21T12:20:28.699 INFO:tasks.workunit.client.1.smithi192.stdout:7/639: write d6/d9/d1f/fd3 [54133,9792] 0 2024-09-21T12:20:28.699 INFO:tasks.workunit.client.0.smithi003.stdout:5/133: creat dc/d15/d1c/f29 x:0 0 0 2024-09-21T12:20:28.701 INFO:tasks.workunit.client.1.smithi192.stdout:5/913: dread d0/d65/d6e/dc0/d44/d85/f93 [0,4194304] 0 2024-09-21T12:20:28.701 INFO:tasks.workunit.client.1.smithi192.stdout:0/675: chown d3/de/d43/f95 13922 1 2024-09-21T12:20:28.701 INFO:tasks.workunit.client.1.smithi192.stdout:4/625: mkdir d2/db/d34/d56/d6c/db8/d88/dd0/dd4 0 2024-09-21T12:20:28.703 INFO:tasks.workunit.client.0.smithi003.stdout:5/134: mknod dc/d15/d1c/c2a 0 2024-09-21T12:20:28.704 INFO:tasks.workunit.client.1.smithi192.stdout:9/698: dread d5/dc/d40/f25 [0,4194304] 0 2024-09-21T12:20:28.709 INFO:tasks.workunit.client.1.smithi192.stdout:1/684: rename d2/da/d6b/dc8/f66 to d2/d12/d2f/d51/d24/d65/fe0 0 2024-09-21T12:20:28.712 INFO:tasks.workunit.client.1.smithi192.stdout:8/714: symlink d14/d1a/d1d/d46/d4e/d83/d8d/d9c/dee/lef 0 2024-09-21T12:20:28.713 INFO:tasks.workunit.client.1.smithi192.stdout:9/699: write d5/dc/d80/d5a/f75 [3841324,13305] 0 2024-09-21T12:20:28.713 INFO:tasks.workunit.client.0.smithi003.stdout:5/135: getdents dc/d15/d1c 0 2024-09-21T12:20:28.714 INFO:tasks.workunit.client.1.smithi192.stdout:6/783: write da/d1f/f4c [2222924,86632] 0 2024-09-21T12:20:28.717 INFO:tasks.workunit.client.1.smithi192.stdout:4/626: mkdir d2/db/dd5 0 2024-09-21T12:20:28.717 INFO:tasks.workunit.client.0.smithi003.stdout:5/136: mkdir dc/d2b 0 2024-09-21T12:20:28.718 INFO:tasks.workunit.client.1.smithi192.stdout:1/685: rmdir d2/d4d 39 2024-09-21T12:20:28.720 INFO:tasks.workunit.client.1.smithi192.stdout:2/643: rename d1b/d1e/d62/db2 to d1b/d1e/d5e/d88/d95/dbe/dd0 0 2024-09-21T12:20:28.720 INFO:tasks.workunit.client.1.smithi192.stdout:4/627: read d2/d21/f38 [87442,30920] 0 2024-09-21T12:20:28.722 INFO:tasks.workunit.client.1.smithi192.stdout:3/574: dwrite db/d16/d18/d33/d3b/fca [0,4194304] 0 2024-09-21T12:20:28.725 INFO:tasks.workunit.client.1.smithi192.stdout:9/700: mknod d5/d19/dd5/cdc 0 2024-09-21T12:20:28.726 INFO:tasks.workunit.client.0.smithi003.stdout:5/137: truncate f6 537426 0 2024-09-21T12:20:28.727 INFO:tasks.workunit.client.1.smithi192.stdout:4/628: write d2/db/d34/d56/d6c/db8/f59 [846156,26271] 0 2024-09-21T12:20:28.727 INFO:tasks.workunit.client.1.smithi192.stdout:6/784: dwrite da/f95 [0,4194304] 0 2024-09-21T12:20:28.731 INFO:tasks.workunit.client.0.smithi003.stdout:5/138: chown dc/d15/c16 23 1 2024-09-21T12:20:28.732 INFO:tasks.workunit.client.1.smithi192.stdout:9/701: write d5/dc/d80/d5a/f75 [394863,40785] 0 2024-09-21T12:20:28.732 INFO:tasks.workunit.client.0.smithi003.stdout:5/139: fsync dc/d15/f1f 0 2024-09-21T12:20:28.733 INFO:tasks.workunit.client.1.smithi192.stdout:7/640: creat d6/d9/d1f/d3e/d7a/d8a/fe5 x:0 0 0 2024-09-21T12:20:28.734 INFO:tasks.workunit.client.1.smithi192.stdout:1/686: dwrite d2/d12/d2f/d81/fab [0,4194304] 0 2024-09-21T12:20:28.737 INFO:tasks.workunit.client.1.smithi192.stdout:0/676: dwrite d3/d6/d72/d7a/dbe/d92/f3e [0,4194304] 0 2024-09-21T12:20:28.738 INFO:tasks.workunit.client.1.smithi192.stdout:0/677: chown d3/de/d33/l8e 1 1 2024-09-21T12:20:28.742 INFO:tasks.workunit.client.1.smithi192.stdout:2/644: creat d1b/d1e/d5e/d88/fd1 x:0 0 0 2024-09-21T12:20:28.742 INFO:tasks.workunit.client.1.smithi192.stdout:3/575: fsync db/d16/d18/fbf 0 2024-09-21T12:20:28.745 INFO:tasks.workunit.client.1.smithi192.stdout:7/641: dwrite d6/d9/d2d/d7b/f97 [0,4194304] 0 2024-09-21T12:20:28.747 INFO:tasks.workunit.client.0.smithi003.stdout:5/140: rename dc/c1e to dc/c2c 0 2024-09-21T12:20:28.749 INFO:tasks.workunit.client.1.smithi192.stdout:2/645: truncate d1b/d1e/d5e/d75/d8d/fb1 251898 0 2024-09-21T12:20:28.752 INFO:tasks.workunit.client.1.smithi192.stdout:5/914: truncate d0/d65/d6e/dc0/d44/d85/d97/d35/ff5 3928188 0 2024-09-21T12:20:28.754 INFO:tasks.workunit.client.1.smithi192.stdout:3/576: dwrite db/d16/d18/d33/d3b/d68/f86 [0,4194304] 0 2024-09-21T12:20:28.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:28 smithi192 ceph-mon[35641]: pgmap v264: 65 pgs: 65 active+clean; 1.2 GiB data, 3.8 GiB used, 533 GiB / 536 GiB avail; 31 MiB/s rd, 158 MiB/s wr, 365 op/s 2024-09-21T12:20:28.758 INFO:tasks.workunit.client.1.smithi192.stdout:2/646: creat d1b/d1e/d5e/d88/d95/dbe/fd2 x:0 0 0 2024-09-21T12:20:28.759 INFO:tasks.workunit.client.1.smithi192.stdout:5/915: write d0/d65/d6e/d84/d126/d13/d37/da8/daa/d101/fe8 [3275162,26621] 0 2024-09-21T12:20:28.759 INFO:tasks.workunit.client.1.smithi192.stdout:9/702: write d5/d19/dd5/d4d/fcf [1794021,50704] 0 2024-09-21T12:20:28.760 INFO:tasks.workunit.client.1.smithi192.stdout:7/642: truncate d6/d20/f48 1375978 0 2024-09-21T12:20:28.762 INFO:tasks.workunit.client.1.smithi192.stdout:9/703: chown d5/d19/dd5/d4d/d6d/fab 616 1 2024-09-21T12:20:28.763 INFO:tasks.workunit.client.1.smithi192.stdout:3/577: creat db/d16/d18/d21/d23/d71/fd8 x:0 0 0 2024-09-21T12:20:28.763 INFO:tasks.workunit.client.1.smithi192.stdout:7/643: write d6/d9/d2d/d7b/fa1 [754654,33329] 0 2024-09-21T12:20:28.766 INFO:tasks.workunit.client.1.smithi192.stdout:2/647: creat d1b/d1e/d62/d99/fd3 x:0 0 0 2024-09-21T12:20:28.766 INFO:tasks.workunit.client.1.smithi192.stdout:9/704: creat d5/dc/d64/dbb/d3d/fdd x:0 0 0 2024-09-21T12:20:28.766 INFO:tasks.workunit.client.1.smithi192.stdout:5/916: mknod d0/d65/d6e/dc0/d44/d85/d97/d45/d12b/da5/c134 0 2024-09-21T12:20:28.767 INFO:tasks.workunit.client.1.smithi192.stdout:3/578: chown db/d16/d18/d40/d60/d7b/dc0 27856411 1 2024-09-21T12:20:28.769 INFO:tasks.workunit.client.1.smithi192.stdout:7/644: unlink d6/d3a/c67 0 2024-09-21T12:20:28.770 INFO:tasks.workunit.client.1.smithi192.stdout:3/579: write db/d16/dc1/fc6 [15751,71144] 0 2024-09-21T12:20:28.771 INFO:tasks.workunit.client.1.smithi192.stdout:5/917: fsync d0/d65/d6e/d84/d126/d13/d37/da8/daa/dc5/ddd/fde 0 2024-09-21T12:20:28.774 INFO:tasks.workunit.client.1.smithi192.stdout:2/648: link d1b/d1e/d3d/f5a d1b/d38/d53/d8b/da7/fd4 0 2024-09-21T12:20:28.775 INFO:tasks.workunit.client.1.smithi192.stdout:9/705: getdents d5/d19/dd5/d4d/d6d/dd9/db5 0 2024-09-21T12:20:28.778 INFO:tasks.workunit.client.1.smithi192.stdout:5/918: rename d0/d65/d6e/da7/da0/ff6 to d0/d65/d6e/dc0/d44/d85/d97/d9e/f135 0 2024-09-21T12:20:28.780 INFO:tasks.workunit.client.1.smithi192.stdout:7/645: dwrite d6/fde [0,4194304] 0 2024-09-21T12:20:28.785 INFO:tasks.workunit.client.1.smithi192.stdout:9/706: mkdir d5/d19/dd5/d4d/dde 0 2024-09-21T12:20:28.786 INFO:tasks.workunit.client.1.smithi192.stdout:6/785: dread da/d23/d37/d75/fda [0,4194304] 0 2024-09-21T12:20:28.787 INFO:tasks.workunit.client.1.smithi192.stdout:8/715: dwrite d14/d18/f33 [0,4194304] 0 2024-09-21T12:20:28.787 INFO:tasks.workunit.client.1.smithi192.stdout:1/687: write d2/d12/f63 [2929796,69124] 0 2024-09-21T12:20:28.791 INFO:tasks.workunit.client.0.smithi003.stdout:5/141: write f6 [56696,90272] 0 2024-09-21T12:20:28.792 INFO:tasks.workunit.client.1.smithi192.stdout:5/919: symlink d0/d65/d6e/d84/d126/d13/d37/da8/daa/de4/l136 0 2024-09-21T12:20:28.792 INFO:tasks.workunit.client.1.smithi192.stdout:7/646: dread d6/fde [0,4194304] 0 2024-09-21T12:20:28.793 INFO:tasks.workunit.client.1.smithi192.stdout:3/580: link db/d16/d18/d21/d23/dd2/c6b db/d16/d18/d33/d4a/cd9 0 2024-09-21T12:20:28.798 INFO:tasks.workunit.client.1.smithi192.stdout:0/678: dread d3/d5/d28/d39/f8a [0,4194304] 0 2024-09-21T12:20:28.798 INFO:tasks.workunit.client.1.smithi192.stdout:3/581: stat db/d16/d18/d40/d60/d7b/l96 0 2024-09-21T12:20:28.802 INFO:tasks.workunit.client.1.smithi192.stdout:1/688: symlink d2/da/d9f/le1 0 2024-09-21T12:20:28.804 INFO:tasks.workunit.client.0.smithi003.stdout:5/142: dread dc/d15/d21/f24 [0,4194304] 0 2024-09-21T12:20:28.804 INFO:tasks.workunit.client.1.smithi192.stdout:7/647: truncate f0 445644 0 2024-09-21T12:20:28.805 INFO:tasks.workunit.client.1.smithi192.stdout:7/648: chown d6/d3a/f46 258 1 2024-09-21T12:20:28.806 INFO:tasks.workunit.client.1.smithi192.stdout:5/920: symlink d0/d65/d6e/d91/l137 0 2024-09-21T12:20:28.810 INFO:tasks.workunit.client.0.smithi003.stdout:5/143: creat dc/d15/d26/f2d x:0 0 0 2024-09-21T12:20:28.813 INFO:tasks.workunit.client.1.smithi192.stdout:0/679: dread d3/d6/d83/d87/fb1 [0,4194304] 0 2024-09-21T12:20:28.813 INFO:tasks.workunit.client.1.smithi192.stdout:6/786: dread da/d23/ffe [0,4194304] 0 2024-09-21T12:20:28.814 INFO:tasks.workunit.client.1.smithi192.stdout:7/649: dwrite d6/d9/d70/d77/f91 [0,4194304] 0 2024-09-21T12:20:28.815 INFO:tasks.workunit.client.1.smithi192.stdout:1/689: fsync d2/d4d/fb8 0 2024-09-21T12:20:28.816 INFO:tasks.workunit.client.1.smithi192.stdout:0/680: write d3/d5/d28/d39/f41 [2072841,118959] 0 2024-09-21T12:20:28.818 INFO:tasks.workunit.client.1.smithi192.stdout:1/690: write d2/d12/d2f/d51/d24/d65/f53 [861048,15503] 0 2024-09-21T12:20:28.819 INFO:tasks.workunit.client.0.smithi003.stdout:5/144: dwrite dc/d15/d26/f2d [0,4194304] 0 2024-09-21T12:20:28.820 INFO:tasks.workunit.client.1.smithi192.stdout:5/921: unlink d0/d65/d6e/f32 0 2024-09-21T12:20:28.820 INFO:tasks.workunit.client.1.smithi192.stdout:1/691: write d2/d45/f9c [1851757,107559] 0 2024-09-21T12:20:28.821 INFO:tasks.workunit.client.0.smithi003.stdout:5/145: dread - dc/d15/d1c/f29 zero size 2024-09-21T12:20:28.822 INFO:tasks.workunit.client.1.smithi192.stdout:5/922: stat d0/d65/d8e/d77/l81 0 2024-09-21T12:20:28.823 INFO:tasks.workunit.client.0.smithi003.stdout:5/146: dread - dc/d15/d1c/f23 zero size 2024-09-21T12:20:28.823 INFO:tasks.workunit.client.1.smithi192.stdout:6/787: dwrite da/d23/d37/f8e [0,4194304] 0 2024-09-21T12:20:28.824 INFO:tasks.workunit.client.1.smithi192.stdout:5/923: write d0/d65/f10c [979733,1880] 0 2024-09-21T12:20:28.825 INFO:tasks.workunit.client.0.smithi003.stdout:5/147: write dc/d15/d1c/f29 [581378,103552] 0 2024-09-21T12:20:28.826 INFO:tasks.workunit.client.1.smithi192.stdout:5/924: dread - d0/d65/d8e/db9/f10d zero size 2024-09-21T12:20:28.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:28 smithi003 ceph-mon[28057]: pgmap v264: 65 pgs: 65 active+clean; 1.2 GiB data, 3.8 GiB used, 533 GiB / 536 GiB avail; 31 MiB/s rd, 158 MiB/s wr, 365 op/s 2024-09-21T12:20:28.831 INFO:tasks.workunit.client.1.smithi192.stdout:2/649: truncate d1b/d1e/f69 2399734 0 2024-09-21T12:20:28.833 INFO:tasks.workunit.client.1.smithi192.stdout:3/582: rename db/la6 to db/d16/d18/d33/d3b/lda 0 2024-09-21T12:20:28.835 INFO:tasks.workunit.client.1.smithi192.stdout:3/583: chown db/d16/d18/d21/l49 649385 1 2024-09-21T12:20:28.837 INFO:tasks.workunit.client.1.smithi192.stdout:0/681: mkdir d3/d5/d28/dc4 0 2024-09-21T12:20:28.837 INFO:tasks.workunit.client.1.smithi192.stdout:5/925: dwrite d0/d65/d6e/dbc/dc8/f118 [0,4194304] 0 2024-09-21T12:20:28.838 INFO:tasks.workunit.client.1.smithi192.stdout:0/682: read - d3/de/f94 zero size 2024-09-21T12:20:28.838 INFO:tasks.workunit.client.1.smithi192.stdout:2/650: creat d1b/d1e/d5e/d88/fd5 x:0 0 0 2024-09-21T12:20:28.840 INFO:tasks.workunit.client.1.smithi192.stdout:5/926: fdatasync d0/d65/d6e/dc0/d44/d85/fa6 0 2024-09-21T12:20:28.844 INFO:tasks.workunit.client.1.smithi192.stdout:1/692: link d2/d4d/c7a d2/d12/d2f/d51/d24/d65/dd4/ce2 0 2024-09-21T12:20:28.845 INFO:tasks.workunit.client.1.smithi192.stdout:8/716: write d14/d18/d94/dc3/fcc [1236468,116352] 0 2024-09-21T12:20:28.846 INFO:tasks.workunit.client.1.smithi192.stdout:9/707: truncate d5/d19/f6b 2383233 0 2024-09-21T12:20:28.849 INFO:tasks.workunit.client.1.smithi192.stdout:9/708: write d5/d8/f2d [2856127,53751] 0 2024-09-21T12:20:28.851 INFO:tasks.workunit.client.1.smithi192.stdout:2/651: unlink fe 0 2024-09-21T12:20:28.852 INFO:tasks.workunit.client.1.smithi192.stdout:6/788: getdents da/d1f/d56/d73 0 2024-09-21T12:20:28.853 INFO:tasks.workunit.client.1.smithi192.stdout:1/693: unlink d2/d45/lc1 0 2024-09-21T12:20:28.853 INFO:tasks.workunit.client.1.smithi192.stdout:3/584: dwrite db/d16/d18/d21/d23/dd2/d2e/f45 [4194304,4194304] 0 2024-09-21T12:20:28.857 INFO:tasks.workunit.client.1.smithi192.stdout:0/683: rename d3/d6/d72/d7a/dbe/d92/d51/lb7 to d3/d6/d72/d7a/dbe/d92/lc5 0 2024-09-21T12:20:28.861 INFO:tasks.workunit.client.0.smithi003.stdout:2/63: sync 2024-09-21T12:20:28.864 INFO:tasks.workunit.client.1.smithi192.stdout:3/585: creat db/d16/d18/d21/d23/d71/fdb x:0 0 0 2024-09-21T12:20:28.864 INFO:tasks.workunit.client.1.smithi192.stdout:7/650: dwrite d6/d9/d1f/d3e/f60 [0,4194304] 0 2024-09-21T12:20:28.866 INFO:tasks.workunit.client.1.smithi192.stdout:3/586: stat db/d16/dc1/dd5 0 2024-09-21T12:20:28.868 INFO:tasks.workunit.client.0.smithi003.stdout:2/64: dwrite d0/f10 [0,4194304] 0 2024-09-21T12:20:28.870 INFO:tasks.workunit.client.1.smithi192.stdout:6/789: getdents da/d1f/d48/dfa 0 2024-09-21T12:20:28.871 INFO:tasks.workunit.client.1.smithi192.stdout:5/927: dread d0/d65/d8e/d98/fd4 [0,4194304] 0 2024-09-21T12:20:28.877 INFO:tasks.workunit.client.0.smithi003.stdout:2/65: dwrite d0/fc [0,4194304] 0 2024-09-21T12:20:28.877 INFO:tasks.workunit.client.1.smithi192.stdout:3/587: mknod db/d16/d18/d21/d23/dd2/d2e/db8/cdc 0 2024-09-21T12:20:28.878 INFO:tasks.workunit.client.1.smithi192.stdout:8/717: dread d14/d18/d94/da4/fd1 [0,4194304] 0 2024-09-21T12:20:28.880 INFO:tasks.workunit.client.1.smithi192.stdout:6/790: creat da/d1f/de6/f109 x:0 0 0 2024-09-21T12:20:28.882 INFO:tasks.workunit.client.1.smithi192.stdout:1/694: link d2/d4d/c52 d2/d12/d2f/d41/ce3 0 2024-09-21T12:20:28.883 INFO:tasks.workunit.client.1.smithi192.stdout:9/709: truncate d5/d8/d2c/f58 2806965 0 2024-09-21T12:20:28.884 INFO:tasks.workunit.client.0.smithi003.stdout:2/66: truncate d0/f13 3444925 0 2024-09-21T12:20:28.885 INFO:tasks.workunit.client.1.smithi192.stdout:5/928: creat d0/d65/d6e/d84/d126/d13/d37/da8/f138 x:0 0 0 2024-09-21T12:20:28.886 INFO:tasks.workunit.client.1.smithi192.stdout:6/791: dread da/d1f/d27/f71 [0,4194304] 0 2024-09-21T12:20:28.886 INFO:tasks.workunit.client.1.smithi192.stdout:0/684: rename d3/d6 to d3/de/dc6 0 2024-09-21T12:20:28.888 INFO:tasks.workunit.client.0.smithi003.stdout:2/67: rename d0/lb to d0/dd/l17 0 2024-09-21T12:20:28.890 INFO:tasks.workunit.client.1.smithi192.stdout:7/651: write d6/d9/d1f/d3e/fa0 [612667,72582] 0 2024-09-21T12:20:28.890 INFO:tasks.workunit.client.1.smithi192.stdout:2/652: link d1b/d38/l6f d1b/d1e/d5e/d75/dab/ld6 0 2024-09-21T12:20:28.891 INFO:tasks.workunit.client.1.smithi192.stdout:7/652: fsync d6/d9/d1f/d3e/f60 0 2024-09-21T12:20:28.891 INFO:tasks.workunit.client.1.smithi192.stdout:3/588: truncate db/d16/d18/d33/d3b/f58 985362 0 2024-09-21T12:20:28.893 INFO:tasks.workunit.client.0.smithi003.stdout:2/68: dread d0/f2 [0,4194304] 0 2024-09-21T12:20:28.894 INFO:tasks.workunit.client.1.smithi192.stdout:0/685: unlink d3/c1c 0 2024-09-21T12:20:28.895 INFO:tasks.workunit.client.1.smithi192.stdout:0/686: dread - d3/de/dc6/d83/f8b zero size 2024-09-21T12:20:28.895 INFO:tasks.workunit.client.1.smithi192.stdout:6/792: rename da/d23/d37/d75/de2/dec/ff0 to da/d23/d37/d75/dd0/f10a 0 2024-09-21T12:20:28.896 INFO:tasks.workunit.client.1.smithi192.stdout:8/718: creat d14/d1a/d1d/d48/dac/ff0 x:0 0 0 2024-09-21T12:20:28.897 INFO:tasks.workunit.client.0.smithi003.stdout:2/69: link d0/ff d0/f18 0 2024-09-21T12:20:28.899 INFO:tasks.workunit.client.1.smithi192.stdout:2/653: mknod d1b/d38/d53/d8b/da7/dbb/cd7 0 2024-09-21T12:20:28.900 INFO:tasks.workunit.client.1.smithi192.stdout:2/654: write f19 [3494353,46334] 0 2024-09-21T12:20:28.901 INFO:tasks.workunit.client.0.smithi003.stdout:2/70: write d0/dd/f12 [873106,55206] 0 2024-09-21T12:20:28.902 INFO:tasks.workunit.client.1.smithi192.stdout:7/653: rename d6/d9/d2d/d7b/fa1 to d6/d3a/fe6 0 2024-09-21T12:20:28.903 INFO:tasks.workunit.client.1.smithi192.stdout:7/654: write d6/d9/d1f/fd3 [383308,104740] 0 2024-09-21T12:20:28.904 INFO:tasks.workunit.client.1.smithi192.stdout:7/655: chown d6/d20/d69/d90/da7/lc2 86068124 1 2024-09-21T12:20:28.905 INFO:tasks.workunit.client.1.smithi192.stdout:7/656: chown d6/d3a/f3f 13451 1 2024-09-21T12:20:28.906 INFO:tasks.workunit.client.1.smithi192.stdout:0/687: creat d3/de/dc6/d83/fc7 x:0 0 0 2024-09-21T12:20:28.906 INFO:tasks.workunit.client.0.smithi003.stdout:2/71: creat d0/dd/d16/f19 x:0 0 0 2024-09-21T12:20:28.907 INFO:tasks.workunit.client.1.smithi192.stdout:0/688: write d3/d5/d28/f64 [1616876,90804] 0 2024-09-21T12:20:28.908 INFO:tasks.workunit.client.1.smithi192.stdout:6/793: mkdir da/d1f/d48/d7d/d9a/d9e/d10b 0 2024-09-21T12:20:28.910 INFO:tasks.workunit.client.1.smithi192.stdout:8/719: chown d14/d18/daf/ld3 45014 1 2024-09-21T12:20:28.913 INFO:tasks.workunit.client.1.smithi192.stdout:1/695: creat d2/d12/fe4 x:0 0 0 2024-09-21T12:20:28.914 INFO:tasks.workunit.client.1.smithi192.stdout:7/657: dwrite d6/d3a/f3f [0,4194304] 0 2024-09-21T12:20:28.916 INFO:tasks.workunit.client.0.smithi003.stdout:2/72: rename d0/l9 to d0/l1a 0 2024-09-21T12:20:28.921 INFO:tasks.workunit.client.0.smithi003.stdout:2/73: rename d0/dd/f11 to d0/dd/f1b 0 2024-09-21T12:20:28.922 INFO:tasks.workunit.client.1.smithi192.stdout:6/794: dwrite da/d1f/d27/d3e/fe4 [0,4194304] 0 2024-09-21T12:20:28.923 INFO:tasks.workunit.client.0.smithi003.stdout:2/74: mkdir d0/d1c 0 2024-09-21T12:20:28.924 INFO:tasks.workunit.client.1.smithi192.stdout:8/720: dwrite d14/d18/f93 [4194304,4194304] 0 2024-09-21T12:20:28.928 INFO:tasks.workunit.client.1.smithi192.stdout:0/689: write d3/de/dc6/d72/d7a/fb8 [1432298,93666] 0 2024-09-21T12:20:28.930 INFO:tasks.workunit.client.1.smithi192.stdout:0/690: fsync d3/de/d43/f95 0 2024-09-21T12:20:28.932 INFO:tasks.workunit.client.1.smithi192.stdout:7/658: write d6/d9/d2d/fae [601471,31991] 0 2024-09-21T12:20:28.933 INFO:tasks.workunit.client.1.smithi192.stdout:6/795: dread da/d1f/d48/f5e [0,4194304] 0 2024-09-21T12:20:28.933 INFO:tasks.workunit.client.1.smithi192.stdout:9/710: getdents d5/dc/d80/d44/d79/d55/d70/da0 0 2024-09-21T12:20:28.934 INFO:tasks.workunit.client.1.smithi192.stdout:7/659: write d6/d3a/f46 [605100,45042] 0 2024-09-21T12:20:28.936 INFO:tasks.workunit.client.1.smithi192.stdout:6/796: chown da/d1f/d56/f83 18578252 1 2024-09-21T12:20:28.938 INFO:tasks.workunit.client.1.smithi192.stdout:5/929: truncate d0/d65/d6e/dc0/d44/d85/d97/d9e/f135 238450 0 2024-09-21T12:20:28.938 INFO:tasks.workunit.client.1.smithi192.stdout:6/797: chown da/d1f/d48/d7d/fbf 14290005 1 2024-09-21T12:20:28.940 INFO:tasks.workunit.client.1.smithi192.stdout:1/696: symlink d2/d12/le5 0 2024-09-21T12:20:28.942 INFO:tasks.workunit.client.1.smithi192.stdout:6/798: fsync da/d1f/d48/d7d/da7/dc8/f105 0 2024-09-21T12:20:28.943 INFO:tasks.workunit.client.1.smithi192.stdout:1/697: write d2/d12/d2f/d51/d24/f35 [2045384,101107] 0 2024-09-21T12:20:28.945 INFO:tasks.workunit.client.1.smithi192.stdout:7/660: dwrite d6/d9/d70/d77/f91 [0,4194304] 0 2024-09-21T12:20:28.945 INFO:tasks.workunit.client.1.smithi192.stdout:7/661: chown d6/d3a/c8b 153 1 2024-09-21T12:20:28.946 INFO:tasks.workunit.client.0.smithi003.stdout:2/75: dread - d0/dd/f1b zero size 2024-09-21T12:20:28.948 INFO:tasks.workunit.client.0.smithi003.stdout:2/76: chown d0/l1a 74 1 2024-09-21T12:20:28.949 INFO:tasks.workunit.client.1.smithi192.stdout:9/711: dread d5/dc/f76 [0,4194304] 0 2024-09-21T12:20:28.954 INFO:tasks.workunit.client.1.smithi192.stdout:2/655: write d1b/d38/d53/d8b/da7/fd4 [144312,96258] 0 2024-09-21T12:20:28.954 INFO:tasks.workunit.client.0.smithi003.stdout:2/77: creat d0/f1d x:0 0 0 2024-09-21T12:20:28.956 INFO:tasks.workunit.client.1.smithi192.stdout:8/721: rename f8 to d14/d1a/d1d/d46/d4e/d83/d8d/d9c/dee/ff1 0 2024-09-21T12:20:28.958 INFO:tasks.workunit.client.0.smithi003.stdout:2/78: mknod d0/d1c/c1e 0 2024-09-21T12:20:28.967 INFO:tasks.workunit.client.0.smithi003.stdout:2/79: write d0/ff [1857182,128631] 0 2024-09-21T12:20:28.974 INFO:tasks.workunit.client.0.smithi003.stdout:2/80: dwrite d0/f10 [0,4194304] 0 2024-09-21T12:20:28.981 INFO:tasks.workunit.client.1.smithi192.stdout:4/629: sync 2024-09-21T12:20:28.986 INFO:tasks.workunit.client.0.smithi003.stdout:3/87: sync 2024-09-21T12:20:28.986 INFO:tasks.workunit.client.0.smithi003.stdout:4/52: sync 2024-09-21T12:20:28.986 INFO:tasks.workunit.client.0.smithi003.stdout:7/88: sync 2024-09-21T12:20:28.986 INFO:tasks.workunit.client.0.smithi003.stdout:9/207: sync 2024-09-21T12:20:28.986 INFO:tasks.workunit.client.0.smithi003.stdout:0/97: sync 2024-09-21T12:20:28.986 INFO:tasks.workunit.client.0.smithi003.stdout:6/92: sync 2024-09-21T12:20:28.986 INFO:tasks.workunit.client.0.smithi003.stdout:1/68: sync 2024-09-21T12:20:28.986 INFO:tasks.workunit.client.0.smithi003.stdout:8/76: sync 2024-09-21T12:20:28.989 INFO:tasks.workunit.client.0.smithi003.stdout:8/77: read d7/df/f12 [1299292,1327] 0 2024-09-21T12:20:28.989 INFO:tasks.workunit.client.0.smithi003.stdout:9/208: chown d2/c13 896 1 2024-09-21T12:20:28.990 INFO:tasks.workunit.client.0.smithi003.stdout:1/69: mknod d4/c1b 0 2024-09-21T12:20:28.990 INFO:tasks.workunit.client.1.smithi192.stdout:5/930: symlink d0/d65/d6e/dc0/l139 0 2024-09-21T12:20:28.990 INFO:tasks.workunit.client.1.smithi192.stdout:0/691: rmdir d3/d5/d28/dc4 0 2024-09-21T12:20:28.991 INFO:tasks.workunit.client.0.smithi003.stdout:0/98: symlink d9/l1a 0 2024-09-21T12:20:28.991 INFO:tasks.workunit.client.1.smithi192.stdout:4/630: dread - d2/d36/d7f/fbb zero size 2024-09-21T12:20:28.991 INFO:tasks.workunit.client.1.smithi192.stdout:1/698: write d2/d12/fbc [3075863,76731] 0 2024-09-21T12:20:28.993 INFO:tasks.workunit.client.1.smithi192.stdout:8/722: creat d14/d18/d94/ff2 x:0 0 0 2024-09-21T12:20:28.994 INFO:tasks.workunit.client.1.smithi192.stdout:1/699: dread - d2/d12/d2f/d41/fb0 zero size 2024-09-21T12:20:28.995 INFO:tasks.workunit.client.1.smithi192.stdout:8/723: fsync d14/d1a/d1d/d39/f3e 0 2024-09-21T12:20:28.997 INFO:tasks.workunit.client.0.smithi003.stdout:3/88: rename d0/f8 to d0/f16 0 2024-09-21T12:20:28.998 INFO:tasks.workunit.client.1.smithi192.stdout:9/712: dwrite d5/dc/f68 [0,4194304] 0 2024-09-21T12:20:28.998 INFO:tasks.workunit.client.1.smithi192.stdout:8/724: write d14/d1a/d1d/d48/f62 [3696457,13009] 0 2024-09-21T12:20:28.998 INFO:tasks.workunit.client.0.smithi003.stdout:7/89: creat d8/db/d13/f1a x:0 0 0 2024-09-21T12:20:29.000 INFO:tasks.workunit.client.1.smithi192.stdout:4/631: truncate d2/db/d3e/d57/d32/d4f/d71/d9d/dad/d9c/d9e/fc7 914646 0 2024-09-21T12:20:29.000 INFO:tasks.workunit.client.1.smithi192.stdout:9/713: write d5/dc/d80/d44/f90 [4676484,56604] 0 2024-09-21T12:20:29.001 INFO:tasks.workunit.client.0.smithi003.stdout:8/78: creat d7/de/f19 x:0 0 0 2024-09-21T12:20:29.002 INFO:tasks.workunit.client.0.smithi003.stdout:3/89: dread d0/d5/d9/fe [0,4194304] 0 2024-09-21T12:20:29.003 INFO:tasks.workunit.client.1.smithi192.stdout:2/656: link d1b/d1e/l26 d1b/d1e/d7b/ld8 0 2024-09-21T12:20:29.003 INFO:tasks.workunit.client.0.smithi003.stdout:9/209: mknod d2/da/d17/c48 0 2024-09-21T12:20:29.003 INFO:tasks.workunit.client.0.smithi003.stdout:3/90: stat d0/c1 0 2024-09-21T12:20:29.005 INFO:tasks.workunit.client.0.smithi003.stdout:1/70: creat d4/dc/f1c x:0 0 0 2024-09-21T12:20:29.006 INFO:tasks.workunit.client.1.smithi192.stdout:1/700: symlink d2/da/d6b/le6 0 2024-09-21T12:20:29.010 INFO:tasks.workunit.client.0.smithi003.stdout:4/53: link d9/fc d9/da/ff 0 2024-09-21T12:20:29.011 INFO:tasks.workunit.client.0.smithi003.stdout:7/90: dwrite d8/fa [0,4194304] 0 2024-09-21T12:20:29.011 INFO:tasks.workunit.client.0.smithi003.stdout:4/54: read d9/da/fd [1898277,80620] 0 2024-09-21T12:20:29.013 INFO:tasks.workunit.client.1.smithi192.stdout:8/725: creat d14/d18/d94/dc3/ff3 x:0 0 0 2024-09-21T12:20:29.013 INFO:tasks.workunit.client.0.smithi003.stdout:4/55: chown d9/da/ff 116 1 2024-09-21T12:20:29.015 INFO:tasks.workunit.client.0.smithi003.stdout:6/93: truncate d4/fe 3735472 0 2024-09-21T12:20:29.016 INFO:tasks.workunit.client.0.smithi003.stdout:6/94: write d4/fb [1068616,15258] 0 2024-09-21T12:20:29.020 INFO:tasks.workunit.client.1.smithi192.stdout:4/632: dread d2/d36/d55/f60 [0,4194304] 0 2024-09-21T12:20:29.020 INFO:tasks.workunit.client.0.smithi003.stdout:8/79: mkdir d7/de/d1a 0 2024-09-21T12:20:29.025 INFO:tasks.workunit.client.1.smithi192.stdout:9/714: dwrite d5/f7 [4194304,4194304] 0 2024-09-21T12:20:29.025 INFO:tasks.workunit.client.0.smithi003.stdout:0/99: creat d9/d12/d15/f1b x:0 0 0 2024-09-21T12:20:29.026 INFO:tasks.workunit.client.1.smithi192.stdout:2/657: dread d1b/d38/f4d [0,4194304] 0 2024-09-21T12:20:29.026 INFO:tasks.workunit.client.1.smithi192.stdout:9/715: fdatasync d5/dc/d40/dad/d53/d6e/faa 0 2024-09-21T12:20:29.027 INFO:tasks.workunit.client.0.smithi003.stdout:0/100: write f0 [6328822,28585] 0 2024-09-21T12:20:29.028 INFO:tasks.workunit.client.0.smithi003.stdout:8/80: dwrite d7/f8 [0,4194304] 0 2024-09-21T12:20:29.028 INFO:tasks.workunit.client.1.smithi192.stdout:0/692: creat d3/d5/d28/fc8 x:0 0 0 2024-09-21T12:20:29.034 INFO:tasks.workunit.client.0.smithi003.stdout:1/71: rmdir d4/dc 39 2024-09-21T12:20:29.036 INFO:tasks.workunit.client.1.smithi192.stdout:4/633: rmdir d2/db/d3e/d57/d32/d4f/d82 39 2024-09-21T12:20:29.037 INFO:tasks.workunit.client.0.smithi003.stdout:3/91: dwrite d0/f16 [4194304,4194304] 0 2024-09-21T12:20:29.039 INFO:tasks.workunit.client.0.smithi003.stdout:0/101: dread d9/fb [0,4194304] 0 2024-09-21T12:20:29.039 INFO:tasks.workunit.client.0.smithi003.stdout:3/92: write d0/f16 [3663334,121460] 0 2024-09-21T12:20:29.039 INFO:tasks.workunit.client.1.smithi192.stdout:5/931: link d0/d65/d6e/dc0/d44/l111 d0/d65/d6e/dc0/d44/d85/d97/d45/l13a 0 2024-09-21T12:20:29.041 INFO:tasks.workunit.client.0.smithi003.stdout:7/91: symlink d8/db/l1b 0 2024-09-21T12:20:29.043 INFO:tasks.workunit.client.0.smithi003.stdout:4/56: rmdir d9/da 39 2024-09-21T12:20:29.047 INFO:tasks.workunit.client.1.smithi192.stdout:2/658: symlink d1b/d1e/d3d/ld9 0 2024-09-21T12:20:29.052 INFO:tasks.workunit.client.0.smithi003.stdout:9/210: mknod d2/da/d2a/d3c/c49 0 2024-09-21T12:20:29.056 INFO:tasks.workunit.client.1.smithi192.stdout:0/693: fsync d3/d5/f80 0 2024-09-21T12:20:29.060 INFO:tasks.workunit.client.0.smithi003.stdout:8/81: creat d7/df/f1b x:0 0 0 2024-09-21T12:20:29.062 INFO:tasks.workunit.client.1.smithi192.stdout:5/932: creat d0/d65/d6e/d84/d126/d13/d37/da8/daa/dc5/ddd/d107/f13b x:0 0 0 2024-09-21T12:20:29.063 INFO:tasks.workunit.client.1.smithi192.stdout:1/701: truncate d2/da/d6b/dc8/faf 2061528 0 2024-09-21T12:20:29.064 INFO:tasks.workunit.client.1.smithi192.stdout:2/659: mknod d1b/d38/d53/d8b/da7/cda 0 2024-09-21T12:20:29.064 INFO:tasks.workunit.client.1.smithi192.stdout:2/660: stat l16 0 2024-09-21T12:20:29.066 INFO:tasks.workunit.client.0.smithi003.stdout:0/102: rename f2 to d9/d12/f1c 0 2024-09-21T12:20:29.067 INFO:tasks.workunit.client.0.smithi003.stdout:0/103: rename d9/d12 to d9/d12/d17/d1d 22 2024-09-21T12:20:29.069 INFO:tasks.workunit.client.0.smithi003.stdout:3/93: mknod d0/d5/da/c17 0 2024-09-21T12:20:29.070 INFO:tasks.workunit.client.1.smithi192.stdout:2/661: dwrite d1b/d1e/d5e/d88/d95/dbe/fd2 [0,4194304] 0 2024-09-21T12:20:29.070 INFO:tasks.workunit.client.1.smithi192.stdout:0/694: mkdir d3/de/dc6/d83/dc9 0 2024-09-21T12:20:29.072 INFO:tasks.workunit.client.0.smithi003.stdout:6/95: dwrite d4/fc [0,4194304] 0 2024-09-21T12:20:29.073 INFO:tasks.workunit.client.1.smithi192.stdout:8/726: link d14/d1a/d1d/d20/l9f d14/d1a/d1d/d46/d4e/d83/d8d/lf4 0 2024-09-21T12:20:29.074 INFO:tasks.workunit.client.1.smithi192.stdout:8/727: truncate d14/d18/d94/da4/fc1 1172262 0 2024-09-21T12:20:29.075 INFO:tasks.workunit.client.1.smithi192.stdout:8/728: dread - d14/d1a/d1d/d20/d5f/fea zero size 2024-09-21T12:20:29.079 INFO:tasks.workunit.client.0.smithi003.stdout:0/104: dwrite d9/d12/d17/f18 [0,4194304] 0 2024-09-21T12:20:29.082 INFO:tasks.workunit.client.0.smithi003.stdout:4/57: chown d9/da 38153986 1 2024-09-21T12:20:29.083 INFO:tasks.workunit.client.0.smithi003.stdout:4/58: read d9/da/fd [3306071,54304] 0 2024-09-21T12:20:29.085 INFO:tasks.workunit.client.0.smithi003.stdout:6/96: dread d4/f10 [4194304,4194304] 0 2024-09-21T12:20:29.087 INFO:tasks.workunit.client.0.smithi003.stdout:9/211: creat d2/da/d17/d40/f4a x:0 0 0 2024-09-21T12:20:29.088 INFO:tasks.workunit.client.1.smithi192.stdout:9/716: write d5/d8/d2c/f5d [772277,41946] 0 2024-09-21T12:20:29.088 INFO:tasks.workunit.client.1.smithi192.stdout:2/662: rmdir d1b/d38/d53/d8b 39 2024-09-21T12:20:29.089 INFO:tasks.workunit.client.0.smithi003.stdout:9/212: dread - d2/d20/d22/f2f zero size 2024-09-21T12:20:29.090 INFO:tasks.workunit.client.0.smithi003.stdout:8/82: truncate f4 1440712 0 2024-09-21T12:20:29.091 INFO:tasks.workunit.client.1.smithi192.stdout:0/695: creat d3/d5/d28/d39/fca x:0 0 0 2024-09-21T12:20:29.091 INFO:tasks.workunit.client.0.smithi003.stdout:1/72: rmdir d4/dc 39 2024-09-21T12:20:29.091 INFO:tasks.workunit.client.0.smithi003.stdout:8/83: write d7/df/d16/f17 [959115,42124] 0 2024-09-21T12:20:29.093 INFO:tasks.workunit.client.1.smithi192.stdout:8/729: unlink d14/d1a/d1d/d20/d5f/f67 0 2024-09-21T12:20:29.094 INFO:tasks.workunit.client.1.smithi192.stdout:8/730: write d14/d18/f33 [1543194,42984] 0 2024-09-21T12:20:29.094 INFO:tasks.workunit.client.0.smithi003.stdout:8/84: truncate d7/f8 4844856 0 2024-09-21T12:20:29.095 INFO:tasks.workunit.client.0.smithi003.stdout:3/94: mknod d0/c18 0 2024-09-21T12:20:29.096 INFO:tasks.workunit.client.0.smithi003.stdout:3/95: chown d0 1 1 2024-09-21T12:20:29.096 INFO:tasks.workunit.client.0.smithi003.stdout:8/85: readlink d7/ld 0 2024-09-21T12:20:29.096 INFO:tasks.workunit.client.1.smithi192.stdout:1/702: link d2/d12/d2f/d51/f37 d2/dae/fe7 0 2024-09-21T12:20:29.098 INFO:tasks.workunit.client.0.smithi003.stdout:9/213: dwrite d2/da/d17/d40/f4a [0,4194304] 0 2024-09-21T12:20:29.098 INFO:tasks.workunit.client.0.smithi003.stdout:8/86: write d7/de/f19 [917383,108294] 0 2024-09-21T12:20:29.100 INFO:tasks.workunit.client.0.smithi003.stdout:9/214: stat d2/d20/d22/l47 0 2024-09-21T12:20:29.101 INFO:tasks.workunit.client.1.smithi192.stdout:1/703: dwrite d2/d12/f63 [0,4194304] 0 2024-09-21T12:20:29.103 INFO:tasks.workunit.client.1.smithi192.stdout:4/634: truncate d2/db/d34/d56/d6c/db8/f8c 1237140 0 2024-09-21T12:20:29.106 INFO:tasks.workunit.client.1.smithi192.stdout:0/696: mkdir d3/de/dc6/d83/d87/dcb 0 2024-09-21T12:20:29.107 INFO:tasks.workunit.client.1.smithi192.stdout:0/697: dread - d3/de/dc6/d83/fc7 zero size 2024-09-21T12:20:29.111 INFO:tasks.workunit.client.0.smithi003.stdout:4/59: rename d9 to d9/d10 22 2024-09-21T12:20:29.111 INFO:tasks.workunit.client.1.smithi192.stdout:8/731: creat d14/d1a/d1d/d46/d4e/d83/d8d/dd8/ff5 x:0 0 0 2024-09-21T12:20:29.112 INFO:tasks.workunit.client.1.smithi192.stdout:3/589: sync 2024-09-21T12:20:29.115 INFO:tasks.workunit.client.1.smithi192.stdout:5/933: rename d0/d65/d6e/dc0/d44/d85/feb to d0/d65/d6e/dc0/f13c 0 2024-09-21T12:20:29.115 INFO:tasks.workunit.client.0.smithi003.stdout:4/60: dread d9/da/ff [0,4194304] 0 2024-09-21T12:20:29.116 INFO:tasks.workunit.client.0.smithi003.stdout:6/97: creat d4/d13/f20 x:0 0 0 2024-09-21T12:20:29.118 INFO:tasks.workunit.client.0.smithi003.stdout:6/98: truncate d4/fc 5202036 0 2024-09-21T12:20:29.123 INFO:tasks.workunit.client.0.smithi003.stdout:7/92: dwrite d8/db/ff [0,4194304] 0 2024-09-21T12:20:29.123 INFO:tasks.workunit.client.0.smithi003.stdout:8/87: mknod d7/de/d11/c1c 0 2024-09-21T12:20:29.125 INFO:tasks.workunit.client.1.smithi192.stdout:8/732: symlink d14/d1a/d1d/d46/d4e/d83/d8d/d9c/dee/d80/d9a/dba/lf6 0 2024-09-21T12:20:29.127 INFO:tasks.workunit.client.1.smithi192.stdout:3/590: mknod db/d16/d18/d40/d60/d7b/cdd 0 2024-09-21T12:20:29.128 INFO:tasks.workunit.client.0.smithi003.stdout:8/88: dread f1 [0,4194304] 0 2024-09-21T12:20:29.129 INFO:tasks.workunit.client.0.smithi003.stdout:0/105: unlink f6 0 2024-09-21T12:20:29.129 INFO:tasks.workunit.client.0.smithi003.stdout:0/106: stat f0 0 2024-09-21T12:20:29.131 INFO:tasks.workunit.client.1.smithi192.stdout:5/934: mknod d0/d65/d8e/d98/dba/c13d 0 2024-09-21T12:20:29.132 INFO:tasks.workunit.client.0.smithi003.stdout:4/61: fsync d9/fc 0 2024-09-21T12:20:29.133 INFO:tasks.workunit.client.0.smithi003.stdout:4/62: truncate f5 5026669 0 2024-09-21T12:20:29.135 INFO:tasks.workunit.client.0.smithi003.stdout:6/99: readlink d4/d13/l14 0 2024-09-21T12:20:29.136 INFO:tasks.workunit.client.0.smithi003.stdout:1/73: symlink d4/df/d12/l1d 0 2024-09-21T12:20:29.136 INFO:tasks.workunit.client.1.smithi192.stdout:0/698: symlink d3/de/lcc 0 2024-09-21T12:20:29.137 INFO:tasks.workunit.client.1.smithi192.stdout:0/699: write d3/de/dc6/d72/d7a/dbe/d92/d51/f2b [4665583,32029] 0 2024-09-21T12:20:29.138 INFO:tasks.workunit.client.1.smithi192.stdout:0/700: dread d3/de/d43/f95 [0,4194304] 0 2024-09-21T12:20:29.138 INFO:tasks.workunit.client.0.smithi003.stdout:4/63: dread d9/da/fd [0,4194304] 0 2024-09-21T12:20:29.139 INFO:tasks.workunit.client.0.smithi003.stdout:7/93: unlink d8/db/l1b 0 2024-09-21T12:20:29.140 INFO:tasks.workunit.client.0.smithi003.stdout:7/94: truncate d8/db/ff 4253021 0 2024-09-21T12:20:29.141 INFO:tasks.workunit.client.1.smithi192.stdout:3/591: dwrite db/f3c [0,4194304] 0 2024-09-21T12:20:29.142 INFO:tasks.workunit.client.1.smithi192.stdout:3/592: stat db/d16/d18/d21/d23/d71 0 2024-09-21T12:20:29.144 INFO:tasks.workunit.client.0.smithi003.stdout:8/89: rmdir d7/de/d11 39 2024-09-21T12:20:29.145 INFO:tasks.workunit.client.1.smithi192.stdout:4/635: truncate d2/db/d3e/d57/d32/d4f/d71/d9d/dad/d9c/fab 150179 0 2024-09-21T12:20:29.146 INFO:tasks.workunit.client.0.smithi003.stdout:0/107: write d9/fb [2759254,111550] 0 2024-09-21T12:20:29.147 INFO:tasks.workunit.client.1.smithi192.stdout:0/701: symlink d3/de/d9b/lcd 0 2024-09-21T12:20:29.149 INFO:tasks.workunit.client.1.smithi192.stdout:0/702: write d3/d5/d28/d39/f41 [3061007,39278] 0 2024-09-21T12:20:29.151 INFO:tasks.workunit.client.1.smithi192.stdout:9/717: rename d5/dc/d40/dad/d53/d6e/faa to d5/d19/dd5/fdf 0 2024-09-21T12:20:29.152 INFO:tasks.workunit.client.0.smithi003.stdout:9/215: truncate d2/f2b 372669 0 2024-09-21T12:20:29.153 INFO:tasks.workunit.client.1.smithi192.stdout:9/718: write d5/d8/d2c/f4b [1933248,121653] 0 2024-09-21T12:20:29.154 INFO:tasks.workunit.client.1.smithi192.stdout:3/593: dwrite db/d16/fb3 [0,4194304] 0 2024-09-21T12:20:29.155 INFO:tasks.workunit.client.1.smithi192.stdout:3/594: write db/d16/d18/d40/f51 [1834529,124255] 0 2024-09-21T12:20:29.156 INFO:tasks.workunit.client.1.smithi192.stdout:4/636: creat d2/d36/d7f/fd6 x:0 0 0 2024-09-21T12:20:29.157 INFO:tasks.workunit.client.0.smithi003.stdout:0/108: dwrite d9/fb [0,4194304] 0 2024-09-21T12:20:29.157 INFO:tasks.workunit.client.0.smithi003.stdout:4/64: fdatasync d9/da/ff 0 2024-09-21T12:20:29.160 INFO:tasks.workunit.client.1.smithi192.stdout:0/703: chown d3/de/l96 435779451 1 2024-09-21T12:20:29.161 INFO:tasks.workunit.client.1.smithi192.stdout:4/637: dwrite d2/db/f26 [0,4194304] 0 2024-09-21T12:20:29.162 INFO:tasks.workunit.client.1.smithi192.stdout:4/638: truncate d2/d36/fba 917574 0 2024-09-21T12:20:29.162 INFO:tasks.workunit.client.0.smithi003.stdout:8/90: truncate d7/f9 4841261 0 2024-09-21T12:20:29.163 INFO:tasks.workunit.client.1.smithi192.stdout:8/733: rename d14/d18/c7d to d14/d1a/d1d/d48/dac/cf7 0 2024-09-21T12:20:29.166 INFO:tasks.workunit.client.1.smithi192.stdout:1/704: getdents d2/d12/d2f/d51/d24/d65/d8b 0 2024-09-21T12:20:29.167 INFO:tasks.workunit.client.0.smithi003.stdout:1/74: dwrite d4/dc/f10 [0,4194304] 0 2024-09-21T12:20:29.202 INFO:tasks.workunit.client.1.smithi192.stdout:6/799: sync 2024-09-21T12:20:29.202 INFO:tasks.workunit.client.1.smithi192.stdout:7/662: sync 2024-09-21T12:20:29.203 INFO:tasks.workunit.client.1.smithi192.stdout:7/663: write d6/d20/f4d [1350063,18059] 0 2024-09-21T12:20:29.203 INFO:tasks.workunit.client.1.smithi192.stdout:6/800: truncate da/d1f/d56/fd2 257946 0 2024-09-21T12:20:29.203 INFO:tasks.workunit.client.1.smithi192.stdout:7/664: chown d6/d20/dcc 67803 1 2024-09-21T12:20:29.222 INFO:tasks.workunit.client.0.smithi003.stdout:5/148: sync 2024-09-21T12:20:29.241 INFO:tasks.workunit.client.0.smithi003.stdout:9/216: creat d2/da/d2a/d3c/f4b x:0 0 0 2024-09-21T12:20:29.242 INFO:tasks.workunit.client.0.smithi003.stdout:0/109: mkdir d9/d12/d1e 0 2024-09-21T12:20:29.246 INFO:tasks.workunit.client.0.smithi003.stdout:0/110: dread f8 [0,4194304] 0 2024-09-21T12:20:29.246 INFO:tasks.workunit.client.0.smithi003.stdout:7/95: link d8/db/ff d8/db/f1c 0 2024-09-21T12:20:29.248 INFO:tasks.workunit.client.1.smithi192.stdout:5/935: rename d0/d2/f48 to d0/d65/d6e/d84/d126/d13/d37/da8/daa/dc5/ddd/f13e 0 2024-09-21T12:20:29.250 INFO:tasks.workunit.client.0.smithi003.stdout:6/100: dwrite d4/fa [0,4194304] 0 2024-09-21T12:20:29.251 INFO:tasks.workunit.client.1.smithi192.stdout:4/639: readlink d2/db/d3e/d57/d32/d4f/d71/d9d/dad/d9c/d9e/la9 0 2024-09-21T12:20:29.256 INFO:tasks.workunit.client.1.smithi192.stdout:4/640: dwrite d2/db/d3e/d41/fa3 [0,4194304] 0 2024-09-21T12:20:29.257 INFO:tasks.workunit.client.1.smithi192.stdout:4/641: stat d2/d36/d55 0 2024-09-21T12:20:29.257 INFO:tasks.workunit.client.0.smithi003.stdout:9/217: dread d2/da/d2a/f33 [0,4194304] 0 2024-09-21T12:20:29.258 INFO:tasks.workunit.client.0.smithi003.stdout:9/218: stat d2/da/d17/d40 0 2024-09-21T12:20:29.258 INFO:tasks.workunit.client.1.smithi192.stdout:7/665: stat d6/d9/d51/fad 0 2024-09-21T12:20:29.259 INFO:tasks.workunit.client.0.smithi003.stdout:7/96: creat d8/f1d x:0 0 0 2024-09-21T12:20:29.261 INFO:tasks.workunit.client.1.smithi192.stdout:3/595: mkdir db/d16/d18/d21/dde 0 2024-09-21T12:20:29.264 INFO:tasks.workunit.client.1.smithi192.stdout:0/704: mknod d3/d5/d69/dbf/cce 0 2024-09-21T12:20:29.266 INFO:tasks.workunit.client.1.smithi192.stdout:4/642: dwrite d2/db/d3e/d41/fa3 [0,4194304] 0 2024-09-21T12:20:29.268 INFO:tasks.workunit.client.1.smithi192.stdout:9/719: rename d5/d19/dd5/d4d/d6d/f74 to d5/dc/d64/fe0 0 2024-09-21T12:20:29.269 INFO:tasks.workunit.client.1.smithi192.stdout:4/643: dread d2/db/d34/d56/f9a [0,4194304] 0 2024-09-21T12:20:29.272 INFO:tasks.workunit.client.0.smithi003.stdout:1/75: getdents d4/d11/d14 0 2024-09-21T12:20:29.273 INFO:tasks.workunit.client.0.smithi003.stdout:5/149: write dc/d15/f19 [418467,30988] 0 2024-09-21T12:20:29.275 INFO:tasks.workunit.client.1.smithi192.stdout:1/705: symlink d2/d12/le8 0 2024-09-21T12:20:29.277 INFO:tasks.workunit.client.0.smithi003.stdout:6/101: dwrite d4/d9/fd [0,4194304] 0 2024-09-21T12:20:29.281 INFO:tasks.workunit.client.0.smithi003.stdout:7/97: rename d8/f10 to d8/db/d13/f1e 0 2024-09-21T12:20:29.285 INFO:tasks.workunit.client.0.smithi003.stdout:0/111: creat d9/d12/d1e/f1f x:0 0 0 2024-09-21T12:20:29.289 INFO:tasks.workunit.client.0.smithi003.stdout:9/219: dwrite d2/da/d2a/d3c/f37 [0,4194304] 0 2024-09-21T12:20:29.289 INFO:tasks.workunit.client.1.smithi192.stdout:0/705: dwrite d3/d5/d28/d39/f8a [4194304,4194304] 0 2024-09-21T12:20:29.289 INFO:tasks.workunit.client.0.smithi003.stdout:6/102: dwrite d4/fb [0,4194304] 0 2024-09-21T12:20:29.290 INFO:tasks.workunit.client.0.smithi003.stdout:8/91: creat d7/de/f1d x:0 0 0 2024-09-21T12:20:29.291 INFO:tasks.workunit.client.0.smithi003.stdout:5/150: creat dc/d15/d26/f2e x:0 0 0 2024-09-21T12:20:29.295 INFO:tasks.workunit.client.1.smithi192.stdout:3/596: rename db/d16/fb3 to db/d16/d18/d40/dd1/fdf 0 2024-09-21T12:20:29.297 INFO:tasks.workunit.client.1.smithi192.stdout:2/663: sync 2024-09-21T12:20:29.300 INFO:tasks.workunit.client.0.smithi003.stdout:8/92: dwrite d7/de/f1d [0,4194304] 0 2024-09-21T12:20:29.308 INFO:tasks.workunit.client.1.smithi192.stdout:5/936: dwrite d0/f3b [0,4194304] 0 2024-09-21T12:20:29.309 INFO:tasks.workunit.client.1.smithi192.stdout:8/734: dwrite d14/d18/f32 [0,4194304] 0 2024-09-21T12:20:29.309 INFO:tasks.workunit.client.1.smithi192.stdout:1/706: symlink d2/d12/d2f/d41/le9 0 2024-09-21T12:20:29.310 INFO:tasks.workunit.client.0.smithi003.stdout:0/112: unlink f0 0 2024-09-21T12:20:29.311 INFO:tasks.workunit.client.0.smithi003.stdout:0/113: dread - d9/d12/d1e/f1f zero size 2024-09-21T12:20:29.311 INFO:tasks.workunit.client.1.smithi192.stdout:8/735: readlink d14/d1a/d1d/d20/l5d 0 2024-09-21T12:20:29.311 INFO:tasks.workunit.client.1.smithi192.stdout:1/707: dread - d2/d12/d2f/d51/fdb zero size 2024-09-21T12:20:29.312 INFO:tasks.workunit.client.1.smithi192.stdout:7/666: dread - d6/d20/d69/d90/da7/dc1/fac zero size 2024-09-21T12:20:29.315 INFO:tasks.workunit.client.1.smithi192.stdout:1/708: truncate d2/da/d6b/dc8/f93 1052996 0 2024-09-21T12:20:29.316 INFO:tasks.workunit.client.0.smithi003.stdout:1/76: unlink d4/f8 0 2024-09-21T12:20:29.317 INFO:tasks.workunit.client.0.smithi003.stdout:1/77: chown d4/df/f1a 72 1 2024-09-21T12:20:29.318 INFO:tasks.workunit.client.0.smithi003.stdout:2/81: sync 2024-09-21T12:20:29.319 INFO:tasks.workunit.client.0.smithi003.stdout:9/220: creat d2/da/d17/d40/f4c x:0 0 0 2024-09-21T12:20:29.320 INFO:tasks.workunit.client.0.smithi003.stdout:9/221: fsync d2/da/f3b 0 2024-09-21T12:20:29.321 INFO:tasks.workunit.client.1.smithi192.stdout:5/937: dwrite d0/d65/d6e/dc0/d44/d85/d97/d9e/f115 [0,4194304] 0 2024-09-21T12:20:29.321 INFO:tasks.workunit.client.0.smithi003.stdout:5/151: symlink dc/d15/l2f 0 2024-09-21T12:20:29.322 INFO:tasks.workunit.client.0.smithi003.stdout:5/152: chown dc/d15/d21 150780 1 2024-09-21T12:20:29.322 INFO:tasks.workunit.client.1.smithi192.stdout:7/667: dwrite d6/d3a/f88 [0,4194304] 0 2024-09-21T12:20:29.323 INFO:tasks.workunit.client.0.smithi003.stdout:9/222: write d2/da/d17/d40/f4a [2601173,54741] 0 2024-09-21T12:20:29.324 INFO:tasks.workunit.client.0.smithi003.stdout:9/223: chown d2/d20/d22/l47 937 1 2024-09-21T12:20:29.325 INFO:tasks.workunit.client.0.smithi003.stdout:8/93: fsync f1 0 2024-09-21T12:20:29.325 INFO:tasks.workunit.client.1.smithi192.stdout:2/664: write d1b/d1e/d3d/f4b [5834452,81473] 0 2024-09-21T12:20:29.328 INFO:tasks.workunit.client.1.smithi192.stdout:3/597: creat db/d16/d18/d21/d23/dd2/d2e/db8/dd0/fe0 x:0 0 0 2024-09-21T12:20:29.332 INFO:tasks.workunit.client.0.smithi003.stdout:0/114: rmdir d9/d12/d1e 39 2024-09-21T12:20:29.335 INFO:tasks.workunit.client.1.smithi192.stdout:8/736: mknod d14/d1a/d1d/d48/cf8 0 2024-09-21T12:20:29.336 INFO:tasks.workunit.client.1.smithi192.stdout:3/598: dwrite db/d16/d18/d33/d3b/d68/fb7 [0,4194304] 0 2024-09-21T12:20:29.336 INFO:tasks.workunit.client.0.smithi003.stdout:1/78: creat d4/d11/f1e x:0 0 0 2024-09-21T12:20:29.339 INFO:tasks.workunit.client.1.smithi192.stdout:1/709: write d2/d12/d2f/d51/d24/d65/fe0 [8404996,97096] 0 2024-09-21T12:20:29.340 INFO:tasks.workunit.client.0.smithi003.stdout:9/224: mkdir d2/da/d35/d4d 0 2024-09-21T12:20:29.349 INFO:tasks.workunit.client.1.smithi192.stdout:3/599: creat db/d16/db4/d8c/fe1 x:0 0 0 2024-09-21T12:20:29.350 INFO:tasks.workunit.client.0.smithi003.stdout:6/103: creat d4/f21 x:0 0 0 2024-09-21T12:20:29.350 INFO:tasks.workunit.client.0.smithi003.stdout:1/79: rename d4/df/d12/l1d to d4/d11/l1f 0 2024-09-21T12:20:29.351 INFO:tasks.workunit.client.0.smithi003.stdout:8/94: dread d7/f9 [0,4194304] 0 2024-09-21T12:20:29.354 INFO:tasks.workunit.client.0.smithi003.stdout:7/98: getdents d8/db/d13 0 2024-09-21T12:20:29.355 INFO:tasks.workunit.client.1.smithi192.stdout:5/938: dread d0/d65/d6e/d84/d126/d13/f53 [0,4194304] 0 2024-09-21T12:20:29.356 INFO:tasks.workunit.client.0.smithi003.stdout:0/115: mknod d9/c20 0 2024-09-21T12:20:29.358 INFO:tasks.workunit.client.1.smithi192.stdout:4/644: dwrite d2/d36/d7f/f39 [0,4194304] 0 2024-09-21T12:20:29.359 INFO:tasks.workunit.client.0.smithi003.stdout:6/104: mkdir d4/d13/d22 0 2024-09-21T12:20:29.359 INFO:tasks.workunit.client.1.smithi192.stdout:1/710: dwrite d2/da/fad [0,4194304] 0 2024-09-21T12:20:29.360 INFO:tasks.workunit.client.0.smithi003.stdout:0/116: truncate d9/d12/d15/f1b 152370 0 2024-09-21T12:20:29.360 INFO:tasks.workunit.client.0.smithi003.stdout:8/95: dwrite d7/f14 [0,4194304] 0 2024-09-21T12:20:29.361 INFO:tasks.workunit.client.1.smithi192.stdout:1/711: stat d2/dae 0 2024-09-21T12:20:29.362 INFO:tasks.workunit.client.0.smithi003.stdout:0/117: stat d9/d12/f13 0 2024-09-21T12:20:29.365 INFO:tasks.workunit.client.0.smithi003.stdout:9/225: creat d2/da/d35/d4d/f4e x:0 0 0 2024-09-21T12:20:29.366 INFO:tasks.workunit.client.1.smithi192.stdout:1/712: truncate d2/da/d6b/dc8/f93 1438038 0 2024-09-21T12:20:29.366 INFO:tasks.workunit.client.1.smithi192.stdout:0/706: dwrite d3/f78 [0,4194304] 0 2024-09-21T12:20:29.367 INFO:tasks.workunit.client.0.smithi003.stdout:9/226: stat d2/d20/d22/d3f 0 2024-09-21T12:20:29.370 INFO:tasks.workunit.client.1.smithi192.stdout:6/801: sync 2024-09-21T12:20:29.371 INFO:tasks.workunit.client.0.smithi003.stdout:6/105: dwrite d4/f5 [4194304,4194304] 0 2024-09-21T12:20:29.374 INFO:tasks.workunit.client.0.smithi003.stdout:6/106: dread - d4/f21 zero size 2024-09-21T12:20:29.379 INFO:tasks.workunit.client.0.smithi003.stdout:6/107: dread d4/fa [0,4194304] 0 2024-09-21T12:20:29.381 INFO:tasks.workunit.client.1.smithi192.stdout:7/668: rename d6/d20/d69/d90/da7/dc1/c73 to d6/ce7 0 2024-09-21T12:20:29.382 INFO:tasks.workunit.client.0.smithi003.stdout:2/82: write d0/fa [1400420,23645] 0 2024-09-21T12:20:29.382 INFO:tasks.workunit.client.0.smithi003.stdout:0/118: mkdir d9/d12/d17/d21 0 2024-09-21T12:20:29.384 INFO:tasks.workunit.client.0.smithi003.stdout:2/83: write d0/f10 [4910765,96437] 0 2024-09-21T12:20:29.384 INFO:tasks.workunit.client.0.smithi003.stdout:2/84: readlink d0/l1a 0 2024-09-21T12:20:29.385 INFO:tasks.workunit.client.1.smithi192.stdout:1/713: dread - d2/d12/f92 zero size 2024-09-21T12:20:29.386 INFO:tasks.workunit.client.1.smithi192.stdout:1/714: dread - d2/d12/fe4 zero size 2024-09-21T12:20:29.386 INFO:tasks.workunit.client.1.smithi192.stdout:1/715: read - d2/d12/f92 zero size 2024-09-21T12:20:29.388 INFO:tasks.workunit.client.1.smithi192.stdout:1/716: dread - d2/da/d6b/dc8/fcc zero size 2024-09-21T12:20:29.391 INFO:tasks.workunit.client.1.smithi192.stdout:8/737: dwrite d14/d1a/d1d/d20/f47 [0,4194304] 0 2024-09-21T12:20:29.391 INFO:tasks.workunit.client.1.smithi192.stdout:3/600: write db/d16/db4/d8c/fd4 [713789,108529] 0 2024-09-21T12:20:29.392 INFO:tasks.workunit.client.1.smithi192.stdout:6/802: chown da/d23/d37/c38 61975 1 2024-09-21T12:20:29.397 INFO:tasks.workunit.client.1.smithi192.stdout:1/717: dwrite d2/fc3 [0,4194304] 0 2024-09-21T12:20:29.397 INFO:tasks.workunit.client.1.smithi192.stdout:6/803: chown da/d1f/d27/d3e/f94 167 1 2024-09-21T12:20:29.399 INFO:tasks.workunit.client.0.smithi003.stdout:8/96: mknod d7/de/d1a/c1e 0 2024-09-21T12:20:29.399 INFO:tasks.workunit.client.0.smithi003.stdout:7/99: dwrite d8/db/f1c [0,4194304] 0 2024-09-21T12:20:29.402 INFO:tasks.workunit.client.0.smithi003.stdout:2/85: symlink d0/dd/d16/l1f 0 2024-09-21T12:20:29.404 INFO:tasks.workunit.client.0.smithi003.stdout:8/97: dread d7/f14 [0,4194304] 0 2024-09-21T12:20:29.408 INFO:tasks.workunit.client.0.smithi003.stdout:9/227: write d2/d20/f21 [201474,69098] 0 2024-09-21T12:20:29.409 INFO:tasks.workunit.client.1.smithi192.stdout:5/939: creat d0/d65/d6e/dc0/f13f x:0 0 0 2024-09-21T12:20:29.411 INFO:tasks.workunit.client.1.smithi192.stdout:4/645: truncate d2/db/d34/d56/d6c/db8/f79 2999765 0 2024-09-21T12:20:29.413 INFO:tasks.workunit.client.0.smithi003.stdout:1/80: getdents d4 0 2024-09-21T12:20:29.415 INFO:tasks.workunit.client.0.smithi003.stdout:0/119: mkdir d9/d12/d22 0 2024-09-21T12:20:29.416 INFO:tasks.workunit.client.1.smithi192.stdout:2/665: rename d1b/d38/c4f to d1b/d38/d53/d8b/da7/cdb 0 2024-09-21T12:20:29.419 INFO:tasks.workunit.client.1.smithi192.stdout:7/669: link d6/d9/d2d/d7b/fbd d6/d9/d1f/d3e/d7a/d8a/da2/fe8 0 2024-09-21T12:20:29.419 INFO:tasks.workunit.client.0.smithi003.stdout:7/100: symlink d8/db/d13/l1f 0 2024-09-21T12:20:29.420 INFO:tasks.workunit.client.1.smithi192.stdout:7/670: readlink d6/d20/l4e 0 2024-09-21T12:20:29.420 INFO:tasks.workunit.client.1.smithi192.stdout:3/601: mknod db/d16/d18/d40/d60/d7b/dc0/ce2 0 2024-09-21T12:20:29.421 INFO:tasks.workunit.client.1.smithi192.stdout:7/671: write d6/d3a/d6d/fd6 [473793,95425] 0 2024-09-21T12:20:29.422 INFO:tasks.workunit.client.0.smithi003.stdout:2/86: unlink d0/f10 0 2024-09-21T12:20:29.422 INFO:tasks.workunit.client.0.smithi003.stdout:6/108: truncate d4/f10 803181 0 2024-09-21T12:20:29.423 INFO:tasks.workunit.client.1.smithi192.stdout:2/666: dwrite d1b/fb7 [0,4194304] 0 2024-09-21T12:20:29.423 INFO:tasks.workunit.client.1.smithi192.stdout:3/602: fsync db/d16/d18/d33/f83 0 2024-09-21T12:20:29.424 INFO:tasks.workunit.client.1.smithi192.stdout:6/804: mkdir da/d1f/d56/da9/d10c 0 2024-09-21T12:20:29.426 INFO:tasks.workunit.client.1.smithi192.stdout:3/603: write db/d16/d18/d40/f6e [1147460,76270] 0 2024-09-21T12:20:29.430 INFO:tasks.workunit.client.1.smithi192.stdout:1/718: symlink d2/da/d6b/dc8/lea 0 2024-09-21T12:20:29.430 INFO:tasks.workunit.client.1.smithi192.stdout:7/672: dwrite d6/d9/d2d/d7b/f9e [0,4194304] 0 2024-09-21T12:20:29.431 INFO:tasks.workunit.client.0.smithi003.stdout:6/109: dwrite d4/d13/f20 [0,4194304] 0 2024-09-21T12:20:29.431 INFO:tasks.workunit.client.1.smithi192.stdout:7/673: chown d6/d3a/f88 1 1 2024-09-21T12:20:29.432 INFO:tasks.workunit.client.0.smithi003.stdout:9/228: rename d2/lf to d2/d20/d22/l4f 0 2024-09-21T12:20:29.433 INFO:tasks.workunit.client.1.smithi192.stdout:7/674: stat d6/d9/d1f/d3e/d7a/d8a/fe5 0 2024-09-21T12:20:29.436 INFO:tasks.workunit.client.1.smithi192.stdout:0/707: creat d3/d5/fcf x:0 0 0 2024-09-21T12:20:29.436 INFO:tasks.workunit.client.1.smithi192.stdout:3/604: dwrite db/d16/dc1/fc6 [0,4194304] 0 2024-09-21T12:20:29.437 INFO:tasks.workunit.client.0.smithi003.stdout:4/65: sync 2024-09-21T12:20:29.437 INFO:tasks.workunit.client.0.smithi003.stdout:3/96: sync 2024-09-21T12:20:29.438 INFO:tasks.workunit.client.1.smithi192.stdout:0/708: fsync d3/d5/d69/faf 0 2024-09-21T12:20:29.438 INFO:tasks.workunit.client.1.smithi192.stdout:5/940: creat d0/d65/d6e/d84/d126/d13/d37/da8/daa/de4/f140 x:0 0 0 2024-09-21T12:20:29.438 INFO:tasks.workunit.client.1.smithi192.stdout:3/605: dread - db/d16/d18/d33/d3b/d68/f9e zero size 2024-09-21T12:20:29.439 INFO:tasks.workunit.client.0.smithi003.stdout:6/110: dwrite d4/fb [0,4194304] 0 2024-09-21T12:20:29.440 INFO:tasks.workunit.client.0.smithi003.stdout:4/66: write f5 [1874461,21320] 0 2024-09-21T12:20:29.441 INFO:tasks.workunit.client.0.smithi003.stdout:0/120: write f8 [5108584,61439] 0 2024-09-21T12:20:29.441 INFO:tasks.workunit.client.1.smithi192.stdout:5/941: write d0/d65/d8e/d98/dba/f12d [9720,23633] 0 2024-09-21T12:20:29.442 INFO:tasks.workunit.client.0.smithi003.stdout:6/111: read d4/d13/f20 [3973192,99384] 0 2024-09-21T12:20:29.442 INFO:tasks.workunit.client.1.smithi192.stdout:5/942: fsync d0/d65/d6e/d84/d126/d104/f46 0 2024-09-21T12:20:29.444 INFO:tasks.workunit.client.1.smithi192.stdout:9/720: sync 2024-09-21T12:20:29.445 INFO:tasks.workunit.client.0.smithi003.stdout:0/121: chown d9/l1a 344 1 2024-09-21T12:20:29.445 INFO:tasks.workunit.client.1.smithi192.stdout:9/721: write d5/d19/f3c [22509,69838] 0 2024-09-21T12:20:29.446 INFO:tasks.workunit.client.0.smithi003.stdout:0/122: readlink l1 0 2024-09-21T12:20:29.449 INFO:tasks.workunit.client.1.smithi192.stdout:8/738: fdatasync d14/d1a/d1d/f49 0 2024-09-21T12:20:29.456 INFO:tasks.workunit.client.0.smithi003.stdout:4/67: dwrite f6 [0,4194304] 0 2024-09-21T12:20:29.460 INFO:tasks.workunit.client.0.smithi003.stdout:1/81: symlink d4/d11/d14/l20 0 2024-09-21T12:20:29.460 INFO:tasks.workunit.client.0.smithi003.stdout:4/68: write d9/da/ff [3413449,127237] 0 2024-09-21T12:20:29.462 INFO:tasks.workunit.client.0.smithi003.stdout:3/97: creat d0/f19 x:0 0 0 2024-09-21T12:20:29.463 INFO:tasks.workunit.client.1.smithi192.stdout:0/709: creat d3/d5/d28/d39/fd0 x:0 0 0 2024-09-21T12:20:29.464 INFO:tasks.workunit.client.0.smithi003.stdout:6/112: mkdir d4/d13/d19/d23 0 2024-09-21T12:20:29.466 INFO:tasks.workunit.client.0.smithi003.stdout:1/82: write d4/f7 [787092,87651] 0 2024-09-21T12:20:29.466 INFO:tasks.workunit.client.0.smithi003.stdout:7/101: dread d8/f9 [4194304,4194304] 0 2024-09-21T12:20:29.467 INFO:tasks.workunit.client.1.smithi192.stdout:5/943: creat d0/d65/d6e/d84/f141 x:0 0 0 2024-09-21T12:20:29.467 INFO:tasks.workunit.client.0.smithi003.stdout:3/98: dread - d0/f19 zero size 2024-09-21T12:20:29.468 INFO:tasks.workunit.client.0.smithi003.stdout:0/123: write d9/d12/f16 [617857,68379] 0 2024-09-21T12:20:29.469 INFO:tasks.workunit.client.1.smithi192.stdout:3/606: dread db/d16/d18/fbf [0,4194304] 0 2024-09-21T12:20:29.470 INFO:tasks.workunit.client.1.smithi192.stdout:9/722: creat d5/dc/d64/fe1 x:0 0 0 2024-09-21T12:20:29.471 INFO:tasks.workunit.client.1.smithi192.stdout:3/607: read - db/d16/d18/d33/d3b/d68/f9e zero size 2024-09-21T12:20:29.471 INFO:tasks.workunit.client.0.smithi003.stdout:8/98: dwrite d7/f9 [0,4194304] 0 2024-09-21T12:20:29.472 INFO:tasks.workunit.client.0.smithi003.stdout:4/69: dread d9/da/fb [4194304,4194304] 0 2024-09-21T12:20:29.472 INFO:tasks.workunit.client.0.smithi003.stdout:5/153: sync 2024-09-21T12:20:29.476 INFO:tasks.workunit.client.0.smithi003.stdout:7/102: creat d8/db/f20 x:0 0 0 2024-09-21T12:20:29.478 INFO:tasks.workunit.client.1.smithi192.stdout:2/667: mknod d1b/d1e/cdc 0 2024-09-21T12:20:29.478 INFO:tasks.workunit.client.0.smithi003.stdout:1/83: creat d4/df/f21 x:0 0 0 2024-09-21T12:20:29.478 INFO:tasks.workunit.client.1.smithi192.stdout:4/646: write d2/d21/f38 [454944,20222] 0 2024-09-21T12:20:29.479 INFO:tasks.workunit.client.0.smithi003.stdout:1/84: dread - d4/d11/f1e zero size 2024-09-21T12:20:29.479 INFO:tasks.workunit.client.1.smithi192.stdout:3/608: dwrite db/f22 [8388608,4194304] 0 2024-09-21T12:20:29.480 INFO:tasks.workunit.client.0.smithi003.stdout:1/85: write d4/df/f21 [334463,3954] 0 2024-09-21T12:20:29.481 INFO:tasks.workunit.client.0.smithi003.stdout:1/86: truncate d4/d11/f1e 812455 0 2024-09-21T12:20:29.482 INFO:tasks.workunit.client.0.smithi003.stdout:9/229: link d2/da/f3b d2/da/f50 0 2024-09-21T12:20:29.483 INFO:tasks.workunit.client.0.smithi003.stdout:9/230: chown d2/f10 26 1 2024-09-21T12:20:29.483 INFO:tasks.workunit.client.1.smithi192.stdout:1/719: mknod d2/d12/d2f/d51/d24/d65/ceb 0 2024-09-21T12:20:29.487 INFO:tasks.workunit.client.1.smithi192.stdout:0/710: creat d3/d5/d28/d39/fd1 x:0 0 0 2024-09-21T12:20:29.488 INFO:tasks.workunit.client.1.smithi192.stdout:5/944: mknod d0/d65/d6e/d84/c142 0 2024-09-21T12:20:29.488 INFO:tasks.workunit.client.1.smithi192.stdout:0/711: write d3/de/dc6/f5b [1324892,59856] 0 2024-09-21T12:20:29.489 INFO:tasks.workunit.client.0.smithi003.stdout:4/70: symlink d9/da/l11 0 2024-09-21T12:20:29.491 INFO:tasks.workunit.client.0.smithi003.stdout:8/99: mknod d7/df/c1f 0 2024-09-21T12:20:29.493 INFO:tasks.workunit.client.0.smithi003.stdout:8/100: write d7/df/d16/f17 [346060,56055] 0 2024-09-21T12:20:29.498 INFO:tasks.workunit.client.0.smithi003.stdout:7/103: mkdir d8/db/d13/d21 0 2024-09-21T12:20:29.498 INFO:tasks.workunit.client.0.smithi003.stdout:8/101: dread d7/de/f19 [0,4194304] 0 2024-09-21T12:20:29.500 INFO:tasks.workunit.client.0.smithi003.stdout:1/87: symlink d4/d11/l22 0 2024-09-21T12:20:29.501 INFO:tasks.workunit.client.1.smithi192.stdout:2/668: mkdir d1b/d1e/d5e/d88/d95/dbe/dd0/ddd 0 2024-09-21T12:20:29.504 INFO:tasks.workunit.client.1.smithi192.stdout:3/609: unlink db/d16/d18/d40/l81 0 2024-09-21T12:20:29.505 INFO:tasks.workunit.client.1.smithi192.stdout:3/610: write db/f3c [4255550,70759] 0 2024-09-21T12:20:29.505 INFO:tasks.workunit.client.1.smithi192.stdout:9/723: dread d5/dc/d80/d44/d79/fb1 [0,4194304] 0 2024-09-21T12:20:29.509 INFO:tasks.workunit.client.1.smithi192.stdout:6/805: write da/d23/d37/d75/de2/f100 [4115886,40809] 0 2024-09-21T12:20:29.509 INFO:tasks.workunit.client.1.smithi192.stdout:6/806: stat da/d1f/d27/d3e/cb3 0 2024-09-21T12:20:29.510 INFO:tasks.workunit.client.0.smithi003.stdout:4/71: creat d9/da/f12 x:0 0 0 2024-09-21T12:20:29.511 INFO:tasks.workunit.client.1.smithi192.stdout:5/945: mkdir d0/d65/d6e/d84/d126/d13/d37/da8/d143 0 2024-09-21T12:20:29.512 INFO:tasks.workunit.client.1.smithi192.stdout:5/946: fsync d0/d65/d6e/dc0/d44/d85/d97/d45/f72 0 2024-09-21T12:20:29.513 INFO:tasks.workunit.client.1.smithi192.stdout:0/712: dread d3/de/d33/f6e [0,4194304] 0 2024-09-21T12:20:29.514 INFO:tasks.workunit.client.1.smithi192.stdout:0/713: write d3/d5/fcf [143246,80675] 0 2024-09-21T12:20:29.515 INFO:tasks.workunit.client.1.smithi192.stdout:0/714: readlink d3/de/l73 0 2024-09-21T12:20:29.516 INFO:tasks.workunit.client.1.smithi192.stdout:4/647: mkdir d2/db/d34/d56/d6c/db8/d99/dd7 0 2024-09-21T12:20:29.517 INFO:tasks.workunit.client.0.smithi003.stdout:7/104: mknod d8/db/d13/c22 0 2024-09-21T12:20:29.517 INFO:tasks.workunit.client.1.smithi192.stdout:8/739: write d14/d1a/d1d/d46/d4e/d83/d8d/d9c/dee/ff1 [4186427,128616] 0 2024-09-21T12:20:29.519 INFO:tasks.workunit.client.1.smithi192.stdout:8/740: chown d14/d1a/d1d/d46/d4e/f76 89191 1 2024-09-21T12:20:29.520 INFO:tasks.workunit.client.1.smithi192.stdout:2/669: dwrite ff [0,4194304] 0 2024-09-21T12:20:29.521 INFO:tasks.workunit.client.0.smithi003.stdout:1/88: mknod d4/df/d12/c23 0 2024-09-21T12:20:29.522 INFO:tasks.workunit.client.0.smithi003.stdout:6/113: dwrite d4/fe [0,4194304] 0 2024-09-21T12:20:29.522 INFO:tasks.workunit.client.0.smithi003.stdout:1/89: readlink d4/l5 0 2024-09-21T12:20:29.523 INFO:tasks.workunit.client.0.smithi003.stdout:1/90: dread - d4/fa zero size 2024-09-21T12:20:29.523 INFO:tasks.workunit.client.0.smithi003.stdout:6/114: fdatasync d4/d9/f15 0 2024-09-21T12:20:29.523 INFO:tasks.workunit.client.1.smithi192.stdout:3/611: mknod db/d16/d18/d40/dd1/ce3 0 2024-09-21T12:20:29.524 INFO:tasks.workunit.client.0.smithi003.stdout:1/91: chown d4/dc/f10 4778 1 2024-09-21T12:20:29.524 INFO:tasks.workunit.client.0.smithi003.stdout:6/115: write d4/fc [5160114,6373] 0 2024-09-21T12:20:29.525 INFO:tasks.workunit.client.0.smithi003.stdout:9/231: symlink d2/da/l51 0 2024-09-21T12:20:29.525 INFO:tasks.workunit.client.0.smithi003.stdout:2/87: write d0/fc [4606665,123289] 0 2024-09-21T12:20:29.527 INFO:tasks.workunit.client.1.smithi192.stdout:7/675: rename d6/d9/l2f to d6/d9/le9 0 2024-09-21T12:20:29.529 INFO:tasks.workunit.client.1.smithi192.stdout:9/724: write d5/dc/d40/dad/d53/d6e/f85 [583160,98626] 0 2024-09-21T12:20:29.532 INFO:tasks.workunit.client.1.smithi192.stdout:6/807: creat da/d1f/d48/d7d/daa/dd7/f10d x:0 0 0 2024-09-21T12:20:29.532 INFO:tasks.workunit.client.0.smithi003.stdout:3/99: link d0/c18 d0/d5/d9/c1a 0 2024-09-21T12:20:29.536 INFO:tasks.workunit.client.0.smithi003.stdout:3/100: dread d0/f16 [4194304,4194304] 0 2024-09-21T12:20:29.537 INFO:tasks.workunit.client.1.smithi192.stdout:0/715: mkdir d3/de/d33/dae/dd2 0 2024-09-21T12:20:29.537 INFO:tasks.workunit.client.0.smithi003.stdout:7/105: symlink d8/l23 0 2024-09-21T12:20:29.538 INFO:tasks.workunit.client.1.smithi192.stdout:0/716: write d3/de/dc6/d83/f85 [1112387,67046] 0 2024-09-21T12:20:29.540 INFO:tasks.workunit.client.1.smithi192.stdout:4/648: unlink d2/db/d3e/d57/d32/d4f/d71/d9d/dad/f2d 0 2024-09-21T12:20:29.542 INFO:tasks.workunit.client.1.smithi192.stdout:4/649: readlink d2/d36/d7f/d68/l73 0 2024-09-21T12:20:29.542 INFO:tasks.workunit.client.1.smithi192.stdout:8/741: creat d14/d1a/d1d/d46/d4e/d83/d8d/dd8/ff9 x:0 0 0 2024-09-21T12:20:29.543 INFO:tasks.workunit.client.1.smithi192.stdout:2/670: mkdir d1b/d1e/d5e/d75/d8d/dde 0 2024-09-21T12:20:29.544 INFO:tasks.workunit.client.1.smithi192.stdout:8/742: read - d14/d1a/d1d/d20/d5f/fea zero size 2024-09-21T12:20:29.545 INFO:tasks.workunit.client.1.smithi192.stdout:3/612: mkdir db/d16/d18/d33/d4a/de4 0 2024-09-21T12:20:29.545 INFO:tasks.workunit.client.1.smithi192.stdout:0/717: dwrite d3/de/dc6/d72/d7a/dbe/d92/d51/f34 [4194304,4194304] 0 2024-09-21T12:20:29.545 INFO:tasks.workunit.client.0.smithi003.stdout:6/116: dread d4/f10 [0,4194304] 0 2024-09-21T12:20:29.546 INFO:tasks.workunit.client.0.smithi003.stdout:9/232: symlink d2/da/d17/l52 0 2024-09-21T12:20:29.546 INFO:tasks.workunit.client.1.smithi192.stdout:8/743: write d14/d1a/d1d/d46/d4e/f5b [4468420,79983] 0 2024-09-21T12:20:29.547 INFO:tasks.workunit.client.1.smithi192.stdout:7/676: unlink d6/f10 0 2024-09-21T12:20:29.549 INFO:tasks.workunit.client.0.smithi003.stdout:2/88: rename d0/l1a to d0/dd/d16/l20 0 2024-09-21T12:20:29.552 INFO:tasks.workunit.client.1.smithi192.stdout:9/725: mknod d5/dc/d80/d44/d8e/ce2 0 2024-09-21T12:20:29.552 INFO:tasks.workunit.client.1.smithi192.stdout:0/718: dwrite d3/de/dc6/d72/d7a/dbe/d92/d51/f2b [0,4194304] 0 2024-09-21T12:20:29.554 INFO:tasks.workunit.client.0.smithi003.stdout:0/124: getdents d9 0 2024-09-21T12:20:29.555 INFO:tasks.workunit.client.1.smithi192.stdout:6/808: creat da/d1f/d48/d7d/d9a/d9e/dbe/f10e x:0 0 0 2024-09-21T12:20:29.559 INFO:tasks.workunit.client.0.smithi003.stdout:8/102: truncate d7/df/d16/f17 34109 0 2024-09-21T12:20:29.565 INFO:tasks.workunit.client.0.smithi003.stdout:9/233: mkdir d2/d53 0 2024-09-21T12:20:29.565 INFO:tasks.workunit.client.0.smithi003.stdout:9/234: read d2/d20/f21 [136129,9251] 0 2024-09-21T12:20:29.567 INFO:tasks.workunit.client.0.smithi003.stdout:9/235: dread - d2/da/d35/d4d/f4e zero size 2024-09-21T12:20:29.567 INFO:tasks.workunit.client.1.smithi192.stdout:1/720: getdents d2/d12/d2f/d51 0 2024-09-21T12:20:29.569 INFO:tasks.workunit.client.1.smithi192.stdout:4/650: read d2/db/d3e/d41/f5f [377127,87950] 0 2024-09-21T12:20:29.569 INFO:tasks.workunit.client.0.smithi003.stdout:1/92: rename d4/d11/c18 to d4/d11/d14/c24 0 2024-09-21T12:20:29.569 INFO:tasks.workunit.client.0.smithi003.stdout:1/93: chown d4/df/f1a 1000 0 2024-09-21T12:20:29.570 INFO:tasks.workunit.client.1.smithi192.stdout:2/671: mknod d1b/d1e/d3d/cdf 0 2024-09-21T12:20:29.570 INFO:tasks.workunit.client.0.smithi003.stdout:2/89: mkdir d0/d21 0 2024-09-21T12:20:29.571 INFO:tasks.workunit.client.1.smithi192.stdout:2/672: write d1b/fb7 [1840081,3250] 0 2024-09-21T12:20:29.573 INFO:tasks.workunit.client.1.smithi192.stdout:2/673: read d1b/d38/f4d [287603,100738] 0 2024-09-21T12:20:29.574 INFO:tasks.workunit.client.0.smithi003.stdout:4/72: creat d9/f13 x:0 0 0 2024-09-21T12:20:29.576 INFO:tasks.workunit.client.0.smithi003.stdout:3/101: symlink d0/d5/d9/d11/l1b 0 2024-09-21T12:20:29.577 INFO:tasks.workunit.client.0.smithi003.stdout:8/103: mkdir d7/df/d20 0 2024-09-21T12:20:29.577 INFO:tasks.workunit.client.0.smithi003.stdout:2/90: dwrite d0/dd/d16/f19 [0,4194304] 0 2024-09-21T12:20:29.579 INFO:tasks.workunit.client.1.smithi192.stdout:7/677: creat d6/d9/d2d/d7b/fea x:0 0 0 2024-09-21T12:20:29.580 INFO:tasks.workunit.client.1.smithi192.stdout:9/726: mkdir d5/dc/d40/dad/de3 0 2024-09-21T12:20:29.580 INFO:tasks.workunit.client.1.smithi192.stdout:0/719: dread d3/de/dc6/f3f [0,4194304] 0 2024-09-21T12:20:29.583 INFO:tasks.workunit.client.1.smithi192.stdout:6/809: write da/d1f/d27/f28 [3179782,60193] 0 2024-09-21T12:20:29.584 INFO:tasks.workunit.client.0.smithi003.stdout:2/91: dread d0/f5 [0,4194304] 0 2024-09-21T12:20:29.584 INFO:tasks.workunit.client.1.smithi192.stdout:7/678: dread d6/d9/d2d/d7b/f9e [0,4194304] 0 2024-09-21T12:20:29.584 INFO:tasks.workunit.client.0.smithi003.stdout:2/92: fsync d0/ff 0 2024-09-21T12:20:29.585 INFO:tasks.workunit.client.0.smithi003.stdout:2/93: fsync d0/f18 0 2024-09-21T12:20:29.585 INFO:tasks.workunit.client.1.smithi192.stdout:6/810: write da/d1f/d48/d7d/daa/dd7/f10d [434986,68679] 0 2024-09-21T12:20:29.588 INFO:tasks.workunit.client.0.smithi003.stdout:0/125: symlink d9/d12/d22/l23 0 2024-09-21T12:20:29.590 INFO:tasks.workunit.client.0.smithi003.stdout:3/102: rmdir d0/d5/d9 39 2024-09-21T12:20:29.593 INFO:tasks.workunit.client.0.smithi003.stdout:8/104: unlink f3 0 2024-09-21T12:20:29.594 INFO:tasks.workunit.client.0.smithi003.stdout:8/105: truncate d7/f18 274658 0 2024-09-21T12:20:29.595 INFO:tasks.workunit.client.0.smithi003.stdout:8/106: stat d7/df/d16 0 2024-09-21T12:20:29.596 INFO:tasks.workunit.client.0.smithi003.stdout:7/106: link l5 d8/l24 0 2024-09-21T12:20:29.596 INFO:tasks.workunit.client.0.smithi003.stdout:7/107: read d8/db/f16 [3699334,14130] 0 2024-09-21T12:20:29.597 INFO:tasks.workunit.client.0.smithi003.stdout:6/117: link l0 d4/d13/d19/l24 0 2024-09-21T12:20:29.599 INFO:tasks.workunit.client.0.smithi003.stdout:6/118: write d4/d9/fd [5031647,20907] 0 2024-09-21T12:20:29.604 INFO:tasks.workunit.client.0.smithi003.stdout:2/94: rmdir d0/d1c 39 2024-09-21T12:20:29.611 INFO:tasks.workunit.client.0.smithi003.stdout:3/103: write d0/f16 [2874704,5380] 0 2024-09-21T12:20:29.619 INFO:tasks.workunit.client.0.smithi003.stdout:7/108: mkdir d8/db/d13/d25 0 2024-09-21T12:20:29.623 INFO:tasks.workunit.client.0.smithi003.stdout:9/236: link d2/da/d2a/l2d d2/da/d35/l54 0 2024-09-21T12:20:29.629 INFO:tasks.workunit.client.0.smithi003.stdout:9/237: dwrite d2/da/d17/f2c [0,4194304] 0 2024-09-21T12:20:29.633 INFO:tasks.workunit.client.0.smithi003.stdout:4/73: rename f5 to d9/f14 0 2024-09-21T12:20:29.634 INFO:tasks.workunit.client.0.smithi003.stdout:3/104: mknod d0/d5/da/c1c 0 2024-09-21T12:20:29.636 INFO:tasks.workunit.client.0.smithi003.stdout:8/107: mkdir d7/df/d20/d21 0 2024-09-21T12:20:29.639 INFO:tasks.workunit.client.1.smithi192.stdout:3/613: dwrite db/f4f [0,4194304] 0 2024-09-21T12:20:29.644 INFO:tasks.workunit.client.0.smithi003.stdout:1/94: getdents d4/d11 0 2024-09-21T12:20:29.646 INFO:tasks.workunit.client.0.smithi003.stdout:2/95: rmdir d0/d1c 39 2024-09-21T12:20:29.646 INFO:tasks.workunit.client.0.smithi003.stdout:8/108: dwrite d7/df/f1b [0,4194304] 0 2024-09-21T12:20:29.646 INFO:tasks.workunit.client.1.smithi192.stdout:3/614: dwrite db/d16/db4/d8c/fe1 [0,4194304] 0 2024-09-21T12:20:29.647 INFO:tasks.workunit.client.1.smithi192.stdout:3/615: chown db/d16/d18/d33/d3b/d68/f86 605246 1 2024-09-21T12:20:29.651 INFO:tasks.workunit.client.0.smithi003.stdout:9/238: creat d2/da/d2a/f55 x:0 0 0 2024-09-21T12:20:29.651 INFO:tasks.workunit.client.0.smithi003.stdout:0/126: dwrite f4 [0,4194304] 0 2024-09-21T12:20:29.656 INFO:tasks.workunit.client.0.smithi003.stdout:7/109: rename d8/l23 to d8/db/d13/l26 0 2024-09-21T12:20:29.657 INFO:tasks.workunit.client.0.smithi003.stdout:7/110: read - d8/db/d13/f1a zero size 2024-09-21T12:20:29.658 INFO:tasks.workunit.client.0.smithi003.stdout:5/154: sync 2024-09-21T12:20:29.663 INFO:tasks.workunit.client.0.smithi003.stdout:1/95: fsync f2 0 2024-09-21T12:20:29.663 INFO:tasks.workunit.client.0.smithi003.stdout:1/96: chown d4/df 383543084 1 2024-09-21T12:20:29.664 INFO:tasks.workunit.client.0.smithi003.stdout:2/96: readlink d0/dd/d16/l20 0 2024-09-21T12:20:29.670 INFO:tasks.workunit.client.0.smithi003.stdout:0/127: truncate d9/d12/d1e/f1f 253372 0 2024-09-21T12:20:29.671 INFO:tasks.workunit.client.1.smithi192.stdout:8/744: mkdir d14/d1a/de9/dfa 0 2024-09-21T12:20:29.671 INFO:tasks.workunit.client.1.smithi192.stdout:8/745: dread - d14/fc5 zero size 2024-09-21T12:20:29.672 INFO:tasks.workunit.client.0.smithi003.stdout:3/105: creat d0/d5/d9/d11/f1d x:0 0 0 2024-09-21T12:20:29.676 INFO:tasks.workunit.client.0.smithi003.stdout:5/155: unlink dc/d15/c1d 0 2024-09-21T12:20:29.677 INFO:tasks.workunit.client.0.smithi003.stdout:6/119: getdents d4/d11/d1d 0 2024-09-21T12:20:29.678 INFO:tasks.workunit.client.1.smithi192.stdout:0/720: mknod d3/de/d43/cd3 0 2024-09-21T12:20:29.679 INFO:tasks.workunit.client.1.smithi192.stdout:5/947: link d0/d2/c20 d0/d65/d6e/dc0/d44/c144 0 2024-09-21T12:20:29.680 INFO:tasks.workunit.client.1.smithi192.stdout:5/948: fdatasync d0/d65/d6e/dc0/d44/d85/d97/d9e/dd5/f10f 0 2024-09-21T12:20:29.681 INFO:tasks.workunit.client.0.smithi003.stdout:8/109: fsync d7/df/f1b 0 2024-09-21T12:20:29.681 INFO:tasks.workunit.client.1.smithi192.stdout:7/679: mkdir d6/d9/d70/d77/dcd/deb 0 2024-09-21T12:20:29.683 INFO:tasks.workunit.client.1.smithi192.stdout:5/949: dread d0/d65/d6e/d84/d126/d104/f46 [0,4194304] 0 2024-09-21T12:20:29.685 INFO:tasks.workunit.client.1.smithi192.stdout:6/811: rename da/f95 to da/d23/d37/d75/de2/d104/f10f 0 2024-09-21T12:20:29.690 INFO:tasks.workunit.client.0.smithi003.stdout:0/128: creat d9/d12/d22/f24 x:0 0 0 2024-09-21T12:20:29.691 INFO:tasks.workunit.client.0.smithi003.stdout:3/106: rmdir d0/d5 39 2024-09-21T12:20:29.692 INFO:tasks.workunit.client.0.smithi003.stdout:3/107: fdatasync d0/f16 0 2024-09-21T12:20:29.692 INFO:tasks.workunit.client.0.smithi003.stdout:3/108: chown d0 2070 1 2024-09-21T12:20:29.695 INFO:tasks.workunit.client.0.smithi003.stdout:5/156: mkdir dc/d15/d21/d30 0 2024-09-21T12:20:29.697 INFO:tasks.workunit.client.0.smithi003.stdout:6/120: mknod d4/d9/c25 0 2024-09-21T12:20:29.699 INFO:tasks.workunit.client.1.smithi192.stdout:3/616: mknod db/d16/d18/d40/d60/d7b/ce5 0 2024-09-21T12:20:29.700 INFO:tasks.workunit.client.0.smithi003.stdout:8/110: rename d7/de to d7/de/d22 22 2024-09-21T12:20:29.701 INFO:tasks.workunit.client.0.smithi003.stdout:6/121: dread d4/fb [0,4194304] 0 2024-09-21T12:20:29.702 INFO:tasks.workunit.client.1.smithi192.stdout:9/727: mkdir d5/dc/d80/d44/d79/de4 0 2024-09-21T12:20:29.703 INFO:tasks.workunit.client.0.smithi003.stdout:4/74: truncate d9/da/fb 5669355 0 2024-09-21T12:20:29.704 INFO:tasks.workunit.client.1.smithi192.stdout:0/721: creat d3/de/d33/fd4 x:0 0 0 2024-09-21T12:20:29.705 INFO:tasks.workunit.client.1.smithi192.stdout:0/722: fsync d3/de/dc6/d72/d7a/dbe/d92/f3e 0 2024-09-21T12:20:29.706 INFO:tasks.workunit.client.0.smithi003.stdout:0/129: rename d9/d12/d22/l23 to d9/d12/d22/l25 0 2024-09-21T12:20:29.706 INFO:tasks.workunit.client.1.smithi192.stdout:7/680: symlink d6/d3a/lec 0 2024-09-21T12:20:29.709 INFO:tasks.workunit.client.0.smithi003.stdout:6/122: dwrite f3 [4194304,4194304] 0 2024-09-21T12:20:29.712 INFO:tasks.workunit.client.0.smithi003.stdout:7/111: rmdir d8/db/d13/d25 0 2024-09-21T12:20:29.712 INFO:tasks.workunit.client.0.smithi003.stdout:9/239: write f1 [4746688,130015] 0 2024-09-21T12:20:29.713 INFO:tasks.workunit.client.0.smithi003.stdout:1/97: dwrite f2 [0,4194304] 0 2024-09-21T12:20:29.713 INFO:tasks.workunit.client.1.smithi192.stdout:6/812: symlink da/d23/d37/d75/de2/d104/l110 0 2024-09-21T12:20:29.715 INFO:tasks.workunit.client.1.smithi192.stdout:1/721: link d2/da/d9f/lcb d2/d12/d2f/d41/d5c/lec 0 2024-09-21T12:20:29.717 INFO:tasks.workunit.client.1.smithi192.stdout:1/722: truncate d2/d4d/fb8 997809 0 2024-09-21T12:20:29.717 INFO:tasks.workunit.client.1.smithi192.stdout:1/723: chown d2/d4d/f6f 4 1 2024-09-21T12:20:29.722 INFO:tasks.workunit.client.0.smithi003.stdout:8/111: unlink d7/de/f1d 0 2024-09-21T12:20:29.724 INFO:tasks.workunit.client.1.smithi192.stdout:8/746: creat d14/d1a/d1d/d48/de2/ffb x:0 0 0 2024-09-21T12:20:29.726 INFO:tasks.workunit.client.0.smithi003.stdout:2/97: write d0/dd/f1b [506682,50170] 0 2024-09-21T12:20:29.727 INFO:tasks.workunit.client.0.smithi003.stdout:0/130: mkdir d9/d12/d15/d26 0 2024-09-21T12:20:29.727 INFO:tasks.workunit.client.0.smithi003.stdout:2/98: stat d0/f5 0 2024-09-21T12:20:29.728 INFO:tasks.workunit.client.0.smithi003.stdout:2/99: truncate d0/f1d 486919 0 2024-09-21T12:20:29.732 INFO:tasks.workunit.client.0.smithi003.stdout:6/123: fdatasync d4/f5 0 2024-09-21T12:20:29.732 INFO:tasks.workunit.client.1.smithi192.stdout:2/674: truncate d1b/d1e/d5e/d75/dab/fae 4107820 0 2024-09-21T12:20:29.733 INFO:tasks.workunit.client.1.smithi192.stdout:2/675: write d1b/d1e/d62/fa4 [976573,4034] 0 2024-09-21T12:20:29.735 INFO:tasks.workunit.client.1.smithi192.stdout:7/681: creat d6/d9/d51/fed x:0 0 0 2024-09-21T12:20:29.737 INFO:tasks.workunit.client.0.smithi003.stdout:7/112: creat d8/db/d13/f27 x:0 0 0 2024-09-21T12:20:29.739 INFO:tasks.workunit.client.1.smithi192.stdout:2/676: dwrite f19 [0,4194304] 0 2024-09-21T12:20:29.739 INFO:tasks.workunit.client.0.smithi003.stdout:5/157: mknod dc/c31 0 2024-09-21T12:20:29.741 INFO:tasks.workunit.client.1.smithi192.stdout:4/651: getdents d2/db/d34/d56/d6c/db8 0 2024-09-21T12:20:29.741 INFO:tasks.workunit.client.1.smithi192.stdout:2/677: write d1b/d38/d53/f6d [4878635,3122] 0 2024-09-21T12:20:29.742 INFO:tasks.workunit.client.1.smithi192.stdout:7/682: dwrite d6/d9/d51/f23 [4194304,4194304] 0 2024-09-21T12:20:29.745 INFO:tasks.workunit.client.1.smithi192.stdout:3/617: mkdir db/d16/d18/de6 0 2024-09-21T12:20:29.748 INFO:tasks.workunit.client.1.smithi192.stdout:2/678: dwrite d1b/d1e/fad [0,4194304] 0 2024-09-21T12:20:29.748 INFO:tasks.workunit.client.0.smithi003.stdout:1/98: mkdir d4/d11/d14/d25 0 2024-09-21T12:20:29.753 INFO:tasks.workunit.client.1.smithi192.stdout:8/747: symlink d14/d1a/d1d/d48/lfc 0 2024-09-21T12:20:29.753 INFO:tasks.workunit.client.1.smithi192.stdout:5/950: write d0/d2/f14 [1990942,102865] 0 2024-09-21T12:20:29.754 INFO:tasks.workunit.client.1.smithi192.stdout:8/748: write d14/d1a/d1d/d20/d5f/fa3 [580247,116359] 0 2024-09-21T12:20:29.758 INFO:tasks.workunit.client.0.smithi003.stdout:1/99: dwrite d4/d11/f1e [0,4194304] 0 2024-09-21T12:20:29.761 INFO:tasks.workunit.client.0.smithi003.stdout:1/100: fdatasync d4/dc/f16 0 2024-09-21T12:20:29.761 INFO:tasks.workunit.client.0.smithi003.stdout:1/101: write d4/dc/f10 [1499386,93353] 0 2024-09-21T12:20:29.763 INFO:tasks.workunit.client.0.smithi003.stdout:1/102: write d4/dc/f16 [1158014,120364] 0 2024-09-21T12:20:29.766 INFO:tasks.workunit.client.0.smithi003.stdout:2/100: mkdir d0/dd/d22 0 2024-09-21T12:20:29.767 INFO:tasks.workunit.client.0.smithi003.stdout:2/101: write d0/fa [2449682,43339] 0 2024-09-21T12:20:29.768 INFO:tasks.workunit.client.0.smithi003.stdout:2/102: fsync d0/f14 0 2024-09-21T12:20:29.769 INFO:tasks.workunit.client.0.smithi003.stdout:6/124: creat d4/d13/d19/f26 x:0 0 0 2024-09-21T12:20:29.770 INFO:tasks.workunit.client.0.smithi003.stdout:2/103: write d0/dd/d16/f19 [3661647,9455] 0 2024-09-21T12:20:29.771 INFO:tasks.workunit.client.1.smithi192.stdout:6/813: creat da/dfc/f111 x:0 0 0 2024-09-21T12:20:29.771 INFO:tasks.workunit.client.0.smithi003.stdout:2/104: chown d0/dd/d16/f19 4 1 2024-09-21T12:20:29.772 INFO:tasks.workunit.client.0.smithi003.stdout:2/105: write d0/f14 [187600,71831] 0 2024-09-21T12:20:29.773 INFO:tasks.workunit.client.1.smithi192.stdout:6/814: write da/d1f/d48/d7d/d9a/d9e/dbe/fff [847758,13401] 0 2024-09-21T12:20:29.778 INFO:tasks.workunit.client.1.smithi192.stdout:4/652: creat d2/d36/d7f/fd8 x:0 0 0 2024-09-21T12:20:29.781 INFO:tasks.workunit.client.1.smithi192.stdout:7/683: mkdir d6/d9/d2d/d7b/dee 0 2024-09-21T12:20:29.781 INFO:tasks.workunit.client.1.smithi192.stdout:2/679: fdatasync d1b/d38/d53/d8b/da0/fba 0 2024-09-21T12:20:29.781 INFO:tasks.workunit.client.1.smithi192.stdout:6/815: dwrite da/d1f/d48/d7d/daa/dd7/f10d [0,4194304] 0 2024-09-21T12:20:29.783 INFO:tasks.workunit.client.1.smithi192.stdout:3/618: dread db/fbe [0,4194304] 0 2024-09-21T12:20:29.785 INFO:tasks.workunit.client.1.smithi192.stdout:8/749: creat d14/d1a/d1d/d48/ffd x:0 0 0 2024-09-21T12:20:29.785 INFO:tasks.workunit.client.1.smithi192.stdout:3/619: readlink db/d16/d18/d40/d60/d7b/l98 0 2024-09-21T12:20:29.786 INFO:tasks.workunit.client.0.smithi003.stdout:8/112: symlink d7/df/d20/d21/l23 0 2024-09-21T12:20:29.786 INFO:tasks.workunit.client.0.smithi003.stdout:8/113: readlink l5 0 2024-09-21T12:20:29.787 INFO:tasks.workunit.client.1.smithi192.stdout:8/750: chown d14/d1a/d1d/d48/c6e 144729842 1 2024-09-21T12:20:29.789 INFO:tasks.workunit.client.1.smithi192.stdout:4/653: unlink d2/db/d34/d56/d6c/db8/d88/d92/f9b 0 2024-09-21T12:20:29.791 INFO:tasks.workunit.client.0.smithi003.stdout:4/75: dread d9/f14 [0,4194304] 0 2024-09-21T12:20:29.792 INFO:tasks.workunit.client.0.smithi003.stdout:4/76: fdatasync f6 0 2024-09-21T12:20:29.792 INFO:tasks.workunit.client.1.smithi192.stdout:3/620: dread db/d16/d18/d21/d23/dd2/d2e/f45 [8388608,4194304] 0 2024-09-21T12:20:29.793 INFO:tasks.workunit.client.0.smithi003.stdout:1/103: creat d4/f26 x:0 0 0 2024-09-21T12:20:29.793 INFO:tasks.workunit.client.1.smithi192.stdout:9/728: getdents d5/dc 0 2024-09-21T12:20:29.795 INFO:tasks.workunit.client.1.smithi192.stdout:8/751: dwrite d14/d18/d94/dc3/ff3 [0,4194304] 0 2024-09-21T12:20:29.795 INFO:tasks.workunit.client.1.smithi192.stdout:3/621: write db/d16/d18/d40/d60/fce [912969,112670] 0 2024-09-21T12:20:29.797 INFO:tasks.workunit.client.0.smithi003.stdout:2/106: dread d0/fa [0,4194304] 0 2024-09-21T12:20:29.797 INFO:tasks.workunit.client.1.smithi192.stdout:8/752: write d14/d18/daf/fe6 [998848,83987] 0 2024-09-21T12:20:29.797 INFO:tasks.workunit.client.1.smithi192.stdout:2/680: unlink d1b/d1e/cdc 0 2024-09-21T12:20:29.798 INFO:tasks.workunit.client.1.smithi192.stdout:3/622: dread - db/d16/d18/d21/d23/d71/fd8 zero size 2024-09-21T12:20:29.799 INFO:tasks.workunit.client.1.smithi192.stdout:8/753: dread - d14/d1a/d1d/d46/d4e/d83/fbf zero size 2024-09-21T12:20:29.799 INFO:tasks.workunit.client.1.smithi192.stdout:2/681: fsync d1b/d1e/d5e/d88/d95/dbe/fd2 0 2024-09-21T12:20:29.799 INFO:tasks.workunit.client.1.smithi192.stdout:6/816: symlink da/d1f/d56/d78/l112 0 2024-09-21T12:20:29.800 INFO:tasks.workunit.client.1.smithi192.stdout:2/682: stat d1b/d1e/d5e/d75/f82 0 2024-09-21T12:20:29.801 INFO:tasks.workunit.client.0.smithi003.stdout:4/77: dwrite d9/fc [4194304,4194304] 0 2024-09-21T12:20:29.802 INFO:tasks.workunit.client.0.smithi003.stdout:6/125: truncate d4/f10 167272 0 2024-09-21T12:20:29.805 INFO:tasks.workunit.client.0.smithi003.stdout:3/109: rename d0/d5/d9/fe to d0/d5/f1e 0 2024-09-21T12:20:29.806 INFO:tasks.workunit.client.0.smithi003.stdout:3/110: readlink d0/d5/d9/dd/l12 0 2024-09-21T12:20:29.806 INFO:tasks.workunit.client.0.smithi003.stdout:3/111: dread - d0/f19 zero size 2024-09-21T12:20:29.807 INFO:tasks.workunit.client.1.smithi192.stdout:0/723: truncate d3/de/dc6/d83/d87/faa 612357 0 2024-09-21T12:20:29.814 INFO:tasks.workunit.client.0.smithi003.stdout:3/112: dwrite d0/d5/d9/d11/f1d [0,4194304] 0 2024-09-21T12:20:29.814 INFO:tasks.workunit.client.0.smithi003.stdout:5/158: unlink dc/d15/d1c/c20 0 2024-09-21T12:20:29.818 INFO:tasks.workunit.client.0.smithi003.stdout:8/114: write d7/f14 [2375766,56783] 0 2024-09-21T12:20:29.823 INFO:tasks.workunit.client.0.smithi003.stdout:1/104: symlink d4/df/d12/l27 0 2024-09-21T12:20:29.825 INFO:tasks.workunit.client.1.smithi192.stdout:6/817: rmdir da/d1f/d48/d7d/d9a/d9e/dbe 39 2024-09-21T12:20:29.828 INFO:tasks.workunit.client.0.smithi003.stdout:6/126: creat d4/d13/f27 x:0 0 0 2024-09-21T12:20:29.830 INFO:tasks.workunit.client.0.smithi003.stdout:6/127: truncate d4/d13/f27 941622 0 2024-09-21T12:20:29.831 INFO:tasks.workunit.client.1.smithi192.stdout:0/724: fsync d3/f7d 0 2024-09-21T12:20:29.833 INFO:tasks.workunit.client.0.smithi003.stdout:7/113: link l6 d8/l28 0 2024-09-21T12:20:29.835 INFO:tasks.workunit.client.1.smithi192.stdout:3/623: rename db/d16/c6a to db/d16/d18/d21/d23/d71/ce7 0 2024-09-21T12:20:29.835 INFO:tasks.workunit.client.1.smithi192.stdout:9/729: dread d5/d8/d2c/f58 [0,4194304] 0 2024-09-21T12:20:29.836 INFO:tasks.workunit.client.1.smithi192.stdout:3/624: chown db/d16/d18/d21/d23/dd2/d2e/db8/dd0/dd3 13 1 2024-09-21T12:20:29.837 INFO:tasks.workunit.client.0.smithi003.stdout:5/159: rename dc/c22 to dc/d15/d21/d28/c32 0 2024-09-21T12:20:29.839 INFO:tasks.workunit.client.1.smithi192.stdout:2/683: truncate d1b/f6a 944935 0 2024-09-21T12:20:29.840 INFO:tasks.workunit.client.0.smithi003.stdout:9/240: getdents d2/da/d35 0 2024-09-21T12:20:29.842 INFO:tasks.workunit.client.0.smithi003.stdout:8/115: mkdir d7/df/d20/d24 0 2024-09-21T12:20:29.843 INFO:tasks.workunit.client.1.smithi192.stdout:5/951: getdents d0/d65/d6e/d84/d126/d13 0 2024-09-21T12:20:29.844 INFO:tasks.workunit.client.1.smithi192.stdout:5/952: truncate d0/d65/d6e/da7/da0/f11e 1013748 0 2024-09-21T12:20:29.845 INFO:tasks.workunit.client.0.smithi003.stdout:1/105: creat d4/dc/f28 x:0 0 0 2024-09-21T12:20:29.847 INFO:tasks.workunit.client.0.smithi003.stdout:9/241: dwrite d2/da/d17/d40/f44 [0,4194304] 0 2024-09-21T12:20:29.851 INFO:tasks.workunit.client.1.smithi192.stdout:0/725: unlink d3/de/d9b/lcd 0 2024-09-21T12:20:29.855 INFO:tasks.workunit.client.1.smithi192.stdout:9/730: symlink d5/d19/d32/dc0/le5 0 2024-09-21T12:20:29.857 INFO:tasks.workunit.client.0.smithi003.stdout:6/128: mknod d4/d11/c28 0 2024-09-21T12:20:29.858 INFO:tasks.workunit.client.0.smithi003.stdout:6/129: write d4/fc [500179,53154] 0 2024-09-21T12:20:29.858 INFO:tasks.workunit.client.1.smithi192.stdout:4/654: write d2/db/d34/d56/f9a [624386,28189] 0 2024-09-21T12:20:29.860 INFO:tasks.workunit.client.1.smithi192.stdout:4/655: truncate d2/d36/d55/d89/fbc 2935472 0 2024-09-21T12:20:29.860 INFO:tasks.workunit.client.1.smithi192.stdout:2/684: rmdir d1b/d1e/d5e/d75 39 2024-09-21T12:20:29.860 INFO:tasks.workunit.client.1.smithi192.stdout:4/656: readlink d2/db/d3e/d57/d32/d4f/l51 0 2024-09-21T12:20:29.862 INFO:tasks.workunit.client.1.smithi192.stdout:2/685: read d1b/d1e/f47 [628746,116158] 0 2024-09-21T12:20:29.863 INFO:tasks.workunit.client.1.smithi192.stdout:6/818: mknod da/d23/d37/d75/d90/d103/c113 0 2024-09-21T12:20:29.866 INFO:tasks.workunit.client.1.smithi192.stdout:0/726: symlink d3/d5/d28/d39/ld5 0 2024-09-21T12:20:29.867 INFO:tasks.workunit.client.1.smithi192.stdout:8/754: write d14/d1a/d1d/d46/f4f [1319739,77694] 0 2024-09-21T12:20:29.867 INFO:tasks.workunit.client.0.smithi003.stdout:7/114: dwrite d8/db/d13/f1e [0,4194304] 0 2024-09-21T12:20:29.867 INFO:tasks.workunit.client.0.smithi003.stdout:6/130: dwrite d4/f5 [4194304,4194304] 0 2024-09-21T12:20:29.872 INFO:tasks.workunit.client.0.smithi003.stdout:1/106: symlink d4/l29 0 2024-09-21T12:20:29.877 INFO:tasks.workunit.client.1.smithi192.stdout:4/657: fdatasync d2/db/d34/d56/d6c/db8/d88/fb2 0 2024-09-21T12:20:29.877 INFO:tasks.workunit.client.0.smithi003.stdout:9/242: symlink d2/da/d2a/d3c/l56 0 2024-09-21T12:20:29.879 INFO:tasks.workunit.client.0.smithi003.stdout:7/115: dwrite d8/db/ff [0,4194304] 0 2024-09-21T12:20:29.879 INFO:tasks.workunit.client.1.smithi192.stdout:4/658: read d2/d36/d7f/d68/f78 [4031537,39311] 0 2024-09-21T12:20:29.886 INFO:tasks.workunit.client.0.smithi003.stdout:1/107: dwrite d4/f13 [0,4194304] 0 2024-09-21T12:20:29.886 INFO:tasks.workunit.client.0.smithi003.stdout:3/113: creat d0/f1f x:0 0 0 2024-09-21T12:20:29.887 INFO:tasks.workunit.client.1.smithi192.stdout:0/727: symlink d3/de/dc6/d83/d87/ld6 0 2024-09-21T12:20:29.888 INFO:tasks.workunit.client.0.smithi003.stdout:1/108: fsync d4/f7 0 2024-09-21T12:20:29.891 INFO:tasks.workunit.client.1.smithi192.stdout:3/625: creat db/d16/db4/fe8 x:0 0 0 2024-09-21T12:20:29.892 INFO:tasks.workunit.client.0.smithi003.stdout:4/78: truncate f8 1645548 0 2024-09-21T12:20:29.893 INFO:tasks.workunit.client.0.smithi003.stdout:9/243: dwrite d2/da/d17/d40/f4a [0,4194304] 0 2024-09-21T12:20:29.894 INFO:tasks.workunit.client.0.smithi003.stdout:5/160: creat dc/d15/d21/d30/f33 x:0 0 0 2024-09-21T12:20:29.895 INFO:tasks.workunit.client.1.smithi192.stdout:0/728: dread d3/de/dc6/fd [0,4194304] 0 2024-09-21T12:20:29.896 INFO:tasks.workunit.client.0.smithi003.stdout:8/116: fsync f4 0 2024-09-21T12:20:29.896 INFO:tasks.workunit.client.1.smithi192.stdout:9/731: mkdir d5/dc/d80/d44/d8e/dd6/dd8/de6 0 2024-09-21T12:20:29.900 INFO:tasks.workunit.client.0.smithi003.stdout:6/131: mknod d4/d13/c29 0 2024-09-21T12:20:29.900 INFO:tasks.workunit.client.0.smithi003.stdout:2/107: dwrite d0/f13 [4194304,4194304] 0 2024-09-21T12:20:29.901 INFO:tasks.workunit.client.0.smithi003.stdout:7/116: fsync d8/db/ff 0 2024-09-21T12:20:29.906 INFO:tasks.workunit.client.0.smithi003.stdout:5/161: dread dc/f1a [0,4194304] 0 2024-09-21T12:20:29.907 INFO:tasks.workunit.client.1.smithi192.stdout:8/755: creat d14/d1a/d1d/d48/de1/ffe x:0 0 0 2024-09-21T12:20:29.908 INFO:tasks.workunit.client.1.smithi192.stdout:8/756: truncate d14/d1a/d1d/d48/de1/ffe 204115 0 2024-09-21T12:20:29.909 INFO:tasks.workunit.client.0.smithi003.stdout:5/162: write dc/d15/d1c/f29 [66353,106984] 0 2024-09-21T12:20:29.909 INFO:tasks.workunit.client.0.smithi003.stdout:1/109: creat d4/d11/f2a x:0 0 0 2024-09-21T12:20:29.911 INFO:tasks.workunit.client.0.smithi003.stdout:3/114: creat d0/d5/d9/d11/f20 x:0 0 0 2024-09-21T12:20:29.912 INFO:tasks.workunit.client.0.smithi003.stdout:3/115: chown d0/f19 1608 1 2024-09-21T12:20:29.914 INFO:tasks.workunit.client.1.smithi192.stdout:9/732: rename d5/dc/d80/d44/d79 to d5/d8/dc7/dd7/de7 0 2024-09-21T12:20:29.918 INFO:tasks.workunit.client.1.smithi192.stdout:5/953: getdents d0/d65/d6e/d84/d126/d13/d37/da8/daa/dc5/ddd 0 2024-09-21T12:20:29.921 INFO:tasks.workunit.client.1.smithi192.stdout:0/729: mkdir d3/d5/dd7 0 2024-09-21T12:20:29.922 INFO:tasks.workunit.client.1.smithi192.stdout:6/819: dwrite da/fc [0,4194304] 0 2024-09-21T12:20:29.922 INFO:tasks.workunit.client.1.smithi192.stdout:3/626: dread db/d16/d18/d33/f83 [0,4194304] 0 2024-09-21T12:20:29.923 INFO:tasks.workunit.client.1.smithi192.stdout:1/724: sync 2024-09-21T12:20:29.923 INFO:tasks.workunit.client.0.smithi003.stdout:9/244: creat d2/da/d17/d40/f57 x:0 0 0 2024-09-21T12:20:29.924 INFO:tasks.workunit.client.1.smithi192.stdout:3/627: fsync db/d16/d18/d33/d3b/db1/fbb 0 2024-09-21T12:20:29.924 INFO:tasks.workunit.client.0.smithi003.stdout:9/245: fdatasync d2/da/d17/f27 0 2024-09-21T12:20:29.927 INFO:tasks.workunit.client.1.smithi192.stdout:8/757: rename d14/d1a/f2e to d14/d1a/d1d/d48/de1/fff 0 2024-09-21T12:20:29.930 INFO:tasks.workunit.client.1.smithi192.stdout:9/733: truncate d5/d19/dd5/f9a 5085595 0 2024-09-21T12:20:29.930 INFO:tasks.workunit.client.1.smithi192.stdout:8/758: write d14/d1a/d1d/d46/d4e/d83/d8d/d9c/dee/d80/d9a/dba/feb [378352,92444] 0 2024-09-21T12:20:29.931 INFO:tasks.workunit.client.1.smithi192.stdout:2/686: write d1b/f5b [288662,106950] 0 2024-09-21T12:20:29.932 INFO:tasks.workunit.client.0.smithi003.stdout:7/117: mknod d8/db/d13/c29 0 2024-09-21T12:20:29.934 INFO:tasks.workunit.client.1.smithi192.stdout:6/820: symlink da/d1f/d48/d7d/daa/dd7/l114 0 2024-09-21T12:20:29.935 INFO:tasks.workunit.client.1.smithi192.stdout:4/659: write d2/db/d3e/d57/d32/d4f/d71/d9d/dad/d4b/f62 [796306,98291] 0 2024-09-21T12:20:29.936 INFO:tasks.workunit.client.0.smithi003.stdout:5/163: creat dc/d15/d21/d30/f34 x:0 0 0 2024-09-21T12:20:29.937 INFO:tasks.workunit.client.1.smithi192.stdout:6/821: read - da/d1f/d56/da9/dcd/f106 zero size 2024-09-21T12:20:29.939 INFO:tasks.workunit.client.1.smithi192.stdout:2/687: dwrite d1b/d38/d53/d8b/da7/fd4 [0,4194304] 0 2024-09-21T12:20:29.939 INFO:tasks.workunit.client.0.smithi003.stdout:5/164: dread dc/d15/d21/f24 [0,4194304] 0 2024-09-21T12:20:29.939 INFO:tasks.workunit.client.1.smithi192.stdout:3/628: truncate db/d16/db4/fa2 236308 0 2024-09-21T12:20:29.940 INFO:tasks.workunit.client.1.smithi192.stdout:3/629: dread - db/d16/d18/d21/d23/d71/fdb zero size 2024-09-21T12:20:29.940 INFO:tasks.workunit.client.1.smithi192.stdout:9/734: dread d5/dc/d64/dbb/f9f [0,4194304] 0 2024-09-21T12:20:29.941 INFO:tasks.workunit.client.0.smithi003.stdout:5/165: chown dc/d15/d1c/c2a 9737090 1 2024-09-21T12:20:29.943 INFO:tasks.workunit.client.1.smithi192.stdout:0/730: rename d3/d5/d28/d39/ld5 to d3/de/d9b/ld8 0 2024-09-21T12:20:29.945 INFO:tasks.workunit.client.1.smithi192.stdout:0/731: write d3/de/d33/f5f [761378,25191] 0 2024-09-21T12:20:29.946 INFO:tasks.workunit.client.1.smithi192.stdout:9/735: dwrite d5/dc/d80/d44/d8e/f98 [4194304,4194304] 0 2024-09-21T12:20:29.952 INFO:tasks.workunit.client.1.smithi192.stdout:8/759: creat d14/d1a/d1d/d46/d4e/db5/f100 x:0 0 0 2024-09-21T12:20:29.956 INFO:tasks.workunit.client.1.smithi192.stdout:1/725: symlink d2/led 0 2024-09-21T12:20:29.958 INFO:tasks.workunit.client.0.smithi003.stdout:2/108: creat d0/dd/d22/f23 x:0 0 0 2024-09-21T12:20:29.958 INFO:tasks.workunit.client.1.smithi192.stdout:4/660: rmdir d2/db/d34/d56/d83 39 2024-09-21T12:20:29.961 INFO:tasks.workunit.client.0.smithi003.stdout:2/109: dread d0/dd/f1b [0,4194304] 0 2024-09-21T12:20:29.961 INFO:tasks.workunit.client.0.smithi003.stdout:7/118: rmdir d8/db 39 2024-09-21T12:20:29.962 INFO:tasks.workunit.client.0.smithi003.stdout:2/110: read - d0/dd/d22/f23 zero size 2024-09-21T12:20:29.963 INFO:tasks.workunit.client.0.smithi003.stdout:1/110: link d4/dc/f28 d4/df/d19/f2b 0 2024-09-21T12:20:29.964 INFO:tasks.workunit.client.0.smithi003.stdout:1/111: chown d4/dc/c17 401 1 2024-09-21T12:20:29.966 INFO:tasks.workunit.client.0.smithi003.stdout:4/79: creat d9/f15 x:0 0 0 2024-09-21T12:20:29.967 INFO:tasks.workunit.client.1.smithi192.stdout:5/954: write d0/d65/d6e/dc0/d44/d85/d97/f6c [1124534,43090] 0 2024-09-21T12:20:29.968 INFO:tasks.workunit.client.0.smithi003.stdout:4/80: write d9/da/fd [5998692,130143] 0 2024-09-21T12:20:29.970 INFO:tasks.workunit.client.0.smithi003.stdout:2/111: dwrite d0/dd/f12 [0,4194304] 0 2024-09-21T12:20:29.971 INFO:tasks.workunit.client.1.smithi192.stdout:0/732: rename d3/de/dc6/d72 to d3/d5/d28/d39/d50/dd9 0 2024-09-21T12:20:29.973 INFO:tasks.workunit.client.0.smithi003.stdout:1/112: dread d4/dc/f16 [0,4194304] 0 2024-09-21T12:20:29.974 INFO:tasks.workunit.client.0.smithi003.stdout:4/81: dread d9/f14 [4194304,4194304] 0 2024-09-21T12:20:29.974 INFO:tasks.workunit.client.1.smithi192.stdout:9/736: creat d5/dc/d80/d44/d8e/fe8 x:0 0 0 2024-09-21T12:20:29.975 INFO:tasks.workunit.client.0.smithi003.stdout:4/82: write d9/fc [4597086,41451] 0 2024-09-21T12:20:29.977 INFO:tasks.workunit.client.1.smithi192.stdout:8/760: write d14/d1a/d1d/db6/fb8 [4718819,31423] 0 2024-09-21T12:20:29.981 INFO:tasks.workunit.client.1.smithi192.stdout:6/822: creat da/d1f/d48/d7d/d9a/d9e/dbe/f115 x:0 0 0 2024-09-21T12:20:29.982 INFO:tasks.workunit.client.0.smithi003.stdout:0/131: sync 2024-09-21T12:20:29.983 INFO:tasks.workunit.client.1.smithi192.stdout:2/688: mknod d1b/d1e/ce0 0 2024-09-21T12:20:29.985 INFO:tasks.workunit.client.0.smithi003.stdout:0/132: truncate d9/d12/d22/f24 298613 0 2024-09-21T12:20:29.986 INFO:tasks.workunit.client.0.smithi003.stdout:2/112: rmdir d0 39 2024-09-21T12:20:29.987 INFO:tasks.workunit.client.1.smithi192.stdout:6/823: dwrite da/d1f/d27/fb1 [4194304,4194304] 0 2024-09-21T12:20:29.988 INFO:tasks.workunit.client.0.smithi003.stdout:1/113: rmdir d4/df 39 2024-09-21T12:20:29.989 INFO:tasks.workunit.client.0.smithi003.stdout:3/116: dwrite d0/d5/f1e [4194304,4194304] 0 2024-09-21T12:20:29.991 INFO:tasks.workunit.client.0.smithi003.stdout:3/117: stat d0/d5/da/c17 0 2024-09-21T12:20:29.995 INFO:tasks.workunit.client.1.smithi192.stdout:1/726: creat d2/d12/d2f/d51/d24/d65/d8b/dd5/fee x:0 0 0 2024-09-21T12:20:29.996 INFO:tasks.workunit.client.1.smithi192.stdout:1/727: chown d2/da/d6b/d7d/l7e 10199443 1 2024-09-21T12:20:29.997 INFO:tasks.workunit.client.1.smithi192.stdout:8/761: creat d14/d1a/d1d/d48/de2/f101 x:0 0 0 2024-09-21T12:20:29.999 INFO:tasks.workunit.client.0.smithi003.stdout:1/114: dwrite d4/dc/f1c [0,4194304] 0 2024-09-21T12:20:30.002 INFO:tasks.workunit.client.0.smithi003.stdout:5/166: truncate dc/d15/d21/f24 1568474 0 2024-09-21T12:20:30.003 INFO:tasks.workunit.client.0.smithi003.stdout:5/167: chown dc/c31 9133298 1 2024-09-21T12:20:30.004 INFO:tasks.workunit.client.0.smithi003.stdout:6/132: getdents d4/d9 0 2024-09-21T12:20:30.007 INFO:tasks.workunit.client.1.smithi192.stdout:3/630: creat db/d16/d18/d21/fe9 x:0 0 0 2024-09-21T12:20:30.009 INFO:tasks.workunit.client.0.smithi003.stdout:2/113: readlink d0/dd/d16/l20 0 2024-09-21T12:20:30.009 INFO:tasks.workunit.client.1.smithi192.stdout:6/824: mknod da/d23/d37/d75/de2/dec/c116 0 2024-09-21T12:20:30.010 INFO:tasks.workunit.client.0.smithi003.stdout:0/133: dread d9/d12/f1c [0,4194304] 0 2024-09-21T12:20:30.010 INFO:tasks.workunit.client.0.smithi003.stdout:8/117: getdents d7/de/d11 0 2024-09-21T12:20:30.012 INFO:tasks.workunit.client.0.smithi003.stdout:6/133: dwrite d4/d9/f15 [4194304,4194304] 0 2024-09-21T12:20:30.013 INFO:tasks.workunit.client.0.smithi003.stdout:9/246: link d2/da/d2a/l2d d2/d20/d42/l58 0 2024-09-21T12:20:30.013 INFO:tasks.workunit.client.0.smithi003.stdout:0/134: read d9/d12/d15/f1b [19470,88484] 0 2024-09-21T12:20:30.014 INFO:tasks.workunit.client.1.smithi192.stdout:4/661: creat d2/db/fd9 x:0 0 0 2024-09-21T12:20:30.016 INFO:tasks.workunit.client.1.smithi192.stdout:1/728: dwrite d2/da/d6b/d7d/fc5 [0,4194304] 0 2024-09-21T12:20:30.018 INFO:tasks.workunit.client.1.smithi192.stdout:5/955: rename d0/d65/d6e/dc0/d44/d85/d97/d9e/lb1 to d0/l145 0 2024-09-21T12:20:30.018 INFO:tasks.workunit.client.0.smithi003.stdout:1/115: chown d4/d11/d14/c24 898 1 2024-09-21T12:20:30.019 INFO:tasks.workunit.client.0.smithi003.stdout:1/116: dread - d4/d11/f2a zero size 2024-09-21T12:20:30.019 INFO:tasks.workunit.client.0.smithi003.stdout:4/83: mkdir d9/d16 0 2024-09-21T12:20:30.020 INFO:tasks.workunit.client.0.smithi003.stdout:1/117: truncate d4/d11/f2a 746474 0 2024-09-21T12:20:30.021 INFO:tasks.workunit.client.0.smithi003.stdout:1/118: write d4/fa [977023,72544] 0 2024-09-21T12:20:30.024 INFO:tasks.workunit.client.0.smithi003.stdout:7/119: creat d8/db/d13/d21/f2a x:0 0 0 2024-09-21T12:20:30.027 INFO:tasks.workunit.client.0.smithi003.stdout:2/114: unlink d0/f6 0 2024-09-21T12:20:30.028 INFO:tasks.workunit.client.1.smithi192.stdout:8/762: symlink d14/d18/l102 0 2024-09-21T12:20:30.029 INFO:tasks.workunit.client.0.smithi003.stdout:8/118: symlink d7/df/d20/d21/l25 0 2024-09-21T12:20:30.035 INFO:tasks.workunit.client.1.smithi192.stdout:7/684: sync 2024-09-21T12:20:30.036 INFO:tasks.workunit.client.1.smithi192.stdout:7/685: readlink d6/l86 0 2024-09-21T12:20:30.036 INFO:tasks.workunit.client.1.smithi192.stdout:9/737: truncate d5/d19/f7f 1013899 0 2024-09-21T12:20:30.037 INFO:tasks.workunit.client.1.smithi192.stdout:7/686: write d6/d9/d70/d77/f91 [1208563,67418] 0 2024-09-21T12:20:30.037 INFO:tasks.workunit.client.1.smithi192.stdout:3/631: symlink db/d16/d18/d33/lea 0 2024-09-21T12:20:30.038 INFO:tasks.workunit.client.0.smithi003.stdout:3/118: symlink d0/d5/l21 0 2024-09-21T12:20:30.039 INFO:tasks.workunit.client.0.smithi003.stdout:3/119: chown d0/d5/d9/fb 6967 1 2024-09-21T12:20:30.039 INFO:tasks.workunit.client.1.smithi192.stdout:2/689: rename d1b/d1e/d5e/d75/dab to d1b/d9e/de1 0 2024-09-21T12:20:30.040 INFO:tasks.workunit.client.0.smithi003.stdout:3/120: write d0/d5/d9/fb [1374003,28093] 0 2024-09-21T12:20:30.042 INFO:tasks.workunit.client.1.smithi192.stdout:5/956: truncate d0/f26 144039 0 2024-09-21T12:20:30.043 INFO:tasks.workunit.client.0.smithi003.stdout:4/84: readlink l2 0 2024-09-21T12:20:30.044 INFO:tasks.workunit.client.0.smithi003.stdout:9/247: dread d2/d20/f39 [0,4194304] 0 2024-09-21T12:20:30.044 INFO:tasks.workunit.client.1.smithi192.stdout:0/733: getdents d3/de/dc6/d83 0 2024-09-21T12:20:30.044 INFO:tasks.workunit.client.0.smithi003.stdout:9/248: chown d2/da 30883 1 2024-09-21T12:20:30.046 INFO:tasks.workunit.client.1.smithi192.stdout:2/690: dwrite d1b/d1e/d7b/f8a [4194304,4194304] 0 2024-09-21T12:20:30.046 INFO:tasks.workunit.client.1.smithi192.stdout:6/825: unlink c4 0 2024-09-21T12:20:30.048 INFO:tasks.workunit.client.1.smithi192.stdout:0/734: chown d3/d5/d28/d39/d50/dd9/d7a/dbe/d92/d51/f76 537757 1 2024-09-21T12:20:30.049 INFO:tasks.workunit.client.0.smithi003.stdout:2/115: creat d0/dd/d16/f24 x:0 0 0 2024-09-21T12:20:30.050 INFO:tasks.workunit.client.1.smithi192.stdout:5/957: dwrite d0/f7c [0,4194304] 0 2024-09-21T12:20:30.051 INFO:tasks.workunit.client.1.smithi192.stdout:4/662: symlink d2/db/d3e/d57/d32/d4f/lda 0 2024-09-21T12:20:30.052 INFO:tasks.workunit.client.0.smithi003.stdout:8/119: creat d7/df/f26 x:0 0 0 2024-09-21T12:20:30.052 INFO:tasks.workunit.client.0.smithi003.stdout:6/134: write d4/fb [4842160,116587] 0 2024-09-21T12:20:30.054 INFO:tasks.workunit.client.0.smithi003.stdout:6/135: write d4/d9/f15 [5158916,19223] 0 2024-09-21T12:20:30.055 INFO:tasks.workunit.client.1.smithi192.stdout:1/729: link d2/d82/fbf d2/d12/d2f/d51/fef 0 2024-09-21T12:20:30.056 INFO:tasks.workunit.client.1.smithi192.stdout:1/730: readlink d2/d12/d2f/d41/le9 0 2024-09-21T12:20:30.056 INFO:tasks.workunit.client.1.smithi192.stdout:1/731: readlink d2/ld0 0 2024-09-21T12:20:30.058 INFO:tasks.workunit.client.1.smithi192.stdout:9/738: creat d5/d8/dc7/dd7/fe9 x:0 0 0 2024-09-21T12:20:30.059 INFO:tasks.workunit.client.0.smithi003.stdout:8/120: dread f4 [0,4194304] 0 2024-09-21T12:20:30.060 INFO:tasks.workunit.client.1.smithi192.stdout:3/632: dread db/d16/db4/fa2 [0,4194304] 0 2024-09-21T12:20:30.060 INFO:tasks.workunit.client.1.smithi192.stdout:3/633: readlink db/d16/d18/d21/d23/dd2/lc8 0 2024-09-21T12:20:30.061 INFO:tasks.workunit.client.0.smithi003.stdout:4/85: chown c7 63168 1 2024-09-21T12:20:30.063 INFO:tasks.workunit.client.1.smithi192.stdout:6/826: chown da/d1f/d56/d73/cfb 101 1 2024-09-21T12:20:30.064 INFO:tasks.workunit.client.0.smithi003.stdout:6/136: dwrite d4/d13/f27 [0,4194304] 0 2024-09-21T12:20:30.066 INFO:tasks.workunit.client.1.smithi192.stdout:2/691: creat d1b/d1e/d62/d99/fe2 x:0 0 0 2024-09-21T12:20:30.068 INFO:tasks.workunit.client.0.smithi003.stdout:9/249: mknod d2/da/d2a/c59 0 2024-09-21T12:20:30.069 INFO:tasks.workunit.client.0.smithi003.stdout:9/250: stat d2/da/d17/c48 0 2024-09-21T12:20:30.070 INFO:tasks.workunit.client.0.smithi003.stdout:6/137: dread d4/d9/fd [0,4194304] 0 2024-09-21T12:20:30.070 INFO:tasks.workunit.client.0.smithi003.stdout:9/251: chown d2/da/d17/c1e 142 1 2024-09-21T12:20:30.071 INFO:tasks.workunit.client.1.smithi192.stdout:8/763: link d14/d18/d88/fc9 d14/d18/daf/f103 0 2024-09-21T12:20:30.072 INFO:tasks.workunit.client.0.smithi003.stdout:6/138: read d4/d13/f27 [3865990,56158] 0 2024-09-21T12:20:30.075 INFO:tasks.workunit.client.1.smithi192.stdout:0/735: creat d3/d5/d69/dbf/fda x:0 0 0 2024-09-21T12:20:30.080 INFO:tasks.workunit.client.1.smithi192.stdout:4/663: unlink d2/d36/f61 0 2024-09-21T12:20:30.084 INFO:tasks.workunit.client.1.smithi192.stdout:5/958: creat d0/d65/d6e/dbc/f146 x:0 0 0 2024-09-21T12:20:30.087 INFO:tasks.workunit.client.1.smithi192.stdout:1/732: write d2/da/d6b/dc8/fa3 [3966569,51813] 0 2024-09-21T12:20:30.088 INFO:tasks.workunit.client.1.smithi192.stdout:1/733: dread - d2/d12/d2f/d51/d24/d58/f88 zero size 2024-09-21T12:20:30.089 INFO:tasks.workunit.client.1.smithi192.stdout:1/734: fsync d2/d12/d2f/d51/d24/d65/d8e/d9d/db6/fbd 0 2024-09-21T12:20:30.093 INFO:tasks.workunit.client.1.smithi192.stdout:3/634: mknod db/d16/d18/d33/d88/ceb 0 2024-09-21T12:20:30.094 INFO:tasks.workunit.client.0.smithi003.stdout:3/121: mknod d0/d5/c22 0 2024-09-21T12:20:30.095 INFO:tasks.workunit.client.1.smithi192.stdout:8/764: dread d14/d1a/d1d/d48/f62 [0,4194304] 0 2024-09-21T12:20:30.095 INFO:tasks.workunit.client.0.smithi003.stdout:3/122: dread - d0/f1f zero size 2024-09-21T12:20:30.096 INFO:tasks.workunit.client.1.smithi192.stdout:8/765: write fc [5633264,105032] 0 2024-09-21T12:20:30.096 INFO:tasks.workunit.client.0.smithi003.stdout:1/119: truncate d4/dc/f1c 745065 0 2024-09-21T12:20:30.097 INFO:tasks.workunit.client.1.smithi192.stdout:8/766: write d14/d1a/d1d/f57 [572121,72158] 0 2024-09-21T12:20:30.102 INFO:tasks.workunit.client.1.smithi192.stdout:4/664: mknod d2/db/d34/d56/d6c/db8/cdb 0 2024-09-21T12:20:30.107 INFO:tasks.workunit.client.0.smithi003.stdout:2/116: dwrite d0/fc [0,4194304] 0 2024-09-21T12:20:30.107 INFO:tasks.workunit.client.0.smithi003.stdout:9/252: chown d2/d20/d42/l58 214 1 2024-09-21T12:20:30.108 INFO:tasks.workunit.client.1.smithi192.stdout:5/959: dread - d0/d65/d6e/dc0/fcb zero size 2024-09-21T12:20:30.110 INFO:tasks.workunit.client.1.smithi192.stdout:9/739: mknod d5/d8/dc7/dd7/de7/de4/cea 0 2024-09-21T12:20:30.111 INFO:tasks.workunit.client.1.smithi192.stdout:7/687: truncate d6/d9/d70/d77/fb0 1113322 0 2024-09-21T12:20:30.112 INFO:tasks.workunit.client.1.smithi192.stdout:1/735: fsync d2/d12/d2f/d41/fb0 0 2024-09-21T12:20:30.112 INFO:tasks.workunit.client.0.smithi003.stdout:6/139: dread d4/fa [0,4194304] 0 2024-09-21T12:20:30.113 INFO:tasks.workunit.client.0.smithi003.stdout:8/121: symlink d7/de/l27 0 2024-09-21T12:20:30.114 INFO:tasks.workunit.client.1.smithi192.stdout:1/736: dread - d2/d82/fbf zero size 2024-09-21T12:20:30.115 INFO:tasks.workunit.client.1.smithi192.stdout:5/960: dwrite d0/d65/d6e/dc0/d44/d85/fa6 [0,4194304] 0 2024-09-21T12:20:30.117 INFO:tasks.workunit.client.0.smithi003.stdout:3/123: unlink d0/d5/da/c17 0 2024-09-21T12:20:30.117 INFO:tasks.workunit.client.1.smithi192.stdout:5/961: fdatasync d0/d65/d8e/d98/dba/f131 0 2024-09-21T12:20:30.118 INFO:tasks.workunit.client.1.smithi192.stdout:1/737: chown d2/d12/d2f/d51/d24/d65/d8e/d9d/fa8 1364587927 1 2024-09-21T12:20:30.119 INFO:tasks.workunit.client.1.smithi192.stdout:6/827: mkdir da/d1f/d48/d117 0 2024-09-21T12:20:30.119 INFO:tasks.workunit.client.1.smithi192.stdout:5/962: dread - d0/d65/d6e/d84/d126/d13/d37/da8/daa/f108 zero size 2024-09-21T12:20:30.120 INFO:tasks.workunit.client.1.smithi192.stdout:6/828: write da/d1f/f45 [1114250,41722] 0 2024-09-21T12:20:30.120 INFO:tasks.workunit.client.0.smithi003.stdout:1/120: mknod d4/d11/d14/c2c 0 2024-09-21T12:20:30.120 INFO:tasks.workunit.client.1.smithi192.stdout:5/963: chown d0/d65/d6e/d84/d126/d13/d37 9399 1 2024-09-21T12:20:30.124 INFO:tasks.workunit.client.0.smithi003.stdout:4/86: mknod d9/d16/c17 0 2024-09-21T12:20:30.127 INFO:tasks.workunit.client.1.smithi192.stdout:2/692: mkdir d1b/d1e/d5e/d75/da1/de3 0 2024-09-21T12:20:30.129 INFO:tasks.workunit.client.1.smithi192.stdout:2/693: truncate d1b/d1e/d5e/d88/d95/dbe/fc5 181210 0 2024-09-21T12:20:30.130 INFO:tasks.workunit.client.0.smithi003.stdout:9/253: creat d2/da/d2a/f5a x:0 0 0 2024-09-21T12:20:30.131 INFO:tasks.workunit.client.0.smithi003.stdout:9/254: chown d2/da/d35/c3e 19288 1 2024-09-21T12:20:30.132 INFO:tasks.workunit.client.0.smithi003.stdout:9/255: read - d2/da/d2a/f55 zero size 2024-09-21T12:20:30.134 INFO:tasks.workunit.client.1.smithi192.stdout:3/635: write db/d16/d18/d21/d23/dd2/d2e/f72 [521264,117296] 0 2024-09-21T12:20:30.135 INFO:tasks.workunit.client.1.smithi192.stdout:4/665: symlink d2/db/d3e/d57/d32/d4f/d71/d9d/dad/d9c/ldc 0 2024-09-21T12:20:30.136 INFO:tasks.workunit.client.1.smithi192.stdout:3/636: write db/d16/d18/fbf [2314804,11533] 0 2024-09-21T12:20:30.139 INFO:tasks.workunit.client.0.smithi003.stdout:3/124: mkdir d0/d5/d9/dd/d23 0 2024-09-21T12:20:30.140 INFO:tasks.workunit.client.0.smithi003.stdout:6/140: dwrite d4/d13/f20 [0,4194304] 0 2024-09-21T12:20:30.141 INFO:tasks.workunit.client.1.smithi192.stdout:9/740: rename d5/d8/dc7/dd7/de7/f82 to d5/d8/d2c/feb 0 2024-09-21T12:20:30.142 INFO:tasks.workunit.client.0.smithi003.stdout:6/141: stat d4/d13/d22 0 2024-09-21T12:20:30.147 INFO:tasks.workunit.client.0.smithi003.stdout:9/256: mknod d2/d20/c5b 0 2024-09-21T12:20:30.148 INFO:tasks.workunit.client.1.smithi192.stdout:9/741: dwrite d5/d19/dd5/d4d/d6d/fd3 [0,4194304] 0 2024-09-21T12:20:30.149 INFO:tasks.workunit.client.0.smithi003.stdout:6/142: dread d4/fa [0,4194304] 0 2024-09-21T12:20:30.150 INFO:tasks.workunit.client.1.smithi192.stdout:9/742: write d5/d8/f2d [572560,118811] 0 2024-09-21T12:20:30.151 INFO:tasks.workunit.client.0.smithi003.stdout:1/121: dwrite d4/df/f1a [0,4194304] 0 2024-09-21T12:20:30.151 INFO:tasks.workunit.client.1.smithi192.stdout:1/738: unlink d2/led 0 2024-09-21T12:20:30.155 INFO:tasks.workunit.client.0.smithi003.stdout:3/125: creat d0/d5/d9/f24 x:0 0 0 2024-09-21T12:20:30.160 INFO:tasks.workunit.client.1.smithi192.stdout:8/767: symlink d14/d1a/d82/de0/l104 0 2024-09-21T12:20:30.161 INFO:tasks.workunit.client.0.smithi003.stdout:8/122: dwrite d7/de/f19 [0,4194304] 0 2024-09-21T12:20:30.161 INFO:tasks.workunit.client.1.smithi192.stdout:2/694: symlink d1b/d65/le4 0 2024-09-21T12:20:30.163 INFO:tasks.workunit.client.1.smithi192.stdout:4/666: symlink d2/d36/d55/d89/ldd 0 2024-09-21T12:20:30.165 INFO:tasks.workunit.client.0.smithi003.stdout:6/143: stat d4/f10 0 2024-09-21T12:20:30.167 INFO:tasks.workunit.client.1.smithi192.stdout:7/688: creat d6/d9/d2d/dc4/fef x:0 0 0 2024-09-21T12:20:30.170 INFO:tasks.workunit.client.0.smithi003.stdout:3/126: unlink d0/d5/l21 0 2024-09-21T12:20:30.174 INFO:tasks.workunit.client.0.smithi003.stdout:4/87: creat d9/f18 x:0 0 0 2024-09-21T12:20:30.175 INFO:tasks.workunit.client.1.smithi192.stdout:9/743: write d5/dc/d64/dbb/f60 [3969073,53194] 0 2024-09-21T12:20:30.175 INFO:tasks.workunit.client.0.smithi003.stdout:3/127: dread d0/d5/d9/d11/f1d [0,4194304] 0 2024-09-21T12:20:30.177 INFO:tasks.workunit.client.0.smithi003.stdout:2/117: creat d0/f25 x:0 0 0 2024-09-21T12:20:30.178 INFO:tasks.workunit.client.1.smithi192.stdout:1/739: mkdir d2/da/d89/df0 0 2024-09-21T12:20:30.179 INFO:tasks.workunit.client.0.smithi003.stdout:1/122: dread d4/dc/f1c [0,4194304] 0 2024-09-21T12:20:30.182 INFO:tasks.workunit.client.0.smithi003.stdout:6/144: symlink d4/d9/l2a 0 2024-09-21T12:20:30.183 INFO:tasks.workunit.client.1.smithi192.stdout:0/736: getdents d3/d5/d28/d39/d50/dd9 0 2024-09-21T12:20:30.185 INFO:tasks.workunit.client.1.smithi192.stdout:1/740: dwrite d2/da/d6b/dc8/f93 [0,4194304] 0 2024-09-21T12:20:30.186 INFO:tasks.workunit.client.1.smithi192.stdout:6/829: dwrite da/d1f/d48/d7d/f102 [0,4194304] 0 2024-09-21T12:20:30.186 INFO:tasks.workunit.client.1.smithi192.stdout:2/695: symlink d1b/d1e/d5e/d75/d8d/le5 0 2024-09-21T12:20:30.190 INFO:tasks.workunit.client.0.smithi003.stdout:6/145: dread d4/fc [4194304,4194304] 0 2024-09-21T12:20:30.190 INFO:tasks.workunit.client.0.smithi003.stdout:9/257: write d2/d20/f21 [4509610,28215] 0 2024-09-21T12:20:30.190 INFO:tasks.workunit.client.1.smithi192.stdout:1/741: chown d2/d12/d2f/d51/d24/d65/d8e/d9d/db6/fb7 112491304 1 2024-09-21T12:20:30.190 INFO:tasks.workunit.client.1.smithi192.stdout:6/830: readlink da/d1f/d27/d6b/lf3 0 2024-09-21T12:20:30.191 INFO:tasks.workunit.client.1.smithi192.stdout:3/637: mknod db/d16/d18/d33/cec 0 2024-09-21T12:20:30.193 INFO:tasks.workunit.client.0.smithi003.stdout:8/123: symlink d7/de/l28 0 2024-09-21T12:20:30.196 INFO:tasks.workunit.client.1.smithi192.stdout:9/744: fsync d5/d8/dc7/dd7/de7/d55/d93/f96 0 2024-09-21T12:20:30.198 INFO:tasks.workunit.client.1.smithi192.stdout:1/742: dwrite d2/d12/d2f/d51/d24/d65/d8e/d9d/db6/fbd [0,4194304] 0 2024-09-21T12:20:30.198 INFO:tasks.workunit.client.0.smithi003.stdout:8/124: dread f1 [0,4194304] 0 2024-09-21T12:20:30.199 INFO:tasks.workunit.client.1.smithi192.stdout:9/745: dread - d5/d19/dd5/d4d/d6d/fab zero size 2024-09-21T12:20:30.200 INFO:tasks.workunit.client.1.smithi192.stdout:3/638: dwrite db/d16/d18/d33/fa1 [0,4194304] 0 2024-09-21T12:20:30.201 INFO:tasks.workunit.client.1.smithi192.stdout:9/746: chown d5/d8/dc7/dd7/de7/d55/l6a 113 1 2024-09-21T12:20:30.204 INFO:tasks.workunit.client.0.smithi003.stdout:8/125: dread d7/f14 [0,4194304] 0 2024-09-21T12:20:30.205 INFO:tasks.workunit.client.0.smithi003.stdout:4/88: mknod d9/c19 0 2024-09-21T12:20:30.206 INFO:tasks.workunit.client.1.smithi192.stdout:7/689: dread d6/d9/d1f/f21 [0,4194304] 0 2024-09-21T12:20:30.207 INFO:tasks.workunit.client.1.smithi192.stdout:6/831: fdatasync da/d1f/d27/f71 0 2024-09-21T12:20:30.210 INFO:tasks.workunit.client.0.smithi003.stdout:9/258: mknod d2/d20/d22/d3f/c5c 0 2024-09-21T12:20:30.211 INFO:tasks.workunit.client.0.smithi003.stdout:9/259: chown d2/da/l51 801785 1 2024-09-21T12:20:30.212 INFO:tasks.workunit.client.0.smithi003.stdout:1/123: symlink d4/d11/d14/d25/l2d 0 2024-09-21T12:20:30.213 INFO:tasks.workunit.client.0.smithi003.stdout:9/260: chown d2/da/d2a/d3c/f4b 7150 1 2024-09-21T12:20:30.214 INFO:tasks.workunit.client.0.smithi003.stdout:9/261: readlink d2/d20/d42/l58 0 2024-09-21T12:20:30.218 INFO:tasks.workunit.client.0.smithi003.stdout:2/118: write d0/dd/d16/f24 [1012022,121401] 0 2024-09-21T12:20:30.219 INFO:tasks.workunit.client.0.smithi003.stdout:8/126: mknod d7/c29 0 2024-09-21T12:20:30.221 INFO:tasks.workunit.client.0.smithi003.stdout:6/146: getdents d4/d13/d22 0 2024-09-21T12:20:30.222 INFO:tasks.workunit.client.1.smithi192.stdout:7/690: symlink d6/d20/lf0 0 2024-09-21T12:20:30.224 INFO:tasks.workunit.client.1.smithi192.stdout:4/667: creat d2/fde x:0 0 0 2024-09-21T12:20:30.225 INFO:tasks.workunit.client.0.smithi003.stdout:2/119: creat d0/dd/f26 x:0 0 0 2024-09-21T12:20:30.227 INFO:tasks.workunit.client.0.smithi003.stdout:8/127: dread d7/df/d16/f17 [0,4194304] 0 2024-09-21T12:20:30.227 INFO:tasks.workunit.client.1.smithi192.stdout:2/696: rename d1b/d38/d7d/f8e to d1b/d1e/d5e/d75/da1/de3/fe6 0 2024-09-21T12:20:30.228 INFO:tasks.workunit.client.1.smithi192.stdout:8/768: getdents d14/d1a/d1d/d46/d4e/d83/d8d/d9c/dbe 0 2024-09-21T12:20:30.231 INFO:tasks.workunit.client.1.smithi192.stdout:9/747: symlink d5/lec 0 2024-09-21T12:20:30.231 INFO:tasks.workunit.client.1.smithi192.stdout:9/748: chown d5/d19 533577414 1 2024-09-21T12:20:30.232 INFO:tasks.workunit.client.1.smithi192.stdout:7/691: mknod d6/d20/dc9/cf1 0 2024-09-21T12:20:30.232 INFO:tasks.workunit.client.1.smithi192.stdout:2/697: dwrite d1b/f24 [4194304,4194304] 0 2024-09-21T12:20:30.233 INFO:tasks.workunit.client.1.smithi192.stdout:7/692: stat d6/d9/d1f/c59 0 2024-09-21T12:20:30.236 INFO:tasks.workunit.client.0.smithi003.stdout:4/89: rename d9/da/ff to d9/f1a 0 2024-09-21T12:20:30.238 INFO:tasks.workunit.client.1.smithi192.stdout:4/668: chown d2/db/d34/d56/d83/d93 118059 1 2024-09-21T12:20:30.239 INFO:tasks.workunit.client.1.smithi192.stdout:5/964: sync 2024-09-21T12:20:30.239 INFO:tasks.workunit.client.1.smithi192.stdout:3/639: write db/f5c [191126,87229] 0 2024-09-21T12:20:30.240 INFO:tasks.workunit.client.0.smithi003.stdout:6/147: getdents d4/d11/d1d 0 2024-09-21T12:20:30.244 INFO:tasks.workunit.client.1.smithi192.stdout:7/693: dwrite d6/d9/f5d [4194304,4194304] 0 2024-09-21T12:20:30.246 INFO:tasks.workunit.client.0.smithi003.stdout:9/262: dwrite d2/da/f3b [0,4194304] 0 2024-09-21T12:20:30.247 INFO:tasks.workunit.client.1.smithi192.stdout:1/743: link d2/d12/d2f/d51/f7c d2/ff1 0 2024-09-21T12:20:30.247 INFO:tasks.workunit.client.0.smithi003.stdout:1/124: truncate d4/df/f1a 2620740 0 2024-09-21T12:20:30.249 INFO:tasks.workunit.client.0.smithi003.stdout:4/90: symlink d9/d16/l1b 0 2024-09-21T12:20:30.250 INFO:tasks.workunit.client.0.smithi003.stdout:1/125: dread d4/dc/f1c [0,4194304] 0 2024-09-21T12:20:30.251 INFO:tasks.workunit.client.1.smithi192.stdout:0/737: getdents d3/d5 0 2024-09-21T12:20:30.252 INFO:tasks.workunit.client.1.smithi192.stdout:0/738: chown d3/de/dc6/d83/d87 21 1 2024-09-21T12:20:30.254 INFO:tasks.workunit.client.1.smithi192.stdout:6/832: truncate da/d1f/d48/d7d/daa/fcf 17475 0 2024-09-21T12:20:30.254 INFO:tasks.workunit.client.1.smithi192.stdout:0/739: truncate d3/d5/d28/d39/d50/fc1 835999 0 2024-09-21T12:20:30.255 INFO:tasks.workunit.client.1.smithi192.stdout:6/833: chown da/d23/f52 12422028 1 2024-09-21T12:20:30.256 INFO:tasks.workunit.client.1.smithi192.stdout:2/698: symlink d1b/d1e/d5e/d88/d95/le7 0 2024-09-21T12:20:30.256 INFO:tasks.workunit.client.1.smithi192.stdout:0/740: write d3/d5/d28/d39/fd1 [553855,51583] 0 2024-09-21T12:20:30.257 INFO:tasks.workunit.client.1.smithi192.stdout:0/741: chown d3/d5/dd7 100 1 2024-09-21T12:20:30.257 INFO:tasks.workunit.client.1.smithi192.stdout:2/699: chown d1b/d38/d53/d8b/da7/dbb/fc3 8362 1 2024-09-21T12:20:30.259 INFO:tasks.workunit.client.1.smithi192.stdout:0/742: chown d3/de/d33/f3c 3 1 2024-09-21T12:20:30.260 INFO:tasks.workunit.client.1.smithi192.stdout:5/965: mkdir d0/d65/d6e/d84/d126/d13/d37/db4/d147 0 2024-09-21T12:20:30.262 INFO:tasks.workunit.client.0.smithi003.stdout:1/126: unlink d4/dc/c17 0 2024-09-21T12:20:30.264 INFO:tasks.workunit.client.0.smithi003.stdout:1/127: truncate d4/df/d19/f2b 209021 0 2024-09-21T12:20:30.264 INFO:tasks.workunit.client.1.smithi192.stdout:7/694: rename d6/d9/d1f/d3e/d7a/d8a/da2/lb1 to d6/d9/d1f/d3e/d7a/d8a/da2/lf2 0 2024-09-21T12:20:30.266 INFO:tasks.workunit.client.1.smithi192.stdout:1/744: unlink d2/d12/d2f/f4a 0 2024-09-21T12:20:30.268 INFO:tasks.workunit.client.0.smithi003.stdout:2/120: rename d0/d1c/c1e to d0/c27 0 2024-09-21T12:20:30.272 INFO:tasks.workunit.client.0.smithi003.stdout:9/263: creat d2/d20/d42/f5d x:0 0 0 2024-09-21T12:20:30.273 INFO:tasks.workunit.client.0.smithi003.stdout:4/91: symlink d9/l1c 0 2024-09-21T12:20:30.273 INFO:tasks.workunit.client.0.smithi003.stdout:4/92: stat d9 0 2024-09-21T12:20:30.274 INFO:tasks.workunit.client.1.smithi192.stdout:3/640: mknod db/d16/d18/d33/d3b/ced 0 2024-09-21T12:20:30.275 INFO:tasks.workunit.client.1.smithi192.stdout:4/669: dread d2/df/f17 [0,4194304] 0 2024-09-21T12:20:30.276 INFO:tasks.workunit.client.1.smithi192.stdout:5/966: dread d0/d65/d6e/d84/d126/d13/d37/f89 [0,4194304] 0 2024-09-21T12:20:30.277 INFO:tasks.workunit.client.1.smithi192.stdout:0/743: creat d3/d5/d28/d39/d50/dd9/fdb x:0 0 0 2024-09-21T12:20:30.277 INFO:tasks.workunit.client.0.smithi003.stdout:8/128: getdents d7/de 0 2024-09-21T12:20:30.278 INFO:tasks.workunit.client.1.smithi192.stdout:6/834: dread f8 [0,4194304] 0 2024-09-21T12:20:30.278 INFO:tasks.workunit.client.1.smithi192.stdout:7/695: readlink d6/d20/d69/d90/da7/dc1/l6e 0 2024-09-21T12:20:30.279 INFO:tasks.workunit.client.1.smithi192.stdout:2/700: dwrite d1b/d38/f79 [0,4194304] 0 2024-09-21T12:20:30.279 INFO:tasks.workunit.client.1.smithi192.stdout:0/744: truncate d3/d5/fa5 652803 0 2024-09-21T12:20:30.282 INFO:tasks.workunit.client.1.smithi192.stdout:4/670: dread d2/d36/d55/f60 [0,4194304] 0 2024-09-21T12:20:30.282 INFO:tasks.workunit.client.0.smithi003.stdout:9/264: mkdir d2/d20/d22/d5e 0 2024-09-21T12:20:30.285 INFO:tasks.workunit.client.0.smithi003.stdout:4/93: symlink d9/da/l1d 0 2024-09-21T12:20:30.285 INFO:tasks.workunit.client.0.smithi003.stdout:4/94: read - d9/f18 zero size 2024-09-21T12:20:30.286 INFO:tasks.workunit.client.0.smithi003.stdout:4/95: readlink d9/da/l1d 0 2024-09-21T12:20:30.293 INFO:tasks.workunit.client.0.smithi003.stdout:9/265: mknod d2/d20/c5f 0 2024-09-21T12:20:30.294 INFO:tasks.workunit.client.0.smithi003.stdout:2/121: dread d0/ff [0,4194304] 0 2024-09-21T12:20:30.303 INFO:tasks.workunit.client.0.smithi003.stdout:9/266: rename d2/da/f12 to d2/d29/f60 0 2024-09-21T12:20:30.304 INFO:tasks.workunit.client.0.smithi003.stdout:4/96: mknod d9/c1e 0 2024-09-21T12:20:30.305 INFO:tasks.workunit.client.0.smithi003.stdout:1/128: getdents d4/df/d12 0 2024-09-21T12:20:30.308 INFO:tasks.workunit.client.0.smithi003.stdout:9/267: mknod d2/d29/c61 0 2024-09-21T12:20:30.308 INFO:tasks.workunit.client.0.smithi003.stdout:2/122: symlink d0/d1c/l28 0 2024-09-21T12:20:30.309 INFO:tasks.workunit.client.0.smithi003.stdout:9/268: write d2/da/d2a/d3c/f37 [16828,8952] 0 2024-09-21T12:20:30.309 INFO:tasks.workunit.client.0.smithi003.stdout:4/97: symlink d9/da/l1f 0 2024-09-21T12:20:30.310 INFO:tasks.workunit.client.0.smithi003.stdout:4/98: chown f6 6609 1 2024-09-21T12:20:30.311 INFO:tasks.workunit.client.0.smithi003.stdout:8/129: getdents d7/df/d16 0 2024-09-21T12:20:30.311 INFO:tasks.workunit.client.0.smithi003.stdout:4/99: chown d9 4212598 1 2024-09-21T12:20:30.312 INFO:tasks.workunit.client.0.smithi003.stdout:1/129: rename d4/d11/l1f to d4/df/l2e 0 2024-09-21T12:20:30.315 INFO:tasks.workunit.client.0.smithi003.stdout:9/269: rmdir d2/d20/d22 39 2024-09-21T12:20:30.317 INFO:tasks.workunit.client.0.smithi003.stdout:4/100: rmdir d9/da 39 2024-09-21T12:20:30.319 INFO:tasks.workunit.client.0.smithi003.stdout:8/130: mknod d7/de/d1a/c2a 0 2024-09-21T12:20:30.320 INFO:tasks.workunit.client.0.smithi003.stdout:8/131: chown d7/df/d20/d24 1658 1 2024-09-21T12:20:30.321 INFO:tasks.workunit.client.0.smithi003.stdout:9/270: dwrite d2/da/d17/f27 [0,4194304] 0 2024-09-21T12:20:30.323 INFO:tasks.workunit.client.0.smithi003.stdout:2/123: creat d0/dd/f29 x:0 0 0 2024-09-21T12:20:30.324 INFO:tasks.workunit.client.0.smithi003.stdout:8/132: creat d7/de/d1a/f2b x:0 0 0 2024-09-21T12:20:30.325 INFO:tasks.workunit.client.1.smithi192.stdout:1/745: rmdir d2/d12/d2f/d51/d24/d65/d8b 39 2024-09-21T12:20:30.325 INFO:tasks.workunit.client.0.smithi003.stdout:9/271: readlink d2/da/d2a/d3c/l43 0 2024-09-21T12:20:30.326 INFO:tasks.workunit.client.0.smithi003.stdout:4/101: symlink d9/l20 0 2024-09-21T12:20:30.327 INFO:tasks.workunit.client.1.smithi192.stdout:5/967: mkdir d0/d65/d6e/da7/da0/d148 0 2024-09-21T12:20:30.328 INFO:tasks.workunit.client.1.smithi192.stdout:0/745: creat d3/de/d9b/fdc x:0 0 0 2024-09-21T12:20:30.328 INFO:tasks.workunit.client.1.smithi192.stdout:7/696: dwrite d6/d9/d1f/fd3 [0,4194304] 0 2024-09-21T12:20:30.329 INFO:tasks.workunit.client.0.smithi003.stdout:8/133: symlink d7/df/d20/l2c 0 2024-09-21T12:20:30.329 INFO:tasks.workunit.client.0.smithi003.stdout:1/130: write d4/dc/f1c [1278675,34052] 0 2024-09-21T12:20:30.329 INFO:tasks.workunit.client.1.smithi192.stdout:2/701: truncate d1b/d1e/d7b/f80 2584417 0 2024-09-21T12:20:30.331 INFO:tasks.workunit.client.1.smithi192.stdout:9/749: link d5/dc/d40/lc8 d5/dc/d40/dad/de3/led 0 2024-09-21T12:20:30.332 INFO:tasks.workunit.client.1.smithi192.stdout:0/746: write d3/d5/d28/d39/d50/dd9/fa7 [738867,123871] 0 2024-09-21T12:20:30.332 INFO:tasks.workunit.client.0.smithi003.stdout:9/272: unlink d2/da/l46 0 2024-09-21T12:20:30.334 INFO:tasks.workunit.client.0.smithi003.stdout:8/134: dread d7/df/f12 [0,4194304] 0 2024-09-21T12:20:30.335 INFO:tasks.workunit.client.1.smithi192.stdout:9/750: truncate d5/fb8 300945 0 2024-09-21T12:20:30.335 INFO:tasks.workunit.client.1.smithi192.stdout:9/751: readlink d5/d19/dd5/d4d/d6d/dd9/lca 0 2024-09-21T12:20:30.335 INFO:tasks.workunit.client.0.smithi003.stdout:8/135: dread - d7/df/f26 zero size 2024-09-21T12:20:30.336 INFO:tasks.workunit.client.0.smithi003.stdout:2/124: rename d0/f14 to d0/dd/d16/f2a 0 2024-09-21T12:20:30.338 INFO:tasks.workunit.client.1.smithi192.stdout:1/746: unlink d2/dae/ld8 0 2024-09-21T12:20:30.340 INFO:tasks.workunit.client.1.smithi192.stdout:5/968: creat d0/d65/d6e/dbc/dc8/f149 x:0 0 0 2024-09-21T12:20:30.341 INFO:tasks.workunit.client.0.smithi003.stdout:1/131: rename d4/d11/f1e to d4/d11/f2f 0 2024-09-21T12:20:30.341 INFO:tasks.workunit.client.0.smithi003.stdout:1/132: fdatasync d4/f7 0 2024-09-21T12:20:30.342 INFO:tasks.workunit.client.0.smithi003.stdout:5/168: sync 2024-09-21T12:20:30.343 INFO:tasks.workunit.client.0.smithi003.stdout:4/102: unlink d9/da/l1f 0 2024-09-21T12:20:30.344 INFO:tasks.workunit.client.1.smithi192.stdout:4/671: mknod d2/db/cdf 0 2024-09-21T12:20:30.345 INFO:tasks.workunit.client.0.smithi003.stdout:9/273: mknod d2/da/d35/d4d/c62 0 2024-09-21T12:20:30.345 INFO:tasks.workunit.client.1.smithi192.stdout:7/697: dwrite d6/d9/d1f/f8d [0,4194304] 0 2024-09-21T12:20:30.347 INFO:tasks.workunit.client.0.smithi003.stdout:8/136: symlink d7/l2d 0 2024-09-21T12:20:30.348 INFO:tasks.workunit.client.0.smithi003.stdout:2/125: fsync d0/f1d 0 2024-09-21T12:20:30.351 INFO:tasks.workunit.client.1.smithi192.stdout:0/747: symlink d3/de/d33/ldd 0 2024-09-21T12:20:30.354 INFO:tasks.workunit.client.1.smithi192.stdout:1/747: mkdir d2/d12/d2f/d51/df2 0 2024-09-21T12:20:30.356 INFO:tasks.workunit.client.1.smithi192.stdout:5/969: mkdir d0/d65/d6e/dc0/d44/d85/d97/d35/d14a 0 2024-09-21T12:20:30.361 INFO:tasks.workunit.client.1.smithi192.stdout:5/970: dwrite d0/d65/d6e/dc0/d44/d85/d97/f6c [0,4194304] 0 2024-09-21T12:20:30.362 INFO:tasks.workunit.client.0.smithi003.stdout:2/126: stat d0/l15 0 2024-09-21T12:20:30.364 INFO:tasks.workunit.client.1.smithi192.stdout:3/641: getdents db/d16/d18/d40/d60 0 2024-09-21T12:20:30.367 INFO:tasks.workunit.client.1.smithi192.stdout:0/748: creat d3/fde x:0 0 0 2024-09-21T12:20:30.368 INFO:tasks.workunit.client.1.smithi192.stdout:0/749: stat d3/de/d9b 0 2024-09-21T12:20:30.368 INFO:tasks.workunit.client.1.smithi192.stdout:9/752: dwrite d5/d8/f22 [0,4194304] 0 2024-09-21T12:20:30.368 INFO:tasks.workunit.client.0.smithi003.stdout:9/274: creat d2/d20/d22/d3f/f63 x:0 0 0 2024-09-21T12:20:30.374 INFO:tasks.workunit.client.1.smithi192.stdout:7/698: creat d6/d9/d2d/dd0/ff3 x:0 0 0 2024-09-21T12:20:30.376 INFO:tasks.workunit.client.1.smithi192.stdout:2/702: rename d1b/d65/l72 to d1b/d1e/le8 0 2024-09-21T12:20:30.376 INFO:tasks.workunit.client.1.smithi192.stdout:5/971: mkdir d0/d65/d6e/d91/d14b 0 2024-09-21T12:20:30.377 INFO:tasks.workunit.client.1.smithi192.stdout:5/972: fsync d0/d65/d6e/f128 0 2024-09-21T12:20:30.377 INFO:tasks.workunit.client.1.smithi192.stdout:9/753: chown d5/d19/dd5/ca1 2879 1 2024-09-21T12:20:30.378 INFO:tasks.workunit.client.1.smithi192.stdout:4/672: link d2/db/da4/cbe d2/db/d34/ce0 0 2024-09-21T12:20:30.379 INFO:tasks.workunit.client.1.smithi192.stdout:7/699: symlink d6/d9/d1f/d3e/lf4 0 2024-09-21T12:20:30.379 INFO:tasks.workunit.client.1.smithi192.stdout:9/754: fdatasync d5/dc/d40/fbd 0 2024-09-21T12:20:30.379 INFO:tasks.workunit.client.1.smithi192.stdout:2/703: mkdir d1b/d1e/d7b/de9 0 2024-09-21T12:20:30.379 INFO:tasks.workunit.client.1.smithi192.stdout:3/642: unlink db/c94 0 2024-09-21T12:20:30.380 INFO:tasks.workunit.client.1.smithi192.stdout:5/973: chown d0/d65/d6e/dc0/d44/d85/d97/f78 3417259 1 2024-09-21T12:20:30.380 INFO:tasks.workunit.client.1.smithi192.stdout:0/750: symlink d3/de/dc6/d83/dc9/ldf 0 2024-09-21T12:20:30.383 INFO:tasks.workunit.client.1.smithi192.stdout:6/835: sync 2024-09-21T12:20:30.383 INFO:tasks.workunit.client.1.smithi192.stdout:8/769: sync 2024-09-21T12:20:30.383 INFO:tasks.workunit.client.1.smithi192.stdout:2/704: creat d1b/d1e/d3d/fea x:0 0 0 2024-09-21T12:20:30.384 INFO:tasks.workunit.client.1.smithi192.stdout:1/748: getdents d2/d12/d2f/d41 0 2024-09-21T12:20:30.384 INFO:tasks.workunit.client.1.smithi192.stdout:0/751: mkdir d3/d5/de0 0 2024-09-21T12:20:30.385 INFO:tasks.workunit.client.1.smithi192.stdout:2/705: chown d1b/d1e/d5e/d88/d95/dbe 23 1 2024-09-21T12:20:30.386 INFO:tasks.workunit.client.1.smithi192.stdout:5/974: mknod d0/d65/d6e/dbc/dc8/c14c 0 2024-09-21T12:20:30.387 INFO:tasks.workunit.client.1.smithi192.stdout:7/700: rename d6/c6a to d6/d20/dc9/cf5 0 2024-09-21T12:20:30.389 INFO:tasks.workunit.client.1.smithi192.stdout:3/643: truncate db/d16/d18/d33/d3b/f58 1906606 0 2024-09-21T12:20:30.391 INFO:tasks.workunit.client.1.smithi192.stdout:6/836: mknod da/c118 0 2024-09-21T12:20:30.391 INFO:tasks.workunit.client.1.smithi192.stdout:8/770: dwrite d14/d1a/d1d/d48/de2/f101 [0,4194304] 0 2024-09-21T12:20:30.395 INFO:tasks.workunit.client.1.smithi192.stdout:2/706: rename d1b/f4c to d1b/d38/d7d/feb 0 2024-09-21T12:20:30.396 INFO:tasks.workunit.client.1.smithi192.stdout:6/837: dread da/d1f/fab [0,4194304] 0 2024-09-21T12:20:30.397 INFO:tasks.workunit.client.1.smithi192.stdout:7/701: unlink d6/d9/d1f/d3e/fa0 0 2024-09-21T12:20:30.399 INFO:tasks.workunit.client.1.smithi192.stdout:8/771: dread d14/d18/d94/dc3/fcc [0,4194304] 0 2024-09-21T12:20:30.405 INFO:tasks.workunit.client.1.smithi192.stdout:1/749: getdents d2/d82 0 2024-09-21T12:20:30.406 INFO:tasks.workunit.client.1.smithi192.stdout:7/702: mknod d6/d20/cf6 0 2024-09-21T12:20:30.409 INFO:tasks.workunit.client.1.smithi192.stdout:4/673: dwrite d2/db/d34/f86 [0,4194304] 0 2024-09-21T12:20:30.410 INFO:tasks.workunit.client.1.smithi192.stdout:9/755: dwrite d5/f9d [0,4194304] 0 2024-09-21T12:20:30.410 INFO:tasks.workunit.client.1.smithi192.stdout:8/772: creat d14/d18/d7b/f105 x:0 0 0 2024-09-21T12:20:30.410 INFO:tasks.workunit.client.1.smithi192.stdout:5/975: write d0/d65/d8e/d77/fcf [637843,69026] 0 2024-09-21T12:20:30.412 INFO:tasks.workunit.client.1.smithi192.stdout:9/756: write d5/f7 [3469689,2729] 0 2024-09-21T12:20:30.412 INFO:tasks.workunit.client.1.smithi192.stdout:4/674: chown d2/db/d3e/d57/d32/cb9 54315 1 2024-09-21T12:20:30.413 INFO:tasks.workunit.client.1.smithi192.stdout:2/707: truncate d1b/f6a 684901 0 2024-09-21T12:20:30.419 INFO:tasks.workunit.client.1.smithi192.stdout:3/644: rmdir db/d16/d18/d21/d23/dd2/d2e/db8/dd0/dd3 0 2024-09-21T12:20:30.421 INFO:tasks.workunit.client.1.smithi192.stdout:7/703: rename d6/d9/d2d/dd0/ff3 to d6/d9/d2d/d7b/dee/ff7 0 2024-09-21T12:20:30.421 INFO:tasks.workunit.client.1.smithi192.stdout:3/645: stat db/d16/dc1/dd5 0 2024-09-21T12:20:30.422 INFO:tasks.workunit.client.1.smithi192.stdout:5/976: truncate d0/d65/d6e/d84/d126/d13/d37/da8/daa/dc5/ddd/d107/f13b 340963 0 2024-09-21T12:20:30.424 INFO:tasks.workunit.client.1.smithi192.stdout:3/646: chown db/d16/d18/d21/d23/l25 80 1 2024-09-21T12:20:30.424 INFO:tasks.workunit.client.1.smithi192.stdout:5/977: dread - d0/d65/d6e/dc0/d44/d85/d97/d45/d12b/fe2 zero size 2024-09-21T12:20:30.426 INFO:tasks.workunit.client.1.smithi192.stdout:2/708: dread d1b/d1e/d3d/f4b [4194304,4194304] 0 2024-09-21T12:20:30.427 INFO:tasks.workunit.client.1.smithi192.stdout:8/773: getdents d14/d1a/de9/dfa 0 2024-09-21T12:20:30.429 INFO:tasks.workunit.client.1.smithi192.stdout:0/752: unlink d3/d5/d28/d39/d50/dd9/d7a/dbe/d92/f3e 0 2024-09-21T12:20:30.432 INFO:tasks.workunit.client.1.smithi192.stdout:3/647: dread - db/d16/fa8 zero size 2024-09-21T12:20:30.433 INFO:tasks.workunit.client.1.smithi192.stdout:5/978: creat d0/d65/d6e/dbc/dc8/f14d x:0 0 0 2024-09-21T12:20:30.436 INFO:tasks.workunit.client.1.smithi192.stdout:0/753: dwrite d3/d5/d28/d39/d50/dd9/d7a/dbe/f65 [0,4194304] 0 2024-09-21T12:20:30.437 INFO:tasks.workunit.client.0.smithi003.stdout:8/137: creat d7/df/d20/d24/f2e x:0 0 0 2024-09-21T12:20:30.438 INFO:tasks.workunit.client.0.smithi003.stdout:4/103: write f8 [1142258,103833] 0 2024-09-21T12:20:30.438 INFO:tasks.workunit.client.1.smithi192.stdout:8/774: mknod d14/d1a/d1d/d39/c106 0 2024-09-21T12:20:30.438 INFO:tasks.workunit.client.1.smithi192.stdout:0/754: write d3/d5/d28/d39/d50/dd9/d7a/dbe/d92/d51/f82 [2426009,96950] 0 2024-09-21T12:20:30.439 INFO:tasks.workunit.client.1.smithi192.stdout:9/757: write d5/dc/d64/dbb/f4c [418239,110917] 0 2024-09-21T12:20:30.439 INFO:tasks.workunit.client.0.smithi003.stdout:1/133: creat d4/f30 x:0 0 0 2024-09-21T12:20:30.439 INFO:tasks.workunit.client.0.smithi003.stdout:8/138: dread - d7/de/d1a/f2b zero size 2024-09-21T12:20:30.441 INFO:tasks.workunit.client.1.smithi192.stdout:8/775: readlink d14/d1a/d1d/d46/d4e/d83/d8d/d9c/dee/d80/lb7 0 2024-09-21T12:20:30.444 INFO:tasks.workunit.client.1.smithi192.stdout:6/838: truncate da/d23/d37/f70 2083830 0 2024-09-21T12:20:30.445 INFO:tasks.workunit.client.0.smithi003.stdout:4/104: rmdir d9/d16 39 2024-09-21T12:20:30.446 INFO:tasks.workunit.client.0.smithi003.stdout:4/105: readlink d9/l20 0 2024-09-21T12:20:30.446 INFO:tasks.workunit.client.0.smithi003.stdout:4/106: read - d9/f15 zero size 2024-09-21T12:20:30.448 INFO:tasks.workunit.client.0.smithi003.stdout:8/139: unlink d7/df/d20/l2c 0 2024-09-21T12:20:30.449 INFO:tasks.workunit.client.0.smithi003.stdout:1/134: creat d4/df/f31 x:0 0 0 2024-09-21T12:20:30.450 INFO:tasks.workunit.client.1.smithi192.stdout:1/750: dread d2/da/f60 [4194304,4194304] 0 2024-09-21T12:20:30.451 INFO:tasks.workunit.client.1.smithi192.stdout:2/709: fdatasync d1b/d1e/d5e/d75/da1/de3/fe6 0 2024-09-21T12:20:30.453 INFO:tasks.workunit.client.0.smithi003.stdout:4/107: truncate d9/f14 5913556 0 2024-09-21T12:20:30.454 INFO:tasks.workunit.client.0.smithi003.stdout:4/108: stat d9/f13 0 2024-09-21T12:20:30.454 INFO:tasks.workunit.client.0.smithi003.stdout:4/109: chown f6 7872 1 2024-09-21T12:20:30.454 INFO:tasks.workunit.client.0.smithi003.stdout:8/140: mknod d7/de/d11/c2f 0 2024-09-21T12:20:30.456 INFO:tasks.workunit.client.0.smithi003.stdout:1/135: creat d4/dc/f32 x:0 0 0 2024-09-21T12:20:30.456 INFO:tasks.workunit.client.0.smithi003.stdout:1/136: readlink l3 0 2024-09-21T12:20:30.458 INFO:tasks.workunit.client.0.smithi003.stdout:2/127: getdents d0 0 2024-09-21T12:20:30.459 INFO:tasks.workunit.client.0.smithi003.stdout:4/110: dread f6 [0,4194304] 0 2024-09-21T12:20:30.460 INFO:tasks.workunit.client.1.smithi192.stdout:0/755: dwrite d3/d5/fcf [0,4194304] 0 2024-09-21T12:20:30.460 INFO:tasks.workunit.client.0.smithi003.stdout:8/141: mknod d7/de/d11/c30 0 2024-09-21T12:20:30.460 INFO:tasks.workunit.client.0.smithi003.stdout:4/111: write f8 [1455515,105819] 0 2024-09-21T12:20:30.464 INFO:tasks.workunit.client.0.smithi003.stdout:1/137: mknod d4/d11/c33 0 2024-09-21T12:20:30.464 INFO:tasks.workunit.client.0.smithi003.stdout:1/138: stat f2 0 2024-09-21T12:20:30.466 INFO:tasks.workunit.client.0.smithi003.stdout:2/128: symlink d0/d1c/l2b 0 2024-09-21T12:20:30.467 INFO:tasks.workunit.client.1.smithi192.stdout:9/758: dread d5/d8/dc7/dd7/de7/d55/d70/fac [0,4194304] 0 2024-09-21T12:20:30.468 INFO:tasks.workunit.client.1.smithi192.stdout:9/759: write d5/dc/d64/dbb/d3d/f54 [3420029,120248] 0 2024-09-21T12:20:30.469 INFO:tasks.workunit.client.1.smithi192.stdout:4/675: rename d2/db/d34/d56/d6c/f74 to d2/db/d34/d56/d6c/db8/d88/fe1 0 2024-09-21T12:20:30.469 INFO:tasks.workunit.client.0.smithi003.stdout:9/275: truncate d2/da/d17/f2c 3446190 0 2024-09-21T12:20:30.471 INFO:tasks.workunit.client.0.smithi003.stdout:9/276: truncate d2/d20/d22/d3f/f63 750919 0 2024-09-21T12:20:30.471 INFO:tasks.workunit.client.0.smithi003.stdout:8/142: fsync f4 0 2024-09-21T12:20:30.472 INFO:tasks.workunit.client.1.smithi192.stdout:9/760: dread d5/f9d [0,4194304] 0 2024-09-21T12:20:30.476 INFO:tasks.workunit.client.0.smithi003.stdout:1/139: chown d4/df/l2e 238 1 2024-09-21T12:20:30.478 INFO:tasks.workunit.client.1.smithi192.stdout:9/761: dread d5/d8/dc7/dd7/de7/fb1 [0,4194304] 0 2024-09-21T12:20:30.480 INFO:tasks.workunit.client.0.smithi003.stdout:8/143: dwrite d7/df/d20/d24/f2e [0,4194304] 0 2024-09-21T12:20:30.486 INFO:tasks.workunit.client.0.smithi003.stdout:1/140: dwrite f2 [4194304,4194304] 0 2024-09-21T12:20:30.487 INFO:tasks.workunit.client.1.smithi192.stdout:8/776: mkdir d14/d1a/d1d/d46/d4e/d83/d8d/d9c/dd6/d107 0 2024-09-21T12:20:30.488 INFO:tasks.workunit.client.0.smithi003.stdout:9/277: mknod d2/d20/d22/c64 0 2024-09-21T12:20:30.490 INFO:tasks.workunit.client.1.smithi192.stdout:0/756: symlink d3/de/d33/dae/le1 0 2024-09-21T12:20:30.492 INFO:tasks.workunit.client.1.smithi192.stdout:5/979: write d0/d65/d6e/dc0/d44/d85/d97/d35/ff5 [2449281,48370] 0 2024-09-21T12:20:30.493 INFO:tasks.workunit.client.1.smithi192.stdout:5/980: dread - d0/d65/d6e/dc0/d44/d85/d97/d45/d12b/f117 zero size 2024-09-21T12:20:30.497 INFO:tasks.workunit.client.0.smithi003.stdout:2/129: mkdir d0/d21/d2c 0 2024-09-21T12:20:30.497 INFO:tasks.workunit.client.1.smithi192.stdout:7/704: getdents d6/d9 0 2024-09-21T12:20:30.499 INFO:tasks.workunit.client.0.smithi003.stdout:8/144: mknod d7/de/c31 0 2024-09-21T12:20:30.501 INFO:tasks.workunit.client.0.smithi003.stdout:1/141: mknod d4/d11/c34 0 2024-09-21T12:20:30.502 INFO:tasks.workunit.client.0.smithi003.stdout:1/142: write d4/dc/f32 [533522,94550] 0 2024-09-21T12:20:30.505 INFO:tasks.workunit.client.1.smithi192.stdout:4/676: rename d2/db/d3e/d41 to d2/db/d3e/de2 0 2024-09-21T12:20:30.505 INFO:tasks.workunit.client.1.smithi192.stdout:4/677: chown d2/fc9 322725240 1 2024-09-21T12:20:30.506 INFO:tasks.workunit.client.1.smithi192.stdout:4/678: dread - d2/db/d34/f94 zero size 2024-09-21T12:20:30.506 INFO:tasks.workunit.client.1.smithi192.stdout:3/648: rmdir db/d16/d18/d33/d4a/dcf 0 2024-09-21T12:20:30.508 INFO:tasks.workunit.client.1.smithi192.stdout:2/710: truncate d1b/d65/d77/fcd 1942900 0 2024-09-21T12:20:30.508 INFO:tasks.workunit.client.0.smithi003.stdout:4/112: dwrite d9/da/fb [0,4194304] 0 2024-09-21T12:20:30.510 INFO:tasks.workunit.client.1.smithi192.stdout:9/762: rmdir d5/dc/d80/d44/d8e/dd6 39 2024-09-21T12:20:30.512 INFO:tasks.workunit.client.0.smithi003.stdout:1/143: read d4/dc/f32 [275310,100360] 0 2024-09-21T12:20:30.513 INFO:tasks.workunit.client.1.smithi192.stdout:8/777: creat d14/d18/daf/f108 x:0 0 0 2024-09-21T12:20:30.514 INFO:tasks.workunit.client.0.smithi003.stdout:4/113: mknod d9/da/c21 0 2024-09-21T12:20:30.514 INFO:tasks.workunit.client.0.smithi003.stdout:4/114: write d9/f18 [256341,30869] 0 2024-09-21T12:20:30.515 INFO:tasks.workunit.client.1.smithi192.stdout:0/757: symlink d3/d5/d28/d39/d50/dd9/d7a/dbe/d92/le2 0 2024-09-21T12:20:30.516 INFO:tasks.workunit.client.0.smithi003.stdout:4/115: read d9/fc [8266180,117704] 0 2024-09-21T12:20:30.518 INFO:tasks.workunit.client.1.smithi192.stdout:0/758: write d3/d5/d28/d39/d50/dd9/d7a/fb8 [1609839,1597] 0 2024-09-21T12:20:30.518 INFO:tasks.workunit.client.0.smithi003.stdout:9/278: dread d2/f10 [0,4194304] 0 2024-09-21T12:20:30.519 INFO:tasks.workunit.client.1.smithi192.stdout:6/839: rmdir da/d1f/d56/da9/d10c 0 2024-09-21T12:20:30.520 INFO:tasks.workunit.client.0.smithi003.stdout:2/130: link d0/dd/f1b d0/dd/d16/f2d 0 2024-09-21T12:20:30.521 INFO:tasks.workunit.client.1.smithi192.stdout:7/705: stat d6/d20/d69/d90/da7/cd8 0 2024-09-21T12:20:30.521 INFO:tasks.workunit.client.1.smithi192.stdout:8/778: dwrite d14/d1a/d1d/f57 [4194304,4194304] 0 2024-09-21T12:20:30.522 INFO:tasks.workunit.client.0.smithi003.stdout:1/144: creat d4/dc/f35 x:0 0 0 2024-09-21T12:20:30.522 INFO:tasks.workunit.client.0.smithi003.stdout:1/145: stat d4/d11/d14 0 2024-09-21T12:20:30.523 INFO:tasks.workunit.client.1.smithi192.stdout:8/779: fsync d14/d1a/d1d/d20/f47 0 2024-09-21T12:20:30.526 INFO:tasks.workunit.client.0.smithi003.stdout:4/116: creat d9/da/f22 x:0 0 0 2024-09-21T12:20:30.526 INFO:tasks.workunit.client.1.smithi192.stdout:6/840: dwrite da/d1f/d48/fdb [4194304,4194304] 0 2024-09-21T12:20:30.528 INFO:tasks.workunit.client.1.smithi192.stdout:4/679: mkdir d2/db/d34/d56/d6c/de3 0 2024-09-21T12:20:30.529 INFO:tasks.workunit.client.0.smithi003.stdout:9/279: chown d2/d20/c26 10 1 2024-09-21T12:20:30.529 INFO:tasks.workunit.client.1.smithi192.stdout:4/680: stat d2/d36/d55/d89/ldd 0 2024-09-21T12:20:30.531 INFO:tasks.workunit.client.1.smithi192.stdout:4/681: write d2/db/d34/f4a [4849113,55181] 0 2024-09-21T12:20:30.531 INFO:tasks.workunit.client.0.smithi003.stdout:1/146: chown d4/df/f1a 1 1 2024-09-21T12:20:30.532 INFO:tasks.workunit.client.0.smithi003.stdout:1/147: chown d4/df/f1a 0 1 2024-09-21T12:20:30.532 INFO:tasks.workunit.client.1.smithi192.stdout:9/763: creat d5/d19/d32/dc0/fee x:0 0 0 2024-09-21T12:20:30.533 INFO:tasks.workunit.client.0.smithi003.stdout:8/145: mknod d7/de/d11/c32 0 2024-09-21T12:20:30.537 INFO:tasks.workunit.client.1.smithi192.stdout:0/759: dread d3/d5/d28/d39/d50/dd9/d7a/f7e [0,4194304] 0 2024-09-21T12:20:30.541 INFO:tasks.workunit.client.1.smithi192.stdout:9/764: dread d5/dc/d40/dad/d53/d6e/f85 [0,4194304] 0 2024-09-21T12:20:30.543 INFO:tasks.workunit.client.1.smithi192.stdout:8/780: symlink d14/d1a/d1d/d48/dac/l109 0 2024-09-21T12:20:30.544 INFO:tasks.workunit.client.1.smithi192.stdout:8/781: fsync d14/d18/daf/f108 0 2024-09-21T12:20:30.545 INFO:tasks.workunit.client.0.smithi003.stdout:4/117: truncate f6 3428542 0 2024-09-21T12:20:30.546 INFO:tasks.workunit.client.1.smithi192.stdout:3/649: mkdir db/d16/dee 0 2024-09-21T12:20:30.547 INFO:tasks.workunit.client.0.smithi003.stdout:8/146: creat d7/df/d20/d21/f33 x:0 0 0 2024-09-21T12:20:30.549 INFO:tasks.workunit.client.0.smithi003.stdout:9/280: link d2/da/d2a/f55 d2/d20/d22/d5e/f65 0 2024-09-21T12:20:30.549 INFO:tasks.workunit.client.1.smithi192.stdout:3/650: dread db/f4f [0,4194304] 0 2024-09-21T12:20:30.551 INFO:tasks.workunit.client.1.smithi192.stdout:2/711: unlink d1b/d1e/d7b/f80 0 2024-09-21T12:20:30.553 INFO:tasks.workunit.client.0.smithi003.stdout:1/148: link d4/fa d4/df/d19/f36 0 2024-09-21T12:20:30.554 INFO:tasks.workunit.client.1.smithi192.stdout:3/651: dwrite db/d16/d18/d33/f83 [0,4194304] 0 2024-09-21T12:20:30.554 INFO:tasks.workunit.client.0.smithi003.stdout:1/149: truncate d4/df/d19/f36 2013237 0 2024-09-21T12:20:30.555 INFO:tasks.workunit.client.1.smithi192.stdout:3/652: fdatasync db/d16/d18/d40/d60/fce 0 2024-09-21T12:20:30.556 INFO:tasks.workunit.client.1.smithi192.stdout:7/706: write d6/f82 [15236,85628] 0 2024-09-21T12:20:30.557 INFO:tasks.workunit.client.1.smithi192.stdout:3/653: write db/d16/d18/d21/f5d [1568728,29184] 0 2024-09-21T12:20:30.559 INFO:tasks.workunit.client.1.smithi192.stdout:3/654: fsync db/d16/d18/d33/d3b/f65 0 2024-09-21T12:20:30.564 INFO:tasks.workunit.client.1.smithi192.stdout:0/760: creat d3/d5/d28/d39/d50/dd9/fe3 x:0 0 0 2024-09-21T12:20:30.564 INFO:tasks.workunit.client.1.smithi192.stdout:7/707: dwrite d6/d9/d70/d77/f79 [0,4194304] 0 2024-09-21T12:20:30.565 INFO:tasks.workunit.client.1.smithi192.stdout:7/708: stat d6/d20/f4d 0 2024-09-21T12:20:30.566 INFO:tasks.workunit.client.1.smithi192.stdout:0/761: dread - d3/d5/d28/d39/d50/dd9/d7a/dbe/f9f zero size 2024-09-21T12:20:30.566 INFO:tasks.workunit.client.1.smithi192.stdout:9/765: creat d5/dc/dc2/dd1/fef x:0 0 0 2024-09-21T12:20:30.570 INFO:tasks.workunit.client.1.smithi192.stdout:8/782: read d14/d1a/d1d/d20/f44 [167594,65797] 0 2024-09-21T12:20:30.570 INFO:tasks.workunit.client.0.smithi003.stdout:9/281: symlink d2/d20/d22/d5e/l66 0 2024-09-21T12:20:30.572 INFO:tasks.workunit.client.1.smithi192.stdout:4/682: write d2/f84 [1040291,49573] 0 2024-09-21T12:20:30.574 INFO:tasks.workunit.client.0.smithi003.stdout:4/118: creat d9/f23 x:0 0 0 2024-09-21T12:20:30.575 INFO:tasks.workunit.client.0.smithi003.stdout:1/150: mkdir d4/df/d19/d37 0 2024-09-21T12:20:30.576 INFO:tasks.workunit.client.0.smithi003.stdout:4/119: write d9/f23 [904759,70418] 0 2024-09-21T12:20:30.577 INFO:tasks.workunit.client.0.smithi003.stdout:8/147: link d7/de/d11/c2f d7/df/c34 0 2024-09-21T12:20:30.580 INFO:tasks.workunit.client.0.smithi003.stdout:9/282: dwrite d2/da/d2a/d3c/f37 [0,4194304] 0 2024-09-21T12:20:30.582 INFO:tasks.workunit.client.0.smithi003.stdout:9/283: stat d2/d20/d22/d5e 0 2024-09-21T12:20:30.587 INFO:tasks.workunit.client.0.smithi003.stdout:8/148: dwrite d7/f18 [0,4194304] 0 2024-09-21T12:20:30.588 INFO:tasks.workunit.client.0.smithi003.stdout:8/149: stat d7/df/d16 0 2024-09-21T12:20:30.591 INFO:tasks.workunit.client.0.smithi003.stdout:9/284: symlink d2/da/d17/l67 0 2024-09-21T12:20:30.593 INFO:tasks.workunit.client.1.smithi192.stdout:8/783: creat d14/d18/d94/dc3/f10a x:0 0 0 2024-09-21T12:20:30.594 INFO:tasks.workunit.client.1.smithi192.stdout:8/784: truncate d14/d18/d94/dc3/f10a 412931 0 2024-09-21T12:20:30.596 INFO:tasks.workunit.client.1.smithi192.stdout:8/785: chown d14/d1a/d1d/d46/d4e/d83/d8d/d9c/dee/d80/d9a/dba/lf6 31877703 1 2024-09-21T12:20:30.596 INFO:tasks.workunit.client.0.smithi003.stdout:8/150: creat d7/df/d20/f35 x:0 0 0 2024-09-21T12:20:30.597 INFO:tasks.workunit.client.0.smithi003.stdout:8/151: chown d7/de/d11 566 1 2024-09-21T12:20:30.598 INFO:tasks.workunit.client.1.smithi192.stdout:2/712: mknod d1b/d1e/d5e/d88/d95/dbe/dd0/ddd/cec 0 2024-09-21T12:20:30.599 INFO:tasks.workunit.client.0.smithi003.stdout:4/120: creat d9/f24 x:0 0 0 2024-09-21T12:20:30.601 INFO:tasks.workunit.client.1.smithi192.stdout:8/786: dwrite d14/fc5 [0,4194304] 0 2024-09-21T12:20:30.602 INFO:tasks.workunit.client.0.smithi003.stdout:8/152: mkdir d7/df/d36 0 2024-09-21T12:20:30.607 INFO:tasks.workunit.client.0.smithi003.stdout:4/121: mkdir d9/d25 0 2024-09-21T12:20:30.609 INFO:tasks.workunit.client.0.smithi003.stdout:4/122: truncate d9/f24 937143 0 2024-09-21T12:20:30.610 INFO:tasks.workunit.client.0.smithi003.stdout:1/151: fsync d4/fa 0 2024-09-21T12:20:30.613 INFO:tasks.workunit.client.0.smithi003.stdout:8/153: dwrite d7/de/d1a/f2b [0,4194304] 0 2024-09-21T12:20:30.619 INFO:tasks.workunit.client.0.smithi003.stdout:1/152: creat d4/df/f38 x:0 0 0 2024-09-21T12:20:30.622 INFO:tasks.workunit.client.0.smithi003.stdout:4/123: dread f8 [0,4194304] 0 2024-09-21T12:20:30.624 INFO:tasks.workunit.client.0.smithi003.stdout:8/154: creat d7/df/d20/d21/f37 x:0 0 0 2024-09-21T12:20:30.626 INFO:tasks.workunit.client.0.smithi003.stdout:9/285: dwrite d2/f2b [0,4194304] 0 2024-09-21T12:20:30.628 INFO:tasks.workunit.client.0.smithi003.stdout:8/155: write d7/df/f1b [2503726,3735] 0 2024-09-21T12:20:30.631 INFO:tasks.workunit.client.0.smithi003.stdout:4/124: dwrite d9/f13 [0,4194304] 0 2024-09-21T12:20:30.637 INFO:tasks.workunit.client.0.smithi003.stdout:1/153: creat d4/f39 x:0 0 0 2024-09-21T12:20:30.640 INFO:tasks.workunit.client.0.smithi003.stdout:0/135: sync 2024-09-21T12:20:30.642 INFO:tasks.workunit.client.1.smithi192.stdout:1/751: sync 2024-09-21T12:20:30.642 INFO:tasks.workunit.client.1.smithi192.stdout:1/752: chown d2/d12/d2f/d51/d24/d65/d8e/d9d 10 1 2024-09-21T12:20:30.644 INFO:tasks.workunit.client.0.smithi003.stdout:8/156: mknod d7/df/d36/c38 0 2024-09-21T12:20:30.646 INFO:tasks.workunit.client.0.smithi003.stdout:1/154: dwrite d4/fa [0,4194304] 0 2024-09-21T12:20:30.647 INFO:tasks.workunit.client.0.smithi003.stdout:4/125: creat d9/d16/f26 x:0 0 0 2024-09-21T12:20:30.649 INFO:tasks.workunit.client.0.smithi003.stdout:4/126: readlink d9/da/l1d 0 2024-09-21T12:20:30.649 INFO:tasks.workunit.client.0.smithi003.stdout:4/127: readlink l2 0 2024-09-21T12:20:30.654 INFO:tasks.workunit.client.0.smithi003.stdout:4/128: read d9/fc [2118779,71243] 0 2024-09-21T12:20:30.654 INFO:tasks.workunit.client.0.smithi003.stdout:0/136: dwrite d9/d12/d1e/f1f [0,4194304] 0 2024-09-21T12:20:30.656 INFO:tasks.workunit.client.0.smithi003.stdout:0/137: write d9/d12/d1e/f1f [1536912,25986] 0 2024-09-21T12:20:30.657 INFO:tasks.workunit.client.0.smithi003.stdout:0/138: chown d9/l11 7 1 2024-09-21T12:20:30.658 INFO:tasks.workunit.client.1.smithi192.stdout:1/753: dread d2/d12/d2f/d51/d24/d65/fe0 [4194304,4194304] 0 2024-09-21T12:20:30.658 INFO:tasks.workunit.client.0.smithi003.stdout:9/286: getdents d2/d20/d42 0 2024-09-21T12:20:30.659 INFO:tasks.workunit.client.0.smithi003.stdout:0/139: stat d9/d12/f13 0 2024-09-21T12:20:30.660 INFO:tasks.workunit.client.0.smithi003.stdout:4/129: dread d9/f14 [0,4194304] 0 2024-09-21T12:20:30.661 INFO:tasks.workunit.client.0.smithi003.stdout:0/140: write d9/d12/f13 [1024420,79876] 0 2024-09-21T12:20:30.663 INFO:tasks.workunit.client.0.smithi003.stdout:1/155: getdents d4/df/d19/d37 0 2024-09-21T12:20:30.666 INFO:tasks.workunit.client.0.smithi003.stdout:0/141: dread d9/d12/f16 [0,4194304] 0 2024-09-21T12:20:30.668 INFO:tasks.workunit.client.0.smithi003.stdout:4/130: dwrite d9/f13 [0,4194304] 0 2024-09-21T12:20:30.676 INFO:tasks.workunit.client.1.smithi192.stdout:6/841: getdents da/d1f/d48/d7d/daa 0 2024-09-21T12:20:30.677 INFO:tasks.workunit.client.0.smithi003.stdout:8/157: write d7/f14 [2834431,94215] 0 2024-09-21T12:20:30.677 INFO:tasks.workunit.client.0.smithi003.stdout:9/287: symlink d2/d20/l68 0 2024-09-21T12:20:30.679 INFO:tasks.workunit.client.0.smithi003.stdout:8/158: write d7/de/d1a/f2b [397903,76714] 0 2024-09-21T12:20:30.680 INFO:tasks.workunit.client.1.smithi192.stdout:4/683: rename d2/db/d3e/d57/f72 to d2/db/d34/d56/d83/d93/fe4 0 2024-09-21T12:20:30.680 INFO:tasks.workunit.client.0.smithi003.stdout:9/288: dread d2/d20/d22/d3f/f63 [0,4194304] 0 2024-09-21T12:20:30.680 INFO:tasks.workunit.client.0.smithi003.stdout:8/159: dread - d7/df/d20/d21/f37 zero size 2024-09-21T12:20:30.681 INFO:tasks.workunit.client.0.smithi003.stdout:9/289: dread - d2/da/d2a/f55 zero size 2024-09-21T12:20:30.686 INFO:tasks.workunit.client.0.smithi003.stdout:9/290: dread d2/da/d17/d40/f4a [0,4194304] 0 2024-09-21T12:20:30.687 INFO:tasks.workunit.client.0.smithi003.stdout:0/142: symlink d9/d12/l27 0 2024-09-21T12:20:30.688 INFO:tasks.workunit.client.0.smithi003.stdout:9/291: chown d2/da/d35/d4d/c62 0 1 2024-09-21T12:20:30.692 INFO:tasks.workunit.client.1.smithi192.stdout:3/655: write db/d16/d18/d33/d3b/f58 [713500,4006] 0 2024-09-21T12:20:30.697 INFO:tasks.workunit.client.0.smithi003.stdout:4/131: link d9/f24 d9/da/f27 0 2024-09-21T12:20:30.697 INFO:tasks.workunit.client.0.smithi003.stdout:0/143: dwrite d9/d12/d22/f24 [0,4194304] 0 2024-09-21T12:20:30.699 INFO:tasks.workunit.client.0.smithi003.stdout:9/292: dwrite d2/d20/d22/d3f/f63 [0,4194304] 0 2024-09-21T12:20:30.700 INFO:tasks.workunit.client.1.smithi192.stdout:0/762: rename d3/de/dc6/fd to d3/d5/d69/db2/fe4 0 2024-09-21T12:20:30.702 INFO:tasks.workunit.client.0.smithi003.stdout:1/156: creat d4/f3a x:0 0 0 2024-09-21T12:20:30.703 INFO:tasks.workunit.client.1.smithi192.stdout:0/763: truncate d3/d5/d28/d39/d50/dd9/d7a/dbe/d89/fa0 287583 0 2024-09-21T12:20:30.703 INFO:tasks.workunit.client.1.smithi192.stdout:5/981: sync 2024-09-21T12:20:30.704 INFO:tasks.workunit.client.0.smithi003.stdout:1/157: fsync d4/dc/f10 0 2024-09-21T12:20:30.706 INFO:tasks.workunit.client.1.smithi192.stdout:2/713: mknod d1b/d1e/d7b/de9/ced 0 2024-09-21T12:20:30.706 INFO:tasks.workunit.client.1.smithi192.stdout:4/684: dread d2/db/d34/f4a [0,4194304] 0 2024-09-21T12:20:30.711 INFO:tasks.workunit.client.1.smithi192.stdout:3/656: mkdir db/d16/dc1/def 0 2024-09-21T12:20:30.712 INFO:tasks.workunit.client.1.smithi192.stdout:6/842: mkdir da/d1f/d119 0 2024-09-21T12:20:30.713 INFO:tasks.workunit.client.1.smithi192.stdout:0/764: dread d3/de/f60 [0,4194304] 0 2024-09-21T12:20:30.713 INFO:tasks.workunit.client.0.smithi003.stdout:9/293: symlink d2/d20/d42/l69 0 2024-09-21T12:20:30.714 INFO:tasks.workunit.client.1.smithi192.stdout:0/765: chown d3/de/dc6/d83/fc7 1153 1 2024-09-21T12:20:30.714 INFO:tasks.workunit.client.1.smithi192.stdout:0/766: write d3/d5/d28/d39/fd0 [373987,121706] 0 2024-09-21T12:20:30.715 INFO:tasks.workunit.client.1.smithi192.stdout:5/982: mkdir d0/d65/d6e/dc0/d44/d85/d97/d45/d12b/da5/d14e 0 2024-09-21T12:20:30.719 INFO:tasks.workunit.client.0.smithi003.stdout:8/160: getdents d7/de 0 2024-09-21T12:20:30.720 INFO:tasks.workunit.client.0.smithi003.stdout:8/161: truncate d7/df/f26 378521 0 2024-09-21T12:20:30.725 INFO:tasks.workunit.client.0.smithi003.stdout:9/294: symlink d2/d20/d22/d3f/l6a 0 2024-09-21T12:20:30.727 INFO:tasks.workunit.client.0.smithi003.stdout:8/162: dwrite d7/f14 [0,4194304] 0 2024-09-21T12:20:30.727 INFO:tasks.workunit.client.0.smithi003.stdout:0/144: getdents d9 0 2024-09-21T12:20:30.729 INFO:tasks.workunit.client.0.smithi003.stdout:1/158: rmdir d4/df/d19/d37 0 2024-09-21T12:20:30.734 INFO:tasks.workunit.client.0.smithi003.stdout:8/163: rename d7/de/c31 to d7/df/d16/c39 0 2024-09-21T12:20:30.735 INFO:tasks.workunit.client.0.smithi003.stdout:0/145: dwrite f8 [4194304,4194304] 0 2024-09-21T12:20:30.737 INFO:tasks.workunit.client.0.smithi003.stdout:1/159: creat d4/df/d12/f3b x:0 0 0 2024-09-21T12:20:30.741 INFO:tasks.workunit.client.0.smithi003.stdout:8/164: creat d7/df/d20/d21/f3a x:0 0 0 2024-09-21T12:20:30.746 INFO:tasks.workunit.client.0.smithi003.stdout:8/165: truncate d7/df/f12 3670096 0 2024-09-21T12:20:30.747 INFO:tasks.workunit.client.0.smithi003.stdout:4/132: truncate d9/fc 623347 0 2024-09-21T12:20:30.748 INFO:tasks.workunit.client.0.smithi003.stdout:4/133: dread - d9/da/f22 zero size 2024-09-21T12:20:30.749 INFO:tasks.workunit.client.0.smithi003.stdout:1/160: creat d4/f3c x:0 0 0 2024-09-21T12:20:30.749 INFO:tasks.workunit.client.0.smithi003.stdout:4/134: creat d9/d16/f28 x:0 0 0 2024-09-21T12:20:30.752 INFO:tasks.workunit.client.0.smithi003.stdout:4/135: rename d9/c19 to d9/c29 0 2024-09-21T12:20:30.768 INFO:tasks.workunit.client.1.smithi192.stdout:8/787: rmdir d14/d1a/d1d/d46/d4e/d83/d8d/d9c/dd6/d107 0 2024-09-21T12:20:30.768 INFO:tasks.workunit.client.1.smithi192.stdout:3/657: mkdir db/d16/d18/d21/d23/dd2/d2e/db8/dd0/df0 0 2024-09-21T12:20:30.769 INFO:tasks.workunit.client.0.smithi003.stdout:7/120: sync 2024-09-21T12:20:30.770 INFO:tasks.workunit.client.1.smithi192.stdout:1/754: link d2/d12/d2f/d51/d24/d65/d8e/ca1 d2/de/dcf/cf3 0 2024-09-21T12:20:30.770 INFO:tasks.workunit.client.1.smithi192.stdout:9/766: getdents d5/dc 0 2024-09-21T12:20:30.772 INFO:tasks.workunit.client.1.smithi192.stdout:6/843: unlink da/d23/d37/l30 0 2024-09-21T12:20:30.773 INFO:tasks.workunit.client.1.smithi192.stdout:3/658: stat db/d16/c37 0 2024-09-21T12:20:30.773 INFO:tasks.workunit.client.0.smithi003.stdout:4/136: dwrite d9/da/f12 [0,4194304] 0 2024-09-21T12:20:30.774 INFO:tasks.workunit.client.0.smithi003.stdout:7/121: chown l5 625 1 2024-09-21T12:20:30.775 INFO:tasks.workunit.client.1.smithi192.stdout:0/767: dwrite d3/d5/d69/db2/fe4 [4194304,4194304] 0 2024-09-21T12:20:30.775 INFO:tasks.workunit.client.0.smithi003.stdout:7/122: chown d8/db/d13/d21/f2a 2442 1 2024-09-21T12:20:30.777 INFO:tasks.workunit.client.0.smithi003.stdout:9/295: write d2/da/d2a/f55 [370339,90826] 0 2024-09-21T12:20:30.778 INFO:tasks.workunit.client.0.smithi003.stdout:0/146: dread d9/d12/d17/f18 [0,4194304] 0 2024-09-21T12:20:30.784 INFO:tasks.workunit.client.1.smithi192.stdout:4/685: symlink d2/db/d1a/le5 0 2024-09-21T12:20:30.786 INFO:tasks.workunit.client.0.smithi003.stdout:0/147: dread d9/d12/f13 [0,4194304] 0 2024-09-21T12:20:30.788 INFO:tasks.workunit.client.0.smithi003.stdout:0/148: write d9/d12/d17/f19 [628461,51140] 0 2024-09-21T12:20:30.789 INFO:tasks.workunit.client.0.smithi003.stdout:0/149: chown l5 26860 1 2024-09-21T12:20:30.790 INFO:tasks.workunit.client.0.smithi003.stdout:0/150: write d9/d12/d22/f24 [1757117,83819] 0 2024-09-21T12:20:30.790 INFO:tasks.workunit.client.0.smithi003.stdout:9/296: unlink d2/da/c1f 0 2024-09-21T12:20:30.793 INFO:tasks.workunit.client.1.smithi192.stdout:9/767: dwrite d5/f2f [0,4194304] 0 2024-09-21T12:20:30.795 INFO:tasks.workunit.client.0.smithi003.stdout:1/161: write d4/fb [2508227,45969] 0 2024-09-21T12:20:30.795 INFO:tasks.workunit.client.1.smithi192.stdout:6/844: truncate da/d23/d37/f8e 8479815 0 2024-09-21T12:20:30.797 INFO:tasks.workunit.client.1.smithi192.stdout:6/845: dread da/d1f/d27/fee [0,4194304] 0 2024-09-21T12:20:30.802 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:30 smithi192 ceph-mon[35641]: pgmap v265: 65 pgs: 65 active+clean; 1.4 GiB data, 4.3 GiB used, 532 GiB / 536 GiB avail; 44 MiB/s rd, 192 MiB/s wr, 388 op/s 2024-09-21T12:20:30.803 INFO:tasks.workunit.client.1.smithi192.stdout:3/659: rename db/d16/d18/d33/d3b/d68 to db/d16/d18/d33/d3b/db1/df1 0 2024-09-21T12:20:30.806 INFO:tasks.workunit.client.1.smithi192.stdout:0/768: creat d3/de/d9b/fe5 x:0 0 0 2024-09-21T12:20:30.808 INFO:tasks.workunit.client.1.smithi192.stdout:5/983: creat d0/d65/d6e/dc0/d44/f14f x:0 0 0 2024-09-21T12:20:30.809 INFO:tasks.workunit.client.0.smithi003.stdout:0/151: creat d9/d12/d22/f28 x:0 0 0 2024-09-21T12:20:30.810 INFO:tasks.workunit.client.0.smithi003.stdout:7/123: dread d8/fa [0,4194304] 0 2024-09-21T12:20:30.811 INFO:tasks.workunit.client.0.smithi003.stdout:9/297: write d2/d20/d22/d3f/f63 [768369,41717] 0 2024-09-21T12:20:30.813 INFO:tasks.workunit.client.1.smithi192.stdout:4/686: symlink d2/db/d3e/d57/d32/d4f/d71/d9d/dad/d9c/le6 0 2024-09-21T12:20:30.814 INFO:tasks.workunit.client.1.smithi192.stdout:5/984: dwrite d0/d65/d8e/d98/dba/f12d [0,4194304] 0 2024-09-21T12:20:30.815 INFO:tasks.workunit.client.1.smithi192.stdout:5/985: dread - d0/d65/d6e/dc0/fcb zero size 2024-09-21T12:20:30.816 INFO:tasks.workunit.client.1.smithi192.stdout:1/755: creat d2/d12/d2f/d51/df2/ff4 x:0 0 0 2024-09-21T12:20:30.816 INFO:tasks.workunit.client.0.smithi003.stdout:9/298: dread d2/da/d2a/d3c/f37 [0,4194304] 0 2024-09-21T12:20:30.817 INFO:tasks.workunit.client.1.smithi192.stdout:1/756: chown d2/da/f60 0 1 2024-09-21T12:20:30.818 INFO:tasks.workunit.client.1.smithi192.stdout:9/768: creat d5/d8/dc7/dd7/de7/d55/d70/da0/ff0 x:0 0 0 2024-09-21T12:20:30.818 INFO:tasks.workunit.client.0.smithi003.stdout:1/162: fdatasync d4/df/f1a 0 2024-09-21T12:20:30.821 INFO:tasks.workunit.client.0.smithi003.stdout:4/137: link c7 d9/d16/c2a 0 2024-09-21T12:20:30.823 INFO:tasks.workunit.client.1.smithi192.stdout:5/986: dwrite d0/d65/d6e/d84/d126/f61 [0,4194304] 0 2024-09-21T12:20:30.823 INFO:tasks.workunit.client.0.smithi003.stdout:4/138: write d9/da/f12 [524461,40757] 0 2024-09-21T12:20:30.823 INFO:tasks.workunit.client.0.smithi003.stdout:0/152: fdatasync d9/d12/f1c 0 2024-09-21T12:20:30.825 INFO:tasks.workunit.client.0.smithi003.stdout:9/299: dwrite d2/d20/d22/d3f/f63 [0,4194304] 0 2024-09-21T12:20:30.825 INFO:tasks.workunit.client.0.smithi003.stdout:0/153: fdatasync f8 0 2024-09-21T12:20:30.827 INFO:tasks.workunit.client.0.smithi003.stdout:0/154: write d9/d12/d22/f28 [999455,92990] 0 2024-09-21T12:20:30.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:30 smithi003 ceph-mon[28057]: pgmap v265: 65 pgs: 65 active+clean; 1.4 GiB data, 4.3 GiB used, 532 GiB / 536 GiB avail; 44 MiB/s rd, 192 MiB/s wr, 388 op/s 2024-09-21T12:20:30.830 INFO:tasks.workunit.client.1.smithi192.stdout:7/709: sync 2024-09-21T12:20:30.835 INFO:tasks.workunit.client.1.smithi192.stdout:1/757: creat d2/dae/ff5 x:0 0 0 2024-09-21T12:20:30.837 INFO:tasks.workunit.client.1.smithi192.stdout:8/788: truncate d14/d1a/f27 3369016 0 2024-09-21T12:20:30.842 INFO:tasks.workunit.client.1.smithi192.stdout:6/846: symlink da/d1f/d48/d7d/l11a 0 2024-09-21T12:20:30.843 INFO:tasks.workunit.client.1.smithi192.stdout:6/847: readlink da/d1f/d27/d6b/lf3 0 2024-09-21T12:20:30.845 INFO:tasks.workunit.client.1.smithi192.stdout:3/660: link db/d16/db4/d8c/fd4 db/d16/d18/d21/d23/dd2/d2e/db8/dd0/df0/ff2 0 2024-09-21T12:20:30.846 INFO:tasks.workunit.client.1.smithi192.stdout:5/987: rmdir d0/d65/d6e/d84/d126/d13/d37/da8/daa/dc5/ddd/d107 39 2024-09-21T12:20:30.849 INFO:tasks.workunit.client.0.smithi003.stdout:3/128: sync 2024-09-21T12:20:30.850 INFO:tasks.workunit.client.1.smithi192.stdout:0/769: rename d3/d5/f14 to d3/d5/d69/fe6 0 2024-09-21T12:20:30.853 INFO:tasks.workunit.client.1.smithi192.stdout:4/687: symlink d2/db/d3e/d57/d32/d4f/le7 0 2024-09-21T12:20:30.855 INFO:tasks.workunit.client.1.smithi192.stdout:4/688: write d2/db/d3e/d57/d32/d4f/d71/d9d/dad/f25 [2574603,110997] 0 2024-09-21T12:20:30.855 INFO:tasks.workunit.client.1.smithi192.stdout:7/710: creat d6/d9/d2d/d7b/ff8 x:0 0 0 2024-09-21T12:20:30.855 INFO:tasks.workunit.client.1.smithi192.stdout:0/770: dwrite d3/de/d9b/fa8 [0,4194304] 0 2024-09-21T12:20:30.857 INFO:tasks.workunit.client.0.smithi003.stdout:3/129: dwrite d0/d5/d9/f24 [0,4194304] 0 2024-09-21T12:20:30.858 INFO:tasks.workunit.client.0.smithi003.stdout:3/130: dread - d0/d5/d9/d11/f20 zero size 2024-09-21T12:20:30.862 INFO:tasks.workunit.client.1.smithi192.stdout:8/789: fsync d14/d1a/d1d/f64 0 2024-09-21T12:20:30.868 INFO:tasks.workunit.client.0.smithi003.stdout:8/166: rename d7/de/d1a/f2b to d7/de/f3b 0 2024-09-21T12:20:30.869 INFO:tasks.workunit.client.1.smithi192.stdout:8/790: dwrite d14/d1a/d1d/d39/f8f [0,4194304] 0 2024-09-21T12:20:30.869 INFO:tasks.workunit.client.1.smithi192.stdout:6/848: fdatasync da/d1f/d27/f71 0 2024-09-21T12:20:30.870 INFO:tasks.workunit.client.1.smithi192.stdout:8/791: chown d14/d1a/d1d/d46/d4e/db5 1078836736 1 2024-09-21T12:20:30.871 INFO:tasks.workunit.client.0.smithi003.stdout:0/155: rmdir d9/d12 39 2024-09-21T12:20:30.875 INFO:tasks.workunit.client.0.smithi003.stdout:7/124: truncate d8/f17 3265544 0 2024-09-21T12:20:30.879 INFO:tasks.workunit.client.0.smithi003.stdout:4/139: dwrite d9/f24 [0,4194304] 0 2024-09-21T12:20:30.882 INFO:tasks.workunit.client.0.smithi003.stdout:3/131: symlink d0/d5/da/l25 0 2024-09-21T12:20:30.883 INFO:tasks.workunit.client.0.smithi003.stdout:3/132: stat d0/d5/d9/fb 0 2024-09-21T12:20:30.889 INFO:tasks.workunit.client.1.smithi192.stdout:9/769: dwrite d5/d19/f7f [0,4194304] 0 2024-09-21T12:20:30.890 INFO:tasks.workunit.client.1.smithi192.stdout:7/711: fdatasync d6/d9/d1f/d3e/d7a/d8a/da2/fe8 0 2024-09-21T12:20:30.896 INFO:tasks.workunit.client.1.smithi192.stdout:8/792: mkdir d14/d18/d94/d10b 0 2024-09-21T12:20:30.897 INFO:tasks.workunit.client.1.smithi192.stdout:6/849: truncate da/d1f/d27/d6b/f6d 3286576 0 2024-09-21T12:20:30.897 INFO:tasks.workunit.client.1.smithi192.stdout:8/793: readlink d14/d1a/d1d/d46/d4e/d83/d8d/d9c/dd0/la1 0 2024-09-21T12:20:30.898 INFO:tasks.workunit.client.1.smithi192.stdout:3/661: symlink db/d16/d18/d21/lf3 0 2024-09-21T12:20:30.899 INFO:tasks.workunit.client.1.smithi192.stdout:5/988: symlink d0/d65/d6e/dc0/l150 0 2024-09-21T12:20:30.901 INFO:tasks.workunit.client.1.smithi192.stdout:0/771: dread - d3/d5/d28/d39/d50/fac zero size 2024-09-21T12:20:30.902 INFO:tasks.workunit.client.1.smithi192.stdout:1/758: creat d2/d12/d2f/ff6 x:0 0 0 2024-09-21T12:20:30.904 INFO:tasks.workunit.client.1.smithi192.stdout:4/689: mknod d2/db/d3e/d57/d32/d4f/ce8 0 2024-09-21T12:20:30.904 INFO:tasks.workunit.client.1.smithi192.stdout:9/770: chown d5/d19/dd5/c28 0 1 2024-09-21T12:20:30.905 INFO:tasks.workunit.client.1.smithi192.stdout:9/771: truncate d5/d19/dd5/d4d/fcf 2749817 0 2024-09-21T12:20:30.908 INFO:tasks.workunit.client.1.smithi192.stdout:6/850: fdatasync da/d1f/d48/d7d/daa/fcf 0 2024-09-21T12:20:30.910 INFO:tasks.workunit.client.1.smithi192.stdout:3/662: fsync db/d16/d18/d40/d60/f8a 0 2024-09-21T12:20:30.911 INFO:tasks.workunit.client.1.smithi192.stdout:3/663: readlink db/d16/d18/d40/la9 0 2024-09-21T12:20:30.914 INFO:tasks.workunit.client.1.smithi192.stdout:2/714: sync 2024-09-21T12:20:30.914 INFO:tasks.workunit.client.1.smithi192.stdout:8/794: rename d14/d1a/d1d/d39/f3e to d14/d1a/d1d/d46/d4e/d83/d8d/d9c/dbe/f10c 0 2024-09-21T12:20:30.914 INFO:tasks.workunit.client.1.smithi192.stdout:5/989: unlink d0/d65/d6e/dc0/d44/d85/d97/f76 0 2024-09-21T12:20:30.919 INFO:tasks.workunit.client.1.smithi192.stdout:9/772: mkdir d5/dc/d64/dbb/df1 0 2024-09-21T12:20:30.921 INFO:tasks.workunit.client.1.smithi192.stdout:6/851: creat da/d1f/d56/da9/f11b x:0 0 0 2024-09-21T12:20:30.930 INFO:tasks.workunit.client.1.smithi192.stdout:8/795: rename d14/d18/d88 to d14/d1a/d1d/d46/d4e/d10d 0 2024-09-21T12:20:30.930 INFO:tasks.workunit.client.1.smithi192.stdout:0/772: write d3/d5/d28/d39/d50/dd9/d7a/dbe/d92/d51/f76 [3441897,106286] 0 2024-09-21T12:20:30.930 INFO:tasks.workunit.client.1.smithi192.stdout:2/715: readlink d1b/l43 0 2024-09-21T12:20:30.931 INFO:tasks.workunit.client.1.smithi192.stdout:4/690: symlink d2/db/d3e/d57/d32/d4f/d82/le9 0 2024-09-21T12:20:30.931 INFO:tasks.workunit.client.1.smithi192.stdout:7/712: symlink d6/d3a/dba/lf9 0 2024-09-21T12:20:30.932 INFO:tasks.workunit.client.1.smithi192.stdout:9/773: mknod d5/dc/d40/dad/d53/d6e/cf2 0 2024-09-21T12:20:30.932 INFO:tasks.workunit.client.1.smithi192.stdout:6/852: mkdir da/d1f/d48/d7d/daa/d11c 0 2024-09-21T12:20:30.934 INFO:tasks.workunit.client.1.smithi192.stdout:4/691: write d2/db/d3e/de2/f5e [1463921,126671] 0 2024-09-21T12:20:30.935 INFO:tasks.workunit.client.1.smithi192.stdout:8/796: write d14/d1a/d1d/d46/d4e/d83/d8d/dd8/fe5 [1033392,31709] 0 2024-09-21T12:20:30.939 INFO:tasks.workunit.client.1.smithi192.stdout:5/990: getdents d0/d65/d6e/d84/d126/d13/d37/da8/daa/de4 0 2024-09-21T12:20:30.940 INFO:tasks.workunit.client.1.smithi192.stdout:3/664: dwrite db/d16/d18/d21/d23/f50 [0,4194304] 0 2024-09-21T12:20:30.942 INFO:tasks.workunit.client.1.smithi192.stdout:6/853: write da/d23/d37/d75/d90/fc4 [357465,80958] 0 2024-09-21T12:20:30.942 INFO:tasks.workunit.client.1.smithi192.stdout:0/773: write d3/de/d33/f5e [254300,83395] 0 2024-09-21T12:20:30.943 INFO:tasks.workunit.client.1.smithi192.stdout:9/774: dwrite d5/dc/d40/fdb [0,4194304] 0 2024-09-21T12:20:30.943 INFO:tasks.workunit.client.1.smithi192.stdout:7/713: creat d6/d9/d70/d77/dd9/ffa x:0 0 0 2024-09-21T12:20:30.944 INFO:tasks.workunit.client.1.smithi192.stdout:5/991: readlink d0/d65/d6e/d84/d126/d13/d37/da8/daa/de4/l136 0 2024-09-21T12:20:30.945 INFO:tasks.workunit.client.1.smithi192.stdout:2/716: write d1b/d1e/d5e/d75/da1/de3/fe6 [4104003,5258] 0 2024-09-21T12:20:30.945 INFO:tasks.workunit.client.1.smithi192.stdout:7/714: readlink d6/d9/le9 0 2024-09-21T12:20:30.947 INFO:tasks.workunit.client.0.smithi003.stdout:9/300: symlink d2/d53/l6b 0 2024-09-21T12:20:30.947 INFO:tasks.workunit.client.1.smithi192.stdout:6/854: chown da/d23/d37/d75/dd0/f10a 21 1 2024-09-21T12:20:30.948 INFO:tasks.workunit.client.0.smithi003.stdout:3/133: chown d0/d5/d9/fb 218186244 1 2024-09-21T12:20:30.949 INFO:tasks.workunit.client.0.smithi003.stdout:7/125: fdatasync d8/fa 0 2024-09-21T12:20:30.950 INFO:tasks.workunit.client.1.smithi192.stdout:3/665: mknod db/d16/d18/d33/d4a/de4/cf4 0 2024-09-21T12:20:30.951 INFO:tasks.workunit.client.1.smithi192.stdout:6/855: write da/d1f/d48/d7d/da7/fc6 [2163258,77436] 0 2024-09-21T12:20:30.952 INFO:tasks.workunit.client.0.smithi003.stdout:3/134: chown d0/d5/d9/f24 54587536 1 2024-09-21T12:20:30.955 INFO:tasks.workunit.client.1.smithi192.stdout:5/992: truncate d0/d65/d6e/dc0/d44/d85/d97/d45/ffa 943095 0 2024-09-21T12:20:30.958 INFO:tasks.workunit.client.1.smithi192.stdout:8/797: getdents d14/d1a/d1d/d20/d5f 0 2024-09-21T12:20:30.958 INFO:tasks.workunit.client.1.smithi192.stdout:9/775: dwrite d5/fb8 [0,4194304] 0 2024-09-21T12:20:30.960 INFO:tasks.workunit.client.1.smithi192.stdout:4/692: getdents d2/db/d3e/d57/d32/d4f/d71/d9d 0 2024-09-21T12:20:30.965 INFO:tasks.workunit.client.1.smithi192.stdout:0/774: getdents d3/de/d33 0 2024-09-21T12:20:30.965 INFO:tasks.workunit.client.1.smithi192.stdout:5/993: write d0/d65/d6e/fce [2550015,95160] 0 2024-09-21T12:20:30.968 INFO:tasks.workunit.client.1.smithi192.stdout:9/776: chown d5/dc/d40/dad/c4a 3036654 1 2024-09-21T12:20:30.969 INFO:tasks.workunit.client.1.smithi192.stdout:3/666: rename db/d16/d18/d21/d23/d71/d77/l90 to db/d16/d18/d21/d23/dd2/d2e/lf5 0 2024-09-21T12:20:30.969 INFO:tasks.workunit.client.1.smithi192.stdout:6/856: read da/d1f/d27/d6b/f85 [368057,129219] 0 2024-09-21T12:20:30.970 INFO:tasks.workunit.client.1.smithi192.stdout:2/717: dwrite d1b/d9e/de1/fc7 [0,4194304] 0 2024-09-21T12:20:30.973 INFO:tasks.workunit.client.1.smithi192.stdout:7/715: dwrite d6/d3a/d6d/fd6 [0,4194304] 0 2024-09-21T12:20:30.974 INFO:tasks.workunit.client.1.smithi192.stdout:2/718: readlink d1b/d38/d53/d8b/da0/lcc 0 2024-09-21T12:20:30.974 INFO:tasks.workunit.client.1.smithi192.stdout:3/667: dread - db/d16/d18/d33/d3b/f65 zero size 2024-09-21T12:20:30.975 INFO:tasks.workunit.client.1.smithi192.stdout:9/777: unlink d5/dc/d40/fbd 0 2024-09-21T12:20:30.975 INFO:tasks.workunit.client.1.smithi192.stdout:8/798: truncate d14/d1a/d1d/d39/f8b 1539998 0 2024-09-21T12:20:30.977 INFO:tasks.workunit.client.1.smithi192.stdout:8/799: write d14/d18/f32 [4522399,76361] 0 2024-09-21T12:20:30.980 INFO:tasks.workunit.client.1.smithi192.stdout:6/857: unlink da/d23/l3d 0 2024-09-21T12:20:30.980 INFO:tasks.workunit.client.1.smithi192.stdout:0/775: unlink d3/d5/d28/d39/d50/dd9/d7a/dbe/d92/d51/f3b 0 2024-09-21T12:20:30.985 INFO:tasks.workunit.client.1.smithi192.stdout:9/778: mkdir d5/d8/dc7/dd7/de7/d55/df3 0 2024-09-21T12:20:30.986 INFO:tasks.workunit.client.1.smithi192.stdout:5/994: creat d0/d65/d6e/d84/d126/d13/d37/db4/d147/f151 x:0 0 0 2024-09-21T12:20:30.993 INFO:tasks.workunit.client.1.smithi192.stdout:2/719: rename d1b/d38/c76 to d1b/d9e/cee 0 2024-09-21T12:20:30.994 INFO:tasks.workunit.client.1.smithi192.stdout:3/668: link db/d16/d18/d33/f83 db/d16/d18/da7/ff6 0 2024-09-21T12:20:30.996 INFO:tasks.workunit.client.1.smithi192.stdout:9/779: mkdir d5/dc/d40/dad/d53/df4 0 2024-09-21T12:20:30.997 INFO:tasks.workunit.client.1.smithi192.stdout:5/995: chown d0/d65/d6e/d84/d126/d13/d37/da8/daa/dc5/ddd/d107/l114 2833947 1 2024-09-21T12:20:30.999 INFO:tasks.workunit.client.1.smithi192.stdout:7/716: creat d6/d9/d70/ffb x:0 0 0 2024-09-21T12:20:30.999 INFO:tasks.workunit.client.1.smithi192.stdout:2/720: symlink d1b/d1e/d62/lef 0 2024-09-21T12:20:31.000 INFO:tasks.workunit.client.1.smithi192.stdout:9/780: mknod d5/d8/dc7/dd7/de7/d55/d70/cf5 0 2024-09-21T12:20:31.002 INFO:tasks.workunit.client.1.smithi192.stdout:0/776: getdents d3/de/dc6/d83/dc9 0 2024-09-21T12:20:31.003 INFO:tasks.workunit.client.1.smithi192.stdout:8/800: dread d14/d18/d5a/fc0 [0,4194304] 0 2024-09-21T12:20:31.004 INFO:tasks.workunit.client.1.smithi192.stdout:3/669: rename db/d16/d18/d33/d3b/f65 to db/ff7 0 2024-09-21T12:20:31.005 INFO:tasks.workunit.client.1.smithi192.stdout:5/996: dread d0/d65/d6e/f92 [0,4194304] 0 2024-09-21T12:20:31.005 INFO:tasks.workunit.client.1.smithi192.stdout:6/858: dwrite da/d1f/d27/d88/f8d [4194304,4194304] 0 2024-09-21T12:20:31.005 INFO:tasks.workunit.client.1.smithi192.stdout:7/717: dread - d6/d9/d70/d77/dcd/fc3 zero size 2024-09-21T12:20:31.006 INFO:tasks.workunit.client.0.smithi003.stdout:6/148: sync 2024-09-21T12:20:31.006 INFO:tasks.workunit.client.0.smithi003.stdout:5/169: sync 2024-09-21T12:20:31.006 INFO:tasks.workunit.client.0.smithi003.stdout:2/131: sync 2024-09-21T12:20:31.008 INFO:tasks.workunit.client.1.smithi192.stdout:3/670: chown db/d16/d18/d40/f6e 6231355 1 2024-09-21T12:20:31.010 INFO:tasks.workunit.client.1.smithi192.stdout:5/997: chown d0/d65/d8e/d98/dba/cc1 1542250 1 2024-09-21T12:20:31.010 INFO:tasks.workunit.client.1.smithi192.stdout:8/801: read d14/d1a/d1d/f58 [1654173,59641] 0 2024-09-21T12:20:31.010 INFO:tasks.workunit.client.1.smithi192.stdout:0/777: rename d3/de to d3/d5/d28/d39/d50/dd9/d7a/dbe/de7 0 2024-09-21T12:20:31.012 INFO:tasks.workunit.client.1.smithi192.stdout:3/671: stat db/d16/db4/d8c/fd4 0 2024-09-21T12:20:31.012 INFO:tasks.workunit.client.1.smithi192.stdout:6/859: mkdir da/d1f/d48/d7d/da7/d11d 0 2024-09-21T12:20:31.013 INFO:tasks.workunit.client.1.smithi192.stdout:2/721: dwrite d1b/f45 [0,4194304] 0 2024-09-21T12:20:31.014 INFO:tasks.workunit.client.1.smithi192.stdout:7/718: rmdir d6/d20/d69/d90 39 2024-09-21T12:20:31.014 INFO:tasks.workunit.client.1.smithi192.stdout:5/998: chown d0/d65/d6e/dbc/f11c 5218 1 2024-09-21T12:20:31.016 INFO:tasks.workunit.client.1.smithi192.stdout:8/802: mkdir d14/d1a/d82/d10e 0 2024-09-21T12:20:31.016 INFO:tasks.workunit.client.0.smithi003.stdout:9/301: mknod d2/d20/d22/d3f/c6c 0 2024-09-21T12:20:31.016 INFO:tasks.workunit.client.0.smithi003.stdout:1/163: getdents d4/d11 0 2024-09-21T12:20:31.017 INFO:tasks.workunit.client.1.smithi192.stdout:3/672: chown db/d16/d18/d21/c6d 1843398 1 2024-09-21T12:20:31.017 INFO:tasks.workunit.client.1.smithi192.stdout:9/781: dwrite d5/dc/d80/d44/d8e/f98 [0,4194304] 0 2024-09-21T12:20:31.017 INFO:tasks.workunit.client.0.smithi003.stdout:3/135: chown d0/d5/d9/dd 1 1 2024-09-21T12:20:31.017 INFO:tasks.workunit.client.1.smithi192.stdout:6/860: chown da/d1f/d56/c8b 510 1 2024-09-21T12:20:31.018 INFO:tasks.workunit.client.0.smithi003.stdout:7/126: fsync d8/f9 0 2024-09-21T12:20:31.018 INFO:tasks.workunit.client.0.smithi003.stdout:4/140: dwrite d9/da/f12 [0,4194304] 0 2024-09-21T12:20:31.019 INFO:tasks.workunit.client.1.smithi192.stdout:5/999: dread - d0/d65/d6e/d84/d126/d13/d37/da8/f138 zero size 2024-09-21T12:20:31.025 INFO:tasks.workunit.client.1.smithi192.stdout:7/719: unlink d6/d9/d51/fad 0 2024-09-21T12:20:31.025 INFO:tasks.workunit.client.1.smithi192.stdout:3/673: chown db/d16/d18/d40/d60/f8a 26 1 2024-09-21T12:20:31.025 INFO:tasks.workunit.client.1.smithi192.stdout:0/778: symlink d3/d5/d28/d39/d50/dd9/d7a/dbe/le8 0 2024-09-21T12:20:31.025 INFO:tasks.workunit.client.1.smithi192.stdout:6/861: dread - da/d1f/d56/da9/dcd/f106 zero size 2024-09-21T12:20:31.027 INFO:tasks.workunit.client.1.smithi192.stdout:8/803: rename d14/d1a/d1d/d46/d4e/d83/d8d/d9c/dee/d80/lb7 to d14/d1a/d1d/d46/d4e/d83/d8d/d9c/l10f 0 2024-09-21T12:20:31.028 INFO:tasks.workunit.client.0.smithi003.stdout:8/167: dwrite d7/de/f19 [0,4194304] 0 2024-09-21T12:20:31.029 INFO:tasks.workunit.client.1.smithi192.stdout:8/804: read d14/d18/d5a/fc0 [3942569,99930] 0 2024-09-21T12:20:31.031 INFO:tasks.workunit.client.1.smithi192.stdout:3/674: write db/ff7 [899356,50103] 0 2024-09-21T12:20:31.033 INFO:tasks.workunit.client.0.smithi003.stdout:2/132: creat d0/d1c/f2e x:0 0 0 2024-09-21T12:20:31.033 INFO:tasks.workunit.client.0.smithi003.stdout:6/149: dwrite d4/fb [4194304,4194304] 0 2024-09-21T12:20:31.034 INFO:tasks.workunit.client.1.smithi192.stdout:6/862: read da/d1f/fab [498441,81622] 0 2024-09-21T12:20:31.035 INFO:tasks.workunit.client.0.smithi003.stdout:1/164: creat d4/d11/f3d x:0 0 0 2024-09-21T12:20:31.035 INFO:tasks.workunit.client.0.smithi003.stdout:5/170: mkdir dc/d15/d21/d30/d35 0 2024-09-21T12:20:31.036 INFO:tasks.workunit.client.1.smithi192.stdout:0/779: symlink d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/d9b/le9 0 2024-09-21T12:20:31.037 INFO:tasks.workunit.client.0.smithi003.stdout:5/171: dread - dc/d15/d1c/f23 zero size 2024-09-21T12:20:31.038 INFO:tasks.workunit.client.0.smithi003.stdout:1/165: dread d4/d11/f2a [0,4194304] 0 2024-09-21T12:20:31.038 INFO:tasks.workunit.client.0.smithi003.stdout:7/127: creat d8/db/f2b x:0 0 0 2024-09-21T12:20:31.039 INFO:tasks.workunit.client.1.smithi192.stdout:3/675: write db/d16/d18/d33/d4a/f5f [1687423,86826] 0 2024-09-21T12:20:31.039 INFO:tasks.workunit.client.0.smithi003.stdout:1/166: fsync d4/f26 0 2024-09-21T12:20:31.041 INFO:tasks.workunit.client.0.smithi003.stdout:3/136: truncate d0/d5/d9/d11/f1d 4247841 0 2024-09-21T12:20:31.043 INFO:tasks.workunit.client.1.smithi192.stdout:0/780: write d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/dc6/f3f [6697177,79393] 0 2024-09-21T12:20:31.046 INFO:tasks.workunit.client.1.smithi192.stdout:0/781: write d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/d33/fd4 [211554,122001] 0 2024-09-21T12:20:31.046 INFO:tasks.workunit.client.0.smithi003.stdout:4/141: symlink d9/d25/l2b 0 2024-09-21T12:20:31.047 INFO:tasks.workunit.client.0.smithi003.stdout:1/167: rmdir d4/df/d19 39 2024-09-21T12:20:31.047 INFO:tasks.workunit.client.0.smithi003.stdout:4/142: read - d9/f15 zero size 2024-09-21T12:20:31.048 INFO:tasks.workunit.client.1.smithi192.stdout:3/676: link db/f1e db/d16/d18/d33/d4a/ff8 0 2024-09-21T12:20:31.048 INFO:tasks.workunit.client.0.smithi003.stdout:6/150: dread d4/f5 [4194304,4194304] 0 2024-09-21T12:20:31.049 INFO:tasks.workunit.client.0.smithi003.stdout:8/168: creat d7/de/d1a/f3c x:0 0 0 2024-09-21T12:20:31.049 INFO:tasks.workunit.client.0.smithi003.stdout:6/151: write d4/fb [3694237,121633] 0 2024-09-21T12:20:31.050 INFO:tasks.workunit.client.0.smithi003.stdout:8/169: write f0 [3433612,21659] 0 2024-09-21T12:20:31.053 INFO:tasks.workunit.client.0.smithi003.stdout:5/172: mkdir dc/d36 0 2024-09-21T12:20:31.053 INFO:tasks.workunit.client.0.smithi003.stdout:8/170: dread f4 [0,4194304] 0 2024-09-21T12:20:31.054 INFO:tasks.workunit.client.0.smithi003.stdout:5/173: dread - dc/d15/d26/f2e zero size 2024-09-21T12:20:31.057 INFO:tasks.workunit.client.1.smithi192.stdout:0/782: rename d3/d5/d28/d39/d50/dd9/d7a/c99 to d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/d33/dae/db4/cea 0 2024-09-21T12:20:31.057 INFO:tasks.workunit.client.1.smithi192.stdout:3/677: rmdir db/d16/d18/de6 0 2024-09-21T12:20:31.059 INFO:tasks.workunit.client.1.smithi192.stdout:3/678: write db/d16/d18/d40/f7e [4914460,11132] 0 2024-09-21T12:20:31.059 INFO:tasks.workunit.client.0.smithi003.stdout:4/143: symlink d9/d25/l2c 0 2024-09-21T12:20:31.059 INFO:tasks.workunit.client.1.smithi192.stdout:3/679: stat db/d16/db4/cb5 0 2024-09-21T12:20:31.060 INFO:tasks.workunit.client.1.smithi192.stdout:0/783: symlink d3/d5/d28/d39/d50/dd9/d7a/leb 0 2024-09-21T12:20:31.061 INFO:tasks.workunit.client.0.smithi003.stdout:9/302: getdents d2/da/d2a 0 2024-09-21T12:20:31.063 INFO:tasks.workunit.client.1.smithi192.stdout:2/722: dread d1b/d1e/d5e/d88/d95/d9c/fce [0,4194304] 0 2024-09-21T12:20:31.065 INFO:tasks.workunit.client.0.smithi003.stdout:8/171: creat d7/df/d36/f3d x:0 0 0 2024-09-21T12:20:31.067 INFO:tasks.workunit.client.0.smithi003.stdout:7/128: rename d8/db/d13/d21 to d8/d2c 0 2024-09-21T12:20:31.068 INFO:tasks.workunit.client.1.smithi192.stdout:3/680: link db/d16/d18/d21/d23/f95 db/d16/dc1/ff9 0 2024-09-21T12:20:31.070 INFO:tasks.workunit.client.1.smithi192.stdout:2/723: rmdir d1b 39 2024-09-21T12:20:31.070 INFO:tasks.workunit.client.0.smithi003.stdout:9/303: truncate d2/d20/f39 3603713 0 2024-09-21T12:20:31.072 INFO:tasks.workunit.client.0.smithi003.stdout:9/304: truncate d2/da/d2a/f55 912169 0 2024-09-21T12:20:31.077 INFO:tasks.workunit.client.1.smithi192.stdout:2/724: rmdir d1b/d1e/d5e/d75/da1 39 2024-09-21T12:20:31.077 INFO:tasks.workunit.client.1.smithi192.stdout:0/784: dread d3/d5/d28/d39/d50/dd9/d7a/dbe/d92/d51/f2b [0,4194304] 0 2024-09-21T12:20:31.078 INFO:tasks.workunit.client.1.smithi192.stdout:2/725: write f19 [5011409,78810] 0 2024-09-21T12:20:31.079 INFO:tasks.workunit.client.0.smithi003.stdout:7/129: rename d8/fc to d8/d2c/f2d 0 2024-09-21T12:20:31.081 INFO:tasks.workunit.client.1.smithi192.stdout:9/782: truncate d5/dc/d40/fdb 1393791 0 2024-09-21T12:20:31.083 INFO:tasks.workunit.client.0.smithi003.stdout:4/144: symlink d9/l2d 0 2024-09-21T12:20:31.083 INFO:tasks.workunit.client.0.smithi003.stdout:7/130: dread d8/fa [0,4194304] 0 2024-09-21T12:20:31.084 INFO:tasks.workunit.client.0.smithi003.stdout:9/305: symlink d2/d20/d42/l6d 0 2024-09-21T12:20:31.085 INFO:tasks.workunit.client.1.smithi192.stdout:6/863: write da/d1f/d27/f71 [926977,7165] 0 2024-09-21T12:20:31.088 INFO:tasks.workunit.client.0.smithi003.stdout:9/306: dread d2/da/f50 [0,4194304] 0 2024-09-21T12:20:31.089 INFO:tasks.workunit.client.1.smithi192.stdout:9/783: creat d5/d8/dc7/dd7/de7/d55/d70/da0/ff6 x:0 0 0 2024-09-21T12:20:31.090 INFO:tasks.workunit.client.0.smithi003.stdout:9/307: write d2/f2b [1761831,115738] 0 2024-09-21T12:20:31.090 INFO:tasks.workunit.client.1.smithi192.stdout:9/784: chown d5/d8/dc7/dd7/de7/de4/cea 261128545 1 2024-09-21T12:20:31.091 INFO:tasks.workunit.client.0.smithi003.stdout:4/145: rename d9/f14 to d9/d16/f2e 0 2024-09-21T12:20:31.092 INFO:tasks.workunit.client.1.smithi192.stdout:3/681: link db/d16/d18/d33/d4a/de4/cf4 db/d16/d18/d40/d60/d7b/cfa 0 2024-09-21T12:20:31.093 INFO:tasks.workunit.client.0.smithi003.stdout:3/137: truncate d0/d5/d9/f24 4052298 0 2024-09-21T12:20:31.099 INFO:tasks.workunit.client.0.smithi003.stdout:5/174: link dc/ce dc/d15/d21/c37 0 2024-09-21T12:20:31.100 INFO:tasks.workunit.client.0.smithi003.stdout:6/152: write d4/f5 [6398814,6302] 0 2024-09-21T12:20:31.103 INFO:tasks.workunit.client.0.smithi003.stdout:9/308: creat d2/d53/f6e x:0 0 0 2024-09-21T12:20:31.103 INFO:tasks.workunit.client.1.smithi192.stdout:9/785: creat d5/d19/dd5/d4d/d6d/dd9/ff7 x:0 0 0 2024-09-21T12:20:31.105 INFO:tasks.workunit.client.0.smithi003.stdout:6/153: dread d4/fb [4194304,4194304] 0 2024-09-21T12:20:31.107 INFO:tasks.workunit.client.1.smithi192.stdout:2/726: unlink d1b/d1e/d5e/d75/da1/daf/cb0 0 2024-09-21T12:20:31.108 INFO:tasks.workunit.client.1.smithi192.stdout:2/727: write d1b/d1e/d5e/d88/fd5 [550014,50233] 0 2024-09-21T12:20:31.109 INFO:tasks.workunit.client.0.smithi003.stdout:6/154: dread d4/f5 [4194304,4194304] 0 2024-09-21T12:20:31.111 INFO:tasks.workunit.client.1.smithi192.stdout:9/786: symlink d5/dc/d40/dad/lf8 0 2024-09-21T12:20:31.116 INFO:tasks.workunit.client.1.smithi192.stdout:2/728: mknod d1b/d1e/d7b/cf0 0 2024-09-21T12:20:31.117 INFO:tasks.workunit.client.1.smithi192.stdout:9/787: dwrite d5/dc/d64/dbb/d3d/fdd [0,4194304] 0 2024-09-21T12:20:31.118 INFO:tasks.workunit.client.0.smithi003.stdout:8/172: getdents d7/df/d16 0 2024-09-21T12:20:31.121 INFO:tasks.workunit.client.0.smithi003.stdout:9/309: mknod d2/da/d17/c6f 0 2024-09-21T12:20:31.122 INFO:tasks.workunit.client.1.smithi192.stdout:6/864: write da/d1f/d48/d7d/da7/fad [567294,75421] 0 2024-09-21T12:20:31.122 INFO:tasks.workunit.client.0.smithi003.stdout:3/138: mkdir d0/d5/d9/dd/d23/d26 0 2024-09-21T12:20:31.124 INFO:tasks.workunit.client.0.smithi003.stdout:4/146: truncate f6 2074045 0 2024-09-21T12:20:31.126 INFO:tasks.workunit.client.1.smithi192.stdout:9/788: unlink d5/dc/d80/d5a/c87 0 2024-09-21T12:20:31.127 INFO:tasks.workunit.client.1.smithi192.stdout:9/789: write d5/fa [2927825,17399] 0 2024-09-21T12:20:31.128 INFO:tasks.workunit.client.1.smithi192.stdout:9/790: write d5/dc/d80/d44/d8e/f98 [6998968,9833] 0 2024-09-21T12:20:31.130 INFO:tasks.workunit.client.0.smithi003.stdout:3/139: dwrite d0/d5/d9/fb [0,4194304] 0 2024-09-21T12:20:31.130 INFO:tasks.workunit.client.0.smithi003.stdout:3/140: dread - d0/f1f zero size 2024-09-21T12:20:31.132 INFO:tasks.workunit.client.0.smithi003.stdout:3/141: write d0/d5/d9/fb [2581527,40184] 0 2024-09-21T12:20:31.134 INFO:tasks.workunit.client.0.smithi003.stdout:5/175: mknod dc/c38 0 2024-09-21T12:20:31.135 INFO:tasks.workunit.client.0.smithi003.stdout:7/131: truncate d8/fe 306287 0 2024-09-21T12:20:31.142 INFO:tasks.workunit.client.1.smithi192.stdout:6/865: truncate da/d23/d37/f70 563244 0 2024-09-21T12:20:31.142 INFO:tasks.workunit.client.0.smithi003.stdout:4/147: write d9/d16/f2e [3183493,64132] 0 2024-09-21T12:20:31.143 INFO:tasks.workunit.client.0.smithi003.stdout:3/142: dwrite d0/f19 [0,4194304] 0 2024-09-21T12:20:31.144 INFO:tasks.workunit.client.1.smithi192.stdout:6/866: write da/d1f/d56/d73/fb8 [2393186,122113] 0 2024-09-21T12:20:31.145 INFO:tasks.workunit.client.0.smithi003.stdout:4/148: fdatasync d9/da/f27 0 2024-09-21T12:20:31.145 INFO:tasks.workunit.client.0.smithi003.stdout:5/176: dwrite dc/d15/d21/d30/f34 [0,4194304] 0 2024-09-21T12:20:31.147 INFO:tasks.workunit.client.0.smithi003.stdout:6/155: creat d4/d13/d22/f2b x:0 0 0 2024-09-21T12:20:31.147 INFO:tasks.workunit.client.1.smithi192.stdout:9/791: dwrite d5/f9d [4194304,4194304] 0 2024-09-21T12:20:31.149 INFO:tasks.workunit.client.1.smithi192.stdout:9/792: dread - d5/d8/dc7/dd7/de7/fb0 zero size 2024-09-21T12:20:31.151 INFO:tasks.workunit.client.1.smithi192.stdout:9/793: truncate d5/d8/d2c/f5d 1666789 0 2024-09-21T12:20:31.154 INFO:tasks.workunit.client.1.smithi192.stdout:6/867: fdatasync da/d23/ffe 0 2024-09-21T12:20:31.155 INFO:tasks.workunit.client.1.smithi192.stdout:6/868: chown da/d23/d37/d75/dd0/f10a 210050510 1 2024-09-21T12:20:31.158 INFO:tasks.workunit.client.1.smithi192.stdout:2/729: truncate d1b/d38/d53/f61 2179237 0 2024-09-21T12:20:31.159 INFO:tasks.workunit.client.1.smithi192.stdout:1/759: sync 2024-09-21T12:20:31.159 INFO:tasks.workunit.client.0.smithi003.stdout:6/156: dwrite d4/d13/d22/f2b [0,4194304] 0 2024-09-21T12:20:31.160 INFO:tasks.workunit.client.1.smithi192.stdout:2/730: dread - d1b/d1e/d5e/d88/fd1 zero size 2024-09-21T12:20:31.160 INFO:tasks.workunit.client.0.smithi003.stdout:8/173: chown d7/de/d11/c2f 15607736 1 2024-09-21T12:20:31.160 INFO:tasks.workunit.client.1.smithi192.stdout:9/794: rmdir d5/dc/d80/d44 39 2024-09-21T12:20:31.161 INFO:tasks.workunit.client.0.smithi003.stdout:6/157: chown d4/d13/f20 1602 1 2024-09-21T12:20:31.161 INFO:tasks.workunit.client.1.smithi192.stdout:2/731: chown d1b/d1e/d3d/l50 283513 1 2024-09-21T12:20:31.166 INFO:tasks.workunit.client.0.smithi003.stdout:7/132: creat d8/d2c/f2e x:0 0 0 2024-09-21T12:20:31.167 INFO:tasks.workunit.client.0.smithi003.stdout:7/133: fdatasync d8/db/d13/f1e 0 2024-09-21T12:20:31.168 INFO:tasks.workunit.client.1.smithi192.stdout:6/869: symlink da/d1f/d56/d73/l11e 0 2024-09-21T12:20:31.168 INFO:tasks.workunit.client.0.smithi003.stdout:8/174: dwrite f1 [4194304,4194304] 0 2024-09-21T12:20:31.168 INFO:tasks.workunit.client.1.smithi192.stdout:2/732: dwrite d1b/f45 [0,4194304] 0 2024-09-21T12:20:31.169 INFO:tasks.workunit.client.0.smithi003.stdout:8/175: readlink d7/lb 0 2024-09-21T12:20:31.180 INFO:tasks.workunit.client.1.smithi192.stdout:1/760: rename d2/da/d6b/dc8/fcc to d2/da/d6b/ff7 0 2024-09-21T12:20:31.182 INFO:tasks.workunit.client.0.smithi003.stdout:4/149: unlink d9/f13 0 2024-09-21T12:20:31.182 INFO:tasks.workunit.client.1.smithi192.stdout:6/870: dwrite da/d23/d37/f8e [8388608,4194304] 0 2024-09-21T12:20:31.187 INFO:tasks.workunit.client.0.smithi003.stdout:6/158: fsync d4/f5 0 2024-09-21T12:20:31.189 INFO:tasks.workunit.client.1.smithi192.stdout:2/733: rename c1a to d1b/d1e/d5e/d75/da1/cf1 0 2024-09-21T12:20:31.191 INFO:tasks.workunit.client.1.smithi192.stdout:2/734: write d1b/d38/f79 [5002656,71075] 0 2024-09-21T12:20:31.191 INFO:tasks.workunit.client.1.smithi192.stdout:6/871: readlink da/d23/d37/dc5/lf9 0 2024-09-21T12:20:31.193 INFO:tasks.workunit.client.0.smithi003.stdout:7/134: mknod d8/db/d13/c2f 0 2024-09-21T12:20:31.193 INFO:tasks.workunit.client.1.smithi192.stdout:2/735: write d1b/d1e/d5e/d88/d95/dbe/fc5 [670961,55840] 0 2024-09-21T12:20:31.193 INFO:tasks.workunit.client.0.smithi003.stdout:7/135: fdatasync d8/db/f20 0 2024-09-21T12:20:31.194 INFO:tasks.workunit.client.1.smithi192.stdout:2/736: write d1b/d38/d53/d8b/da7/dbb/fc3 [344831,41780] 0 2024-09-21T12:20:31.195 INFO:tasks.workunit.client.1.smithi192.stdout:1/761: truncate d2/d12/d2f/d51/d24/d65/d8b/fd7 961877 0 2024-09-21T12:20:31.195 INFO:tasks.workunit.client.1.smithi192.stdout:2/737: readlink d1b/d1e/l46 0 2024-09-21T12:20:31.196 INFO:tasks.workunit.client.1.smithi192.stdout:9/795: rename d5/fb8 to d5/dc/d80/d44/d8e/dd6/dd8/ff9 0 2024-09-21T12:20:31.196 INFO:tasks.workunit.client.1.smithi192.stdout:9/796: chown d5/f2f 178654238 1 2024-09-21T12:20:31.198 INFO:tasks.workunit.client.1.smithi192.stdout:9/797: truncate d5/dc/f76 5082829 0 2024-09-21T12:20:31.205 INFO:tasks.workunit.client.0.smithi003.stdout:7/136: creat d8/db/d13/f30 x:0 0 0 2024-09-21T12:20:31.207 INFO:tasks.workunit.client.1.smithi192.stdout:2/738: unlink d1b/f57 0 2024-09-21T12:20:31.207 INFO:tasks.workunit.client.1.smithi192.stdout:2/739: stat d1b/d1e/d5e/d75/lbc 0 2024-09-21T12:20:31.208 INFO:tasks.workunit.client.1.smithi192.stdout:1/762: rmdir d2/da/d89 39 2024-09-21T12:20:31.209 INFO:tasks.workunit.client.0.smithi003.stdout:7/137: dread d8/fa [0,4194304] 0 2024-09-21T12:20:31.215 INFO:tasks.workunit.client.0.smithi003.stdout:8/176: creat d7/de/f3e x:0 0 0 2024-09-21T12:20:31.216 INFO:tasks.workunit.client.1.smithi192.stdout:9/798: dread d5/dc/d64/dbb/f60 [0,4194304] 0 2024-09-21T12:20:31.217 INFO:tasks.workunit.client.1.smithi192.stdout:9/799: stat d5/dc/d40 0 2024-09-21T12:20:31.217 INFO:tasks.workunit.client.1.smithi192.stdout:9/800: readlink d5/dc/d40/lc9 0 2024-09-21T12:20:31.218 INFO:tasks.workunit.client.1.smithi192.stdout:1/763: creat d2/d12/d2f/d51/d24/d65/d8e/d9d/ff8 x:0 0 0 2024-09-21T12:20:31.221 INFO:tasks.workunit.client.0.smithi003.stdout:4/150: creat d9/f2f x:0 0 0 2024-09-21T12:20:31.222 INFO:tasks.workunit.client.0.smithi003.stdout:4/151: fsync d9/f23 0 2024-09-21T12:20:31.223 INFO:tasks.workunit.client.0.smithi003.stdout:6/159: link d4/d9/fd d4/d13/f2c 0 2024-09-21T12:20:31.225 INFO:tasks.workunit.client.1.smithi192.stdout:9/801: mkdir d5/dc/d80/d5a/dfa 0 2024-09-21T12:20:31.226 INFO:tasks.workunit.client.1.smithi192.stdout:9/802: dread - d5/d19/dd5/d4d/d6d/fab zero size 2024-09-21T12:20:31.227 INFO:tasks.workunit.client.1.smithi192.stdout:1/764: creat d2/de/ff9 x:0 0 0 2024-09-21T12:20:31.227 INFO:tasks.workunit.client.1.smithi192.stdout:4/693: sync 2024-09-21T12:20:31.227 INFO:tasks.workunit.client.1.smithi192.stdout:7/720: sync 2024-09-21T12:20:31.229 INFO:tasks.workunit.client.1.smithi192.stdout:9/803: rename d5/dc/d40/dad/de3 to d5/dc/dc2/dfb 0 2024-09-21T12:20:31.230 INFO:tasks.workunit.client.1.smithi192.stdout:1/765: mkdir d2/da/d6b/dfa 0 2024-09-21T12:20:31.231 INFO:tasks.workunit.client.1.smithi192.stdout:6/872: write da/d1f/d27/f6f [163969,32387] 0 2024-09-21T12:20:31.231 INFO:tasks.workunit.client.0.smithi003.stdout:5/177: dwrite dc/d15/d21/f24 [0,4194304] 0 2024-09-21T12:20:31.232 INFO:tasks.workunit.client.1.smithi192.stdout:4/694: unlink d2/df/f17 0 2024-09-21T12:20:31.236 INFO:tasks.workunit.client.1.smithi192.stdout:9/804: dwrite d5/dc/d80/d44/d8e/fe8 [0,4194304] 0 2024-09-21T12:20:31.239 INFO:tasks.workunit.client.1.smithi192.stdout:7/721: mknod d6/d9/d2d/dc4/cfc 0 2024-09-21T12:20:31.240 INFO:tasks.workunit.client.0.smithi003.stdout:4/152: symlink d9/l30 0 2024-09-21T12:20:31.242 INFO:tasks.workunit.client.0.smithi003.stdout:7/138: write d8/f9 [4619553,88217] 0 2024-09-21T12:20:31.242 INFO:tasks.workunit.client.1.smithi192.stdout:6/873: write da/d23/d37/d75/dd0/f10a [131170,72928] 0 2024-09-21T12:20:31.243 INFO:tasks.workunit.client.0.smithi003.stdout:5/178: mknod dc/d15/d21/d30/c39 0 2024-09-21T12:20:31.244 INFO:tasks.workunit.client.1.smithi192.stdout:6/874: write da/d1f/d27/f28 [2131220,10972] 0 2024-09-21T12:20:31.249 INFO:tasks.workunit.client.0.smithi003.stdout:3/143: dwrite d0/d5/d9/f24 [0,4194304] 0 2024-09-21T12:20:31.249 INFO:tasks.workunit.client.0.smithi003.stdout:6/160: creat d4/d11/d1f/f2d x:0 0 0 2024-09-21T12:20:31.249 INFO:tasks.workunit.client.1.smithi192.stdout:1/766: mknod d2/d12/d2f/d51/d24/d65/d8e/cfb 0 2024-09-21T12:20:31.251 INFO:tasks.workunit.client.0.smithi003.stdout:6/161: read d4/d13/f20 [1131222,26687] 0 2024-09-21T12:20:31.253 INFO:tasks.workunit.client.1.smithi192.stdout:4/695: creat d2/db/d34/d56/d6c/fea x:0 0 0 2024-09-21T12:20:31.253 INFO:tasks.workunit.client.1.smithi192.stdout:2/740: dwrite d1b/d1e/d5e/d75/f8c [0,4194304] 0 2024-09-21T12:20:31.253 INFO:tasks.workunit.client.0.smithi003.stdout:4/153: dwrite d9/da/f27 [0,4194304] 0 2024-09-21T12:20:31.254 INFO:tasks.workunit.client.0.smithi003.stdout:6/162: readlink d4/d11/d1d/l1e 0 2024-09-21T12:20:31.256 INFO:tasks.workunit.client.1.smithi192.stdout:7/722: creat d6/d20/dc9/ffd x:0 0 0 2024-09-21T12:20:31.257 INFO:tasks.workunit.client.1.smithi192.stdout:2/741: chown d1b/d1e/d3d/f56 22027 1 2024-09-21T12:20:31.258 INFO:tasks.workunit.client.0.smithi003.stdout:3/144: truncate d0/d5/d9/d11/f20 498614 0 2024-09-21T12:20:31.258 INFO:tasks.workunit.client.0.smithi003.stdout:7/139: read d8/fe [166986,33878] 0 2024-09-21T12:20:31.260 INFO:tasks.workunit.client.1.smithi192.stdout:1/767: dwrite d2/da/d6b/dc8/fa3 [0,4194304] 0 2024-09-21T12:20:31.260 INFO:tasks.workunit.client.0.smithi003.stdout:5/179: dwrite dc/d15/d1c/f23 [0,4194304] 0 2024-09-21T12:20:31.263 INFO:tasks.workunit.client.0.smithi003.stdout:6/163: mkdir d4/d13/d2e 0 2024-09-21T12:20:31.264 INFO:tasks.workunit.client.1.smithi192.stdout:6/875: symlink da/d1f/d56/d73/l11f 0 2024-09-21T12:20:31.265 INFO:tasks.workunit.client.1.smithi192.stdout:6/876: readlink da/d1f/d27/d6b/lf3 0 2024-09-21T12:20:31.270 INFO:tasks.workunit.client.0.smithi003.stdout:4/154: creat d9/da/f31 x:0 0 0 2024-09-21T12:20:31.270 INFO:tasks.workunit.client.0.smithi003.stdout:8/177: dwrite d7/df/f12 [0,4194304] 0 2024-09-21T12:20:31.274 INFO:tasks.workunit.client.1.smithi192.stdout:2/742: unlink f19 0 2024-09-21T12:20:31.275 INFO:tasks.workunit.client.0.smithi003.stdout:6/164: dwrite d4/d11/d1f/f2d [0,4194304] 0 2024-09-21T12:20:31.276 INFO:tasks.workunit.client.1.smithi192.stdout:7/723: fsync d6/d9/d70/d77/f9a 0 2024-09-21T12:20:31.279 INFO:tasks.workunit.client.0.smithi003.stdout:4/155: mknod d9/d16/c32 0 2024-09-21T12:20:31.280 INFO:tasks.workunit.client.1.smithi192.stdout:7/724: read d6/d9/d70/d77/fb7 [663910,36097] 0 2024-09-21T12:20:31.281 INFO:tasks.workunit.client.0.smithi003.stdout:7/140: mkdir d8/d31 0 2024-09-21T12:20:31.281 INFO:tasks.workunit.client.1.smithi192.stdout:7/725: chown d6/d20/l42 113917 1 2024-09-21T12:20:31.282 INFO:tasks.workunit.client.0.smithi003.stdout:7/141: write d8/db/d13/f30 [217724,115388] 0 2024-09-21T12:20:31.283 INFO:tasks.workunit.client.1.smithi192.stdout:2/743: mkdir d1b/d1e/d5e/d88/d95/df2 0 2024-09-21T12:20:31.284 INFO:tasks.workunit.client.0.smithi003.stdout:6/165: creat d4/d11/f2f x:0 0 0 2024-09-21T12:20:31.285 INFO:tasks.workunit.client.0.smithi003.stdout:6/166: readlink d4/d11/d1d/l1e 0 2024-09-21T12:20:31.286 INFO:tasks.workunit.client.0.smithi003.stdout:6/167: stat d4/d9/l2a 0 2024-09-21T12:20:31.289 INFO:tasks.workunit.client.0.smithi003.stdout:5/180: rename f6 to dc/f3a 0 2024-09-21T12:20:31.291 INFO:tasks.workunit.client.0.smithi003.stdout:7/142: unlink d8/db/d13/f27 0 2024-09-21T12:20:31.294 INFO:tasks.workunit.client.1.smithi192.stdout:7/726: rmdir d6/d20/d69/d90/da7/dc1 39 2024-09-21T12:20:31.295 INFO:tasks.workunit.client.0.smithi003.stdout:4/156: mknod d9/c33 0 2024-09-21T12:20:31.299 INFO:tasks.workunit.client.1.smithi192.stdout:7/727: mknod d6/d3a/d6d/cfe 0 2024-09-21T12:20:31.301 INFO:tasks.workunit.client.0.smithi003.stdout:4/157: dwrite d9/f18 [0,4194304] 0 2024-09-21T12:20:31.302 INFO:tasks.workunit.client.1.smithi192.stdout:7/728: creat d6/d20/dc9/fff x:0 0 0 2024-09-21T12:20:31.302 INFO:tasks.workunit.client.0.smithi003.stdout:4/158: readlink d9/l30 0 2024-09-21T12:20:31.302 INFO:tasks.workunit.client.0.smithi003.stdout:7/143: mkdir d8/db/d32 0 2024-09-21T12:20:31.303 INFO:tasks.workunit.client.0.smithi003.stdout:6/168: mkdir d4/d30 0 2024-09-21T12:20:31.305 INFO:tasks.workunit.client.1.smithi192.stdout:7/729: mkdir d6/d9/d70/d77/d100 0 2024-09-21T12:20:31.308 INFO:tasks.workunit.client.0.smithi003.stdout:4/159: mknod d9/da/c34 0 2024-09-21T12:20:31.310 INFO:tasks.workunit.client.0.smithi003.stdout:7/144: creat d8/db/d13/f33 x:0 0 0 2024-09-21T12:20:31.311 INFO:tasks.workunit.client.1.smithi192.stdout:7/730: fsync d6/d9/d1f/d3e/d7a/d8a/fe5 0 2024-09-21T12:20:31.311 INFO:tasks.workunit.client.0.smithi003.stdout:6/169: creat d4/d11/d1f/f31 x:0 0 0 2024-09-21T12:20:31.317 INFO:tasks.workunit.client.0.smithi003.stdout:6/170: rename d4/d30 to d4/d11/d32 0 2024-09-21T12:20:31.317 INFO:tasks.workunit.client.0.smithi003.stdout:7/145: dwrite d8/db/f20 [0,4194304] 0 2024-09-21T12:20:31.318 INFO:tasks.workunit.client.1.smithi192.stdout:7/731: creat d6/d9/d70/dda/f101 x:0 0 0 2024-09-21T12:20:31.318 INFO:tasks.workunit.client.1.smithi192.stdout:3/682: sync 2024-09-21T12:20:31.318 INFO:tasks.workunit.client.1.smithi192.stdout:0/785: sync 2024-09-21T12:20:31.318 INFO:tasks.workunit.client.1.smithi192.stdout:8/805: sync 2024-09-21T12:20:31.319 INFO:tasks.workunit.client.0.smithi003.stdout:4/160: link d9/l1c d9/d25/l35 0 2024-09-21T12:20:31.321 INFO:tasks.workunit.client.1.smithi192.stdout:3/683: fsync db/d16/d18/d21/f5d 0 2024-09-21T12:20:31.322 INFO:tasks.workunit.client.1.smithi192.stdout:7/732: fdatasync d6/d9/f5b 0 2024-09-21T12:20:31.325 INFO:tasks.workunit.client.1.smithi192.stdout:0/786: symlink d3/lec 0 2024-09-21T12:20:31.326 INFO:tasks.workunit.client.1.smithi192.stdout:4/696: dwrite d2/d36/d7f/d68/f78 [0,4194304] 0 2024-09-21T12:20:31.327 INFO:tasks.workunit.client.0.smithi003.stdout:3/145: truncate d0/d5/da/ff 860359 0 2024-09-21T12:20:31.329 INFO:tasks.workunit.client.1.smithi192.stdout:6/877: truncate da/d23/d37/d75/de2/f100 3883587 0 2024-09-21T12:20:31.334 INFO:tasks.workunit.client.1.smithi192.stdout:1/768: dwrite d2/d12/d2f/d41/d5c/f83 [4194304,4194304] 0 2024-09-21T12:20:31.335 INFO:tasks.workunit.client.0.smithi003.stdout:4/161: truncate f6 239388 0 2024-09-21T12:20:31.337 INFO:tasks.workunit.client.1.smithi192.stdout:4/697: read d2/db/d34/d56/d6c/db8/d88/fe1 [499559,68518] 0 2024-09-21T12:20:31.338 INFO:tasks.workunit.client.0.smithi003.stdout:7/146: rename d8/l24 to d8/l34 0 2024-09-21T12:20:31.340 INFO:tasks.workunit.client.1.smithi192.stdout:8/806: dwrite d14/d1a/d1d/d48/de2/ffb [0,4194304] 0 2024-09-21T12:20:31.341 INFO:tasks.workunit.client.0.smithi003.stdout:4/162: mkdir d9/da/d36 0 2024-09-21T12:20:31.342 INFO:tasks.workunit.client.1.smithi192.stdout:3/684: truncate db/d16/d18/d33/d3b/db1/fbb 10903 0 2024-09-21T12:20:31.342 INFO:tasks.workunit.client.0.smithi003.stdout:4/163: fsync d9/da/fb 0 2024-09-21T12:20:31.344 INFO:tasks.workunit.client.0.smithi003.stdout:4/164: write d9/d16/f26 [746123,31776] 0 2024-09-21T12:20:31.345 INFO:tasks.workunit.client.0.smithi003.stdout:5/181: truncate dc/d15/d1c/f29 445120 0 2024-09-21T12:20:31.345 INFO:tasks.workunit.client.0.smithi003.stdout:4/165: write d9/d16/f28 [301016,80823] 0 2024-09-21T12:20:31.346 INFO:tasks.workunit.client.0.smithi003.stdout:5/182: chown c5 119 1 2024-09-21T12:20:31.347 INFO:tasks.workunit.client.1.smithi192.stdout:3/685: chown db/d16/d18/d40/fa3 1 1 2024-09-21T12:20:31.348 INFO:tasks.workunit.client.1.smithi192.stdout:0/787: dwrite d3/f7f [0,4194304] 0 2024-09-21T12:20:31.350 INFO:tasks.workunit.client.1.smithi192.stdout:2/744: dwrite d1b/d1e/f2f [0,4194304] 0 2024-09-21T12:20:31.353 INFO:tasks.workunit.client.1.smithi192.stdout:0/788: write d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/dc6/d83/f8b [349587,6044] 0 2024-09-21T12:20:31.359 INFO:tasks.workunit.client.0.smithi003.stdout:5/183: mknod dc/d2b/c3b 0 2024-09-21T12:20:31.360 INFO:tasks.workunit.client.0.smithi003.stdout:5/184: dread - dc/d15/d21/d30/f33 zero size 2024-09-21T12:20:31.361 INFO:tasks.workunit.client.0.smithi003.stdout:5/185: stat dc/d2b 0 2024-09-21T12:20:31.363 INFO:tasks.workunit.client.1.smithi192.stdout:4/698: symlink d2/db/d3e/d57/d32/d4f/d71/d9d/dad/leb 0 2024-09-21T12:20:31.364 INFO:tasks.workunit.client.0.smithi003.stdout:6/171: truncate d4/fe 1361077 0 2024-09-21T12:20:31.366 INFO:tasks.workunit.client.0.smithi003.stdout:7/147: rename d8/l28 to d8/l35 0 2024-09-21T12:20:31.369 INFO:tasks.workunit.client.0.smithi003.stdout:5/186: mkdir dc/d15/d21/d28/d3c 0 2024-09-21T12:20:31.369 INFO:tasks.workunit.client.1.smithi192.stdout:4/699: dwrite d2/db/d34/f94 [0,4194304] 0 2024-09-21T12:20:31.374 INFO:tasks.workunit.client.0.smithi003.stdout:7/148: dwrite d8/f9 [4194304,4194304] 0 2024-09-21T12:20:31.374 INFO:tasks.workunit.client.1.smithi192.stdout:7/733: creat d6/d20/d69/d90/da7/dc1/f102 x:0 0 0 2024-09-21T12:20:31.375 INFO:tasks.workunit.client.1.smithi192.stdout:8/807: dread d14/d18/f33 [0,4194304] 0 2024-09-21T12:20:31.376 INFO:tasks.workunit.client.0.smithi003.stdout:7/149: chown d8/db/d32 30 1 2024-09-21T12:20:31.380 INFO:tasks.workunit.client.0.smithi003.stdout:5/187: dwrite dc/d15/f1f [0,4194304] 0 2024-09-21T12:20:31.381 INFO:tasks.workunit.client.0.smithi003.stdout:4/166: getdents d9/da 0 2024-09-21T12:20:31.383 INFO:tasks.workunit.client.0.smithi003.stdout:5/188: write dc/d15/d21/f24 [16827,43166] 0 2024-09-21T12:20:31.383 INFO:tasks.workunit.client.0.smithi003.stdout:5/189: stat dc/d15/d26 0 2024-09-21T12:20:31.385 INFO:tasks.workunit.client.1.smithi192.stdout:6/878: link da/d1f/lc0 da/d1f/d48/d7d/da7/d11d/l120 0 2024-09-21T12:20:31.388 INFO:tasks.workunit.client.1.smithi192.stdout:3/686: symlink db/d16/dee/lfb 0 2024-09-21T12:20:31.390 INFO:tasks.workunit.client.1.smithi192.stdout:7/734: dwrite d6/d20/f40 [8388608,4194304] 0 2024-09-21T12:20:31.391 INFO:tasks.workunit.client.0.smithi003.stdout:4/167: mknod d9/da/c37 0 2024-09-21T12:20:31.393 INFO:tasks.workunit.client.0.smithi003.stdout:7/150: mknod d8/d31/c36 0 2024-09-21T12:20:31.394 INFO:tasks.workunit.client.1.smithi192.stdout:1/769: dwrite d2/d12/d2f/d51/d24/d58/f88 [0,4194304] 0 2024-09-21T12:20:31.398 INFO:tasks.workunit.client.1.smithi192.stdout:8/808: dwrite d14/d18/d94/dc3/ff3 [0,4194304] 0 2024-09-21T12:20:31.398 INFO:tasks.workunit.client.1.smithi192.stdout:0/789: rename d3/lec to d3/d5/dd7/led 0 2024-09-21T12:20:31.399 INFO:tasks.workunit.client.0.smithi003.stdout:5/190: mknod dc/d15/d1c/c3d 0 2024-09-21T12:20:31.400 INFO:tasks.workunit.client.1.smithi192.stdout:7/735: write d6/d9/d70/d77/f91 [84982,76112] 0 2024-09-21T12:20:31.405 INFO:tasks.workunit.client.1.smithi192.stdout:4/700: truncate d2/d36/f7c 99529 0 2024-09-21T12:20:31.406 INFO:tasks.workunit.client.1.smithi192.stdout:3/687: readlink db/d16/d18/d21/d23/dd2/d2e/lf5 0 2024-09-21T12:20:31.414 INFO:tasks.workunit.client.1.smithi192.stdout:9/805: sync 2024-09-21T12:20:31.414 INFO:tasks.workunit.client.1.smithi192.stdout:3/688: dwrite db/d16/d18/d33/d3b/db1/df1/f9e [0,4194304] 0 2024-09-21T12:20:31.418 INFO:tasks.workunit.client.0.smithi003.stdout:7/151: truncate d8/db/d13/f1e 1953009 0 2024-09-21T12:20:31.418 INFO:tasks.workunit.client.0.smithi003.stdout:6/172: dwrite d4/d9/fd [0,4194304] 0 2024-09-21T12:20:31.419 INFO:tasks.workunit.client.0.smithi003.stdout:7/152: chown d8/l12 428742 1 2024-09-21T12:20:31.419 INFO:tasks.workunit.client.1.smithi192.stdout:8/809: mknod d14/d1a/d1d/d46/d4e/c110 0 2024-09-21T12:20:31.420 INFO:tasks.workunit.client.0.smithi003.stdout:4/168: mknod d9/da/d36/c38 0 2024-09-21T12:20:31.422 INFO:tasks.workunit.client.0.smithi003.stdout:4/169: fsync d9/f24 0 2024-09-21T12:20:31.430 INFO:tasks.workunit.client.0.smithi003.stdout:6/173: truncate f3 8960459 0 2024-09-21T12:20:31.431 INFO:tasks.workunit.client.1.smithi192.stdout:4/701: mknod d2/db/d3e/d57/d32/d4f/d71/d9d/dad/d9c/d9e/cec 0 2024-09-21T12:20:31.433 INFO:tasks.workunit.client.1.smithi192.stdout:4/702: fdatasync d2/db/d3e/d57/d32/d4f/d71/d9d/dad/d9c/d9e/fc7 0 2024-09-21T12:20:31.433 INFO:tasks.workunit.client.0.smithi003.stdout:7/153: creat d8/d2c/f37 x:0 0 0 2024-09-21T12:20:31.434 INFO:tasks.workunit.client.0.smithi003.stdout:6/174: dread d4/d11/d1f/f2d [0,4194304] 0 2024-09-21T12:20:31.438 INFO:tasks.workunit.client.1.smithi192.stdout:3/689: rename db/d16/d18/d21/d23/dd2/d2e/f72 to db/d16/d18/da7/ffc 0 2024-09-21T12:20:31.439 INFO:tasks.workunit.client.1.smithi192.stdout:2/745: write d1b/d38/d53/d8b/da7/fd4 [4591494,49504] 0 2024-09-21T12:20:31.441 INFO:tasks.workunit.client.1.smithi192.stdout:6/879: link da/d23/d37/f8e da/d23/d37/d75/de2/f121 0 2024-09-21T12:20:31.443 INFO:tasks.workunit.client.1.smithi192.stdout:1/770: dread d2/d12/d2f/d51/f7c [0,4194304] 0 2024-09-21T12:20:31.443 INFO:tasks.workunit.client.1.smithi192.stdout:8/810: truncate d14/d1a/d1d/d48/f62 2500783 0 2024-09-21T12:20:31.444 INFO:tasks.workunit.client.1.smithi192.stdout:1/771: chown d2/d12/d2f/d81 2263098 1 2024-09-21T12:20:31.444 INFO:tasks.workunit.client.1.smithi192.stdout:8/811: dread - d14/d18/fed zero size 2024-09-21T12:20:31.444 INFO:tasks.workunit.client.0.smithi003.stdout:7/154: creat d8/db/f38 x:0 0 0 2024-09-21T12:20:31.445 INFO:tasks.workunit.client.1.smithi192.stdout:0/790: link d3/d5/d28/d39/d50/fac d3/d5/d28/d39/d50/fee 0 2024-09-21T12:20:31.446 INFO:tasks.workunit.client.0.smithi003.stdout:0/156: sync 2024-09-21T12:20:31.447 INFO:tasks.workunit.client.0.smithi003.stdout:6/175: symlink d4/d11/l33 0 2024-09-21T12:20:31.448 INFO:tasks.workunit.client.1.smithi192.stdout:0/791: dread d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/dc6/f5a [0,4194304] 0 2024-09-21T12:20:31.450 INFO:tasks.workunit.client.0.smithi003.stdout:6/176: dread d4/fa [0,4194304] 0 2024-09-21T12:20:31.450 INFO:tasks.workunit.client.1.smithi192.stdout:0/792: truncate d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/d33/dae/db4/fc0 4762486 0 2024-09-21T12:20:31.452 INFO:tasks.workunit.client.0.smithi003.stdout:7/155: creat d8/d2c/f39 x:0 0 0 2024-09-21T12:20:31.452 INFO:tasks.workunit.client.1.smithi192.stdout:9/806: write d5/d19/dd5/d4d/f47 [998048,99198] 0 2024-09-21T12:20:31.453 INFO:tasks.workunit.client.0.smithi003.stdout:7/156: stat d8/db/d13 0 2024-09-21T12:20:31.461 INFO:tasks.workunit.client.1.smithi192.stdout:8/812: rmdir d14/d1a/d1d/d48/de1 39 2024-09-21T12:20:31.462 INFO:tasks.workunit.client.1.smithi192.stdout:2/746: dwrite d1b/d1e/d7b/f8a [0,4194304] 0 2024-09-21T12:20:31.464 INFO:tasks.workunit.client.0.smithi003.stdout:7/157: creat d8/db/d13/f3a x:0 0 0 2024-09-21T12:20:31.467 INFO:tasks.workunit.client.1.smithi192.stdout:7/736: creat d6/d9/d1f/d3e/d7a/d8a/f103 x:0 0 0 2024-09-21T12:20:31.467 INFO:tasks.workunit.client.1.smithi192.stdout:4/703: write d2/f66 [53483,110647] 0 2024-09-21T12:20:31.468 INFO:tasks.workunit.client.1.smithi192.stdout:4/704: stat d2/db/d3e/d57/d32/d4f/d82/c91 0 2024-09-21T12:20:31.469 INFO:tasks.workunit.client.0.smithi003.stdout:4/170: getdents d9 0 2024-09-21T12:20:31.473 INFO:tasks.workunit.client.1.smithi192.stdout:0/793: creat d3/d5/d28/d39/d50/dd9/d7a/fef x:0 0 0 2024-09-21T12:20:31.475 INFO:tasks.workunit.client.1.smithi192.stdout:9/807: symlink d5/d8/dc7/dd7/de7/d55/lfc 0 2024-09-21T12:20:31.478 INFO:tasks.workunit.client.1.smithi192.stdout:2/747: dread - d1b/d9e/fac zero size 2024-09-21T12:20:31.479 INFO:tasks.workunit.client.1.smithi192.stdout:7/737: chown d6/d3a/f46 1746397 1 2024-09-21T12:20:31.480 INFO:tasks.workunit.client.1.smithi192.stdout:7/738: dread - d6/d9/d1f/d3e/d7a/fc8 zero size 2024-09-21T12:20:31.481 INFO:tasks.workunit.client.1.smithi192.stdout:3/690: creat db/d16/d18/d21/ffd x:0 0 0 2024-09-21T12:20:31.481 INFO:tasks.workunit.client.1.smithi192.stdout:9/808: symlink d5/d19/dd5/d4d/d6d/dd9/db5/lfd 0 2024-09-21T12:20:31.482 INFO:tasks.workunit.client.1.smithi192.stdout:1/772: creat d2/d12/d2f/d51/d24/d65/d8e/d9d/db6/ffc x:0 0 0 2024-09-21T12:20:31.484 INFO:tasks.workunit.client.1.smithi192.stdout:6/880: rename da/d1f/d27/d6b/f6d to da/f122 0 2024-09-21T12:20:31.485 INFO:tasks.workunit.client.1.smithi192.stdout:9/809: symlink d5/dc/d40/lfe 0 2024-09-21T12:20:31.486 INFO:tasks.workunit.client.1.smithi192.stdout:1/773: creat d2/d82/ffd x:0 0 0 2024-09-21T12:20:31.487 INFO:tasks.workunit.client.1.smithi192.stdout:0/794: rmdir d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/dc6/d83/d87/dcb 0 2024-09-21T12:20:31.487 INFO:tasks.workunit.client.1.smithi192.stdout:1/774: chown d2/d12/d2f/d51/d24/d65/d5a/ca7 6868280 1 2024-09-21T12:20:31.488 INFO:tasks.workunit.client.1.smithi192.stdout:1/775: dread - d2/d12/fe4 zero size 2024-09-21T12:20:31.489 INFO:tasks.workunit.client.1.smithi192.stdout:9/810: symlink d5/d19/d32/dc0/lff 0 2024-09-21T12:20:31.489 INFO:tasks.workunit.client.1.smithi192.stdout:4/705: link d2/db/d3e/d57/d32/cb9 d2/db/d34/d56/d6c/db8/d99/ced 0 2024-09-21T12:20:31.489 INFO:tasks.workunit.client.1.smithi192.stdout:0/795: dread - d3/d5/d28/d39/d50/dd9/d7a/dbe/d92/d51/fad zero size 2024-09-21T12:20:31.490 INFO:tasks.workunit.client.1.smithi192.stdout:3/691: creat db/d16/d18/d33/d3b/ffe x:0 0 0 2024-09-21T12:20:31.491 INFO:tasks.workunit.client.1.smithi192.stdout:4/706: chown d2/db/d34/d56/d6c/fea 63 1 2024-09-21T12:20:31.491 INFO:tasks.workunit.client.1.smithi192.stdout:1/776: fsync d2/d12/d2f/d51/d24/d65/f74 0 2024-09-21T12:20:31.493 INFO:tasks.workunit.client.1.smithi192.stdout:0/796: unlink d3/d5/d28/d39/d50/fee 0 2024-09-21T12:20:31.494 INFO:tasks.workunit.client.1.smithi192.stdout:1/777: dread - d2/d12/d2f/d51/d24/d65/d8e/d9d/db6/fdc zero size 2024-09-21T12:20:31.497 INFO:tasks.workunit.client.1.smithi192.stdout:9/811: dread d5/dc/d40/f25 [0,4194304] 0 2024-09-21T12:20:31.499 INFO:tasks.workunit.client.1.smithi192.stdout:6/881: write da/d1f/d56/d78/faf [4636942,9843] 0 2024-09-21T12:20:31.500 INFO:tasks.workunit.client.1.smithi192.stdout:3/692: dwrite db/d16/d18/d21/d23/dd2/d2e/db8/dd0/fe0 [0,4194304] 0 2024-09-21T12:20:31.502 INFO:tasks.workunit.client.1.smithi192.stdout:0/797: write d3/d5/d28/d39/d50/dd9/d7a/dbe/d89/f9d [562031,112867] 0 2024-09-21T12:20:31.506 INFO:tasks.workunit.client.1.smithi192.stdout:4/707: rename d2/db/d3e/de2 to d2/db/d1a/dee 0 2024-09-21T12:20:31.507 INFO:tasks.workunit.client.1.smithi192.stdout:0/798: chown d3/d5/d28/d39/d50/dd9/d7a/dbe/c7b 82825341 1 2024-09-21T12:20:31.507 INFO:tasks.workunit.client.1.smithi192.stdout:1/778: write d2/dae/fe7 [2733963,71284] 0 2024-09-21T12:20:31.511 INFO:tasks.workunit.client.1.smithi192.stdout:4/708: chown d2/db/d3e/d57/d32/d4f/d82 473282 1 2024-09-21T12:20:31.511 INFO:tasks.workunit.client.1.smithi192.stdout:0/799: mkdir d3/df0 0 2024-09-21T12:20:31.512 INFO:tasks.workunit.client.1.smithi192.stdout:6/882: dwrite da/d1f/de6/f109 [0,4194304] 0 2024-09-21T12:20:31.515 INFO:tasks.workunit.client.1.smithi192.stdout:9/812: dwrite d5/dc/fa4 [0,4194304] 0 2024-09-21T12:20:31.519 INFO:tasks.workunit.client.1.smithi192.stdout:4/709: symlink d2/db/d3e/d57/lef 0 2024-09-21T12:20:31.524 INFO:tasks.workunit.client.1.smithi192.stdout:6/883: link da/d1f/f45 da/d1f/d48/d7d/da7/dc8/f123 0 2024-09-21T12:20:31.524 INFO:tasks.workunit.client.1.smithi192.stdout:0/800: read d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/dc6/d83/d87/faa [388667,56652] 0 2024-09-21T12:20:31.526 INFO:tasks.workunit.client.1.smithi192.stdout:9/813: creat d5/f100 x:0 0 0 2024-09-21T12:20:31.527 INFO:tasks.workunit.client.1.smithi192.stdout:9/814: write d5/d19/f7f [4695338,14285] 0 2024-09-21T12:20:31.529 INFO:tasks.workunit.client.1.smithi192.stdout:4/710: fsync d2/db/d1a/f46 0 2024-09-21T12:20:31.533 INFO:tasks.workunit.client.1.smithi192.stdout:3/693: dread db/d16/d18/f2f [0,4194304] 0 2024-09-21T12:20:31.533 INFO:tasks.workunit.client.1.smithi192.stdout:0/801: dwrite d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/d33/f3c [0,4194304] 0 2024-09-21T12:20:31.534 INFO:tasks.workunit.client.1.smithi192.stdout:3/694: stat db/f4f 0 2024-09-21T12:20:31.534 INFO:tasks.workunit.client.1.smithi192.stdout:4/711: fdatasync d2/db/d3e/d57/d32/d4f/d71/d9d/dad/d4b/f62 0 2024-09-21T12:20:31.536 INFO:tasks.workunit.client.1.smithi192.stdout:6/884: dread da/d23/d37/f59 [0,4194304] 0 2024-09-21T12:20:31.541 INFO:tasks.workunit.client.1.smithi192.stdout:4/712: unlink d2/db/d34/f4a 0 2024-09-21T12:20:31.543 INFO:tasks.workunit.client.1.smithi192.stdout:3/695: fsync db/d16/d18/d21/d23/dd2/f84 0 2024-09-21T12:20:31.544 INFO:tasks.workunit.client.1.smithi192.stdout:9/815: dwrite d5/dc/d80/d44/d8e/dd6/dd8/ff9 [4194304,4194304] 0 2024-09-21T12:20:31.544 INFO:tasks.workunit.client.0.smithi003.stdout:6/177: fsync f3 0 2024-09-21T12:20:31.544 INFO:tasks.workunit.client.0.smithi003.stdout:7/158: symlink d8/db/l3b 0 2024-09-21T12:20:31.546 INFO:tasks.workunit.client.1.smithi192.stdout:3/696: fdatasync db/d16/d18/d40/f51 0 2024-09-21T12:20:31.547 INFO:tasks.workunit.client.0.smithi003.stdout:4/171: creat d9/d25/f39 x:0 0 0 2024-09-21T12:20:31.549 INFO:tasks.workunit.client.0.smithi003.stdout:4/172: write d9/f2f [612942,98443] 0 2024-09-21T12:20:31.550 INFO:tasks.workunit.client.1.smithi192.stdout:0/802: dwrite d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/dc6/f68 [0,4194304] 0 2024-09-21T12:20:31.552 INFO:tasks.workunit.client.0.smithi003.stdout:0/157: dwrite d9/d12/d15/f1b [0,4194304] 0 2024-09-21T12:20:31.553 INFO:tasks.workunit.client.1.smithi192.stdout:0/803: chown d3/d5/d28/d39/d50/fc1 19699 1 2024-09-21T12:20:31.556 INFO:tasks.workunit.client.0.smithi003.stdout:7/159: mkdir d8/d3c 0 2024-09-21T12:20:31.557 INFO:tasks.workunit.client.0.smithi003.stdout:7/160: dread - d8/db/d13/f3a zero size 2024-09-21T12:20:31.558 INFO:tasks.workunit.client.0.smithi003.stdout:6/178: mknod d4/d13/d19/d23/c34 0 2024-09-21T12:20:31.559 INFO:tasks.workunit.client.1.smithi192.stdout:9/816: mkdir d5/dc/d80/d5a/dfa/d101 0 2024-09-21T12:20:31.560 INFO:tasks.workunit.client.1.smithi192.stdout:0/804: readlink d3/d5/d28/d39/d50/dd9/d7a/dbe/lb0 0 2024-09-21T12:20:31.563 INFO:tasks.workunit.client.0.smithi003.stdout:6/179: dread d4/d9/fd [0,4194304] 0 2024-09-21T12:20:31.563 INFO:tasks.workunit.client.0.smithi003.stdout:7/161: link d8/db/ff d8/db/f3d 0 2024-09-21T12:20:31.564 INFO:tasks.workunit.client.0.smithi003.stdout:6/180: readlink d4/d11/d1d/l1e 0 2024-09-21T12:20:31.565 INFO:tasks.workunit.client.1.smithi192.stdout:4/713: dwrite d2/db/d34/d56/d6c/db8/f59 [0,4194304] 0 2024-09-21T12:20:31.568 INFO:tasks.workunit.client.1.smithi192.stdout:6/885: dwrite da/d1f/d48/d7d/da7/dc8/f123 [4194304,4194304] 0 2024-09-21T12:20:31.570 INFO:tasks.workunit.client.1.smithi192.stdout:9/817: creat d5/d8/dc7/dd7/de7/d55/df3/f102 x:0 0 0 2024-09-21T12:20:31.573 INFO:tasks.workunit.client.1.smithi192.stdout:9/818: write d5/d8/dc7/dd7/de7/d55/df3/f102 [409594,106339] 0 2024-09-21T12:20:31.574 INFO:tasks.workunit.client.1.smithi192.stdout:9/819: stat d5/f33 0 2024-09-21T12:20:31.577 INFO:tasks.workunit.client.0.smithi003.stdout:7/162: rename d8/d2c/f2d to d8/d3c/f3e 0 2024-09-21T12:20:31.578 INFO:tasks.workunit.client.1.smithi192.stdout:0/805: dwrite d3/d5/d28/d39/d50/dd9/fa7 [0,4194304] 0 2024-09-21T12:20:31.579 INFO:tasks.workunit.client.0.smithi003.stdout:0/158: dwrite d9/d12/f16 [0,4194304] 0 2024-09-21T12:20:31.579 INFO:tasks.workunit.client.1.smithi192.stdout:4/714: creat d2/db/d34/d56/d6c/ff0 x:0 0 0 2024-09-21T12:20:31.579 INFO:tasks.workunit.client.0.smithi003.stdout:7/163: dread - d8/d2c/f39 zero size 2024-09-21T12:20:31.581 INFO:tasks.workunit.client.1.smithi192.stdout:6/886: write da/d23/d37/fd9 [402574,14517] 0 2024-09-21T12:20:31.581 INFO:tasks.workunit.client.1.smithi192.stdout:9/820: creat d5/d19/dd5/d4d/d6d/f103 x:0 0 0 2024-09-21T12:20:31.583 INFO:tasks.workunit.client.0.smithi003.stdout:0/159: dread d9/d12/f13 [0,4194304] 0 2024-09-21T12:20:31.583 INFO:tasks.workunit.client.1.smithi192.stdout:4/715: unlink d2/df/f30 0 2024-09-21T12:20:31.588 INFO:tasks.workunit.client.0.smithi003.stdout:0/160: creat d9/d12/d22/f29 x:0 0 0 2024-09-21T12:20:31.591 INFO:tasks.workunit.client.0.smithi003.stdout:7/164: getdents d8/db 0 2024-09-21T12:20:31.592 INFO:tasks.workunit.client.0.smithi003.stdout:7/165: chown d8/db/f38 1 1 2024-09-21T12:20:31.593 INFO:tasks.workunit.client.0.smithi003.stdout:0/161: symlink d9/d12/d1e/l2a 0 2024-09-21T12:20:31.593 INFO:tasks.workunit.client.1.smithi192.stdout:9/821: creat d5/dc/d64/dbb/d3d/f104 x:0 0 0 2024-09-21T12:20:31.597 INFO:tasks.workunit.client.0.smithi003.stdout:0/162: unlink d9/ce 0 2024-09-21T12:20:31.598 INFO:tasks.workunit.client.0.smithi003.stdout:7/166: symlink d8/db/d32/l3f 0 2024-09-21T12:20:31.600 INFO:tasks.workunit.client.1.smithi192.stdout:3/697: dread db/d16/d18/d33/d3b/db1/df1/f86 [0,4194304] 0 2024-09-21T12:20:31.603 INFO:tasks.workunit.client.0.smithi003.stdout:0/163: dwrite d9/fb [0,4194304] 0 2024-09-21T12:20:31.605 INFO:tasks.workunit.client.0.smithi003.stdout:6/181: dwrite f3 [0,4194304] 0 2024-09-21T12:20:31.606 INFO:tasks.workunit.client.0.smithi003.stdout:6/182: stat d4/d11 0 2024-09-21T12:20:31.608 INFO:tasks.workunit.client.0.smithi003.stdout:0/164: rename d9/d12/d15 to d9/d12/d1e/d2b 0 2024-09-21T12:20:31.614 INFO:tasks.workunit.client.0.smithi003.stdout:0/165: dread d9/d12/d1e/f1f [0,4194304] 0 2024-09-21T12:20:31.615 INFO:tasks.workunit.client.0.smithi003.stdout:0/166: chown d9/d12/d1e/d2b 103 1 2024-09-21T12:20:31.617 INFO:tasks.workunit.client.0.smithi003.stdout:0/167: truncate d9/d12/d22/f29 849291 0 2024-09-21T12:20:31.624 INFO:tasks.workunit.client.0.smithi003.stdout:0/168: dwrite d9/d12/d17/f19 [0,4194304] 0 2024-09-21T12:20:31.629 INFO:tasks.workunit.client.1.smithi192.stdout:4/716: write d2/d36/d7f/f39 [1371181,88579] 0 2024-09-21T12:20:31.630 INFO:tasks.workunit.client.1.smithi192.stdout:6/887: symlink da/l124 0 2024-09-21T12:20:31.631 INFO:tasks.workunit.client.0.smithi003.stdout:0/169: creat d9/d12/f2c x:0 0 0 2024-09-21T12:20:31.632 INFO:tasks.workunit.client.1.smithi192.stdout:9/822: mkdir d5/d19/dd5/d4d/d6d/d105 0 2024-09-21T12:20:31.633 INFO:tasks.workunit.client.0.smithi003.stdout:0/170: mkdir d9/d12/d22/d2d 0 2024-09-21T12:20:31.634 INFO:tasks.workunit.client.1.smithi192.stdout:4/717: rmdir d2/d36/d7f/d68 39 2024-09-21T12:20:31.635 INFO:tasks.workunit.client.1.smithi192.stdout:3/698: read db/f22 [165989,34802] 0 2024-09-21T12:20:31.635 INFO:tasks.workunit.client.1.smithi192.stdout:4/718: stat d2/d36/d55/d89/da6/dd1 0 2024-09-21T12:20:31.636 INFO:tasks.workunit.client.1.smithi192.stdout:9/823: mkdir d5/d8/dc7/d106 0 2024-09-21T12:20:31.638 INFO:tasks.workunit.client.0.smithi003.stdout:0/171: dread d9/d12/d1e/d2b/f1b [0,4194304] 0 2024-09-21T12:20:31.640 INFO:tasks.workunit.client.1.smithi192.stdout:6/888: rename da/d1f/d48/d7d/cb6 to da/d1f/d27/d6b/c125 0 2024-09-21T12:20:31.641 INFO:tasks.workunit.client.1.smithi192.stdout:3/699: creat db/d16/d18/d21/d23/dd2/d2e/db8/dd0/fff x:0 0 0 2024-09-21T12:20:31.641 INFO:tasks.workunit.client.1.smithi192.stdout:4/719: dwrite d2/fc9 [0,4194304] 0 2024-09-21T12:20:31.643 INFO:tasks.workunit.client.0.smithi003.stdout:0/172: dread d9/d12/d1e/f1f [0,4194304] 0 2024-09-21T12:20:31.647 INFO:tasks.workunit.client.0.smithi003.stdout:6/183: dwrite d4/f10 [0,4194304] 0 2024-09-21T12:20:31.648 INFO:tasks.workunit.client.0.smithi003.stdout:0/173: creat d9/d12/d1e/f2e x:0 0 0 2024-09-21T12:20:31.649 INFO:tasks.workunit.client.0.smithi003.stdout:0/174: chown d9/la 52 1 2024-09-21T12:20:31.650 INFO:tasks.workunit.client.1.smithi192.stdout:6/889: dwrite da/d1f/f86 [4194304,4194304] 0 2024-09-21T12:20:31.650 INFO:tasks.workunit.client.1.smithi192.stdout:3/700: creat db/d16/d18/d21/d23/dd2/d2e/f100 x:0 0 0 2024-09-21T12:20:31.652 INFO:tasks.workunit.client.1.smithi192.stdout:9/824: link d5/d8/dc7/dd7/de7/d55/d70/da0/cd0 d5/dc/d64/dbb/d3d/c107 0 2024-09-21T12:20:31.652 INFO:tasks.workunit.client.0.smithi003.stdout:0/175: creat d9/d12/d17/f2f x:0 0 0 2024-09-21T12:20:31.654 INFO:tasks.workunit.client.1.smithi192.stdout:4/720: dwrite d2/db/d3e/d57/f9f [0,4194304] 0 2024-09-21T12:20:31.655 INFO:tasks.workunit.client.0.smithi003.stdout:0/176: mkdir d9/d12/d17/d21/d30 0 2024-09-21T12:20:31.658 INFO:tasks.workunit.client.0.smithi003.stdout:0/177: creat d9/d12/d17/d21/f31 x:0 0 0 2024-09-21T12:20:31.659 INFO:tasks.workunit.client.0.smithi003.stdout:0/178: chown l1 550 1 2024-09-21T12:20:31.659 INFO:tasks.workunit.client.0.smithi003.stdout:1/168: sync 2024-09-21T12:20:31.659 INFO:tasks.workunit.client.0.smithi003.stdout:2/133: sync 2024-09-21T12:20:31.660 INFO:tasks.workunit.client.1.smithi192.stdout:4/721: readlink d2/db/d3e/d57/d32/d4f/l51 0 2024-09-21T12:20:31.660 INFO:tasks.workunit.client.0.smithi003.stdout:1/169: chown d4/d11/d14/c24 465 1 2024-09-21T12:20:31.661 INFO:tasks.workunit.client.1.smithi192.stdout:3/701: chown db/d16/d18/d21/d23/dd2/c6b 1 1 2024-09-21T12:20:31.662 INFO:tasks.workunit.client.0.smithi003.stdout:2/134: mkdir d0/d21/d2f 0 2024-09-21T12:20:31.663 INFO:tasks.workunit.client.0.smithi003.stdout:2/135: write d0/dd/f26 [695014,51533] 0 2024-09-21T12:20:31.664 INFO:tasks.workunit.client.0.smithi003.stdout:0/179: mkdir d9/d12/d1e/d2b/d32 0 2024-09-21T12:20:31.664 INFO:tasks.workunit.client.0.smithi003.stdout:2/136: write d0/fc [4375221,39317] 0 2024-09-21T12:20:31.669 INFO:tasks.workunit.client.1.smithi192.stdout:6/890: dread da/d1f/d48/d7d/d9a/d9e/dbe/fff [0,4194304] 0 2024-09-21T12:20:31.670 INFO:tasks.workunit.client.1.smithi192.stdout:9/825: dread d5/d8/d2c/feb [0,4194304] 0 2024-09-21T12:20:31.671 INFO:tasks.workunit.client.1.smithi192.stdout:9/826: fsync d5/f9d 0 2024-09-21T12:20:31.694 INFO:tasks.workunit.client.0.smithi003.stdout:1/170: rename d4/d11/d14/c24 to d4/dc/c3e 0 2024-09-21T12:20:31.700 INFO:tasks.workunit.client.0.smithi003.stdout:2/137: mkdir d0/d21/d30 0 2024-09-21T12:20:31.704 INFO:tasks.workunit.client.0.smithi003.stdout:2/138: creat d0/dd/d16/f31 x:0 0 0 2024-09-21T12:20:31.706 INFO:tasks.workunit.client.0.smithi003.stdout:1/171: link d4/dc/f28 d4/d11/d14/f3f 0 2024-09-21T12:20:31.707 INFO:tasks.workunit.client.0.smithi003.stdout:1/172: dread - d4/d11/f3d zero size 2024-09-21T12:20:31.708 INFO:tasks.workunit.client.0.smithi003.stdout:0/180: creat d9/d12/f33 x:0 0 0 2024-09-21T12:20:31.709 INFO:tasks.workunit.client.0.smithi003.stdout:2/139: unlink d0/dd/d16/l1f 0 2024-09-21T12:20:31.710 INFO:tasks.workunit.client.0.smithi003.stdout:0/181: truncate d9/d12/d1e/f2e 649685 0 2024-09-21T12:20:31.710 INFO:tasks.workunit.client.0.smithi003.stdout:1/173: symlink d4/d11/l40 0 2024-09-21T12:20:31.711 INFO:tasks.workunit.client.1.smithi192.stdout:3/702: dwrite db/d16/d18/d33/d4a/f52 [0,4194304] 0 2024-09-21T12:20:31.713 INFO:tasks.workunit.client.0.smithi003.stdout:2/140: symlink d0/d21/d2c/l32 0 2024-09-21T12:20:31.716 INFO:tasks.workunit.client.1.smithi192.stdout:6/891: truncate da/d1f/d48/d7d/f102 3286509 0 2024-09-21T12:20:31.716 INFO:tasks.workunit.client.0.smithi003.stdout:0/182: mknod d9/d12/d22/d2d/c34 0 2024-09-21T12:20:31.717 INFO:tasks.workunit.client.1.smithi192.stdout:4/722: dwrite d2/db/d34/d56/d6c/db8/f79 [0,4194304] 0 2024-09-21T12:20:31.720 INFO:tasks.workunit.client.0.smithi003.stdout:0/183: rmdir d9/d12/d1e/d2b 39 2024-09-21T12:20:31.721 INFO:tasks.workunit.client.1.smithi192.stdout:9/827: dread d5/d8/dc7/dd7/de7/f45 [0,4194304] 0 2024-09-21T12:20:31.723 INFO:tasks.workunit.client.1.smithi192.stdout:3/703: dwrite db/d16/db4/d8c/fb9 [0,4194304] 0 2024-09-21T12:20:31.725 INFO:tasks.workunit.client.1.smithi192.stdout:4/723: mknod d2/db/d3e/d57/cf1 0 2024-09-21T12:20:31.725 INFO:tasks.workunit.client.1.smithi192.stdout:3/704: write db/d16/d18/d40/d60/fce [373331,130474] 0 2024-09-21T12:20:31.726 INFO:tasks.workunit.client.0.smithi003.stdout:0/184: creat d9/d12/d1e/d2b/d26/f35 x:0 0 0 2024-09-21T12:20:31.727 INFO:tasks.workunit.client.0.smithi003.stdout:1/174: dread d4/f7 [0,4194304] 0 2024-09-21T12:20:31.728 INFO:tasks.workunit.client.1.smithi192.stdout:4/724: fsync d2/db/d3e/d57/d32/d4f/d71/d9d/dad/d9c/d9e/fc7 0 2024-09-21T12:20:31.729 INFO:tasks.workunit.client.1.smithi192.stdout:3/705: mknod db/d16/d18/d40/d60/d7b/c101 0 2024-09-21T12:20:31.730 INFO:tasks.workunit.client.0.smithi003.stdout:0/185: rmdir d9/d12/d17/d21 39 2024-09-21T12:20:31.732 INFO:tasks.workunit.client.1.smithi192.stdout:6/892: link da/d1f/d27/d6b/f7f da/d1f/d27/d6b/f126 0 2024-09-21T12:20:31.733 INFO:tasks.workunit.client.0.smithi003.stdout:1/175: truncate d4/df/f1a 1952433 0 2024-09-21T12:20:31.734 INFO:tasks.workunit.client.0.smithi003.stdout:1/176: truncate d4/df/f38 652436 0 2024-09-21T12:20:31.735 INFO:tasks.workunit.client.1.smithi192.stdout:6/893: dread da/d23/d37/d75/dd0/f10a [0,4194304] 0 2024-09-21T12:20:31.737 INFO:tasks.workunit.client.0.smithi003.stdout:0/186: creat d9/d12/d17/f36 x:0 0 0 2024-09-21T12:20:31.739 INFO:tasks.workunit.client.0.smithi003.stdout:1/177: unlink d4/d11/f3d 0 2024-09-21T12:20:31.739 INFO:tasks.workunit.client.0.smithi003.stdout:1/178: chown d4/f3c 171 1 2024-09-21T12:20:31.741 INFO:tasks.workunit.client.1.smithi192.stdout:6/894: mkdir da/d23/d37/d75/de2/d104/d127 0 2024-09-21T12:20:31.745 INFO:tasks.workunit.client.0.smithi003.stdout:0/187: mknod d9/c37 0 2024-09-21T12:20:31.746 INFO:tasks.workunit.client.1.smithi192.stdout:6/895: write da/d23/d37/d75/dd0/f10a [349733,38338] 0 2024-09-21T12:20:31.748 INFO:tasks.workunit.client.0.smithi003.stdout:1/179: dwrite d4/f3a [0,4194304] 0 2024-09-21T12:20:31.749 INFO:tasks.workunit.client.1.smithi192.stdout:4/725: getdents d2/db/d3e/d57 0 2024-09-21T12:20:31.751 INFO:tasks.workunit.client.1.smithi192.stdout:9/828: write d5/d8/dc7/dd7/de7/f45 [4354829,96335] 0 2024-09-21T12:20:31.752 INFO:tasks.workunit.client.0.smithi003.stdout:1/180: chown d4/d11/d14/l20 47887 1 2024-09-21T12:20:31.753 INFO:tasks.workunit.client.1.smithi192.stdout:4/726: chown d2/db/l1d 52565 1 2024-09-21T12:20:31.756 INFO:tasks.workunit.client.0.smithi003.stdout:2/141: dwrite d0/dd/f1b [0,4194304] 0 2024-09-21T12:20:31.757 INFO:tasks.workunit.client.1.smithi192.stdout:3/706: dread db/d16/d18/d33/f83 [0,4194304] 0 2024-09-21T12:20:31.758 INFO:tasks.workunit.client.0.smithi003.stdout:2/142: write d0/dd/d22/f23 [413888,84694] 0 2024-09-21T12:20:31.762 INFO:tasks.workunit.client.0.smithi003.stdout:0/188: dwrite d9/d12/d1e/d2b/d26/f35 [0,4194304] 0 2024-09-21T12:20:31.768 INFO:tasks.workunit.client.1.smithi192.stdout:8/813: sync 2024-09-21T12:20:31.769 INFO:tasks.workunit.client.1.smithi192.stdout:8/814: fdatasync d14/d18/f93 0 2024-09-21T12:20:31.771 INFO:tasks.workunit.client.0.smithi003.stdout:1/181: mkdir d4/df/d41 0 2024-09-21T12:20:31.773 INFO:tasks.workunit.client.0.smithi003.stdout:2/143: dwrite d0/dd/f29 [0,4194304] 0 2024-09-21T12:20:31.774 INFO:tasks.workunit.client.1.smithi192.stdout:6/896: getdents da/d1f/d48/d7d/d9a 0 2024-09-21T12:20:31.775 INFO:tasks.workunit.client.1.smithi192.stdout:6/897: readlink da/d1f/d56/lba 0 2024-09-21T12:20:31.778 INFO:tasks.workunit.client.1.smithi192.stdout:9/829: dread d5/dc/d80/d44/f90 [0,4194304] 0 2024-09-21T12:20:31.779 INFO:tasks.workunit.client.0.smithi003.stdout:0/189: mkdir d9/d12/d17/d38 0 2024-09-21T12:20:31.780 INFO:tasks.workunit.client.0.smithi003.stdout:1/182: mkdir d4/d11/d14/d25/d42 0 2024-09-21T12:20:31.781 INFO:tasks.workunit.client.1.smithi192.stdout:9/830: truncate d5/d19/dd5/d4d/d6d/f103 309476 0 2024-09-21T12:20:31.781 INFO:tasks.workunit.client.1.smithi192.stdout:9/831: stat d5/dc 0 2024-09-21T12:20:31.783 INFO:tasks.workunit.client.1.smithi192.stdout:6/898: dwrite da/d1f/d48/d7d/d9a/d9e/dbe/f10e [0,4194304] 0 2024-09-21T12:20:31.784 INFO:tasks.workunit.client.1.smithi192.stdout:9/832: fdatasync d5/d8/d2c/f5d 0 2024-09-21T12:20:31.785 INFO:tasks.workunit.client.1.smithi192.stdout:9/833: write d5/f7 [6818728,48527] 0 2024-09-21T12:20:31.787 INFO:tasks.workunit.client.1.smithi192.stdout:8/815: mknod d14/d1a/c111 0 2024-09-21T12:20:31.789 INFO:tasks.workunit.client.0.smithi003.stdout:0/190: rename d9/d12/d22/f24 to d9/d12/d1e/d2b/d26/f39 0 2024-09-21T12:20:31.790 INFO:tasks.workunit.client.1.smithi192.stdout:4/727: dread d2/db/f6d [0,4194304] 0 2024-09-21T12:20:31.794 INFO:tasks.workunit.client.1.smithi192.stdout:9/834: read d5/d19/dd5/d4d/d6d/fd3 [6232,60767] 0 2024-09-21T12:20:31.797 INFO:tasks.workunit.client.1.smithi192.stdout:4/728: dwrite d2/d21/fc6 [4194304,4194304] 0 2024-09-21T12:20:31.802 INFO:tasks.workunit.client.1.smithi192.stdout:6/899: creat da/d23/d37/d75/d90/f128 x:0 0 0 2024-09-21T12:20:31.806 INFO:tasks.workunit.client.0.smithi003.stdout:1/183: rename d4/df/f1a to d4/dc/f43 0 2024-09-21T12:20:31.806 INFO:tasks.workunit.client.0.smithi003.stdout:1/184: readlink d4/df/d12/l27 0 2024-09-21T12:20:31.808 INFO:tasks.workunit.client.0.smithi003.stdout:0/191: mkdir d9/d12/d17/d38/d3a 0 2024-09-21T12:20:31.813 INFO:tasks.workunit.client.1.smithi192.stdout:9/835: write d5/d8/dc7/dd7/de7/fb1 [3118430,127234] 0 2024-09-21T12:20:31.813 INFO:tasks.workunit.client.0.smithi003.stdout:1/185: mknod d4/df/d19/c44 0 2024-09-21T12:20:31.813 INFO:tasks.workunit.client.0.smithi003.stdout:2/144: dread d0/dd/d16/f19 [0,4194304] 0 2024-09-21T12:20:31.815 INFO:tasks.workunit.client.1.smithi192.stdout:3/707: dwrite db/d16/d18/d40/fa3 [0,4194304] 0 2024-09-21T12:20:31.816 INFO:tasks.workunit.client.1.smithi192.stdout:6/900: creat da/d1f/d27/d3e/f129 x:0 0 0 2024-09-21T12:20:31.816 INFO:tasks.workunit.client.1.smithi192.stdout:6/901: stat da/d1f/d48/d7d 0 2024-09-21T12:20:31.817 INFO:tasks.workunit.client.0.smithi003.stdout:1/186: mknod d4/d11/d14/c45 0 2024-09-21T12:20:31.819 INFO:tasks.workunit.client.0.smithi003.stdout:1/187: dread - d4/df/f31 zero size 2024-09-21T12:20:31.819 INFO:tasks.workunit.client.0.smithi003.stdout:0/192: creat d9/f3b x:0 0 0 2024-09-21T12:20:31.819 INFO:tasks.workunit.client.0.smithi003.stdout:2/145: dread d0/dd/d16/f2d [0,4194304] 0 2024-09-21T12:20:31.827 INFO:tasks.workunit.client.1.smithi192.stdout:4/729: mknod d2/db/cf2 0 2024-09-21T12:20:31.829 INFO:tasks.workunit.client.0.smithi003.stdout:1/188: write d4/dc/f32 [1329718,84473] 0 2024-09-21T12:20:31.829 INFO:tasks.workunit.client.0.smithi003.stdout:1/189: read - d4/df/f31 zero size 2024-09-21T12:20:31.830 INFO:tasks.workunit.client.1.smithi192.stdout:9/836: rename d5/f7 to d5/dc/d64/dbb/df1/f108 0 2024-09-21T12:20:31.831 INFO:tasks.workunit.client.1.smithi192.stdout:9/837: read d5/dc/fa4 [3920306,2977] 0 2024-09-21T12:20:31.832 INFO:tasks.workunit.client.0.smithi003.stdout:1/190: truncate d4/d11/d14/f3f 427456 0 2024-09-21T12:20:31.832 INFO:tasks.workunit.client.1.smithi192.stdout:6/902: symlink da/dfc/l12a 0 2024-09-21T12:20:31.834 INFO:tasks.workunit.client.0.smithi003.stdout:2/146: creat d0/dd/d16/f33 x:0 0 0 2024-09-21T12:20:31.834 INFO:tasks.workunit.client.1.smithi192.stdout:9/838: truncate d5/d8/dc7/dd7/de7/d55/d70/da0/ff0 700119 0 2024-09-21T12:20:31.835 INFO:tasks.workunit.client.1.smithi192.stdout:8/816: dwrite d14/d18/d94/dc3/fcc [0,4194304] 0 2024-09-21T12:20:31.836 INFO:tasks.workunit.client.1.smithi192.stdout:9/839: write d5/dc/fa4 [952521,111173] 0 2024-09-21T12:20:31.838 INFO:tasks.workunit.client.0.smithi003.stdout:1/191: dwrite d4/dc/f1c [0,4194304] 0 2024-09-21T12:20:31.845 INFO:tasks.workunit.client.0.smithi003.stdout:8/178: sync 2024-09-21T12:20:31.845 INFO:tasks.workunit.client.0.smithi003.stdout:9/310: sync 2024-09-21T12:20:31.846 INFO:tasks.workunit.client.0.smithi003.stdout:0/193: link d9/d12/d1e/d2b/d26/f39 d9/d12/d1e/d2b/d26/f3c 0 2024-09-21T12:20:31.847 INFO:tasks.workunit.client.0.smithi003.stdout:0/194: chown d9/d12/d1e 2 1 2024-09-21T12:20:31.854 INFO:tasks.workunit.client.0.smithi003.stdout:9/311: creat d2/d29/f70 x:0 0 0 2024-09-21T12:20:31.855 INFO:tasks.workunit.client.1.smithi192.stdout:9/840: mknod d5/dc/c109 0 2024-09-21T12:20:31.855 INFO:tasks.workunit.client.0.smithi003.stdout:2/147: write d0/ff [2474894,63285] 0 2024-09-21T12:20:31.856 INFO:tasks.workunit.client.1.smithi192.stdout:9/841: write d5/dc/d80/d5a/f9e [597239,93665] 0 2024-09-21T12:20:31.856 INFO:tasks.workunit.client.0.smithi003.stdout:2/148: chown d0/d1c/l2b 17714006 1 2024-09-21T12:20:31.857 INFO:tasks.workunit.client.0.smithi003.stdout:8/179: creat d7/df/d20/d21/f3f x:0 0 0 2024-09-21T12:20:31.860 INFO:tasks.workunit.client.0.smithi003.stdout:8/180: truncate d7/df/d20/f35 23378 0 2024-09-21T12:20:31.862 INFO:tasks.workunit.client.0.smithi003.stdout:2/149: dread d0/dd/f26 [0,4194304] 0 2024-09-21T12:20:31.864 INFO:tasks.workunit.client.1.smithi192.stdout:6/903: dwrite da/d23/d37/f8e [4194304,4194304] 0 2024-09-21T12:20:31.866 INFO:tasks.workunit.client.1.smithi192.stdout:2/748: sync 2024-09-21T12:20:31.866 INFO:tasks.workunit.client.1.smithi192.stdout:7/739: sync 2024-09-21T12:20:31.866 INFO:tasks.workunit.client.1.smithi192.stdout:1/779: sync 2024-09-21T12:20:31.866 INFO:tasks.workunit.client.1.smithi192.stdout:0/806: sync 2024-09-21T12:20:31.867 INFO:tasks.workunit.client.1.smithi192.stdout:6/904: chown da/d1f/d48/d7d/d9a/d9e/dbe/dce 1363 1 2024-09-21T12:20:31.867 INFO:tasks.workunit.client.1.smithi192.stdout:3/708: rename db/d16/c37 to db/c102 0 2024-09-21T12:20:31.867 INFO:tasks.workunit.client.1.smithi192.stdout:4/730: getdents d2/db/d34/d56/d83/d93 0 2024-09-21T12:20:31.868 INFO:tasks.workunit.client.1.smithi192.stdout:6/905: write da/d23/f52 [4822336,19530] 0 2024-09-21T12:20:31.869 INFO:tasks.workunit.client.1.smithi192.stdout:1/780: fdatasync d2/d12/d2f/d51/d24/d65/d8b/dd5/fee 0 2024-09-21T12:20:31.870 INFO:tasks.workunit.client.0.smithi003.stdout:1/192: dwrite d4/dc/f28 [0,4194304] 0 2024-09-21T12:20:31.870 INFO:tasks.workunit.client.1.smithi192.stdout:0/807: creat d3/d5/dd7/ff1 x:0 0 0 2024-09-21T12:20:31.873 INFO:tasks.workunit.client.0.smithi003.stdout:0/195: mknod d9/d12/d17/d21/d30/c3d 0 2024-09-21T12:20:31.880 INFO:tasks.workunit.client.0.smithi003.stdout:9/312: dread d2/da/f14 [0,4194304] 0 2024-09-21T12:20:31.881 INFO:tasks.workunit.client.0.smithi003.stdout:2/150: link d0/f18 d0/d1c/f34 0 2024-09-21T12:20:31.881 INFO:tasks.workunit.client.0.smithi003.stdout:9/313: chown d2/da/d35/d4d/c62 113863 1 2024-09-21T12:20:31.882 INFO:tasks.workunit.client.0.smithi003.stdout:1/193: creat d4/df/d12/f46 x:0 0 0 2024-09-21T12:20:31.883 INFO:tasks.workunit.client.0.smithi003.stdout:0/196: creat d9/d12/d1e/d2b/d26/f3e x:0 0 0 2024-09-21T12:20:31.883 INFO:tasks.workunit.client.0.smithi003.stdout:1/194: chown d4/dc/f32 260852 1 2024-09-21T12:20:31.884 INFO:tasks.workunit.client.0.smithi003.stdout:0/197: write f4 [2301882,111033] 0 2024-09-21T12:20:31.884 INFO:tasks.workunit.client.0.smithi003.stdout:2/151: creat d0/d21/f35 x:0 0 0 2024-09-21T12:20:31.886 INFO:tasks.workunit.client.1.smithi192.stdout:8/817: rename d14/d1a/d1d/db4/cde to d14/d18/daf/ddd/c112 0 2024-09-21T12:20:31.886 INFO:tasks.workunit.client.0.smithi003.stdout:2/152: chown d0/dd/f1b 2111477 1 2024-09-21T12:20:31.887 INFO:tasks.workunit.client.1.smithi192.stdout:3/709: mknod db/d16/d18/d21/d23/d71/c103 0 2024-09-21T12:20:31.887 INFO:tasks.workunit.client.1.smithi192.stdout:1/781: dread - d2/d12/d2f/d51/d24/d65/d8e/d9d/db6/fdc zero size 2024-09-21T12:20:31.888 INFO:tasks.workunit.client.0.smithi003.stdout:9/314: creat d2/d20/f71 x:0 0 0 2024-09-21T12:20:31.889 INFO:tasks.workunit.client.0.smithi003.stdout:9/315: chown d2/d20/d22/d3f/l6a 2355933 1 2024-09-21T12:20:31.892 INFO:tasks.workunit.client.1.smithi192.stdout:6/906: symlink da/l12b 0 2024-09-21T12:20:31.894 INFO:tasks.workunit.client.1.smithi192.stdout:1/782: readlink d2/da/d89/l8d 0 2024-09-21T12:20:31.895 INFO:tasks.workunit.client.0.smithi003.stdout:2/153: link d0/d21/f35 d0/f36 0 2024-09-21T12:20:31.896 INFO:tasks.workunit.client.1.smithi192.stdout:3/710: dwrite db/d16/d18/d21/d23/d71/fdb [0,4194304] 0 2024-09-21T12:20:31.896 INFO:tasks.workunit.client.1.smithi192.stdout:1/783: chown d2/d12/d2f/d51/f37 10022 1 2024-09-21T12:20:31.897 INFO:tasks.workunit.client.1.smithi192.stdout:1/784: stat d2/d12/d2f/d51/lbb 0 2024-09-21T12:20:31.898 INFO:tasks.workunit.client.0.smithi003.stdout:9/316: symlink d2/d20/d22/d5e/l72 0 2024-09-21T12:20:31.900 INFO:tasks.workunit.client.1.smithi192.stdout:4/731: dread d2/db/d1a/dee/fa3 [0,4194304] 0 2024-09-21T12:20:31.901 INFO:tasks.workunit.client.1.smithi192.stdout:9/842: rename d5/d19/f6b to d5/dc/dc2/f10a 0 2024-09-21T12:20:31.902 INFO:tasks.workunit.client.0.smithi003.stdout:5/191: sync 2024-09-21T12:20:31.902 INFO:tasks.workunit.client.0.smithi003.stdout:7/167: sync 2024-09-21T12:20:31.902 INFO:tasks.workunit.client.0.smithi003.stdout:4/173: sync 2024-09-21T12:20:31.902 INFO:tasks.workunit.client.0.smithi003.stdout:6/184: sync 2024-09-21T12:20:31.902 INFO:tasks.workunit.client.0.smithi003.stdout:3/146: sync 2024-09-21T12:20:31.905 INFO:tasks.workunit.client.0.smithi003.stdout:1/195: link d4/d11/d14/c45 d4/d11/d14/d25/d42/c47 0 2024-09-21T12:20:31.906 INFO:tasks.workunit.client.1.smithi192.stdout:9/843: dwrite d5/d8/dc7/dd7/de7/fb0 [0,4194304] 0 2024-09-21T12:20:31.908 INFO:tasks.workunit.client.0.smithi003.stdout:9/317: rename d2/l1c to d2/da/d17/l73 0 2024-09-21T12:20:31.912 INFO:tasks.workunit.client.1.smithi192.stdout:9/844: truncate d5/dc/d64/fe1 951242 0 2024-09-21T12:20:31.912 INFO:tasks.workunit.client.0.smithi003.stdout:9/318: read d2/f10 [863783,80660] 0 2024-09-21T12:20:31.913 INFO:tasks.workunit.client.1.smithi192.stdout:9/845: stat d5/d19/l24 0 2024-09-21T12:20:31.913 INFO:tasks.workunit.client.0.smithi003.stdout:7/168: creat d8/d2c/f40 x:0 0 0 2024-09-21T12:20:31.914 INFO:tasks.workunit.client.1.smithi192.stdout:6/907: creat da/d23/d37/d75/de2/d104/f12c x:0 0 0 2024-09-21T12:20:31.914 INFO:tasks.workunit.client.0.smithi003.stdout:8/181: truncate f1 4384898 0 2024-09-21T12:20:31.915 INFO:tasks.workunit.client.1.smithi192.stdout:2/749: dwrite d1b/d1e/d62/f7f [0,4194304] 0 2024-09-21T12:20:31.915 INFO:tasks.workunit.client.0.smithi003.stdout:7/169: write d8/f9 [5258931,63046] 0 2024-09-21T12:20:31.918 INFO:tasks.workunit.client.0.smithi003.stdout:7/170: chown d8/db/f1c 1 1 2024-09-21T12:20:31.920 INFO:tasks.workunit.client.0.smithi003.stdout:6/185: unlink d4/fb 0 2024-09-21T12:20:31.922 INFO:tasks.workunit.client.1.smithi192.stdout:3/711: creat db/d16/d18/d21/d23/dd2/d2e/f104 x:0 0 0 2024-09-21T12:20:31.925 INFO:tasks.workunit.client.0.smithi003.stdout:4/174: dwrite d9/da/f22 [0,4194304] 0 2024-09-21T12:20:31.925 INFO:tasks.workunit.client.0.smithi003.stdout:5/192: creat dc/d15/d1c/f3e x:0 0 0 2024-09-21T12:20:31.928 INFO:tasks.workunit.client.1.smithi192.stdout:1/785: rename d2/d12/d2f/d51/d24/d65/d8e/d9d/db6/ffc to d2/da/d6b/d7d/ffe 0 2024-09-21T12:20:31.929 INFO:tasks.workunit.client.0.smithi003.stdout:5/193: chown dc/d15/d1c/f3e 57162135 1 2024-09-21T12:20:31.929 INFO:tasks.workunit.client.1.smithi192.stdout:1/786: chown d2/d12/d2f/d51/d24/d65/d5a/lda 4095 1 2024-09-21T12:20:31.930 INFO:tasks.workunit.client.0.smithi003.stdout:0/198: dwrite d9/d12/f13 [0,4194304] 0 2024-09-21T12:20:31.933 INFO:tasks.workunit.client.1.smithi192.stdout:4/732: dread d2/db/d3e/d57/d32/d4f/d82/fa1 [0,4194304] 0 2024-09-21T12:20:31.933 INFO:tasks.workunit.client.1.smithi192.stdout:4/733: chown d2/db/d1a 174574 1 2024-09-21T12:20:31.935 INFO:tasks.workunit.client.1.smithi192.stdout:0/808: write d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/dc6/d83/d87/faa [53133,110680] 0 2024-09-21T12:20:31.938 INFO:tasks.workunit.client.1.smithi192.stdout:9/846: mknod d5/dc/c10b 0 2024-09-21T12:20:31.939 INFO:tasks.workunit.client.0.smithi003.stdout:8/182: mknod d7/c40 0 2024-09-21T12:20:31.939 INFO:tasks.workunit.client.1.smithi192.stdout:8/818: truncate fc 8286406 0 2024-09-21T12:20:31.940 INFO:tasks.workunit.client.1.smithi192.stdout:9/847: chown d5/d8/d2c/feb 1 1 2024-09-21T12:20:31.940 INFO:tasks.workunit.client.0.smithi003.stdout:8/183: readlink d7/l2d 0 2024-09-21T12:20:31.943 INFO:tasks.workunit.client.0.smithi003.stdout:7/171: mkdir d8/d31/d41 0 2024-09-21T12:20:31.943 INFO:tasks.workunit.client.0.smithi003.stdout:7/172: chown d8/c14 440552 1 2024-09-21T12:20:31.944 INFO:tasks.workunit.client.1.smithi192.stdout:2/750: mknod d1b/d1e/d5e/d88/d95/d9c/cf3 0 2024-09-21T12:20:31.945 INFO:tasks.workunit.client.1.smithi192.stdout:6/908: dread da/d1f/d27/d88/f8d [0,4194304] 0 2024-09-21T12:20:31.947 INFO:tasks.workunit.client.1.smithi192.stdout:3/712: chown db/d16/d18/c57 15620647 1 2024-09-21T12:20:31.948 INFO:tasks.workunit.client.1.smithi192.stdout:3/713: write db/d16/d18/d21/fe9 [23127,21340] 0 2024-09-21T12:20:31.949 INFO:tasks.workunit.client.0.smithi003.stdout:6/186: creat d4/d13/f35 x:0 0 0 2024-09-21T12:20:31.951 INFO:tasks.workunit.client.0.smithi003.stdout:9/319: dread d2/f2b [0,4194304] 0 2024-09-21T12:20:31.952 INFO:tasks.workunit.client.1.smithi192.stdout:3/714: dread db/d16/d18/d33/f83 [0,4194304] 0 2024-09-21T12:20:31.953 INFO:tasks.workunit.client.0.smithi003.stdout:1/196: mknod d4/df/d41/c48 0 2024-09-21T12:20:31.953 INFO:tasks.workunit.client.0.smithi003.stdout:9/320: chown d2/da/d17/l52 6 1 2024-09-21T12:20:31.955 INFO:tasks.workunit.client.0.smithi003.stdout:4/175: creat d9/f3a x:0 0 0 2024-09-21T12:20:31.957 INFO:tasks.workunit.client.1.smithi192.stdout:4/734: truncate d2/df/f5d 2941390 0 2024-09-21T12:20:31.959 INFO:tasks.workunit.client.0.smithi003.stdout:3/147: creat d0/f27 x:0 0 0 2024-09-21T12:20:31.960 INFO:tasks.workunit.client.1.smithi192.stdout:0/809: rename d3/d5/d28/d39/d50/dd9/d7a/dbe/d89/f9d to d3/d5/d28/d39/d50/dd9/d7a/dbe/ff2 0 2024-09-21T12:20:31.961 INFO:tasks.workunit.client.0.smithi003.stdout:3/148: fsync d0/f19 0 2024-09-21T12:20:31.962 INFO:tasks.workunit.client.0.smithi003.stdout:9/321: dwrite d2/da/d17/d40/f44 [0,4194304] 0 2024-09-21T12:20:31.963 INFO:tasks.workunit.client.0.smithi003.stdout:1/197: dwrite d4/df/f21 [0,4194304] 0 2024-09-21T12:20:31.963 INFO:tasks.workunit.client.0.smithi003.stdout:3/149: readlink d0/d5/da/l25 0 2024-09-21T12:20:31.964 INFO:tasks.workunit.client.0.smithi003.stdout:3/150: readlink d0/l7 0 2024-09-21T12:20:31.969 INFO:tasks.workunit.client.1.smithi192.stdout:2/751: symlink d1b/d1e/d5e/d75/d8d/lf4 0 2024-09-21T12:20:31.970 INFO:tasks.workunit.client.0.smithi003.stdout:1/198: dread d4/df/f21 [0,4194304] 0 2024-09-21T12:20:31.972 INFO:tasks.workunit.client.1.smithi192.stdout:6/909: mknod da/d1f/d48/d7d/d9a/c12d 0 2024-09-21T12:20:31.973 INFO:tasks.workunit.client.0.smithi003.stdout:7/173: rmdir d8/db 39 2024-09-21T12:20:31.974 INFO:tasks.workunit.client.0.smithi003.stdout:2/154: dread d0/dd/d16/f19 [0,4194304] 0 2024-09-21T12:20:31.974 INFO:tasks.workunit.client.1.smithi192.stdout:7/740: sync 2024-09-21T12:20:31.977 INFO:tasks.workunit.client.1.smithi192.stdout:4/735: mknod d2/db/d3e/cf3 0 2024-09-21T12:20:31.978 INFO:tasks.workunit.client.0.smithi003.stdout:6/187: mkdir d4/d11/d1d/d36 0 2024-09-21T12:20:31.979 INFO:tasks.workunit.client.0.smithi003.stdout:8/184: dwrite d7/de/f3b [0,4194304] 0 2024-09-21T12:20:31.982 INFO:tasks.workunit.client.0.smithi003.stdout:8/185: chown d7/de/d11/c2f 69620 1 2024-09-21T12:20:31.986 INFO:tasks.workunit.client.0.smithi003.stdout:8/186: dread d7/de/f19 [0,4194304] 0 2024-09-21T12:20:31.986 INFO:tasks.workunit.client.1.smithi192.stdout:9/848: mknod d5/c10c 0 2024-09-21T12:20:31.987 INFO:tasks.workunit.client.1.smithi192.stdout:9/849: write d5/f100 [681668,18154] 0 2024-09-21T12:20:31.992 INFO:tasks.workunit.client.0.smithi003.stdout:9/322: mknod d2/d20/d22/d5e/c74 0 2024-09-21T12:20:31.993 INFO:tasks.workunit.client.1.smithi192.stdout:6/910: mknod da/d1f/d27/d88/c12e 0 2024-09-21T12:20:31.995 INFO:tasks.workunit.client.0.smithi003.stdout:3/151: rename d0/d5/d9 to d0/d5/da/d28 0 2024-09-21T12:20:31.995 INFO:tasks.workunit.client.1.smithi192.stdout:2/752: dread d1b/f5b [0,4194304] 0 2024-09-21T12:20:31.996 INFO:tasks.workunit.client.1.smithi192.stdout:7/741: mknod d6/d3a/dba/c104 0 2024-09-21T12:20:31.996 INFO:tasks.workunit.client.0.smithi003.stdout:3/152: stat d0/c1 0 2024-09-21T12:20:31.998 INFO:tasks.workunit.client.0.smithi003.stdout:1/199: mkdir d4/d11/d49 0 2024-09-21T12:20:32.000 INFO:tasks.workunit.client.1.smithi192.stdout:0/810: truncate d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/d43/f9a 2175782 0 2024-09-21T12:20:32.000 INFO:tasks.workunit.client.0.smithi003.stdout:1/200: readlink d4/d11/d14/l20 0 2024-09-21T12:20:32.002 INFO:tasks.workunit.client.1.smithi192.stdout:0/811: write d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/d9b/fe5 [340215,103075] 0 2024-09-21T12:20:32.004 INFO:tasks.workunit.client.1.smithi192.stdout:0/812: readlink d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/dc6/d83/dc9/ldf 0 2024-09-21T12:20:32.005 INFO:tasks.workunit.client.0.smithi003.stdout:3/153: dwrite d0/f16 [4194304,4194304] 0 2024-09-21T12:20:32.007 INFO:tasks.workunit.client.0.smithi003.stdout:4/176: fsync d9/d16/f26 0 2024-09-21T12:20:32.008 INFO:tasks.workunit.client.1.smithi192.stdout:6/911: mkdir da/d1f/de6/d12f 0 2024-09-21T12:20:32.010 INFO:tasks.workunit.client.0.smithi003.stdout:9/323: mkdir d2/d53/d75 0 2024-09-21T12:20:32.010 INFO:tasks.workunit.client.1.smithi192.stdout:1/787: getdents d2/d12/d2f/d51/d24/d65/d8e/d9d/db6 0 2024-09-21T12:20:32.011 INFO:tasks.workunit.client.0.smithi003.stdout:2/155: dwrite d0/dd/d16/f19 [0,4194304] 0 2024-09-21T12:20:32.012 INFO:tasks.workunit.client.1.smithi192.stdout:1/788: write d2/d12/d2f/ff6 [998931,121556] 0 2024-09-21T12:20:32.017 INFO:tasks.workunit.client.0.smithi003.stdout:6/188: rename d4/d11/d1f to d4/d13/d2e/d37 0 2024-09-21T12:20:32.017 INFO:tasks.workunit.client.0.smithi003.stdout:5/194: truncate dc/f3a 329215 0 2024-09-21T12:20:32.019 INFO:tasks.workunit.client.0.smithi003.stdout:3/154: dwrite d0/f16 [4194304,4194304] 0 2024-09-21T12:20:32.022 INFO:tasks.workunit.client.0.smithi003.stdout:3/155: fdatasync d0/d5/f10 0 2024-09-21T12:20:32.022 INFO:tasks.workunit.client.1.smithi192.stdout:3/715: rename db/d16/d18/d40/d60/d7b/cdd to db/c105 0 2024-09-21T12:20:32.023 INFO:tasks.workunit.client.0.smithi003.stdout:0/199: link c7 d9/d12/d1e/d2b/d32/c3f 0 2024-09-21T12:20:32.025 INFO:tasks.workunit.client.0.smithi003.stdout:6/189: dread d4/f10 [0,4194304] 0 2024-09-21T12:20:32.025 INFO:tasks.workunit.client.1.smithi192.stdout:7/742: truncate d6/d9/f5b 2235095 0 2024-09-21T12:20:32.026 INFO:tasks.workunit.client.0.smithi003.stdout:7/174: getdents d8/d31/d41 0 2024-09-21T12:20:32.029 INFO:tasks.workunit.client.0.smithi003.stdout:1/201: creat d4/d11/f4a x:0 0 0 2024-09-21T12:20:32.030 INFO:tasks.workunit.client.0.smithi003.stdout:1/202: dread - d4/dc/f35 zero size 2024-09-21T12:20:32.030 INFO:tasks.workunit.client.1.smithi192.stdout:8/819: getdents d14/d1a/d1d/d48/de2 0 2024-09-21T12:20:32.032 INFO:tasks.workunit.client.1.smithi192.stdout:2/753: dread d1b/d1e/f31 [0,4194304] 0 2024-09-21T12:20:32.033 INFO:tasks.workunit.client.1.smithi192.stdout:0/813: mknod d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/d43/cf3 0 2024-09-21T12:20:32.033 INFO:tasks.workunit.client.1.smithi192.stdout:9/850: write d5/dc/d40/dad/d53/d6e/f85 [1275803,92634] 0 2024-09-21T12:20:32.035 INFO:tasks.workunit.client.1.smithi192.stdout:0/814: chown d3/d5/d28/d39/d50/dd9/d7a 455315 1 2024-09-21T12:20:32.036 INFO:tasks.workunit.client.0.smithi003.stdout:2/156: readlink d0/d1c/l2b 0 2024-09-21T12:20:32.037 INFO:tasks.workunit.client.1.smithi192.stdout:8/820: dwrite d14/d1a/d1d/d48/de2/f101 [0,4194304] 0 2024-09-21T12:20:32.038 INFO:tasks.workunit.client.0.smithi003.stdout:9/324: write d2/d29/f60 [969663,10786] 0 2024-09-21T12:20:32.039 INFO:tasks.workunit.client.0.smithi003.stdout:9/325: chown d2/d20/d42/l58 9 1 2024-09-21T12:20:32.040 INFO:tasks.workunit.client.0.smithi003.stdout:5/195: truncate dc/f1a 787412 0 2024-09-21T12:20:32.042 INFO:tasks.workunit.client.0.smithi003.stdout:5/196: write dc/d15/d21/f24 [420436,38259] 0 2024-09-21T12:20:32.043 INFO:tasks.workunit.client.1.smithi192.stdout:2/754: dwrite d1b/d1e/d3d/f5a [0,4194304] 0 2024-09-21T12:20:32.045 INFO:tasks.workunit.client.1.smithi192.stdout:6/912: creat da/d1f/de6/d12f/f130 x:0 0 0 2024-09-21T12:20:32.047 INFO:tasks.workunit.client.0.smithi003.stdout:0/200: creat d9/d12/d17/d21/f40 x:0 0 0 2024-09-21T12:20:32.048 INFO:tasks.workunit.client.1.smithi192.stdout:8/821: dwrite d14/d18/d7b/f105 [0,4194304] 0 2024-09-21T12:20:32.050 INFO:tasks.workunit.client.1.smithi192.stdout:7/743: link d6/d9/d2d/dc4/fef d6/d9/d70/d77/dcd/deb/f105 0 2024-09-21T12:20:32.050 INFO:tasks.workunit.client.1.smithi192.stdout:2/755: truncate d1b/d38/d53/d8b/da7/dbb/fc3 476317 0 2024-09-21T12:20:32.051 INFO:tasks.workunit.client.0.smithi003.stdout:6/190: mkdir d4/d13/d19/d38 0 2024-09-21T12:20:32.053 INFO:tasks.workunit.client.1.smithi192.stdout:2/756: truncate d1b/d1e/d3d/f5a 5385956 0 2024-09-21T12:20:32.053 INFO:tasks.workunit.client.0.smithi003.stdout:7/175: mknod d8/d31/c42 0 2024-09-21T12:20:32.053 INFO:tasks.workunit.client.1.smithi192.stdout:7/744: truncate d6/d9/d1f/d3e/d7a/fc8 874137 0 2024-09-21T12:20:32.054 INFO:tasks.workunit.client.1.smithi192.stdout:1/789: truncate d2/da/f31 776218 0 2024-09-21T12:20:32.054 INFO:tasks.workunit.client.1.smithi192.stdout:7/745: chown d6/f15 2 1 2024-09-21T12:20:32.057 INFO:tasks.workunit.client.0.smithi003.stdout:4/177: chown d9/da/f31 8176888 1 2024-09-21T12:20:32.063 INFO:tasks.workunit.client.0.smithi003.stdout:2/157: mkdir d0/dd/d22/d37 0 2024-09-21T12:20:32.070 INFO:tasks.workunit.client.1.smithi192.stdout:0/815: unlink d3/d5/d69/lb3 0 2024-09-21T12:20:32.071 INFO:tasks.workunit.client.0.smithi003.stdout:9/326: unlink d2/d20/l24 0 2024-09-21T12:20:32.073 INFO:tasks.workunit.client.1.smithi192.stdout:8/822: symlink d14/d1a/d1d/d46/d4e/d83/d8d/d9c/dee/d80/l113 0 2024-09-21T12:20:32.082 INFO:tasks.workunit.client.1.smithi192.stdout:6/913: mknod da/d1f/d48/d7d/c131 0 2024-09-21T12:20:32.083 INFO:tasks.workunit.client.0.smithi003.stdout:1/203: creat d4/d11/d49/f4b x:0 0 0 2024-09-21T12:20:32.084 INFO:tasks.workunit.client.1.smithi192.stdout:0/816: read d3/d5/fa5 [387156,105348] 0 2024-09-21T12:20:32.084 INFO:tasks.workunit.client.0.smithi003.stdout:1/204: write d4/dc/f10 [5035242,130470] 0 2024-09-21T12:20:32.086 INFO:tasks.workunit.client.1.smithi192.stdout:8/823: creat d14/d18/d94/f114 x:0 0 0 2024-09-21T12:20:32.086 INFO:tasks.workunit.client.1.smithi192.stdout:8/824: fdatasync d14/d1a/d1d/d46/fdb 0 2024-09-21T12:20:32.087 INFO:tasks.workunit.client.0.smithi003.stdout:6/191: symlink d4/d13/d2e/l39 0 2024-09-21T12:20:32.088 INFO:tasks.workunit.client.0.smithi003.stdout:8/187: getdents d7/df/d36 0 2024-09-21T12:20:32.089 INFO:tasks.workunit.client.0.smithi003.stdout:8/188: chown d7/df/c34 4982786 1 2024-09-21T12:20:32.090 INFO:tasks.workunit.client.1.smithi192.stdout:9/851: getdents d5/dc 0 2024-09-21T12:20:32.093 INFO:tasks.workunit.client.0.smithi003.stdout:4/178: creat d9/d16/f3b x:0 0 0 2024-09-21T12:20:32.097 INFO:tasks.workunit.client.0.smithi003.stdout:6/192: dwrite d4/d13/d19/f26 [0,4194304] 0 2024-09-21T12:20:32.097 INFO:tasks.workunit.client.0.smithi003.stdout:4/179: write d9/d16/f2e [2906632,86824] 0 2024-09-21T12:20:32.099 INFO:tasks.workunit.client.0.smithi003.stdout:9/327: mkdir d2/da/d35/d76 0 2024-09-21T12:20:32.103 INFO:tasks.workunit.client.0.smithi003.stdout:6/193: fsync d4/f5 0 2024-09-21T12:20:32.104 INFO:tasks.workunit.client.0.smithi003.stdout:8/189: dwrite d7/df/d20/f35 [0,4194304] 0 2024-09-21T12:20:32.105 INFO:tasks.workunit.client.0.smithi003.stdout:6/194: write d4/fc [9203396,85160] 0 2024-09-21T12:20:32.106 INFO:tasks.workunit.client.1.smithi192.stdout:0/817: creat d3/d5/d69/db2/ff4 x:0 0 0 2024-09-21T12:20:32.106 INFO:tasks.workunit.client.0.smithi003.stdout:8/190: chown d7/df/d36/c38 0 1 2024-09-21T12:20:32.107 INFO:tasks.workunit.client.0.smithi003.stdout:0/201: mknod d9/d12/d17/d38/d3a/c41 0 2024-09-21T12:20:32.110 INFO:tasks.workunit.client.1.smithi192.stdout:8/825: rename d14/d1a/d1d/d48/dac to d14/d1a/d1d/d39/d115 0 2024-09-21T12:20:32.111 INFO:tasks.workunit.client.0.smithi003.stdout:7/176: mkdir d8/db/d32/d43 0 2024-09-21T12:20:32.112 INFO:tasks.workunit.client.0.smithi003.stdout:3/156: truncate d0/d5/f1e 3089717 0 2024-09-21T12:20:32.114 INFO:tasks.workunit.client.1.smithi192.stdout:1/790: write d2/da/d6b/dc8/f69 [735680,53804] 0 2024-09-21T12:20:32.115 INFO:tasks.workunit.client.1.smithi192.stdout:1/791: fdatasync d2/d4d/fb8 0 2024-09-21T12:20:32.120 INFO:tasks.workunit.client.1.smithi192.stdout:7/746: dwrite d6/d3a/d6d/f78 [4194304,4194304] 0 2024-09-21T12:20:32.123 INFO:tasks.workunit.client.0.smithi003.stdout:4/180: read d9/fc [104935,28070] 0 2024-09-21T12:20:32.124 INFO:tasks.workunit.client.0.smithi003.stdout:5/197: truncate dc/d15/d26/f2d 2689002 0 2024-09-21T12:20:32.127 INFO:tasks.workunit.client.1.smithi192.stdout:8/826: creat d14/d1a/f116 x:0 0 0 2024-09-21T12:20:32.127 INFO:tasks.workunit.client.1.smithi192.stdout:2/757: link d1b/f45 d1b/d9e/ff5 0 2024-09-21T12:20:32.128 INFO:tasks.workunit.client.1.smithi192.stdout:8/827: fdatasync d14/d18/f28 0 2024-09-21T12:20:32.129 INFO:tasks.workunit.client.1.smithi192.stdout:8/828: truncate d14/d1a/f116 742927 0 2024-09-21T12:20:32.129 INFO:tasks.workunit.client.0.smithi003.stdout:6/195: symlink d4/d11/d1d/l3a 0 2024-09-21T12:20:32.130 INFO:tasks.workunit.client.1.smithi192.stdout:8/829: stat d14/d1a/d82/de0/l104 0 2024-09-21T12:20:32.131 INFO:tasks.workunit.client.0.smithi003.stdout:6/196: write d4/f5 [8118103,21532] 0 2024-09-21T12:20:32.132 INFO:tasks.workunit.client.1.smithi192.stdout:1/792: unlink d2/d12/f2e 0 2024-09-21T12:20:32.133 INFO:tasks.workunit.client.0.smithi003.stdout:6/197: fdatasync d4/f21 0 2024-09-21T12:20:32.134 INFO:tasks.workunit.client.1.smithi192.stdout:4/736: sync 2024-09-21T12:20:32.135 INFO:tasks.workunit.client.1.smithi192.stdout:6/914: rmdir da/d23/d37/d75/de2/d104/d127 0 2024-09-21T12:20:32.136 INFO:tasks.workunit.client.0.smithi003.stdout:5/198: dwrite dc/d15/d26/f2e [0,4194304] 0 2024-09-21T12:20:32.136 INFO:tasks.workunit.client.1.smithi192.stdout:4/737: write d2/db/d34/d56/d6c/db8/f79 [1698971,36661] 0 2024-09-21T12:20:32.137 INFO:tasks.workunit.client.1.smithi192.stdout:4/738: write d2/db/d1a/dee/f69 [5102396,85413] 0 2024-09-21T12:20:32.137 INFO:tasks.workunit.client.0.smithi003.stdout:8/191: dread d7/de/f19 [0,4194304] 0 2024-09-21T12:20:32.140 INFO:tasks.workunit.client.0.smithi003.stdout:7/177: creat d8/db/d13/f44 x:0 0 0 2024-09-21T12:20:32.141 INFO:tasks.workunit.client.0.smithi003.stdout:8/192: truncate d7/de/d1a/f3c 414053 0 2024-09-21T12:20:32.143 INFO:tasks.workunit.client.0.smithi003.stdout:7/178: truncate d8/db/d13/f33 945412 0 2024-09-21T12:20:32.143 INFO:tasks.workunit.client.1.smithi192.stdout:4/739: fdatasync d2/db/d34/d56/d6c/db8/f79 0 2024-09-21T12:20:32.145 INFO:tasks.workunit.client.0.smithi003.stdout:8/193: write d7/df/d36/f3d [33950,107690] 0 2024-09-21T12:20:32.145 INFO:tasks.workunit.client.0.smithi003.stdout:5/199: dread dc/d15/d26/f2e [0,4194304] 0 2024-09-21T12:20:32.145 INFO:tasks.workunit.client.1.smithi192.stdout:7/747: rename d6/d9/d51/c6c to d6/d9/d70/d77/dcd/deb/c106 0 2024-09-21T12:20:32.146 INFO:tasks.workunit.client.0.smithi003.stdout:7/179: write d8/d2c/f2a [212854,8387] 0 2024-09-21T12:20:32.148 INFO:tasks.workunit.client.0.smithi003.stdout:7/180: write d8/db/f20 [1669390,13445] 0 2024-09-21T12:20:32.154 INFO:tasks.workunit.client.0.smithi003.stdout:2/158: creat d0/d21/d2f/f38 x:0 0 0 2024-09-21T12:20:32.155 INFO:tasks.workunit.client.0.smithi003.stdout:7/181: dwrite d8/f9 [4194304,4194304] 0 2024-09-21T12:20:32.155 INFO:tasks.workunit.client.1.smithi192.stdout:2/758: chown d1b/d38/d53/l90 4598437 1 2024-09-21T12:20:32.156 INFO:tasks.workunit.client.0.smithi003.stdout:4/181: mknod d9/da/d36/c3c 0 2024-09-21T12:20:32.158 INFO:tasks.workunit.client.1.smithi192.stdout:9/852: creat d5/d19/dd5/f10d x:0 0 0 2024-09-21T12:20:32.161 INFO:tasks.workunit.client.0.smithi003.stdout:4/182: dread d9/d16/f28 [0,4194304] 0 2024-09-21T12:20:32.161 INFO:tasks.workunit.client.0.smithi003.stdout:0/202: write d9/d12/d1e/d2b/d26/f3c [686843,21089] 0 2024-09-21T12:20:32.163 INFO:tasks.workunit.client.0.smithi003.stdout:4/183: chown d9/da/c37 45033458 1 2024-09-21T12:20:32.164 INFO:tasks.workunit.client.0.smithi003.stdout:4/184: fsync d9/da/f22 0 2024-09-21T12:20:32.165 INFO:tasks.workunit.client.0.smithi003.stdout:4/185: write d9/d16/f2e [4734865,128179] 0 2024-09-21T12:20:32.167 INFO:tasks.workunit.client.0.smithi003.stdout:1/205: truncate f2 1754331 0 2024-09-21T12:20:32.171 INFO:tasks.workunit.client.1.smithi192.stdout:6/915: write da/d23/d37/d75/fda [4990438,86899] 0 2024-09-21T12:20:32.176 INFO:tasks.workunit.client.1.smithi192.stdout:3/716: sync 2024-09-21T12:20:32.177 INFO:tasks.workunit.client.0.smithi003.stdout:3/157: truncate d0/d5/f10 1530597 0 2024-09-21T12:20:32.178 INFO:tasks.workunit.client.1.smithi192.stdout:4/740: symlink d2/db/d3e/d57/d32/d4f/d82/lf4 0 2024-09-21T12:20:32.180 INFO:tasks.workunit.client.1.smithi192.stdout:7/748: unlink d6/d3a/dba/lf9 0 2024-09-21T12:20:32.181 INFO:tasks.workunit.client.1.smithi192.stdout:7/749: chown d6/d20/d69/d90/da7/fd1 712 1 2024-09-21T12:20:32.181 INFO:tasks.workunit.client.1.smithi192.stdout:7/750: dread - d6/d9/d2d/fd4 zero size 2024-09-21T12:20:32.182 INFO:tasks.workunit.client.1.smithi192.stdout:7/751: readlink d6/d20/l42 0 2024-09-21T12:20:32.182 INFO:tasks.workunit.client.0.smithi003.stdout:3/158: dread d0/d5/da/d28/fb [0,4194304] 0 2024-09-21T12:20:32.182 INFO:tasks.workunit.client.0.smithi003.stdout:8/194: creat d7/df/d36/f41 x:0 0 0 2024-09-21T12:20:32.183 INFO:tasks.workunit.client.1.smithi192.stdout:0/818: link d3/d5/d28/d39/d50/dd9/d7a/dbe/c7b d3/d5/d28/d39/d50/cf5 0 2024-09-21T12:20:32.188 INFO:tasks.workunit.client.1.smithi192.stdout:9/853: creat d5/dc/d40/dad/f10e x:0 0 0 2024-09-21T12:20:32.189 INFO:tasks.workunit.client.0.smithi003.stdout:2/159: creat d0/d21/f39 x:0 0 0 2024-09-21T12:20:32.189 INFO:tasks.workunit.client.1.smithi192.stdout:9/854: dread - d5/dc/d40/dad/f10e zero size 2024-09-21T12:20:32.190 INFO:tasks.workunit.client.1.smithi192.stdout:9/855: truncate d5/d8/fa6 1026654 0 2024-09-21T12:20:32.190 INFO:tasks.workunit.client.0.smithi003.stdout:2/160: chown d0/dd/d16/f2a 13282348 1 2024-09-21T12:20:32.191 INFO:tasks.workunit.client.1.smithi192.stdout:8/830: mkdir d14/d1a/d1d/d48/d117 0 2024-09-21T12:20:32.191 INFO:tasks.workunit.client.1.smithi192.stdout:8/831: readlink d14/d1a/d1d/l61 0 2024-09-21T12:20:32.191 INFO:tasks.workunit.client.0.smithi003.stdout:2/161: fsync d0/dd/d16/f19 0 2024-09-21T12:20:32.191 INFO:tasks.workunit.client.0.smithi003.stdout:7/182: mknod d8/d31/c45 0 2024-09-21T12:20:32.198 INFO:tasks.workunit.client.0.smithi003.stdout:2/162: dread d0/dd/d16/f24 [0,4194304] 0 2024-09-21T12:20:32.199 INFO:tasks.workunit.client.1.smithi192.stdout:7/752: dread d6/d9/d70/d77/f91 [0,4194304] 0 2024-09-21T12:20:32.199 INFO:tasks.workunit.client.0.smithi003.stdout:2/163: stat d0/dd/d16/f19 0 2024-09-21T12:20:32.199 INFO:tasks.workunit.client.1.smithi192.stdout:2/759: write d1b/d1e/d5e/d88/faa [1203192,92964] 0 2024-09-21T12:20:32.201 INFO:tasks.workunit.client.1.smithi192.stdout:7/753: write d6/d9/d1f/d3e/d7a/d8a/f103 [505529,74234] 0 2024-09-21T12:20:32.204 INFO:tasks.workunit.client.0.smithi003.stdout:0/203: creat d9/d12/d17/d21/f42 x:0 0 0 2024-09-21T12:20:32.205 INFO:tasks.workunit.client.1.smithi192.stdout:0/819: chown d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/c2f 401 1 2024-09-21T12:20:32.206 INFO:tasks.workunit.client.1.smithi192.stdout:0/820: dread - d3/d5/d69/dbf/fda zero size 2024-09-21T12:20:32.208 INFO:tasks.workunit.client.1.smithi192.stdout:0/821: truncate d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/dc6/d83/f8b 662225 0 2024-09-21T12:20:32.208 INFO:tasks.workunit.client.1.smithi192.stdout:9/856: creat d5/d19/dd5/d4d/d6d/f10f x:0 0 0 2024-09-21T12:20:32.210 INFO:tasks.workunit.client.1.smithi192.stdout:9/857: dread - d5/dc/d80/d44/db3/fce zero size 2024-09-21T12:20:32.212 INFO:tasks.workunit.client.0.smithi003.stdout:6/198: link d4/d13/d22/f2b d4/d11/d32/f3b 0 2024-09-21T12:20:32.212 INFO:tasks.workunit.client.0.smithi003.stdout:6/199: stat f3 0 2024-09-21T12:20:32.213 INFO:tasks.workunit.client.0.smithi003.stdout:6/200: write d4/fc [1268554,34371] 0 2024-09-21T12:20:32.216 INFO:tasks.workunit.client.1.smithi192.stdout:3/717: creat db/d16/d18/d21/d23/dd2/d2e/db8/dd0/df0/f106 x:0 0 0 2024-09-21T12:20:32.219 INFO:tasks.workunit.client.1.smithi192.stdout:6/916: dwrite da/d1f/d27/d88/fbb [0,4194304] 0 2024-09-21T12:20:32.220 INFO:tasks.workunit.client.0.smithi003.stdout:8/195: unlink d7/df/d16/f17 0 2024-09-21T12:20:32.221 INFO:tasks.workunit.client.0.smithi003.stdout:0/204: dread d9/d12/d1e/d2b/d26/f39 [0,4194304] 0 2024-09-21T12:20:32.221 INFO:tasks.workunit.client.0.smithi003.stdout:0/205: chown d9/d12/d22 594 1 2024-09-21T12:20:32.222 INFO:tasks.workunit.client.1.smithi192.stdout:4/741: rename d2/db/d3e/d57/d32 to d2/d36/d7f/df5 0 2024-09-21T12:20:32.223 INFO:tasks.workunit.client.0.smithi003.stdout:0/206: chown d9/d12/d1e/d2b/f1b 15874 1 2024-09-21T12:20:32.224 INFO:tasks.workunit.client.1.smithi192.stdout:0/822: mkdir d3/df0/df6 0 2024-09-21T12:20:32.225 INFO:tasks.workunit.client.1.smithi192.stdout:3/718: dwrite db/d16/d18/d21/d23/dd2/d2e/fc3 [0,4194304] 0 2024-09-21T12:20:32.226 INFO:tasks.workunit.client.1.smithi192.stdout:0/823: chown d3/d5/d69/db2/lba 3785329 1 2024-09-21T12:20:32.226 INFO:tasks.workunit.client.1.smithi192.stdout:3/719: chown db/l12 302543924 1 2024-09-21T12:20:32.227 INFO:tasks.workunit.client.0.smithi003.stdout:0/207: read d9/d12/d17/f18 [1689434,57474] 0 2024-09-21T12:20:32.228 INFO:tasks.workunit.client.1.smithi192.stdout:9/858: mknod d5/d8/dc7/dd7/de7/d55/c110 0 2024-09-21T12:20:32.230 INFO:tasks.workunit.client.0.smithi003.stdout:8/196: dwrite d7/de/d1a/f3c [0,4194304] 0 2024-09-21T12:20:32.230 INFO:tasks.workunit.client.0.smithi003.stdout:7/183: mknod d8/d31/c46 0 2024-09-21T12:20:32.232 INFO:tasks.workunit.client.0.smithi003.stdout:8/197: write d7/df/f1b [1018828,70540] 0 2024-09-21T12:20:32.234 INFO:tasks.workunit.client.1.smithi192.stdout:1/793: link d2/da/d9f/l71 d2/d12/d2f/d51/d24/d65/d8e/d9d/lff 0 2024-09-21T12:20:32.235 INFO:tasks.workunit.client.0.smithi003.stdout:8/198: readlink d7/df/d20/d21/l23 0 2024-09-21T12:20:32.237 INFO:tasks.workunit.client.1.smithi192.stdout:0/824: dwrite d3/f78 [0,4194304] 0 2024-09-21T12:20:32.238 INFO:tasks.workunit.client.0.smithi003.stdout:0/208: dwrite d9/f3b [0,4194304] 0 2024-09-21T12:20:32.239 INFO:tasks.workunit.client.0.smithi003.stdout:5/200: write dc/f1a [193779,127088] 0 2024-09-21T12:20:32.242 INFO:tasks.workunit.client.0.smithi003.stdout:9/328: getdents d2/da/d35/d4d 0 2024-09-21T12:20:32.244 INFO:tasks.workunit.client.1.smithi192.stdout:8/832: rename d14/d18/d94/dc3/ff3 to d14/d1a/d1d/d46/d4e/d83/d8d/d9c/dbe/f118 0 2024-09-21T12:20:32.245 INFO:tasks.workunit.client.0.smithi003.stdout:2/164: chown d0/l15 29289013 1 2024-09-21T12:20:32.247 INFO:tasks.workunit.client.1.smithi192.stdout:8/833: chown d14/d1a/d1d/d46/d4e/d83/d8d/d9c/dd0/l9e 0 1 2024-09-21T12:20:32.248 INFO:tasks.workunit.client.0.smithi003.stdout:1/206: mknod d4/d11/d14/d25/d42/c4c 0 2024-09-21T12:20:32.249 INFO:tasks.workunit.client.0.smithi003.stdout:8/199: dwrite d7/df/d20/d21/f33 [0,4194304] 0 2024-09-21T12:20:32.249 INFO:tasks.workunit.client.0.smithi003.stdout:1/207: fsync d4/fb 0 2024-09-21T12:20:32.250 INFO:tasks.workunit.client.1.smithi192.stdout:8/834: readlink d14/d1a/d1d/d39/d115/l109 0 2024-09-21T12:20:32.251 INFO:tasks.workunit.client.0.smithi003.stdout:6/201: creat d4/d13/d19/d23/f3c x:0 0 0 2024-09-21T12:20:32.256 INFO:tasks.workunit.client.1.smithi192.stdout:0/825: unlink d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/dc6/f5a 0 2024-09-21T12:20:32.259 INFO:tasks.workunit.client.0.smithi003.stdout:6/202: dwrite d4/d9/f15 [4194304,4194304] 0 2024-09-21T12:20:32.265 INFO:tasks.workunit.client.1.smithi192.stdout:6/917: dread da/d1f/d48/d7d/fbf [0,4194304] 0 2024-09-21T12:20:32.268 INFO:tasks.workunit.client.1.smithi192.stdout:0/826: dwrite d3/d5/d28/d39/d50/dd9/d7a/dbe/d92/d51/f34 [0,4194304] 0 2024-09-21T12:20:32.271 INFO:tasks.workunit.client.1.smithi192.stdout:9/859: symlink d5/d19/dd5/d4d/l111 0 2024-09-21T12:20:32.275 INFO:tasks.workunit.client.1.smithi192.stdout:2/760: link d1b/d38/d7d/feb d1b/d1e/d5e/d88/d95/dbe/ff6 0 2024-09-21T12:20:32.276 INFO:tasks.workunit.client.1.smithi192.stdout:1/794: write d2/d82/f9e [1011425,54136] 0 2024-09-21T12:20:32.284 INFO:tasks.workunit.client.1.smithi192.stdout:0/827: mknod d3/d5/d69/dbf/cf7 0 2024-09-21T12:20:32.285 INFO:tasks.workunit.client.1.smithi192.stdout:4/742: write d2/db/d34/d56/d6c/db8/f8c [1690301,73887] 0 2024-09-21T12:20:32.286 INFO:tasks.workunit.client.1.smithi192.stdout:3/720: link db/d16/d18/d40/d60/d7b/l96 db/d16/dee/l107 0 2024-09-21T12:20:32.288 INFO:tasks.workunit.client.1.smithi192.stdout:4/743: write d2/db/d34/d56/d6c/db8/d88/fb2 [1265370,85100] 0 2024-09-21T12:20:32.289 INFO:tasks.workunit.client.0.smithi003.stdout:3/159: dwrite d0/d5/da/ff [0,4194304] 0 2024-09-21T12:20:32.290 INFO:tasks.workunit.client.0.smithi003.stdout:3/160: read d0/d5/da/d28/d11/f20 [262521,119595] 0 2024-09-21T12:20:32.291 INFO:tasks.workunit.client.0.smithi003.stdout:4/186: link d9/f18 d9/d16/f3d 0 2024-09-21T12:20:32.293 INFO:tasks.workunit.client.1.smithi192.stdout:1/795: fsync d2/d12/d2f/d51/d24/f70 0 2024-09-21T12:20:32.298 INFO:tasks.workunit.client.1.smithi192.stdout:0/828: fsync d3/d5/d28/d39/d50/dd9/d7a/dbe/d92/d51/f2b 0 2024-09-21T12:20:32.301 INFO:tasks.workunit.client.1.smithi192.stdout:8/835: truncate d14/d1a/d1d/d48/de1/fff 1160589 0 2024-09-21T12:20:32.306 INFO:tasks.workunit.client.1.smithi192.stdout:2/761: creat d1b/d65/ff7 x:0 0 0 2024-09-21T12:20:32.307 INFO:tasks.workunit.client.1.smithi192.stdout:0/829: dwrite d3/d5/d69/faf [0,4194304] 0 2024-09-21T12:20:32.309 INFO:tasks.workunit.client.1.smithi192.stdout:1/796: fsync d2/d12/f3c 0 2024-09-21T12:20:32.310 INFO:tasks.workunit.client.1.smithi192.stdout:6/918: link da/d1f/d48/f4d da/d1f/d56/d78/f132 0 2024-09-21T12:20:32.314 INFO:tasks.workunit.client.1.smithi192.stdout:6/919: chown da/d1f/d27/d3e/c87 16279888 1 2024-09-21T12:20:32.314 INFO:tasks.workunit.client.1.smithi192.stdout:9/860: link d5/d8/dc7/dd7/de7/c69 d5/dc/d80/d44/d8e/dd6/c112 0 2024-09-21T12:20:32.316 INFO:tasks.workunit.client.1.smithi192.stdout:4/744: mknod d2/db/d34/d56/d6c/db8/d99/dd7/cf6 0 2024-09-21T12:20:32.317 INFO:tasks.workunit.client.1.smithi192.stdout:8/836: chown d14/d1a/d1d/d48/f6f 3271 1 2024-09-21T12:20:32.318 INFO:tasks.workunit.client.0.smithi003.stdout:3/161: unlink d0/d5/da/d28/dd/c15 0 2024-09-21T12:20:32.320 INFO:tasks.workunit.client.1.smithi192.stdout:3/721: dwrite db/f22 [0,4194304] 0 2024-09-21T12:20:32.321 INFO:tasks.workunit.client.1.smithi192.stdout:0/830: creat d3/d5/d28/d39/d50/dd9/d7a/dbe/ff8 x:0 0 0 2024-09-21T12:20:32.322 INFO:tasks.workunit.client.0.smithi003.stdout:3/162: dread d0/f19 [0,4194304] 0 2024-09-21T12:20:32.325 INFO:tasks.workunit.client.0.smithi003.stdout:7/184: write d8/f17 [809015,22768] 0 2024-09-21T12:20:32.328 INFO:tasks.workunit.client.1.smithi192.stdout:1/797: rename d2/de/dcf/cf3 to d2/d12/d2f/d41/d5c/d99/c100 0 2024-09-21T12:20:32.331 INFO:tasks.workunit.client.1.smithi192.stdout:6/920: symlink da/d1f/d27/l133 0 2024-09-21T12:20:32.331 INFO:tasks.workunit.client.0.smithi003.stdout:0/209: truncate d9/fd 326105 0 2024-09-21T12:20:32.332 INFO:tasks.workunit.client.1.smithi192.stdout:6/921: truncate da/d1f/d48/f53 4703582 0 2024-09-21T12:20:32.333 INFO:tasks.workunit.client.1.smithi192.stdout:9/861: symlink d5/d8/dc7/dd7/l113 0 2024-09-21T12:20:32.334 INFO:tasks.workunit.client.0.smithi003.stdout:5/201: rmdir dc/d36 0 2024-09-21T12:20:32.335 INFO:tasks.workunit.client.0.smithi003.stdout:5/202: fsync dc/d15/d21/d30/f33 0 2024-09-21T12:20:32.335 INFO:tasks.workunit.client.1.smithi192.stdout:8/837: symlink d14/d18/d94/da4/l119 0 2024-09-21T12:20:32.339 INFO:tasks.workunit.client.1.smithi192.stdout:3/722: creat db/d16/d18/d21/d23/dd2/d2e/db8/dd0/f108 x:0 0 0 2024-09-21T12:20:32.341 INFO:tasks.workunit.client.0.smithi003.stdout:1/208: truncate d4/d11/d14/f3f 2762795 0 2024-09-21T12:20:32.342 INFO:tasks.workunit.client.0.smithi003.stdout:1/209: write d4/f30 [50776,79248] 0 2024-09-21T12:20:32.344 INFO:tasks.workunit.client.1.smithi192.stdout:4/745: rename d2/db/d34/d56 to d2/d36/d55/d89/dc8/df7 0 2024-09-21T12:20:32.345 INFO:tasks.workunit.client.1.smithi192.stdout:4/746: write d2/f23 [1892100,114603] 0 2024-09-21T12:20:32.346 INFO:tasks.workunit.client.0.smithi003.stdout:7/185: mknod d8/db/d32/c47 0 2024-09-21T12:20:32.347 INFO:tasks.workunit.client.0.smithi003.stdout:7/186: read - d8/db/f38 zero size 2024-09-21T12:20:32.348 INFO:tasks.workunit.client.0.smithi003.stdout:7/187: truncate d8/d2c/f40 278492 0 2024-09-21T12:20:32.349 INFO:tasks.workunit.client.1.smithi192.stdout:9/862: unlink d5/d8/dc7/dd7/de7/d55/d70/cae 0 2024-09-21T12:20:32.350 INFO:tasks.workunit.client.1.smithi192.stdout:9/863: fsync d5/dc/d64/fe1 0 2024-09-21T12:20:32.350 INFO:tasks.workunit.client.0.smithi003.stdout:7/188: truncate d8/d2c/f40 558973 0 2024-09-21T12:20:32.350 INFO:tasks.workunit.client.0.smithi003.stdout:0/210: write d9/d12/d17/f18 [189968,25232] 0 2024-09-21T12:20:32.351 INFO:tasks.workunit.client.0.smithi003.stdout:0/211: read - d9/d12/d17/f36 zero size 2024-09-21T12:20:32.354 INFO:tasks.workunit.client.0.smithi003.stdout:7/189: read d8/d2c/f2a [92461,125330] 0 2024-09-21T12:20:32.354 INFO:tasks.workunit.client.1.smithi192.stdout:8/838: dread d14/d18/d94/dc3/fd9 [0,4194304] 0 2024-09-21T12:20:32.356 INFO:tasks.workunit.client.1.smithi192.stdout:0/831: dread d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/d43/f9a [0,4194304] 0 2024-09-21T12:20:32.357 INFO:tasks.workunit.client.0.smithi003.stdout:2/165: link d0/ff d0/d21/d2f/f3a 0 2024-09-21T12:20:32.359 INFO:tasks.workunit.client.0.smithi003.stdout:0/212: dwrite f8 [4194304,4194304] 0 2024-09-21T12:20:32.361 INFO:tasks.workunit.client.1.smithi192.stdout:6/922: symlink da/d1f/d48/d7d/d9a/d9e/dbe/dce/l134 0 2024-09-21T12:20:32.362 INFO:tasks.workunit.client.0.smithi003.stdout:8/200: getdents d7/df/d20 0 2024-09-21T12:20:32.362 INFO:tasks.workunit.client.0.smithi003.stdout:8/201: read - d7/df/d20/d21/f37 zero size 2024-09-21T12:20:32.363 INFO:tasks.workunit.client.1.smithi192.stdout:4/747: mkdir d2/d36/d7f/df5/d4f/d71/d9d/dad/d9c/df8 0 2024-09-21T12:20:32.370 INFO:tasks.workunit.client.1.smithi192.stdout:1/798: write d2/d12/d2f/d51/d24/d58/f91 [886578,129485] 0 2024-09-21T12:20:32.370 INFO:tasks.workunit.client.0.smithi003.stdout:3/163: truncate d0/d5/da/d28/d11/f1d 4935073 0 2024-09-21T12:20:32.370 INFO:tasks.workunit.client.0.smithi003.stdout:3/164: stat d0/d5/da/d28/dd 0 2024-09-21T12:20:32.372 INFO:tasks.workunit.client.0.smithi003.stdout:6/203: getdents d4/d13/d19 0 2024-09-21T12:20:32.375 INFO:tasks.workunit.client.0.smithi003.stdout:3/165: dread d0/d5/da/d28/f24 [0,4194304] 0 2024-09-21T12:20:32.377 INFO:tasks.workunit.client.1.smithi192.stdout:8/839: mknod d14/d1a/d1d/d46/d4e/d83/d8d/d9c/dbe/c11a 0 2024-09-21T12:20:32.378 INFO:tasks.workunit.client.0.smithi003.stdout:5/203: unlink dc/d15/c16 0 2024-09-21T12:20:32.380 INFO:tasks.workunit.client.1.smithi192.stdout:0/832: creat d3/d5/d28/d39/ff9 x:0 0 0 2024-09-21T12:20:32.381 INFO:tasks.workunit.client.1.smithi192.stdout:0/833: readlink d3/d5/d28/d39/d50/dd9/d7a/dbe/le8 0 2024-09-21T12:20:32.382 INFO:tasks.workunit.client.0.smithi003.stdout:7/190: unlink d8/db/d13/f33 0 2024-09-21T12:20:32.383 INFO:tasks.workunit.client.1.smithi192.stdout:0/834: dread - d3/d5/d28/d39/d50/dd9/fdb zero size 2024-09-21T12:20:32.386 INFO:tasks.workunit.client.0.smithi003.stdout:4/187: getdents d9 0 2024-09-21T12:20:32.387 INFO:tasks.workunit.client.1.smithi192.stdout:1/799: mkdir d2/d12/d2f/d41/d5c/d101 0 2024-09-21T12:20:32.388 INFO:tasks.workunit.client.1.smithi192.stdout:3/723: link db/d16/d18/d21/d23/dd2/c62 db/d16/dc1/c109 0 2024-09-21T12:20:32.390 INFO:tasks.workunit.client.0.smithi003.stdout:8/202: mknod d7/df/d20/d24/c42 0 2024-09-21T12:20:32.390 INFO:tasks.workunit.client.0.smithi003.stdout:8/203: readlink l5 0 2024-09-21T12:20:32.392 INFO:tasks.workunit.client.1.smithi192.stdout:9/864: mkdir d5/d19/dd5/d4d/dde/d114 0 2024-09-21T12:20:32.393 INFO:tasks.workunit.client.0.smithi003.stdout:1/210: rename d4/d11/d14/d25/d42/c47 to d4/d11/d14/c4d 0 2024-09-21T12:20:32.398 INFO:tasks.workunit.client.0.smithi003.stdout:6/204: symlink d4/d11/d32/l3d 0 2024-09-21T12:20:32.399 INFO:tasks.workunit.client.1.smithi192.stdout:0/835: mkdir d3/df0/dfa 0 2024-09-21T12:20:32.403 INFO:tasks.workunit.client.1.smithi192.stdout:1/800: symlink d2/d12/d2f/d41/d5c/d99/l102 0 2024-09-21T12:20:32.405 INFO:tasks.workunit.client.1.smithi192.stdout:3/724: dread db/d16/d18/d40/f51 [0,4194304] 0 2024-09-21T12:20:32.406 INFO:tasks.workunit.client.0.smithi003.stdout:2/166: dwrite d0/d21/f35 [0,4194304] 0 2024-09-21T12:20:32.409 INFO:tasks.workunit.client.1.smithi192.stdout:0/836: creat d3/d5/d28/d39/d50/ffb x:0 0 0 2024-09-21T12:20:32.410 INFO:tasks.workunit.client.1.smithi192.stdout:1/801: dwrite d2/d82/ffd [0,4194304] 0 2024-09-21T12:20:32.411 INFO:tasks.workunit.client.1.smithi192.stdout:0/837: readlink d3/d5/d28/d39/d50/dd9/d7a/leb 0 2024-09-21T12:20:32.411 INFO:tasks.workunit.client.1.smithi192.stdout:1/802: chown d2/d12/l6c 167077 1 2024-09-21T12:20:32.412 INFO:tasks.workunit.client.1.smithi192.stdout:4/748: link d2/f23 d2/d36/d7f/ff9 0 2024-09-21T12:20:32.412 INFO:tasks.workunit.client.0.smithi003.stdout:4/188: symlink d9/l3e 0 2024-09-21T12:20:32.413 INFO:tasks.workunit.client.1.smithi192.stdout:9/865: mknod d5/d19/d32/dc0/dd2/c115 0 2024-09-21T12:20:32.414 INFO:tasks.workunit.client.0.smithi003.stdout:0/213: mknod d9/d12/d1e/d2b/d32/c43 0 2024-09-21T12:20:32.415 INFO:tasks.workunit.client.1.smithi192.stdout:9/866: read - d5/d19/dd5/d4d/d6d/dd9/ff7 zero size 2024-09-21T12:20:32.417 INFO:tasks.workunit.client.1.smithi192.stdout:8/840: rename d14/d18/f22 to d14/d1a/d1d/d48/f11b 0 2024-09-21T12:20:32.418 INFO:tasks.workunit.client.1.smithi192.stdout:7/754: sync 2024-09-21T12:20:32.420 INFO:tasks.workunit.client.1.smithi192.stdout:6/923: getdents da/d23/d37/d75/d90/d103 0 2024-09-21T12:20:32.421 INFO:tasks.workunit.client.1.smithi192.stdout:6/924: stat da/d1f/d27/fb1 0 2024-09-21T12:20:32.424 INFO:tasks.workunit.client.1.smithi192.stdout:0/838: mknod d3/d5/d69/dbf/cfc 0 2024-09-21T12:20:32.424 INFO:tasks.workunit.client.0.smithi003.stdout:0/214: dwrite d9/d12/d1e/d2b/d26/f3e [0,4194304] 0 2024-09-21T12:20:32.427 INFO:tasks.workunit.client.1.smithi192.stdout:9/867: mknod d5/dc/d64/dbb/df1/c116 0 2024-09-21T12:20:32.428 INFO:tasks.workunit.client.1.smithi192.stdout:9/868: dread - d5/d19/d32/dc0/fee zero size 2024-09-21T12:20:32.429 INFO:tasks.workunit.client.1.smithi192.stdout:9/869: fsync d5/dc/f68 0 2024-09-21T12:20:32.436 INFO:tasks.workunit.client.0.smithi003.stdout:1/211: link d4/fa d4/df/d19/f4e 0 2024-09-21T12:20:32.437 INFO:tasks.workunit.client.0.smithi003.stdout:1/212: dread - d4/d11/f4a zero size 2024-09-21T12:20:32.443 INFO:tasks.workunit.client.1.smithi192.stdout:0/839: creat d3/d5/d69/dbf/ffd x:0 0 0 2024-09-21T12:20:32.443 INFO:tasks.workunit.client.1.smithi192.stdout:4/749: dread d2/db/d3e/d57/f9f [0,4194304] 0 2024-09-21T12:20:32.444 INFO:tasks.workunit.client.0.smithi003.stdout:0/215: mkdir d9/d12/d22/d2d/d44 0 2024-09-21T12:20:32.444 INFO:tasks.workunit.client.1.smithi192.stdout:0/840: chown d3/d5/d28/d39/d50/dd9/d7a/dbe/c2e 7893024 1 2024-09-21T12:20:32.445 INFO:tasks.workunit.client.1.smithi192.stdout:3/725: creat db/d16/d18/f10a x:0 0 0 2024-09-21T12:20:32.445 INFO:tasks.workunit.client.0.smithi003.stdout:6/205: dwrite d4/f10 [0,4194304] 0 2024-09-21T12:20:32.447 INFO:tasks.workunit.client.1.smithi192.stdout:9/870: rmdir d5/d19/dd5/d4d/d6d/dd9 39 2024-09-21T12:20:32.448 INFO:tasks.workunit.client.0.smithi003.stdout:7/191: link d8/d31/c45 d8/d31/d41/c48 0 2024-09-21T12:20:32.449 INFO:tasks.workunit.client.0.smithi003.stdout:7/192: chown d8/db/d32/c47 32751841 1 2024-09-21T12:20:32.450 INFO:tasks.workunit.client.1.smithi192.stdout:1/803: creat d2/f103 x:0 0 0 2024-09-21T12:20:32.458 INFO:tasks.workunit.client.0.smithi003.stdout:0/216: mknod d9/d12/d1e/d2b/d26/c45 0 2024-09-21T12:20:32.458 INFO:tasks.workunit.client.1.smithi192.stdout:6/925: write da/d1f/d48/fdb [8631093,107489] 0 2024-09-21T12:20:32.458 INFO:tasks.workunit.client.1.smithi192.stdout:8/841: dread d14/d1a/d1d/d46/d4e/f76 [0,4194304] 0 2024-09-21T12:20:32.462 INFO:tasks.workunit.client.0.smithi003.stdout:5/204: dwrite dc/d15/d1c/f29 [0,4194304] 0 2024-09-21T12:20:32.462 INFO:tasks.workunit.client.0.smithi003.stdout:0/217: fsync d9/d12/d17/d21/f31 0 2024-09-21T12:20:32.464 INFO:tasks.workunit.client.0.smithi003.stdout:6/206: fsync d4/d9/fd 0 2024-09-21T12:20:32.467 INFO:tasks.workunit.client.1.smithi192.stdout:2/762: sync 2024-09-21T12:20:32.467 INFO:tasks.workunit.client.0.smithi003.stdout:4/189: dwrite d9/d25/f39 [0,4194304] 0 2024-09-21T12:20:32.470 INFO:tasks.workunit.client.1.smithi192.stdout:0/841: truncate d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/f11 2010461 0 2024-09-21T12:20:32.471 INFO:tasks.workunit.client.0.smithi003.stdout:0/218: dread d9/f3b [0,4194304] 0 2024-09-21T12:20:32.471 INFO:tasks.workunit.client.1.smithi192.stdout:9/871: mkdir d5/dc/d80/d44/d8e/dd6/d117 0 2024-09-21T12:20:32.471 INFO:tasks.workunit.client.1.smithi192.stdout:9/872: stat d5/dc/d40/fb2 0 2024-09-21T12:20:32.473 INFO:tasks.workunit.client.1.smithi192.stdout:7/755: creat d6/d9/d70/f107 x:0 0 0 2024-09-21T12:20:32.474 INFO:tasks.workunit.client.0.smithi003.stdout:2/167: truncate d0/f2 189670 0 2024-09-21T12:20:32.475 INFO:tasks.workunit.client.0.smithi003.stdout:8/204: getdents d7/de/d11 0 2024-09-21T12:20:32.476 INFO:tasks.workunit.client.0.smithi003.stdout:8/205: chown d7/ca 44312 1 2024-09-21T12:20:32.479 INFO:tasks.workunit.client.1.smithi192.stdout:4/750: mknod d2/d36/d55/d89/dc8/df7/d6c/db8/cfa 0 2024-09-21T12:20:32.480 INFO:tasks.workunit.client.0.smithi003.stdout:2/168: dread d0/d21/f35 [0,4194304] 0 2024-09-21T12:20:32.482 INFO:tasks.workunit.client.1.smithi192.stdout:0/842: dread d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/d33/f6e [0,4194304] 0 2024-09-21T12:20:32.485 INFO:tasks.workunit.client.0.smithi003.stdout:5/205: readlink dc/l18 0 2024-09-21T12:20:32.488 INFO:tasks.workunit.client.1.smithi192.stdout:3/726: rename c6 to db/d16/d18/d33/d3b/d99/c10b 0 2024-09-21T12:20:32.500 INFO:tasks.workunit.client.0.smithi003.stdout:6/207: mknod d4/d11/d1d/c3e 0 2024-09-21T12:20:32.500 INFO:tasks.workunit.client.0.smithi003.stdout:0/219: dread f8 [0,4194304] 0 2024-09-21T12:20:32.500 INFO:tasks.workunit.client.0.smithi003.stdout:6/208: readlink d4/d11/d32/l3d 0 2024-09-21T12:20:32.501 INFO:tasks.workunit.client.1.smithi192.stdout:2/763: mknod d1b/d1e/d5e/d75/da1/daf/cf8 0 2024-09-21T12:20:32.503 INFO:tasks.workunit.client.1.smithi192.stdout:8/842: write d14/d1a/d1d/f64 [3787456,97531] 0 2024-09-21T12:20:32.521 INFO:tasks.workunit.client.0.smithi003.stdout:8/206: mkdir d7/df/d20/d24/d43 0 2024-09-21T12:20:32.522 INFO:tasks.workunit.client.0.smithi003.stdout:8/207: write d7/f8 [3600854,124876] 0 2024-09-21T12:20:32.523 INFO:tasks.workunit.client.0.smithi003.stdout:8/208: dread - d7/df/d20/d21/f3a zero size 2024-09-21T12:20:32.524 INFO:tasks.workunit.client.1.smithi192.stdout:0/843: creat d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/dc6/d83/ffe x:0 0 0 2024-09-21T12:20:32.525 INFO:tasks.workunit.client.0.smithi003.stdout:2/169: fsync d0/dd/f26 0 2024-09-21T12:20:32.526 INFO:tasks.workunit.client.1.smithi192.stdout:0/844: write d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/d33/f3c [2331265,25480] 0 2024-09-21T12:20:32.527 INFO:tasks.workunit.client.0.smithi003.stdout:5/206: creat dc/d15/f3f x:0 0 0 2024-09-21T12:20:32.529 INFO:tasks.workunit.client.1.smithi192.stdout:1/804: truncate d2/d12/d2f/d51/f20 6522635 0 2024-09-21T12:20:32.530 INFO:tasks.workunit.client.1.smithi192.stdout:3/727: truncate db/d16/db4/fb2 755926 0 2024-09-21T12:20:32.530 INFO:tasks.workunit.client.1.smithi192.stdout:1/805: write d2/d12/d2f/fc2 [9449,95679] 0 2024-09-21T12:20:32.531 INFO:tasks.workunit.client.0.smithi003.stdout:6/209: mkdir d4/d13/d19/d3f 0 2024-09-21T12:20:32.533 INFO:tasks.workunit.client.0.smithi003.stdout:0/220: mkdir d9/d12/d17/d38/d3a/d46 0 2024-09-21T12:20:32.534 INFO:tasks.workunit.client.1.smithi192.stdout:6/926: write da/d23/d37/f33 [6421081,47313] 0 2024-09-21T12:20:32.535 INFO:tasks.workunit.client.1.smithi192.stdout:9/873: mknod d5/d19/dd5/d4d/d6d/d105/c118 0 2024-09-21T12:20:32.535 INFO:tasks.workunit.client.1.smithi192.stdout:4/751: dwrite d2/d36/d7f/ff9 [0,4194304] 0 2024-09-21T12:20:32.536 INFO:tasks.workunit.client.0.smithi003.stdout:5/207: dwrite dc/d15/d21/d30/f34 [0,4194304] 0 2024-09-21T12:20:32.537 INFO:tasks.workunit.client.1.smithi192.stdout:9/874: fsync d5/dc/d64/dbb/d3d/fdd 0 2024-09-21T12:20:32.537 INFO:tasks.workunit.client.1.smithi192.stdout:6/927: truncate da/d1f/d27/fe5 5110828 0 2024-09-21T12:20:32.539 INFO:tasks.workunit.client.0.smithi003.stdout:5/208: fsync dc/d15/d21/f24 0 2024-09-21T12:20:32.542 INFO:tasks.workunit.client.1.smithi192.stdout:9/875: dwrite d5/d8/dc7/dd7/de7/d55/d93/f96 [0,4194304] 0 2024-09-21T12:20:32.542 INFO:tasks.workunit.client.0.smithi003.stdout:6/210: dwrite d4/d13/f35 [0,4194304] 0 2024-09-21T12:20:32.544 INFO:tasks.workunit.client.0.smithi003.stdout:7/193: link d8/db/d13/c29 d8/d31/c49 0 2024-09-21T12:20:32.547 INFO:tasks.workunit.client.0.smithi003.stdout:1/213: link d4/dc/c3e d4/d11/d14/d25/c4f 0 2024-09-21T12:20:32.548 INFO:tasks.workunit.client.1.smithi192.stdout:7/756: mknod d6/d20/d69/d90/da7/dc1/c108 0 2024-09-21T12:20:32.551 INFO:tasks.workunit.client.1.smithi192.stdout:9/876: dwrite d5/d8/dc7/dd7/de7/d55/d70/da0/ff6 [0,4194304] 0 2024-09-21T12:20:32.552 INFO:tasks.workunit.client.1.smithi192.stdout:0/845: unlink d3/cf 0 2024-09-21T12:20:32.553 INFO:tasks.workunit.client.0.smithi003.stdout:7/194: dwrite d8/f9 [4194304,4194304] 0 2024-09-21T12:20:32.553 INFO:tasks.workunit.client.1.smithi192.stdout:3/728: creat db/d16/d18/d40/dd1/f10c x:0 0 0 2024-09-21T12:20:32.555 INFO:tasks.workunit.client.1.smithi192.stdout:2/764: fsync d1b/f3e 0 2024-09-21T12:20:32.555 INFO:tasks.workunit.client.0.smithi003.stdout:0/221: mkdir d9/d12/d17/d38/d47 0 2024-09-21T12:20:32.555 INFO:tasks.workunit.client.1.smithi192.stdout:0/846: chown d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/dc6/f68 2083691 1 2024-09-21T12:20:32.557 INFO:tasks.workunit.client.1.smithi192.stdout:0/847: chown d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/dc6/d83/c84 0 1 2024-09-21T12:20:32.564 INFO:tasks.workunit.client.1.smithi192.stdout:6/928: unlink da/d23/fe9 0 2024-09-21T12:20:32.565 INFO:tasks.workunit.client.1.smithi192.stdout:4/752: creat d2/d36/d7f/df5/d4f/d71/d9d/ffb x:0 0 0 2024-09-21T12:20:32.567 INFO:tasks.workunit.client.1.smithi192.stdout:4/753: chown d2/d36/d7f/df5/d4f/d71/d9d/dad/leb 30290 1 2024-09-21T12:20:32.569 INFO:tasks.workunit.client.0.smithi003.stdout:1/214: creat d4/d11/f50 x:0 0 0 2024-09-21T12:20:32.570 INFO:tasks.workunit.client.1.smithi192.stdout:9/877: write d5/dc/d40/f25 [1156928,11506] 0 2024-09-21T12:20:32.573 INFO:tasks.workunit.client.0.smithi003.stdout:7/195: rmdir d8/db 39 2024-09-21T12:20:32.576 INFO:tasks.workunit.client.1.smithi192.stdout:6/929: truncate da/d1f/d56/d78/f7c 3537596 0 2024-09-21T12:20:32.577 INFO:tasks.workunit.client.0.smithi003.stdout:2/170: creat d0/f3b x:0 0 0 2024-09-21T12:20:32.578 INFO:tasks.workunit.client.1.smithi192.stdout:4/754: symlink d2/d36/lfc 0 2024-09-21T12:20:32.578 INFO:tasks.workunit.client.0.smithi003.stdout:7/196: fsync d8/d2c/f2a 0 2024-09-21T12:20:32.579 INFO:tasks.workunit.client.0.smithi003.stdout:7/197: fsync d8/fa 0 2024-09-21T12:20:32.580 INFO:tasks.workunit.client.0.smithi003.stdout:7/198: dread - d8/d2c/f2e zero size 2024-09-21T12:20:32.580 INFO:tasks.workunit.client.1.smithi192.stdout:1/806: creat d2/d12/f104 x:0 0 0 2024-09-21T12:20:32.580 INFO:tasks.workunit.client.0.smithi003.stdout:7/199: dread - d8/d2c/f39 zero size 2024-09-21T12:20:32.584 INFO:tasks.workunit.client.0.smithi003.stdout:1/215: link d4/d11/l15 d4/df/d19/l51 0 2024-09-21T12:20:32.584 INFO:tasks.workunit.client.0.smithi003.stdout:1/216: dread - d4/f39 zero size 2024-09-21T12:20:32.585 INFO:tasks.workunit.client.1.smithi192.stdout:1/807: creat d2/d12/d2f/d41/d5c/d99/f105 x:0 0 0 2024-09-21T12:20:32.586 INFO:tasks.workunit.client.0.smithi003.stdout:1/217: write d4/df/f38 [510401,100736] 0 2024-09-21T12:20:32.587 INFO:tasks.workunit.client.0.smithi003.stdout:1/218: chown d4/dc/c3e 111018 1 2024-09-21T12:20:32.587 INFO:tasks.workunit.client.0.smithi003.stdout:7/200: creat d8/f4a x:0 0 0 2024-09-21T12:20:32.588 INFO:tasks.workunit.client.0.smithi003.stdout:7/201: stat d8/fe 0 2024-09-21T12:20:32.589 INFO:tasks.workunit.client.1.smithi192.stdout:0/848: link d3/d5/d28/d39/d50/dd9/d7a/fb8 d3/d5/d28/fff 0 2024-09-21T12:20:32.591 INFO:tasks.workunit.client.0.smithi003.stdout:1/219: mknod d4/df/d41/c52 0 2024-09-21T12:20:32.591 INFO:tasks.workunit.client.0.smithi003.stdout:5/209: fsync dc/d15/f3f 0 2024-09-21T12:20:32.593 INFO:tasks.workunit.client.0.smithi003.stdout:5/210: chown dc/d15/d21/d30/f33 14907460 1 2024-09-21T12:20:32.593 INFO:tasks.workunit.client.0.smithi003.stdout:1/220: truncate d4/dc/f32 1957609 0 2024-09-21T12:20:32.596 INFO:tasks.workunit.client.0.smithi003.stdout:7/202: creat d8/d3c/f4b x:0 0 0 2024-09-21T12:20:32.597 INFO:tasks.workunit.client.1.smithi192.stdout:4/755: symlink d2/d36/d55/d89/dc8/df7/d6c/db8/lfd 0 2024-09-21T12:20:32.598 INFO:tasks.workunit.client.1.smithi192.stdout:9/878: creat d5/d19/dd5/f119 x:0 0 0 2024-09-21T12:20:32.598 INFO:tasks.workunit.client.0.smithi003.stdout:5/211: dread dc/f1a [0,4194304] 0 2024-09-21T12:20:32.600 INFO:tasks.workunit.client.0.smithi003.stdout:5/212: dread dc/f1a [0,4194304] 0 2024-09-21T12:20:32.600 INFO:tasks.workunit.client.0.smithi003.stdout:1/221: mknod d4/d11/c53 0 2024-09-21T12:20:32.601 INFO:tasks.workunit.client.1.smithi192.stdout:2/765: dread d1b/d65/d77/fa3 [0,4194304] 0 2024-09-21T12:20:32.601 INFO:tasks.workunit.client.1.smithi192.stdout:2/766: fdatasync d1b/d9e/fa9 0 2024-09-21T12:20:32.603 INFO:tasks.workunit.client.1.smithi192.stdout:0/849: dwrite d3/d5/d28/d39/d50/dd9/d7a/dbe/ff8 [0,4194304] 0 2024-09-21T12:20:32.611 INFO:tasks.workunit.client.0.smithi003.stdout:2/171: fsync d0/f2 0 2024-09-21T12:20:32.614 INFO:tasks.workunit.client.1.smithi192.stdout:9/879: dread d5/dc/d64/fe0 [0,4194304] 0 2024-09-21T12:20:32.615 INFO:tasks.workunit.client.0.smithi003.stdout:4/190: write d9/da/fd [982967,73055] 0 2024-09-21T12:20:32.615 INFO:tasks.workunit.client.1.smithi192.stdout:9/880: truncate d5/d8/f2d 5014423 0 2024-09-21T12:20:32.619 INFO:tasks.workunit.client.0.smithi003.stdout:7/203: mknod d8/db/d32/d43/c4c 0 2024-09-21T12:20:32.622 INFO:tasks.workunit.client.0.smithi003.stdout:4/191: dwrite d9/da/f22 [0,4194304] 0 2024-09-21T12:20:32.625 INFO:tasks.workunit.client.0.smithi003.stdout:8/209: truncate d7/f18 2042659 0 2024-09-21T12:20:32.626 INFO:tasks.workunit.client.1.smithi192.stdout:8/843: dwrite d14/d1a/d1d/d48/f11b [0,4194304] 0 2024-09-21T12:20:32.626 INFO:tasks.workunit.client.0.smithi003.stdout:5/213: creat dc/f40 x:0 0 0 2024-09-21T12:20:32.629 INFO:tasks.workunit.client.0.smithi003.stdout:2/172: rmdir d0/dd/d16 39 2024-09-21T12:20:32.630 INFO:tasks.workunit.client.0.smithi003.stdout:0/222: write d9/d12/d1e/d2b/d26/f39 [4451034,2636] 0 2024-09-21T12:20:32.630 INFO:tasks.workunit.client.1.smithi192.stdout:7/757: dwrite d6/d9/d70/d77/f91 [0,4194304] 0 2024-09-21T12:20:32.634 INFO:tasks.workunit.client.1.smithi192.stdout:3/729: dwrite db/d16/d18/d33/f48 [4194304,4194304] 0 2024-09-21T12:20:32.636 INFO:tasks.workunit.client.1.smithi192.stdout:3/730: chown db/d16/d18/d21/d23/d71/fdb 21867735 1 2024-09-21T12:20:32.637 INFO:tasks.workunit.client.1.smithi192.stdout:3/731: chown db/d16/d18/c44 89 1 2024-09-21T12:20:32.637 INFO:tasks.workunit.client.1.smithi192.stdout:3/732: chown db/d16/d18/d33/d4a/de4 0 1 2024-09-21T12:20:32.638 INFO:tasks.workunit.client.0.smithi003.stdout:5/214: mkdir dc/d15/d21/d28/d41 0 2024-09-21T12:20:32.640 INFO:tasks.workunit.client.0.smithi003.stdout:0/223: dwrite d9/fb [0,4194304] 0 2024-09-21T12:20:32.651 INFO:tasks.workunit.client.0.smithi003.stdout:8/210: stat d7/f18 0 2024-09-21T12:20:32.664 INFO:tasks.workunit.client.0.smithi003.stdout:0/224: dwrite d9/d12/d1e/f1f [4194304,4194304] 0 2024-09-21T12:20:32.664 INFO:tasks.workunit.client.0.smithi003.stdout:2/173: mknod d0/dd/d16/c3c 0 2024-09-21T12:20:32.666 INFO:tasks.workunit.client.0.smithi003.stdout:8/211: symlink d7/df/l44 0 2024-09-21T12:20:32.669 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:32 smithi003 ceph-mon[28057]: pgmap v266: 65 pgs: 65 active+clean; 1.8 GiB data, 5.2 GiB used, 531 GiB / 536 GiB avail; 60 MiB/s rd, 247 MiB/s wr, 462 op/s 2024-09-21T12:20:32.669 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:32 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:20:32.669 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:32 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:20:32.669 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:32 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:20:32.669 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:32 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:20:32.669 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:32 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:20:32.669 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:32 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:20:32.669 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:32 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:20:32.669 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:32 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mgr fail", "who": "smithi003.wztftl"}]: dispatch 2024-09-21T12:20:32.669 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:32 smithi003 ceph-mon[28057]: Activating manager daemon smithi192.qsaprd 2024-09-21T12:20:32.669 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:32 smithi003 ceph-mon[28057]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "mgr fail", "who": "smithi003.wztftl"}]': finished 2024-09-21T12:20:32.670 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:32 smithi003 ceph-mon[28057]: osdmap e47: 6 total, 6 up, 6 in 2024-09-21T12:20:32.670 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:32 smithi003 ceph-mon[28057]: mgrmap e21: smithi192.qsaprd(active, starting, since 0.0187503s) 2024-09-21T12:20:32.670 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:32 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "mon metadata", "id": "smithi003"}]: dispatch 2024-09-21T12:20:32.670 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:32 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "mon metadata", "id": "smithi192"}]: dispatch 2024-09-21T12:20:32.670 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:32 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi003.gfkngj"}]: dispatch 2024-09-21T12:20:32.670 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:32 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi192.ywqqxe"}]: dispatch 2024-09-21T12:20:32.670 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:32 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi192.ktdqns"}]: dispatch 2024-09-21T12:20:32.670 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:32 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi003.ebjgyl"}]: dispatch 2024-09-21T12:20:32.670 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:32 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "mgr metadata", "who": "smithi192.qsaprd", "id": "smithi192.qsaprd"}]: dispatch 2024-09-21T12:20:32.670 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:32 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T12:20:32.670 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:32 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T12:20:32.670 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:32 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T12:20:32.670 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:32 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T12:20:32.671 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:32 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T12:20:32.671 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:32 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T12:20:32.671 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:32 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-21T12:20:32.671 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:32 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-21T12:20:32.671 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:32 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-21T12:20:32.671 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:32 smithi003 ceph-mon[28057]: Manager daemon smithi192.qsaprd is now available 2024-09-21T12:20:32.676 INFO:tasks.workunit.client.0.smithi003.stdout:2/174: dwrite d0/dd/d16/f33 [0,4194304] 0 2024-09-21T12:20:32.677 INFO:tasks.workunit.client.0.smithi003.stdout:1/222: dwrite d4/df/d19/f36 [0,4194304] 0 2024-09-21T12:20:32.678 INFO:tasks.workunit.client.0.smithi003.stdout:0/225: symlink d9/d12/d1e/d2b/d32/l48 0 2024-09-21T12:20:32.679 INFO:tasks.workunit.client.0.smithi003.stdout:0/226: chown d9/d12/d17/f2f 8 1 2024-09-21T12:20:32.689 INFO:tasks.workunit.client.0.smithi003.stdout:2/175: fsync d0/dd/d16/f24 0 2024-09-21T12:20:32.692 INFO:tasks.workunit.client.0.smithi003.stdout:1/223: creat d4/df/d41/f54 x:0 0 0 2024-09-21T12:20:32.697 INFO:tasks.workunit.client.0.smithi003.stdout:0/227: unlink d9/d12/f2c 0 2024-09-21T12:20:32.703 INFO:tasks.workunit.client.0.smithi003.stdout:1/224: creat d4/d11/d14/d25/d42/f55 x:0 0 0 2024-09-21T12:20:32.705 INFO:tasks.workunit.client.0.smithi003.stdout:8/212: rmdir d7/df/d20/d24/d43 0 2024-09-21T12:20:32.706 INFO:tasks.workunit.client.0.smithi003.stdout:4/192: truncate d9/f2f 415362 0 2024-09-21T12:20:32.708 INFO:tasks.workunit.client.0.smithi003.stdout:0/228: mknod d9/d12/d17/d38/c49 0 2024-09-21T12:20:32.709 INFO:tasks.workunit.client.1.smithi192.stdout:4/756: chown d2/db/d3e/d57/cf1 178 1 2024-09-21T12:20:32.709 INFO:tasks.workunit.client.1.smithi192.stdout:4/757: stat d2/d36/d55/d89/dc8/df7/d83 0 2024-09-21T12:20:32.710 INFO:tasks.workunit.client.1.smithi192.stdout:1/808: unlink d2/da/lc4 0 2024-09-21T12:20:32.710 INFO:tasks.workunit.client.1.smithi192.stdout:1/809: stat d2/d12/d2f/fc2 0 2024-09-21T12:20:32.715 INFO:tasks.workunit.client.0.smithi003.stdout:5/215: dwrite dc/f10 [0,4194304] 0 2024-09-21T12:20:32.716 INFO:tasks.workunit.client.0.smithi003.stdout:5/216: write dc/d15/d1c/f3e [315144,87174] 0 2024-09-21T12:20:32.724 INFO:tasks.workunit.client.0.smithi003.stdout:5/217: dwrite dc/d15/d21/d30/f34 [0,4194304] 0 2024-09-21T12:20:32.732 INFO:tasks.workunit.client.0.smithi003.stdout:5/218: dwrite dc/d15/d1c/f23 [0,4194304] 0 2024-09-21T12:20:32.793 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:32 smithi192 ceph-mon[35641]: pgmap v266: 65 pgs: 65 active+clean; 1.8 GiB data, 5.2 GiB used, 531 GiB / 536 GiB avail; 60 MiB/s rd, 247 MiB/s wr, 462 op/s 2024-09-21T12:20:32.793 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:32 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:20:32.793 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:32 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:20:32.793 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:32 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:20:32.793 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:32 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:20:32.794 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:32 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:20:32.794 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:32 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' 2024-09-21T12:20:32.794 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:32 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:20:32.794 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:32 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mgr fail", "who": "smithi003.wztftl"}]: dispatch 2024-09-21T12:20:32.794 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:32 smithi192 ceph-mon[35641]: Activating manager daemon smithi192.qsaprd 2024-09-21T12:20:32.794 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:32 smithi192 ceph-mon[35641]: from='mgr.14217 172.21.15.3:0/1142780873' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "mgr fail", "who": "smithi003.wztftl"}]': finished 2024-09-21T12:20:32.794 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:32 smithi192 ceph-mon[35641]: osdmap e47: 6 total, 6 up, 6 in 2024-09-21T12:20:32.794 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:32 smithi192 ceph-mon[35641]: mgrmap e21: smithi192.qsaprd(active, starting, since 0.0187503s) 2024-09-21T12:20:32.794 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:32 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "mon metadata", "id": "smithi003"}]: dispatch 2024-09-21T12:20:32.794 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:32 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "mon metadata", "id": "smithi192"}]: dispatch 2024-09-21T12:20:32.794 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:32 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi003.gfkngj"}]: dispatch 2024-09-21T12:20:32.794 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:32 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi192.ywqqxe"}]: dispatch 2024-09-21T12:20:32.794 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:32 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi192.ktdqns"}]: dispatch 2024-09-21T12:20:32.794 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:32 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi003.ebjgyl"}]: dispatch 2024-09-21T12:20:32.794 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:32 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "mgr metadata", "who": "smithi192.qsaprd", "id": "smithi192.qsaprd"}]: dispatch 2024-09-21T12:20:32.795 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:32 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T12:20:32.795 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:32 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T12:20:32.795 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:32 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T12:20:32.795 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:32 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T12:20:32.795 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:32 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T12:20:32.795 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:32 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T12:20:32.795 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:32 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-21T12:20:32.795 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:32 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-21T12:20:32.795 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:32 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-21T12:20:32.795 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:32 smithi192 ceph-mon[35641]: Manager daemon smithi192.qsaprd is now available 2024-09-21T12:20:32.836 INFO:tasks.workunit.client.0.smithi003.stdout:9/329: sync 2024-09-21T12:20:32.836 INFO:tasks.workunit.client.0.smithi003.stdout:3/166: sync 2024-09-21T12:20:32.886 INFO:tasks.workunit.client.0.smithi003.stdout:8/213: creat d7/df/d20/d21/f45 x:0 0 0 2024-09-21T12:20:32.887 INFO:tasks.workunit.client.1.smithi192.stdout:6/930: getdents da/d1f/de6 0 2024-09-21T12:20:32.891 INFO:tasks.workunit.client.0.smithi003.stdout:0/229: creat d9/d12/d22/f4a x:0 0 0 2024-09-21T12:20:32.894 INFO:tasks.workunit.client.1.smithi192.stdout:2/767: unlink d1b/d1e/d5e/d75/d8d/f94 0 2024-09-21T12:20:32.894 INFO:tasks.workunit.client.0.smithi003.stdout:0/230: write d9/d12/d1e/f2e [5062,89866] 0 2024-09-21T12:20:32.895 INFO:tasks.workunit.client.1.smithi192.stdout:2/768: write d1b/d1e/fad [1336142,11649] 0 2024-09-21T12:20:32.896 INFO:tasks.workunit.client.0.smithi003.stdout:4/193: dwrite d9/d16/f3b [0,4194304] 0 2024-09-21T12:20:32.897 INFO:tasks.workunit.client.1.smithi192.stdout:0/850: creat d3/d5/dd7/f100 x:0 0 0 2024-09-21T12:20:32.901 INFO:tasks.workunit.client.1.smithi192.stdout:9/881: mknod d5/d8/dc7/dd7/de7/d55/df3/c11a 0 2024-09-21T12:20:32.901 INFO:tasks.workunit.client.1.smithi192.stdout:0/851: dread d3/d5/d69/faf [0,4194304] 0 2024-09-21T12:20:32.907 INFO:tasks.workunit.client.0.smithi003.stdout:5/219: creat dc/d15/d21/d30/f42 x:0 0 0 2024-09-21T12:20:32.908 INFO:tasks.workunit.client.0.smithi003.stdout:5/220: chown dc/d15/d21/l25 1 1 2024-09-21T12:20:32.910 INFO:tasks.workunit.client.1.smithi192.stdout:8/844: symlink d14/d1a/d1d/d20/l11c 0 2024-09-21T12:20:32.913 INFO:tasks.workunit.client.0.smithi003.stdout:3/167: creat d0/d5/da/d28/f29 x:0 0 0 2024-09-21T12:20:32.916 INFO:tasks.workunit.client.1.smithi192.stdout:8/845: dwrite d14/d18/fed [0,4194304] 0 2024-09-21T12:20:32.917 INFO:tasks.workunit.client.1.smithi192.stdout:7/758: chown d6/d9/d1f/fd3 173733 1 2024-09-21T12:20:32.918 INFO:tasks.workunit.client.1.smithi192.stdout:7/759: write d6/d9/d2d/fd4 [888165,48462] 0 2024-09-21T12:20:32.920 INFO:tasks.workunit.client.1.smithi192.stdout:3/733: mknod db/d16/d18/da7/c10d 0 2024-09-21T12:20:32.922 INFO:tasks.workunit.client.0.smithi003.stdout:8/214: creat d7/df/d16/f46 x:0 0 0 2024-09-21T12:20:32.924 INFO:tasks.workunit.client.1.smithi192.stdout:3/734: write db/d16/d18/d21/d23/dd2/d2e/fc9 [1157109,55298] 0 2024-09-21T12:20:32.924 INFO:tasks.workunit.client.0.smithi003.stdout:2/176: write d0/f2 [581263,42332] 0 2024-09-21T12:20:32.926 INFO:tasks.workunit.client.1.smithi192.stdout:8/846: dwrite d14/d18/d94/ff2 [0,4194304] 0 2024-09-21T12:20:32.930 INFO:tasks.workunit.client.1.smithi192.stdout:7/760: dwrite d6/d20/d69/d90/da7/dc1/f102 [0,4194304] 0 2024-09-21T12:20:32.935 INFO:tasks.workunit.client.1.smithi192.stdout:4/758: rename d2/db/d34/f94 to d2/d36/d7f/df5/ffe 0 2024-09-21T12:20:32.937 INFO:tasks.workunit.client.0.smithi003.stdout:1/225: creat d4/f56 x:0 0 0 2024-09-21T12:20:32.939 INFO:tasks.workunit.client.0.smithi003.stdout:1/226: dread d4/f30 [0,4194304] 0 2024-09-21T12:20:32.941 INFO:tasks.workunit.client.1.smithi192.stdout:1/810: fdatasync d2/d12/d2f/d51/d24/d65/d5a/f5d 0 2024-09-21T12:20:32.946 INFO:tasks.workunit.client.0.smithi003.stdout:0/231: symlink d9/d12/d1e/d2b/l4b 0 2024-09-21T12:20:32.946 INFO:tasks.workunit.client.0.smithi003.stdout:1/227: dread d4/df/d19/f4e [0,4194304] 0 2024-09-21T12:20:32.947 INFO:tasks.workunit.client.1.smithi192.stdout:7/761: dread d6/d20/d69/d90/f94 [0,4194304] 0 2024-09-21T12:20:32.953 INFO:tasks.workunit.client.0.smithi003.stdout:4/194: chown d9/da/f27 16883868 1 2024-09-21T12:20:32.959 INFO:tasks.workunit.client.1.smithi192.stdout:2/769: fsync d1b/d65/d77/fa3 0 2024-09-21T12:20:32.963 INFO:tasks.workunit.client.1.smithi192.stdout:9/882: mknod d5/d8/dc7/dd7/c11b 0 2024-09-21T12:20:32.965 INFO:tasks.workunit.client.0.smithi003.stdout:6/211: sync 2024-09-21T12:20:32.965 INFO:tasks.workunit.client.0.smithi003.stdout:8/215: truncate f4 2140824 0 2024-09-21T12:20:32.966 INFO:tasks.workunit.client.0.smithi003.stdout:6/212: readlink d4/d9/l2a 0 2024-09-21T12:20:32.966 INFO:tasks.workunit.client.0.smithi003.stdout:8/216: stat d7/ca 0 2024-09-21T12:20:32.969 INFO:tasks.workunit.client.0.smithi003.stdout:3/168: dread d0/d5/f10 [0,4194304] 0 2024-09-21T12:20:32.969 INFO:tasks.workunit.client.1.smithi192.stdout:0/852: creat d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/d33/dae/db4/f101 x:0 0 0 2024-09-21T12:20:32.975 INFO:tasks.workunit.client.1.smithi192.stdout:9/883: dread d5/dc/d64/dbb/f60 [0,4194304] 0 2024-09-21T12:20:32.977 INFO:tasks.workunit.client.0.smithi003.stdout:1/228: dread d4/d11/f2a [0,4194304] 0 2024-09-21T12:20:32.988 INFO:tasks.workunit.client.0.smithi003.stdout:4/195: dwrite d9/f24 [0,4194304] 0 2024-09-21T12:20:32.990 INFO:tasks.workunit.client.0.smithi003.stdout:6/213: creat d4/d13/d22/f40 x:0 0 0 2024-09-21T12:20:32.993 INFO:tasks.workunit.client.1.smithi192.stdout:3/735: rename db/d16/d18/d21/d23/dd2 to db/d16/d18/da7/d10e 0 2024-09-21T12:20:32.995 INFO:tasks.workunit.client.0.smithi003.stdout:8/217: mkdir d7/df/d20/d24/d47 0 2024-09-21T12:20:32.997 INFO:tasks.workunit.client.1.smithi192.stdout:4/759: creat d2/d36/d55/d89/da6/fff x:0 0 0 2024-09-21T12:20:32.998 INFO:tasks.workunit.client.0.smithi003.stdout:6/214: dwrite f3 [4194304,4194304] 0 2024-09-21T12:20:33.003 INFO:tasks.workunit.client.1.smithi192.stdout:1/811: symlink d2/d12/d2f/d81/l106 0 2024-09-21T12:20:33.006 INFO:tasks.workunit.client.1.smithi192.stdout:6/931: mknod da/d1f/d48/d7d/d9a/d9e/d10b/c135 0 2024-09-21T12:20:33.015 INFO:tasks.workunit.client.0.smithi003.stdout:4/196: rmdir d9/da 39 2024-09-21T12:20:33.019 INFO:tasks.workunit.client.1.smithi192.stdout:7/762: dread d6/d9/d51/f4b [0,4194304] 0 2024-09-21T12:20:33.020 INFO:tasks.workunit.client.1.smithi192.stdout:2/770: mkdir d1b/d38/d53/d8b/da0/df9 0 2024-09-21T12:20:33.022 INFO:tasks.workunit.client.0.smithi003.stdout:0/232: creat d9/f4c x:0 0 0 2024-09-21T12:20:33.024 INFO:tasks.workunit.client.0.smithi003.stdout:1/229: link d4/dc/f35 d4/d11/d14/d25/d42/f57 0 2024-09-21T12:20:33.025 INFO:tasks.workunit.client.0.smithi003.stdout:1/230: stat d4/df/d19/c44 0 2024-09-21T12:20:33.026 INFO:tasks.workunit.client.1.smithi192.stdout:9/884: write d5/dc/d64/dbb/f60 [4192162,47732] 0 2024-09-21T12:20:33.029 INFO:tasks.workunit.client.1.smithi192.stdout:8/847: link d14/d1a/d1d/d39/f8f d14/d1a/d1d/d46/d4e/d83/f11d 0 2024-09-21T12:20:33.029 INFO:tasks.workunit.client.1.smithi192.stdout:8/848: stat fd 0 2024-09-21T12:20:33.033 INFO:tasks.workunit.client.1.smithi192.stdout:8/849: dread d14/d1a/d1d/d46/d4e/d83/d8d/d9c/dee/d80/d9a/dba/feb [0,4194304] 0 2024-09-21T12:20:33.033 INFO:tasks.workunit.client.0.smithi003.stdout:4/197: chown d9/f1a 11927 1 2024-09-21T12:20:33.034 INFO:tasks.workunit.client.1.smithi192.stdout:3/736: readlink db/d16/d18/d40/l97 0 2024-09-21T12:20:33.039 INFO:tasks.workunit.client.1.smithi192.stdout:1/812: mkdir d2/d12/d2f/d51/d24/d107 0 2024-09-21T12:20:33.043 INFO:tasks.workunit.client.1.smithi192.stdout:6/932: stat da/lac 0 2024-09-21T12:20:33.043 INFO:tasks.workunit.client.1.smithi192.stdout:7/763: stat d6/d20/dc9/cf5 0 2024-09-21T12:20:33.044 INFO:tasks.workunit.client.1.smithi192.stdout:4/760: mkdir d2/d36/d55/d89/dc8/df7/d6c/db8/d88/d100 0 2024-09-21T12:20:33.045 INFO:tasks.workunit.client.0.smithi003.stdout:4/198: creat d9/da/d36/f3f x:0 0 0 2024-09-21T12:20:33.047 INFO:tasks.workunit.client.1.smithi192.stdout:0/853: mknod d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/c102 0 2024-09-21T12:20:33.048 INFO:tasks.workunit.client.1.smithi192.stdout:9/885: mkdir d5/d19/d32/dc0/d11c 0 2024-09-21T12:20:33.050 INFO:tasks.workunit.client.0.smithi003.stdout:4/199: dread d9/da/f22 [0,4194304] 0 2024-09-21T12:20:33.055 INFO:tasks.workunit.client.1.smithi192.stdout:3/737: mkdir db/d16/d18/d21/d23/d10f 0 2024-09-21T12:20:33.057 INFO:tasks.workunit.client.1.smithi192.stdout:6/933: chown da/d1f/d48/f4d 3139765 1 2024-09-21T12:20:33.057 INFO:tasks.workunit.client.1.smithi192.stdout:7/764: rmdir d6/d3a/dba 39 2024-09-21T12:20:33.061 INFO:tasks.workunit.client.1.smithi192.stdout:4/761: mkdir d2/d36/d55/d89/dc8/df7/d83/d101 0 2024-09-21T12:20:33.061 INFO:tasks.workunit.client.1.smithi192.stdout:4/762: chown d2/d36/d7f/df5/d4f/d71/d9d/dad/d9c/lae 150908636 1 2024-09-21T12:20:33.062 INFO:tasks.workunit.client.1.smithi192.stdout:4/763: readlink d2/d36/d7f/df5/d4f/d82/le9 0 2024-09-21T12:20:33.068 INFO:tasks.workunit.client.1.smithi192.stdout:4/764: dread d2/f84 [0,4194304] 0 2024-09-21T12:20:33.072 INFO:tasks.workunit.client.1.smithi192.stdout:6/934: creat da/d1f/de6/f136 x:0 0 0 2024-09-21T12:20:33.073 INFO:tasks.workunit.client.1.smithi192.stdout:0/854: symlink d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/l103 0 2024-09-21T12:20:33.080 INFO:tasks.workunit.client.1.smithi192.stdout:4/765: dread d2/d36/d7f/df5/d4f/d71/d9d/dad/d4b/f64 [0,4194304] 0 2024-09-21T12:20:33.081 INFO:tasks.workunit.client.1.smithi192.stdout:0/855: getdents d3/d5/de0 0 2024-09-21T12:20:33.086 INFO:tasks.workunit.client.1.smithi192.stdout:6/935: getdents da/d23/d37/d75 0 2024-09-21T12:20:33.087 INFO:tasks.workunit.client.1.smithi192.stdout:4/766: rmdir d2/d36/d55/d89/da6/dd1 0 2024-09-21T12:20:33.088 INFO:tasks.workunit.client.1.smithi192.stdout:6/936: fdatasync da/d1f/d48/d7d/fbf 0 2024-09-21T12:20:33.089 INFO:tasks.workunit.client.1.smithi192.stdout:4/767: chown d2/db/l18 500 1 2024-09-21T12:20:33.091 INFO:tasks.workunit.client.1.smithi192.stdout:6/937: mknod da/d1f/d48/d7d/d9a/d9e/dbe/dce/c137 0 2024-09-21T12:20:33.116 INFO:tasks.workunit.client.1.smithi192.stdout:0/856: rename d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/d43/l75 to d3/l104 0 2024-09-21T12:20:33.119 INFO:tasks.workunit.client.1.smithi192.stdout:9/886: unlink d5/d8/fa6 0 2024-09-21T12:20:33.122 INFO:tasks.workunit.client.1.smithi192.stdout:0/857: dwrite d3/d5/d28/d39/d50/dd9/d7a/fef [0,4194304] 0 2024-09-21T12:20:33.123 INFO:tasks.workunit.client.1.smithi192.stdout:9/887: fsync d5/dc/d64/fe0 0 2024-09-21T12:20:33.125 INFO:tasks.workunit.client.1.smithi192.stdout:9/888: fsync d5/d19/fa8 0 2024-09-21T12:20:33.127 INFO:tasks.workunit.client.1.smithi192.stdout:0/858: rename d3/d5/d28/d39/d50/dd9/d7a/fb8 to d3/d5/d28/d39/d50/dd9/d7a/f105 0 2024-09-21T12:20:33.128 INFO:tasks.workunit.client.1.smithi192.stdout:0/859: chown d3/d5/d28/d39/d50/dd9/d7a/dbe/d89 13580011 1 2024-09-21T12:20:33.129 INFO:tasks.workunit.client.1.smithi192.stdout:0/860: read - d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/d33/dae/db4/f101 zero size 2024-09-21T12:20:33.132 INFO:tasks.workunit.client.1.smithi192.stdout:0/861: unlink d3/d5/d28/d39/d50/cf5 0 2024-09-21T12:20:33.139 INFO:tasks.workunit.client.1.smithi192.stdout:0/862: dwrite d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/dc6/d83/f8b [0,4194304] 0 2024-09-21T12:20:33.142 INFO:tasks.workunit.client.1.smithi192.stdout:9/889: creat d5/d8/dc7/dd7/de7/d55/f11d x:0 0 0 2024-09-21T12:20:33.143 INFO:tasks.workunit.client.1.smithi192.stdout:0/863: mknod d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/c106 0 2024-09-21T12:20:33.144 INFO:tasks.workunit.client.1.smithi192.stdout:9/890: rmdir d5/dc/d80/d44/db3 39 2024-09-21T12:20:33.145 INFO:tasks.workunit.client.1.smithi192.stdout:6/938: rmdir da/d1f/d48/d7d/daa 39 2024-09-21T12:20:33.146 INFO:tasks.workunit.client.1.smithi192.stdout:9/891: mknod d5/dc/d80/d5a/c11e 0 2024-09-21T12:20:33.148 INFO:tasks.workunit.client.1.smithi192.stdout:9/892: read d5/d19/dd5/fdf [1596831,91307] 0 2024-09-21T12:20:33.152 INFO:tasks.workunit.client.1.smithi192.stdout:6/939: symlink da/d1f/l138 0 2024-09-21T12:20:33.156 INFO:tasks.workunit.client.1.smithi192.stdout:9/893: creat d5/d8/dc7/dd7/de7/d55/d70/da0/da2/daf/f11f x:0 0 0 2024-09-21T12:20:33.157 INFO:tasks.workunit.client.0.smithi003.stdout:0/233: truncate d9/fb 3239025 0 2024-09-21T12:20:33.159 INFO:tasks.workunit.client.1.smithi192.stdout:0/864: rename d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/dc6/f5b to d3/d5/d28/d39/d50/dd9/d7a/dbe/d92/f107 0 2024-09-21T12:20:33.159 INFO:tasks.workunit.client.1.smithi192.stdout:9/894: creat d5/d8/dc7/dd7/de7/d55/d70/da0/f120 x:0 0 0 2024-09-21T12:20:33.160 INFO:tasks.workunit.client.1.smithi192.stdout:0/865: truncate d3/d5/dd7/ff1 750570 0 2024-09-21T12:20:33.160 INFO:tasks.workunit.client.1.smithi192.stdout:9/895: readlink d5/dc/l99 0 2024-09-21T12:20:33.164 INFO:tasks.workunit.client.0.smithi003.stdout:0/234: dread f8 [0,4194304] 0 2024-09-21T12:20:33.164 INFO:tasks.workunit.client.1.smithi192.stdout:9/896: dread d5/d8/dc7/dd7/de7/fb0 [0,4194304] 0 2024-09-21T12:20:33.165 INFO:tasks.workunit.client.1.smithi192.stdout:0/866: creat d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/d33/dae/f108 x:0 0 0 2024-09-21T12:20:33.166 INFO:tasks.workunit.client.1.smithi192.stdout:9/897: write d5/dc/d80/d44/d8e/f98 [2819885,22539] 0 2024-09-21T12:20:33.167 INFO:tasks.workunit.client.0.smithi003.stdout:0/235: mkdir d9/d12/d17/d21/d30/d4d 0 2024-09-21T12:20:33.168 INFO:tasks.workunit.client.1.smithi192.stdout:6/940: dread da/d1f/d27/f28 [0,4194304] 0 2024-09-21T12:20:33.168 INFO:tasks.workunit.client.0.smithi003.stdout:0/236: readlink d9/l1a 0 2024-09-21T12:20:33.169 INFO:tasks.workunit.client.1.smithi192.stdout:6/941: read da/d1f/d48/f53 [4588773,334] 0 2024-09-21T12:20:33.169 INFO:tasks.workunit.client.0.smithi003.stdout:0/237: write d9/d12/d1e/d2b/d26/f3c [1990638,107704] 0 2024-09-21T12:20:33.177 INFO:tasks.workunit.client.0.smithi003.stdout:0/238: mknod d9/d12/d17/c4e 0 2024-09-21T12:20:33.178 INFO:tasks.workunit.client.1.smithi192.stdout:6/942: getdents da/d1f/d48/d7d/d9a/d9e/dbe 0 2024-09-21T12:20:33.180 INFO:tasks.workunit.client.0.smithi003.stdout:4/200: truncate d9/f1a 147012 0 2024-09-21T12:20:33.180 INFO:tasks.workunit.client.1.smithi192.stdout:6/943: write da/d1f/d27/d3e/f94 [3221505,119963] 0 2024-09-21T12:20:33.180 INFO:tasks.workunit.client.1.smithi192.stdout:6/944: write f8 [2216646,118325] 0 2024-09-21T12:20:33.181 INFO:tasks.workunit.client.0.smithi003.stdout:0/239: mknod d9/d12/c4f 0 2024-09-21T12:20:33.187 INFO:tasks.workunit.client.0.smithi003.stdout:0/240: mknod d9/d12/c50 0 2024-09-21T12:20:33.188 INFO:tasks.workunit.client.1.smithi192.stdout:8/850: truncate d14/d1a/d1d/db6/fb8 4702466 0 2024-09-21T12:20:33.188 INFO:tasks.workunit.client.1.smithi192.stdout:7/765: write d6/f38 [635346,109510] 0 2024-09-21T12:20:33.188 INFO:tasks.workunit.client.1.smithi192.stdout:3/738: rmdir db/d16/d18/da7/d10e/d2e/db8 39 2024-09-21T12:20:33.189 INFO:tasks.workunit.client.1.smithi192.stdout:8/851: chown d14/d18/d94/da4/l119 2 1 2024-09-21T12:20:33.195 INFO:tasks.workunit.client.0.smithi003.stdout:9/330: rename d2/d20/d22/f2f to d2/d20/f77 0 2024-09-21T12:20:33.195 INFO:tasks.workunit.client.0.smithi003.stdout:9/331: chown d2 1 1 2024-09-21T12:20:33.196 INFO:tasks.workunit.client.1.smithi192.stdout:6/945: dread da/d1f/d27/d3e/fe4 [0,4194304] 0 2024-09-21T12:20:33.197 INFO:tasks.workunit.client.1.smithi192.stdout:3/739: symlink db/d16/d18/d21/dde/l110 0 2024-09-21T12:20:33.198 INFO:tasks.workunit.client.1.smithi192.stdout:7/766: creat d6/d20/d69/d90/da7/dc1/f109 x:0 0 0 2024-09-21T12:20:33.204 INFO:tasks.workunit.client.0.smithi003.stdout:5/221: rename dc/d15/d26/f2d to dc/d2b/f43 0 2024-09-21T12:20:33.205 INFO:tasks.workunit.client.1.smithi192.stdout:8/852: dread d14/d1a/d1d/f64 [0,4194304] 0 2024-09-21T12:20:33.205 INFO:tasks.workunit.client.0.smithi003.stdout:5/222: dread - dc/d15/d21/d30/f42 zero size 2024-09-21T12:20:33.205 INFO:tasks.workunit.client.1.smithi192.stdout:2/771: mkdir d1b/d1e/d5e/d75/dfa 0 2024-09-21T12:20:33.206 INFO:tasks.workunit.client.1.smithi192.stdout:3/740: mkdir db/d16/dc1/def/d111 0 2024-09-21T12:20:33.207 INFO:tasks.workunit.client.1.smithi192.stdout:3/741: chown db/d16/d18/d40/f51 13 1 2024-09-21T12:20:33.208 INFO:tasks.workunit.client.1.smithi192.stdout:7/767: mkdir d6/d20/d69/d90/da7/dc1/d10a 0 2024-09-21T12:20:33.210 INFO:tasks.workunit.client.0.smithi003.stdout:2/177: rename d0/f5 to d0/dd/d16/f3d 0 2024-09-21T12:20:33.213 INFO:tasks.workunit.client.0.smithi003.stdout:5/223: dwrite dc/d15/f3f [0,4194304] 0 2024-09-21T12:20:33.215 INFO:tasks.workunit.client.1.smithi192.stdout:7/768: rmdir d6/d9/d1f 39 2024-09-21T12:20:33.218 INFO:tasks.workunit.client.1.smithi192.stdout:8/853: fdatasync d14/d1a/d1d/d48/f62 0 2024-09-21T12:20:33.219 INFO:tasks.workunit.client.0.smithi003.stdout:3/169: rename d0/l7 to d0/d5/da/d28/d11/l2a 0 2024-09-21T12:20:33.223 INFO:tasks.workunit.client.1.smithi192.stdout:3/742: mkdir db/d16/d112 0 2024-09-21T12:20:33.224 INFO:tasks.workunit.client.0.smithi003.stdout:2/178: truncate d0/f18 1602131 0 2024-09-21T12:20:33.225 INFO:tasks.workunit.client.1.smithi192.stdout:7/769: creat d6/d9/d51/f10b x:0 0 0 2024-09-21T12:20:33.226 INFO:tasks.workunit.client.1.smithi192.stdout:7/770: write d6/d3a/d6d/fd6 [1030401,51112] 0 2024-09-21T12:20:33.227 INFO:tasks.workunit.client.0.smithi003.stdout:8/218: rename d7/df/c1f to d7/df/d20/d24/c48 0 2024-09-21T12:20:33.230 INFO:tasks.workunit.client.0.smithi003.stdout:5/224: truncate dc/d15/d21/f24 3396071 0 2024-09-21T12:20:33.232 INFO:tasks.workunit.client.1.smithi192.stdout:9/898: unlink d5/dc/l99 0 2024-09-21T12:20:33.233 INFO:tasks.workunit.client.0.smithi003.stdout:2/179: dread - d0/d21/d2f/f38 zero size 2024-09-21T12:20:33.233 INFO:tasks.workunit.client.1.smithi192.stdout:3/743: read - db/d16/d18/da7/d10e/f79 zero size 2024-09-21T12:20:33.236 INFO:tasks.workunit.client.0.smithi003.stdout:6/215: rename d4/d13/f27 to d4/d13/d19/d38/f41 0 2024-09-21T12:20:33.236 INFO:tasks.workunit.client.1.smithi192.stdout:9/899: dread d5/dc/d64/fe0 [0,4194304] 0 2024-09-21T12:20:33.237 INFO:tasks.workunit.client.0.smithi003.stdout:6/216: fsync d4/d13/d22/f40 0 2024-09-21T12:20:33.237 INFO:tasks.workunit.client.0.smithi003.stdout:2/180: dread d0/d21/f35 [0,4194304] 0 2024-09-21T12:20:33.238 INFO:tasks.workunit.client.1.smithi192.stdout:8/854: creat d14/d1a/d1d/d46/d4e/d83/d8d/f11e x:0 0 0 2024-09-21T12:20:33.239 INFO:tasks.workunit.client.0.smithi003.stdout:6/217: write d4/d13/f2c [4424884,53766] 0 2024-09-21T12:20:33.239 INFO:tasks.workunit.client.1.smithi192.stdout:7/771: mkdir d6/d3a/d6d/d10c 0 2024-09-21T12:20:33.242 INFO:tasks.workunit.client.0.smithi003.stdout:5/225: creat dc/d2b/f44 x:0 0 0 2024-09-21T12:20:33.245 INFO:tasks.workunit.client.1.smithi192.stdout:8/855: symlink d14/d1a/d1d/d46/d4e/d83/l11f 0 2024-09-21T12:20:33.245 INFO:tasks.workunit.client.1.smithi192.stdout:8/856: chown d14/d18/f93 9140 1 2024-09-21T12:20:33.246 INFO:tasks.workunit.client.0.smithi003.stdout:3/170: rename d0/d5/da/d28/f24 to d0/d5/da/d28/dd/f2b 0 2024-09-21T12:20:33.247 INFO:tasks.workunit.client.0.smithi003.stdout:3/171: read - d0/f27 zero size 2024-09-21T12:20:33.247 INFO:tasks.workunit.client.0.smithi003.stdout:3/172: readlink d0/d5/da/d28/dd/l12 0 2024-09-21T12:20:33.248 INFO:tasks.workunit.client.0.smithi003.stdout:3/173: stat d0/f27 0 2024-09-21T12:20:33.249 INFO:tasks.workunit.client.0.smithi003.stdout:3/174: read d0/f16 [5827375,22537] 0 2024-09-21T12:20:33.251 INFO:tasks.workunit.client.1.smithi192.stdout:3/744: creat db/d16/dc1/def/d111/f113 x:0 0 0 2024-09-21T12:20:33.259 INFO:tasks.workunit.client.0.smithi003.stdout:5/226: mknod dc/d15/d1c/c45 0 2024-09-21T12:20:33.260 INFO:tasks.workunit.client.1.smithi192.stdout:7/772: mknod d6/d9/d1f/d99/c10d 0 2024-09-21T12:20:33.263 INFO:tasks.workunit.client.1.smithi192.stdout:1/813: sync 2024-09-21T12:20:33.263 INFO:tasks.workunit.client.1.smithi192.stdout:4/768: sync 2024-09-21T12:20:33.264 INFO:tasks.workunit.client.0.smithi003.stdout:7/204: sync 2024-09-21T12:20:33.266 INFO:tasks.workunit.client.0.smithi003.stdout:7/205: dread - d8/f1d zero size 2024-09-21T12:20:33.267 INFO:tasks.workunit.client.0.smithi003.stdout:5/227: dwrite dc/d15/d21/d30/f42 [0,4194304] 0 2024-09-21T12:20:33.270 INFO:tasks.workunit.client.0.smithi003.stdout:5/228: dread dc/f1a [0,4194304] 0 2024-09-21T12:20:33.271 INFO:tasks.workunit.client.0.smithi003.stdout:4/201: dread d9/da/fd [0,4194304] 0 2024-09-21T12:20:33.276 INFO:tasks.workunit.client.0.smithi003.stdout:3/175: creat d0/d5/da/d28/dd/d23/d26/f2c x:0 0 0 2024-09-21T12:20:33.277 INFO:tasks.workunit.client.1.smithi192.stdout:6/946: write da/f57 [1848167,48595] 0 2024-09-21T12:20:33.279 INFO:tasks.workunit.client.1.smithi192.stdout:6/947: write da/d1f/d27/d6b/f126 [9398626,30428] 0 2024-09-21T12:20:33.282 INFO:tasks.workunit.client.1.smithi192.stdout:4/769: unlink d2/db/d3e/d57/lef 0 2024-09-21T12:20:33.285 INFO:tasks.workunit.client.0.smithi003.stdout:4/202: chown d9/c29 10 1 2024-09-21T12:20:33.286 INFO:tasks.workunit.client.0.smithi003.stdout:4/203: chown d9/da/fd 12166395 1 2024-09-21T12:20:33.286 INFO:tasks.workunit.client.1.smithi192.stdout:6/948: write da/d23/d37/f59 [1286989,25544] 0 2024-09-21T12:20:33.289 INFO:tasks.workunit.client.0.smithi003.stdout:3/176: rename d0/d5/da/d28/fb to d0/d5/da/d28/dd/f2d 0 2024-09-21T12:20:33.291 INFO:tasks.workunit.client.1.smithi192.stdout:6/949: mkdir da/d1f/de6/d139 0 2024-09-21T12:20:33.292 INFO:tasks.workunit.client.0.smithi003.stdout:7/206: mknod d8/d31/d41/c4d 0 2024-09-21T12:20:33.293 INFO:tasks.workunit.client.1.smithi192.stdout:2/772: dwrite d1b/d9e/de1/fae [0,4194304] 0 2024-09-21T12:20:33.294 INFO:tasks.workunit.client.0.smithi003.stdout:5/229: creat dc/d15/d21/d30/d35/f46 x:0 0 0 2024-09-21T12:20:33.295 INFO:tasks.workunit.client.1.smithi192.stdout:2/773: write d1b/d9e/fac [1011865,125286] 0 2024-09-21T12:20:33.296 INFO:tasks.workunit.client.1.smithi192.stdout:2/774: stat d1b/d1e/c98 0 2024-09-21T12:20:33.296 INFO:tasks.workunit.client.1.smithi192.stdout:6/950: read da/d23/d37/d75/d90/fdc [260932,26728] 0 2024-09-21T12:20:33.296 INFO:tasks.workunit.client.0.smithi003.stdout:4/204: symlink d9/da/d36/l40 0 2024-09-21T12:20:33.297 INFO:tasks.workunit.client.1.smithi192.stdout:2/775: fdatasync d1b/d38/d53/f6d 0 2024-09-21T12:20:33.297 INFO:tasks.workunit.client.1.smithi192.stdout:6/951: chown da/d1f/de6/d12f 16531509 1 2024-09-21T12:20:33.298 INFO:tasks.workunit.client.1.smithi192.stdout:6/952: write da/d1f/d27/d88/fbb [1369995,72361] 0 2024-09-21T12:20:33.299 INFO:tasks.workunit.client.1.smithi192.stdout:6/953: readlink da/d1f/l69 0 2024-09-21T12:20:33.300 INFO:tasks.workunit.client.1.smithi192.stdout:2/776: chown d1b/d1e/d5e/d88/d95/d9c/l9d 80028 1 2024-09-21T12:20:33.300 INFO:tasks.workunit.client.0.smithi003.stdout:7/207: fdatasync d8/fe 0 2024-09-21T12:20:33.305 INFO:tasks.workunit.client.1.smithi192.stdout:4/770: getdents d2/db/d1a/dee 0 2024-09-21T12:20:33.305 INFO:tasks.workunit.client.1.smithi192.stdout:4/771: chown d2/d36/d7f/df5/ffe 0 1 2024-09-21T12:20:33.307 INFO:tasks.workunit.client.1.smithi192.stdout:4/772: fdatasync d2/d36/d55/d89/dc8/df7/d6c/db8/f79 0 2024-09-21T12:20:33.311 INFO:tasks.workunit.client.1.smithi192.stdout:2/777: mkdir d1b/d1e/d7b/dfb 0 2024-09-21T12:20:33.311 INFO:tasks.workunit.client.1.smithi192.stdout:4/773: dread d2/d36/d7f/df5/d4f/d82/fa1 [0,4194304] 0 2024-09-21T12:20:33.311 INFO:tasks.workunit.client.0.smithi003.stdout:7/208: symlink d8/d3c/l4e 0 2024-09-21T12:20:33.313 INFO:tasks.workunit.client.1.smithi192.stdout:6/954: mknod da/d23/d37/c13a 0 2024-09-21T12:20:33.316 INFO:tasks.workunit.client.0.smithi003.stdout:8/219: truncate d7/df/f26 298146 0 2024-09-21T12:20:33.317 INFO:tasks.workunit.client.1.smithi192.stdout:9/900: truncate d5/d8/dc7/dd7/de7/fb0 313312 0 2024-09-21T12:20:33.318 INFO:tasks.workunit.client.1.smithi192.stdout:4/774: symlink d2/d36/d55/d89/da6/l102 0 2024-09-21T12:20:33.318 INFO:tasks.workunit.client.0.smithi003.stdout:2/181: dwrite d0/dd/f1b [4194304,4194304] 0 2024-09-21T12:20:33.319 INFO:tasks.workunit.client.0.smithi003.stdout:4/205: mknod d9/d16/c41 0 2024-09-21T12:20:33.322 INFO:tasks.workunit.client.0.smithi003.stdout:8/220: dread d7/de/d1a/f3c [0,4194304] 0 2024-09-21T12:20:33.324 INFO:tasks.workunit.client.1.smithi192.stdout:3/745: dwrite db/d16/d18/da7/d10e/d2e/fc4 [0,4194304] 0 2024-09-21T12:20:33.338 INFO:tasks.workunit.client.1.smithi192.stdout:2/778: dread d1b/d9e/de1/fc7 [0,4194304] 0 2024-09-21T12:20:33.338 INFO:tasks.workunit.client.0.smithi003.stdout:6/218: truncate d4/fc 1622036 0 2024-09-21T12:20:33.339 INFO:tasks.workunit.client.1.smithi192.stdout:4/775: chown l1 795172 1 2024-09-21T12:20:33.341 INFO:tasks.workunit.client.1.smithi192.stdout:1/814: write d2/da/d6b/d7d/f90 [4914839,4472] 0 2024-09-21T12:20:33.344 INFO:tasks.workunit.client.0.smithi003.stdout:2/182: symlink d0/dd/d16/l3e 0 2024-09-21T12:20:33.345 INFO:tasks.workunit.client.1.smithi192.stdout:7/773: dwrite d6/d3a/d63/f65 [0,4194304] 0 2024-09-21T12:20:33.347 INFO:tasks.workunit.client.1.smithi192.stdout:3/746: fsync db/d16/d18/da7/d10e/d2e/f38 0 2024-09-21T12:20:33.350 INFO:tasks.workunit.client.0.smithi003.stdout:8/221: creat d7/df/f49 x:0 0 0 2024-09-21T12:20:33.356 INFO:tasks.workunit.client.0.smithi003.stdout:6/219: symlink d4/d13/l42 0 2024-09-21T12:20:33.360 INFO:tasks.workunit.client.0.smithi003.stdout:4/206: symlink d9/d25/l42 0 2024-09-21T12:20:33.362 INFO:tasks.workunit.client.0.smithi003.stdout:8/222: symlink d7/df/d20/d21/l4a 0 2024-09-21T12:20:33.364 INFO:tasks.workunit.client.1.smithi192.stdout:4/776: rename d2/d36/d55/f60 to d2/d36/d55/d89/dc8/df7/d6c/f103 0 2024-09-21T12:20:33.367 INFO:tasks.workunit.client.0.smithi003.stdout:8/223: dread d7/df/d20/d21/f33 [0,4194304] 0 2024-09-21T12:20:33.368 INFO:tasks.workunit.client.1.smithi192.stdout:7/774: fdatasync d6/d3a/f88 0 2024-09-21T12:20:33.369 INFO:tasks.workunit.client.0.smithi003.stdout:8/224: dread d7/df/d36/f3d [0,4194304] 0 2024-09-21T12:20:33.369 INFO:tasks.workunit.client.1.smithi192.stdout:0/867: sync 2024-09-21T12:20:33.370 INFO:tasks.workunit.client.0.smithi003.stdout:5/230: write dc/f3a [550391,66301] 0 2024-09-21T12:20:33.371 INFO:tasks.workunit.client.1.smithi192.stdout:0/868: readlink d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/lcc 0 2024-09-21T12:20:33.373 INFO:tasks.workunit.client.1.smithi192.stdout:0/869: dread d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/d43/f95 [0,4194304] 0 2024-09-21T12:20:33.373 INFO:tasks.workunit.client.1.smithi192.stdout:3/747: creat db/d16/d18/d33/d4a/de4/f114 x:0 0 0 2024-09-21T12:20:33.375 INFO:tasks.workunit.client.1.smithi192.stdout:0/870: write d3/d5/d28/d39/d50/dd9/d7a/dbe/d92/d51/f82 [2968365,80707] 0 2024-09-21T12:20:33.379 INFO:tasks.workunit.client.1.smithi192.stdout:1/815: rename d2/da/d89/df0 to d2/da/d6b/d108 0 2024-09-21T12:20:33.383 INFO:tasks.workunit.client.1.smithi192.stdout:4/777: symlink d2/d36/d7f/df5/d4f/d71/d9d/dad/d9c/d9e/l104 0 2024-09-21T12:20:33.387 INFO:tasks.workunit.client.1.smithi192.stdout:7/775: mkdir d6/d20/dcc/d10e 0 2024-09-21T12:20:33.387 INFO:tasks.workunit.client.1.smithi192.stdout:6/955: write da/d23/d37/f70 [1283037,56842] 0 2024-09-21T12:20:33.391 INFO:tasks.workunit.client.1.smithi192.stdout:2/779: write f15 [8620182,114486] 0 2024-09-21T12:20:33.392 INFO:tasks.workunit.client.0.smithi003.stdout:4/207: symlink d9/l43 0 2024-09-21T12:20:33.393 INFO:tasks.workunit.client.1.smithi192.stdout:2/780: stat d1b/d38/d53/d8b/da7/cda 0 2024-09-21T12:20:33.394 INFO:tasks.workunit.client.1.smithi192.stdout:9/901: truncate d5/dc/d64/dbb/f4c 540869 0 2024-09-21T12:20:33.394 INFO:tasks.workunit.client.1.smithi192.stdout:3/748: dwrite db/f4f [0,4194304] 0 2024-09-21T12:20:33.396 INFO:tasks.workunit.client.1.smithi192.stdout:9/902: stat d5/dc/dc2/dfb 0 2024-09-21T12:20:33.396 INFO:tasks.workunit.client.1.smithi192.stdout:1/816: rename d2/d12/d2f/d51/d24/d58/f88 to d2/da/d6b/f109 0 2024-09-21T12:20:33.397 INFO:tasks.workunit.client.0.smithi003.stdout:3/177: link d0/d5/da/d28/dd/f2d d0/d5/da/d28/dd/f2e 0 2024-09-21T12:20:33.398 INFO:tasks.workunit.client.1.smithi192.stdout:9/903: fsync d5/d8/dc7/dd7/de7/d55/d70/da0/f120 0 2024-09-21T12:20:33.402 INFO:tasks.workunit.client.1.smithi192.stdout:3/749: dwrite db/d16/d18/d33/fa1 [0,4194304] 0 2024-09-21T12:20:33.404 INFO:tasks.workunit.client.1.smithi192.stdout:6/956: rmdir da/dfc 39 2024-09-21T12:20:33.404 INFO:tasks.workunit.client.0.smithi003.stdout:3/178: dwrite d0/d5/da/ff [0,4194304] 0 2024-09-21T12:20:33.407 INFO:tasks.workunit.client.0.smithi003.stdout:2/183: write d0/fa [1088228,3958] 0 2024-09-21T12:20:33.415 INFO:tasks.workunit.client.0.smithi003.stdout:4/208: symlink d9/d16/l44 0 2024-09-21T12:20:33.422 INFO:tasks.workunit.client.0.smithi003.stdout:3/179: rename d0/d5/f10 to d0/d5/da/d28/dd/d23/f2f 0 2024-09-21T12:20:33.423 INFO:tasks.workunit.client.0.smithi003.stdout:3/180: chown d0/d5/c13 3 1 2024-09-21T12:20:33.427 INFO:tasks.workunit.client.1.smithi192.stdout:2/781: rename d1b/d1e/d5e/d75/f8f to d1b/d1e/d5e/d75/dfa/ffc 0 2024-09-21T12:20:33.428 INFO:tasks.workunit.client.0.smithi003.stdout:5/231: link dc/d15/l1b dc/d15/l47 0 2024-09-21T12:20:33.428 INFO:tasks.workunit.client.0.smithi003.stdout:6/220: dwrite d4/f5 [0,4194304] 0 2024-09-21T12:20:33.429 INFO:tasks.workunit.client.0.smithi003.stdout:5/232: fdatasync dc/f40 0 2024-09-21T12:20:33.429 INFO:tasks.workunit.client.0.smithi003.stdout:6/221: stat d4/d13/d2e 0 2024-09-21T12:20:33.431 INFO:tasks.workunit.client.1.smithi192.stdout:9/904: unlink d5/dc/d64/dbb/d3d/f104 0 2024-09-21T12:20:33.434 INFO:tasks.workunit.client.0.smithi003.stdout:5/233: dread dc/f10 [0,4194304] 0 2024-09-21T12:20:33.435 INFO:tasks.workunit.client.1.smithi192.stdout:8/857: sync 2024-09-21T12:20:33.440 INFO:tasks.workunit.client.1.smithi192.stdout:6/957: mkdir da/d23/d37/d75/dd0/d13b 0 2024-09-21T12:20:33.440 INFO:tasks.workunit.client.1.smithi192.stdout:4/778: write d2/f84 [786811,40963] 0 2024-09-21T12:20:33.440 INFO:tasks.workunit.client.0.smithi003.stdout:3/181: chown d0/d5/da/d28/d11/l2a 26 1 2024-09-21T12:20:33.442 INFO:tasks.workunit.client.1.smithi192.stdout:0/871: truncate d3/d5/dd7/ff1 353787 0 2024-09-21T12:20:33.444 INFO:tasks.workunit.client.0.smithi003.stdout:2/184: mkdir d0/dd/d22/d37/d3f 0 2024-09-21T12:20:33.447 INFO:tasks.workunit.client.1.smithi192.stdout:6/958: dread da/d1f/fb7 [0,4194304] 0 2024-09-21T12:20:33.448 INFO:tasks.workunit.client.1.smithi192.stdout:0/872: dread d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/d33/f5e [0,4194304] 0 2024-09-21T12:20:33.449 INFO:tasks.workunit.client.1.smithi192.stdout:0/873: stat d3/d5/d69/dbf/cfc 0 2024-09-21T12:20:33.451 INFO:tasks.workunit.client.0.smithi003.stdout:5/234: creat dc/d15/f48 x:0 0 0 2024-09-21T12:20:33.452 INFO:tasks.workunit.client.0.smithi003.stdout:5/235: dread - dc/d15/d21/d30/d35/f46 zero size 2024-09-21T12:20:33.452 INFO:tasks.workunit.client.1.smithi192.stdout:1/817: dread d2/da/fad [0,4194304] 0 2024-09-21T12:20:33.453 INFO:tasks.workunit.client.0.smithi003.stdout:5/236: fdatasync dc/d15/d21/d30/d35/f46 0 2024-09-21T12:20:33.453 INFO:tasks.workunit.client.1.smithi192.stdout:2/782: unlink f15 0 2024-09-21T12:20:33.457 INFO:tasks.workunit.client.0.smithi003.stdout:8/225: truncate d7/df/f26 435750 0 2024-09-21T12:20:33.458 INFO:tasks.workunit.client.1.smithi192.stdout:9/905: fsync d5/d19/fa8 0 2024-09-21T12:20:33.462 INFO:tasks.workunit.client.1.smithi192.stdout:8/858: rename d14/d1a/d1d/d46/d4e/f76 to d14/d1a/d1d/d46/d4e/db5/f120 0 2024-09-21T12:20:33.462 INFO:tasks.workunit.client.1.smithi192.stdout:8/859: readlink d14/d1a/d1d/d46/d4e/d10d/laa 0 2024-09-21T12:20:33.465 INFO:tasks.workunit.client.1.smithi192.stdout:3/750: mknod db/d16/d18/c115 0 2024-09-21T12:20:33.466 INFO:tasks.workunit.client.1.smithi192.stdout:3/751: write db/d16/d18/d40/f6e [642784,26107] 0 2024-09-21T12:20:33.467 INFO:tasks.workunit.client.0.smithi003.stdout:4/209: rename d9/d16/l1b to d9/da/l45 0 2024-09-21T12:20:33.471 INFO:tasks.workunit.client.1.smithi192.stdout:7/776: link d6/d9/d1f/d3e/d7a/d8a/da2/fb5 d6/d9/d1f/d99/f10f 0 2024-09-21T12:20:33.476 INFO:tasks.workunit.client.1.smithi192.stdout:8/860: dread d14/d1a/d1d/d20/d5f/fa3 [0,4194304] 0 2024-09-21T12:20:33.476 INFO:tasks.workunit.client.1.smithi192.stdout:8/861: write fd [1630629,57422] 0 2024-09-21T12:20:33.477 INFO:tasks.workunit.client.0.smithi003.stdout:6/222: rename d4/d13/f35 to d4/d11/d1d/f43 0 2024-09-21T12:20:33.477 INFO:tasks.workunit.client.0.smithi003.stdout:8/226: rename d7 to d7/df/d20/d21/d4b 22 2024-09-21T12:20:33.478 INFO:tasks.workunit.client.0.smithi003.stdout:1/231: sync 2024-09-21T12:20:33.479 INFO:tasks.workunit.client.0.smithi003.stdout:8/227: dread - d7/df/d20/d21/f3a zero size 2024-09-21T12:20:33.480 INFO:tasks.workunit.client.1.smithi192.stdout:0/874: mknod d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/dc6/d83/d87/c109 0 2024-09-21T12:20:33.482 INFO:tasks.workunit.client.0.smithi003.stdout:5/237: link dc/l18 dc/d2b/l49 0 2024-09-21T12:20:33.483 INFO:tasks.workunit.client.1.smithi192.stdout:1/818: chown d2/da/f8f 350523408 1 2024-09-21T12:20:33.484 INFO:tasks.workunit.client.0.smithi003.stdout:3/182: write d0/d5/f1e [2173633,50826] 0 2024-09-21T12:20:33.484 INFO:tasks.workunit.client.1.smithi192.stdout:1/819: chown d2/d12/cd 17857 1 2024-09-21T12:20:33.485 INFO:tasks.workunit.client.0.smithi003.stdout:3/183: write d0/d5/da/d28/dd/d23/d26/f2c [176352,82818] 0 2024-09-21T12:20:33.487 INFO:tasks.workunit.client.1.smithi192.stdout:1/820: readlink d2/d12/d2f/d51/d24/d65/l96 0 2024-09-21T12:20:33.487 INFO:tasks.workunit.client.1.smithi192.stdout:4/779: dwrite d2/d36/d55/d89/dc8/df7/d83/f95 [0,4194304] 0 2024-09-21T12:20:33.488 INFO:tasks.workunit.client.0.smithi003.stdout:6/223: creat d4/d13/d2e/f44 x:0 0 0 2024-09-21T12:20:33.489 INFO:tasks.workunit.client.1.smithi192.stdout:1/821: chown d2/d12/d2f/d51/d24/d65/d8b/cd3 1181 1 2024-09-21T12:20:33.490 INFO:tasks.workunit.client.0.smithi003.stdout:6/224: write d4/fc [1943644,102720] 0 2024-09-21T12:20:33.491 INFO:tasks.workunit.client.0.smithi003.stdout:6/225: stat d4/d13/d19/d38/f41 0 2024-09-21T12:20:33.494 INFO:tasks.workunit.client.0.smithi003.stdout:2/185: getdents d0 0 2024-09-21T12:20:33.496 INFO:tasks.workunit.client.0.smithi003.stdout:5/238: fsync dc/f1a 0 2024-09-21T12:20:33.497 INFO:tasks.workunit.client.0.smithi003.stdout:4/210: write d9/f18 [844957,6271] 0 2024-09-21T12:20:33.500 INFO:tasks.workunit.client.0.smithi003.stdout:3/184: chown d0/d5/da/d28/d11/f1d 10504979 1 2024-09-21T12:20:33.503 INFO:tasks.workunit.client.1.smithi192.stdout:8/862: creat d14/d1a/d1d/d46/d4e/d83/d8d/dd8/f121 x:0 0 0 2024-09-21T12:20:33.504 INFO:tasks.workunit.client.1.smithi192.stdout:6/959: link da/d1f/de6/d12f/f130 da/d1f/d56/d78/f13c 0 2024-09-21T12:20:33.504 INFO:tasks.workunit.client.0.smithi003.stdout:5/239: dwrite dc/d2b/f44 [0,4194304] 0 2024-09-21T12:20:33.505 INFO:tasks.workunit.client.1.smithi192.stdout:6/960: read da/f57 [96045,4145] 0 2024-09-21T12:20:33.506 INFO:tasks.workunit.client.1.smithi192.stdout:6/961: readlink da/d23/d37/dc5/lf9 0 2024-09-21T12:20:33.509 INFO:tasks.workunit.client.0.smithi003.stdout:5/240: write dc/d15/f1f [638302,50813] 0 2024-09-21T12:20:33.509 INFO:tasks.workunit.client.0.smithi003.stdout:6/226: creat d4/d9/f45 x:0 0 0 2024-09-21T12:20:33.509 INFO:tasks.workunit.client.1.smithi192.stdout:2/783: creat d1b/d1e/d5e/d75/d8d/dde/ffd x:0 0 0 2024-09-21T12:20:33.511 INFO:tasks.workunit.client.0.smithi003.stdout:8/228: dwrite d7/df/d36/f3d [0,4194304] 0 2024-09-21T12:20:33.512 INFO:tasks.workunit.client.0.smithi003.stdout:2/186: rename d0/d21/d2c/l32 to d0/dd/d16/l40 0 2024-09-21T12:20:33.516 INFO:tasks.workunit.client.0.smithi003.stdout:8/229: write d7/df/d20/d24/f2e [1926428,49348] 0 2024-09-21T12:20:33.520 INFO:tasks.workunit.client.1.smithi192.stdout:1/822: unlink d2/da/d6b/d7d/l9b 0 2024-09-21T12:20:33.520 INFO:tasks.workunit.client.1.smithi192.stdout:7/777: truncate d6/d9/f11 1247743 0 2024-09-21T12:20:33.521 INFO:tasks.workunit.client.0.smithi003.stdout:2/187: dread d0/dd/d16/f19 [0,4194304] 0 2024-09-21T12:20:33.522 INFO:tasks.workunit.client.0.smithi003.stdout:3/185: dread d0/d5/da/d28/dd/f2d [0,4194304] 0 2024-09-21T12:20:33.523 INFO:tasks.workunit.client.0.smithi003.stdout:6/227: symlink d4/d11/l46 0 2024-09-21T12:20:33.524 INFO:tasks.workunit.client.0.smithi003.stdout:3/186: chown d0/c1 5465190 1 2024-09-21T12:20:33.525 INFO:tasks.workunit.client.0.smithi003.stdout:3/187: readlink d0/d5/da/d28/d11/l1b 0 2024-09-21T12:20:33.528 INFO:tasks.workunit.client.0.smithi003.stdout:1/232: getdents d4 0 2024-09-21T12:20:33.528 INFO:tasks.workunit.client.0.smithi003.stdout:8/230: mkdir d7/df/d20/d21/d4c 0 2024-09-21T12:20:33.528 INFO:tasks.workunit.client.0.smithi003.stdout:3/188: readlink d0/d5/da/d28/d11/l2a 0 2024-09-21T12:20:33.529 INFO:tasks.workunit.client.0.smithi003.stdout:6/228: read d4/d13/d22/f2b [1467095,55499] 0 2024-09-21T12:20:33.531 INFO:tasks.workunit.client.1.smithi192.stdout:9/906: creat d5/dc/d80/d44/f121 x:0 0 0 2024-09-21T12:20:33.533 INFO:tasks.workunit.client.0.smithi003.stdout:2/188: symlink d0/dd/d22/l41 0 2024-09-21T12:20:33.534 INFO:tasks.workunit.client.0.smithi003.stdout:2/189: write d0/d21/f39 [487876,70506] 0 2024-09-21T12:20:33.537 INFO:tasks.workunit.client.1.smithi192.stdout:1/823: creat d2/d12/d2f/d51/d24/d58/f10a x:0 0 0 2024-09-21T12:20:33.538 INFO:tasks.workunit.client.1.smithi192.stdout:1/824: chown d2/d12/d2f/d51/d24/d65/d8b/dd5/fee 3 1 2024-09-21T12:20:33.539 INFO:tasks.workunit.client.1.smithi192.stdout:1/825: read d2/d12/d2f/d51/d24/d65/d8b/fd7 [630759,23196] 0 2024-09-21T12:20:33.546 INFO:tasks.workunit.client.0.smithi003.stdout:7/209: sync 2024-09-21T12:20:33.546 INFO:tasks.workunit.client.0.smithi003.stdout:0/241: sync 2024-09-21T12:20:33.546 INFO:tasks.workunit.client.0.smithi003.stdout:9/332: sync 2024-09-21T12:20:33.547 INFO:tasks.workunit.client.0.smithi003.stdout:1/233: rename d4/d11/d14/d25/d42/c4c to d4/df/d19/c58 0 2024-09-21T12:20:33.548 INFO:tasks.workunit.client.0.smithi003.stdout:0/242: fdatasync d9/d12/d22/f4a 0 2024-09-21T12:20:33.551 INFO:tasks.workunit.client.0.smithi003.stdout:0/243: read d9/d12/d1e/d2b/d26/f35 [4083830,41164] 0 2024-09-21T12:20:33.554 INFO:tasks.workunit.client.1.smithi192.stdout:8/863: fdatasync fc 0 2024-09-21T12:20:33.555 INFO:tasks.workunit.client.1.smithi192.stdout:6/962: rename da/d23/d37/f39 to da/d1f/d48/d117/f13d 0 2024-09-21T12:20:33.555 INFO:tasks.workunit.client.1.smithi192.stdout:9/907: mkdir d5/dc/d80/d44/d8e/dd6/d122 0 2024-09-21T12:20:33.555 INFO:tasks.workunit.client.1.smithi192.stdout:0/875: fsync d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/d33/dae/db4/fc0 0 2024-09-21T12:20:33.556 INFO:tasks.workunit.client.1.smithi192.stdout:2/784: write d1b/d1e/f31 [1908810,33236] 0 2024-09-21T12:20:33.558 INFO:tasks.workunit.client.1.smithi192.stdout:4/780: creat d2/d36/d55/d89/dc8/df7/f105 x:0 0 0 2024-09-21T12:20:33.559 INFO:tasks.workunit.client.0.smithi003.stdout:5/241: dwrite dc/f10 [0,4194304] 0 2024-09-21T12:20:33.559 INFO:tasks.workunit.client.1.smithi192.stdout:9/908: dread - d5/d8/dc7/dd7/fe9 zero size 2024-09-21T12:20:33.561 INFO:tasks.workunit.client.0.smithi003.stdout:3/189: creat d0/d5/da/d28/dd/d23/d26/f30 x:0 0 0 2024-09-21T12:20:33.562 INFO:tasks.workunit.client.1.smithi192.stdout:4/781: chown d2/db/d1a/dee/f70 1899 1 2024-09-21T12:20:33.564 INFO:tasks.workunit.client.1.smithi192.stdout:1/826: dwrite d2/d12/d2f/d51/d24/f4c [0,4194304] 0 2024-09-21T12:20:33.564 INFO:tasks.workunit.client.0.smithi003.stdout:0/244: dwrite d9/d12/d17/d21/f42 [0,4194304] 0 2024-09-21T12:20:33.565 INFO:tasks.workunit.client.0.smithi003.stdout:2/190: readlink d0/dd/d16/l40 0 2024-09-21T12:20:33.565 INFO:tasks.workunit.client.0.smithi003.stdout:0/245: readlink d9/d12/d1e/d2b/l4b 0 2024-09-21T12:20:33.566 INFO:tasks.workunit.client.0.smithi003.stdout:7/210: readlink d8/db/d13/l26 0 2024-09-21T12:20:33.567 INFO:tasks.workunit.client.1.smithi192.stdout:1/827: read d2/d12/d2f/d51/d24/d58/f91 [744395,34702] 0 2024-09-21T12:20:33.567 INFO:tasks.workunit.client.1.smithi192.stdout:8/864: dread d14/d18/f28 [0,4194304] 0 2024-09-21T12:20:33.568 INFO:tasks.workunit.client.1.smithi192.stdout:8/865: readlink d14/d1a/d1d/d20/l5d 0 2024-09-21T12:20:33.571 INFO:tasks.workunit.client.0.smithi003.stdout:8/231: mkdir d7/df/d20/d21/d4c/d4d 0 2024-09-21T12:20:33.574 INFO:tasks.workunit.client.0.smithi003.stdout:6/229: write d4/d13/d2e/d37/f2d [399510,109923] 0 2024-09-21T12:20:33.578 INFO:tasks.workunit.client.1.smithi192.stdout:0/876: symlink d3/d5/d28/d39/d50/dd9/d7a/dbe/l10a 0 2024-09-21T12:20:33.581 INFO:tasks.workunit.client.0.smithi003.stdout:3/190: truncate d0/f16 280882 0 2024-09-21T12:20:33.582 INFO:tasks.workunit.client.0.smithi003.stdout:4/211: link d9/da/c21 d9/da/c46 0 2024-09-21T12:20:33.583 INFO:tasks.workunit.client.0.smithi003.stdout:4/212: write d9/d25/f39 [1336503,98031] 0 2024-09-21T12:20:33.583 INFO:tasks.workunit.client.1.smithi192.stdout:9/909: read d5/dc/d40/fdb [1302373,94426] 0 2024-09-21T12:20:33.584 INFO:tasks.workunit.client.0.smithi003.stdout:2/191: creat d0/d1c/f42 x:0 0 0 2024-09-21T12:20:33.584 INFO:tasks.workunit.client.1.smithi192.stdout:4/782: dread d2/d36/d7f/df5/d4f/d71/d9d/dad/f25 [0,4194304] 0 2024-09-21T12:20:33.585 INFO:tasks.workunit.client.1.smithi192.stdout:1/828: creat d2/d12/d2f/d41/f10b x:0 0 0 2024-09-21T12:20:33.587 INFO:tasks.workunit.client.1.smithi192.stdout:0/877: dwrite d3/d5/d28/d39/f41 [4194304,4194304] 0 2024-09-21T12:20:33.587 INFO:tasks.workunit.client.1.smithi192.stdout:8/866: unlink d14/d1a/d1d/d48/ffd 0 2024-09-21T12:20:33.588 INFO:tasks.workunit.client.0.smithi003.stdout:8/232: symlink d7/de/d11/l4e 0 2024-09-21T12:20:33.589 INFO:tasks.workunit.client.1.smithi192.stdout:1/829: chown d2/d12/d2f/d51/d24/d65/d8b/dd5/fee 5304233 1 2024-09-21T12:20:33.591 INFO:tasks.workunit.client.0.smithi003.stdout:8/233: write d7/df/d20/d21/f37 [109656,116612] 0 2024-09-21T12:20:33.593 INFO:tasks.workunit.client.0.smithi003.stdout:2/192: dread d0/dd/d16/f2a [0,4194304] 0 2024-09-21T12:20:33.594 INFO:tasks.workunit.client.0.smithi003.stdout:3/191: mkdir d0/d5/da/d28/d31 0 2024-09-21T12:20:33.596 INFO:tasks.workunit.client.1.smithi192.stdout:3/752: sync 2024-09-21T12:20:33.602 INFO:tasks.workunit.client.0.smithi003.stdout:7/211: truncate d8/db/f1c 1526235 0 2024-09-21T12:20:33.604 INFO:tasks.workunit.client.1.smithi192.stdout:9/910: creat d5/dc/d40/f123 x:0 0 0 2024-09-21T12:20:33.605 INFO:tasks.workunit.client.1.smithi192.stdout:2/785: creat d1b/d1e/d5e/ffe x:0 0 0 2024-09-21T12:20:33.606 INFO:tasks.workunit.client.0.smithi003.stdout:6/230: dread d4/d13/d22/f2b [0,4194304] 0 2024-09-21T12:20:33.606 INFO:tasks.workunit.client.1.smithi192.stdout:2/786: readlink d1b/d1e/d5e/d88/d95/le7 0 2024-09-21T12:20:33.607 INFO:tasks.workunit.client.0.smithi003.stdout:6/231: fsync d4/d13/f2c 0 2024-09-21T12:20:33.607 INFO:tasks.workunit.client.1.smithi192.stdout:6/963: write da/d1f/d27/d6b/f8c [2484653,85377] 0 2024-09-21T12:20:33.608 INFO:tasks.workunit.client.1.smithi192.stdout:1/830: creat d2/d12/d2f/d51/d24/d65/d8b/f10c x:0 0 0 2024-09-21T12:20:33.610 INFO:tasks.workunit.client.1.smithi192.stdout:9/911: write d5/d8/dc7/dd7/de7/d55/d70/da0/da2/daf/f11f [24434,15018] 0 2024-09-21T12:20:33.613 INFO:tasks.workunit.client.1.smithi192.stdout:4/783: dread d2/db/d1a/dee/f70 [0,4194304] 0 2024-09-21T12:20:33.614 INFO:tasks.workunit.client.0.smithi003.stdout:7/212: symlink d8/db/d32/d43/l4f 0 2024-09-21T12:20:33.615 INFO:tasks.workunit.client.1.smithi192.stdout:8/867: dread d14/d1a/d1d/d20/d5f/f68 [0,4194304] 0 2024-09-21T12:20:33.616 INFO:tasks.workunit.client.0.smithi003.stdout:5/242: getdents dc/d15/d21/d30/d35 0 2024-09-21T12:20:33.619 INFO:tasks.workunit.client.0.smithi003.stdout:9/333: truncate d2/da/d2a/f55 174969 0 2024-09-21T12:20:33.623 INFO:tasks.workunit.client.0.smithi003.stdout:2/193: creat d0/d21/d30/f43 x:0 0 0 2024-09-21T12:20:33.627 INFO:tasks.workunit.client.0.smithi003.stdout:6/232: mknod d4/d13/d22/c47 0 2024-09-21T12:20:33.628 INFO:tasks.workunit.client.0.smithi003.stdout:6/233: readlink d4/d9/l2a 0 2024-09-21T12:20:33.631 INFO:tasks.workunit.client.0.smithi003.stdout:3/192: rename d0/d5/da/d28/dd/d23/f2f to d0/d5/da/d28/d31/f32 0 2024-09-21T12:20:33.632 INFO:tasks.workunit.client.1.smithi192.stdout:4/784: dread d2/db/d1a/dee/f5e [0,4194304] 0 2024-09-21T12:20:33.632 INFO:tasks.workunit.client.0.smithi003.stdout:0/246: getdents d9/d12/d17/d21 0 2024-09-21T12:20:33.636 INFO:tasks.workunit.client.0.smithi003.stdout:5/243: mkdir dc/d15/d21/d28/d4a 0 2024-09-21T12:20:33.637 INFO:tasks.workunit.client.0.smithi003.stdout:5/244: chown dc/d15/f3f 311138222 1 2024-09-21T12:20:33.639 INFO:tasks.workunit.client.0.smithi003.stdout:8/234: truncate d7/df/f1b 3868144 0 2024-09-21T12:20:33.640 INFO:tasks.workunit.client.0.smithi003.stdout:2/194: rmdir d0/dd/d16 39 2024-09-21T12:20:33.645 INFO:tasks.workunit.client.0.smithi003.stdout:6/234: rename d4/d13/d19/d23/c34 to d4/d13/d19/d38/c48 0 2024-09-21T12:20:33.648 INFO:tasks.workunit.client.0.smithi003.stdout:3/193: creat d0/d5/da/d28/f33 x:0 0 0 2024-09-21T12:20:33.655 INFO:tasks.workunit.client.0.smithi003.stdout:5/245: mkdir dc/d15/d21/d30/d4b 0 2024-09-21T12:20:33.656 INFO:tasks.workunit.client.0.smithi003.stdout:5/246: chown cb 1016898 1 2024-09-21T12:20:33.659 INFO:tasks.workunit.client.0.smithi003.stdout:8/235: mknod d7/df/d20/d21/d4c/c4f 0 2024-09-21T12:20:33.664 INFO:tasks.workunit.client.0.smithi003.stdout:6/235: creat d4/d13/d19/f49 x:0 0 0 2024-09-21T12:20:33.666 INFO:tasks.workunit.client.0.smithi003.stdout:8/236: dwrite d7/f14 [0,4194304] 0 2024-09-21T12:20:33.667 INFO:tasks.workunit.client.0.smithi003.stdout:8/237: dread - d7/df/d16/f46 zero size 2024-09-21T12:20:33.669 INFO:tasks.workunit.client.1.smithi192.stdout:7/778: sync 2024-09-21T12:20:33.672 INFO:tasks.workunit.client.0.smithi003.stdout:2/195: dread d0/d21/d2f/f3a [0,4194304] 0 2024-09-21T12:20:33.675 INFO:tasks.workunit.client.0.smithi003.stdout:0/247: write d9/d12/f1c [1176045,87110] 0 2024-09-21T12:20:33.677 INFO:tasks.workunit.client.0.smithi003.stdout:5/247: creat dc/d15/d1c/f4c x:0 0 0 2024-09-21T12:20:33.679 INFO:tasks.workunit.client.0.smithi003.stdout:9/334: write d2/d20/d22/d5e/f65 [491992,42096] 0 2024-09-21T12:20:33.686 INFO:tasks.workunit.client.0.smithi003.stdout:8/238: rename d7/f9 to d7/df/d20/d21/f50 0 2024-09-21T12:20:33.688 INFO:tasks.workunit.client.0.smithi003.stdout:8/239: truncate d7/df/d20/d21/f45 858971 0 2024-09-21T12:20:33.692 INFO:tasks.workunit.client.0.smithi003.stdout:5/248: chown dc/d2b/l49 1 1 2024-09-21T12:20:33.693 INFO:tasks.workunit.client.1.smithi192.stdout:0/878: unlink d3/d5/d69/db2/cc2 0 2024-09-21T12:20:33.694 INFO:tasks.workunit.client.0.smithi003.stdout:3/194: dwrite d0/d5/da/d28/dd/f2d [0,4194304] 0 2024-09-21T12:20:33.694 INFO:tasks.workunit.client.1.smithi192.stdout:0/879: chown d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/dc6/d83/c84 20 1 2024-09-21T12:20:33.700 INFO:tasks.workunit.client.1.smithi192.stdout:2/787: rename d1b/d1e/d7b/de9 to d1b/d1e/d62/dff 0 2024-09-21T12:20:33.701 INFO:tasks.workunit.client.1.smithi192.stdout:9/912: mknod d5/dc/d64/dbb/df1/c124 0 2024-09-21T12:20:33.702 INFO:tasks.workunit.client.1.smithi192.stdout:9/913: fsync d5/d19/f3c 0 2024-09-21T12:20:33.704 INFO:tasks.workunit.client.0.smithi003.stdout:2/196: mkdir d0/dd/d44 0 2024-09-21T12:20:33.704 INFO:tasks.workunit.client.0.smithi003.stdout:2/197: chown d0/d21/f39 30599 1 2024-09-21T12:20:33.705 INFO:tasks.workunit.client.0.smithi003.stdout:8/240: mknod d7/c51 0 2024-09-21T12:20:33.706 INFO:tasks.workunit.client.1.smithi192.stdout:8/868: symlink d14/d1a/d1d/d46/d4e/d83/d8d/d9c/dbe/l122 0 2024-09-21T12:20:33.707 INFO:tasks.workunit.client.1.smithi192.stdout:8/869: chown d14/d18/d94/dc3/f10a 54177849 1 2024-09-21T12:20:33.707 INFO:tasks.workunit.client.1.smithi192.stdout:4/785: truncate d2/d36/f7c 324330 0 2024-09-21T12:20:33.709 INFO:tasks.workunit.client.0.smithi003.stdout:9/335: link d2/f2b d2/d20/d22/f78 0 2024-09-21T12:20:33.709 INFO:tasks.workunit.client.1.smithi192.stdout:7/779: mknod d6/d9/d1f/d3e/c110 0 2024-09-21T12:20:33.711 INFO:tasks.workunit.client.0.smithi003.stdout:9/336: readlink d2/d20/d42/l58 0 2024-09-21T12:20:33.711 INFO:tasks.workunit.client.0.smithi003.stdout:6/236: creat d4/f4a x:0 0 0 2024-09-21T12:20:33.711 INFO:tasks.workunit.client.1.smithi192.stdout:1/831: mkdir d2/d10d 0 2024-09-21T12:20:33.712 INFO:tasks.workunit.client.0.smithi003.stdout:6/237: dread - d4/d13/d19/f49 zero size 2024-09-21T12:20:33.713 INFO:tasks.workunit.client.0.smithi003.stdout:8/241: dwrite d7/f8 [4194304,4194304] 0 2024-09-21T12:20:33.713 INFO:tasks.workunit.client.1.smithi192.stdout:8/870: dwrite d14/d1a/d1d/d39/f4a [0,4194304] 0 2024-09-21T12:20:33.714 INFO:tasks.workunit.client.0.smithi003.stdout:3/195: creat d0/d5/da/d28/d11/f34 x:0 0 0 2024-09-21T12:20:33.715 INFO:tasks.workunit.client.0.smithi003.stdout:8/242: chown f0 1 1 2024-09-21T12:20:33.715 INFO:tasks.workunit.client.1.smithi192.stdout:0/880: creat d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/d43/f10b x:0 0 0 2024-09-21T12:20:33.716 INFO:tasks.workunit.client.0.smithi003.stdout:8/243: stat d7/de/d11/c13 0 2024-09-21T12:20:33.717 INFO:tasks.workunit.client.0.smithi003.stdout:3/196: write d0/d5/da/d28/dd/f2d [2298439,38191] 0 2024-09-21T12:20:33.718 INFO:tasks.workunit.client.0.smithi003.stdout:3/197: write d0/d5/f1e [2166042,82974] 0 2024-09-21T12:20:33.720 INFO:tasks.workunit.client.0.smithi003.stdout:2/198: mknod d0/d21/d30/c45 0 2024-09-21T12:20:33.723 INFO:tasks.workunit.client.0.smithi003.stdout:9/337: fdatasync d2/f10 0 2024-09-21T12:20:33.725 INFO:tasks.workunit.client.0.smithi003.stdout:6/238: mknod d4/d13/d19/d38/c4b 0 2024-09-21T12:20:33.726 INFO:tasks.workunit.client.0.smithi003.stdout:6/239: stat d4/d13/d19/d3f 0 2024-09-21T12:20:33.726 INFO:tasks.workunit.client.1.smithi192.stdout:9/914: creat d5/d8/dc7/dd7/de7/d55/d93/f125 x:0 0 0 2024-09-21T12:20:33.727 INFO:tasks.workunit.client.0.smithi003.stdout:7/213: dread d8/db/ff [0,4194304] 0 2024-09-21T12:20:33.727 INFO:tasks.workunit.client.1.smithi192.stdout:3/753: sync 2024-09-21T12:20:33.732 INFO:tasks.workunit.client.0.smithi003.stdout:0/248: rename d9/d12/d17/d38/d3a/c41 to d9/d12/d17/c51 0 2024-09-21T12:20:33.737 INFO:tasks.workunit.client.0.smithi003.stdout:3/198: creat d0/d5/da/d28/dd/d23/d26/f35 x:0 0 0 2024-09-21T12:20:33.737 INFO:tasks.workunit.client.0.smithi003.stdout:3/199: fdatasync d0/f19 0 2024-09-21T12:20:33.739 INFO:tasks.workunit.client.0.smithi003.stdout:2/199: fdatasync d0/fc 0 2024-09-21T12:20:33.740 INFO:tasks.workunit.client.0.smithi003.stdout:2/200: dread - d0/d21/d2f/f38 zero size 2024-09-21T12:20:33.741 INFO:tasks.workunit.client.1.smithi192.stdout:0/881: symlink d3/df0/l10c 0 2024-09-21T12:20:33.743 INFO:tasks.workunit.client.0.smithi003.stdout:9/338: creat d2/da/d35/f79 x:0 0 0 2024-09-21T12:20:33.744 INFO:tasks.workunit.client.0.smithi003.stdout:8/244: mkdir d7/de/d52 0 2024-09-21T12:20:33.746 INFO:tasks.workunit.client.1.smithi192.stdout:2/788: mknod d1b/d38/d53/d8b/da2/c100 0 2024-09-21T12:20:33.748 INFO:tasks.workunit.client.1.smithi192.stdout:4/786: mknod d2/db/d3e/d57/c106 0 2024-09-21T12:20:33.749 INFO:tasks.workunit.client.1.smithi192.stdout:2/789: readlink d1b/d1e/d5e/d75/lbc 0 2024-09-21T12:20:33.749 INFO:tasks.workunit.client.1.smithi192.stdout:6/964: dwrite da/d23/d37/d75/de2/f100 [0,4194304] 0 2024-09-21T12:20:33.750 INFO:tasks.workunit.client.1.smithi192.stdout:0/882: dwrite d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/dc6/d83/fc7 [0,4194304] 0 2024-09-21T12:20:33.750 INFO:tasks.workunit.client.0.smithi003.stdout:0/249: mknod d9/d12/d17/d38/d3a/c52 0 2024-09-21T12:20:33.750 INFO:tasks.workunit.client.0.smithi003.stdout:6/240: dread d4/fa [0,4194304] 0 2024-09-21T12:20:33.752 INFO:tasks.workunit.client.1.smithi192.stdout:4/787: chown d2/d36/d7f/df5/d4f/lda 40055147 1 2024-09-21T12:20:33.752 INFO:tasks.workunit.client.0.smithi003.stdout:9/339: dwrite d2/d20/f21 [4194304,4194304] 0 2024-09-21T12:20:33.753 INFO:tasks.workunit.client.1.smithi192.stdout:0/883: dread d3/d5/d28/d39/d50/fc1 [0,4194304] 0 2024-09-21T12:20:33.753 INFO:tasks.workunit.client.0.smithi003.stdout:6/241: chown d4/d13/d19/d38/c4b 366394 1 2024-09-21T12:20:33.754 INFO:tasks.workunit.client.1.smithi192.stdout:0/884: fdatasync d3/f7f 0 2024-09-21T12:20:33.757 INFO:tasks.workunit.client.0.smithi003.stdout:2/201: mkdir d0/d46 0 2024-09-21T12:20:33.762 INFO:tasks.workunit.client.1.smithi192.stdout:1/832: fsync d2/d12/d2f/d51/f7c 0 2024-09-21T12:20:33.764 INFO:tasks.workunit.client.0.smithi003.stdout:9/340: rmdir d2/d29 39 2024-09-21T12:20:33.765 INFO:tasks.workunit.client.1.smithi192.stdout:2/790: mknod d1b/d1e/d7b/c101 0 2024-09-21T12:20:33.766 INFO:tasks.workunit.client.0.smithi003.stdout:6/242: symlink d4/d13/d2e/d37/l4c 0 2024-09-21T12:20:33.768 INFO:tasks.workunit.client.1.smithi192.stdout:1/833: stat d2/d12/d2f/d51/f37 0 2024-09-21T12:20:33.771 INFO:tasks.workunit.client.1.smithi192.stdout:7/780: dwrite d6/d9/d70/d77/dcd/deb/f105 [0,4194304] 0 2024-09-21T12:20:33.771 INFO:tasks.workunit.client.1.smithi192.stdout:0/885: dwrite d3/d5/d69/dbf/ffd [0,4194304] 0 2024-09-21T12:20:33.772 INFO:tasks.workunit.client.0.smithi003.stdout:5/249: rename dc/d15/f48 to dc/f4d 0 2024-09-21T12:20:33.776 INFO:tasks.workunit.client.1.smithi192.stdout:0/886: truncate d3/d5/dd7/f100 448680 0 2024-09-21T12:20:33.776 INFO:tasks.workunit.client.1.smithi192.stdout:4/788: fsync d2/d36/d55/d89/da6/fce 0 2024-09-21T12:20:33.776 INFO:tasks.workunit.client.1.smithi192.stdout:1/834: truncate d2/d12/d2f/d51/d24/d58/f10a 878404 0 2024-09-21T12:20:33.778 INFO:tasks.workunit.client.0.smithi003.stdout:3/200: link d0/f19 d0/d5/f36 0 2024-09-21T12:20:33.781 INFO:tasks.workunit.client.0.smithi003.stdout:9/341: creat d2/da/d17/f7a x:0 0 0 2024-09-21T12:20:33.782 INFO:tasks.workunit.client.1.smithi192.stdout:8/871: dwrite d14/d1a/d1d/d39/f8b [0,4194304] 0 2024-09-21T12:20:33.784 INFO:tasks.workunit.client.0.smithi003.stdout:6/243: creat d4/d13/d19/d23/f4d x:0 0 0 2024-09-21T12:20:33.787 INFO:tasks.workunit.client.1.smithi192.stdout:3/754: getdents db/d16/d18/d40/d60 0 2024-09-21T12:20:33.789 INFO:tasks.workunit.client.0.smithi003.stdout:7/214: rename d8/f9 to d8/db/d32/f50 0 2024-09-21T12:20:33.793 INFO:tasks.workunit.client.0.smithi003.stdout:5/250: mkdir dc/d2b/d4e 0 2024-09-21T12:20:33.795 INFO:tasks.workunit.client.0.smithi003.stdout:5/251: write dc/d15/d21/d30/d35/f46 [629640,96904] 0 2024-09-21T12:20:33.798 INFO:tasks.workunit.client.0.smithi003.stdout:3/201: write d0/d5/f36 [3497860,114023] 0 2024-09-21T12:20:33.800 INFO:tasks.workunit.client.1.smithi192.stdout:7/781: symlink d6/d3a/d6d/l111 0 2024-09-21T12:20:33.802 INFO:tasks.workunit.client.0.smithi003.stdout:6/244: mknod d4/d13/d19/d23/c4e 0 2024-09-21T12:20:33.805 INFO:tasks.workunit.client.1.smithi192.stdout:1/835: rmdir d2/d45 39 2024-09-21T12:20:33.809 INFO:tasks.workunit.client.0.smithi003.stdout:8/245: dwrite d7/f18 [0,4194304] 0 2024-09-21T12:20:33.809 INFO:tasks.workunit.client.1.smithi192.stdout:0/887: mknod d3/d5/d28/d39/d50/dd9/c10d 0 2024-09-21T12:20:33.811 INFO:tasks.workunit.client.1.smithi192.stdout:0/888: chown d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/d33/cbc 121284 1 2024-09-21T12:20:33.811 INFO:tasks.workunit.client.1.smithi192.stdout:6/965: truncate da/d1f/d27/f28 1705513 0 2024-09-21T12:20:33.812 INFO:tasks.workunit.client.1.smithi192.stdout:6/966: stat da/d1f/d56/d78/l112 0 2024-09-21T12:20:33.814 INFO:tasks.workunit.client.0.smithi003.stdout:1/234: sync 2024-09-21T12:20:33.815 INFO:tasks.workunit.client.0.smithi003.stdout:3/202: dwrite d0/d5/da/d28/f29 [0,4194304] 0 2024-09-21T12:20:33.815 INFO:tasks.workunit.client.0.smithi003.stdout:5/252: symlink dc/d15/d21/d30/l4f 0 2024-09-21T12:20:33.817 INFO:tasks.workunit.client.0.smithi003.stdout:5/253: dread - dc/f4d zero size 2024-09-21T12:20:33.818 INFO:tasks.workunit.client.0.smithi003.stdout:5/254: chown dc/d15/d21 3849 1 2024-09-21T12:20:33.819 INFO:tasks.workunit.client.0.smithi003.stdout:2/202: mknod d0/d46/c47 0 2024-09-21T12:20:33.820 INFO:tasks.workunit.client.1.smithi192.stdout:2/791: creat d1b/d1e/d7b/dfb/f102 x:0 0 0 2024-09-21T12:20:33.821 INFO:tasks.workunit.client.0.smithi003.stdout:6/245: mknod d4/d13/d2e/c4f 0 2024-09-21T12:20:33.826 INFO:tasks.workunit.client.1.smithi192.stdout:4/789: dwrite d2/db/d1a/dee/f77 [0,4194304] 0 2024-09-21T12:20:33.828 INFO:tasks.workunit.client.0.smithi003.stdout:8/246: symlink d7/df/d16/l53 0 2024-09-21T12:20:33.829 INFO:tasks.workunit.client.1.smithi192.stdout:8/872: rename d14/d1a/d1d/d46/c60 to d14/d1a/d1d/d48/de1/c123 0 2024-09-21T12:20:33.833 INFO:tasks.workunit.client.1.smithi192.stdout:6/967: creat da/d1f/d56/d78/f13e x:0 0 0 2024-09-21T12:20:33.834 INFO:tasks.workunit.client.0.smithi003.stdout:3/203: unlink d0/d5/da/ff 0 2024-09-21T12:20:33.834 INFO:tasks.workunit.client.1.smithi192.stdout:3/755: write db/d16/d18/d40/d60/f87 [522826,25648] 0 2024-09-21T12:20:33.836 INFO:tasks.workunit.client.0.smithi003.stdout:3/204: dread - d0/d5/da/d28/dd/d23/d26/f30 zero size 2024-09-21T12:20:33.836 INFO:tasks.workunit.client.0.smithi003.stdout:1/235: mkdir d4/d11/d14/d25/d59 0 2024-09-21T12:20:33.838 INFO:tasks.workunit.client.0.smithi003.stdout:3/205: write d0/d5/da/d28/dd/d23/d26/f2c [256476,82382] 0 2024-09-21T12:20:33.839 INFO:tasks.workunit.client.1.smithi192.stdout:2/792: creat d1b/d1e/d5e/d88/d95/dbe/dd0/f103 x:0 0 0 2024-09-21T12:20:33.840 INFO:tasks.workunit.client.1.smithi192.stdout:2/793: rename d1b/d38/d53 to d1b/d38/d53/d8b/d104 22 2024-09-21T12:20:33.842 INFO:tasks.workunit.client.1.smithi192.stdout:7/782: write d6/f27 [1459574,124991] 0 2024-09-21T12:20:33.843 INFO:tasks.workunit.client.0.smithi003.stdout:6/246: readlink d4/d13/d19/l24 0 2024-09-21T12:20:33.845 INFO:tasks.workunit.client.1.smithi192.stdout:8/873: fdatasync d14/d1a/d1d/d39/f8f 0 2024-09-21T12:20:33.846 INFO:tasks.workunit.client.0.smithi003.stdout:4/213: sync 2024-09-21T12:20:33.847 INFO:tasks.workunit.client.0.smithi003.stdout:0/250: rename d9/l11 to d9/d12/d1e/l53 0 2024-09-21T12:20:33.848 INFO:tasks.workunit.client.1.smithi192.stdout:2/794: dwrite d1b/d65/ff7 [0,4194304] 0 2024-09-21T12:20:33.850 INFO:tasks.workunit.client.0.smithi003.stdout:8/247: mkdir d7/df/d20/d54 0 2024-09-21T12:20:33.852 INFO:tasks.workunit.client.1.smithi192.stdout:6/968: unlink da/d1f/ff2 0 2024-09-21T12:20:33.853 INFO:tasks.workunit.client.1.smithi192.stdout:2/795: dwrite d1b/d38/f79 [0,4194304] 0 2024-09-21T12:20:33.855 INFO:tasks.workunit.client.1.smithi192.stdout:2/796: chown d1b/d1e/d5e/d88/d95/fb8 303866 1 2024-09-21T12:20:33.860 INFO:tasks.workunit.client.0.smithi003.stdout:1/236: mknod d4/d11/c5a 0 2024-09-21T12:20:33.862 INFO:tasks.workunit.client.1.smithi192.stdout:7/783: mknod d6/d9/d70/d77/dcd/deb/c112 0 2024-09-21T12:20:33.863 INFO:tasks.workunit.client.0.smithi003.stdout:5/255: symlink dc/d15/d21/d28/d41/l50 0 2024-09-21T12:20:33.864 INFO:tasks.workunit.client.0.smithi003.stdout:2/203: write d0/d21/f35 [1266607,102485] 0 2024-09-21T12:20:33.866 INFO:tasks.workunit.client.0.smithi003.stdout:6/247: creat d4/d9/f50 x:0 0 0 2024-09-21T12:20:33.871 INFO:tasks.workunit.client.0.smithi003.stdout:9/342: rename d2/da/d35/d4d/f4e to d2/d29/f7b 0 2024-09-21T12:20:33.874 INFO:tasks.workunit.client.0.smithi003.stdout:9/343: write d2/da/d35/f79 [704641,92303] 0 2024-09-21T12:20:33.874 INFO:tasks.workunit.client.0.smithi003.stdout:9/344: dread - d2/da/d2a/f5a zero size 2024-09-21T12:20:33.876 INFO:tasks.workunit.client.1.smithi192.stdout:2/797: mkdir d1b/d1e/d5e/d75/da1/d105 0 2024-09-21T12:20:33.877 INFO:tasks.workunit.client.0.smithi003.stdout:7/215: getdents d8 0 2024-09-21T12:20:33.879 INFO:tasks.workunit.client.0.smithi003.stdout:1/237: rmdir d4/df 39 2024-09-21T12:20:33.879 INFO:tasks.workunit.client.1.smithi192.stdout:7/784: rmdir d6/d3a 39 2024-09-21T12:20:33.880 INFO:tasks.workunit.client.1.smithi192.stdout:7/785: readlink d6/d9/l18 0 2024-09-21T12:20:33.882 INFO:tasks.workunit.client.0.smithi003.stdout:6/248: symlink d4/d13/d19/d23/l51 0 2024-09-21T12:20:33.882 INFO:tasks.workunit.client.1.smithi192.stdout:0/889: link d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/c6b d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/d33/dae/db4/c10e 0 2024-09-21T12:20:33.883 INFO:tasks.workunit.client.0.smithi003.stdout:6/249: stat d4/d11/d17 0 2024-09-21T12:20:33.884 INFO:tasks.workunit.client.0.smithi003.stdout:6/250: truncate d4/d13/d2e/d37/f2d 4471703 0 2024-09-21T12:20:33.885 INFO:tasks.workunit.client.1.smithi192.stdout:3/756: link db/d16/fa8 db/d16/d18/da7/d10e/f116 0 2024-09-21T12:20:33.888 INFO:tasks.workunit.client.1.smithi192.stdout:0/890: dwrite d3/f7f [0,4194304] 0 2024-09-21T12:20:33.888 INFO:tasks.workunit.client.1.smithi192.stdout:2/798: mkdir d1b/d1e/d5e/d75/da1/daf/d106 0 2024-09-21T12:20:33.889 INFO:tasks.workunit.client.1.smithi192.stdout:2/799: chown d1b/d1e/d5e/cc2 59 1 2024-09-21T12:20:33.891 INFO:tasks.workunit.client.0.smithi003.stdout:3/206: rename d0/c1 to d0/d5/da/d28/dd/c37 0 2024-09-21T12:20:33.891 INFO:tasks.workunit.client.1.smithi192.stdout:4/790: link d2/l7 d2/d21/l107 0 2024-09-21T12:20:33.893 INFO:tasks.workunit.client.0.smithi003.stdout:3/207: fdatasync d0/d5/da/d28/dd/f2e 0 2024-09-21T12:20:33.894 INFO:tasks.workunit.client.0.smithi003.stdout:0/251: getdents d9/d12/d17/d38/d3a/d46 0 2024-09-21T12:20:33.899 INFO:tasks.workunit.client.0.smithi003.stdout:9/345: symlink d2/d20/d22/d3f/l7c 0 2024-09-21T12:20:33.902 INFO:tasks.workunit.client.0.smithi003.stdout:8/248: mknod d7/df/d20/d24/d47/c55 0 2024-09-21T12:20:33.903 INFO:tasks.workunit.client.0.smithi003.stdout:8/249: chown d7/df/d20/d24/d47 22516 1 2024-09-21T12:20:33.904 INFO:tasks.workunit.client.1.smithi192.stdout:3/757: mknod db/d16/dee/c117 0 2024-09-21T12:20:33.904 INFO:tasks.workunit.client.0.smithi003.stdout:4/214: write d9/fc [89118,117394] 0 2024-09-21T12:20:33.905 INFO:tasks.workunit.client.0.smithi003.stdout:7/216: symlink d8/db/d13/l51 0 2024-09-21T12:20:33.906 INFO:tasks.workunit.client.0.smithi003.stdout:9/346: dread d2/d20/d22/d5e/f65 [0,4194304] 0 2024-09-21T12:20:33.907 INFO:tasks.workunit.client.0.smithi003.stdout:6/251: dread d4/d13/d2e/d37/f2d [0,4194304] 0 2024-09-21T12:20:33.914 INFO:tasks.workunit.client.1.smithi192.stdout:4/791: symlink d2/d21/l108 0 2024-09-21T12:20:33.914 INFO:tasks.workunit.client.1.smithi192.stdout:8/874: link d14/d1a/d1d/db6/fb8 d14/d18/d94/da4/f124 0 2024-09-21T12:20:33.914 INFO:tasks.workunit.client.1.smithi192.stdout:7/786: read - d6/d3a/d63/fcf zero size 2024-09-21T12:20:33.917 INFO:tasks.workunit.client.1.smithi192.stdout:7/787: write d6/d9/d70/d77/f91 [4536165,95385] 0 2024-09-21T12:20:33.918 INFO:tasks.workunit.client.1.smithi192.stdout:0/891: dread d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/d43/f54 [0,4194304] 0 2024-09-21T12:20:33.918 INFO:tasks.workunit.client.1.smithi192.stdout:2/800: mkdir d1b/d38/d53/d107 0 2024-09-21T12:20:33.919 INFO:tasks.workunit.client.1.smithi192.stdout:9/915: sync 2024-09-21T12:20:33.920 INFO:tasks.workunit.client.0.smithi003.stdout:7/217: dwrite d8/d3c/f4b [0,4194304] 0 2024-09-21T12:20:33.922 INFO:tasks.workunit.client.0.smithi003.stdout:0/252: mkdir d9/d12/d1e/d2b/d26/d54 0 2024-09-21T12:20:33.923 INFO:tasks.workunit.client.0.smithi003.stdout:4/215: dwrite d9/d25/f39 [0,4194304] 0 2024-09-21T12:20:33.923 INFO:tasks.workunit.client.0.smithi003.stdout:7/218: readlink d8/db/l3b 0 2024-09-21T12:20:33.925 INFO:tasks.workunit.client.0.smithi003.stdout:4/216: fsync d9/d16/f26 0 2024-09-21T12:20:33.925 INFO:tasks.workunit.client.0.smithi003.stdout:0/253: write d9/d12/d17/f19 [1315289,59142] 0 2024-09-21T12:20:33.926 INFO:tasks.workunit.client.0.smithi003.stdout:0/254: readlink d9/d12/l27 0 2024-09-21T12:20:33.927 INFO:tasks.workunit.client.0.smithi003.stdout:0/255: dread - d9/d12/d17/d21/f31 zero size 2024-09-21T12:20:33.928 INFO:tasks.workunit.client.1.smithi192.stdout:8/875: symlink d14/d1a/d1d/d20/l125 0 2024-09-21T12:20:33.928 INFO:tasks.workunit.client.0.smithi003.stdout:1/238: chown d4/d11/d14/d25/d42/f55 1189076 1 2024-09-21T12:20:33.930 INFO:tasks.workunit.client.1.smithi192.stdout:9/916: dwrite d5/d8/dc7/dd7/de7/fb1 [0,4194304] 0 2024-09-21T12:20:33.933 INFO:tasks.workunit.client.0.smithi003.stdout:5/256: link dc/d15/d21/l25 dc/d15/d21/d30/l51 0 2024-09-21T12:20:33.934 INFO:tasks.workunit.client.0.smithi003.stdout:9/347: creat d2/d29/f7d x:0 0 0 2024-09-21T12:20:33.938 INFO:tasks.workunit.client.0.smithi003.stdout:5/257: dread dc/d15/d1c/f23 [0,4194304] 0 2024-09-21T12:20:33.939 INFO:tasks.workunit.client.0.smithi003.stdout:5/258: chown dc/d2b/d4e 1429966 1 2024-09-21T12:20:33.940 INFO:tasks.workunit.client.0.smithi003.stdout:2/204: truncate d0/dd/d16/f24 2012894 0 2024-09-21T12:20:33.940 INFO:tasks.workunit.client.1.smithi192.stdout:7/788: mkdir d6/d9/d70/d77/d100/d113 0 2024-09-21T12:20:33.943 INFO:tasks.workunit.client.1.smithi192.stdout:8/876: creat d14/d1a/d1d/d46/d4e/d83/d8d/d9c/dee/d80/d9a/f126 x:0 0 0 2024-09-21T12:20:33.944 INFO:tasks.workunit.client.0.smithi003.stdout:5/259: dread dc/f10 [0,4194304] 0 2024-09-21T12:20:33.946 INFO:tasks.workunit.client.0.smithi003.stdout:5/260: dread - dc/d15/d21/d30/f33 zero size 2024-09-21T12:20:33.948 INFO:tasks.workunit.client.0.smithi003.stdout:7/219: creat d8/f52 x:0 0 0 2024-09-21T12:20:33.949 INFO:tasks.workunit.client.1.smithi192.stdout:8/877: dwrite fd [0,4194304] 0 2024-09-21T12:20:33.950 INFO:tasks.workunit.client.1.smithi192.stdout:9/917: creat d5/d19/d32/dc0/d11c/f126 x:0 0 0 2024-09-21T12:20:33.951 INFO:tasks.workunit.client.1.smithi192.stdout:8/878: chown d14/d1a/d1d/d46/d4e/db5/f100 12025952 1 2024-09-21T12:20:33.952 INFO:tasks.workunit.client.1.smithi192.stdout:8/879: chown d14/d18/d94/dc3/fcc 416 1 2024-09-21T12:20:33.954 INFO:tasks.workunit.client.1.smithi192.stdout:8/880: dread - d14/d1a/d1d/d46/d4e/d83/d8d/dd8/ff5 zero size 2024-09-21T12:20:33.956 INFO:tasks.workunit.client.1.smithi192.stdout:6/969: sync 2024-09-21T12:20:33.956 INFO:tasks.workunit.client.1.smithi192.stdout:1/836: sync 2024-09-21T12:20:33.956 INFO:tasks.workunit.client.1.smithi192.stdout:0/892: creat d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/f10f x:0 0 0 2024-09-21T12:20:33.960 INFO:tasks.workunit.client.1.smithi192.stdout:9/918: dwrite d5/d8/dc7/dd7/de7/d55/d70/da0/da2/daf/f11f [0,4194304] 0 2024-09-21T12:20:33.966 INFO:tasks.workunit.client.1.smithi192.stdout:7/789: rename d6/d9/d70/d77/dcd/deb/f105 to d6/d9/d1f/f114 0 2024-09-21T12:20:33.971 INFO:tasks.workunit.client.1.smithi192.stdout:0/893: mkdir d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/d43/d110 0 2024-09-21T12:20:33.971 INFO:tasks.workunit.client.1.smithi192.stdout:3/758: dwrite db/d16/d18/da7/d10e/f79 [0,4194304] 0 2024-09-21T12:20:33.974 INFO:tasks.workunit.client.0.smithi003.stdout:6/252: dwrite d4/d13/d22/f2b [0,4194304] 0 2024-09-21T12:20:33.976 INFO:tasks.workunit.client.1.smithi192.stdout:7/790: write d6/d9/d1f/d3e/d7a/d8a/da2/fa5 [1146166,11251] 0 2024-09-21T12:20:33.976 INFO:tasks.workunit.client.1.smithi192.stdout:4/792: dwrite d2/db/d3e/fcd [0,4194304] 0 2024-09-21T12:20:33.978 INFO:tasks.workunit.client.0.smithi003.stdout:4/217: mkdir d9/da/d47 0 2024-09-21T12:20:33.978 INFO:tasks.workunit.client.0.smithi003.stdout:3/208: write d0/f16 [1213009,103343] 0 2024-09-21T12:20:33.980 INFO:tasks.workunit.client.0.smithi003.stdout:3/209: write d0/d5/da/d28/dd/d23/d26/f2c [1253424,87363] 0 2024-09-21T12:20:33.981 INFO:tasks.workunit.client.0.smithi003.stdout:3/210: write d0/d5/f36 [4875036,72299] 0 2024-09-21T12:20:33.982 INFO:tasks.workunit.client.0.smithi003.stdout:3/211: dread - d0/f27 zero size 2024-09-21T12:20:33.985 INFO:tasks.workunit.client.0.smithi003.stdout:3/212: chown d0/d5/da/d28/dd/d23/d26/f30 27 1 2024-09-21T12:20:33.986 INFO:tasks.workunit.client.0.smithi003.stdout:3/213: write d0/f19 [5086308,123465] 0 2024-09-21T12:20:33.987 INFO:tasks.workunit.client.0.smithi003.stdout:3/214: chown d0/f19 449262 1 2024-09-21T12:20:33.988 INFO:tasks.workunit.client.1.smithi192.stdout:1/837: rename d2/da/d9f/le1 to d2/d12/d2f/d51/d24/d58/l10e 0 2024-09-21T12:20:33.992 INFO:tasks.workunit.client.1.smithi192.stdout:2/801: dwrite d1b/d1e/d5e/d75/f84 [0,4194304] 0 2024-09-21T12:20:33.995 INFO:tasks.workunit.client.1.smithi192.stdout:6/970: link da/d1f/d56/c8b da/d1f/d48/d7d/da7/dc8/c13f 0 2024-09-21T12:20:33.996 INFO:tasks.workunit.client.1.smithi192.stdout:0/894: stat d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/dc6/d83/d87/fb1 0 2024-09-21T12:20:33.998 INFO:tasks.workunit.client.1.smithi192.stdout:2/802: chown d1b/d9e/fa9 2 1 2024-09-21T12:20:33.998 INFO:tasks.workunit.client.1.smithi192.stdout:3/759: dwrite db/d16/d18/d21/ffd [0,4194304] 0 2024-09-21T12:20:34.001 INFO:tasks.workunit.client.0.smithi003.stdout:0/256: mkdir d9/d12/d17/d38/d3a/d46/d55 0 2024-09-21T12:20:34.002 INFO:tasks.workunit.client.0.smithi003.stdout:5/261: symlink dc/d2b/d4e/l52 0 2024-09-21T12:20:34.003 INFO:tasks.workunit.client.0.smithi003.stdout:8/250: rename f1 to d7/de/f56 0 2024-09-21T12:20:34.004 INFO:tasks.workunit.client.1.smithi192.stdout:7/791: truncate d6/d9/d51/f32 1693194 0 2024-09-21T12:20:34.006 INFO:tasks.workunit.client.1.smithi192.stdout:8/881: write d14/d1a/d1d/db6/fb8 [1012500,28202] 0 2024-09-21T12:20:34.008 INFO:tasks.workunit.client.1.smithi192.stdout:6/971: creat da/d23/d37/d75/de2/f140 x:0 0 0 2024-09-21T12:20:34.009 INFO:tasks.workunit.client.1.smithi192.stdout:0/895: mknod d3/d5/d69/db2/c111 0 2024-09-21T12:20:34.009 INFO:tasks.workunit.client.0.smithi003.stdout:5/262: stat dc/d15/d21/d30/f34 0 2024-09-21T12:20:34.010 INFO:tasks.workunit.client.0.smithi003.stdout:7/220: write d8/f17 [1636234,110343] 0 2024-09-21T12:20:34.010 INFO:tasks.workunit.client.0.smithi003.stdout:4/218: mkdir d9/d48 0 2024-09-21T12:20:34.012 INFO:tasks.workunit.client.0.smithi003.stdout:8/251: rmdir d7/de 39 2024-09-21T12:20:34.012 INFO:tasks.workunit.client.1.smithi192.stdout:7/792: mknod d6/d9/d70/d77/d100/c115 0 2024-09-21T12:20:34.013 INFO:tasks.workunit.client.1.smithi192.stdout:2/803: dwrite ff [4194304,4194304] 0 2024-09-21T12:20:34.014 INFO:tasks.workunit.client.0.smithi003.stdout:4/219: stat d9/da/d36/f3f 0 2024-09-21T12:20:34.014 INFO:tasks.workunit.client.1.smithi192.stdout:2/804: chown ff 1000358 1 2024-09-21T12:20:34.014 INFO:tasks.workunit.client.0.smithi003.stdout:9/348: dwrite d2/da/d17/d40/f4a [0,4194304] 0 2024-09-21T12:20:34.015 INFO:tasks.workunit.client.0.smithi003.stdout:2/205: rename d0/dd/f26 to d0/dd/d22/d37/f48 0 2024-09-21T12:20:34.015 INFO:tasks.workunit.client.0.smithi003.stdout:8/252: chown d7/df/c34 1 1 2024-09-21T12:20:34.016 INFO:tasks.workunit.client.1.smithi192.stdout:9/919: dread d5/dc/d64/dbb/df1/f108 [4194304,4194304] 0 2024-09-21T12:20:34.019 INFO:tasks.workunit.client.1.smithi192.stdout:2/805: write d1b/d1e/d5e/d88/d95/dbe/fd2 [3113732,19216] 0 2024-09-21T12:20:34.019 INFO:tasks.workunit.client.1.smithi192.stdout:9/920: chown d5/d19 317360 1 2024-09-21T12:20:34.021 INFO:tasks.workunit.client.0.smithi003.stdout:0/257: dwrite d9/d12/d17/d21/f40 [0,4194304] 0 2024-09-21T12:20:34.022 INFO:tasks.workunit.client.1.smithi192.stdout:6/972: fsync da/d1f/d48/f4d 0 2024-09-21T12:20:34.022 INFO:tasks.workunit.client.1.smithi192.stdout:4/793: truncate d2/d36/d7f/df5/d4f/d71/d9d/dad/d9c/fab 1005277 0 2024-09-21T12:20:34.023 INFO:tasks.workunit.client.1.smithi192.stdout:7/793: rmdir d6/d3a 39 2024-09-21T12:20:34.023 INFO:tasks.workunit.client.0.smithi003.stdout:5/263: rmdir dc/d15 39 2024-09-21T12:20:34.027 INFO:tasks.workunit.client.1.smithi192.stdout:0/896: unlink d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/dc6/l6c 0 2024-09-21T12:20:34.029 INFO:tasks.workunit.client.0.smithi003.stdout:3/215: dread d0/f16 [0,4194304] 0 2024-09-21T12:20:34.030 INFO:tasks.workunit.client.1.smithi192.stdout:3/760: getdents db/d16/d18/d33/d3b 0 2024-09-21T12:20:34.034 INFO:tasks.workunit.client.1.smithi192.stdout:9/921: dwrite d5/dc/d80/d44/f121 [0,4194304] 0 2024-09-21T12:20:34.034 INFO:tasks.workunit.client.0.smithi003.stdout:2/206: rename d0/dd/d44 to d0/d21/d2f/d49 0 2024-09-21T12:20:34.036 INFO:tasks.workunit.client.0.smithi003.stdout:0/258: rmdir d9/d12 39 2024-09-21T12:20:34.036 INFO:tasks.workunit.client.1.smithi192.stdout:9/922: write d5/d8/dc7/dd7/de7/fb1 [2388255,92474] 0 2024-09-21T12:20:34.039 INFO:tasks.workunit.client.0.smithi003.stdout:4/220: dwrite d9/f23 [0,4194304] 0 2024-09-21T12:20:34.039 INFO:tasks.workunit.client.0.smithi003.stdout:7/221: dwrite d8/d2c/f40 [0,4194304] 0 2024-09-21T12:20:34.044 INFO:tasks.workunit.client.0.smithi003.stdout:3/216: dread d0/d5/f36 [4194304,4194304] 0 2024-09-21T12:20:34.045 INFO:tasks.workunit.client.1.smithi192.stdout:6/973: dread da/d1f/d48/d7d/fe1 [0,4194304] 0 2024-09-21T12:20:34.047 INFO:tasks.workunit.client.0.smithi003.stdout:5/264: read dc/d15/d21/d30/f34 [1696412,4610] 0 2024-09-21T12:20:34.048 INFO:tasks.workunit.client.0.smithi003.stdout:1/239: write d4/df/d19/f2b [503709,91556] 0 2024-09-21T12:20:34.049 INFO:tasks.workunit.client.1.smithi192.stdout:9/923: dwrite d5/d19/dd5/d4d/d6d/fab [0,4194304] 0 2024-09-21T12:20:34.049 INFO:tasks.workunit.client.1.smithi192.stdout:4/794: mknod d2/d36/d7f/df5/d4f/d82/c109 0 2024-09-21T12:20:34.055 INFO:tasks.workunit.client.0.smithi003.stdout:9/349: creat d2/da/d35/d76/f7e x:0 0 0 2024-09-21T12:20:34.056 INFO:tasks.workunit.client.0.smithi003.stdout:9/350: stat d2/da/d17/c1d 0 2024-09-21T12:20:34.058 INFO:tasks.workunit.client.1.smithi192.stdout:3/761: mkdir db/d16/d18/d21/d23/d71/d77/d118 0 2024-09-21T12:20:34.059 INFO:tasks.workunit.client.1.smithi192.stdout:9/924: dwrite d5/d19/dd5/d4d/d6d/f10f [0,4194304] 0 2024-09-21T12:20:34.059 INFO:tasks.workunit.client.1.smithi192.stdout:2/806: write d1b/d1e/d3d/f56 [3865038,5233] 0 2024-09-21T12:20:34.061 INFO:tasks.workunit.client.1.smithi192.stdout:9/925: write d5/f100 [1447402,47380] 0 2024-09-21T12:20:34.062 INFO:tasks.workunit.client.1.smithi192.stdout:0/897: creat d3/df0/df6/f112 x:0 0 0 2024-09-21T12:20:34.064 INFO:tasks.workunit.client.1.smithi192.stdout:7/794: creat d6/d9/d70/d77/d100/d113/f116 x:0 0 0 2024-09-21T12:20:34.065 INFO:tasks.workunit.client.1.smithi192.stdout:3/762: write db/d16/d18/da7/d10e/d2e/f45 [2219956,116007] 0 2024-09-21T12:20:34.066 INFO:tasks.workunit.client.0.smithi003.stdout:2/207: unlink d0/dd/d16/f3d 0 2024-09-21T12:20:34.067 INFO:tasks.workunit.client.1.smithi192.stdout:4/795: symlink d2/d36/d55/d89/dc8/df7/d6c/db8/d88/d92/l10a 0 2024-09-21T12:20:34.069 INFO:tasks.workunit.client.0.smithi003.stdout:4/221: chown d9/f15 533071749 1 2024-09-21T12:20:34.070 INFO:tasks.workunit.client.0.smithi003.stdout:4/222: dread - d9/f15 zero size 2024-09-21T12:20:34.071 INFO:tasks.workunit.client.1.smithi192.stdout:3/763: dread db/d16/d18/da7/d10e/d2e/fc4 [0,4194304] 0 2024-09-21T12:20:34.073 INFO:tasks.workunit.client.0.smithi003.stdout:2/208: dread d0/dd/d22/f23 [0,4194304] 0 2024-09-21T12:20:34.074 INFO:tasks.workunit.client.0.smithi003.stdout:2/209: dread - d0/d21/d2f/f38 zero size 2024-09-21T12:20:34.075 INFO:tasks.workunit.client.0.smithi003.stdout:1/240: rename d4/df/d12/l27 to d4/df/d41/l5b 0 2024-09-21T12:20:34.077 INFO:tasks.workunit.client.0.smithi003.stdout:1/241: truncate d4/d11/f50 711861 0 2024-09-21T12:20:34.080 INFO:tasks.workunit.client.1.smithi192.stdout:0/898: creat d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/d33/f113 x:0 0 0 2024-09-21T12:20:34.080 INFO:tasks.workunit.client.0.smithi003.stdout:9/351: creat d2/d53/f7f x:0 0 0 2024-09-21T12:20:34.081 INFO:tasks.workunit.client.1.smithi192.stdout:0/899: stat d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/lcc 0 2024-09-21T12:20:34.087 INFO:tasks.workunit.client.0.smithi003.stdout:8/253: dwrite d7/de/f19 [0,4194304] 0 2024-09-21T12:20:34.090 INFO:tasks.workunit.client.0.smithi003.stdout:7/222: symlink d8/db/l53 0 2024-09-21T12:20:34.090 INFO:tasks.workunit.client.0.smithi003.stdout:7/223: readlink d8/db/l18 0 2024-09-21T12:20:34.093 INFO:tasks.workunit.client.1.smithi192.stdout:9/926: unlink d5/dc/d64/dbb/f4c 0 2024-09-21T12:20:34.094 INFO:tasks.workunit.client.1.smithi192.stdout:3/764: dwrite db/d16/d18/da7/d10e/d2e/db8/dd0/fff [0,4194304] 0 2024-09-21T12:20:34.097 INFO:tasks.workunit.client.0.smithi003.stdout:3/217: mkdir d0/d5/d38 0 2024-09-21T12:20:34.098 INFO:tasks.workunit.client.0.smithi003.stdout:3/218: chown d0/d5/da/d28/dd/f2d 125716 1 2024-09-21T12:20:34.102 INFO:tasks.workunit.client.1.smithi192.stdout:0/900: creat d3/d5/d69/dbf/f114 x:0 0 0 2024-09-21T12:20:34.104 INFO:tasks.workunit.client.1.smithi192.stdout:7/795: getdents d6/d20/d69/d90/da7/dc1/d10a 0 2024-09-21T12:20:34.107 INFO:tasks.workunit.client.0.smithi003.stdout:4/223: dwrite d9/f24 [0,4194304] 0 2024-09-21T12:20:34.109 INFO:tasks.workunit.client.0.smithi003.stdout:2/210: creat d0/dd/d22/f4a x:0 0 0 2024-09-21T12:20:34.113 INFO:tasks.workunit.client.0.smithi003.stdout:1/242: chown d4/l5 1414131 1 2024-09-21T12:20:34.115 INFO:tasks.workunit.client.0.smithi003.stdout:9/352: mknod d2/da/d2a/d3c/c80 0 2024-09-21T12:20:34.119 INFO:tasks.workunit.client.1.smithi192.stdout:7/796: creat d6/d9/d2d/dc4/f117 x:0 0 0 2024-09-21T12:20:34.121 INFO:tasks.workunit.client.1.smithi192.stdout:2/807: dwrite d1b/d1e/d62/f6c [0,4194304] 0 2024-09-21T12:20:34.122 INFO:tasks.workunit.client.0.smithi003.stdout:5/265: rmdir dc/d15/d21/d28/d4a 0 2024-09-21T12:20:34.124 INFO:tasks.workunit.client.0.smithi003.stdout:4/224: rmdir d9/da/d36 39 2024-09-21T12:20:34.124 INFO:tasks.workunit.client.1.smithi192.stdout:3/765: link db/d16/d18/d21/f5d db/d16/dee/f119 0 2024-09-21T12:20:34.125 INFO:tasks.workunit.client.1.smithi192.stdout:0/901: symlink d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/d33/dae/dd2/l115 0 2024-09-21T12:20:34.126 INFO:tasks.workunit.client.0.smithi003.stdout:2/211: fdatasync d0/d1c/f2e 0 2024-09-21T12:20:34.127 INFO:tasks.workunit.client.1.smithi192.stdout:3/766: read db/d16/db4/d8c/fe1 [2106334,47320] 0 2024-09-21T12:20:34.129 INFO:tasks.workunit.client.1.smithi192.stdout:3/767: dread db/d16/d18/d33/d3b/db1/fbb [0,4194304] 0 2024-09-21T12:20:34.129 INFO:tasks.workunit.client.1.smithi192.stdout:4/796: link d2/db/d34/laf d2/d36/d7f/df5/d4f/d71/d9d/dad/l10b 0 2024-09-21T12:20:34.131 INFO:tasks.workunit.client.0.smithi003.stdout:9/353: chown d2/d20/d22/l4f 304 1 2024-09-21T12:20:34.131 INFO:tasks.workunit.client.1.smithi192.stdout:4/797: chown d2/d36/d55/d89/dc8/df7/d6c/db8/cfa 2 1 2024-09-21T12:20:34.135 INFO:tasks.workunit.client.0.smithi003.stdout:8/254: fsync d7/df/f26 0 2024-09-21T12:20:34.137 INFO:tasks.workunit.client.0.smithi003.stdout:8/255: write d7/df/d16/f46 [1016734,63492] 0 2024-09-21T12:20:34.137 INFO:tasks.workunit.client.1.smithi192.stdout:0/902: symlink d3/d5/d28/d39/d50/l116 0 2024-09-21T12:20:34.140 INFO:tasks.workunit.client.0.smithi003.stdout:9/354: dread d2/da/d2a/f33 [0,4194304] 0 2024-09-21T12:20:34.141 INFO:tasks.workunit.client.0.smithi003.stdout:9/355: chown d2/d20/c5b 33163475 1 2024-09-21T12:20:34.141 INFO:tasks.workunit.client.0.smithi003.stdout:3/219: mknod d0/d5/d38/c39 0 2024-09-21T12:20:34.144 INFO:tasks.workunit.client.1.smithi192.stdout:9/927: truncate d5/d8/dc7/dd7/de7/fb1 3466786 0 2024-09-21T12:20:34.145 INFO:tasks.workunit.client.0.smithi003.stdout:5/266: creat dc/d2b/d4e/f53 x:0 0 0 2024-09-21T12:20:34.147 INFO:tasks.workunit.client.1.smithi192.stdout:3/768: creat db/d16/d18/d21/dde/f11a x:0 0 0 2024-09-21T12:20:34.149 INFO:tasks.workunit.client.1.smithi192.stdout:1/838: sync 2024-09-21T12:20:34.150 INFO:tasks.workunit.client.0.smithi003.stdout:9/356: dwrite d2/da/d35/d76/f7e [0,4194304] 0 2024-09-21T12:20:34.150 INFO:tasks.workunit.client.1.smithi192.stdout:4/798: chown d2/d36/d7f/d68/l73 0 1 2024-09-21T12:20:34.151 INFO:tasks.workunit.client.0.smithi003.stdout:4/225: dread d9/d16/f2e [0,4194304] 0 2024-09-21T12:20:34.153 INFO:tasks.workunit.client.0.smithi003.stdout:4/226: fdatasync d9/fc 0 2024-09-21T12:20:34.154 INFO:tasks.workunit.client.0.smithi003.stdout:2/212: chown d0/dd/l17 14 1 2024-09-21T12:20:34.155 INFO:tasks.workunit.client.0.smithi003.stdout:0/259: getdents d9/d12/d1e/d2b 0 2024-09-21T12:20:34.155 INFO:tasks.workunit.client.0.smithi003.stdout:0/260: dread - d9/d12/f33 zero size 2024-09-21T12:20:34.156 INFO:tasks.workunit.client.0.smithi003.stdout:0/261: readlink d9/d12/d1e/l2a 0 2024-09-21T12:20:34.158 INFO:tasks.workunit.client.0.smithi003.stdout:0/262: dread d9/d12/d22/f29 [0,4194304] 0 2024-09-21T12:20:34.158 INFO:tasks.workunit.client.1.smithi192.stdout:7/797: creat d6/d3a/dba/f118 x:0 0 0 2024-09-21T12:20:34.158 INFO:tasks.workunit.client.0.smithi003.stdout:7/224: link d8/db/l15 d8/db/l54 0 2024-09-21T12:20:34.159 INFO:tasks.workunit.client.1.smithi192.stdout:2/808: dwrite d1b/d38/d53/d8b/da0/fb9 [0,4194304] 0 2024-09-21T12:20:34.161 INFO:tasks.workunit.client.1.smithi192.stdout:9/928: truncate d5/dc/d40/fdb 227722 0 2024-09-21T12:20:34.161 INFO:tasks.workunit.client.0.smithi003.stdout:5/267: truncate dc/f10 639927 0 2024-09-21T12:20:34.162 INFO:tasks.workunit.client.1.smithi192.stdout:7/798: chown d6/d9/d1f/d3e/d7a/d8a/da2/fa5 107345 1 2024-09-21T12:20:34.163 INFO:tasks.workunit.client.1.smithi192.stdout:1/839: symlink d2/d4d/l10f 0 2024-09-21T12:20:34.164 INFO:tasks.workunit.client.0.smithi003.stdout:9/357: fsync d2/da/f3b 0 2024-09-21T12:20:34.165 INFO:tasks.workunit.client.1.smithi192.stdout:4/799: mkdir d2/d36/d10c 0 2024-09-21T12:20:34.166 INFO:tasks.workunit.client.1.smithi192.stdout:0/903: dread d3/d5/d28/f56 [0,4194304] 0 2024-09-21T12:20:34.166 INFO:tasks.workunit.client.1.smithi192.stdout:9/929: read d5/f2f [2947038,51149] 0 2024-09-21T12:20:34.167 INFO:tasks.workunit.client.0.smithi003.stdout:0/263: dwrite d9/d12/d17/d21/f42 [4194304,4194304] 0 2024-09-21T12:20:34.168 INFO:tasks.workunit.client.1.smithi192.stdout:2/809: mknod d1b/d1e/d5e/d75/d8d/c108 0 2024-09-21T12:20:34.169 INFO:tasks.workunit.client.1.smithi192.stdout:4/800: readlink d2/d36/d55/d89/dc8/df7/d6c/db8/lfd 0 2024-09-21T12:20:34.175 INFO:tasks.workunit.client.0.smithi003.stdout:3/220: dread d0/d5/da/d28/d11/f1d [0,4194304] 0 2024-09-21T12:20:34.179 INFO:tasks.workunit.client.0.smithi003.stdout:7/225: mknod d8/db/d32/d43/c55 0 2024-09-21T12:20:34.182 INFO:tasks.workunit.client.0.smithi003.stdout:5/268: creat dc/d2b/f54 x:0 0 0 2024-09-21T12:20:34.188 INFO:tasks.workunit.client.1.smithi192.stdout:7/799: mkdir d6/d9/d70/d119 0 2024-09-21T12:20:34.189 INFO:tasks.workunit.client.1.smithi192.stdout:7/800: chown d6/d20/dcc 15 1 2024-09-21T12:20:34.190 INFO:tasks.workunit.client.1.smithi192.stdout:7/801: truncate d6/f27 2965534 0 2024-09-21T12:20:34.190 INFO:tasks.workunit.client.0.smithi003.stdout:0/264: mknod d9/d12/d17/d38/c56 0 2024-09-21T12:20:34.192 INFO:tasks.workunit.client.0.smithi003.stdout:0/265: write d9/d12/d1e/d2b/d26/f3e [2581704,22782] 0 2024-09-21T12:20:34.193 INFO:tasks.workunit.client.1.smithi192.stdout:3/769: write db/d16/d18/da7/d10e/f116 [608905,23826] 0 2024-09-21T12:20:34.194 INFO:tasks.workunit.client.0.smithi003.stdout:4/227: mkdir d9/d48/d49 0 2024-09-21T12:20:34.196 INFO:tasks.workunit.client.0.smithi003.stdout:2/213: fdatasync d0/f18 0 2024-09-21T12:20:34.197 INFO:tasks.workunit.client.1.smithi192.stdout:0/904: getdents d3/df0/dfa 0 2024-09-21T12:20:34.198 INFO:tasks.workunit.client.0.smithi003.stdout:1/243: truncate d4/f3a 3310138 0 2024-09-21T12:20:34.198 INFO:tasks.workunit.client.1.smithi192.stdout:3/770: dread db/d16/d18/d33/fa1 [0,4194304] 0 2024-09-21T12:20:34.200 INFO:tasks.workunit.client.0.smithi003.stdout:3/221: mknod d0/d5/da/d28/d31/c3a 0 2024-09-21T12:20:34.202 INFO:tasks.workunit.client.1.smithi192.stdout:7/802: symlink d6/d9/d70/d77/l11a 0 2024-09-21T12:20:34.202 INFO:tasks.workunit.client.0.smithi003.stdout:4/228: dwrite d9/da/f31 [0,4194304] 0 2024-09-21T12:20:34.204 INFO:tasks.workunit.client.0.smithi003.stdout:5/269: creat dc/d15/d21/d30/f55 x:0 0 0 2024-09-21T12:20:34.205 INFO:tasks.workunit.client.1.smithi192.stdout:4/801: link d2/d36/d55/d89/dc8/df7/d6c/f103 d2/d36/d55/f10d 0 2024-09-21T12:20:34.206 INFO:tasks.workunit.client.1.smithi192.stdout:4/802: readlink d2/d21/l67 0 2024-09-21T12:20:34.212 INFO:tasks.workunit.client.1.smithi192.stdout:0/905: write d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/d43/f54 [3904558,9550] 0 2024-09-21T12:20:34.214 INFO:tasks.workunit.client.1.smithi192.stdout:0/906: dread - d3/d5/d28/fc8 zero size 2024-09-21T12:20:34.215 INFO:tasks.workunit.client.0.smithi003.stdout:1/244: fsync d4/f13 0 2024-09-21T12:20:34.217 INFO:tasks.workunit.client.1.smithi192.stdout:7/803: mkdir d6/d9/d2d/d11b 0 2024-09-21T12:20:34.217 INFO:tasks.workunit.client.0.smithi003.stdout:1/245: dread - d4/d11/d14/d25/d42/f55 zero size 2024-09-21T12:20:34.217 INFO:tasks.workunit.client.1.smithi192.stdout:2/810: dwrite d1b/d1e/d5e/d88/d95/d9c/fce [4194304,4194304] 0 2024-09-21T12:20:34.219 INFO:tasks.workunit.client.0.smithi003.stdout:7/226: creat d8/d3c/f56 x:0 0 0 2024-09-21T12:20:34.221 INFO:tasks.workunit.client.0.smithi003.stdout:3/222: creat d0/d5/da/d28/d31/f3b x:0 0 0 2024-09-21T12:20:34.223 INFO:tasks.workunit.client.0.smithi003.stdout:4/229: symlink d9/d25/l4a 0 2024-09-21T12:20:34.224 INFO:tasks.workunit.client.1.smithi192.stdout:1/840: getdents d2/d12/d2f/d81 0 2024-09-21T12:20:34.225 INFO:tasks.workunit.client.1.smithi192.stdout:2/811: dread d1b/d1e/d5e/d88/faa [0,4194304] 0 2024-09-21T12:20:34.225 INFO:tasks.workunit.client.0.smithi003.stdout:5/270: symlink dc/d15/d21/l56 0 2024-09-21T12:20:34.226 INFO:tasks.workunit.client.1.smithi192.stdout:9/930: getdents d5/d19/dd5 0 2024-09-21T12:20:34.229 INFO:tasks.workunit.client.0.smithi003.stdout:0/266: mkdir d9/d12/d17/d38/d3a/d46/d55/d57 0 2024-09-21T12:20:34.232 INFO:tasks.workunit.client.1.smithi192.stdout:0/907: symlink d3/d5/d28/d39/d50/dd9/d7a/dbe/d89/l117 0 2024-09-21T12:20:34.234 INFO:tasks.workunit.client.1.smithi192.stdout:9/931: dread d5/dc/f76 [0,4194304] 0 2024-09-21T12:20:34.234 INFO:tasks.workunit.client.0.smithi003.stdout:9/358: dwrite d2/d20/f39 [0,4194304] 0 2024-09-21T12:20:34.235 INFO:tasks.workunit.client.1.smithi192.stdout:0/908: truncate d3/df0/df6/f112 534413 0 2024-09-21T12:20:34.237 INFO:tasks.workunit.client.1.smithi192.stdout:0/909: read d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/d33/f6e [1419289,38206] 0 2024-09-21T12:20:34.238 INFO:tasks.workunit.client.0.smithi003.stdout:1/246: mknod d4/df/d12/c5c 0 2024-09-21T12:20:34.238 INFO:tasks.workunit.client.1.smithi192.stdout:4/803: getdents d2/db/dd5 0 2024-09-21T12:20:34.240 INFO:tasks.workunit.client.0.smithi003.stdout:7/227: unlink d8/d2c/f40 0 2024-09-21T12:20:34.241 INFO:tasks.workunit.client.0.smithi003.stdout:7/228: readlink l7 0 2024-09-21T12:20:34.242 INFO:tasks.workunit.client.0.smithi003.stdout:9/359: dwrite d2/d53/f7f [0,4194304] 0 2024-09-21T12:20:34.247 INFO:tasks.workunit.client.0.smithi003.stdout:5/271: mkdir dc/d15/d21/d57 0 2024-09-21T12:20:34.251 INFO:tasks.workunit.client.0.smithi003.stdout:2/214: write d0/dd/d22/d37/f48 [1618980,95558] 0 2024-09-21T12:20:34.252 INFO:tasks.workunit.client.0.smithi003.stdout:7/229: dwrite d8/d3c/f56 [0,4194304] 0 2024-09-21T12:20:34.254 INFO:tasks.workunit.client.1.smithi192.stdout:7/804: mkdir d6/d9/d11c 0 2024-09-21T12:20:34.254 INFO:tasks.workunit.client.1.smithi192.stdout:8/882: sync 2024-09-21T12:20:34.256 INFO:tasks.workunit.client.1.smithi192.stdout:8/883: chown d14/d1a/d1d/d46/d4e/d83/d8d/d9c/dd0/l9e 412 1 2024-09-21T12:20:34.257 INFO:tasks.workunit.client.1.smithi192.stdout:0/910: rmdir d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/d43 39 2024-09-21T12:20:34.262 INFO:tasks.workunit.client.1.smithi192.stdout:1/841: rename d2/d12/d2f/d51/d24/d65/d8e/d9d/fa8 to d2/d12/d2f/d41/d5c/f110 0 2024-09-21T12:20:34.262 INFO:tasks.workunit.client.0.smithi003.stdout:9/360: rmdir d2/d20 39 2024-09-21T12:20:34.263 INFO:tasks.workunit.client.1.smithi192.stdout:3/771: getdents db/d16/d18/da7/d10e/d2e/db8 0 2024-09-21T12:20:34.263 INFO:tasks.workunit.client.1.smithi192.stdout:7/805: symlink d6/d9/d70/dda/l11d 0 2024-09-21T12:20:34.264 INFO:tasks.workunit.client.0.smithi003.stdout:5/272: creat dc/d15/d1c/f58 x:0 0 0 2024-09-21T12:20:34.266 INFO:tasks.workunit.client.1.smithi192.stdout:8/884: symlink d14/d1a/d1d/d46/d4e/d83/d8d/l127 0 2024-09-21T12:20:34.267 INFO:tasks.workunit.client.1.smithi192.stdout:8/885: write d14/d18/d94/da4/fc1 [1989467,72598] 0 2024-09-21T12:20:34.268 INFO:tasks.workunit.client.0.smithi003.stdout:7/230: mkdir d8/d3c/d57 0 2024-09-21T12:20:34.270 INFO:tasks.workunit.client.1.smithi192.stdout:0/911: creat d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/dc6/d83/dc9/f118 x:0 0 0 2024-09-21T12:20:34.270 INFO:tasks.workunit.client.1.smithi192.stdout:7/806: dread d6/d9/d1f/d3e/d7a/d8a/da2/fa5 [0,4194304] 0 2024-09-21T12:20:34.273 INFO:tasks.workunit.client.0.smithi003.stdout:2/215: dwrite d0/f3b [0,4194304] 0 2024-09-21T12:20:34.273 INFO:tasks.workunit.client.1.smithi192.stdout:9/932: rename d5/d19/dd5/d4d/dde/d114 to d5/dc/d80/d5a/dfa/d101/d127 0 2024-09-21T12:20:34.276 INFO:tasks.workunit.client.0.smithi003.stdout:2/216: read d0/dd/f1b [394873,128144] 0 2024-09-21T12:20:34.276 INFO:tasks.workunit.client.1.smithi192.stdout:9/933: dread - d5/d8/dc7/dd7/de7/d55/f11d zero size 2024-09-21T12:20:34.277 INFO:tasks.workunit.client.0.smithi003.stdout:0/267: write d9/d12/d22/f29 [1506199,78989] 0 2024-09-21T12:20:34.278 INFO:tasks.workunit.client.1.smithi192.stdout:0/912: dwrite d3/d5/d28/d39/d50/dd9/fe3 [0,4194304] 0 2024-09-21T12:20:34.279 INFO:tasks.workunit.client.0.smithi003.stdout:0/268: chown d9/d12/d17/d21/f42 31044526 1 2024-09-21T12:20:34.281 INFO:tasks.workunit.client.0.smithi003.stdout:0/269: write d9/d12/d22/f29 [3326,60277] 0 2024-09-21T12:20:34.283 INFO:tasks.workunit.client.0.smithi003.stdout:5/273: mknod dc/d15/d1c/c59 0 2024-09-21T12:20:34.283 INFO:tasks.workunit.client.1.smithi192.stdout:0/913: chown d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/dc6/l7c 0 1 2024-09-21T12:20:34.283 INFO:tasks.workunit.client.0.smithi003.stdout:2/217: dread d0/d21/f35 [0,4194304] 0 2024-09-21T12:20:34.286 INFO:tasks.workunit.client.1.smithi192.stdout:1/842: dwrite d2/da/d6b/ff7 [0,4194304] 0 2024-09-21T12:20:34.289 INFO:tasks.workunit.client.0.smithi003.stdout:7/231: creat d8/db/f58 x:0 0 0 2024-09-21T12:20:34.292 INFO:tasks.workunit.client.1.smithi192.stdout:4/804: write d2/d21/f7a [798185,51682] 0 2024-09-21T12:20:34.293 INFO:tasks.workunit.client.0.smithi003.stdout:4/230: dwrite f6 [0,4194304] 0 2024-09-21T12:20:34.293 INFO:tasks.workunit.client.0.smithi003.stdout:1/247: creat d4/df/f5d x:0 0 0 2024-09-21T12:20:34.295 INFO:tasks.workunit.client.1.smithi192.stdout:2/812: getdents d1b/d1e/d62/d99 0 2024-09-21T12:20:34.296 INFO:tasks.workunit.client.1.smithi192.stdout:6/974: sync 2024-09-21T12:20:34.297 INFO:tasks.workunit.client.1.smithi192.stdout:2/813: fdatasync d1b/d1e/d62/d99/fe2 0 2024-09-21T12:20:34.301 INFO:tasks.workunit.client.0.smithi003.stdout:7/232: dwrite d8/f17 [0,4194304] 0 2024-09-21T12:20:34.302 INFO:tasks.workunit.client.1.smithi192.stdout:8/886: creat d14/d1a/d1d/d20/f128 x:0 0 0 2024-09-21T12:20:34.304 INFO:tasks.workunit.client.0.smithi003.stdout:9/361: symlink d2/d20/d22/l81 0 2024-09-21T12:20:34.314 INFO:tasks.workunit.client.1.smithi192.stdout:9/934: dread - d5/d19/dd5/d4d/d6d/dd9/ff7 zero size 2024-09-21T12:20:34.315 INFO:tasks.workunit.client.0.smithi003.stdout:1/248: read - d4/f56 zero size 2024-09-21T12:20:34.318 INFO:tasks.workunit.client.1.smithi192.stdout:1/843: creat d2/da/d6b/d108/f111 x:0 0 0 2024-09-21T12:20:34.320 INFO:tasks.workunit.client.0.smithi003.stdout:7/233: unlink d8/db/d13/c22 0 2024-09-21T12:20:34.320 INFO:tasks.workunit.client.1.smithi192.stdout:7/807: dread d6/d20/f4d [0,4194304] 0 2024-09-21T12:20:34.322 INFO:tasks.workunit.client.1.smithi192.stdout:2/814: mknod d1b/d1e/d5e/d88/d95/c109 0 2024-09-21T12:20:34.323 INFO:tasks.workunit.client.0.smithi003.stdout:9/362: rmdir d2/da/d2a 39 2024-09-21T12:20:34.324 INFO:tasks.workunit.client.1.smithi192.stdout:2/815: write d1b/d1e/d5e/d75/d8d/fb1 [623535,69678] 0 2024-09-21T12:20:34.324 INFO:tasks.workunit.client.1.smithi192.stdout:8/887: truncate d14/d1a/d1d/d46/d4e/d83/d8d/d9c/dbe/fc8 1756153 0 2024-09-21T12:20:34.324 INFO:tasks.workunit.client.1.smithi192.stdout:6/975: dread da/d1f/d27/d3e/f94 [0,4194304] 0 2024-09-21T12:20:34.325 INFO:tasks.workunit.client.0.smithi003.stdout:0/270: mknod d9/d12/d1e/d2b/d26/d54/c58 0 2024-09-21T12:20:34.326 INFO:tasks.workunit.client.1.smithi192.stdout:6/976: chown da/d1f/c6e 75772898 1 2024-09-21T12:20:34.327 INFO:tasks.workunit.client.0.smithi003.stdout:2/218: mknod d0/dd/c4b 0 2024-09-21T12:20:34.327 INFO:tasks.workunit.client.1.smithi192.stdout:0/914: mkdir d3/d5/de0/d119 0 2024-09-21T12:20:34.328 INFO:tasks.workunit.client.1.smithi192.stdout:0/915: chown d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/f60 63011352 1 2024-09-21T12:20:34.329 INFO:tasks.workunit.client.1.smithi192.stdout:9/935: symlink d5/dc/d80/d5a/dfa/l128 0 2024-09-21T12:20:34.331 INFO:tasks.workunit.client.1.smithi192.stdout:1/844: mknod d2/da/d6b/d7d/c112 0 2024-09-21T12:20:34.331 INFO:tasks.workunit.client.0.smithi003.stdout:4/231: mkdir d9/da/d47/d4b 0 2024-09-21T12:20:34.332 INFO:tasks.workunit.client.0.smithi003.stdout:7/234: read d8/fa [2701708,24182] 0 2024-09-21T12:20:34.333 INFO:tasks.workunit.client.0.smithi003.stdout:4/232: truncate d9/da/f27 4642177 0 2024-09-21T12:20:34.336 INFO:tasks.workunit.client.1.smithi192.stdout:3/772: getdents db/d16 0 2024-09-21T12:20:34.336 INFO:tasks.workunit.client.0.smithi003.stdout:2/219: symlink d0/d21/d2f/d49/l4c 0 2024-09-21T12:20:34.338 INFO:tasks.workunit.client.1.smithi192.stdout:2/816: creat d1b/d1e/d3d/f10a x:0 0 0 2024-09-21T12:20:34.339 INFO:tasks.workunit.client.1.smithi192.stdout:8/888: creat d14/d1a/d1d/d46/d4e/d83/f129 x:0 0 0 2024-09-21T12:20:34.340 INFO:tasks.workunit.client.0.smithi003.stdout:7/235: fsync d8/db/f3d 0 2024-09-21T12:20:34.340 INFO:tasks.workunit.client.1.smithi192.stdout:8/889: stat d14/d1a/d1d/d39/d115 0 2024-09-21T12:20:34.343 INFO:tasks.workunit.client.1.smithi192.stdout:6/977: chown da/d1f/l41 48 1 2024-09-21T12:20:34.344 INFO:tasks.workunit.client.0.smithi003.stdout:7/236: dread d8/d2c/f2a [0,4194304] 0 2024-09-21T12:20:34.345 INFO:tasks.workunit.client.1.smithi192.stdout:0/916: symlink d3/d5/dd7/l11a 0 2024-09-21T12:20:34.346 INFO:tasks.workunit.client.1.smithi192.stdout:2/817: dwrite d1b/d9e/de1/fae [0,4194304] 0 2024-09-21T12:20:34.347 INFO:tasks.workunit.client.1.smithi192.stdout:0/917: read - d3/d5/d28/fc8 zero size 2024-09-21T12:20:34.348 INFO:tasks.workunit.client.0.smithi003.stdout:2/220: symlink d0/d21/d2f/d49/l4d 0 2024-09-21T12:20:34.353 INFO:tasks.workunit.client.1.smithi192.stdout:1/845: creat d2/d12/d2f/d51/d24/f113 x:0 0 0 2024-09-21T12:20:34.353 INFO:tasks.workunit.client.0.smithi003.stdout:1/249: creat d4/f5e x:0 0 0 2024-09-21T12:20:34.354 INFO:tasks.workunit.client.1.smithi192.stdout:3/773: dread db/f3c [0,4194304] 0 2024-09-21T12:20:34.355 INFO:tasks.workunit.client.1.smithi192.stdout:7/808: mknod d6/d20/d69/d90/da7/c11e 0 2024-09-21T12:20:34.355 INFO:tasks.workunit.client.0.smithi003.stdout:5/274: truncate dc/d15/d21/d30/f42 1618722 0 2024-09-21T12:20:34.356 INFO:tasks.workunit.client.0.smithi003.stdout:5/275: chown cb 46 1 2024-09-21T12:20:34.357 INFO:tasks.workunit.client.1.smithi192.stdout:3/774: truncate db/d16/db4/fe8 888036 0 2024-09-21T12:20:34.357 INFO:tasks.workunit.client.1.smithi192.stdout:1/846: write d2/d12/d2f/d51/d24/d65/d8e/d9d/db6/fbd [2395258,123133] 0 2024-09-21T12:20:34.357 INFO:tasks.workunit.client.1.smithi192.stdout:3/775: stat db/d16/d18/d21/f5d 0 2024-09-21T12:20:34.362 INFO:tasks.workunit.client.1.smithi192.stdout:4/805: getdents d2/d36/d7f 0 2024-09-21T12:20:34.364 INFO:tasks.workunit.client.1.smithi192.stdout:8/890: dread d14/d1a/d1d/f64 [0,4194304] 0 2024-09-21T12:20:34.365 INFO:tasks.workunit.client.1.smithi192.stdout:6/978: mknod da/d23/d37/d75/de2/dec/c141 0 2024-09-21T12:20:34.368 INFO:tasks.workunit.client.0.smithi003.stdout:7/237: chown d8/d31/c42 485 1 2024-09-21T12:20:34.369 INFO:tasks.workunit.client.0.smithi003.stdout:7/238: write d8/db/d13/f44 [810847,19095] 0 2024-09-21T12:20:34.370 INFO:tasks.workunit.client.0.smithi003.stdout:0/271: creat d9/f59 x:0 0 0 2024-09-21T12:20:34.370 INFO:tasks.workunit.client.0.smithi003.stdout:7/239: rename d8/db to d8/db/d32/d59 22 2024-09-21T12:20:34.372 INFO:tasks.workunit.client.1.smithi192.stdout:9/936: dwrite d5/d19/fa8 [0,4194304] 0 2024-09-21T12:20:34.373 INFO:tasks.workunit.client.1.smithi192.stdout:7/809: rmdir d6/d9/d2d/d7b 39 2024-09-21T12:20:34.375 INFO:tasks.workunit.client.0.smithi003.stdout:1/250: creat d4/d11/d14/d25/d42/f5f x:0 0 0 2024-09-21T12:20:34.382 INFO:tasks.workunit.client.0.smithi003.stdout:9/363: link d2/da/d17/l73 d2/d20/d22/d5e/l82 0 2024-09-21T12:20:34.383 INFO:tasks.workunit.client.1.smithi192.stdout:3/776: rename db/d16/d18/d21/dde/l110 to db/d16/l11b 0 2024-09-21T12:20:34.385 INFO:tasks.workunit.client.0.smithi003.stdout:0/272: unlink f4 0 2024-09-21T12:20:34.407 INFO:tasks.workunit.client.1.smithi192.stdout:4/806: symlink d2/db/da4/l10e 0 2024-09-21T12:20:34.408 INFO:tasks.workunit.client.1.smithi192.stdout:4/807: write d2/fde [869105,93359] 0 2024-09-21T12:20:34.409 INFO:tasks.workunit.client.0.smithi003.stdout:7/240: rename d8/d3c/f56 to d8/d31/d41/f5a 0 2024-09-21T12:20:34.410 INFO:tasks.workunit.client.0.smithi003.stdout:7/241: readlink d8/d3c/l4e 0 2024-09-21T12:20:34.410 INFO:tasks.workunit.client.1.smithi192.stdout:8/891: rmdir d14/d1a/d82 39 2024-09-21T12:20:34.410 INFO:tasks.workunit.client.1.smithi192.stdout:8/892: readlink l13 0 2024-09-21T12:20:34.412 INFO:tasks.workunit.client.0.smithi003.stdout:2/221: link d0/d1c/f2e d0/d21/f4e 0 2024-09-21T12:20:34.413 INFO:tasks.workunit.client.1.smithi192.stdout:6/979: mkdir da/d1f/d48/d7d/d9a/d9e/dbe/d142 0 2024-09-21T12:20:34.415 INFO:tasks.workunit.client.0.smithi003.stdout:5/276: mknod dc/d15/d21/d57/c5a 0 2024-09-21T12:20:34.416 INFO:tasks.workunit.client.0.smithi003.stdout:5/277: write dc/d2b/f44 [2399486,118782] 0 2024-09-21T12:20:34.417 INFO:tasks.workunit.client.0.smithi003.stdout:4/233: getdents d9/da 0 2024-09-21T12:20:34.418 INFO:tasks.workunit.client.0.smithi003.stdout:4/234: read - d9/da/d36/f3f zero size 2024-09-21T12:20:34.418 INFO:tasks.workunit.client.0.smithi003.stdout:9/364: mkdir d2/d53/d83 0 2024-09-21T12:20:34.419 INFO:tasks.workunit.client.0.smithi003.stdout:9/365: write f1 [749883,8064] 0 2024-09-21T12:20:34.420 INFO:tasks.workunit.client.0.smithi003.stdout:9/366: truncate d2/f10 4516596 0 2024-09-21T12:20:34.421 INFO:tasks.workunit.client.1.smithi192.stdout:9/937: symlink d5/dc/d64/l129 0 2024-09-21T12:20:34.423 INFO:tasks.workunit.client.1.smithi192.stdout:7/810: read - d6/d9/d1f/d3e/d7a/faf zero size 2024-09-21T12:20:34.424 INFO:tasks.workunit.client.1.smithi192.stdout:7/811: chown d6/d9/d70/d77/dcd/deb/c112 12 1 2024-09-21T12:20:34.426 INFO:tasks.workunit.client.1.smithi192.stdout:1/847: mkdir d2/d12/d114 0 2024-09-21T12:20:34.430 INFO:tasks.workunit.client.1.smithi192.stdout:2/818: write d1b/f87 [3808381,75077] 0 2024-09-21T12:20:34.430 INFO:tasks.workunit.client.1.smithi192.stdout:7/812: dwrite d6/d9/f5d [4194304,4194304] 0 2024-09-21T12:20:34.431 INFO:tasks.workunit.client.0.smithi003.stdout:2/222: fdatasync d0/dd/f1b 0 2024-09-21T12:20:34.433 INFO:tasks.workunit.client.0.smithi003.stdout:2/223: read d0/dd/d22/d37/f48 [390152,23772] 0 2024-09-21T12:20:34.435 INFO:tasks.workunit.client.0.smithi003.stdout:2/224: write d0/dd/f29 [3225971,73516] 0 2024-09-21T12:20:34.436 INFO:tasks.workunit.client.0.smithi003.stdout:2/225: write d0/dd/d22/f4a [20410,81552] 0 2024-09-21T12:20:34.437 INFO:tasks.workunit.client.1.smithi192.stdout:2/819: read d1b/d1e/d5e/d88/d95/dbe/fd2 [4051850,16184] 0 2024-09-21T12:20:34.439 INFO:tasks.workunit.client.0.smithi003.stdout:1/251: rename d4/dc/f35 to d4/df/d41/f60 0 2024-09-21T12:20:34.440 INFO:tasks.workunit.client.0.smithi003.stdout:1/252: fsync d4/df/f5d 0 2024-09-21T12:20:34.441 INFO:tasks.workunit.client.0.smithi003.stdout:1/253: write d4/df/f38 [944630,5101] 0 2024-09-21T12:20:34.443 INFO:tasks.workunit.client.0.smithi003.stdout:5/278: stat dc/l12 0 2024-09-21T12:20:34.447 INFO:tasks.workunit.client.1.smithi192.stdout:1/848: mknod d2/d4d/c115 0 2024-09-21T12:20:34.448 INFO:tasks.workunit.client.1.smithi192.stdout:3/777: readlink db/d16/l4b 0 2024-09-21T12:20:34.450 INFO:tasks.workunit.client.1.smithi192.stdout:8/893: write d14/d1a/d1d/d46/d4e/f65 [1847314,74246] 0 2024-09-21T12:20:34.452 INFO:tasks.workunit.client.0.smithi003.stdout:9/367: dwrite d2/da/d2a/f5a [0,4194304] 0 2024-09-21T12:20:34.452 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:34 smithi003 ceph-mon[28057]: mgrmap e22: smithi192.qsaprd(active, since 1.02035s) 2024-09-21T12:20:34.452 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:34 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' 2024-09-21T12:20:34.453 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:34 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' 2024-09-21T12:20:34.453 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:34 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:20:34.453 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:34 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:20:34.453 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:34 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T12:20:34.453 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:34 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi192.qsaprd/mirror_snapshot_schedule"}]: dispatch 2024-09-21T12:20:34.453 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:34 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi192.qsaprd/trash_purge_schedule"}]: dispatch 2024-09-21T12:20:34.453 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:34 smithi003 ceph-mon[28057]: Deploying cephadm binary to smithi192 2024-09-21T12:20:34.455 INFO:tasks.workunit.client.1.smithi192.stdout:9/938: write d5/dc/d40/f25 [5879417,129812] 0 2024-09-21T12:20:34.459 INFO:tasks.workunit.client.1.smithi192.stdout:2/820: mkdir d1b/d1e/d5e/d75/d8d/d10b 0 2024-09-21T12:20:34.461 INFO:tasks.workunit.client.0.smithi003.stdout:5/279: write dc/d15/d26/f2e [731449,106488] 0 2024-09-21T12:20:34.462 INFO:tasks.workunit.client.1.smithi192.stdout:6/980: truncate da/d1f/d27/fb1 840943 0 2024-09-21T12:20:34.463 INFO:tasks.workunit.client.0.smithi003.stdout:5/280: stat dc/c38 0 2024-09-21T12:20:34.463 INFO:tasks.workunit.client.1.smithi192.stdout:7/813: write d6/d9/d70/d77/dcd/fc3 [1035154,112177] 0 2024-09-21T12:20:34.464 INFO:tasks.workunit.client.0.smithi003.stdout:0/273: dwrite d9/fb [0,4194304] 0 2024-09-21T12:20:34.465 INFO:tasks.workunit.client.1.smithi192.stdout:0/918: getdents d3/d5/d28/d39/d50/dd9/d7a/dbe/d92 0 2024-09-21T12:20:34.466 INFO:tasks.workunit.client.1.smithi192.stdout:8/894: dread d14/d1a/d1d/d48/f62 [0,4194304] 0 2024-09-21T12:20:34.466 INFO:tasks.workunit.client.1.smithi192.stdout:7/814: fsync d6/d9/d70/d77/f79 0 2024-09-21T12:20:34.466 INFO:tasks.workunit.client.1.smithi192.stdout:6/981: chown da/d1f/d48/d7d/d9a/d9e/dbe/cc1 10402 1 2024-09-21T12:20:34.466 INFO:tasks.workunit.client.0.smithi003.stdout:2/226: write d0/d21/f35 [3812524,7453] 0 2024-09-21T12:20:34.468 INFO:tasks.workunit.client.1.smithi192.stdout:1/849: symlink d2/d12/d2f/d41/d5c/d99/l116 0 2024-09-21T12:20:34.470 INFO:tasks.workunit.client.1.smithi192.stdout:2/821: dread d1b/d65/ff7 [0,4194304] 0 2024-09-21T12:20:34.474 INFO:tasks.workunit.client.0.smithi003.stdout:5/281: rename dc/d15/d21/d57 to dc/d15/d21/d28/d41/d5b 0 2024-09-21T12:20:34.478 INFO:tasks.workunit.client.1.smithi192.stdout:9/939: rename d5/f100 to d5/d8/dc7/f12a 0 2024-09-21T12:20:34.479 INFO:tasks.workunit.client.0.smithi003.stdout:0/274: mknod d9/d12/d1e/d2b/d26/c5a 0 2024-09-21T12:20:34.483 INFO:tasks.workunit.client.0.smithi003.stdout:2/227: dread d0/dd/d22/f23 [0,4194304] 0 2024-09-21T12:20:34.486 INFO:tasks.workunit.client.1.smithi192.stdout:8/895: mknod d14/d18/daf/ddd/c12a 0 2024-09-21T12:20:34.486 INFO:tasks.workunit.client.0.smithi003.stdout:1/254: write f2 [257382,47896] 0 2024-09-21T12:20:34.487 INFO:tasks.workunit.client.1.smithi192.stdout:8/896: write d14/d1a/d1d/d20/d5f/fea [883532,848] 0 2024-09-21T12:20:34.487 INFO:tasks.workunit.client.0.smithi003.stdout:1/255: chown d4/f5e 32724 1 2024-09-21T12:20:34.488 INFO:tasks.workunit.client.0.smithi003.stdout:9/368: dread d2/da/d17/d40/f44 [0,4194304] 0 2024-09-21T12:20:34.492 INFO:tasks.workunit.client.0.smithi003.stdout:0/275: symlink d9/d12/d1e/d2b/l5b 0 2024-09-21T12:20:34.494 INFO:tasks.workunit.client.1.smithi192.stdout:3/778: mkdir db/d16/d18/d21/d23/d71/d77/d11c 0 2024-09-21T12:20:34.496 INFO:tasks.workunit.client.1.smithi192.stdout:4/808: getdents d2/d36/d55/d89/dc8/df7/d6c/db8/d99 0 2024-09-21T12:20:34.498 INFO:tasks.workunit.client.0.smithi003.stdout:1/256: dread - d4/f3c zero size 2024-09-21T12:20:34.500 INFO:tasks.workunit.client.0.smithi003.stdout:5/282: mkdir dc/d15/d21/d30/d4b/d5c 0 2024-09-21T12:20:34.501 INFO:tasks.workunit.client.1.smithi192.stdout:9/940: mknod d5/dc/d64/dbb/c12b 0 2024-09-21T12:20:34.502 INFO:tasks.workunit.client.1.smithi192.stdout:9/941: chown d5/dc/d64/dbb/d3d/l7b 531574944 1 2024-09-21T12:20:34.503 INFO:tasks.workunit.client.1.smithi192.stdout:9/942: stat d5/d8/dc7/dd7/de7/d55/d93 0 2024-09-21T12:20:34.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:34 smithi192 ceph-mon[35641]: mgrmap e22: smithi192.qsaprd(active, since 1.02035s) 2024-09-21T12:20:34.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:34 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' 2024-09-21T12:20:34.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:34 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' 2024-09-21T12:20:34.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:34 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:20:34.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:34 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:20:34.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:34 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T12:20:34.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:34 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi192.qsaprd/mirror_snapshot_schedule"}]: dispatch 2024-09-21T12:20:34.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:34 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi192.qsaprd/trash_purge_schedule"}]: dispatch 2024-09-21T12:20:34.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:34 smithi192 ceph-mon[35641]: Deploying cephadm binary to smithi192 2024-09-21T12:20:34.509 INFO:tasks.workunit.client.1.smithi192.stdout:9/943: dwrite d5/dc/d64/dbb/d3d/f54 [0,4194304] 0 2024-09-21T12:20:34.509 INFO:tasks.workunit.client.0.smithi003.stdout:1/257: dwrite d4/dc/f32 [0,4194304] 0 2024-09-21T12:20:34.509 INFO:tasks.workunit.client.0.smithi003.stdout:0/276: dread d9/d12/d1e/d2b/d26/f3c [0,4194304] 0 2024-09-21T12:20:34.509 INFO:tasks.workunit.client.0.smithi003.stdout:9/369: dread d2/d20/f21 [0,4194304] 0 2024-09-21T12:20:34.510 INFO:tasks.workunit.client.1.smithi192.stdout:9/944: stat d5/dc/d64/dbb/df1 0 2024-09-21T12:20:34.510 INFO:tasks.workunit.client.1.smithi192.stdout:1/850: mkdir d2/d10d/d117 0 2024-09-21T12:20:34.510 INFO:tasks.workunit.client.0.smithi003.stdout:9/370: write d2/f10 [4677573,24582] 0 2024-09-21T12:20:34.512 INFO:tasks.workunit.client.0.smithi003.stdout:5/283: creat dc/d15/d21/f5d x:0 0 0 2024-09-21T12:20:34.513 INFO:tasks.workunit.client.1.smithi192.stdout:1/851: dread - d2/d12/d2f/d51/d24/d65/d8b/dd5/fee zero size 2024-09-21T12:20:34.515 INFO:tasks.workunit.client.1.smithi192.stdout:2/822: link d1b/d1e/d5e/d75/f84 d1b/d9e/f10c 0 2024-09-21T12:20:34.515 INFO:tasks.workunit.client.1.smithi192.stdout:8/897: write d14/d1a/d1d/d20/d5f/f68 [1309265,36417] 0 2024-09-21T12:20:34.516 INFO:tasks.workunit.client.1.smithi192.stdout:8/898: fdatasync d14/fc5 0 2024-09-21T12:20:34.519 INFO:tasks.workunit.client.0.smithi003.stdout:0/277: dwrite d9/d12/d1e/f2e [0,4194304] 0 2024-09-21T12:20:34.520 INFO:tasks.workunit.client.1.smithi192.stdout:0/919: creat d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/d43/d110/f11b x:0 0 0 2024-09-21T12:20:34.521 INFO:tasks.workunit.client.0.smithi003.stdout:9/371: creat d2/da/d17/f84 x:0 0 0 2024-09-21T12:20:34.522 INFO:tasks.workunit.client.0.smithi003.stdout:0/278: write d9/d12/d17/d21/f42 [8645936,20401] 0 2024-09-21T12:20:34.526 INFO:tasks.workunit.client.1.smithi192.stdout:7/815: rename d6/d9/d2d/dc4/fef to d6/f11f 0 2024-09-21T12:20:34.527 INFO:tasks.workunit.client.1.smithi192.stdout:2/823: read d1b/d1e/f36 [316682,115216] 0 2024-09-21T12:20:34.531 INFO:tasks.workunit.client.1.smithi192.stdout:1/852: rename d2/d12/d2f/d51/d24/d65/d8e/cfb to d2/d12/d2f/d41/d5c/d101/c118 0 2024-09-21T12:20:34.532 INFO:tasks.workunit.client.0.smithi003.stdout:1/258: dwrite d4/f7 [0,4194304] 0 2024-09-21T12:20:34.532 INFO:tasks.workunit.client.0.smithi003.stdout:9/372: truncate d2/da/d2a/d3c/f4b 70263 0 2024-09-21T12:20:34.532 INFO:tasks.workunit.client.1.smithi192.stdout:1/853: write d2/d12/d2f/d51/fdb [97300,97003] 0 2024-09-21T12:20:34.533 INFO:tasks.workunit.client.1.smithi192.stdout:2/824: truncate d1b/d65/f6e 855361 0 2024-09-21T12:20:34.535 INFO:tasks.workunit.client.0.smithi003.stdout:5/284: dread dc/d15/d21/d30/f34 [0,4194304] 0 2024-09-21T12:20:34.537 INFO:tasks.workunit.client.0.smithi003.stdout:2/228: getdents d0/d21/d2f 0 2024-09-21T12:20:34.540 INFO:tasks.workunit.client.1.smithi192.stdout:0/920: getdents d3/d5/d69 0 2024-09-21T12:20:34.540 INFO:tasks.workunit.client.0.smithi003.stdout:5/285: rename dc/c17 to dc/d2b/d4e/c5e 0 2024-09-21T12:20:34.541 INFO:tasks.workunit.client.0.smithi003.stdout:0/279: dwrite d9/d12/d1e/d2b/d26/f3e [0,4194304] 0 2024-09-21T12:20:34.542 INFO:tasks.workunit.client.1.smithi192.stdout:1/854: symlink d2/d12/d2f/d51/d24/l119 0 2024-09-21T12:20:34.543 INFO:tasks.workunit.client.0.smithi003.stdout:0/280: fdatasync d9/d12/d22/f29 0 2024-09-21T12:20:34.544 INFO:tasks.workunit.client.0.smithi003.stdout:2/229: unlink d0/f18 0 2024-09-21T12:20:34.545 INFO:tasks.workunit.client.1.smithi192.stdout:2/825: read d1b/d1e/d5e/d75/f82 [271675,95036] 0 2024-09-21T12:20:34.550 INFO:tasks.workunit.client.0.smithi003.stdout:5/286: dread dc/d15/f3f [0,4194304] 0 2024-09-21T12:20:34.551 INFO:tasks.workunit.client.0.smithi003.stdout:5/287: fsync dc/d15/f1f 0 2024-09-21T12:20:34.553 INFO:tasks.workunit.client.0.smithi003.stdout:5/288: write dc/d15/d21/d30/f33 [669074,21022] 0 2024-09-21T12:20:34.554 INFO:tasks.workunit.client.1.smithi192.stdout:4/809: dwrite d2/d36/d7f/df5/d4f/fbd [0,4194304] 0 2024-09-21T12:20:34.557 INFO:tasks.workunit.client.1.smithi192.stdout:7/816: write d6/d9/d70/d77/f9a [988493,51067] 0 2024-09-21T12:20:34.563 INFO:tasks.workunit.client.0.smithi003.stdout:9/373: rename d2/c45 to d2/c85 0 2024-09-21T12:20:34.564 INFO:tasks.workunit.client.1.smithi192.stdout:1/855: dwrite d2/da/d6b/d7d/ffe [0,4194304] 0 2024-09-21T12:20:34.564 INFO:tasks.workunit.client.0.smithi003.stdout:5/289: readlink dc/d15/l47 0 2024-09-21T12:20:34.565 INFO:tasks.workunit.client.0.smithi003.stdout:5/290: dread - dc/d15/d1c/f4c zero size 2024-09-21T12:20:34.567 INFO:tasks.workunit.client.1.smithi192.stdout:4/810: rename d2/d36/d7f/df5/d4f/d71/d9d/dad/d9c/lae to d2/d36/d7f/df5/l10f 0 2024-09-21T12:20:34.575 INFO:tasks.workunit.client.0.smithi003.stdout:1/259: getdents d4/df 0 2024-09-21T12:20:34.575 INFO:tasks.workunit.client.0.smithi003.stdout:5/291: dwrite dc/f3a [0,4194304] 0 2024-09-21T12:20:34.580 INFO:tasks.workunit.client.0.smithi003.stdout:2/230: mknod d0/d21/d2c/c4f 0 2024-09-21T12:20:34.580 INFO:tasks.workunit.client.0.smithi003.stdout:5/292: write dc/d2b/f44 [3837148,65774] 0 2024-09-21T12:20:34.580 INFO:tasks.workunit.client.1.smithi192.stdout:0/921: dread d3/d5/d28/d39/d50/dd9/d7a/dbe/d92/f107 [0,4194304] 0 2024-09-21T12:20:34.581 INFO:tasks.workunit.client.1.smithi192.stdout:2/826: dwrite d1b/d9e/f10c [4194304,4194304] 0 2024-09-21T12:20:34.583 INFO:tasks.workunit.client.1.smithi192.stdout:1/856: rename d2/d12/d2f/d51/d24/d65/f53 to d2/de/dcf/f11a 0 2024-09-21T12:20:34.584 INFO:tasks.workunit.client.1.smithi192.stdout:4/811: mknod d2/d36/d7f/df5/d4f/d71/d9d/dad/d4b/c110 0 2024-09-21T12:20:34.585 INFO:tasks.workunit.client.0.smithi003.stdout:5/293: chown dc/f4d 1030724 1 2024-09-21T12:20:34.586 INFO:tasks.workunit.client.1.smithi192.stdout:7/817: mkdir d6/d9/d70/d119/d120 0 2024-09-21T12:20:34.589 INFO:tasks.workunit.client.0.smithi003.stdout:2/231: mkdir d0/d21/d2f/d50 0 2024-09-21T12:20:34.590 INFO:tasks.workunit.client.0.smithi003.stdout:0/281: link d9/d12/d1e/d2b/l5b d9/l5c 0 2024-09-21T12:20:34.591 INFO:tasks.workunit.client.1.smithi192.stdout:1/857: mknod d2/d12/d2f/d41/d5c/d99/c11b 0 2024-09-21T12:20:34.592 INFO:tasks.workunit.client.0.smithi003.stdout:5/294: truncate dc/d15/d21/f5d 15052 0 2024-09-21T12:20:34.592 INFO:tasks.workunit.client.0.smithi003.stdout:1/260: dwrite d4/f3c [0,4194304] 0 2024-09-21T12:20:34.593 INFO:tasks.workunit.client.1.smithi192.stdout:0/922: dwrite d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/d33/dae/db4/fc0 [4194304,4194304] 0 2024-09-21T12:20:34.593 INFO:tasks.workunit.client.0.smithi003.stdout:9/374: creat d2/f86 x:0 0 0 2024-09-21T12:20:34.595 INFO:tasks.workunit.client.1.smithi192.stdout:7/818: dread d6/d9/d1f/d3e/d7a/fc8 [0,4194304] 0 2024-09-21T12:20:34.598 INFO:tasks.workunit.client.1.smithi192.stdout:0/923: write d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/f10f [128170,20630] 0 2024-09-21T12:20:34.600 INFO:tasks.workunit.client.0.smithi003.stdout:9/375: rmdir d2/da/d35/d4d 39 2024-09-21T12:20:34.606 INFO:tasks.workunit.client.0.smithi003.stdout:5/295: creat dc/d15/d1c/f5f x:0 0 0 2024-09-21T12:20:34.609 INFO:tasks.workunit.client.0.smithi003.stdout:6/253: sync 2024-09-21T12:20:34.609 INFO:tasks.workunit.client.0.smithi003.stdout:2/232: dwrite d0/f3b [4194304,4194304] 0 2024-09-21T12:20:34.610 INFO:tasks.workunit.client.1.smithi192.stdout:1/858: truncate d2/d12/d2f/f5f 1981468 0 2024-09-21T12:20:34.612 INFO:tasks.workunit.client.0.smithi003.stdout:0/282: dwrite d9/d12/d1e/d2b/d26/f39 [0,4194304] 0 2024-09-21T12:20:34.612 INFO:tasks.workunit.client.0.smithi003.stdout:9/376: mkdir d2/d20/d22/d5e/d87 0 2024-09-21T12:20:34.617 INFO:tasks.workunit.client.1.smithi192.stdout:1/859: dread d2/d12/d2f/ff6 [0,4194304] 0 2024-09-21T12:20:34.619 INFO:tasks.workunit.client.0.smithi003.stdout:6/254: dwrite d4/f5 [4194304,4194304] 0 2024-09-21T12:20:34.621 INFO:tasks.workunit.client.0.smithi003.stdout:6/255: dread - d4/d13/d19/f49 zero size 2024-09-21T12:20:34.623 INFO:tasks.workunit.client.0.smithi003.stdout:5/296: symlink dc/d2b/l60 0 2024-09-21T12:20:34.624 INFO:tasks.workunit.client.0.smithi003.stdout:6/256: dread - d4/d11/f2f zero size 2024-09-21T12:20:34.628 INFO:tasks.workunit.client.1.smithi192.stdout:2/827: dwrite d1b/f2a [0,4194304] 0 2024-09-21T12:20:34.636 INFO:tasks.workunit.client.0.smithi003.stdout:9/377: dwrite d2/da/d17/f7a [0,4194304] 0 2024-09-21T12:20:34.637 INFO:tasks.workunit.client.0.smithi003.stdout:2/233: truncate d0/f1d 799288 0 2024-09-21T12:20:34.640 INFO:tasks.workunit.client.0.smithi003.stdout:0/283: truncate d9/d12/d1e/d2b/d26/f35 5239599 0 2024-09-21T12:20:34.646 INFO:tasks.workunit.client.0.smithi003.stdout:5/297: dwrite dc/f1a [0,4194304] 0 2024-09-21T12:20:34.647 INFO:tasks.workunit.client.0.smithi003.stdout:6/257: dwrite d4/fc [0,4194304] 0 2024-09-21T12:20:34.649 INFO:tasks.workunit.client.0.smithi003.stdout:6/258: readlink d4/l12 0 2024-09-21T12:20:34.651 INFO:tasks.workunit.client.0.smithi003.stdout:9/378: symlink d2/d29/l88 0 2024-09-21T12:20:34.652 INFO:tasks.workunit.client.0.smithi003.stdout:1/261: dwrite d4/df/d19/f36 [0,4194304] 0 2024-09-21T12:20:34.654 INFO:tasks.workunit.client.0.smithi003.stdout:0/284: write d9/d12/d17/f36 [711446,38730] 0 2024-09-21T12:20:34.654 INFO:tasks.workunit.client.1.smithi192.stdout:0/924: dread d3/d5/d28/d39/d50/dd9/d7a/dbe/f65 [0,4194304] 0 2024-09-21T12:20:34.655 INFO:tasks.workunit.client.0.smithi003.stdout:5/298: dread - dc/d15/d1c/f5f zero size 2024-09-21T12:20:34.656 INFO:tasks.workunit.client.1.smithi192.stdout:6/982: sync 2024-09-21T12:20:34.660 INFO:tasks.workunit.client.0.smithi003.stdout:9/379: chown d2/da/l51 17 1 2024-09-21T12:20:34.665 INFO:tasks.workunit.client.0.smithi003.stdout:2/234: rename d0/dd/d16/f2d to d0/d21/f51 0 2024-09-21T12:20:34.668 INFO:tasks.workunit.client.0.smithi003.stdout:9/380: mkdir d2/da/d2a/d89 0 2024-09-21T12:20:34.669 INFO:tasks.workunit.client.0.smithi003.stdout:9/381: chown d2/da/d35 62691 1 2024-09-21T12:20:34.670 INFO:tasks.workunit.client.0.smithi003.stdout:6/259: symlink d4/d11/d17/l52 0 2024-09-21T12:20:34.672 INFO:tasks.workunit.client.0.smithi003.stdout:6/260: chown d4/d13/d2e/d37/f31 18717 1 2024-09-21T12:20:34.672 INFO:tasks.workunit.client.0.smithi003.stdout:5/299: mknod dc/d15/d21/c61 0 2024-09-21T12:20:34.674 INFO:tasks.workunit.client.0.smithi003.stdout:0/285: symlink d9/d12/d22/l5d 0 2024-09-21T12:20:34.675 INFO:tasks.workunit.client.0.smithi003.stdout:0/286: chown d9/d12/d17/f36 1856222820 1 2024-09-21T12:20:34.676 INFO:tasks.workunit.client.0.smithi003.stdout:0/287: truncate d9/f3b 5181693 0 2024-09-21T12:20:34.678 INFO:tasks.workunit.client.0.smithi003.stdout:9/382: rename d2/da/d2a/l2d to d2/d53/d83/l8a 0 2024-09-21T12:20:34.681 INFO:tasks.workunit.client.0.smithi003.stdout:5/300: symlink dc/d15/d21/d28/d41/l62 0 2024-09-21T12:20:34.682 INFO:tasks.workunit.client.0.smithi003.stdout:2/235: creat d0/d1c/f52 x:0 0 0 2024-09-21T12:20:34.689 INFO:tasks.workunit.client.0.smithi003.stdout:5/301: dwrite dc/f3a [0,4194304] 0 2024-09-21T12:20:34.689 INFO:tasks.workunit.client.0.smithi003.stdout:8/256: sync 2024-09-21T12:20:34.691 INFO:tasks.workunit.client.0.smithi003.stdout:5/302: truncate dc/d15/d1c/f58 439620 0 2024-09-21T12:20:34.694 INFO:tasks.workunit.client.0.smithi003.stdout:1/262: dread d4/df/f21 [0,4194304] 0 2024-09-21T12:20:34.695 INFO:tasks.workunit.client.0.smithi003.stdout:1/263: dread - d4/d11/d14/d25/d42/f5f zero size 2024-09-21T12:20:34.696 INFO:tasks.workunit.client.0.smithi003.stdout:2/236: unlink d0/dd/l17 0 2024-09-21T12:20:34.701 INFO:tasks.workunit.client.0.smithi003.stdout:5/303: mknod dc/d15/d26/c63 0 2024-09-21T12:20:34.703 INFO:tasks.workunit.client.0.smithi003.stdout:1/264: creat d4/d11/d14/f61 x:0 0 0 2024-09-21T12:20:34.706 INFO:tasks.workunit.client.0.smithi003.stdout:6/261: write d4/d13/f20 [444190,22854] 0 2024-09-21T12:20:34.707 INFO:tasks.workunit.client.0.smithi003.stdout:0/288: creat d9/f5e x:0 0 0 2024-09-21T12:20:34.708 INFO:tasks.workunit.client.1.smithi192.stdout:4/812: getdents d2/d36/d55/d89/dc8/df7/d6c/db8/d88 0 2024-09-21T12:20:34.708 INFO:tasks.workunit.client.0.smithi003.stdout:6/262: truncate d4/d11/d1d/f43 4946825 0 2024-09-21T12:20:34.709 INFO:tasks.workunit.client.0.smithi003.stdout:8/257: mkdir d7/d57 0 2024-09-21T12:20:34.713 INFO:tasks.workunit.client.0.smithi003.stdout:5/304: creat dc/d15/d21/f64 x:0 0 0 2024-09-21T12:20:34.714 INFO:tasks.workunit.client.0.smithi003.stdout:5/305: write dc/d15/d1c/f3e [949406,95668] 0 2024-09-21T12:20:34.714 INFO:tasks.workunit.client.0.smithi003.stdout:1/265: creat d4/d11/d14/f62 x:0 0 0 2024-09-21T12:20:34.719 INFO:tasks.workunit.client.1.smithi192.stdout:1/860: dread d2/d12/d2f/d51/d24/d65/d8b/fd7 [0,4194304] 0 2024-09-21T12:20:34.721 INFO:tasks.workunit.client.1.smithi192.stdout:3/779: sync 2024-09-21T12:20:34.722 INFO:tasks.workunit.client.1.smithi192.stdout:8/899: sync 2024-09-21T12:20:34.722 INFO:tasks.workunit.client.1.smithi192.stdout:9/945: sync 2024-09-21T12:20:34.722 INFO:tasks.workunit.client.0.smithi003.stdout:6/263: mkdir d4/d11/d53 0 2024-09-21T12:20:34.722 INFO:tasks.workunit.client.1.smithi192.stdout:9/946: chown d5/d19/dd5/f9a 5658367 1 2024-09-21T12:20:34.723 INFO:tasks.workunit.client.0.smithi003.stdout:9/383: dwrite d2/da/d2a/f33 [0,4194304] 0 2024-09-21T12:20:34.726 INFO:tasks.workunit.client.0.smithi003.stdout:5/306: dwrite dc/d15/d1c/f29 [0,4194304] 0 2024-09-21T12:20:34.726 INFO:tasks.workunit.client.1.smithi192.stdout:0/925: creat d3/d5/d69/f11c x:0 0 0 2024-09-21T12:20:34.728 INFO:tasks.workunit.client.1.smithi192.stdout:8/900: dwrite d14/d1a/d1d/d46/d4e/d83/d8d/dd8/f121 [0,4194304] 0 2024-09-21T12:20:34.730 INFO:tasks.workunit.client.1.smithi192.stdout:8/901: fdatasync d14/d1a/d1d/d46/d4e/d83/d8d/f11e 0 2024-09-21T12:20:34.735 INFO:tasks.workunit.client.0.smithi003.stdout:1/266: rmdir d4/d11/d14 39 2024-09-21T12:20:34.738 INFO:tasks.workunit.client.0.smithi003.stdout:8/258: dwrite d7/df/f12 [0,4194304] 0 2024-09-21T12:20:34.741 INFO:tasks.workunit.client.0.smithi003.stdout:9/384: dwrite d2/da/d2a/f5a [0,4194304] 0 2024-09-21T12:20:34.741 INFO:tasks.workunit.client.0.smithi003.stdout:8/259: chown d7/de/d11/c13 1 1 2024-09-21T12:20:34.743 INFO:tasks.workunit.client.0.smithi003.stdout:9/385: read d2/d53/f7f [3613964,19258] 0 2024-09-21T12:20:34.744 INFO:tasks.workunit.client.0.smithi003.stdout:0/289: unlink d9/d12/d22/l25 0 2024-09-21T12:20:34.745 INFO:tasks.workunit.client.1.smithi192.stdout:7/819: dwrite d6/d9/d2d/d7b/fbd [0,4194304] 0 2024-09-21T12:20:34.746 INFO:tasks.workunit.client.0.smithi003.stdout:2/237: write d0/f2 [621860,121011] 0 2024-09-21T12:20:34.749 INFO:tasks.workunit.client.1.smithi192.stdout:3/780: unlink db/d16/d18/d40/d60/d7b/ce5 0 2024-09-21T12:20:34.757 INFO:tasks.workunit.client.0.smithi003.stdout:0/290: dwrite d9/d12/f33 [0,4194304] 0 2024-09-21T12:20:34.759 INFO:tasks.workunit.client.0.smithi003.stdout:1/267: mkdir d4/d11/d14/d25/d42/d63 0 2024-09-21T12:20:34.759 INFO:tasks.workunit.client.0.smithi003.stdout:8/260: creat d7/df/d16/f58 x:0 0 0 2024-09-21T12:20:34.764 INFO:tasks.workunit.client.1.smithi192.stdout:7/820: creat d6/d9/d70/d119/f121 x:0 0 0 2024-09-21T12:20:34.766 INFO:tasks.workunit.client.0.smithi003.stdout:1/268: write f2 [1619585,99885] 0 2024-09-21T12:20:34.769 INFO:tasks.workunit.client.1.smithi192.stdout:3/781: symlink db/d16/d18/d40/d60/d7b/dc0/l11d 0 2024-09-21T12:20:34.769 INFO:tasks.workunit.client.0.smithi003.stdout:6/264: dread d4/d9/fd [0,4194304] 0 2024-09-21T12:20:34.770 INFO:tasks.workunit.client.1.smithi192.stdout:2/828: truncate d1b/d38/d53/d8b/da0/fb9 1250227 0 2024-09-21T12:20:34.773 INFO:tasks.workunit.client.1.smithi192.stdout:7/821: dwrite d6/d20/d69/d90/da7/dc1/f109 [0,4194304] 0 2024-09-21T12:20:34.774 INFO:tasks.workunit.client.1.smithi192.stdout:6/983: link da/d1f/d48/d7d/daa/dd7/f10d da/d1f/d48/d7d/d9a/d9e/d10b/f143 0 2024-09-21T12:20:34.775 INFO:tasks.workunit.client.1.smithi192.stdout:6/984: readlink da/d1f/d56/lba 0 2024-09-21T12:20:34.777 INFO:tasks.workunit.client.0.smithi003.stdout:0/291: dwrite d9/d12/d1e/d2b/f1b [4194304,4194304] 0 2024-09-21T12:20:34.777 INFO:tasks.workunit.client.1.smithi192.stdout:8/902: mknod d14/d1a/d82/c12b 0 2024-09-21T12:20:34.778 INFO:tasks.workunit.client.0.smithi003.stdout:5/307: getdents dc/d15 0 2024-09-21T12:20:34.779 INFO:tasks.workunit.client.1.smithi192.stdout:1/861: link d2/d12/d2f/d41/d5c/f68 d2/d10d/f11c 0 2024-09-21T12:20:34.779 INFO:tasks.workunit.client.1.smithi192.stdout:1/862: readlink d2/ld0 0 2024-09-21T12:20:34.780 INFO:tasks.workunit.client.0.smithi003.stdout:5/308: chown dc/d15/d1c/c59 3 1 2024-09-21T12:20:34.781 INFO:tasks.workunit.client.0.smithi003.stdout:1/269: creat d4/d11/d14/f64 x:0 0 0 2024-09-21T12:20:34.785 INFO:tasks.workunit.client.0.smithi003.stdout:6/265: creat d4/d13/d19/f54 x:0 0 0 2024-09-21T12:20:34.788 INFO:tasks.workunit.client.0.smithi003.stdout:8/261: creat d7/de/d52/f59 x:0 0 0 2024-09-21T12:20:34.789 INFO:tasks.workunit.client.1.smithi192.stdout:6/985: creat da/d1f/de6/f144 x:0 0 0 2024-09-21T12:20:34.791 INFO:tasks.workunit.client.1.smithi192.stdout:4/813: getdents d2/d36/d55/d89/dc8/df7/d6c/db8 0 2024-09-21T12:20:34.793 INFO:tasks.workunit.client.1.smithi192.stdout:2/829: mkdir d1b/d1e/d10d 0 2024-09-21T12:20:34.794 INFO:tasks.workunit.client.0.smithi003.stdout:2/238: link d0/d21/d2c/c4f d0/dd/d16/c53 0 2024-09-21T12:20:34.794 INFO:tasks.workunit.client.0.smithi003.stdout:0/292: dread d9/d12/d17/f18 [0,4194304] 0 2024-09-21T12:20:34.795 INFO:tasks.workunit.client.1.smithi192.stdout:3/782: rename db/d16/d18/d40/c92 to db/d16/d18/d21/d23/d71/c11e 0 2024-09-21T12:20:34.796 INFO:tasks.workunit.client.0.smithi003.stdout:6/266: mknod d4/d13/d19/c55 0 2024-09-21T12:20:34.800 INFO:tasks.workunit.client.0.smithi003.stdout:5/309: symlink dc/l65 0 2024-09-21T12:20:34.802 INFO:tasks.workunit.client.1.smithi192.stdout:2/830: fdatasync d1b/d1e/d62/d99/fd3 0 2024-09-21T12:20:34.804 INFO:tasks.workunit.client.0.smithi003.stdout:1/270: mkdir d4/d11/d14/d25/d59/d65 0 2024-09-21T12:20:34.806 INFO:tasks.workunit.client.1.smithi192.stdout:3/783: rename db/d16/d18/f2f to db/d16/d18/d21/d23/d71/f11f 0 2024-09-21T12:20:34.808 INFO:tasks.workunit.client.1.smithi192.stdout:3/784: truncate db/d16/d18/d33/d4a/de4/f114 591191 0 2024-09-21T12:20:34.811 INFO:tasks.workunit.client.1.smithi192.stdout:7/822: dread f3 [0,4194304] 0 2024-09-21T12:20:34.813 INFO:tasks.workunit.client.0.smithi003.stdout:6/267: mkdir d4/d13/d56 0 2024-09-21T12:20:34.814 INFO:tasks.workunit.client.0.smithi003.stdout:8/262: dread d7/de/d1a/f3c [0,4194304] 0 2024-09-21T12:20:34.814 INFO:tasks.workunit.client.0.smithi003.stdout:6/268: chown d4/d11/d1d/l1e 2135 1 2024-09-21T12:20:34.816 INFO:tasks.workunit.client.0.smithi003.stdout:7/242: sync 2024-09-21T12:20:34.816 INFO:tasks.workunit.client.0.smithi003.stdout:3/223: sync 2024-09-21T12:20:34.816 INFO:tasks.workunit.client.0.smithi003.stdout:4/235: sync 2024-09-21T12:20:34.819 INFO:tasks.workunit.client.0.smithi003.stdout:2/239: rename d0/c27 to d0/d46/c54 0 2024-09-21T12:20:34.820 INFO:tasks.workunit.client.1.smithi192.stdout:6/986: link da/d1f/de6/l108 da/d23/d37/d75/l145 0 2024-09-21T12:20:34.820 INFO:tasks.workunit.client.0.smithi003.stdout:2/240: write d0/f25 [495345,20771] 0 2024-09-21T12:20:34.822 INFO:tasks.workunit.client.0.smithi003.stdout:0/293: mkdir d9/d12/d1e/d5f 0 2024-09-21T12:20:34.823 INFO:tasks.workunit.client.1.smithi192.stdout:7/823: mknod d6/d20/dcc/c122 0 2024-09-21T12:20:34.823 INFO:tasks.workunit.client.1.smithi192.stdout:8/903: write d14/d1a/d1d/d46/d4e/d83/d8d/fbb [4307866,27226] 0 2024-09-21T12:20:34.823 INFO:tasks.workunit.client.0.smithi003.stdout:5/310: getdents dc/d15/d21/d30/d4b/d5c 0 2024-09-21T12:20:34.826 INFO:tasks.workunit.client.0.smithi003.stdout:8/263: creat d7/df/d20/f5a x:0 0 0 2024-09-21T12:20:34.828 INFO:tasks.workunit.client.1.smithi192.stdout:7/824: dwrite d6/d9/d70/d77/f79 [0,4194304] 0 2024-09-21T12:20:34.829 INFO:tasks.workunit.client.0.smithi003.stdout:1/271: mkdir d4/d66 0 2024-09-21T12:20:34.830 INFO:tasks.workunit.client.1.smithi192.stdout:4/814: dwrite d2/d36/d7f/f4d [0,4194304] 0 2024-09-21T12:20:34.834 INFO:tasks.workunit.client.1.smithi192.stdout:8/904: mknod d14/d1a/d1d/d48/de1/c12c 0 2024-09-21T12:20:34.836 INFO:tasks.workunit.client.0.smithi003.stdout:4/236: creat d9/da/d47/f4c x:0 0 0 2024-09-21T12:20:34.838 INFO:tasks.workunit.client.1.smithi192.stdout:6/987: mknod da/d1f/d48/dfa/c146 0 2024-09-21T12:20:34.838 INFO:tasks.workunit.client.0.smithi003.stdout:1/272: dwrite d4/df/f5d [0,4194304] 0 2024-09-21T12:20:34.839 INFO:tasks.workunit.client.0.smithi003.stdout:1/273: write d4/f13 [4488902,66543] 0 2024-09-21T12:20:34.840 INFO:tasks.workunit.client.1.smithi192.stdout:7/825: rmdir d6/d9/d70/d77 39 2024-09-21T12:20:34.841 INFO:tasks.workunit.client.1.smithi192.stdout:3/785: write db/d16/d18/da7/d10e/d2e/db8/dd0/df0/ff2 [3983308,74307] 0 2024-09-21T12:20:34.842 INFO:tasks.workunit.client.0.smithi003.stdout:2/241: chown d0/dd/d16/f24 1063563988 1 2024-09-21T12:20:34.843 INFO:tasks.workunit.client.0.smithi003.stdout:2/242: readlink d0/d1c/l28 0 2024-09-21T12:20:34.844 INFO:tasks.workunit.client.1.smithi192.stdout:2/831: link d1b/d38/l6f d1b/d1e/d5e/d75/da1/de3/l10e 0 2024-09-21T12:20:34.845 INFO:tasks.workunit.client.0.smithi003.stdout:5/311: symlink dc/d15/d1c/l66 0 2024-09-21T12:20:34.846 INFO:tasks.workunit.client.0.smithi003.stdout:5/312: fsync dc/d15/d1c/f5f 0 2024-09-21T12:20:34.846 INFO:tasks.workunit.client.1.smithi192.stdout:4/815: mkdir d2/d36/d55/d89/dc8/df7/d6c/db8/d111 0 2024-09-21T12:20:34.846 INFO:tasks.workunit.client.0.smithi003.stdout:5/313: readlink dc/d15/l2f 0 2024-09-21T12:20:34.847 INFO:tasks.workunit.client.0.smithi003.stdout:8/264: unlink d7/l2d 0 2024-09-21T12:20:34.850 INFO:tasks.workunit.client.1.smithi192.stdout:8/905: creat d14/d18/daf/f12d x:0 0 0 2024-09-21T12:20:34.851 INFO:tasks.workunit.client.1.smithi192.stdout:6/988: fdatasync da/d1f/f4c 0 2024-09-21T12:20:34.853 INFO:tasks.workunit.client.0.smithi003.stdout:4/237: rmdir d9/d25 39 2024-09-21T12:20:34.854 INFO:tasks.workunit.client.1.smithi192.stdout:4/816: dwrite d2/db/d34/f86 [0,4194304] 0 2024-09-21T12:20:34.855 INFO:tasks.workunit.client.0.smithi003.stdout:5/314: dwrite dc/d15/d21/d30/f33 [0,4194304] 0 2024-09-21T12:20:34.856 INFO:tasks.workunit.client.0.smithi003.stdout:5/315: chown dc/d15/d21/d28 81818 1 2024-09-21T12:20:34.857 INFO:tasks.workunit.client.0.smithi003.stdout:1/274: creat d4/dc/f67 x:0 0 0 2024-09-21T12:20:34.859 INFO:tasks.workunit.client.1.smithi192.stdout:7/826: getdents d6/d9/d2d/d11b 0 2024-09-21T12:20:34.861 INFO:tasks.workunit.client.0.smithi003.stdout:2/243: mknod d0/d46/c55 0 2024-09-21T12:20:34.862 INFO:tasks.workunit.client.0.smithi003.stdout:1/275: chown d4/d11/d14/f61 2 1 2024-09-21T12:20:34.863 INFO:tasks.workunit.client.0.smithi003.stdout:6/269: rmdir d4/d13/d19/d3f 0 2024-09-21T12:20:34.863 INFO:tasks.workunit.client.0.smithi003.stdout:1/276: fsync d4/d11/f50 0 2024-09-21T12:20:34.866 INFO:tasks.workunit.client.0.smithi003.stdout:6/270: write d4/d13/d2e/d37/f31 [680721,48758] 0 2024-09-21T12:20:34.867 INFO:tasks.workunit.client.0.smithi003.stdout:1/277: dread - d4/d11/d14/d25/d42/f55 zero size 2024-09-21T12:20:34.867 INFO:tasks.workunit.client.1.smithi192.stdout:7/827: dwrite d6/d9/d51/f23 [0,4194304] 0 2024-09-21T12:20:34.869 INFO:tasks.workunit.client.1.smithi192.stdout:3/786: rename db/d16/l53 to db/d16/d18/d21/d23/d71/d77/d118/l120 0 2024-09-21T12:20:34.872 INFO:tasks.workunit.client.1.smithi192.stdout:9/947: sync 2024-09-21T12:20:34.872 INFO:tasks.workunit.client.1.smithi192.stdout:0/926: sync 2024-09-21T12:20:34.872 INFO:tasks.workunit.client.0.smithi003.stdout:1/278: write d4/df/d19/f4e [3176079,72727] 0 2024-09-21T12:20:34.872 INFO:tasks.workunit.client.1.smithi192.stdout:2/832: symlink d1b/d38/d53/d107/l10f 0 2024-09-21T12:20:34.873 INFO:tasks.workunit.client.0.smithi003.stdout:4/238: mknod d9/da/c4d 0 2024-09-21T12:20:34.877 INFO:tasks.workunit.client.0.smithi003.stdout:6/271: dwrite d4/d13/d19/f54 [0,4194304] 0 2024-09-21T12:20:34.879 INFO:tasks.workunit.client.0.smithi003.stdout:6/272: dread - d4/d13/d19/d23/f3c zero size 2024-09-21T12:20:34.897 INFO:tasks.workunit.client.0.smithi003.stdout:5/316: dread dc/d2b/f44 [0,4194304] 0 2024-09-21T12:20:34.898 INFO:tasks.workunit.client.1.smithi192.stdout:1/863: sync 2024-09-21T12:20:34.898 INFO:tasks.workunit.client.1.smithi192.stdout:1/864: fdatasync d2/d12/d2f/d51/f37 0 2024-09-21T12:20:34.899 INFO:tasks.workunit.client.1.smithi192.stdout:1/865: readlink d2/de/la6 0 2024-09-21T12:20:34.928 INFO:tasks.workunit.client.1.smithi192.stdout:6/989: truncate da/d1f/d27/d3e/f67 184937 0 2024-09-21T12:20:34.945 INFO:tasks.workunit.client.0.smithi003.stdout:7/243: getdents d8/db/d32 0 2024-09-21T12:20:34.945 INFO:tasks.workunit.client.0.smithi003.stdout:7/244: stat d8/db/f20 0 2024-09-21T12:20:34.950 INFO:tasks.workunit.client.0.smithi003.stdout:3/224: getdents d0/d5/da/d28/d31 0 2024-09-21T12:20:34.952 INFO:tasks.workunit.client.0.smithi003.stdout:1/279: fsync d4/f39 0 2024-09-21T12:20:34.952 INFO:tasks.workunit.client.0.smithi003.stdout:7/245: dwrite d8/d2c/f37 [0,4194304] 0 2024-09-21T12:20:34.954 INFO:tasks.workunit.client.0.smithi003.stdout:7/246: dread - d8/db/f2b zero size 2024-09-21T12:20:34.954 INFO:tasks.workunit.client.1.smithi192.stdout:0/927: stat d3/d5/l3a 0 2024-09-21T12:20:34.956 INFO:tasks.workunit.client.1.smithi192.stdout:3/787: dwrite db/d16/db4/d8c/fd4 [0,4194304] 0 2024-09-21T12:20:34.962 INFO:tasks.workunit.client.0.smithi003.stdout:6/273: creat d4/d11/f57 x:0 0 0 2024-09-21T12:20:34.964 INFO:tasks.workunit.client.0.smithi003.stdout:1/280: dwrite d4/f7 [0,4194304] 0 2024-09-21T12:20:34.967 INFO:tasks.workunit.client.0.smithi003.stdout:1/281: truncate d4/d11/d14/d25/d42/f5f 160536 0 2024-09-21T12:20:34.969 INFO:tasks.workunit.client.0.smithi003.stdout:5/317: mknod dc/d15/d21/d30/c67 0 2024-09-21T12:20:34.970 INFO:tasks.workunit.client.0.smithi003.stdout:6/274: dread d4/d13/d2e/d37/f31 [0,4194304] 0 2024-09-21T12:20:34.970 INFO:tasks.workunit.client.0.smithi003.stdout:5/318: readlink dc/d15/l1b 0 2024-09-21T12:20:34.971 INFO:tasks.workunit.client.1.smithi192.stdout:7/828: dread d6/d9/f5f [0,4194304] 0 2024-09-21T12:20:34.973 INFO:tasks.workunit.client.1.smithi192.stdout:7/829: write d6/d9/d1f/d3e/d7a/d8a/da2/fe8 [1623501,123555] 0 2024-09-21T12:20:34.973 INFO:tasks.workunit.client.1.smithi192.stdout:1/866: mknod d2/d12/d2f/d51/c11d 0 2024-09-21T12:20:34.974 INFO:tasks.workunit.client.1.smithi192.stdout:7/830: fsync d6/d9/f5d 0 2024-09-21T12:20:34.977 INFO:tasks.workunit.client.0.smithi003.stdout:3/225: mknod d0/d5/da/d28/c3c 0 2024-09-21T12:20:34.982 INFO:tasks.workunit.client.1.smithi192.stdout:3/788: truncate db/d16/dc1/ff9 581987 0 2024-09-21T12:20:34.983 INFO:tasks.workunit.client.1.smithi192.stdout:3/789: readlink db/d16/d18/d33/d3b/lb6 0 2024-09-21T12:20:34.985 INFO:tasks.workunit.client.1.smithi192.stdout:3/790: dread - db/d16/d18/da7/d10e/d2e/db8/dd0/df0/f106 zero size 2024-09-21T12:20:34.986 INFO:tasks.workunit.client.1.smithi192.stdout:8/906: getdents d14/d1a/d1d/d20 0 2024-09-21T12:20:34.987 INFO:tasks.workunit.client.1.smithi192.stdout:8/907: readlink d14/d1a/d1d/d39/d115/l109 0 2024-09-21T12:20:34.989 INFO:tasks.workunit.client.1.smithi192.stdout:8/908: write d14/d1a/d1d/d46/d4e/f65 [7648404,33214] 0 2024-09-21T12:20:34.989 INFO:tasks.workunit.client.1.smithi192.stdout:8/909: chown d14/d1a/d1d/d39/c40 22105 1 2024-09-21T12:20:34.990 INFO:tasks.workunit.client.0.smithi003.stdout:7/247: rename d8/db/d13/l1f to d8/db/d32/d43/l5b 0 2024-09-21T12:20:34.991 INFO:tasks.workunit.client.1.smithi192.stdout:4/817: rename d2/db/d1a/le5 to d2/d36/d55/d89/dc8/df7/d6c/db8/d99/l112 0 2024-09-21T12:20:34.993 INFO:tasks.workunit.client.1.smithi192.stdout:1/867: fsync d2/d12/d2f/d41/d5c/fc9 0 2024-09-21T12:20:34.997 INFO:tasks.workunit.client.1.smithi192.stdout:7/831: dread d6/d9/d70/d77/f79 [0,4194304] 0 2024-09-21T12:20:34.998 INFO:tasks.workunit.client.1.smithi192.stdout:0/928: mkdir d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/d11d 0 2024-09-21T12:20:35.000 INFO:tasks.workunit.client.0.smithi003.stdout:3/226: mkdir d0/d5/da/d28/dd/d23/d26/d3d 0 2024-09-21T12:20:35.003 INFO:tasks.workunit.client.1.smithi192.stdout:6/990: dwrite da/d1f/d27/d6b/f9c [0,4194304] 0 2024-09-21T12:20:35.005 INFO:tasks.workunit.client.1.smithi192.stdout:3/791: mkdir db/d16/d18/d21/dde/d121 0 2024-09-21T12:20:35.007 INFO:tasks.workunit.client.1.smithi192.stdout:8/910: mkdir d14/d1a/de9/d12e 0 2024-09-21T12:20:35.008 INFO:tasks.workunit.client.1.smithi192.stdout:4/818: truncate d2/db/d1a/dee/f5b 430030 0 2024-09-21T12:20:35.009 INFO:tasks.workunit.client.1.smithi192.stdout:2/833: dwrite d1b/d38/f49 [4194304,4194304] 0 2024-09-21T12:20:35.013 INFO:tasks.workunit.client.1.smithi192.stdout:0/929: creat d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/dc6/d83/dc9/f11e x:0 0 0 2024-09-21T12:20:35.013 INFO:tasks.workunit.client.1.smithi192.stdout:9/948: getdents d5/d8/d2c 0 2024-09-21T12:20:35.014 INFO:tasks.workunit.client.1.smithi192.stdout:6/991: creat da/d1f/d56/da9/f147 x:0 0 0 2024-09-21T12:20:35.016 INFO:tasks.workunit.client.1.smithi192.stdout:6/992: chown da/d23/d37/dc5/cfd 434 1 2024-09-21T12:20:35.016 INFO:tasks.workunit.client.1.smithi192.stdout:8/911: unlink d14/d1a/d1d/f58 0 2024-09-21T12:20:35.022 INFO:tasks.workunit.client.1.smithi192.stdout:7/832: dread d6/d9/f5b [0,4194304] 0 2024-09-21T12:20:35.025 INFO:tasks.workunit.client.1.smithi192.stdout:0/930: dread d3/d5/d28/d39/d50/fc1 [0,4194304] 0 2024-09-21T12:20:35.025 INFO:tasks.workunit.client.1.smithi192.stdout:9/949: mknod d5/d19/dd5/d4d/dde/c12c 0 2024-09-21T12:20:35.033 INFO:tasks.workunit.client.1.smithi192.stdout:3/792: creat db/d16/d18/da7/d10e/d2e/f122 x:0 0 0 2024-09-21T12:20:35.034 INFO:tasks.workunit.client.1.smithi192.stdout:9/950: mkdir d5/d19/dd5/d4d/d6d/dd9/d12d 0 2024-09-21T12:20:35.035 INFO:tasks.workunit.client.1.smithi192.stdout:6/993: truncate da/d1f/d48/d7d/daa/dd7/f10d 2037742 0 2024-09-21T12:20:35.036 INFO:tasks.workunit.client.1.smithi192.stdout:9/951: truncate d5/d19/dd5/d4d/fcf 3352061 0 2024-09-21T12:20:35.038 INFO:tasks.workunit.client.1.smithi192.stdout:8/912: dread d14/d1a/d1d/d46/d4e/db5/f120 [0,4194304] 0 2024-09-21T12:20:35.038 INFO:tasks.workunit.client.1.smithi192.stdout:0/931: mkdir d3/d5/de0/d119/d11f 0 2024-09-21T12:20:35.040 INFO:tasks.workunit.client.1.smithi192.stdout:4/819: write d2/db/d1a/dee/f70 [2207513,16523] 0 2024-09-21T12:20:35.044 INFO:tasks.workunit.client.1.smithi192.stdout:3/793: mknod db/d16/d18/d21/c123 0 2024-09-21T12:20:35.044 INFO:tasks.workunit.client.1.smithi192.stdout:9/952: creat d5/d19/d32/dc0/d11c/f12e x:0 0 0 2024-09-21T12:20:35.044 INFO:tasks.workunit.client.1.smithi192.stdout:8/913: rmdir d14/d18/d7b 39 2024-09-21T12:20:35.047 INFO:tasks.workunit.client.1.smithi192.stdout:9/953: readlink d5/dc/d64/dbb/d3d/l7b 0 2024-09-21T12:20:35.047 INFO:tasks.workunit.client.1.smithi192.stdout:0/932: creat d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/d33/f120 x:0 0 0 2024-09-21T12:20:35.047 INFO:tasks.workunit.client.1.smithi192.stdout:7/833: link d6/d3a/f61 d6/d9/d1f/d3e/f123 0 2024-09-21T12:20:35.048 INFO:tasks.workunit.client.1.smithi192.stdout:8/914: fsync d14/d1a/d1d/d46/d4e/d83/d8d/f11e 0 2024-09-21T12:20:35.050 INFO:tasks.workunit.client.1.smithi192.stdout:4/820: unlink d2/d36/d7f/df5/d4f/d71/d9d/dad/d9c/d9e/fc7 0 2024-09-21T12:20:35.050 INFO:tasks.workunit.client.1.smithi192.stdout:9/954: chown d5/dc/d80/lb6 91629 1 2024-09-21T12:20:35.050 INFO:tasks.workunit.client.1.smithi192.stdout:2/834: dwrite d1b/f27 [0,4194304] 0 2024-09-21T12:20:35.052 INFO:tasks.workunit.client.1.smithi192.stdout:9/955: chown d5/d8/dc7/dd7/de7/d55/c110 116930101 1 2024-09-21T12:20:35.053 INFO:tasks.workunit.client.1.smithi192.stdout:3/794: stat db/d16/d18/d21/d23/d71/d77/d118/l120 0 2024-09-21T12:20:35.056 INFO:tasks.workunit.client.1.smithi192.stdout:0/933: creat d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/dc6/d83/f121 x:0 0 0 2024-09-21T12:20:35.057 INFO:tasks.workunit.client.1.smithi192.stdout:0/934: chown d3/d5/d28/d39/d50/dd9/d7a/dbe/d92/d51/lc3 16436737 1 2024-09-21T12:20:35.057 INFO:tasks.workunit.client.1.smithi192.stdout:4/821: creat d2/d36/d55/d89/da6/f113 x:0 0 0 2024-09-21T12:20:35.058 INFO:tasks.workunit.client.1.smithi192.stdout:4/822: read - d2/d36/d7f/fd8 zero size 2024-09-21T12:20:35.059 INFO:tasks.workunit.client.1.smithi192.stdout:6/994: truncate da/f4b 3820947 0 2024-09-21T12:20:35.064 INFO:tasks.workunit.client.1.smithi192.stdout:2/835: truncate d1b/d1e/f5f 236811 0 2024-09-21T12:20:35.065 INFO:tasks.workunit.client.1.smithi192.stdout:8/915: rename d14/d1a/d1d/d39/c75 to d14/c12f 0 2024-09-21T12:20:35.070 INFO:tasks.workunit.client.1.smithi192.stdout:9/956: getdents d5/d8/dc7/dd7/de7/d55/df3 0 2024-09-21T12:20:35.071 INFO:tasks.workunit.client.1.smithi192.stdout:0/935: dwrite d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/dc6/d83/f85 [0,4194304] 0 2024-09-21T12:20:35.071 INFO:tasks.workunit.client.1.smithi192.stdout:6/995: dwrite da/d1f/de6/f144 [0,4194304] 0 2024-09-21T12:20:35.071 INFO:tasks.workunit.client.1.smithi192.stdout:8/916: stat d14/d1a/d1d/d46/d4e/d83/d8d/d9c/dd6 0 2024-09-21T12:20:35.074 INFO:tasks.workunit.client.1.smithi192.stdout:9/957: truncate d5/dc/f76 5785100 0 2024-09-21T12:20:35.074 INFO:tasks.workunit.client.1.smithi192.stdout:6/996: dread - da/d23/d37/d75/de2/f140 zero size 2024-09-21T12:20:35.076 INFO:tasks.workunit.client.1.smithi192.stdout:9/958: chown d5/dc/d80/d44/d8e 36 1 2024-09-21T12:20:35.078 INFO:tasks.workunit.client.1.smithi192.stdout:2/836: rename d1b/d1e/d5e/d75/f84 to d1b/d1e/d5e/d88/d95/dbe/f110 0 2024-09-21T12:20:35.083 INFO:tasks.workunit.client.1.smithi192.stdout:9/959: symlink d5/dc/d64/dbb/df1/l12f 0 2024-09-21T12:20:35.087 INFO:tasks.workunit.client.1.smithi192.stdout:2/837: mkdir d1b/d1e/d5e/d88/d95/dbe/d111 0 2024-09-21T12:20:35.087 INFO:tasks.workunit.client.1.smithi192.stdout:4/823: dread d2/f5 [0,4194304] 0 2024-09-21T12:20:35.087 INFO:tasks.workunit.client.1.smithi192.stdout:6/997: mknod da/dfc/c148 0 2024-09-21T12:20:35.087 INFO:tasks.workunit.client.1.smithi192.stdout:3/795: dwrite db/d16/d18/f3e [4194304,4194304] 0 2024-09-21T12:20:35.089 INFO:tasks.workunit.client.1.smithi192.stdout:8/917: write d14/d1a/d1d/d46/d4e/d83/d8d/d9c/dd0/d8e/fce [612716,97413] 0 2024-09-21T12:20:35.092 INFO:tasks.workunit.client.0.smithi003.stdout:5/319: rename dc/d15/d21/c61 to dc/d15/d26/c68 0 2024-09-21T12:20:35.092 INFO:tasks.workunit.client.1.smithi192.stdout:3/796: chown db/d16/d18/d21/c6d 31 1 2024-09-21T12:20:35.093 INFO:tasks.workunit.client.0.smithi003.stdout:7/248: symlink d8/d31/l5c 0 2024-09-21T12:20:35.093 INFO:tasks.workunit.client.0.smithi003.stdout:4/239: creat d9/da/d47/f4e x:0 0 0 2024-09-21T12:20:35.093 INFO:tasks.workunit.client.0.smithi003.stdout:2/244: link d0/d21/f4e d0/dd/f56 0 2024-09-21T12:20:35.096 INFO:tasks.workunit.client.0.smithi003.stdout:3/227: creat d0/d5/da/d28/d11/f3e x:0 0 0 2024-09-21T12:20:35.096 INFO:tasks.workunit.client.0.smithi003.stdout:2/245: read d0/f25 [315749,7039] 0 2024-09-21T12:20:35.097 INFO:tasks.workunit.client.1.smithi192.stdout:3/797: rmdir db/d16/dc1/def 39 2024-09-21T12:20:35.097 INFO:tasks.workunit.client.1.smithi192.stdout:0/936: dread d3/d5/d28/f64 [0,4194304] 0 2024-09-21T12:20:35.097 INFO:tasks.workunit.client.0.smithi003.stdout:5/320: mknod dc/d15/d21/d30/c69 0 2024-09-21T12:20:35.098 INFO:tasks.workunit.client.0.smithi003.stdout:3/228: fdatasync d0/d5/f1e 0 2024-09-21T12:20:35.099 INFO:tasks.workunit.client.0.smithi003.stdout:7/249: creat d8/db/d32/f5d x:0 0 0 2024-09-21T12:20:35.100 INFO:tasks.workunit.client.0.smithi003.stdout:3/229: dread - d0/f27 zero size 2024-09-21T12:20:35.101 INFO:tasks.workunit.client.0.smithi003.stdout:7/250: fsync d8/db/d13/f3a 0 2024-09-21T12:20:35.104 INFO:tasks.workunit.client.0.smithi003.stdout:6/275: dread d4/d13/d2e/d37/f2d [0,4194304] 0 2024-09-21T12:20:35.104 INFO:tasks.workunit.client.0.smithi003.stdout:5/321: dread dc/d2b/f44 [0,4194304] 0 2024-09-21T12:20:35.104 INFO:tasks.workunit.client.1.smithi192.stdout:3/798: dwrite db/d16/d18/d33/d4a/de4/f114 [0,4194304] 0 2024-09-21T12:20:35.105 INFO:tasks.workunit.client.0.smithi003.stdout:5/322: dread - dc/d2b/d4e/f53 zero size 2024-09-21T12:20:35.105 INFO:tasks.workunit.client.0.smithi003.stdout:4/240: dread d9/da/fd [0,4194304] 0 2024-09-21T12:20:35.106 INFO:tasks.workunit.client.1.smithi192.stdout:2/838: fdatasync d1b/d1e/f69 0 2024-09-21T12:20:35.106 INFO:tasks.workunit.client.0.smithi003.stdout:4/241: stat d9/f23 0 2024-09-21T12:20:35.107 INFO:tasks.workunit.client.1.smithi192.stdout:3/799: write db/d16/d18/da7/d10e/d2e/f100 [60723,57055] 0 2024-09-21T12:20:35.107 INFO:tasks.workunit.client.0.smithi003.stdout:2/246: unlink d0/dd/d16/l20 0 2024-09-21T12:20:35.109 INFO:tasks.workunit.client.0.smithi003.stdout:2/247: truncate d0/d1c/f42 181135 0 2024-09-21T12:20:35.110 INFO:tasks.workunit.client.0.smithi003.stdout:3/230: unlink d0/d5/da/d28/d11/f20 0 2024-09-21T12:20:35.112 INFO:tasks.workunit.client.0.smithi003.stdout:7/251: truncate d8/db/d13/f1a 159186 0 2024-09-21T12:20:35.113 INFO:tasks.workunit.client.0.smithi003.stdout:7/252: chown d8/db/ff 218 1 2024-09-21T12:20:35.115 INFO:tasks.workunit.client.0.smithi003.stdout:7/253: write d8/db/f2b [263204,110053] 0 2024-09-21T12:20:35.119 INFO:tasks.workunit.client.0.smithi003.stdout:3/231: dwrite d0/d5/f1e [0,4194304] 0 2024-09-21T12:20:35.119 INFO:tasks.workunit.client.0.smithi003.stdout:5/323: creat dc/d15/d21/d28/f6a x:0 0 0 2024-09-21T12:20:35.120 INFO:tasks.workunit.client.1.smithi192.stdout:6/998: symlink da/d1f/d48/d7d/daa/d11c/l149 0 2024-09-21T12:20:35.121 INFO:tasks.workunit.client.0.smithi003.stdout:5/324: fsync dc/f1a 0 2024-09-21T12:20:35.121 INFO:tasks.workunit.client.1.smithi192.stdout:9/960: dread d5/d8/dc7/dd7/de7/d55/d93/f96 [0,4194304] 0 2024-09-21T12:20:35.122 INFO:tasks.workunit.client.0.smithi003.stdout:2/248: creat d0/dd/d22/f57 x:0 0 0 2024-09-21T12:20:35.122 INFO:tasks.workunit.client.0.smithi003.stdout:3/232: chown d0/d5/da/d28/d11/f1d 130 1 2024-09-21T12:20:35.122 INFO:tasks.workunit.client.1.smithi192.stdout:6/999: truncate da/d1f/d56/d78/f13c 710373 0 2024-09-21T12:20:35.125 INFO:tasks.workunit.client.0.smithi003.stdout:3/233: write d0/d5/da/d28/d31/f3b [953092,122117] 0 2024-09-21T12:20:35.125 INFO:tasks.workunit.client.0.smithi003.stdout:7/254: creat d8/db/f5e x:0 0 0 2024-09-21T12:20:35.129 INFO:tasks.workunit.client.1.smithi192.stdout:2/839: mkdir d1b/d1e/d7b/dfb/d112 0 2024-09-21T12:20:35.131 INFO:tasks.workunit.client.1.smithi192.stdout:2/840: write d1b/f27 [57101,68383] 0 2024-09-21T12:20:35.132 INFO:tasks.workunit.client.0.smithi003.stdout:2/249: rename d0/d21/d2f/f38 to d0/d21/d2c/f58 0 2024-09-21T12:20:35.133 INFO:tasks.workunit.client.1.smithi192.stdout:1/868: sync 2024-09-21T12:20:35.133 INFO:tasks.workunit.client.1.smithi192.stdout:9/961: mkdir d5/dc/d80/d5a/dfa/d101/d127/d130 0 2024-09-21T12:20:35.137 INFO:tasks.workunit.client.0.smithi003.stdout:7/255: chown d8/d3c/f3e 1089 1 2024-09-21T12:20:35.139 INFO:tasks.workunit.client.0.smithi003.stdout:6/276: getdents d4/d9 0 2024-09-21T12:20:35.139 INFO:tasks.workunit.client.1.smithi192.stdout:8/918: link d14/d1a/d1d/d46/d4e/d83/d8d/dd8/ff9 d14/d1a/d82/d10e/f130 0 2024-09-21T12:20:35.141 INFO:tasks.workunit.client.1.smithi192.stdout:3/800: mkdir db/d16/dc1/d124 0 2024-09-21T12:20:35.143 INFO:tasks.workunit.client.1.smithi192.stdout:4/824: rename d2/d36/d55/d89/dc8/df7/d6c/db8/c53 to d2/d36/d55/d89/dc8/df7/d6c/db8/d88/dd0/c114 0 2024-09-21T12:20:35.146 INFO:tasks.workunit.client.0.smithi003.stdout:2/250: unlink d0/dd/d16/f24 0 2024-09-21T12:20:35.147 INFO:tasks.workunit.client.0.smithi003.stdout:2/251: write d0/dd/f12 [2569309,19802] 0 2024-09-21T12:20:35.148 INFO:tasks.workunit.client.0.smithi003.stdout:3/234: dread d0/d5/da/d28/dd/f2e [0,4194304] 0 2024-09-21T12:20:35.148 INFO:tasks.workunit.client.1.smithi192.stdout:2/841: write d1b/d1e/f69 [846246,30993] 0 2024-09-21T12:20:35.149 INFO:tasks.workunit.client.0.smithi003.stdout:7/256: creat d8/d31/f5f x:0 0 0 2024-09-21T12:20:35.150 INFO:tasks.workunit.client.0.smithi003.stdout:6/277: mkdir d4/d13/d2e/d37/d58 0 2024-09-21T12:20:35.151 INFO:tasks.workunit.client.0.smithi003.stdout:2/252: dread d0/dd/d22/f23 [0,4194304] 0 2024-09-21T12:20:35.151 INFO:tasks.workunit.client.1.smithi192.stdout:1/869: creat d2/d12/d2f/d41/d5c/d99/f11e x:0 0 0 2024-09-21T12:20:35.157 INFO:tasks.workunit.client.0.smithi003.stdout:6/278: dwrite d4/d13/d19/f49 [0,4194304] 0 2024-09-21T12:20:35.157 INFO:tasks.workunit.client.1.smithi192.stdout:4/825: rename d2/d36/d7f/df5/d4f/d71/d9d/dad/d9c/d9e/l104 to d2/d36/d55/d89/dc8/df7/d83/d101/l115 0 2024-09-21T12:20:35.162 INFO:tasks.workunit.client.0.smithi003.stdout:7/257: mkdir d8/db/d13/d60 0 2024-09-21T12:20:35.164 INFO:tasks.workunit.client.1.smithi192.stdout:1/870: rmdir d2/d12/d2f/d81 39 2024-09-21T12:20:35.169 INFO:tasks.workunit.client.1.smithi192.stdout:3/801: dread db/d16/d18/d33/fbc [0,4194304] 0 2024-09-21T12:20:35.169 INFO:tasks.workunit.client.0.smithi003.stdout:7/258: dwrite d8/db/f20 [0,4194304] 0 2024-09-21T12:20:35.169 INFO:tasks.workunit.client.0.smithi003.stdout:5/325: link dc/c13 dc/d15/d1c/c6b 0 2024-09-21T12:20:35.170 INFO:tasks.workunit.client.1.smithi192.stdout:4/826: read d2/df/f5d [2848839,94509] 0 2024-09-21T12:20:35.171 INFO:tasks.workunit.client.1.smithi192.stdout:2/842: symlink d1b/d1e/d5e/l113 0 2024-09-21T12:20:35.173 INFO:tasks.workunit.client.1.smithi192.stdout:9/962: creat d5/d19/dd5/d4d/f131 x:0 0 0 2024-09-21T12:20:35.173 INFO:tasks.workunit.client.0.smithi003.stdout:6/279: mkdir d4/d9/d59 0 2024-09-21T12:20:35.175 INFO:tasks.workunit.client.0.smithi003.stdout:2/253: mknod d0/c59 0 2024-09-21T12:20:35.176 INFO:tasks.workunit.client.0.smithi003.stdout:6/280: chown d4/d11/d32/l3d 1 1 2024-09-21T12:20:35.176 INFO:tasks.workunit.client.0.smithi003.stdout:2/254: stat d0/dd/d16/l40 0 2024-09-21T12:20:35.177 INFO:tasks.workunit.client.1.smithi192.stdout:9/963: chown d5/d8/d2c 8267 1 2024-09-21T12:20:35.177 INFO:tasks.workunit.client.1.smithi192.stdout:3/802: dread db/d16/d18/d33/fbc [0,4194304] 0 2024-09-21T12:20:35.177 INFO:tasks.workunit.client.0.smithi003.stdout:6/281: chown d4/d9/f15 37704 1 2024-09-21T12:20:35.178 INFO:tasks.workunit.client.1.smithi192.stdout:2/843: creat d1b/d1e/d62/f114 x:0 0 0 2024-09-21T12:20:35.178 INFO:tasks.workunit.client.0.smithi003.stdout:7/259: dwrite d8/db/d13/f30 [0,4194304] 0 2024-09-21T12:20:35.184 INFO:tasks.workunit.client.0.smithi003.stdout:7/260: chown d8/l12 30149 1 2024-09-21T12:20:35.187 INFO:tasks.workunit.client.1.smithi192.stdout:9/964: creat d5/dc/d40/dad/d53/df4/f132 x:0 0 0 2024-09-21T12:20:35.188 INFO:tasks.workunit.client.0.smithi003.stdout:3/235: link d0/d5/da/d28/d11/f1d d0/d5/da/f3f 0 2024-09-21T12:20:35.189 INFO:tasks.workunit.client.0.smithi003.stdout:3/236: dread - d0/d5/da/d28/d11/f34 zero size 2024-09-21T12:20:35.189 INFO:tasks.workunit.client.0.smithi003.stdout:5/326: symlink dc/d15/d21/d28/d3c/l6c 0 2024-09-21T12:20:35.190 INFO:tasks.workunit.client.1.smithi192.stdout:2/844: mknod d1b/d1e/d5e/d88/d95/dbe/d111/c115 0 2024-09-21T12:20:35.192 INFO:tasks.workunit.client.0.smithi003.stdout:6/282: mknod d4/d13/d2e/d37/d58/c5a 0 2024-09-21T12:20:35.192 INFO:tasks.workunit.client.1.smithi192.stdout:2/845: write d1b/d1e/d5e/d88/d95/dbe/fc5 [1090892,78523] 0 2024-09-21T12:20:35.193 INFO:tasks.workunit.client.0.smithi003.stdout:6/283: chown d4/d11/d1d/f43 2028 1 2024-09-21T12:20:35.194 INFO:tasks.workunit.client.0.smithi003.stdout:5/327: stat dc/c14 0 2024-09-21T12:20:35.195 INFO:tasks.workunit.client.1.smithi192.stdout:9/965: mkdir d5/d8/dc7/dd7/de7/d133 0 2024-09-21T12:20:35.196 INFO:tasks.workunit.client.0.smithi003.stdout:2/255: creat d0/dd/f5a x:0 0 0 2024-09-21T12:20:35.197 INFO:tasks.workunit.client.0.smithi003.stdout:7/261: link d8/d2c/f2e d8/d3c/f61 0 2024-09-21T12:20:35.199 INFO:tasks.workunit.client.0.smithi003.stdout:3/237: mknod d0/d5/c40 0 2024-09-21T12:20:35.200 INFO:tasks.workunit.client.1.smithi192.stdout:4/827: getdents d2/d36/d55/d89/dc8/df7/d6c/db8/d99 0 2024-09-21T12:20:35.200 INFO:tasks.workunit.client.0.smithi003.stdout:6/284: mkdir d4/d13/d5b 0 2024-09-21T12:20:35.201 INFO:tasks.workunit.client.0.smithi003.stdout:6/285: fdatasync d4/d13/d19/f54 0 2024-09-21T12:20:35.201 INFO:tasks.workunit.client.1.smithi192.stdout:9/966: symlink d5/dc/d80/d5a/dfa/d101/d127/l134 0 2024-09-21T12:20:35.202 INFO:tasks.workunit.client.0.smithi003.stdout:5/328: symlink dc/d15/d21/d28/d3c/l6d 0 2024-09-21T12:20:35.202 INFO:tasks.workunit.client.1.smithi192.stdout:9/967: readlink d5/d19/dd5/d4d/d6d/dd9/lca 0 2024-09-21T12:20:35.203 INFO:tasks.workunit.client.0.smithi003.stdout:5/329: chown dc/d15/d21/f5d 23709571 1 2024-09-21T12:20:35.205 INFO:tasks.workunit.client.1.smithi192.stdout:4/828: creat d2/d36/d55/d89/dc8/f116 x:0 0 0 2024-09-21T12:20:35.206 INFO:tasks.workunit.client.0.smithi003.stdout:7/262: rename l7 to d8/d31/l62 0 2024-09-21T12:20:35.208 INFO:tasks.workunit.client.1.smithi192.stdout:9/968: symlink d5/d8/dc7/dd7/de7/d55/d70/da0/da2/l135 0 2024-09-21T12:20:35.209 INFO:tasks.workunit.client.1.smithi192.stdout:2/846: dread d1b/d1e/d5e/d88/d95/d9c/fce [0,4194304] 0 2024-09-21T12:20:35.210 INFO:tasks.workunit.client.0.smithi003.stdout:6/286: creat d4/d13/d2e/d37/d58/f5c x:0 0 0 2024-09-21T12:20:35.211 INFO:tasks.workunit.client.0.smithi003.stdout:2/256: symlink d0/dd/l5b 0 2024-09-21T12:20:35.212 INFO:tasks.workunit.client.1.smithi192.stdout:3/803: truncate db/d16/d18/da7/ff6 1865522 0 2024-09-21T12:20:35.213 INFO:tasks.workunit.client.1.smithi192.stdout:9/969: creat d5/dc/dc2/dd1/f136 x:0 0 0 2024-09-21T12:20:35.213 INFO:tasks.workunit.client.0.smithi003.stdout:5/330: mknod dc/d15/d21/d30/d35/c6e 0 2024-09-21T12:20:35.217 INFO:tasks.workunit.client.0.smithi003.stdout:3/238: rename d0/d5/da/d28/d11/f3e to d0/d5/da/d28/dd/f41 0 2024-09-21T12:20:35.221 INFO:tasks.workunit.client.0.smithi003.stdout:5/331: dwrite dc/f40 [0,4194304] 0 2024-09-21T12:20:35.223 INFO:tasks.workunit.client.0.smithi003.stdout:6/287: creat d4/d11/d17/f5d x:0 0 0 2024-09-21T12:20:35.224 INFO:tasks.workunit.client.0.smithi003.stdout:6/288: write d4/f4a [1007683,30989] 0 2024-09-21T12:20:35.224 INFO:tasks.workunit.client.0.smithi003.stdout:2/257: creat d0/dd/d22/d37/f5c x:0 0 0 2024-09-21T12:20:35.228 INFO:tasks.workunit.client.1.smithi192.stdout:3/804: mkdir db/d16/dc1/def/d125 0 2024-09-21T12:20:35.230 INFO:tasks.workunit.client.0.smithi003.stdout:2/258: dread d0/dd/d16/f2a [0,4194304] 0 2024-09-21T12:20:35.230 INFO:tasks.workunit.client.0.smithi003.stdout:6/289: dread d4/fc [4194304,4194304] 0 2024-09-21T12:20:35.234 INFO:tasks.workunit.client.1.smithi192.stdout:2/847: creat d1b/d1e/f116 x:0 0 0 2024-09-21T12:20:35.236 INFO:tasks.workunit.client.1.smithi192.stdout:3/805: mknod db/d16/d18/d21/dde/c126 0 2024-09-21T12:20:35.237 INFO:tasks.workunit.client.1.smithi192.stdout:3/806: write db/d16/d18/da7/d10e/d2e/f45 [13063922,122933] 0 2024-09-21T12:20:35.239 INFO:tasks.workunit.client.1.smithi192.stdout:9/970: creat d5/d19/f137 x:0 0 0 2024-09-21T12:20:35.241 INFO:tasks.workunit.client.0.smithi003.stdout:5/332: unlink dc/d2b/l49 0 2024-09-21T12:20:35.241 INFO:tasks.workunit.client.0.smithi003.stdout:5/333: chown dc/d15/d21 33 1 2024-09-21T12:20:35.242 INFO:tasks.workunit.client.1.smithi192.stdout:2/848: chown d1b/l37 1107107165 1 2024-09-21T12:20:35.242 INFO:tasks.workunit.client.1.smithi192.stdout:4/829: truncate d2/db/f6d 1765757 0 2024-09-21T12:20:35.243 INFO:tasks.workunit.client.0.smithi003.stdout:0/294: sync 2024-09-21T12:20:35.243 INFO:tasks.workunit.client.0.smithi003.stdout:8/265: sync 2024-09-21T12:20:35.243 INFO:tasks.workunit.client.0.smithi003.stdout:9/386: sync 2024-09-21T12:20:35.243 INFO:tasks.workunit.client.1.smithi192.stdout:2/849: chown d1b/d1e/d5e/d88/d95/dbe/dd0/f103 5 1 2024-09-21T12:20:35.246 INFO:tasks.workunit.client.0.smithi003.stdout:8/266: dread - d7/df/d20/d21/f3f zero size 2024-09-21T12:20:35.248 INFO:tasks.workunit.client.1.smithi192.stdout:3/807: truncate db/d16/db4/fa2 580947 0 2024-09-21T12:20:35.249 INFO:tasks.workunit.client.0.smithi003.stdout:5/334: dwrite dc/d15/d21/f64 [0,4194304] 0 2024-09-21T12:20:35.249 INFO:tasks.workunit.client.0.smithi003.stdout:2/259: rename d0/d21/d2f/d49/l4d to d0/dd/d22/l5d 0 2024-09-21T12:20:35.250 INFO:tasks.workunit.client.0.smithi003.stdout:5/335: chown dc/d15 0 1 2024-09-21T12:20:35.251 INFO:tasks.workunit.client.0.smithi003.stdout:5/336: chown dc/f1a 2005353 1 2024-09-21T12:20:35.251 INFO:tasks.workunit.client.0.smithi003.stdout:5/337: stat dc/c31 0 2024-09-21T12:20:35.251 INFO:tasks.workunit.client.0.smithi003.stdout:5/338: stat dc/f40 0 2024-09-21T12:20:35.253 INFO:tasks.workunit.client.0.smithi003.stdout:3/239: mkdir d0/d5/da/d28/dd/d23/d26/d3d/d42 0 2024-09-21T12:20:35.254 INFO:tasks.workunit.client.0.smithi003.stdout:7/263: truncate d8/db/f20 1152905 0 2024-09-21T12:20:35.255 INFO:tasks.workunit.client.1.smithi192.stdout:7/834: sync 2024-09-21T12:20:35.255 INFO:tasks.workunit.client.0.smithi003.stdout:7/264: write d8/db/f5e [277940,27010] 0 2024-09-21T12:20:35.256 INFO:tasks.workunit.client.1.smithi192.stdout:4/830: mknod d2/d36/d7f/df5/d4f/d71/d9d/dad/d9c/c117 0 2024-09-21T12:20:35.256 INFO:tasks.workunit.client.0.smithi003.stdout:7/265: chown d8/d31/f5f 82 1 2024-09-21T12:20:35.263 INFO:tasks.workunit.client.1.smithi192.stdout:4/831: creat d2/d36/d7f/f118 x:0 0 0 2024-09-21T12:20:35.265 INFO:tasks.workunit.client.0.smithi003.stdout:6/290: unlink d4/d13/d19/f54 0 2024-09-21T12:20:35.266 INFO:tasks.workunit.client.0.smithi003.stdout:6/291: chown d4/d13/l42 109 1 2024-09-21T12:20:35.272 INFO:tasks.workunit.client.0.smithi003.stdout:8/267: creat d7/df/d36/f5b x:0 0 0 2024-09-21T12:20:35.273 INFO:tasks.workunit.client.0.smithi003.stdout:6/292: dwrite d4/d9/fd [4194304,4194304] 0 2024-09-21T12:20:35.273 INFO:tasks.workunit.client.1.smithi192.stdout:9/971: dwrite d5/dc/d80/d5a/f75 [0,4194304] 0 2024-09-21T12:20:35.275 INFO:tasks.workunit.client.0.smithi003.stdout:2/260: dread - d0/d21/f4e zero size 2024-09-21T12:20:35.278 INFO:tasks.workunit.client.0.smithi003.stdout:5/339: mkdir dc/d15/d6f 0 2024-09-21T12:20:35.278 INFO:tasks.workunit.client.0.smithi003.stdout:9/387: write d2/da/d17/d40/f4c [502542,66912] 0 2024-09-21T12:20:35.279 INFO:tasks.workunit.client.0.smithi003.stdout:3/240: symlink d0/d5/da/d28/dd/d23/d26/l43 0 2024-09-21T12:20:35.280 INFO:tasks.workunit.client.0.smithi003.stdout:2/261: dread d0/dd/d22/f4a [0,4194304] 0 2024-09-21T12:20:35.281 INFO:tasks.workunit.client.0.smithi003.stdout:9/388: write d2/da/d2a/d3c/f4b [130798,3071] 0 2024-09-21T12:20:35.282 INFO:tasks.workunit.client.0.smithi003.stdout:9/389: fsync d2/da/d17/f27 0 2024-09-21T12:20:35.286 INFO:tasks.workunit.client.0.smithi003.stdout:0/295: fdatasync d9/fd 0 2024-09-21T12:20:35.287 INFO:tasks.workunit.client.1.smithi192.stdout:2/850: truncate d1b/d1e/d5e/d88/d95/dbe/f110 886637 0 2024-09-21T12:20:35.291 INFO:tasks.workunit.client.0.smithi003.stdout:0/296: dread d9/d12/d1e/f2e [0,4194304] 0 2024-09-21T12:20:35.292 INFO:tasks.workunit.client.0.smithi003.stdout:8/268: creat d7/df/d16/f5c x:0 0 0 2024-09-21T12:20:35.296 INFO:tasks.workunit.client.1.smithi192.stdout:7/835: getdents d6/d3a/d6d 0 2024-09-21T12:20:35.302 INFO:tasks.workunit.client.1.smithi192.stdout:7/836: creat d6/d3a/dba/f124 x:0 0 0 2024-09-21T12:20:35.303 INFO:tasks.workunit.client.0.smithi003.stdout:3/241: chown d0/d5/da/d28/d11/f1d 492327060 1 2024-09-21T12:20:35.304 INFO:tasks.workunit.client.0.smithi003.stdout:2/262: symlink d0/dd/d22/l5e 0 2024-09-21T12:20:35.306 INFO:tasks.workunit.client.1.smithi192.stdout:7/837: write d6/fde [2595649,84846] 0 2024-09-21T12:20:35.306 INFO:tasks.workunit.client.0.smithi003.stdout:3/242: write d0/d5/da/d28/dd/d23/d26/f30 [65670,130914] 0 2024-09-21T12:20:35.306 INFO:tasks.workunit.client.0.smithi003.stdout:9/390: truncate d2/d20/d22/d5e/f65 206963 0 2024-09-21T12:20:35.307 INFO:tasks.workunit.client.1.smithi192.stdout:9/972: dread d5/d19/dd5/d4d/d6d/f10f [0,4194304] 0 2024-09-21T12:20:35.307 INFO:tasks.workunit.client.0.smithi003.stdout:9/391: stat d2/da/d2a/d3c/l43 0 2024-09-21T12:20:35.307 INFO:tasks.workunit.client.0.smithi003.stdout:3/243: readlink d0/d5/da/d28/dd/d23/d26/l43 0 2024-09-21T12:20:35.308 INFO:tasks.workunit.client.1.smithi192.stdout:9/973: truncate d5/d8/d2c/f5d 2547529 0 2024-09-21T12:20:35.308 INFO:tasks.workunit.client.0.smithi003.stdout:8/269: chown d7/df/f1b 26945 1 2024-09-21T12:20:35.309 INFO:tasks.workunit.client.0.smithi003.stdout:3/244: write d0/f27 [236771,91437] 0 2024-09-21T12:20:35.309 INFO:tasks.workunit.client.0.smithi003.stdout:6/293: symlink d4/l5e 0 2024-09-21T12:20:35.312 INFO:tasks.workunit.client.0.smithi003.stdout:6/294: write d4/d9/fd [3025489,47551] 0 2024-09-21T12:20:35.312 INFO:tasks.workunit.client.1.smithi192.stdout:7/838: creat d6/d9/d11c/f125 x:0 0 0 2024-09-21T12:20:35.314 INFO:tasks.workunit.client.0.smithi003.stdout:5/340: truncate dc/f10 61432 0 2024-09-21T12:20:35.315 INFO:tasks.workunit.client.0.smithi003.stdout:9/392: dread d2/da/d2a/f33 [0,4194304] 0 2024-09-21T12:20:35.317 INFO:tasks.workunit.client.0.smithi003.stdout:1/282: sync 2024-09-21T12:20:35.317 INFO:tasks.workunit.client.0.smithi003.stdout:4/242: sync 2024-09-21T12:20:35.318 INFO:tasks.workunit.client.0.smithi003.stdout:2/263: mknod d0/d1c/c5f 0 2024-09-21T12:20:35.318 INFO:tasks.workunit.client.0.smithi003.stdout:1/283: fdatasync d4/d11/d14/d25/d42/f5f 0 2024-09-21T12:20:35.322 INFO:tasks.workunit.client.0.smithi003.stdout:0/297: mknod d9/c60 0 2024-09-21T12:20:35.322 INFO:tasks.workunit.client.1.smithi192.stdout:2/851: dread d1b/d38/f96 [0,4194304] 0 2024-09-21T12:20:35.323 INFO:tasks.workunit.client.1.smithi192.stdout:4/832: dread d2/d36/d7f/df5/d4f/f6a [0,4194304] 0 2024-09-21T12:20:35.325 INFO:tasks.workunit.client.0.smithi003.stdout:8/270: mknod d7/df/c5d 0 2024-09-21T12:20:35.326 INFO:tasks.workunit.client.0.smithi003.stdout:8/271: chown d7/df/d20/d21/d4c/c4f 29 1 2024-09-21T12:20:35.328 INFO:tasks.workunit.client.0.smithi003.stdout:3/245: creat d0/d5/da/d28/d11/f44 x:0 0 0 2024-09-21T12:20:35.330 INFO:tasks.workunit.client.0.smithi003.stdout:5/341: truncate dc/d15/d1c/f23 2980507 0 2024-09-21T12:20:35.332 INFO:tasks.workunit.client.1.smithi192.stdout:2/852: rename d1b/d38/d53/d8b/da7/dbb/cd7 to d1b/d1e/d5e/d88/d95/df2/c117 0 2024-09-21T12:20:35.333 INFO:tasks.workunit.client.0.smithi003.stdout:9/393: symlink d2/da/d2a/l8b 0 2024-09-21T12:20:35.335 INFO:tasks.workunit.client.1.smithi192.stdout:4/833: mknod d2/d36/d55/d89/dc8/df7/d6c/db8/c119 0 2024-09-21T12:20:35.336 INFO:tasks.workunit.client.0.smithi003.stdout:7/266: link d8/d31/d41/c48 d8/d2c/c63 0 2024-09-21T12:20:35.339 INFO:tasks.workunit.client.1.smithi192.stdout:7/839: dread d6/d9/d1f/f37 [0,4194304] 0 2024-09-21T12:20:35.341 INFO:tasks.workunit.client.1.smithi192.stdout:9/974: dwrite d5/d8/f15 [0,4194304] 0 2024-09-21T12:20:35.341 INFO:tasks.workunit.client.1.smithi192.stdout:0/937: sync 2024-09-21T12:20:35.342 INFO:tasks.workunit.client.1.smithi192.stdout:2/853: mkdir d1b/d1e/d5e/d75/da1/d105/d118 0 2024-09-21T12:20:35.348 INFO:tasks.workunit.client.1.smithi192.stdout:7/840: dwrite d6/f38 [0,4194304] 0 2024-09-21T12:20:35.354 INFO:tasks.workunit.client.1.smithi192.stdout:2/854: stat d1b/l2b 0 2024-09-21T12:20:35.354 INFO:tasks.workunit.client.0.smithi003.stdout:3/246: mknod d0/d5/da/d28/dd/d23/d26/c45 0 2024-09-21T12:20:35.355 INFO:tasks.workunit.client.1.smithi192.stdout:9/975: mkdir d5/d8/dc7/dd7/de7/d55/df3/d138 0 2024-09-21T12:20:35.356 INFO:tasks.workunit.client.0.smithi003.stdout:5/342: creat dc/d2b/d4e/f70 x:0 0 0 2024-09-21T12:20:35.356 INFO:tasks.workunit.client.1.smithi192.stdout:9/976: write d5/d19/fa8 [3059589,53244] 0 2024-09-21T12:20:35.357 INFO:tasks.workunit.client.0.smithi003.stdout:5/343: write dc/d15/d26/f2e [472098,67547] 0 2024-09-21T12:20:35.357 INFO:tasks.workunit.client.0.smithi003.stdout:7/267: mkdir d8/d3c/d64 0 2024-09-21T12:20:35.358 INFO:tasks.workunit.client.1.smithi192.stdout:7/841: fsync d6/d9/d1f/d3e/f8c 0 2024-09-21T12:20:35.359 INFO:tasks.workunit.client.0.smithi003.stdout:4/243: mknod d9/da/d36/c4f 0 2024-09-21T12:20:35.363 INFO:tasks.workunit.client.1.smithi192.stdout:2/855: mknod d1b/d38/d53/d8b/c119 0 2024-09-21T12:20:35.364 INFO:tasks.workunit.client.1.smithi192.stdout:2/856: read d1b/d9e/fac [280367,52704] 0 2024-09-21T12:20:35.365 INFO:tasks.workunit.client.0.smithi003.stdout:2/264: symlink d0/dd/d22/d37/d3f/l60 0 2024-09-21T12:20:35.366 INFO:tasks.workunit.client.0.smithi003.stdout:5/344: dwrite dc/d2b/d4e/f53 [0,4194304] 0 2024-09-21T12:20:35.367 INFO:tasks.workunit.client.0.smithi003.stdout:1/284: mkdir d4/d11/d14/d25/d59/d65/d68 0 2024-09-21T12:20:35.368 INFO:tasks.workunit.client.1.smithi192.stdout:4/834: link d2/d36/d7f/df5/d4f/d71/d9d/dad/d9c/d9e/dcf/cd2 d2/d36/d7f/df5/d4f/d71/d9d/dad/d9c/d9e/c11a 0 2024-09-21T12:20:35.368 INFO:tasks.workunit.client.0.smithi003.stdout:5/345: write dc/d15/d21/d30/f33 [2554487,653] 0 2024-09-21T12:20:35.373 INFO:tasks.workunit.client.0.smithi003.stdout:8/272: link d7/df/d16/f46 d7/df/d20/d54/f5e 0 2024-09-21T12:20:35.375 INFO:tasks.workunit.client.0.smithi003.stdout:6/295: dwrite d4/fe [0,4194304] 0 2024-09-21T12:20:35.375 INFO:tasks.workunit.client.0.smithi003.stdout:1/285: dread d4/f3c [0,4194304] 0 2024-09-21T12:20:35.376 INFO:tasks.workunit.client.0.smithi003.stdout:1/286: chown d4/d11/d49/f4b 1 1 2024-09-21T12:20:35.379 INFO:tasks.workunit.client.1.smithi192.stdout:0/938: creat d3/d5/d28/f122 x:0 0 0 2024-09-21T12:20:35.385 INFO:tasks.workunit.client.0.smithi003.stdout:7/268: write d8/f1d [93325,111221] 0 2024-09-21T12:20:35.386 INFO:tasks.workunit.client.1.smithi192.stdout:9/977: write d5/d8/dc7/dd7/de7/d55/d70/fac [1253629,13761] 0 2024-09-21T12:20:35.392 INFO:tasks.workunit.client.1.smithi192.stdout:3/808: sync 2024-09-21T12:20:35.392 INFO:tasks.workunit.client.1.smithi192.stdout:8/919: sync 2024-09-21T12:20:35.392 INFO:tasks.workunit.client.1.smithi192.stdout:1/871: sync 2024-09-21T12:20:35.394 INFO:tasks.workunit.client.1.smithi192.stdout:3/809: fsync db/d16/d18/d33/d3b/f58 0 2024-09-21T12:20:35.394 INFO:tasks.workunit.client.1.smithi192.stdout:1/872: chown d2/da/d6b/dc8/f69 1 1 2024-09-21T12:20:35.397 INFO:tasks.workunit.client.1.smithi192.stdout:4/835: link d2/d36/d55/d89/dc8/df7/d6c/f6e d2/d36/d7f/df5/d4f/d71/d9d/dad/d9c/d9e/dcf/f11b 0 2024-09-21T12:20:35.397 INFO:tasks.workunit.client.1.smithi192.stdout:1/873: write d2/d12/d2f/d41/d5c/d99/f11e [508306,55608] 0 2024-09-21T12:20:35.398 INFO:tasks.workunit.client.0.smithi003.stdout:0/298: creat d9/d12/d1e/f61 x:0 0 0 2024-09-21T12:20:35.399 INFO:tasks.workunit.client.0.smithi003.stdout:0/299: fdatasync d9/d12/d1e/d2b/d26/f3e 0 2024-09-21T12:20:35.400 INFO:tasks.workunit.client.0.smithi003.stdout:5/346: mknod dc/d15/d21/d30/d35/c71 0 2024-09-21T12:20:35.401 INFO:tasks.workunit.client.1.smithi192.stdout:9/978: read d5/dc/d40/fdb [116773,88279] 0 2024-09-21T12:20:35.401 INFO:tasks.workunit.client.1.smithi192.stdout:8/920: dwrite d14/d18/d94/da4/fc1 [0,4194304] 0 2024-09-21T12:20:35.403 INFO:tasks.workunit.client.1.smithi192.stdout:0/939: symlink d3/d5/de0/d119/d11f/l123 0 2024-09-21T12:20:35.404 INFO:tasks.workunit.client.1.smithi192.stdout:7/842: write d6/d9/f11 [642542,90918] 0 2024-09-21T12:20:35.404 INFO:tasks.workunit.client.1.smithi192.stdout:8/921: chown d14/d1a/d1d/d46/d4e/d83/d8d/d9c/dbe/cd4 523358764 1 2024-09-21T12:20:35.406 INFO:tasks.workunit.client.0.smithi003.stdout:6/296: read d4/f5 [7885796,94394] 0 2024-09-21T12:20:35.408 INFO:tasks.workunit.client.0.smithi003.stdout:1/287: rmdir d4/d11/d49 39 2024-09-21T12:20:35.410 INFO:tasks.workunit.client.1.smithi192.stdout:0/940: truncate d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/dc6/d83/d87/faa 984025 0 2024-09-21T12:20:35.410 INFO:tasks.workunit.client.0.smithi003.stdout:2/265: dwrite d0/d21/f4e [0,4194304] 0 2024-09-21T12:20:35.411 INFO:tasks.workunit.client.1.smithi192.stdout:2/857: link d1b/d38/f96 d1b/d1e/d3d/f11a 0 2024-09-21T12:20:35.411 INFO:tasks.workunit.client.0.smithi003.stdout:1/288: dread d4/d11/f50 [0,4194304] 0 2024-09-21T12:20:35.412 INFO:tasks.workunit.client.0.smithi003.stdout:3/247: getdents d0/d5/da/d28/d31 0 2024-09-21T12:20:35.413 INFO:tasks.workunit.client.1.smithi192.stdout:2/858: dread - d1b/d1e/d3d/fea zero size 2024-09-21T12:20:35.419 INFO:tasks.workunit.client.1.smithi192.stdout:7/843: dwrite d6/d9/d51/f23 [4194304,4194304] 0 2024-09-21T12:20:35.421 INFO:tasks.workunit.client.0.smithi003.stdout:0/300: creat d9/d12/d1e/d2b/d32/f62 x:0 0 0 2024-09-21T12:20:35.422 INFO:tasks.workunit.client.0.smithi003.stdout:5/347: mknod dc/d15/d21/d28/d41/c72 0 2024-09-21T12:20:35.425 INFO:tasks.workunit.client.1.smithi192.stdout:3/810: write db/f3c [3840481,46483] 0 2024-09-21T12:20:35.425 INFO:tasks.workunit.client.1.smithi192.stdout:2/859: dread d1b/f45 [0,4194304] 0 2024-09-21T12:20:35.425 INFO:tasks.workunit.client.0.smithi003.stdout:8/273: symlink d7/d57/l5f 0 2024-09-21T12:20:35.426 INFO:tasks.workunit.client.0.smithi003.stdout:8/274: stat d7/de/d11/l4e 0 2024-09-21T12:20:35.427 INFO:tasks.workunit.client.0.smithi003.stdout:6/297: creat d4/d11/d32/f5f x:0 0 0 2024-09-21T12:20:35.428 INFO:tasks.workunit.client.1.smithi192.stdout:9/979: dread d5/dc/d80/d44/d8e/dd6/dd8/ff9 [0,4194304] 0 2024-09-21T12:20:35.429 INFO:tasks.workunit.client.0.smithi003.stdout:8/275: write d7/df/d20/d21/f45 [1887287,8526] 0 2024-09-21T12:20:35.429 INFO:tasks.workunit.client.1.smithi192.stdout:9/980: dread - d5/d19/d32/dc0/fee zero size 2024-09-21T12:20:35.431 INFO:tasks.workunit.client.1.smithi192.stdout:9/981: write d5/dc/d40/f25 [3357221,50618] 0 2024-09-21T12:20:35.432 INFO:tasks.workunit.client.1.smithi192.stdout:1/874: truncate d2/f3e 1031542 0 2024-09-21T12:20:35.432 INFO:tasks.workunit.client.1.smithi192.stdout:4/836: creat d2/d36/d55/d89/dc8/df7/d6c/db8/d88/f11c x:0 0 0 2024-09-21T12:20:35.434 INFO:tasks.workunit.client.1.smithi192.stdout:7/844: dwrite d6/d9/d70/d77/f9a [0,4194304] 0 2024-09-21T12:20:35.436 INFO:tasks.workunit.client.0.smithi003.stdout:3/248: rmdir d0/d5/da/d28/dd 39 2024-09-21T12:20:35.436 INFO:tasks.workunit.client.0.smithi003.stdout:6/298: dwrite d4/f10 [4194304,4194304] 0 2024-09-21T12:20:35.437 INFO:tasks.workunit.client.1.smithi192.stdout:7/845: write d6/d9/d51/f24 [9406,56195] 0 2024-09-21T12:20:35.438 INFO:tasks.workunit.client.1.smithi192.stdout:8/922: mkdir d14/d1a/de9/d12e/d131 0 2024-09-21T12:20:35.439 INFO:tasks.workunit.client.0.smithi003.stdout:4/244: link d9/da/f27 d9/da/d36/f50 0 2024-09-21T12:20:35.440 INFO:tasks.workunit.client.1.smithi192.stdout:3/811: mkdir db/d16/d18/d40/dd1/d127 0 2024-09-21T12:20:35.440 INFO:tasks.workunit.client.0.smithi003.stdout:4/245: chown d9/d16/c41 84269 1 2024-09-21T12:20:35.441 INFO:tasks.workunit.client.1.smithi192.stdout:8/923: chown d14/d1a/d1d/c7c 25161 1 2024-09-21T12:20:35.441 INFO:tasks.workunit.client.0.smithi003.stdout:5/348: mkdir dc/d15/d21/d28/d3c/d73 0 2024-09-21T12:20:35.442 INFO:tasks.workunit.client.1.smithi192.stdout:3/812: stat db/d16/d18/d40/d60 0 2024-09-21T12:20:35.444 INFO:tasks.workunit.client.1.smithi192.stdout:4/837: dwrite d2/d36/d55/d89/dc8/df7/f105 [0,4194304] 0 2024-09-21T12:20:35.445 INFO:tasks.workunit.client.1.smithi192.stdout:2/860: read d1b/d1e/d5e/d88/faa [540825,54617] 0 2024-09-21T12:20:35.447 INFO:tasks.workunit.client.0.smithi003.stdout:8/276: creat d7/de/d52/f60 x:0 0 0 2024-09-21T12:20:35.450 INFO:tasks.workunit.client.0.smithi003.stdout:1/289: mknod d4/d11/d14/d25/d59/d65/d68/c69 0 2024-09-21T12:20:35.451 INFO:tasks.workunit.client.0.smithi003.stdout:7/269: link d8/db/f3d d8/d3c/d57/f65 0 2024-09-21T12:20:35.452 INFO:tasks.workunit.client.0.smithi003.stdout:7/270: fsync d8/f52 0 2024-09-21T12:20:35.453 INFO:tasks.workunit.client.1.smithi192.stdout:8/924: mkdir d14/d18/daf/d132 0 2024-09-21T12:20:35.454 INFO:tasks.workunit.client.0.smithi003.stdout:1/290: write d4/d11/d14/d25/d42/f5f [1044848,103459] 0 2024-09-21T12:20:35.457 INFO:tasks.workunit.client.0.smithi003.stdout:3/249: write d0/d5/da/d28/dd/d23/d26/f35 [510077,22381] 0 2024-09-21T12:20:35.457 INFO:tasks.workunit.client.1.smithi192.stdout:9/982: mknod d5/dc/d80/d44/c139 0 2024-09-21T12:20:35.458 INFO:tasks.workunit.client.1.smithi192.stdout:9/983: write d5/dc/d40/f25 [819477,94385] 0 2024-09-21T12:20:35.462 INFO:tasks.workunit.client.1.smithi192.stdout:4/838: mkdir d2/d21/d11d 0 2024-09-21T12:20:35.463 INFO:tasks.workunit.client.0.smithi003.stdout:4/246: creat d9/d48/f51 x:0 0 0 2024-09-21T12:20:35.464 INFO:tasks.workunit.client.0.smithi003.stdout:3/250: dwrite d0/d5/da/d28/dd/f2d [0,4194304] 0 2024-09-21T12:20:35.466 INFO:tasks.workunit.client.0.smithi003.stdout:5/349: mkdir dc/d15/d21/d28/d41/d5b/d74 0 2024-09-21T12:20:35.467 INFO:tasks.workunit.client.1.smithi192.stdout:0/941: dwrite d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/dc6/d83/d87/fb1 [0,4194304] 0 2024-09-21T12:20:35.470 INFO:tasks.workunit.client.0.smithi003.stdout:8/277: symlink d7/df/d16/l61 0 2024-09-21T12:20:35.474 INFO:tasks.workunit.client.1.smithi192.stdout:8/925: creat d14/d1a/d1d/db4/f133 x:0 0 0 2024-09-21T12:20:35.479 INFO:tasks.workunit.client.1.smithi192.stdout:3/813: fsync db/d16/db4/fa2 0 2024-09-21T12:20:35.479 INFO:tasks.workunit.client.0.smithi003.stdout:0/301: link l1 d9/d12/d17/d38/d3a/d46/d55/l63 0 2024-09-21T12:20:35.480 INFO:tasks.workunit.client.1.smithi192.stdout:1/875: write d2/da/d9f/f67 [5037194,121781] 0 2024-09-21T12:20:35.481 INFO:tasks.workunit.client.1.smithi192.stdout:4/839: truncate d2/d21/f38 3087569 0 2024-09-21T12:20:35.482 INFO:tasks.workunit.client.0.smithi003.stdout:2/266: write d0/d1c/f34 [1081142,129102] 0 2024-09-21T12:20:35.484 INFO:tasks.workunit.client.0.smithi003.stdout:2/267: write d0/dd/d22/f57 [77641,95773] 0 2024-09-21T12:20:35.486 INFO:tasks.workunit.client.0.smithi003.stdout:5/350: unlink dc/c13 0 2024-09-21T12:20:35.487 INFO:tasks.workunit.client.0.smithi003.stdout:8/278: mknod d7/df/d20/d24/d47/c62 0 2024-09-21T12:20:35.490 INFO:tasks.workunit.client.1.smithi192.stdout:8/926: rename d14/d1a/d82/d10e to d14/d1a/d1d/d46/d4e/d83/d8d/d9c/dd0/d8e/d134 0 2024-09-21T12:20:35.493 INFO:tasks.workunit.client.1.smithi192.stdout:3/814: mknod db/d16/d18/d33/d3b/db1/c128 0 2024-09-21T12:20:35.493 INFO:tasks.workunit.client.0.smithi003.stdout:6/299: link d4/d13/d19/c1b d4/d11/d1d/c60 0 2024-09-21T12:20:35.495 INFO:tasks.workunit.client.0.smithi003.stdout:8/279: dread d7/df/d20/d21/f45 [0,4194304] 0 2024-09-21T12:20:35.496 INFO:tasks.workunit.client.0.smithi003.stdout:8/280: write d7/df/d20/f5a [316357,25433] 0 2024-09-21T12:20:35.497 INFO:tasks.workunit.client.0.smithi003.stdout:0/302: unlink d9/d12/f33 0 2024-09-21T12:20:35.498 INFO:tasks.workunit.client.0.smithi003.stdout:0/303: fsync d9/d12/d22/f4a 0 2024-09-21T12:20:35.498 INFO:tasks.workunit.client.0.smithi003.stdout:8/281: write d7/df/d20/d21/f3a [531599,115650] 0 2024-09-21T12:20:35.501 INFO:tasks.workunit.client.0.smithi003.stdout:4/247: symlink d9/d48/d49/l52 0 2024-09-21T12:20:35.503 INFO:tasks.workunit.client.1.smithi192.stdout:2/861: rmdir d1b/d1e/d5e/d75/da1/daf/d106 0 2024-09-21T12:20:35.505 INFO:tasks.workunit.client.1.smithi192.stdout:7/846: link d6/d9/d70/d77/dcd/deb/c106 d6/d9/d70/dda/c126 0 2024-09-21T12:20:35.506 INFO:tasks.workunit.client.1.smithi192.stdout:7/847: write d6/d20/dc9/fff [653660,118770] 0 2024-09-21T12:20:35.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:35 smithi192 ceph-mon[35641]: Deploying cephadm binary to smithi003 2024-09-21T12:20:35.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:35 smithi192 ceph-mon[35641]: pgmap v4: 65 pgs: 65 active+clean; 2.3 GiB data, 6.9 GiB used, 529 GiB / 536 GiB avail 2024-09-21T12:20:35.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:35 smithi192 ceph-mon[35641]: mgrmap e23: smithi192.qsaprd(active, since 2s) 2024-09-21T12:20:35.510 INFO:tasks.workunit.client.1.smithi192.stdout:7/848: read d6/d20/f4d [1382408,32744] 0 2024-09-21T12:20:35.510 INFO:tasks.workunit.client.1.smithi192.stdout:0/942: write d3/d5/d28/d39/d50/dd9/d7a/dbe/d92/d51/f32 [1695879,96127] 0 2024-09-21T12:20:35.510 INFO:tasks.workunit.client.0.smithi003.stdout:6/300: fsync f3 0 2024-09-21T12:20:35.515 INFO:tasks.workunit.client.1.smithi192.stdout:3/815: creat db/d16/d18/d33/d3b/f129 x:0 0 0 2024-09-21T12:20:35.516 INFO:tasks.workunit.client.1.smithi192.stdout:3/816: stat db/d16/d18/c115 0 2024-09-21T12:20:35.517 INFO:tasks.workunit.client.1.smithi192.stdout:3/817: write db/d16/d18/f3e [3281438,51046] 0 2024-09-21T12:20:35.519 INFO:tasks.workunit.client.0.smithi003.stdout:0/304: creat d9/d12/d22/f64 x:0 0 0 2024-09-21T12:20:35.520 INFO:tasks.workunit.client.0.smithi003.stdout:7/271: truncate d8/d31/d41/f5a 4173093 0 2024-09-21T12:20:35.521 INFO:tasks.workunit.client.0.smithi003.stdout:1/291: truncate d4/dc/f32 1214366 0 2024-09-21T12:20:35.523 INFO:tasks.workunit.client.0.smithi003.stdout:3/251: creat d0/d5/f46 x:0 0 0 2024-09-21T12:20:35.524 INFO:tasks.workunit.client.0.smithi003.stdout:1/292: chown d4/df/d12/f46 23 1 2024-09-21T12:20:35.525 INFO:tasks.workunit.client.0.smithi003.stdout:4/248: write f8 [372208,33087] 0 2024-09-21T12:20:35.528 INFO:tasks.workunit.client.0.smithi003.stdout:2/268: rename d0/f13 to d0/d1c/f61 0 2024-09-21T12:20:35.530 INFO:tasks.workunit.client.0.smithi003.stdout:0/305: dwrite d9/d12/d17/d21/f42 [8388608,4194304] 0 2024-09-21T12:20:35.530 INFO:tasks.workunit.client.1.smithi192.stdout:1/876: dwrite d2/d12/d2f/d51/d24/f28 [0,4194304] 0 2024-09-21T12:20:35.531 INFO:tasks.workunit.client.0.smithi003.stdout:5/351: write dc/d15/f3f [5035202,68697] 0 2024-09-21T12:20:35.533 INFO:tasks.workunit.client.0.smithi003.stdout:5/352: fsync dc/d15/d26/f2e 0 2024-09-21T12:20:35.533 INFO:tasks.workunit.client.1.smithi192.stdout:2/862: dread d1b/f52 [0,4194304] 0 2024-09-21T12:20:35.537 INFO:tasks.workunit.client.0.smithi003.stdout:4/249: dwrite d9/d16/f26 [0,4194304] 0 2024-09-21T12:20:35.543 INFO:tasks.workunit.client.0.smithi003.stdout:7/272: mknod d8/db/d32/d43/c66 0 2024-09-21T12:20:35.545 INFO:tasks.workunit.client.0.smithi003.stdout:1/293: creat d4/d11/d14/f6a x:0 0 0 2024-09-21T12:20:35.548 INFO:tasks.workunit.client.1.smithi192.stdout:0/943: dread d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/d33/f5e [0,4194304] 0 2024-09-21T12:20:35.550 INFO:tasks.workunit.client.0.smithi003.stdout:8/282: rename d7/df/d20/d21/l23 to d7/de/d1a/l63 0 2024-09-21T12:20:35.551 INFO:tasks.workunit.client.1.smithi192.stdout:1/877: symlink d2/d82/l11f 0 2024-09-21T12:20:35.553 INFO:tasks.workunit.client.1.smithi192.stdout:4/840: dwrite d2/d36/f7c [0,4194304] 0 2024-09-21T12:20:35.554 INFO:tasks.workunit.client.1.smithi192.stdout:9/984: link d5/d8/dc7/dd7/de7/fb1 d5/d19/dd5/d4d/f13a 0 2024-09-21T12:20:35.555 INFO:tasks.workunit.client.0.smithi003.stdout:0/306: creat d9/d12/d22/d2d/f65 x:0 0 0 2024-09-21T12:20:35.558 INFO:tasks.workunit.client.1.smithi192.stdout:8/927: getdents d14/d1a/d1d/d20/d5f 0 2024-09-21T12:20:35.559 INFO:tasks.workunit.client.0.smithi003.stdout:7/273: chown d8/db/f1c 15 1 2024-09-21T12:20:35.560 INFO:tasks.workunit.client.0.smithi003.stdout:9/394: sync 2024-09-21T12:20:35.562 INFO:tasks.workunit.client.0.smithi003.stdout:1/294: read - d4/d11/d49/f4b zero size 2024-09-21T12:20:35.562 INFO:tasks.workunit.client.1.smithi192.stdout:1/878: creat d2/d10d/f120 x:0 0 0 2024-09-21T12:20:35.563 INFO:tasks.workunit.client.1.smithi192.stdout:7/849: dwrite d6/d9/d2d/fae [0,4194304] 0 2024-09-21T12:20:35.563 INFO:tasks.workunit.client.0.smithi003.stdout:1/295: dread - d4/f5e zero size 2024-09-21T12:20:35.565 INFO:tasks.workunit.client.0.smithi003.stdout:6/301: rename d4/fc to d4/d13/d2e/f61 0 2024-09-21T12:20:35.566 INFO:tasks.workunit.client.1.smithi192.stdout:7/850: chown d6/d20/d69/d90/da7/dc1/d10a 471129874 1 2024-09-21T12:20:35.568 INFO:tasks.workunit.client.1.smithi192.stdout:9/985: rmdir d5/dc/d80/d5a 39 2024-09-21T12:20:35.568 INFO:tasks.workunit.client.1.smithi192.stdout:9/986: readlink d5/dc/d40/lc8 0 2024-09-21T12:20:35.569 INFO:tasks.workunit.client.0.smithi003.stdout:7/274: dwrite d8/fa [4194304,4194304] 0 2024-09-21T12:20:35.571 INFO:tasks.workunit.client.1.smithi192.stdout:4/841: chown d2/d36/d55/d89/dc8/df7/c76 56093753 1 2024-09-21T12:20:35.571 INFO:tasks.workunit.client.0.smithi003.stdout:7/275: dread - d8/d2c/f39 zero size 2024-09-21T12:20:35.575 INFO:tasks.workunit.client.0.smithi003.stdout:1/296: dwrite d4/dc/f1c [0,4194304] 0 2024-09-21T12:20:35.577 INFO:tasks.workunit.client.0.smithi003.stdout:0/307: mkdir d9/d12/d1e/d2b/d66 0 2024-09-21T12:20:35.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:35 smithi003 ceph-mon[28057]: Deploying cephadm binary to smithi003 2024-09-21T12:20:35.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:35 smithi003 ceph-mon[28057]: pgmap v4: 65 pgs: 65 active+clean; 2.3 GiB data, 6.9 GiB used, 529 GiB / 536 GiB avail 2024-09-21T12:20:35.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:35 smithi003 ceph-mon[28057]: mgrmap e23: smithi192.qsaprd(active, since 2s) 2024-09-21T12:20:35.581 INFO:tasks.workunit.client.0.smithi003.stdout:2/269: write d0/dd/d22/d37/f48 [1125505,57699] 0 2024-09-21T12:20:35.582 INFO:tasks.workunit.client.0.smithi003.stdout:9/395: rmdir d2/d20/d22 39 2024-09-21T12:20:35.582 INFO:tasks.workunit.client.0.smithi003.stdout:2/270: stat d0/d21/d2f/d49 0 2024-09-21T12:20:35.584 INFO:tasks.workunit.client.1.smithi192.stdout:1/879: creat d2/dae/f121 x:0 0 0 2024-09-21T12:20:35.585 INFO:tasks.workunit.client.0.smithi003.stdout:3/252: link d0/d5/da/c1c d0/d5/da/c47 0 2024-09-21T12:20:35.589 INFO:tasks.workunit.client.0.smithi003.stdout:5/353: rename dc/d15/d21/d30/c67 to dc/d15/d21/d28/d3c/c75 0 2024-09-21T12:20:35.591 INFO:tasks.workunit.client.1.smithi192.stdout:4/842: symlink d2/db/d34/l11e 0 2024-09-21T12:20:35.592 INFO:tasks.workunit.client.0.smithi003.stdout:6/302: mkdir d4/d13/d19/d62 0 2024-09-21T12:20:35.593 INFO:tasks.workunit.client.0.smithi003.stdout:8/283: write d7/de/d1a/f3c [3755666,31342] 0 2024-09-21T12:20:35.594 INFO:tasks.workunit.client.1.smithi192.stdout:2/863: write d1b/d1e/d5e/d75/dfa/ffc [903133,79459] 0 2024-09-21T12:20:35.594 INFO:tasks.workunit.client.0.smithi003.stdout:8/284: fdatasync d7/df/d20/d21/f3f 0 2024-09-21T12:20:35.596 INFO:tasks.workunit.client.0.smithi003.stdout:8/285: chown d7/df/f49 67070553 1 2024-09-21T12:20:35.598 INFO:tasks.workunit.client.1.smithi192.stdout:1/880: symlink d2/da/d6b/d108/l122 0 2024-09-21T12:20:35.600 INFO:tasks.workunit.client.1.smithi192.stdout:9/987: symlink d5/d8/dc7/dd7/de7/d133/l13b 0 2024-09-21T12:20:35.603 INFO:tasks.workunit.client.1.smithi192.stdout:4/843: write d2/d36/d7f/df5/d4f/d82/fa1 [4114489,76514] 0 2024-09-21T12:20:35.605 INFO:tasks.workunit.client.1.smithi192.stdout:0/944: link d3/d5/d69/c91 d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/dc6/c124 0 2024-09-21T12:20:35.608 INFO:tasks.workunit.client.1.smithi192.stdout:2/864: unlink d1b/d38/cc8 0 2024-09-21T12:20:35.608 INFO:tasks.workunit.client.0.smithi003.stdout:2/271: stat d0/d1c/f61 0 2024-09-21T12:20:35.609 INFO:tasks.workunit.client.1.smithi192.stdout:2/865: write d1b/d38/d53/d8b/da0/fba [378047,101136] 0 2024-09-21T12:20:35.612 INFO:tasks.workunit.client.0.smithi003.stdout:9/396: creat d2/da/d2a/f8c x:0 0 0 2024-09-21T12:20:35.614 INFO:tasks.workunit.client.0.smithi003.stdout:3/253: mkdir d0/d5/da/d28/dd/d23/d48 0 2024-09-21T12:20:35.616 INFO:tasks.workunit.client.0.smithi003.stdout:0/308: rename d9/d12/d22 to d9/d12/d17/d38/d3a/d46/d55/d67 0 2024-09-21T12:20:35.618 INFO:tasks.workunit.client.0.smithi003.stdout:6/303: mkdir d4/d13/d63 0 2024-09-21T12:20:35.619 INFO:tasks.workunit.client.0.smithi003.stdout:7/276: dwrite d8/db/f3d [0,4194304] 0 2024-09-21T12:20:35.621 INFO:tasks.workunit.client.0.smithi003.stdout:1/297: creat d4/d11/d14/d25/d42/d63/f6b x:0 0 0 2024-09-21T12:20:35.621 INFO:tasks.workunit.client.0.smithi003.stdout:4/250: link c4 d9/da/d47/c53 0 2024-09-21T12:20:35.624 INFO:tasks.workunit.client.0.smithi003.stdout:2/272: mkdir d0/d21/d62 0 2024-09-21T12:20:35.625 INFO:tasks.workunit.client.0.smithi003.stdout:9/397: creat d2/d53/f8d x:0 0 0 2024-09-21T12:20:35.626 INFO:tasks.workunit.client.0.smithi003.stdout:3/254: mkdir d0/d5/da/d28/d11/d49 0 2024-09-21T12:20:35.629 INFO:tasks.workunit.client.0.smithi003.stdout:9/398: write d2/da/d35/f79 [1229992,116895] 0 2024-09-21T12:20:35.629 INFO:tasks.workunit.client.0.smithi003.stdout:5/354: symlink dc/d15/d21/d28/d41/d5b/d74/l76 0 2024-09-21T12:20:35.631 INFO:tasks.workunit.client.0.smithi003.stdout:5/355: readlink dc/d15/d21/l56 0 2024-09-21T12:20:35.632 INFO:tasks.workunit.client.1.smithi192.stdout:8/928: link d14/d18/d7b/f105 d14/d1a/d1d/d46/d4e/d83/d8d/d9c/dbe/f135 0 2024-09-21T12:20:35.632 INFO:tasks.workunit.client.1.smithi192.stdout:1/881: mknod d2/da/d6b/d108/c123 0 2024-09-21T12:20:35.632 INFO:tasks.workunit.client.1.smithi192.stdout:9/988: symlink d5/dc/dc2/dfb/l13c 0 2024-09-21T12:20:35.632 INFO:tasks.workunit.client.0.smithi003.stdout:0/309: rename d9/d12/d1e/d2b/d26/f3e to d9/d12/d17/d21/d30/f68 0 2024-09-21T12:20:35.633 INFO:tasks.workunit.client.1.smithi192.stdout:0/945: creat d3/df0/df6/f125 x:0 0 0 2024-09-21T12:20:35.635 INFO:tasks.workunit.client.1.smithi192.stdout:1/882: write d2/da/d6b/ff7 [478540,71328] 0 2024-09-21T12:20:35.635 INFO:tasks.workunit.client.1.smithi192.stdout:7/851: dread d6/d9/d1f/d3e/d7a/d8a/fab [0,4194304] 0 2024-09-21T12:20:35.635 INFO:tasks.workunit.client.0.smithi003.stdout:2/273: dwrite d0/d21/d30/f43 [0,4194304] 0 2024-09-21T12:20:35.637 INFO:tasks.workunit.client.0.smithi003.stdout:2/274: stat d0/dd/d16/f2a 0 2024-09-21T12:20:35.638 INFO:tasks.workunit.client.1.smithi192.stdout:7/852: write d6/d9/d1f/d3e/d7a/d8a/da2/fe8 [3898252,121888] 0 2024-09-21T12:20:35.642 INFO:tasks.workunit.client.0.smithi003.stdout:4/251: dread d9/fc [0,4194304] 0 2024-09-21T12:20:35.643 INFO:tasks.workunit.client.1.smithi192.stdout:1/883: dwrite d2/d12/d2f/fc2 [0,4194304] 0 2024-09-21T12:20:35.646 INFO:tasks.workunit.client.1.smithi192.stdout:1/884: readlink d2/d12/d2f/d51/d24/d65/l79 0 2024-09-21T12:20:35.651 INFO:tasks.workunit.client.0.smithi003.stdout:9/399: creat d2/da/d17/f8e x:0 0 0 2024-09-21T12:20:35.658 INFO:tasks.workunit.client.0.smithi003.stdout:5/356: truncate dc/d15/d21/d30/f34 4536374 0 2024-09-21T12:20:35.659 INFO:tasks.workunit.client.0.smithi003.stdout:2/275: mkdir d0/d21/d2c/d63 0 2024-09-21T12:20:35.666 INFO:tasks.workunit.client.0.smithi003.stdout:8/286: getdents d7/de/d11 0 2024-09-21T12:20:35.672 INFO:tasks.workunit.client.0.smithi003.stdout:2/276: unlink d0/dd/d22/l5e 0 2024-09-21T12:20:35.676 INFO:tasks.workunit.client.1.smithi192.stdout:3/818: sync 2024-09-21T12:20:35.679 INFO:tasks.workunit.client.0.smithi003.stdout:3/255: write d0/d5/f36 [3967788,37152] 0 2024-09-21T12:20:35.680 INFO:tasks.workunit.client.0.smithi003.stdout:9/400: mknod d2/d53/d75/c8f 0 2024-09-21T12:20:35.681 INFO:tasks.workunit.client.0.smithi003.stdout:2/277: dwrite d0/dd/d16/f19 [0,4194304] 0 2024-09-21T12:20:35.682 INFO:tasks.workunit.client.0.smithi003.stdout:7/277: dwrite d8/db/f16 [0,4194304] 0 2024-09-21T12:20:35.685 INFO:tasks.workunit.client.0.smithi003.stdout:5/357: write dc/d15/d1c/f58 [159813,48201] 0 2024-09-21T12:20:35.686 INFO:tasks.workunit.client.0.smithi003.stdout:0/310: link d9/d12/d1e/d2b/d32/l48 d9/d12/d1e/d2b/d26/d54/l69 0 2024-09-21T12:20:35.687 INFO:tasks.workunit.client.0.smithi003.stdout:3/256: truncate d0/d5/da/d28/dd/d23/d26/f30 382239 0 2024-09-21T12:20:35.687 INFO:tasks.workunit.client.0.smithi003.stdout:5/358: readlink dc/d2b/l60 0 2024-09-21T12:20:35.688 INFO:tasks.workunit.client.0.smithi003.stdout:5/359: chown dc 0 1 2024-09-21T12:20:35.690 INFO:tasks.workunit.client.0.smithi003.stdout:5/360: readlink dc/d15/d21/d28/d3c/l6d 0 2024-09-21T12:20:35.693 INFO:tasks.workunit.client.0.smithi003.stdout:8/287: mknod d7/df/d20/d21/d4c/d4d/c64 0 2024-09-21T12:20:35.698 INFO:tasks.workunit.client.0.smithi003.stdout:9/401: creat d2/d53/f90 x:0 0 0 2024-09-21T12:20:35.701 INFO:tasks.workunit.client.0.smithi003.stdout:7/278: creat d8/d31/f67 x:0 0 0 2024-09-21T12:20:35.702 INFO:tasks.workunit.client.0.smithi003.stdout:1/298: dwrite d4/f30 [0,4194304] 0 2024-09-21T12:20:35.703 INFO:tasks.workunit.client.0.smithi003.stdout:7/279: fsync d8/db/f5e 0 2024-09-21T12:20:35.704 INFO:tasks.workunit.client.0.smithi003.stdout:2/278: fdatasync d0/dd/d22/f4a 0 2024-09-21T12:20:35.705 INFO:tasks.workunit.client.0.smithi003.stdout:7/280: stat d8/db/f3d 0 2024-09-21T12:20:35.705 INFO:tasks.workunit.client.0.smithi003.stdout:1/299: dread - d4/d11/d14/f61 zero size 2024-09-21T12:20:35.707 INFO:tasks.workunit.client.0.smithi003.stdout:2/279: read d0/dd/d22/f23 [403773,57132] 0 2024-09-21T12:20:35.707 INFO:tasks.workunit.client.0.smithi003.stdout:3/257: truncate d0/d5/da/d28/d11/f1d 5483739 0 2024-09-21T12:20:35.711 INFO:tasks.workunit.client.0.smithi003.stdout:2/280: chown d0/d21/f4e 10668 1 2024-09-21T12:20:35.712 INFO:tasks.workunit.client.0.smithi003.stdout:5/361: rename dc/f40 to dc/d15/d21/d30/d4b/d5c/f77 0 2024-09-21T12:20:35.712 INFO:tasks.workunit.client.0.smithi003.stdout:3/258: fsync d0/d5/da/d28/dd/f2e 0 2024-09-21T12:20:35.714 INFO:tasks.workunit.client.0.smithi003.stdout:8/288: rmdir d7/d57 39 2024-09-21T12:20:35.716 INFO:tasks.workunit.client.0.smithi003.stdout:9/402: dwrite d2/f10 [0,4194304] 0 2024-09-21T12:20:35.719 INFO:tasks.workunit.client.0.smithi003.stdout:2/281: write d0/d21/f35 [4149433,123702] 0 2024-09-21T12:20:35.722 INFO:tasks.workunit.client.0.smithi003.stdout:2/282: chown d0/d21/d62 1216814270 1 2024-09-21T12:20:35.722 INFO:tasks.workunit.client.0.smithi003.stdout:4/252: dwrite d9/da/d36/f50 [4194304,4194304] 0 2024-09-21T12:20:35.730 INFO:tasks.workunit.client.0.smithi003.stdout:5/362: dwrite dc/d15/d21/d30/f55 [0,4194304] 0 2024-09-21T12:20:35.734 INFO:tasks.workunit.client.1.smithi192.stdout:0/946: mknod d3/c126 0 2024-09-21T12:20:35.737 INFO:tasks.workunit.client.1.smithi192.stdout:8/929: mkdir d14/d1a/de9/d12e/d136 0 2024-09-21T12:20:35.740 INFO:tasks.workunit.client.0.smithi003.stdout:7/281: rename d8/d31/d41 to d8/d3c/d57/d68 0 2024-09-21T12:20:35.744 INFO:tasks.workunit.client.1.smithi192.stdout:7/853: mknod d6/d9/d1f/d3e/d7a/d8a/da2/c127 0 2024-09-21T12:20:35.745 INFO:tasks.workunit.client.1.smithi192.stdout:7/854: chown d6/d3a/d6d/cfe 31 1 2024-09-21T12:20:35.747 INFO:tasks.workunit.client.1.smithi192.stdout:1/885: unlink d2/d12/d2f/d51/d24/d65/dd4/fd9 0 2024-09-21T12:20:35.750 INFO:tasks.workunit.client.0.smithi003.stdout:2/283: creat d0/d46/f64 x:0 0 0 2024-09-21T12:20:35.751 INFO:tasks.workunit.client.1.smithi192.stdout:2/866: mkdir d1b/d38/d11b 0 2024-09-21T12:20:35.753 INFO:tasks.workunit.client.1.smithi192.stdout:9/989: mkdir d5/d8/d13d 0 2024-09-21T12:20:35.753 INFO:tasks.workunit.client.1.smithi192.stdout:9/990: chown d5/d19/d32/dc0/d11c/f12e 83753 1 2024-09-21T12:20:35.755 INFO:tasks.workunit.client.1.smithi192.stdout:0/947: stat d3/d5/c67 0 2024-09-21T12:20:35.756 INFO:tasks.workunit.client.1.smithi192.stdout:0/948: readlink d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/dc6/d83/lab 0 2024-09-21T12:20:35.757 INFO:tasks.workunit.client.1.smithi192.stdout:0/949: write d3/d5/d69/dbf/f114 [66576,35644] 0 2024-09-21T12:20:35.757 INFO:tasks.workunit.client.0.smithi003.stdout:5/363: creat dc/d15/d21/d30/d35/f78 x:0 0 0 2024-09-21T12:20:35.759 INFO:tasks.workunit.client.1.smithi192.stdout:4/844: sync 2024-09-21T12:20:35.760 INFO:tasks.workunit.client.1.smithi192.stdout:4/845: readlink d2/d36/d55/d89/dc8/df7/d6c/db8/d99/l112 0 2024-09-21T12:20:35.762 INFO:tasks.workunit.client.0.smithi003.stdout:1/300: rename l3 to d4/d11/d14/d25/d42/d63/l6c 0 2024-09-21T12:20:35.764 INFO:tasks.workunit.client.0.smithi003.stdout:7/282: creat d8/d31/f69 x:0 0 0 2024-09-21T12:20:35.766 INFO:tasks.workunit.client.0.smithi003.stdout:7/283: write d8/db/d13/f3a [313500,77950] 0 2024-09-21T12:20:35.766 INFO:tasks.workunit.client.1.smithi192.stdout:1/886: dwrite d2/de/dcf/f11a [0,4194304] 0 2024-09-21T12:20:35.769 INFO:tasks.workunit.client.1.smithi192.stdout:9/991: mkdir d5/d19/dd5/d4d/dde/d13e 0 2024-09-21T12:20:35.770 INFO:tasks.workunit.client.1.smithi192.stdout:0/950: readlink d3/l104 0 2024-09-21T12:20:35.771 INFO:tasks.workunit.client.0.smithi003.stdout:0/311: truncate d9/d12/d17/d21/f42 8539197 0 2024-09-21T12:20:35.773 INFO:tasks.workunit.client.1.smithi192.stdout:7/855: mknod d6/d3a/c128 0 2024-09-21T12:20:35.774 INFO:tasks.workunit.client.1.smithi192.stdout:7/856: chown d6/d9/d2d 1148 1 2024-09-21T12:20:35.775 INFO:tasks.workunit.client.1.smithi192.stdout:4/846: rename d2/d36/d55/d89/da6/l102 to d2/d36/d55/d89/dc8/df7/d6c/l11f 0 2024-09-21T12:20:35.775 INFO:tasks.workunit.client.1.smithi192.stdout:7/857: dread - d6/d9/d70/f107 zero size 2024-09-21T12:20:35.775 INFO:tasks.workunit.client.1.smithi192.stdout:0/951: dread d3/d5/d28/d39/d50/dd9/d7a/dbe/d92/d51/f2b [0,4194304] 0 2024-09-21T12:20:35.778 INFO:tasks.workunit.client.1.smithi192.stdout:3/819: symlink db/d16/d18/d33/d3b/db1/l12a 0 2024-09-21T12:20:35.778 INFO:tasks.workunit.client.1.smithi192.stdout:4/847: write d2/d36/d55/d89/dc8/f116 [14683,28563] 0 2024-09-21T12:20:35.781 INFO:tasks.workunit.client.1.smithi192.stdout:1/887: creat d2/d12/d2f/d51/d24/d65/d8e/f124 x:0 0 0 2024-09-21T12:20:35.782 INFO:tasks.workunit.client.0.smithi003.stdout:8/289: creat d7/f65 x:0 0 0 2024-09-21T12:20:35.783 INFO:tasks.workunit.client.0.smithi003.stdout:5/364: dwrite dc/d15/d1c/f3e [0,4194304] 0 2024-09-21T12:20:35.784 INFO:tasks.workunit.client.0.smithi003.stdout:7/284: mknod d8/d3c/d57/d68/c6a 0 2024-09-21T12:20:35.785 INFO:tasks.workunit.client.1.smithi192.stdout:7/858: dwrite d6/d9/d70/ffb [0,4194304] 0 2024-09-21T12:20:35.786 INFO:tasks.workunit.client.1.smithi192.stdout:0/952: dwrite d3/df0/df6/f112 [0,4194304] 0 2024-09-21T12:20:35.787 INFO:tasks.workunit.client.1.smithi192.stdout:9/992: mkdir d5/d8/dc7/dd7/d13f 0 2024-09-21T12:20:35.787 INFO:tasks.workunit.client.0.smithi003.stdout:9/403: getdents d2/d20/d22/d5e/d87 0 2024-09-21T12:20:35.791 INFO:tasks.workunit.client.1.smithi192.stdout:8/930: write d14/d1a/d1d/d46/d4e/d83/d8d/d9c/dd0/d8e/fb1 [646291,65974] 0 2024-09-21T12:20:35.796 INFO:tasks.workunit.client.0.smithi003.stdout:0/312: mknod d9/d12/d1e/d2b/c6a 0 2024-09-21T12:20:35.799 INFO:tasks.workunit.client.1.smithi192.stdout:2/867: dwrite d1b/d1e/d5e/d75/f82 [0,4194304] 0 2024-09-21T12:20:35.800 INFO:tasks.workunit.client.0.smithi003.stdout:8/290: rmdir d7/de/d52 39 2024-09-21T12:20:35.803 INFO:tasks.workunit.client.0.smithi003.stdout:5/365: fsync dc/d15/d1c/f4c 0 2024-09-21T12:20:35.804 INFO:tasks.workunit.client.0.smithi003.stdout:5/366: write dc/d15/f1f [612514,11921] 0 2024-09-21T12:20:35.806 INFO:tasks.workunit.client.1.smithi192.stdout:0/953: creat d3/d5/d28/d39/d50/dd9/d7a/f127 x:0 0 0 2024-09-21T12:20:35.807 INFO:tasks.workunit.client.0.smithi003.stdout:9/404: creat d2/da/d35/d76/f91 x:0 0 0 2024-09-21T12:20:35.809 INFO:tasks.workunit.client.0.smithi003.stdout:3/259: truncate d0/d5/da/d28/d11/f1d 5659075 0 2024-09-21T12:20:35.812 INFO:tasks.workunit.client.0.smithi003.stdout:6/304: sync 2024-09-21T12:20:35.812 INFO:tasks.workunit.client.0.smithi003.stdout:2/284: creat d0/dd/f65 x:0 0 0 2024-09-21T12:20:35.813 INFO:tasks.workunit.client.0.smithi003.stdout:6/305: chown d4/f5 0 1 2024-09-21T12:20:35.814 INFO:tasks.workunit.client.1.smithi192.stdout:0/954: dwrite d3/d5/d28/d39/f41 [8388608,4194304] 0 2024-09-21T12:20:35.815 INFO:tasks.workunit.client.1.smithi192.stdout:3/820: mknod db/c12b 0 2024-09-21T12:20:35.816 INFO:tasks.workunit.client.0.smithi003.stdout:4/253: getdents d9/da/d36 0 2024-09-21T12:20:35.816 INFO:tasks.workunit.client.1.smithi192.stdout:3/821: chown db/d16/d18/d33/d3b/f129 90944 1 2024-09-21T12:20:35.817 INFO:tasks.workunit.client.0.smithi003.stdout:4/254: dread - d9/f15 zero size 2024-09-21T12:20:35.817 INFO:tasks.workunit.client.1.smithi192.stdout:3/822: read - db/d16/d18/da7/d10e/d2e/db8/dd0/f108 zero size 2024-09-21T12:20:35.820 INFO:tasks.workunit.client.0.smithi003.stdout:7/285: rename d8/d3c/d57/d68 to d8/d3c/d6b 0 2024-09-21T12:20:35.824 INFO:tasks.workunit.client.0.smithi003.stdout:1/301: link d4/fa d4/df/d19/f6d 0 2024-09-21T12:20:35.826 INFO:tasks.workunit.client.0.smithi003.stdout:8/291: chown d7/de/l27 166398 1 2024-09-21T12:20:35.828 INFO:tasks.workunit.client.0.smithi003.stdout:5/367: creat dc/d15/f79 x:0 0 0 2024-09-21T12:20:35.830 INFO:tasks.workunit.client.1.smithi192.stdout:7/859: write d6/d9/f2b [1694172,67385] 0 2024-09-21T12:20:35.833 INFO:tasks.workunit.client.0.smithi003.stdout:6/306: mkdir d4/d13/d2e/d37/d64 0 2024-09-21T12:20:35.834 INFO:tasks.workunit.client.0.smithi003.stdout:6/307: truncate d4/d11/f2f 167734 0 2024-09-21T12:20:35.834 INFO:tasks.workunit.client.1.smithi192.stdout:1/888: dwrite d2/d12/d2f/d51/d24/d65/f74 [0,4194304] 0 2024-09-21T12:20:35.835 INFO:tasks.workunit.client.1.smithi192.stdout:1/889: chown d2/d82/ffd 2585625 1 2024-09-21T12:20:35.836 INFO:tasks.workunit.client.1.smithi192.stdout:0/955: creat d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/dc6/d83/d87/f128 x:0 0 0 2024-09-21T12:20:35.837 INFO:tasks.workunit.client.0.smithi003.stdout:9/405: dread d2/da/f14 [0,4194304] 0 2024-09-21T12:20:35.839 INFO:tasks.workunit.client.1.smithi192.stdout:3/823: readlink db/d16/d18/d33/d3b/lda 0 2024-09-21T12:20:35.839 INFO:tasks.workunit.client.1.smithi192.stdout:4/848: link d2/d36/d7f/df5/d4f/d71/d9d/dad/c65 d2/d36/d55/d89/dc8/df7/d6c/db8/d88/dd0/c120 0 2024-09-21T12:20:35.840 INFO:tasks.workunit.client.1.smithi192.stdout:0/956: dread - d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/dc6/d83/dc9/f11e zero size 2024-09-21T12:20:35.841 INFO:tasks.workunit.client.0.smithi003.stdout:7/286: rename d8/db/l3b to d8/db/d13/d60/l6c 0 2024-09-21T12:20:35.841 INFO:tasks.workunit.client.1.smithi192.stdout:3/824: write db/d16/d18/d40/d60/fce [302168,25573] 0 2024-09-21T12:20:35.842 INFO:tasks.workunit.client.1.smithi192.stdout:2/868: creat d1b/d1e/d7b/dfb/d112/f11c x:0 0 0 2024-09-21T12:20:35.843 INFO:tasks.workunit.client.0.smithi003.stdout:1/302: write d4/d11/f2f [3082164,77429] 0 2024-09-21T12:20:35.847 INFO:tasks.workunit.client.0.smithi003.stdout:5/368: stat dc/d15/d1c/c45 0 2024-09-21T12:20:35.847 INFO:tasks.workunit.client.0.smithi003.stdout:2/285: dread d0/f36 [0,4194304] 0 2024-09-21T12:20:35.849 INFO:tasks.workunit.client.1.smithi192.stdout:8/931: rename d14/d1a/d1d/d46/d4e/d83/d8d/dd8/le8 to d14/d1a/d1d/d48/l137 0 2024-09-21T12:20:35.852 INFO:tasks.workunit.client.1.smithi192.stdout:4/849: unlink d2/db/d1a/f46 0 2024-09-21T12:20:35.856 INFO:tasks.workunit.client.0.smithi003.stdout:6/308: mknod d4/d11/c65 0 2024-09-21T12:20:35.857 INFO:tasks.workunit.client.0.smithi003.stdout:6/309: dread - d4/d11/f57 zero size 2024-09-21T12:20:35.858 INFO:tasks.workunit.client.1.smithi192.stdout:0/957: rename d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/d43/cf3 to d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/dc6/d83/d87/c129 0 2024-09-21T12:20:35.858 INFO:tasks.workunit.client.0.smithi003.stdout:6/310: write d4/f21 [1016990,49472] 0 2024-09-21T12:20:35.859 INFO:tasks.workunit.client.0.smithi003.stdout:6/311: readlink d4/d13/d19/l24 0 2024-09-21T12:20:35.861 INFO:tasks.workunit.client.1.smithi192.stdout:3/825: dread db/d16/d18/d33/d3b/db1/df1/f86 [0,4194304] 0 2024-09-21T12:20:35.861 INFO:tasks.workunit.client.0.smithi003.stdout:0/313: truncate d9/d12/d1e/f1f 3160547 0 2024-09-21T12:20:35.863 INFO:tasks.workunit.client.0.smithi003.stdout:8/292: dread d7/df/d20/d21/f33 [0,4194304] 0 2024-09-21T12:20:35.864 INFO:tasks.workunit.client.0.smithi003.stdout:8/293: dread - d7/df/d36/f5b zero size 2024-09-21T12:20:35.865 INFO:tasks.workunit.client.0.smithi003.stdout:9/406: rename d2/da/d2a/d3c/l56 to d2/d29/l92 0 2024-09-21T12:20:35.868 INFO:tasks.workunit.client.1.smithi192.stdout:3/826: dwrite db/d16/dc1/def/d111/f113 [0,4194304] 0 2024-09-21T12:20:35.868 INFO:tasks.workunit.client.0.smithi003.stdout:1/303: creat d4/d11/d14/d25/d42/f6e x:0 0 0 2024-09-21T12:20:35.869 INFO:tasks.workunit.client.0.smithi003.stdout:1/304: fsync d4/df/d12/f3b 0 2024-09-21T12:20:35.870 INFO:tasks.workunit.client.1.smithi192.stdout:4/850: stat d2/d21/f38 0 2024-09-21T12:20:35.871 INFO:tasks.workunit.client.1.smithi192.stdout:1/890: write d2/d12/d2f/d51/fef [471525,19745] 0 2024-09-21T12:20:35.872 INFO:tasks.workunit.client.0.smithi003.stdout:2/286: write d0/f36 [1280174,32056] 0 2024-09-21T12:20:35.872 INFO:tasks.workunit.client.1.smithi192.stdout:1/891: chown d2/dae/cb4 126 1 2024-09-21T12:20:35.872 INFO:tasks.workunit.client.1.smithi192.stdout:4/851: read d2/d36/d55/d89/dc8/df7/d6c/f6e [2808556,59159] 0 2024-09-21T12:20:35.873 INFO:tasks.workunit.client.1.smithi192.stdout:9/993: link d5/d19/dd5/d4d/f13a d5/dc/d80/d44/d8e/f140 0 2024-09-21T12:20:35.876 INFO:tasks.workunit.client.1.smithi192.stdout:0/958: mknod d3/d5/d69/c12a 0 2024-09-21T12:20:35.877 INFO:tasks.workunit.client.0.smithi003.stdout:3/260: creat d0/d5/f4a x:0 0 0 2024-09-21T12:20:35.881 INFO:tasks.workunit.client.0.smithi003.stdout:5/369: creat dc/d15/d21/d28/d41/d5b/d74/f7a x:0 0 0 2024-09-21T12:20:35.883 INFO:tasks.workunit.client.0.smithi003.stdout:2/287: dwrite d0/f2 [0,4194304] 0 2024-09-21T12:20:35.886 INFO:tasks.workunit.client.0.smithi003.stdout:8/294: dread d7/de/f19 [0,4194304] 0 2024-09-21T12:20:35.886 INFO:tasks.workunit.client.0.smithi003.stdout:4/255: dwrite d9/f2f [0,4194304] 0 2024-09-21T12:20:35.889 INFO:tasks.workunit.client.1.smithi192.stdout:3/827: read db/d16/d18/d33/d3b/db1/fbb [9962,77041] 0 2024-09-21T12:20:35.889 INFO:tasks.workunit.client.0.smithi003.stdout:8/295: truncate d7/df/d16/f5c 747707 0 2024-09-21T12:20:35.890 INFO:tasks.workunit.client.1.smithi192.stdout:9/994: creat d5/d19/dd5/f141 x:0 0 0 2024-09-21T12:20:35.891 INFO:tasks.workunit.client.0.smithi003.stdout:7/287: rename d8/db/l18 to d8/db/d32/l6d 0 2024-09-21T12:20:35.892 INFO:tasks.workunit.client.1.smithi192.stdout:8/932: dwrite d14/d1a/d1d/d46/d4e/f5b [0,4194304] 0 2024-09-21T12:20:35.892 INFO:tasks.workunit.client.1.smithi192.stdout:3/828: write db/d16/db4/d8c/fd4 [1396871,89744] 0 2024-09-21T12:20:35.894 INFO:tasks.workunit.client.0.smithi003.stdout:9/407: creat d2/d53/f93 x:0 0 0 2024-09-21T12:20:35.898 INFO:tasks.workunit.client.1.smithi192.stdout:0/959: creat d3/d5/d28/d39/d50/dd9/d7a/dbe/d92/f12b x:0 0 0 2024-09-21T12:20:35.900 INFO:tasks.workunit.client.1.smithi192.stdout:4/852: rename d2/d36/f3c to d2/d36/d7f/df5/f121 0 2024-09-21T12:20:35.902 INFO:tasks.workunit.client.1.smithi192.stdout:9/995: dwrite d5/dc/d80/d44/d8e/f98 [4194304,4194304] 0 2024-09-21T12:20:35.904 INFO:tasks.workunit.client.1.smithi192.stdout:9/996: dread - d5/d19/d32/dc0/d11c/f126 zero size 2024-09-21T12:20:35.905 INFO:tasks.workunit.client.0.smithi003.stdout:3/261: symlink d0/d5/d38/l4b 0 2024-09-21T12:20:35.907 INFO:tasks.workunit.client.0.smithi003.stdout:3/262: write d0/d5/f36 [2442885,91742] 0 2024-09-21T12:20:35.907 INFO:tasks.workunit.client.1.smithi192.stdout:8/933: fsync d14/d18/daf/ddd/fe3 0 2024-09-21T12:20:35.908 INFO:tasks.workunit.client.0.smithi003.stdout:5/370: stat dc/d15/d1c/l66 0 2024-09-21T12:20:35.911 INFO:tasks.workunit.client.1.smithi192.stdout:3/829: dread - db/d16/d18/d33/d3b/faf zero size 2024-09-21T12:20:35.911 INFO:tasks.workunit.client.0.smithi003.stdout:2/288: symlink d0/d1c/l66 0 2024-09-21T12:20:35.914 INFO:tasks.workunit.client.1.smithi192.stdout:9/997: dwrite d5/dc/d40/dad/d53/df4/f132 [0,4194304] 0 2024-09-21T12:20:35.915 INFO:tasks.workunit.client.0.smithi003.stdout:8/296: rmdir d7/df/d20/d21 39 2024-09-21T12:20:35.916 INFO:tasks.workunit.client.0.smithi003.stdout:3/263: read d0/d5/da/d28/d31/f32 [910516,63811] 0 2024-09-21T12:20:35.918 INFO:tasks.workunit.client.0.smithi003.stdout:0/314: rename d9/l1a to d9/d12/d1e/d2b/l6b 0 2024-09-21T12:20:35.919 INFO:tasks.workunit.client.1.smithi192.stdout:8/934: truncate d14/d1a/d1d/d48/de1/ffe 934451 0 2024-09-21T12:20:35.924 INFO:tasks.workunit.client.0.smithi003.stdout:6/312: dwrite d4/d13/d2e/f61 [4194304,4194304] 0 2024-09-21T12:20:35.926 INFO:tasks.workunit.client.0.smithi003.stdout:6/313: write d4/d9/f15 [6393096,12569] 0 2024-09-21T12:20:35.927 INFO:tasks.workunit.client.0.smithi003.stdout:9/408: mkdir d2/da/d35/d76/d94 0 2024-09-21T12:20:35.928 INFO:tasks.workunit.client.0.smithi003.stdout:8/297: dwrite d7/de/f3b [0,4194304] 0 2024-09-21T12:20:35.931 INFO:tasks.workunit.client.1.smithi192.stdout:3/830: mknod db/d16/dc1/dd5/c12c 0 2024-09-21T12:20:35.937 INFO:tasks.workunit.client.1.smithi192.stdout:0/960: dread d3/d5/d28/d39/d50/dd9/d7a/dbe/ff8 [0,4194304] 0 2024-09-21T12:20:35.937 INFO:tasks.workunit.client.0.smithi003.stdout:1/305: dwrite d4/d11/f2a [0,4194304] 0 2024-09-21T12:20:35.938 INFO:tasks.workunit.client.1.smithi192.stdout:9/998: creat d5/dc/d80/d44/d8e/dd6/f142 x:0 0 0 2024-09-21T12:20:35.941 INFO:tasks.workunit.client.1.smithi192.stdout:3/831: dwrite db/d16/d18/da7/d10e/d2e/db8/dd0/f108 [0,4194304] 0 2024-09-21T12:20:35.952 INFO:tasks.workunit.client.0.smithi003.stdout:2/289: rename d0/dd/f12 to d0/dd/d22/d37/d3f/f67 0 2024-09-21T12:20:35.958 INFO:tasks.workunit.client.1.smithi192.stdout:9/999: symlink d5/dc/d80/l143 0 2024-09-21T12:20:35.960 INFO:tasks.workunit.client.1.smithi192.stdout:0/961: truncate d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/f11 1248096 0 2024-09-21T12:20:35.963 INFO:tasks.workunit.client.1.smithi192.stdout:3/832: creat db/d16/d18/d21/d23/d71/d77/d11c/f12d x:0 0 0 2024-09-21T12:20:35.964 INFO:tasks.workunit.client.1.smithi192.stdout:3/833: write db/d16/d18/f3e [8022116,6456] 0 2024-09-21T12:20:35.966 INFO:tasks.workunit.client.0.smithi003.stdout:1/306: creat d4/df/d19/f6f x:0 0 0 2024-09-21T12:20:35.967 INFO:tasks.workunit.client.1.smithi192.stdout:4/853: symlink d2/d36/d7f/d68/l122 0 2024-09-21T12:20:35.969 INFO:tasks.workunit.client.1.smithi192.stdout:8/935: write d14/d1a/d1d/d20/f47 [2434735,76674] 0 2024-09-21T12:20:35.971 INFO:tasks.workunit.client.1.smithi192.stdout:0/962: fdatasync d3/f7d 0 2024-09-21T12:20:35.974 INFO:tasks.workunit.client.1.smithi192.stdout:3/834: mknod db/d16/d18/d33/d3b/db1/c12e 0 2024-09-21T12:20:35.975 INFO:tasks.workunit.client.0.smithi003.stdout:2/290: mkdir d0/dd/d22/d68 0 2024-09-21T12:20:35.979 INFO:tasks.workunit.client.0.smithi003.stdout:8/298: mknod d7/de/d52/c66 0 2024-09-21T12:20:35.981 INFO:tasks.workunit.client.1.smithi192.stdout:0/963: creat d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/dc6/d83/dc9/f12c x:0 0 0 2024-09-21T12:20:35.983 INFO:tasks.workunit.client.0.smithi003.stdout:6/314: dwrite d4/d13/d2e/d37/f31 [0,4194304] 0 2024-09-21T12:20:35.984 INFO:tasks.workunit.client.0.smithi003.stdout:6/315: readlink d4/d13/d19/l24 0 2024-09-21T12:20:35.984 INFO:tasks.workunit.client.1.smithi192.stdout:3/835: write db/d16/d18/d33/d3b/f58 [726503,93907] 0 2024-09-21T12:20:35.984 INFO:tasks.workunit.client.1.smithi192.stdout:8/936: dread d14/d1a/f27 [0,4194304] 0 2024-09-21T12:20:35.985 INFO:tasks.workunit.client.1.smithi192.stdout:2/869: sync 2024-09-21T12:20:35.986 INFO:tasks.workunit.client.1.smithi192.stdout:1/892: sync 2024-09-21T12:20:35.986 INFO:tasks.workunit.client.1.smithi192.stdout:7/860: sync 2024-09-21T12:20:35.987 INFO:tasks.workunit.client.1.smithi192.stdout:2/870: write d1b/d1e/d62/f7f [1645934,12788] 0 2024-09-21T12:20:35.988 INFO:tasks.workunit.client.1.smithi192.stdout:7/861: write d6/d9/d70/d77/d100/d113/f116 [336591,90455] 0 2024-09-21T12:20:35.990 INFO:tasks.workunit.client.1.smithi192.stdout:0/964: rename d3/d5/d28/d39/d50/dd9/d7a/dbe/f9f to d3/d5/d28/d39/d50/f12d 0 2024-09-21T12:20:35.991 INFO:tasks.workunit.client.0.smithi003.stdout:3/264: write d0/d5/da/f3f [4218226,51538] 0 2024-09-21T12:20:35.992 INFO:tasks.workunit.client.1.smithi192.stdout:0/965: write d3/d5/d28/d39/d50/dd9/d7a/dbe/d92/f12b [149321,25625] 0 2024-09-21T12:20:35.993 INFO:tasks.workunit.client.1.smithi192.stdout:0/966: chown d3/d5/d69/db2 49061652 1 2024-09-21T12:20:35.995 INFO:tasks.workunit.client.0.smithi003.stdout:1/307: unlink d4/d11/d14/f64 0 2024-09-21T12:20:35.995 INFO:tasks.workunit.client.0.smithi003.stdout:5/371: dwrite dc/f10 [0,4194304] 0 2024-09-21T12:20:35.996 INFO:tasks.workunit.client.0.smithi003.stdout:1/308: read - d4/f5e zero size 2024-09-21T12:20:36.004 INFO:tasks.workunit.client.1.smithi192.stdout:2/871: mknod d1b/d38/d53/d8b/da7/c11d 0 2024-09-21T12:20:36.005 INFO:tasks.workunit.client.0.smithi003.stdout:5/372: dwrite dc/d15/d21/f5d [0,4194304] 0 2024-09-21T12:20:36.006 INFO:tasks.workunit.client.1.smithi192.stdout:2/872: chown d1b/d1e/d5e/d88/d95/dbe/dd0/ddd/cec 34044608 1 2024-09-21T12:20:36.007 INFO:tasks.workunit.client.0.smithi003.stdout:7/288: link d8/db/d13/f1e d8/d31/f6e 0 2024-09-21T12:20:36.010 INFO:tasks.workunit.client.1.smithi192.stdout:0/967: dread d3/f78 [0,4194304] 0 2024-09-21T12:20:36.011 INFO:tasks.workunit.client.0.smithi003.stdout:7/289: dread d8/db/f2b [0,4194304] 0 2024-09-21T12:20:36.013 INFO:tasks.workunit.client.1.smithi192.stdout:0/968: write d3/d5/d28/d39/d50/dd9/d7a/dbe/d92/d51/f32 [142690,118422] 0 2024-09-21T12:20:36.013 INFO:tasks.workunit.client.1.smithi192.stdout:4/854: getdents d2/db/d3e 0 2024-09-21T12:20:36.016 INFO:tasks.workunit.client.1.smithi192.stdout:1/893: dwrite d2/d12/fa5 [0,4194304] 0 2024-09-21T12:20:36.016 INFO:tasks.workunit.client.0.smithi003.stdout:3/265: dread d0/d5/da/d28/f29 [0,4194304] 0 2024-09-21T12:20:36.020 INFO:tasks.workunit.client.1.smithi192.stdout:7/862: getdents d6/d20/dcc/d10e 0 2024-09-21T12:20:36.021 INFO:tasks.workunit.client.0.smithi003.stdout:1/309: readlink d4/d11/l15 0 2024-09-21T12:20:36.023 INFO:tasks.workunit.client.0.smithi003.stdout:1/310: dread - d4/d11/d14/f62 zero size 2024-09-21T12:20:36.024 INFO:tasks.workunit.client.1.smithi192.stdout:3/836: truncate db/d16/d18/d33/d4a/de4/f114 39394 0 2024-09-21T12:20:36.025 INFO:tasks.workunit.client.0.smithi003.stdout:1/311: write d4/d11/d14/d25/d42/d63/f6b [864087,100454] 0 2024-09-21T12:20:36.026 INFO:tasks.workunit.client.0.smithi003.stdout:0/315: rename d9/d12/d1e/d2b to d9/d6c 0 2024-09-21T12:20:36.027 INFO:tasks.workunit.client.1.smithi192.stdout:4/855: truncate d2/d36/d55/d89/dc8/f116 1063671 0 2024-09-21T12:20:36.027 INFO:tasks.workunit.client.0.smithi003.stdout:2/291: creat d0/d21/d2f/d50/f69 x:0 0 0 2024-09-21T12:20:36.028 INFO:tasks.workunit.client.1.smithi192.stdout:4/856: stat d2/d36/d55/d89 0 2024-09-21T12:20:36.029 INFO:tasks.workunit.client.0.smithi003.stdout:5/373: creat dc/d15/d21/d28/d41/d5b/d74/f7b x:0 0 0 2024-09-21T12:20:36.030 INFO:tasks.workunit.client.1.smithi192.stdout:1/894: creat d2/d12/d2f/d51/d24/d65/dd4/f125 x:0 0 0 2024-09-21T12:20:36.031 INFO:tasks.workunit.client.1.smithi192.stdout:2/873: creat d1b/d1e/d10d/f11e x:0 0 0 2024-09-21T12:20:36.031 INFO:tasks.workunit.client.0.smithi003.stdout:8/299: getdents d7/de/d11 0 2024-09-21T12:20:36.031 INFO:tasks.workunit.client.1.smithi192.stdout:7/863: symlink d6/d9/d1f/d3e/d7a/d8a/da2/l129 0 2024-09-21T12:20:36.032 INFO:tasks.workunit.client.0.smithi003.stdout:7/290: creat d8/db/d32/f6f x:0 0 0 2024-09-21T12:20:36.033 INFO:tasks.workunit.client.1.smithi192.stdout:3/837: readlink db/lc 0 2024-09-21T12:20:36.034 INFO:tasks.workunit.client.0.smithi003.stdout:6/316: mknod d4/d13/d5b/c66 0 2024-09-21T12:20:36.035 INFO:tasks.workunit.client.1.smithi192.stdout:0/969: getdents d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/d11d 0 2024-09-21T12:20:36.035 INFO:tasks.workunit.client.0.smithi003.stdout:6/317: write d4/fe [4876560,55520] 0 2024-09-21T12:20:36.036 INFO:tasks.workunit.client.0.smithi003.stdout:6/318: stat d4/d11/d1d/c3e 0 2024-09-21T12:20:36.038 INFO:tasks.workunit.client.1.smithi192.stdout:4/857: creat d2/d36/d55/d89/dc8/df7/d83/d101/f123 x:0 0 0 2024-09-21T12:20:36.039 INFO:tasks.workunit.client.1.smithi192.stdout:4/858: chown d2/f66 25324 1 2024-09-21T12:20:36.039 INFO:tasks.workunit.client.1.smithi192.stdout:1/895: rmdir d2/d82 39 2024-09-21T12:20:36.041 INFO:tasks.workunit.client.0.smithi003.stdout:9/409: rename d2/d20/d22/f78 to d2/da/d2a/d89/f95 0 2024-09-21T12:20:36.043 INFO:tasks.workunit.client.0.smithi003.stdout:6/319: dread d4/f21 [0,4194304] 0 2024-09-21T12:20:36.045 INFO:tasks.workunit.client.1.smithi192.stdout:3/838: creat db/d16/d18/d33/d4a/de4/f12f x:0 0 0 2024-09-21T12:20:36.046 INFO:tasks.workunit.client.1.smithi192.stdout:3/839: readlink db/d16/d18/d40/la9 0 2024-09-21T12:20:36.049 INFO:tasks.workunit.client.1.smithi192.stdout:7/864: dread d6/d20/d69/d90/da7/dc1/f102 [0,4194304] 0 2024-09-21T12:20:36.051 INFO:tasks.workunit.client.0.smithi003.stdout:8/300: creat d7/de/d11/f67 x:0 0 0 2024-09-21T12:20:36.056 INFO:tasks.workunit.client.0.smithi003.stdout:3/266: truncate d0/d5/da/d28/dd/f2e 1265379 0 2024-09-21T12:20:36.056 INFO:tasks.workunit.client.1.smithi192.stdout:7/865: dwrite d6/d9/d70/d77/dcd/fc3 [0,4194304] 0 2024-09-21T12:20:36.060 INFO:tasks.workunit.client.1.smithi192.stdout:1/896: unlink d2/da/f32 0 2024-09-21T12:20:36.062 INFO:tasks.workunit.client.1.smithi192.stdout:1/897: truncate d2/d12/d2f/fc2 4549361 0 2024-09-21T12:20:36.062 INFO:tasks.workunit.client.0.smithi003.stdout:1/312: rename d4/df/d19/c44 to d4/df/c70 0 2024-09-21T12:20:36.065 INFO:tasks.workunit.client.1.smithi192.stdout:0/970: write d3/d5/d28/d39/d50/dd9/d7a/dbe/d92/f58 [4122656,1800] 0 2024-09-21T12:20:36.066 INFO:tasks.workunit.client.0.smithi003.stdout:6/320: rmdir d4/d11/d32 39 2024-09-21T12:20:36.070 INFO:tasks.workunit.client.1.smithi192.stdout:7/866: symlink d6/d9/d1f/d99/l12a 0 2024-09-21T12:20:36.072 INFO:tasks.workunit.client.0.smithi003.stdout:8/301: creat d7/de/d1a/f68 x:0 0 0 2024-09-21T12:20:36.073 INFO:tasks.workunit.client.0.smithi003.stdout:8/302: write d7/de/f3b [479240,34551] 0 2024-09-21T12:20:36.078 INFO:tasks.workunit.client.0.smithi003.stdout:2/292: rename d0/dd/d16 to d0/d1c/d6a 0 2024-09-21T12:20:36.078 INFO:tasks.workunit.client.1.smithi192.stdout:3/840: truncate db/d16/d18/f3e 5756644 0 2024-09-21T12:20:36.079 INFO:tasks.workunit.client.1.smithi192.stdout:7/867: fsync d6/d9/d1f/d3e/d7a/faf 0 2024-09-21T12:20:36.080 INFO:tasks.workunit.client.0.smithi003.stdout:1/313: mknod d4/d11/d14/d25/d42/d63/c71 0 2024-09-21T12:20:36.081 INFO:tasks.workunit.client.1.smithi192.stdout:1/898: creat d2/d10d/d117/f126 x:0 0 0 2024-09-21T12:20:36.082 INFO:tasks.workunit.client.1.smithi192.stdout:7/868: write d6/d3a/dba/f118 [485254,25531] 0 2024-09-21T12:20:36.082 INFO:tasks.workunit.client.1.smithi192.stdout:4/859: dwrite d2/d36/d7f/df5/d4f/d71/d9d/dad/d9c/fab [0,4194304] 0 2024-09-21T12:20:36.083 INFO:tasks.workunit.client.0.smithi003.stdout:0/316: creat d9/d12/d17/f6d x:0 0 0 2024-09-21T12:20:36.085 INFO:tasks.workunit.client.0.smithi003.stdout:5/374: dwrite dc/d15/d21/d30/f34 [0,4194304] 0 2024-09-21T12:20:36.093 INFO:tasks.workunit.client.0.smithi003.stdout:5/375: dread dc/d15/d21/d30/f55 [0,4194304] 0 2024-09-21T12:20:36.098 INFO:tasks.workunit.client.0.smithi003.stdout:3/267: mkdir d0/d5/da/d28/d11/d49/d4c 0 2024-09-21T12:20:36.098 INFO:tasks.workunit.client.0.smithi003.stdout:3/268: dread - d0/d5/f46 zero size 2024-09-21T12:20:36.099 INFO:tasks.workunit.client.1.smithi192.stdout:4/860: creat d2/d36/d7f/df5/d4f/d71/d9d/dad/d9c/d9e/f124 x:0 0 0 2024-09-21T12:20:36.101 INFO:tasks.workunit.client.0.smithi003.stdout:2/293: write d0/dd/d22/d37/d3f/f67 [4374128,33177] 0 2024-09-21T12:20:36.102 INFO:tasks.workunit.client.0.smithi003.stdout:2/294: write d0/dd/d22/d37/f5c [703628,97658] 0 2024-09-21T12:20:36.103 INFO:tasks.workunit.client.1.smithi192.stdout:7/869: unlink f0 0 2024-09-21T12:20:36.104 INFO:tasks.workunit.client.0.smithi003.stdout:0/317: creat d9/d6c/d32/f6e x:0 0 0 2024-09-21T12:20:36.105 INFO:tasks.workunit.client.1.smithi192.stdout:1/899: creat d2/d12/d2f/d51/d24/d107/f127 x:0 0 0 2024-09-21T12:20:36.109 INFO:tasks.workunit.client.0.smithi003.stdout:6/321: creat d4/d13/d19/d62/f67 x:0 0 0 2024-09-21T12:20:36.112 INFO:tasks.workunit.client.1.smithi192.stdout:1/900: dwrite d2/d12/d2f/d51/d24/f113 [0,4194304] 0 2024-09-21T12:20:36.113 INFO:tasks.workunit.client.1.smithi192.stdout:1/901: write d2/d12/fe4 [266930,3508] 0 2024-09-21T12:20:36.115 INFO:tasks.workunit.client.0.smithi003.stdout:3/269: read d0/d5/da/d28/dd/f2d [901520,53068] 0 2024-09-21T12:20:36.115 INFO:tasks.workunit.client.1.smithi192.stdout:3/841: write db/d16/d18/d33/fbc [125518,125342] 0 2024-09-21T12:20:36.116 INFO:tasks.workunit.client.0.smithi003.stdout:6/322: dwrite d4/d13/f20 [0,4194304] 0 2024-09-21T12:20:36.119 INFO:tasks.workunit.client.0.smithi003.stdout:7/291: rename d8/db/l54 to d8/db/d13/l70 0 2024-09-21T12:20:36.119 INFO:tasks.workunit.client.1.smithi192.stdout:3/842: truncate db/d16/d18/d40/d60/fce 1054809 0 2024-09-21T12:20:36.122 INFO:tasks.workunit.client.1.smithi192.stdout:3/843: chown db/d16/d18/da7/d10e/f116 146 1 2024-09-21T12:20:36.122 INFO:tasks.workunit.client.1.smithi192.stdout:4/861: dread d2/db/d3e/fcd [0,4194304] 0 2024-09-21T12:20:36.122 INFO:tasks.workunit.client.0.smithi003.stdout:6/323: write d4/d13/d19/d62/f67 [17326,82045] 0 2024-09-21T12:20:36.123 INFO:tasks.workunit.client.0.smithi003.stdout:6/324: truncate d4/d13/d19/f26 4632750 0 2024-09-21T12:20:36.123 INFO:tasks.workunit.client.0.smithi003.stdout:2/295: creat d0/d21/f6b x:0 0 0 2024-09-21T12:20:36.123 INFO:tasks.workunit.client.0.smithi003.stdout:6/325: chown d4/d11/d1d 27432 1 2024-09-21T12:20:36.125 INFO:tasks.workunit.client.0.smithi003.stdout:2/296: write d0/f36 [1494756,13598] 0 2024-09-21T12:20:36.128 INFO:tasks.workunit.client.0.smithi003.stdout:0/318: creat d9/d6c/d26/d54/f6f x:0 0 0 2024-09-21T12:20:36.129 INFO:tasks.workunit.client.1.smithi192.stdout:7/870: rmdir d6/d9/d2d/dd0 0 2024-09-21T12:20:36.132 INFO:tasks.workunit.client.1.smithi192.stdout:1/902: mknod d2/d12/c128 0 2024-09-21T12:20:36.132 INFO:tasks.workunit.client.1.smithi192.stdout:1/903: readlink d2/dae/lb9 0 2024-09-21T12:20:36.133 INFO:tasks.workunit.client.1.smithi192.stdout:4/862: symlink d2/db/d34/l125 0 2024-09-21T12:20:36.134 INFO:tasks.workunit.client.1.smithi192.stdout:1/904: truncate d2/d12/d2f/d51/d24/d65/d8e/d9d/ff8 401103 0 2024-09-21T12:20:36.136 INFO:tasks.workunit.client.0.smithi003.stdout:8/303: rename d7/de/d11/c30 to d7/df/d20/d54/c69 0 2024-09-21T12:20:36.137 INFO:tasks.workunit.client.0.smithi003.stdout:7/292: symlink d8/d3c/d57/l71 0 2024-09-21T12:20:36.142 INFO:tasks.workunit.client.0.smithi003.stdout:2/297: mkdir d0/d21/d2c/d6c 0 2024-09-21T12:20:36.146 INFO:tasks.workunit.client.1.smithi192.stdout:7/871: symlink d6/d3a/l12b 0 2024-09-21T12:20:36.147 INFO:tasks.workunit.client.1.smithi192.stdout:1/905: symlink d2/d12/d2f/d51/d24/d65/l129 0 2024-09-21T12:20:36.148 INFO:tasks.workunit.client.0.smithi003.stdout:3/270: rename d0/d5/c13 to d0/d5/da/d28/dd/d23/d26/d3d/c4d 0 2024-09-21T12:20:36.151 INFO:tasks.workunit.client.0.smithi003.stdout:8/304: dread d7/df/f26 [0,4194304] 0 2024-09-21T12:20:36.153 INFO:tasks.workunit.client.0.smithi003.stdout:3/271: dread d0/d5/da/d28/d31/f3b [0,4194304] 0 2024-09-21T12:20:36.154 INFO:tasks.workunit.client.1.smithi192.stdout:8/937: sync 2024-09-21T12:20:36.155 INFO:tasks.workunit.client.0.smithi003.stdout:7/293: creat d8/d3c/d57/f72 x:0 0 0 2024-09-21T12:20:36.155 INFO:tasks.workunit.client.1.smithi192.stdout:3/844: truncate db/d16/dc1/def/d111/f113 2135419 0 2024-09-21T12:20:36.156 INFO:tasks.workunit.client.1.smithi192.stdout:3/845: chown db/d16/d18/da7/d10e/d2e/db8/dd0/df0/f106 733502 1 2024-09-21T12:20:36.157 INFO:tasks.workunit.client.0.smithi003.stdout:2/298: creat d0/dd/d22/f6d x:0 0 0 2024-09-21T12:20:36.159 INFO:tasks.workunit.client.0.smithi003.stdout:0/319: mknod d9/d12/d17/d38/d3a/d46/d55/d57/c70 0 2024-09-21T12:20:36.159 INFO:tasks.workunit.client.0.smithi003.stdout:0/320: dread - d9/d12/d1e/f61 zero size 2024-09-21T12:20:36.161 INFO:tasks.workunit.client.1.smithi192.stdout:8/938: rename d14/d1a/d1d/d48/lfc to d14/d18/d94/dc3/l138 0 2024-09-21T12:20:36.162 INFO:tasks.workunit.client.0.smithi003.stdout:5/376: link dc/d15/d21/d28/d3c/c75 dc/d15/d21/d28/d3c/c7c 0 2024-09-21T12:20:36.162 INFO:tasks.workunit.client.1.smithi192.stdout:8/939: dread - d14/d1a/d1d/d20/f128 zero size 2024-09-21T12:20:36.163 INFO:tasks.workunit.client.1.smithi192.stdout:3/846: truncate db/d16/db4/d8c/f8d 2195584 0 2024-09-21T12:20:36.164 INFO:tasks.workunit.client.1.smithi192.stdout:8/940: stat d14/d1a/d1d/d20/l26 0 2024-09-21T12:20:36.165 INFO:tasks.workunit.client.0.smithi003.stdout:8/305: unlink l5 0 2024-09-21T12:20:36.167 INFO:tasks.workunit.client.1.smithi192.stdout:1/906: dwrite d2/d12/f63 [0,4194304] 0 2024-09-21T12:20:36.170 INFO:tasks.workunit.client.1.smithi192.stdout:8/941: unlink f7 0 2024-09-21T12:20:36.171 INFO:tasks.workunit.client.0.smithi003.stdout:0/321: symlink d9/d6c/l71 0 2024-09-21T12:20:36.172 INFO:tasks.workunit.client.0.smithi003.stdout:4/256: sync 2024-09-21T12:20:36.173 INFO:tasks.workunit.client.0.smithi003.stdout:0/322: stat d9/d12/d17/d38/d3a/d46/d55 0 2024-09-21T12:20:36.175 INFO:tasks.workunit.client.0.smithi003.stdout:0/323: write d9/d6c/d26/d54/f6f [1026443,130212] 0 2024-09-21T12:20:36.175 INFO:tasks.workunit.client.1.smithi192.stdout:3/847: unlink db/d16/d18/d40/l97 0 2024-09-21T12:20:36.176 INFO:tasks.workunit.client.0.smithi003.stdout:5/377: write dc/d15/d1c/f29 [5107197,87888] 0 2024-09-21T12:20:36.180 INFO:tasks.workunit.client.1.smithi192.stdout:7/872: dwrite d6/d9/d1f/f21 [0,4194304] 0 2024-09-21T12:20:36.182 INFO:tasks.workunit.client.1.smithi192.stdout:7/873: stat d6/d9/d70/d77/dcd/deb 0 2024-09-21T12:20:36.182 INFO:tasks.workunit.client.0.smithi003.stdout:3/272: mknod d0/d5/c4e 0 2024-09-21T12:20:36.183 INFO:tasks.workunit.client.1.smithi192.stdout:8/942: fdatasync d14/d1a/f96 0 2024-09-21T12:20:36.185 INFO:tasks.workunit.client.0.smithi003.stdout:7/294: link d8/db/d13/f44 d8/d3c/d57/f73 0 2024-09-21T12:20:36.187 INFO:tasks.workunit.client.0.smithi003.stdout:4/257: chown d9/da/c21 53860204 1 2024-09-21T12:20:36.190 INFO:tasks.workunit.client.0.smithi003.stdout:0/324: creat d9/d12/d17/d38/d3a/f72 x:0 0 0 2024-09-21T12:20:36.195 INFO:tasks.workunit.client.0.smithi003.stdout:4/258: dwrite d9/d16/f26 [0,4194304] 0 2024-09-21T12:20:36.197 INFO:tasks.workunit.client.0.smithi003.stdout:5/378: creat dc/d15/d21/d28/d41/f7d x:0 0 0 2024-09-21T12:20:36.198 INFO:tasks.workunit.client.0.smithi003.stdout:5/379: chown dc/d15/d26/f2e 7206 1 2024-09-21T12:20:36.199 INFO:tasks.workunit.client.0.smithi003.stdout:6/326: rename d4/d13/d5b/c66 to d4/c68 0 2024-09-21T12:20:36.200 INFO:tasks.workunit.client.0.smithi003.stdout:6/327: dread - d4/d9/f45 zero size 2024-09-21T12:20:36.200 INFO:tasks.workunit.client.1.smithi192.stdout:3/848: write db/d16/dc1/ff9 [1100789,27001] 0 2024-09-21T12:20:36.202 INFO:tasks.workunit.client.1.smithi192.stdout:7/874: dread d6/d9/d1f/f72 [0,4194304] 0 2024-09-21T12:20:36.203 INFO:tasks.workunit.client.1.smithi192.stdout:7/875: chown d6/d9/d2d/d7b/fce 10 1 2024-09-21T12:20:36.204 INFO:tasks.workunit.client.0.smithi003.stdout:5/380: dread dc/d15/d21/d30/f33 [0,4194304] 0 2024-09-21T12:20:36.205 INFO:tasks.workunit.client.0.smithi003.stdout:0/325: unlink d9/d12/f16 0 2024-09-21T12:20:36.206 INFO:tasks.workunit.client.0.smithi003.stdout:0/326: chown d9/d12/d1e/d5f 218579 1 2024-09-21T12:20:36.206 INFO:tasks.workunit.client.1.smithi192.stdout:8/943: creat d14/d18/f139 x:0 0 0 2024-09-21T12:20:36.213 INFO:tasks.workunit.client.0.smithi003.stdout:3/273: link d0/f27 d0/d5/da/d28/dd/d23/f4f 0 2024-09-21T12:20:36.213 INFO:tasks.workunit.client.1.smithi192.stdout:8/944: rmdir d14/d1a/d1d/d20/d5f 39 2024-09-21T12:20:36.216 INFO:tasks.workunit.client.1.smithi192.stdout:7/876: read d6/d9/d1f/d3e/d7a/d8a/da2/fa5 [878463,47649] 0 2024-09-21T12:20:36.219 INFO:tasks.workunit.client.0.smithi003.stdout:7/295: link d8/db/d32/f6f d8/d31/f74 0 2024-09-21T12:20:36.221 INFO:tasks.workunit.client.0.smithi003.stdout:7/296: write d8/d31/f5f [321389,62414] 0 2024-09-21T12:20:36.222 INFO:tasks.workunit.client.1.smithi192.stdout:7/877: creat d6/d9/d70/d77/d100/f12c x:0 0 0 2024-09-21T12:20:36.223 INFO:tasks.workunit.client.1.smithi192.stdout:3/849: dread db/f22 [4194304,4194304] 0 2024-09-21T12:20:36.225 INFO:tasks.workunit.client.1.smithi192.stdout:8/945: dread d14/d18/d94/da4/f124 [0,4194304] 0 2024-09-21T12:20:36.225 INFO:tasks.workunit.client.0.smithi003.stdout:2/299: rename d0/l15 to d0/d1c/d6a/l6e 0 2024-09-21T12:20:36.225 INFO:tasks.workunit.client.0.smithi003.stdout:3/274: fdatasync d0/d5/da/d28/d31/f32 0 2024-09-21T12:20:36.226 INFO:tasks.workunit.client.1.smithi192.stdout:7/878: mknod d6/d9/d70/d77/dcd/deb/c12d 0 2024-09-21T12:20:36.228 INFO:tasks.workunit.client.0.smithi003.stdout:0/327: dread d9/d6c/d26/f39 [0,4194304] 0 2024-09-21T12:20:36.228 INFO:tasks.workunit.client.0.smithi003.stdout:6/328: creat d4/d13/d2e/d37/d64/f69 x:0 0 0 2024-09-21T12:20:36.231 INFO:tasks.workunit.client.1.smithi192.stdout:8/946: fdatasync d14/d18/f33 0 2024-09-21T12:20:36.232 INFO:tasks.workunit.client.1.smithi192.stdout:8/947: dread - d14/d1a/d1d/d20/f128 zero size 2024-09-21T12:20:36.233 INFO:tasks.workunit.client.1.smithi192.stdout:8/948: chown d14/d1a/d1d/d46/d4e/d83/d8d/d9c/dee/fa2 969 1 2024-09-21T12:20:36.237 INFO:tasks.workunit.client.0.smithi003.stdout:7/297: mkdir d8/db/d13/d75 0 2024-09-21T12:20:36.238 INFO:tasks.workunit.client.0.smithi003.stdout:7/298: read d8/d2c/f37 [3984056,126435] 0 2024-09-21T12:20:36.241 INFO:tasks.workunit.client.1.smithi192.stdout:8/949: rename fd to d14/d1a/d1d/d46/d4e/d83/d8d/d99/f13a 0 2024-09-21T12:20:36.242 INFO:tasks.workunit.client.1.smithi192.stdout:7/879: dread d6/fde [0,4194304] 0 2024-09-21T12:20:36.243 INFO:tasks.workunit.client.1.smithi192.stdout:7/880: chown d6/d9/d51/c89 891 1 2024-09-21T12:20:36.243 INFO:tasks.workunit.client.0.smithi003.stdout:5/381: write dc/d15/d21/f24 [3375507,4576] 0 2024-09-21T12:20:36.244 INFO:tasks.workunit.client.0.smithi003.stdout:3/275: creat d0/d5/d38/f50 x:0 0 0 2024-09-21T12:20:36.246 INFO:tasks.workunit.client.0.smithi003.stdout:3/276: stat d0/d5/da/d28/dd/f2d 0 2024-09-21T12:20:36.246 INFO:tasks.workunit.client.1.smithi192.stdout:3/850: write db/d16/d18/d33/f83 [2565326,75883] 0 2024-09-21T12:20:36.248 INFO:tasks.workunit.client.1.smithi192.stdout:3/851: write db/d16/d18/d40/f51 [225682,98910] 0 2024-09-21T12:20:36.248 INFO:tasks.workunit.client.0.smithi003.stdout:6/329: mknod d4/d13/d2e/d37/c6a 0 2024-09-21T12:20:36.249 INFO:tasks.workunit.client.0.smithi003.stdout:6/330: chown f3 243 1 2024-09-21T12:20:36.254 INFO:tasks.workunit.client.0.smithi003.stdout:7/299: rmdir d8/d31 39 2024-09-21T12:20:36.256 INFO:tasks.workunit.client.0.smithi003.stdout:4/259: link d9/da/l11 d9/d16/l54 0 2024-09-21T12:20:36.258 INFO:tasks.workunit.client.1.smithi192.stdout:8/950: dwrite d14/d18/daf/f103 [0,4194304] 0 2024-09-21T12:20:36.258 INFO:tasks.workunit.client.1.smithi192.stdout:7/881: rename d6/d20/dc9/cf5 to d6/d9/d1f/d3e/d7a/d8a/c12e 0 2024-09-21T12:20:36.258 INFO:tasks.workunit.client.1.smithi192.stdout:2/874: sync 2024-09-21T12:20:36.259 INFO:tasks.workunit.client.1.smithi192.stdout:0/971: sync 2024-09-21T12:20:36.260 INFO:tasks.workunit.client.1.smithi192.stdout:3/852: symlink db/d16/d18/da7/d10e/l130 0 2024-09-21T12:20:36.261 INFO:tasks.workunit.client.0.smithi003.stdout:2/300: creat d0/d21/d62/f6f x:0 0 0 2024-09-21T12:20:36.263 INFO:tasks.workunit.client.1.smithi192.stdout:0/972: truncate d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/d33/fd4 677328 0 2024-09-21T12:20:36.264 INFO:tasks.workunit.client.0.smithi003.stdout:5/382: symlink dc/d15/d21/d30/l7e 0 2024-09-21T12:20:36.265 INFO:tasks.workunit.client.1.smithi192.stdout:2/875: chown d1b/l34 938282 1 2024-09-21T12:20:36.266 INFO:tasks.workunit.client.1.smithi192.stdout:8/951: mkdir d14/d18/d94/da4/d13b 0 2024-09-21T12:20:36.269 INFO:tasks.workunit.client.0.smithi003.stdout:6/331: fsync d4/d13/d2e/d37/f2d 0 2024-09-21T12:20:36.270 INFO:tasks.workunit.client.1.smithi192.stdout:3/853: dwrite db/d16/d18/da7/d10e/d2e/db8/dd0/f108 [0,4194304] 0 2024-09-21T12:20:36.272 INFO:tasks.workunit.client.1.smithi192.stdout:2/876: stat d1b/d65/f6e 0 2024-09-21T12:20:36.274 INFO:tasks.workunit.client.0.smithi003.stdout:6/332: dread d4/d13/f20 [0,4194304] 0 2024-09-21T12:20:36.275 INFO:tasks.workunit.client.0.smithi003.stdout:4/260: mkdir d9/da/d36/d55 0 2024-09-21T12:20:36.277 INFO:tasks.workunit.client.1.smithi192.stdout:8/952: mkdir d14/d1a/d1d/d48/de2/d13c 0 2024-09-21T12:20:36.279 INFO:tasks.workunit.client.0.smithi003.stdout:2/301: symlink d0/dd/d22/d37/d3f/l70 0 2024-09-21T12:20:36.282 INFO:tasks.workunit.client.0.smithi003.stdout:5/383: stat dc/d15/d1c/c2a 0 2024-09-21T12:20:36.283 INFO:tasks.workunit.client.1.smithi192.stdout:2/877: mknod d1b/d1e/d5e/d88/c11f 0 2024-09-21T12:20:36.286 INFO:tasks.workunit.client.1.smithi192.stdout:8/953: creat d14/d1a/d1d/db4/f13d x:0 0 0 2024-09-21T12:20:36.288 INFO:tasks.workunit.client.0.smithi003.stdout:7/300: dread - d8/d31/f67 zero size 2024-09-21T12:20:36.292 INFO:tasks.workunit.client.1.smithi192.stdout:8/954: creat d14/d1a/d82/f13e x:0 0 0 2024-09-21T12:20:36.293 INFO:tasks.workunit.client.1.smithi192.stdout:3/854: dread db/d16/d18/d21/d23/d71/fdb [0,4194304] 0 2024-09-21T12:20:36.294 INFO:tasks.workunit.client.0.smithi003.stdout:2/302: creat d0/d1c/d6a/f71 x:0 0 0 2024-09-21T12:20:36.294 INFO:tasks.workunit.client.1.smithi192.stdout:0/973: getdents d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/d43/d110 0 2024-09-21T12:20:36.296 INFO:tasks.workunit.client.1.smithi192.stdout:7/882: truncate d6/d20/d69/d90/da7/dc1/f102 1351827 0 2024-09-21T12:20:36.297 INFO:tasks.workunit.client.1.smithi192.stdout:1/907: sync 2024-09-21T12:20:36.297 INFO:tasks.workunit.client.1.smithi192.stdout:4/863: sync 2024-09-21T12:20:36.297 INFO:tasks.workunit.client.0.smithi003.stdout:0/328: getdents d9/d6c/d32 0 2024-09-21T12:20:36.297 INFO:tasks.workunit.client.0.smithi003.stdout:0/329: chown d9/d6c/d32 6233002 1 2024-09-21T12:20:36.298 INFO:tasks.workunit.client.1.smithi192.stdout:4/864: write d2/d36/d55/d89/dc8/df7/d6c/ff0 [852768,2547] 0 2024-09-21T12:20:36.299 INFO:tasks.workunit.client.0.smithi003.stdout:3/277: link d0/d5/da/d28/d11/f44 d0/d5/da/d28/f51 0 2024-09-21T12:20:36.300 INFO:tasks.workunit.client.0.smithi003.stdout:6/333: dread f3 [0,4194304] 0 2024-09-21T12:20:36.300 INFO:tasks.workunit.client.0.smithi003.stdout:3/278: write d0/d5/f1e [2245695,130690] 0 2024-09-21T12:20:36.305 INFO:tasks.workunit.client.0.smithi003.stdout:7/301: dread - d8/db/f58 zero size 2024-09-21T12:20:36.306 INFO:tasks.workunit.client.0.smithi003.stdout:4/261: creat d9/da/d47/d4b/f56 x:0 0 0 2024-09-21T12:20:36.308 INFO:tasks.workunit.client.0.smithi003.stdout:2/303: rename d0/d21/f35 to d0/d21/d2c/f72 0 2024-09-21T12:20:36.311 INFO:tasks.workunit.client.0.smithi003.stdout:2/304: truncate d0/f2 4257982 0 2024-09-21T12:20:36.315 INFO:tasks.workunit.client.1.smithi192.stdout:8/955: dread d14/d1a/d1d/d20/d5f/f68 [0,4194304] 0 2024-09-21T12:20:36.316 INFO:tasks.workunit.client.1.smithi192.stdout:2/878: dwrite d1b/d1e/d5e/d88/d95/fb8 [0,4194304] 0 2024-09-21T12:20:36.317 INFO:tasks.workunit.client.0.smithi003.stdout:3/279: mknod d0/d5/da/d28/dd/d23/d26/c52 0 2024-09-21T12:20:36.318 INFO:tasks.workunit.client.0.smithi003.stdout:4/262: dwrite d9/da/fd [0,4194304] 0 2024-09-21T12:20:36.322 INFO:tasks.workunit.client.1.smithi192.stdout:4/865: dwrite d2/db/f26 [0,4194304] 0 2024-09-21T12:20:36.323 INFO:tasks.workunit.client.0.smithi003.stdout:0/330: rename d9/f3b to d9/d6c/d26/f73 0 2024-09-21T12:20:36.326 INFO:tasks.workunit.client.1.smithi192.stdout:3/855: link db/d16/d18/d33/d3b/db1/df1/fb7 db/d16/d18/d40/dd1/d127/f131 0 2024-09-21T12:20:36.333 INFO:tasks.workunit.client.1.smithi192.stdout:0/974: creat d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/f12e x:0 0 0 2024-09-21T12:20:36.334 INFO:tasks.workunit.client.0.smithi003.stdout:6/334: getdents d4/d13/d56 0 2024-09-21T12:20:36.336 INFO:tasks.workunit.client.0.smithi003.stdout:2/305: creat d0/dd/d22/d37/f73 x:0 0 0 2024-09-21T12:20:36.336 INFO:tasks.workunit.client.1.smithi192.stdout:0/975: write d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/d33/f113 [803779,87709] 0 2024-09-21T12:20:36.337 INFO:tasks.workunit.client.0.smithi003.stdout:2/306: chown d0/dd/d22/d37/f5c 245 1 2024-09-21T12:20:36.338 INFO:tasks.workunit.client.1.smithi192.stdout:0/976: dread - d3/d5/d28/d39/ff9 zero size 2024-09-21T12:20:36.339 INFO:tasks.workunit.client.1.smithi192.stdout:1/908: dwrite d2/d12/d2f/d41/d5c/f110 [0,4194304] 0 2024-09-21T12:20:36.340 INFO:tasks.workunit.client.0.smithi003.stdout:6/335: creat d4/d13/d2e/d37/f6b x:0 0 0 2024-09-21T12:20:36.340 INFO:tasks.workunit.client.1.smithi192.stdout:4/866: dread - d2/d36/d7f/fd6 zero size 2024-09-21T12:20:36.341 INFO:tasks.workunit.client.1.smithi192.stdout:0/977: dread d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/d43/f95 [0,4194304] 0 2024-09-21T12:20:36.342 INFO:tasks.workunit.client.1.smithi192.stdout:3/856: rename db/d16/d18/fbf to db/d16/d18/d33/d4a/de4/f132 0 2024-09-21T12:20:36.342 INFO:tasks.workunit.client.1.smithi192.stdout:4/867: write d2/d36/d55/d89/dc8/df7/d83/d101/f123 [650766,130432] 0 2024-09-21T12:20:36.344 INFO:tasks.workunit.client.0.smithi003.stdout:0/331: link d9/d12/d17/d21/f40 d9/d12/d17/d38/d3a/d46/d55/d67/f74 0 2024-09-21T12:20:36.348 INFO:tasks.workunit.client.1.smithi192.stdout:3/857: dwrite db/d16/d18/da7/ff6 [0,4194304] 0 2024-09-21T12:20:36.349 INFO:tasks.workunit.client.1.smithi192.stdout:3/858: chown db/d16/d18/d33 1069427 1 2024-09-21T12:20:36.349 INFO:tasks.workunit.client.0.smithi003.stdout:2/307: dread d0/f25 [0,4194304] 0 2024-09-21T12:20:36.349 INFO:tasks.workunit.client.0.smithi003.stdout:4/263: rename d9/d16/f26 to d9/da/f57 0 2024-09-21T12:20:36.355 INFO:tasks.workunit.client.0.smithi003.stdout:2/308: chown d0/d21/d2f/d50/f69 322 1 2024-09-21T12:20:36.356 INFO:tasks.workunit.client.0.smithi003.stdout:4/264: write d9/da/f27 [379061,84333] 0 2024-09-21T12:20:36.357 INFO:tasks.workunit.client.0.smithi003.stdout:6/336: symlink d4/d13/d2e/d37/d64/l6c 0 2024-09-21T12:20:36.357 INFO:tasks.workunit.client.0.smithi003.stdout:3/280: rename d0/d5/da/d28/d31/f3b to d0/d5/da/d28/dd/d23/d26/d3d/f53 0 2024-09-21T12:20:36.358 INFO:tasks.workunit.client.1.smithi192.stdout:4/868: mkdir d2/d36/d7f/df5/d4f/d71/d9d/dad/d9c/d126 0 2024-09-21T12:20:36.360 INFO:tasks.workunit.client.0.smithi003.stdout:2/309: readlink d0/dd/d22/l5d 0 2024-09-21T12:20:36.361 INFO:tasks.workunit.client.0.smithi003.stdout:2/310: read d0/dd/d22/d37/f5c [322438,44585] 0 2024-09-21T12:20:36.362 INFO:tasks.workunit.client.0.smithi003.stdout:6/337: readlink d4/d11/d17/l1c 0 2024-09-21T12:20:36.362 INFO:tasks.workunit.client.1.smithi192.stdout:8/956: link l13 d14/d1a/d1d/d46/d4e/d83/l13f 0 2024-09-21T12:20:36.363 INFO:tasks.workunit.client.0.smithi003.stdout:2/311: chown d0/dd/f56 806288 1 2024-09-21T12:20:36.365 INFO:tasks.workunit.client.0.smithi003.stdout:0/332: rename d9/d6c/d26/d54/c58 to d9/d12/d17/d38/d3a/c75 0 2024-09-21T12:20:36.366 INFO:tasks.workunit.client.0.smithi003.stdout:4/265: fdatasync d9/f24 0 2024-09-21T12:20:36.366 INFO:tasks.workunit.client.1.smithi192.stdout:1/909: rename d2/d82 to d2/d12/d2f/d41/d5c/d101/d12a 0 2024-09-21T12:20:36.367 INFO:tasks.workunit.client.0.smithi003.stdout:4/266: truncate d9/da/d36/f3f 654914 0 2024-09-21T12:20:36.370 INFO:tasks.workunit.client.1.smithi192.stdout:4/869: mknod d2/db/da4/c127 0 2024-09-21T12:20:36.372 INFO:tasks.workunit.client.0.smithi003.stdout:4/267: dread d9/f1a [0,4194304] 0 2024-09-21T12:20:36.372 INFO:tasks.workunit.client.1.smithi192.stdout:1/910: dwrite d2/d12/d2f/d51/d24/d65/d8e/d9d/db6/fdc [0,4194304] 0 2024-09-21T12:20:36.374 INFO:tasks.workunit.client.1.smithi192.stdout:1/911: write d2/d12/d2f/d51/d24/d65/d8b/f10c [521310,14038] 0 2024-09-21T12:20:36.375 INFO:tasks.workunit.client.0.smithi003.stdout:6/338: symlink d4/d13/d2e/d37/d64/l6d 0 2024-09-21T12:20:36.379 INFO:tasks.workunit.client.0.smithi003.stdout:2/312: read d0/fc [4240720,107559] 0 2024-09-21T12:20:36.379 INFO:tasks.workunit.client.1.smithi192.stdout:3/859: mknod db/d16/d18/da7/d10e/c133 0 2024-09-21T12:20:36.379 INFO:tasks.workunit.client.1.smithi192.stdout:2/879: write d1b/d1e/d3d/f4b [6352208,55805] 0 2024-09-21T12:20:36.381 INFO:tasks.workunit.client.0.smithi003.stdout:2/313: readlink d0/d1c/d6a/l40 0 2024-09-21T12:20:36.381 INFO:tasks.workunit.client.1.smithi192.stdout:3/860: write db/d16/d18/da7/d10e/d2e/db8/dd0/df0/ff2 [4105717,24341] 0 2024-09-21T12:20:36.382 INFO:tasks.workunit.client.1.smithi192.stdout:3/861: write db/d16/d18/da7/d10e/f79 [5042392,18771] 0 2024-09-21T12:20:36.384 INFO:tasks.workunit.client.0.smithi003.stdout:0/333: write d9/d12/d17/d21/d30/f68 [1770105,32888] 0 2024-09-21T12:20:36.384 INFO:tasks.workunit.client.0.smithi003.stdout:0/334: dread - d9/d12/d17/d38/d3a/f72 zero size 2024-09-21T12:20:36.394 INFO:tasks.workunit.client.0.smithi003.stdout:4/268: creat d9/d48/f58 x:0 0 0 2024-09-21T12:20:36.396 INFO:tasks.workunit.client.1.smithi192.stdout:2/880: mknod d1b/d38/d53/d8b/da0/c120 0 2024-09-21T12:20:36.397 INFO:tasks.workunit.client.1.smithi192.stdout:2/881: write d1b/d1e/d5e/d75/d8d/fb1 [644076,125956] 0 2024-09-21T12:20:36.398 INFO:tasks.workunit.client.1.smithi192.stdout:0/978: truncate d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/d33/fd4 251950 0 2024-09-21T12:20:36.400 INFO:tasks.workunit.client.1.smithi192.stdout:0/979: chown d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/dc6/d83/lab 4938347 1 2024-09-21T12:20:36.401 INFO:tasks.workunit.client.0.smithi003.stdout:3/281: dwrite d0/d5/da/d28/dd/f2e [0,4194304] 0 2024-09-21T12:20:36.402 INFO:tasks.workunit.client.1.smithi192.stdout:8/957: write d14/d18/daf/ddd/fe3 [594187,92360] 0 2024-09-21T12:20:36.406 INFO:tasks.workunit.client.0.smithi003.stdout:0/335: rename d9/fd to d9/d12/d17/d38/d3a/d46/d55/d57/f76 0 2024-09-21T12:20:36.407 INFO:tasks.workunit.client.0.smithi003.stdout:3/282: dread d0/d5/da/d28/f29 [0,4194304] 0 2024-09-21T12:20:36.408 INFO:tasks.workunit.client.1.smithi192.stdout:3/862: symlink db/d16/dc1/def/l134 0 2024-09-21T12:20:36.408 INFO:tasks.workunit.client.0.smithi003.stdout:0/336: write d9/d12/d17/d21/f31 [98347,102724] 0 2024-09-21T12:20:36.409 INFO:tasks.workunit.client.1.smithi192.stdout:3/863: write db/d16/dc1/ff9 [142809,87493] 0 2024-09-21T12:20:36.411 INFO:tasks.workunit.client.0.smithi003.stdout:4/269: mknod d9/d48/d49/c59 0 2024-09-21T12:20:36.416 INFO:tasks.workunit.client.1.smithi192.stdout:2/882: rmdir d1b/d38/d53/d8b/da7 39 2024-09-21T12:20:36.417 INFO:tasks.workunit.client.1.smithi192.stdout:0/980: truncate d3/fb6 553418 0 2024-09-21T12:20:36.418 INFO:tasks.workunit.client.0.smithi003.stdout:2/314: link d0/d21/f39 d0/dd/d22/d37/f74 0 2024-09-21T12:20:36.421 INFO:tasks.workunit.client.0.smithi003.stdout:2/315: dread - d0/d1c/f52 zero size 2024-09-21T12:20:36.423 INFO:tasks.workunit.client.0.smithi003.stdout:6/339: creat d4/d11/f6e x:0 0 0 2024-09-21T12:20:36.424 INFO:tasks.workunit.client.1.smithi192.stdout:0/981: dwrite d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/d43/f95 [0,4194304] 0 2024-09-21T12:20:36.425 INFO:tasks.workunit.client.1.smithi192.stdout:3/864: creat db/d16/dc1/def/d111/f135 x:0 0 0 2024-09-21T12:20:36.426 INFO:tasks.workunit.client.1.smithi192.stdout:1/912: link d2/d12/d2f/d51/d24/l119 d2/d12/d2f/d51/d24/d58/l12b 0 2024-09-21T12:20:36.426 INFO:tasks.workunit.client.1.smithi192.stdout:8/958: dread d14/d18/fed [0,4194304] 0 2024-09-21T12:20:36.427 INFO:tasks.workunit.client.0.smithi003.stdout:3/283: mkdir d0/d5/da/d28/d11/d49/d4c/d54 0 2024-09-21T12:20:36.428 INFO:tasks.workunit.client.1.smithi192.stdout:1/913: write d2/d12/d2f/d51/d24/f113 [2526397,69938] 0 2024-09-21T12:20:36.428 INFO:tasks.workunit.client.1.smithi192.stdout:0/982: write d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/dc6/d83/d87/faa [1407851,32930] 0 2024-09-21T12:20:36.430 INFO:tasks.workunit.client.0.smithi003.stdout:0/337: link d9/d12/d1e/f61 d9/d12/d17/d38/d3a/d46/d55/d67/d2d/f77 0 2024-09-21T12:20:36.430 INFO:tasks.workunit.client.0.smithi003.stdout:9/410: sync 2024-09-21T12:20:36.430 INFO:tasks.workunit.client.1.smithi192.stdout:2/883: creat d1b/d1e/d5e/d88/f121 x:0 0 0 2024-09-21T12:20:36.432 INFO:tasks.workunit.client.0.smithi003.stdout:0/338: dread - d9/f5e zero size 2024-09-21T12:20:36.433 INFO:tasks.workunit.client.0.smithi003.stdout:2/316: symlink d0/d1c/d6a/l75 0 2024-09-21T12:20:36.434 INFO:tasks.workunit.client.0.smithi003.stdout:2/317: chown d0/d1c/d6a/f71 43545572 1 2024-09-21T12:20:36.434 INFO:tasks.workunit.client.1.smithi192.stdout:4/870: getdents d2/d36/d55 0 2024-09-21T12:20:36.435 INFO:tasks.workunit.client.1.smithi192.stdout:1/914: dwrite d2/d12/d2f/d41/d5c/d101/d12a/fbf [0,4194304] 0 2024-09-21T12:20:36.436 INFO:tasks.workunit.client.1.smithi192.stdout:1/915: fdatasync d2/dae/fe7 0 2024-09-21T12:20:36.436 INFO:tasks.workunit.client.0.smithi003.stdout:6/340: chown d4/c68 4092733 1 2024-09-21T12:20:36.437 INFO:tasks.workunit.client.0.smithi003.stdout:6/341: truncate f3 9005997 0 2024-09-21T12:20:36.437 INFO:tasks.workunit.client.0.smithi003.stdout:3/284: mkdir d0/d5/d38/d55 0 2024-09-21T12:20:36.440 INFO:tasks.workunit.client.0.smithi003.stdout:9/411: mkdir d2/d53/d83/d96 0 2024-09-21T12:20:36.444 INFO:tasks.workunit.client.0.smithi003.stdout:6/342: creat d4/d13/d22/f6f x:0 0 0 2024-09-21T12:20:36.446 INFO:tasks.workunit.client.0.smithi003.stdout:6/343: write d4/d13/d22/f6f [585066,63549] 0 2024-09-21T12:20:36.447 INFO:tasks.workunit.client.0.smithi003.stdout:6/344: chown d4/d11/l33 35862543 1 2024-09-21T12:20:36.448 INFO:tasks.workunit.client.0.smithi003.stdout:6/345: stat d4/d13/d2e/d37/d64/l6c 0 2024-09-21T12:20:36.449 INFO:tasks.workunit.client.1.smithi192.stdout:0/983: symlink d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/dc6/d83/d87/l12f 0 2024-09-21T12:20:36.450 INFO:tasks.workunit.client.1.smithi192.stdout:0/984: stat d3/d5/d28/f64 0 2024-09-21T12:20:36.455 INFO:tasks.workunit.client.1.smithi192.stdout:4/871: symlink d2/db/d1a/dee/l128 0 2024-09-21T12:20:36.457 INFO:tasks.workunit.client.0.smithi003.stdout:6/346: creat d4/d13/d19/d23/f70 x:0 0 0 2024-09-21T12:20:36.459 INFO:tasks.workunit.client.1.smithi192.stdout:1/916: rename d2/d12/d2f/d51/d24/c25 to d2/d12/d2f/d51/df2/c12c 0 2024-09-21T12:20:36.460 INFO:tasks.workunit.client.1.smithi192.stdout:4/872: dread d2/fde [0,4194304] 0 2024-09-21T12:20:36.460 INFO:tasks.workunit.client.0.smithi003.stdout:0/339: dwrite d9/d12/d1e/f2e [0,4194304] 0 2024-09-21T12:20:36.462 INFO:tasks.workunit.client.1.smithi192.stdout:8/959: creat d14/d18/d94/da4/d13b/f140 x:0 0 0 2024-09-21T12:20:36.465 INFO:tasks.workunit.client.1.smithi192.stdout:0/985: creat d3/d5/de0/d119/f130 x:0 0 0 2024-09-21T12:20:36.468 INFO:tasks.workunit.client.0.smithi003.stdout:9/412: link d2/d53/f8d d2/f97 0 2024-09-21T12:20:36.470 INFO:tasks.workunit.client.1.smithi192.stdout:1/917: creat d2/d12/d2f/d51/f12d x:0 0 0 2024-09-21T12:20:36.470 INFO:tasks.workunit.client.0.smithi003.stdout:2/318: link d0/d21/d2c/c4f d0/d1c/d6a/c76 0 2024-09-21T12:20:36.472 INFO:tasks.workunit.client.1.smithi192.stdout:3/865: symlink db/d16/d112/l136 0 2024-09-21T12:20:36.472 INFO:tasks.workunit.client.0.smithi003.stdout:3/285: getdents d0/d5/da/d28/dd/d23 0 2024-09-21T12:20:36.473 INFO:tasks.workunit.client.0.smithi003.stdout:3/286: chown d0/d5/da/d28/dd/f41 4108 1 2024-09-21T12:20:36.474 INFO:tasks.workunit.client.0.smithi003.stdout:6/347: creat d4/d13/d63/f71 x:0 0 0 2024-09-21T12:20:36.475 INFO:tasks.workunit.client.1.smithi192.stdout:8/960: rmdir d14/d1a/de9 39 2024-09-21T12:20:36.476 INFO:tasks.workunit.client.0.smithi003.stdout:3/287: dread - d0/d5/da/d28/d11/f34 zero size 2024-09-21T12:20:36.478 INFO:tasks.workunit.client.0.smithi003.stdout:9/413: mknod d2/c98 0 2024-09-21T12:20:36.481 INFO:tasks.workunit.client.1.smithi192.stdout:1/918: fsync d2/ff1 0 2024-09-21T12:20:36.487 INFO:tasks.workunit.client.0.smithi003.stdout:9/414: chown d2/da/d17/l73 220832364 1 2024-09-21T12:20:36.487 INFO:tasks.workunit.client.1.smithi192.stdout:2/884: getdents d1b/d1e/d5e/d88/d95/dbe/d111 0 2024-09-21T12:20:36.492 INFO:tasks.workunit.client.1.smithi192.stdout:1/919: creat d2/d12/d2f/d51/d24/d65/d8b/dd5/f12e x:0 0 0 2024-09-21T12:20:36.494 INFO:tasks.workunit.client.0.smithi003.stdout:0/340: write d9/d12/d1e/f1f [2097809,77059] 0 2024-09-21T12:20:36.497 INFO:tasks.workunit.client.1.smithi192.stdout:0/986: creat d3/d5/d28/f131 x:0 0 0 2024-09-21T12:20:36.498 INFO:tasks.workunit.client.1.smithi192.stdout:2/885: mkdir d1b/d38/d7d/d122 0 2024-09-21T12:20:36.498 INFO:tasks.workunit.client.0.smithi003.stdout:3/288: truncate d0/d5/da/f3f 4929092 0 2024-09-21T12:20:36.498 INFO:tasks.workunit.client.1.smithi192.stdout:1/920: dwrite d2/dae/ff5 [0,4194304] 0 2024-09-21T12:20:36.499 INFO:tasks.workunit.client.0.smithi003.stdout:3/289: fsync d0/d5/da/d28/f33 0 2024-09-21T12:20:36.499 INFO:tasks.workunit.client.0.smithi003.stdout:0/341: mknod d9/d6c/d26/c78 0 2024-09-21T12:20:36.501 INFO:tasks.workunit.client.0.smithi003.stdout:9/415: write d2/d20/d22/d3f/f63 [2356438,18655] 0 2024-09-21T12:20:36.503 INFO:tasks.workunit.client.0.smithi003.stdout:0/342: rmdir d9/d12/d1e 39 2024-09-21T12:20:36.503 INFO:tasks.workunit.client.0.smithi003.stdout:6/348: getdents d4/d13/d2e/d37/d58 0 2024-09-21T12:20:36.504 INFO:tasks.workunit.client.0.smithi003.stdout:9/416: read d2/f2b [2349454,43565] 0 2024-09-21T12:20:36.506 INFO:tasks.workunit.client.0.smithi003.stdout:0/343: chown d9/d12/d17/d38/d3a/d46/d55/d67/d2d 91051 1 2024-09-21T12:20:36.506 INFO:tasks.workunit.client.0.smithi003.stdout:9/417: fsync d2/da/d17/f27 0 2024-09-21T12:20:36.507 INFO:tasks.workunit.client.0.smithi003.stdout:3/290: rename d0/d5/da/d28/c1a to d0/d5/d38/c56 0 2024-09-21T12:20:36.509 INFO:tasks.workunit.client.1.smithi192.stdout:0/987: unlink d3/d5/d28/d39/d50/dd9/d7a/fef 0 2024-09-21T12:20:36.511 INFO:tasks.workunit.client.0.smithi003.stdout:6/349: creat d4/d13/d63/f72 x:0 0 0 2024-09-21T12:20:36.512 INFO:tasks.workunit.client.1.smithi192.stdout:2/886: mknod d1b/d38/d53/d8b/da0/c123 0 2024-09-21T12:20:36.517 INFO:tasks.workunit.client.0.smithi003.stdout:0/344: chown d9/d12/d1e/f2e 28536573 1 2024-09-21T12:20:36.518 INFO:tasks.workunit.client.0.smithi003.stdout:0/345: dread - d9/d12/d17/f6d zero size 2024-09-21T12:20:36.521 INFO:tasks.workunit.client.0.smithi003.stdout:3/291: rename d0/d5/da/d28/d11/l1b to d0/d5/da/d28/d11/l57 0 2024-09-21T12:20:36.524 INFO:tasks.workunit.client.0.smithi003.stdout:6/350: rmdir d4/d13/d19/d62 39 2024-09-21T12:20:36.528 INFO:tasks.workunit.client.1.smithi192.stdout:1/921: creat d2/d12/d114/f12f x:0 0 0 2024-09-21T12:20:36.530 INFO:tasks.workunit.client.0.smithi003.stdout:0/346: creat d9/d12/d17/d38/d3a/d46/f79 x:0 0 0 2024-09-21T12:20:36.531 INFO:tasks.workunit.client.1.smithi192.stdout:4/873: truncate d2/db/d1a/dee/f77 1815704 0 2024-09-21T12:20:36.533 INFO:tasks.workunit.client.1.smithi192.stdout:3/866: link db/d16/d18/d21/d23/d71/f11f db/d16/d18/f137 0 2024-09-21T12:20:36.537 INFO:tasks.workunit.client.1.smithi192.stdout:1/922: read d2/d12/d2f/d51/f38 [614959,98698] 0 2024-09-21T12:20:36.538 INFO:tasks.workunit.client.0.smithi003.stdout:0/347: dwrite d9/d12/d17/f36 [0,4194304] 0 2024-09-21T12:20:36.541 INFO:tasks.workunit.client.0.smithi003.stdout:3/292: mknod d0/d5/d38/d55/c58 0 2024-09-21T12:20:36.542 INFO:tasks.workunit.client.0.smithi003.stdout:9/418: getdents d2/d20/d42 0 2024-09-21T12:20:36.543 INFO:tasks.workunit.client.1.smithi192.stdout:1/923: mkdir d2/d12/d2f/d51/d24/d58/d130 0 2024-09-21T12:20:36.545 INFO:tasks.workunit.client.0.smithi003.stdout:6/351: dwrite d4/d9/f15 [4194304,4194304] 0 2024-09-21T12:20:36.547 INFO:tasks.workunit.client.1.smithi192.stdout:3/867: mkdir db/d16/d138 0 2024-09-21T12:20:36.547 INFO:tasks.workunit.client.0.smithi003.stdout:6/352: dread - d4/d13/d19/d23/f70 zero size 2024-09-21T12:20:36.549 INFO:tasks.workunit.client.1.smithi192.stdout:3/868: dread - db/d16/d18/d21/d23/d71/d77/d11c/f12d zero size 2024-09-21T12:20:36.550 INFO:tasks.workunit.client.1.smithi192.stdout:2/887: dread d1b/d38/d53/d8b/da7/fd4 [0,4194304] 0 2024-09-21T12:20:36.550 INFO:tasks.workunit.client.1.smithi192.stdout:3/869: chown db/d16/d18/da7/ff6 399245 1 2024-09-21T12:20:36.552 INFO:tasks.workunit.client.1.smithi192.stdout:0/988: getdents d3/d5/dd7 0 2024-09-21T12:20:36.552 INFO:tasks.workunit.client.1.smithi192.stdout:3/870: chown db/d16/dc1/dd5/c12c 13836144 1 2024-09-21T12:20:36.553 INFO:tasks.workunit.client.1.smithi192.stdout:4/874: write d2/fde [1749451,115762] 0 2024-09-21T12:20:36.554 INFO:tasks.workunit.client.1.smithi192.stdout:1/924: fdatasync d2/d12/d2f/ff6 0 2024-09-21T12:20:36.555 INFO:tasks.workunit.client.1.smithi192.stdout:1/925: readlink d2/de/la6 0 2024-09-21T12:20:36.556 INFO:tasks.workunit.client.1.smithi192.stdout:4/875: dread - d2/d36/d55/d89/dc8/df7/d6c/db8/d88/f11c zero size 2024-09-21T12:20:36.556 INFO:tasks.workunit.client.0.smithi003.stdout:3/293: mknod d0/d5/da/d28/d11/c59 0 2024-09-21T12:20:36.557 INFO:tasks.workunit.client.1.smithi192.stdout:2/888: creat d1b/d1e/d62/d99/f124 x:0 0 0 2024-09-21T12:20:36.562 INFO:tasks.workunit.client.0.smithi003.stdout:9/419: mkdir d2/da/d99 0 2024-09-21T12:20:36.564 INFO:tasks.workunit.client.1.smithi192.stdout:3/871: rename db/d16/d18/d21/d23/d71/l8e to db/d16/d18/d21/d23/d10f/l139 0 2024-09-21T12:20:36.564 INFO:tasks.workunit.client.1.smithi192.stdout:4/876: rename d2/d36/d7f/df5/d4f/d71/d9d/dad/d9c/d9e/dcf to d2/d36/d7f/df5/d4f/d71/d9d/dad/d9c/d9e/dcf/d129 22 2024-09-21T12:20:36.565 INFO:tasks.workunit.client.0.smithi003.stdout:3/294: mknod d0/d5/d38/c5a 0 2024-09-21T12:20:36.567 INFO:tasks.workunit.client.0.smithi003.stdout:6/353: mknod d4/d11/c73 0 2024-09-21T12:20:36.570 INFO:tasks.workunit.client.1.smithi192.stdout:4/877: dwrite d2/d36/d55/d89/dc8/df7/d6c/ff0 [0,4194304] 0 2024-09-21T12:20:36.574 INFO:tasks.workunit.client.1.smithi192.stdout:0/989: write d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/fa9 [1244142,45132] 0 2024-09-21T12:20:36.575 INFO:tasks.workunit.client.0.smithi003.stdout:0/348: getdents d9/d12/d17/d38 0 2024-09-21T12:20:36.579 INFO:tasks.workunit.client.1.smithi192.stdout:4/878: dwrite d2/d36/d7f/df5/d4f/d71/d9d/dad/d9c/d9e/f124 [0,4194304] 0 2024-09-21T12:20:36.583 INFO:tasks.workunit.client.0.smithi003.stdout:3/295: mknod d0/d5/da/d28/dd/d23/d48/c5b 0 2024-09-21T12:20:36.584 INFO:tasks.workunit.client.1.smithi192.stdout:1/926: creat d2/d45/f131 x:0 0 0 2024-09-21T12:20:36.585 INFO:tasks.workunit.client.1.smithi192.stdout:2/889: write d1b/d38/f4d [1474104,120654] 0 2024-09-21T12:20:36.586 INFO:tasks.workunit.client.1.smithi192.stdout:2/890: dread - d1b/d1e/d5e/d88/f121 zero size 2024-09-21T12:20:36.589 INFO:tasks.workunit.client.0.smithi003.stdout:9/420: link d2/d20/c5f d2/da/d99/c9a 0 2024-09-21T12:20:36.590 INFO:tasks.workunit.client.0.smithi003.stdout:9/421: fdatasync d2/d29/f7d 0 2024-09-21T12:20:36.591 INFO:tasks.workunit.client.0.smithi003.stdout:9/422: fdatasync d2/da/d35/d76/f7e 0 2024-09-21T12:20:36.592 INFO:tasks.workunit.client.1.smithi192.stdout:3/872: creat db/d16/d18/d33/d3b/d99/f13a x:0 0 0 2024-09-21T12:20:36.594 INFO:tasks.workunit.client.1.smithi192.stdout:3/873: write db/d16/d18/da7/d10e/d2e/db8/dd0/fff [3348530,110352] 0 2024-09-21T12:20:36.600 INFO:tasks.workunit.client.0.smithi003.stdout:9/423: rename d2/d20/d22/d3f/f63 to d2/da/d35/d76/d94/f9b 0 2024-09-21T12:20:36.600 INFO:tasks.workunit.client.1.smithi192.stdout:1/927: mkdir d2/da/d6b/d132 0 2024-09-21T12:20:36.601 INFO:tasks.workunit.client.1.smithi192.stdout:1/928: fsync d2/d12/f104 0 2024-09-21T12:20:36.601 INFO:tasks.workunit.client.0.smithi003.stdout:8/306: sync 2024-09-21T12:20:36.601 INFO:tasks.workunit.client.0.smithi003.stdout:1/314: sync 2024-09-21T12:20:36.601 INFO:tasks.workunit.client.1.smithi192.stdout:2/891: fdatasync d1b/f3e 0 2024-09-21T12:20:36.602 INFO:tasks.workunit.client.1.smithi192.stdout:7/883: sync 2024-09-21T12:20:36.602 INFO:tasks.workunit.client.1.smithi192.stdout:8/961: sync 2024-09-21T12:20:36.603 INFO:tasks.workunit.client.1.smithi192.stdout:7/884: chown d6/d20/dcc/ce3 65181615 1 2024-09-21T12:20:36.605 INFO:tasks.workunit.client.1.smithi192.stdout:7/885: chown d6/d3a/dba/c104 847 1 2024-09-21T12:20:36.606 INFO:tasks.workunit.client.1.smithi192.stdout:7/886: fsync d6/f38 0 2024-09-21T12:20:36.606 INFO:tasks.workunit.client.0.smithi003.stdout:0/349: dwrite d9/d12/d17/d38/d3a/d46/d55/d67/f28 [0,4194304] 0 2024-09-21T12:20:36.606 INFO:tasks.workunit.client.0.smithi003.stdout:3/296: write d0/d5/da/d28/d11/f1d [1875606,6490] 0 2024-09-21T12:20:36.607 INFO:tasks.workunit.client.1.smithi192.stdout:2/892: dwrite d1b/d9e/fa9 [0,4194304] 0 2024-09-21T12:20:36.608 INFO:tasks.workunit.client.1.smithi192.stdout:4/879: truncate d2/db/f6d 2099124 0 2024-09-21T12:20:36.614 INFO:tasks.workunit.client.0.smithi003.stdout:9/424: mkdir d2/da/d2a/d89/d9c 0 2024-09-21T12:20:36.619 INFO:tasks.workunit.client.0.smithi003.stdout:0/350: dwrite d9/d12/d17/d38/d3a/d46/d55/d67/f64 [0,4194304] 0 2024-09-21T12:20:36.620 INFO:tasks.workunit.client.0.smithi003.stdout:1/315: write d4/df/d19/f2b [979988,29759] 0 2024-09-21T12:20:36.622 INFO:tasks.workunit.client.0.smithi003.stdout:1/316: write d4/f5e [30628,32187] 0 2024-09-21T12:20:36.624 INFO:tasks.workunit.client.0.smithi003.stdout:8/307: mknod d7/df/d20/d21/d4c/c6a 0 2024-09-21T12:20:36.630 INFO:tasks.workunit.client.0.smithi003.stdout:0/351: rmdir d9/d6c/d26 39 2024-09-21T12:20:36.631 INFO:tasks.workunit.client.0.smithi003.stdout:1/317: write d4/d11/d14/d25/d42/d63/f6b [6373,54658] 0 2024-09-21T12:20:36.633 INFO:tasks.workunit.client.0.smithi003.stdout:9/425: dwrite d2/da/d2a/d3c/f4b [0,4194304] 0 2024-09-21T12:20:36.633 INFO:tasks.workunit.client.0.smithi003.stdout:3/297: creat d0/d5/f5c x:0 0 0 2024-09-21T12:20:36.635 INFO:tasks.workunit.client.0.smithi003.stdout:0/352: rename d9/d12/d1e/f2e to d9/d12/d17/d38/d47/f7a 0 2024-09-21T12:20:36.636 INFO:tasks.workunit.client.0.smithi003.stdout:3/298: chown d0/d5/da/d28/d11/d49 6704749 1 2024-09-21T12:20:36.641 INFO:tasks.workunit.client.0.smithi003.stdout:8/308: read d7/de/d1a/f3c [579280,28496] 0 2024-09-21T12:20:36.643 INFO:tasks.workunit.client.0.smithi003.stdout:0/353: mkdir d9/d12/d17/d38/d3a/d46/d55/d7b 0 2024-09-21T12:20:36.646 INFO:tasks.workunit.client.0.smithi003.stdout:9/426: creat d2/da/d2a/d89/d9c/f9d x:0 0 0 2024-09-21T12:20:36.648 INFO:tasks.workunit.client.0.smithi003.stdout:1/318: creat d4/d11/f72 x:0 0 0 2024-09-21T12:20:36.650 INFO:tasks.workunit.client.0.smithi003.stdout:9/427: write d2/d20/f39 [4582557,72580] 0 2024-09-21T12:20:36.651 INFO:tasks.workunit.client.0.smithi003.stdout:3/299: getdents d0/d5/da/d28/d11/d49 0 2024-09-21T12:20:36.652 INFO:tasks.workunit.client.0.smithi003.stdout:8/309: dwrite d7/df/d20/d21/f3a [0,4194304] 0 2024-09-21T12:20:36.653 INFO:tasks.workunit.client.0.smithi003.stdout:1/319: chown d4/f26 6 1 2024-09-21T12:20:36.654 INFO:tasks.workunit.client.0.smithi003.stdout:3/300: write d0/d5/f4a [558730,21820] 0 2024-09-21T12:20:36.658 INFO:tasks.workunit.client.0.smithi003.stdout:8/310: truncate d7/df/d20/d21/f37 1230237 0 2024-09-21T12:20:36.659 INFO:tasks.workunit.client.0.smithi003.stdout:3/301: fsync d0/d5/da/d28/dd/d23/d26/f30 0 2024-09-21T12:20:36.661 INFO:tasks.workunit.client.0.smithi003.stdout:3/302: stat d0/d5/d38/d55/c58 0 2024-09-21T12:20:36.665 INFO:tasks.workunit.client.0.smithi003.stdout:9/428: mknod d2/c9e 0 2024-09-21T12:20:36.665 INFO:tasks.workunit.client.0.smithi003.stdout:0/354: link d9/d6c/d26/c45 d9/d6c/d66/c7c 0 2024-09-21T12:20:36.666 INFO:tasks.workunit.client.0.smithi003.stdout:1/320: dwrite d4/d11/f50 [0,4194304] 0 2024-09-21T12:20:36.667 INFO:tasks.workunit.client.0.smithi003.stdout:8/311: truncate d7/df/f1b 2408136 0 2024-09-21T12:20:36.669 INFO:tasks.workunit.client.0.smithi003.stdout:3/303: stat d0/d5/da/d28/dd/d23/d26/d3d/f53 0 2024-09-21T12:20:36.672 INFO:tasks.workunit.client.0.smithi003.stdout:3/304: fsync d0/f19 0 2024-09-21T12:20:36.672 INFO:tasks.workunit.client.0.smithi003.stdout:0/355: fdatasync d9/d12/d17/f18 0 2024-09-21T12:20:36.672 INFO:tasks.workunit.client.0.smithi003.stdout:9/429: unlink d2/da/d99/c9a 0 2024-09-21T12:20:36.680 INFO:tasks.workunit.client.0.smithi003.stdout:0/356: truncate d9/d12/d17/f2f 410964 0 2024-09-21T12:20:36.680 INFO:tasks.workunit.client.0.smithi003.stdout:8/312: dwrite f0 [0,4194304] 0 2024-09-21T12:20:36.680 INFO:tasks.workunit.client.0.smithi003.stdout:8/313: dread - d7/de/d1a/f68 zero size 2024-09-21T12:20:36.681 INFO:tasks.workunit.client.1.smithi192.stdout:0/990: creat d3/d5/d28/f132 x:0 0 0 2024-09-21T12:20:36.681 INFO:tasks.workunit.client.1.smithi192.stdout:3/874: mknod db/d16/db4/c13b 0 2024-09-21T12:20:36.682 INFO:tasks.workunit.client.1.smithi192.stdout:7/887: creat d6/d9/d1f/d3e/d7a/d8a/da2/f12f x:0 0 0 2024-09-21T12:20:36.684 INFO:tasks.workunit.client.1.smithi192.stdout:3/875: read - db/d16/d18/f10a zero size 2024-09-21T12:20:36.685 INFO:tasks.workunit.client.0.smithi003.stdout:1/321: link d4/d11/c53 d4/c73 0 2024-09-21T12:20:36.688 INFO:tasks.workunit.client.0.smithi003.stdout:1/322: write d4/d11/d14/f61 [778400,44255] 0 2024-09-21T12:20:36.690 INFO:tasks.workunit.client.0.smithi003.stdout:1/323: write d4/d11/d14/f3f [774089,78675] 0 2024-09-21T12:20:36.691 INFO:tasks.workunit.client.0.smithi003.stdout:0/357: unlink d9/d12/d17/d38/d3a/d46/d55/l63 0 2024-09-21T12:20:36.693 INFO:tasks.workunit.client.0.smithi003.stdout:0/358: write d9/d12/d1e/f1f [3875574,96423] 0 2024-09-21T12:20:36.693 INFO:tasks.workunit.client.0.smithi003.stdout:8/314: rename d7/df/d20/d24/c48 to d7/df/d20/d21/d4c/d4d/c6b 0 2024-09-21T12:20:36.696 INFO:tasks.workunit.client.0.smithi003.stdout:8/315: dread - d7/de/d11/f67 zero size 2024-09-21T12:20:36.696 INFO:tasks.workunit.client.0.smithi003.stdout:0/359: chown d9/d12/d17/d21/d30/f68 244508965 1 2024-09-21T12:20:36.700 INFO:tasks.workunit.client.0.smithi003.stdout:3/305: dread d0/d5/da/d28/d31/f32 [0,4194304] 0 2024-09-21T12:20:36.702 INFO:tasks.workunit.client.0.smithi003.stdout:1/324: dwrite d4/d11/d14/f61 [0,4194304] 0 2024-09-21T12:20:36.703 INFO:tasks.workunit.client.0.smithi003.stdout:1/325: dread - d4/dc/f67 zero size 2024-09-21T12:20:36.709 INFO:tasks.workunit.client.0.smithi003.stdout:3/306: creat d0/d5/da/d28/d11/f5d x:0 0 0 2024-09-21T12:20:36.710 INFO:tasks.workunit.client.0.smithi003.stdout:3/307: write d0/d5/da/d28/d11/f1d [3821203,122722] 0 2024-09-21T12:20:36.713 INFO:tasks.workunit.client.0.smithi003.stdout:1/326: dread d4/dc/f1c [0,4194304] 0 2024-09-21T12:20:36.713 INFO:tasks.workunit.client.0.smithi003.stdout:3/308: readlink d0/d5/da/d28/dd/d23/d26/l43 0 2024-09-21T12:20:36.715 INFO:tasks.workunit.client.0.smithi003.stdout:0/360: getdents d9/d12/d17/d38/d47 0 2024-09-21T12:20:36.716 INFO:tasks.workunit.client.0.smithi003.stdout:9/430: dread d2/da/d17/f2c [0,4194304] 0 2024-09-21T12:20:36.720 INFO:tasks.workunit.client.0.smithi003.stdout:8/316: dread d7/f14 [0,4194304] 0 2024-09-21T12:20:36.721 INFO:tasks.workunit.client.0.smithi003.stdout:3/309: rename d0/d5/da/d28/dd/d23 to d0/d5/da/d28/d11/d49/d4c/d54/d5e 0 2024-09-21T12:20:36.724 INFO:tasks.workunit.client.0.smithi003.stdout:0/361: symlink d9/d12/d17/d38/d3a/d46/d55/d57/l7d 0 2024-09-21T12:20:36.726 INFO:tasks.workunit.client.0.smithi003.stdout:1/327: creat d4/df/f74 x:0 0 0 2024-09-21T12:20:36.727 INFO:tasks.workunit.client.0.smithi003.stdout:9/431: mknod d2/da/d2a/d3c/c9f 0 2024-09-21T12:20:36.729 INFO:tasks.workunit.client.0.smithi003.stdout:3/310: dwrite d0/d5/f4a [0,4194304] 0 2024-09-21T12:20:36.729 INFO:tasks.workunit.client.0.smithi003.stdout:8/317: creat d7/de/d11/f6c x:0 0 0 2024-09-21T12:20:36.731 INFO:tasks.workunit.client.0.smithi003.stdout:8/318: write d7/df/d16/f5c [378021,5967] 0 2024-09-21T12:20:36.733 INFO:tasks.workunit.client.0.smithi003.stdout:0/362: mkdir d9/d6c/d26/d54/d7e 0 2024-09-21T12:20:36.742 INFO:tasks.workunit.client.0.smithi003.stdout:8/319: unlink d7/df/d20/d21/f37 0 2024-09-21T12:20:36.744 INFO:tasks.workunit.client.0.smithi003.stdout:3/311: dwrite d0/d5/da/d28/dd/f2d [0,4194304] 0 2024-09-21T12:20:36.744 INFO:tasks.workunit.client.0.smithi003.stdout:1/328: creat d4/df/d12/f75 x:0 0 0 2024-09-21T12:20:36.745 INFO:tasks.workunit.client.0.smithi003.stdout:0/363: dwrite d9/d12/f13 [0,4194304] 0 2024-09-21T12:20:36.747 INFO:tasks.workunit.client.0.smithi003.stdout:1/329: write d4/f5e [733863,71066] 0 2024-09-21T12:20:36.755 INFO:tasks.workunit.client.0.smithi003.stdout:8/320: write d7/de/d1a/f3c [666862,67830] 0 2024-09-21T12:20:36.769 INFO:tasks.workunit.client.0.smithi003.stdout:8/321: creat d7/df/d20/d21/f6d x:0 0 0 2024-09-21T12:20:36.770 INFO:tasks.workunit.client.0.smithi003.stdout:0/364: mknod d9/d12/d1e/d5f/c7f 0 2024-09-21T12:20:36.773 INFO:tasks.workunit.client.0.smithi003.stdout:1/330: mknod d4/df/d41/c76 0 2024-09-21T12:20:36.776 INFO:tasks.workunit.client.0.smithi003.stdout:0/365: rmdir d9/d12/d17 39 2024-09-21T12:20:36.778 INFO:tasks.workunit.client.0.smithi003.stdout:7/302: sync 2024-09-21T12:20:36.778 INFO:tasks.workunit.client.0.smithi003.stdout:5/384: sync 2024-09-21T12:20:36.778 INFO:tasks.workunit.client.0.smithi003.stdout:1/331: mkdir d4/d11/d14/d25/d59/d65/d68/d77 0 2024-09-21T12:20:36.782 INFO:tasks.workunit.client.0.smithi003.stdout:0/366: write d9/d12/d17/f36 [69726,113415] 0 2024-09-21T12:20:36.783 INFO:tasks.workunit.client.0.smithi003.stdout:7/303: chown l3 12551 1 2024-09-21T12:20:36.784 INFO:tasks.workunit.client.0.smithi003.stdout:5/385: rmdir dc/d15/d1c 39 2024-09-21T12:20:36.798 INFO:tasks.workunit.client.0.smithi003.stdout:5/386: mkdir dc/d15/d21/d28/d41/d5b/d74/d7f 0 2024-09-21T12:20:36.801 INFO:tasks.workunit.client.0.smithi003.stdout:1/332: unlink d4/df/f21 0 2024-09-21T12:20:36.802 INFO:tasks.workunit.client.0.smithi003.stdout:8/322: getdents d7/df/d16 0 2024-09-21T12:20:36.803 INFO:tasks.workunit.client.0.smithi003.stdout:9/432: write d2/d53/f7f [357556,20328] 0 2024-09-21T12:20:36.808 INFO:tasks.workunit.client.0.smithi003.stdout:5/387: creat dc/d2b/f80 x:0 0 0 2024-09-21T12:20:36.811 INFO:tasks.workunit.client.0.smithi003.stdout:1/333: mkdir d4/d11/d14/d78 0 2024-09-21T12:20:36.813 INFO:tasks.workunit.client.1.smithi192.stdout:0/991: symlink d3/d5/d28/d39/d50/dd9/d7a/dbe/d92/d51/l133 0 2024-09-21T12:20:36.814 INFO:tasks.workunit.client.0.smithi003.stdout:8/323: rename d7/df/d20/d24/d47/c62 to d7/df/d16/c6e 0 2024-09-21T12:20:36.817 INFO:tasks.workunit.client.1.smithi192.stdout:8/962: creat d14/d1a/de9/d12e/d136/f141 x:0 0 0 2024-09-21T12:20:36.818 INFO:tasks.workunit.client.1.smithi192.stdout:8/963: write d14/d1a/d1d/d46/d4e/d83/d8d/fbb [4763905,48569] 0 2024-09-21T12:20:36.820 INFO:tasks.workunit.client.0.smithi003.stdout:4/270: sync 2024-09-21T12:20:36.820 INFO:tasks.workunit.client.0.smithi003.stdout:2/319: sync 2024-09-21T12:20:36.820 INFO:tasks.workunit.client.0.smithi003.stdout:6/354: sync 2024-09-21T12:20:36.822 INFO:tasks.workunit.client.1.smithi192.stdout:0/992: rename d3/d5/d69/dbf/cf7 to d3/d5/d28/d39/d50/dd9/d7a/dbe/d89/c134 0 2024-09-21T12:20:36.823 INFO:tasks.workunit.client.0.smithi003.stdout:8/324: dwrite d7/df/d20/d24/f2e [0,4194304] 0 2024-09-21T12:20:36.823 INFO:tasks.workunit.client.0.smithi003.stdout:9/433: mkdir d2/da0 0 2024-09-21T12:20:36.823 INFO:tasks.workunit.client.1.smithi192.stdout:3/876: dread db/d16/d18/d40/dd1/d127/f131 [0,4194304] 0 2024-09-21T12:20:36.826 INFO:tasks.workunit.client.0.smithi003.stdout:0/367: link d9/d6c/l6b d9/d12/d17/d38/d3a/d46/l80 0 2024-09-21T12:20:36.828 INFO:tasks.workunit.client.1.smithi192.stdout:3/877: dwrite db/d16/d18/d40/f6e [0,4194304] 0 2024-09-21T12:20:36.828 INFO:tasks.workunit.client.1.smithi192.stdout:8/964: rename d14/d1a/d1d/cae to d14/d1a/d82/c142 0 2024-09-21T12:20:36.831 INFO:tasks.workunit.client.0.smithi003.stdout:8/325: dread d7/df/d16/f5c [0,4194304] 0 2024-09-21T12:20:36.833 INFO:tasks.workunit.client.1.smithi192.stdout:4/880: getdents d2/d36/d7f/d68 0 2024-09-21T12:20:36.833 INFO:tasks.workunit.client.0.smithi003.stdout:0/368: chown d9/d12/d17/d38/c49 85964 1 2024-09-21T12:20:36.834 INFO:tasks.workunit.client.0.smithi003.stdout:8/326: dread - d7/df/d36/f5b zero size 2024-09-21T12:20:36.836 INFO:tasks.workunit.client.0.smithi003.stdout:3/312: dwrite d0/f27 [0,4194304] 0 2024-09-21T12:20:36.837 INFO:tasks.workunit.client.0.smithi003.stdout:1/334: mknod d4/df/c79 0 2024-09-21T12:20:36.841 INFO:tasks.workunit.client.0.smithi003.stdout:5/388: truncate dc/d15/d21/d30/f42 1570837 0 2024-09-21T12:20:36.850 INFO:tasks.workunit.client.0.smithi003.stdout:6/355: creat d4/d13/d2e/d37/d64/f74 x:0 0 0 2024-09-21T12:20:36.851 INFO:tasks.workunit.client.1.smithi192.stdout:8/965: creat d14/d1a/de9/d12e/d136/f143 x:0 0 0 2024-09-21T12:20:36.852 INFO:tasks.workunit.client.0.smithi003.stdout:7/304: write d8/d31/f6e [12149,20702] 0 2024-09-21T12:20:36.852 INFO:tasks.workunit.client.0.smithi003.stdout:6/356: chown d4/d13/d2e/d37/d64/l6c 7476441 1 2024-09-21T12:20:36.854 INFO:tasks.workunit.client.0.smithi003.stdout:7/305: chown d8/db/d32 7339808 1 2024-09-21T12:20:36.860 INFO:tasks.workunit.client.1.smithi192.stdout:7/888: write d6/d9/d70/d77/fb7 [1366484,100384] 0 2024-09-21T12:20:36.861 INFO:tasks.workunit.client.1.smithi192.stdout:8/966: symlink d14/d1a/d1d/d46/d4e/d83/d8d/dd8/l144 0 2024-09-21T12:20:36.861 INFO:tasks.workunit.client.0.smithi003.stdout:8/327: read f4 [312085,108290] 0 2024-09-21T12:20:36.863 INFO:tasks.workunit.client.1.smithi192.stdout:4/881: creat d2/d36/d7f/df5/d4f/d71/d9d/dad/d9c/df8/f12a x:0 0 0 2024-09-21T12:20:36.867 INFO:tasks.workunit.client.1.smithi192.stdout:7/889: rename d6/d9/d1f/d3e/lf4 to d6/d20/dc9/l130 0 2024-09-21T12:20:36.868 INFO:tasks.workunit.client.1.smithi192.stdout:7/890: chown d6/d9/d1f/d3e/d7a/d8a/fe5 43 1 2024-09-21T12:20:36.869 INFO:tasks.workunit.client.1.smithi192.stdout:7/891: read d6/d9/d51/f23 [104425,28721] 0 2024-09-21T12:20:36.870 INFO:tasks.workunit.client.0.smithi003.stdout:4/271: dread d9/d25/f39 [0,4194304] 0 2024-09-21T12:20:36.870 INFO:tasks.workunit.client.0.smithi003.stdout:1/335: creat d4/d11/d14/d25/d59/d65/d68/f7a x:0 0 0 2024-09-21T12:20:36.874 INFO:tasks.workunit.client.0.smithi003.stdout:3/313: creat d0/d5/da/d28/d11/d49/d4c/d54/d5e/f5f x:0 0 0 2024-09-21T12:20:36.878 INFO:tasks.workunit.client.0.smithi003.stdout:5/389: symlink dc/d15/d21/d28/d3c/l81 0 2024-09-21T12:20:36.882 INFO:tasks.workunit.client.1.smithi192.stdout:7/892: creat d6/d9/d70/dda/f131 x:0 0 0 2024-09-21T12:20:36.885 INFO:tasks.workunit.client.0.smithi003.stdout:9/434: unlink d2/da/d2a/f55 0 2024-09-21T12:20:36.886 INFO:tasks.workunit.client.1.smithi192.stdout:8/967: link d14/d18/f33 d14/d1a/d1d/d46/d4e/d83/d8d/dd8/f145 0 2024-09-21T12:20:36.887 INFO:tasks.workunit.client.1.smithi192.stdout:7/893: dwrite d6/d9/f2b [0,4194304] 0 2024-09-21T12:20:36.888 INFO:tasks.workunit.client.0.smithi003.stdout:6/357: symlink d4/d13/d19/d23/l75 0 2024-09-21T12:20:36.888 INFO:tasks.workunit.client.0.smithi003.stdout:6/358: readlink d4/d13/l14 0 2024-09-21T12:20:36.894 INFO:tasks.workunit.client.1.smithi192.stdout:0/993: dwrite d3/d5/d28/d39/d50/dd9/fa7 [4194304,4194304] 0 2024-09-21T12:20:36.894 INFO:tasks.workunit.client.1.smithi192.stdout:2/893: sync 2024-09-21T12:20:36.894 INFO:tasks.workunit.client.1.smithi192.stdout:1/929: sync 2024-09-21T12:20:36.896 INFO:tasks.workunit.client.1.smithi192.stdout:8/968: mkdir d14/d1a/d1d/d46/d4e/d10d/d146 0 2024-09-21T12:20:36.899 INFO:tasks.workunit.client.1.smithi192.stdout:3/878: dwrite db/d16/d18/da7/d10e/f42 [0,4194304] 0 2024-09-21T12:20:36.907 INFO:tasks.workunit.client.1.smithi192.stdout:7/894: creat d6/d20/d69/d90/da7/dc1/d10a/f132 x:0 0 0 2024-09-21T12:20:36.908 INFO:tasks.workunit.client.1.smithi192.stdout:3/879: read db/d16/d18/d40/f51 [529574,46406] 0 2024-09-21T12:20:36.909 INFO:tasks.workunit.client.1.smithi192.stdout:8/969: dwrite d14/d18/d94/f114 [0,4194304] 0 2024-09-21T12:20:36.910 INFO:tasks.workunit.client.0.smithi003.stdout:3/314: creat d0/d5/d38/d55/f60 x:0 0 0 2024-09-21T12:20:36.910 INFO:tasks.workunit.client.1.smithi192.stdout:8/970: stat d14/d1a/d1d/d46/d4e/d83/d8d/d9c/dbe/c11a 0 2024-09-21T12:20:36.914 INFO:tasks.workunit.client.1.smithi192.stdout:2/894: rename d1b/d65/le4 to d1b/d1e/d5e/d88/d95/dbe/dd0/ddd/l125 0 2024-09-21T12:20:36.917 INFO:tasks.workunit.client.1.smithi192.stdout:4/882: truncate d2/db/d1a/dee/f69 3666734 0 2024-09-21T12:20:36.919 INFO:tasks.workunit.client.0.smithi003.stdout:2/320: truncate d0/dd/d22/d37/d3f/f67 2684154 0 2024-09-21T12:20:36.920 INFO:tasks.workunit.client.1.smithi192.stdout:8/971: dread d14/d1a/d1d/d46/d4e/d83/d8d/fbb [4194304,4194304] 0 2024-09-21T12:20:36.920 INFO:tasks.workunit.client.0.smithi003.stdout:2/321: dread - d0/d46/f64 zero size 2024-09-21T12:20:36.921 INFO:tasks.workunit.client.0.smithi003.stdout:7/306: rmdir d8/d2c 39 2024-09-21T12:20:36.922 INFO:tasks.workunit.client.1.smithi192.stdout:3/880: fdatasync db/d16/fa8 0 2024-09-21T12:20:36.923 INFO:tasks.workunit.client.1.smithi192.stdout:3/881: fsync db/d16/d18/d33/f83 0 2024-09-21T12:20:36.923 INFO:tasks.workunit.client.0.smithi003.stdout:0/369: creat d9/d12/f81 x:0 0 0 2024-09-21T12:20:36.925 INFO:tasks.workunit.client.0.smithi003.stdout:8/328: mknod d7/de/c6f 0 2024-09-21T12:20:36.928 INFO:tasks.workunit.client.1.smithi192.stdout:0/994: dread d3/d5/d28/d39/d50/dd9/fe3 [0,4194304] 0 2024-09-21T12:20:36.929 INFO:tasks.workunit.client.0.smithi003.stdout:8/329: dread f0 [0,4194304] 0 2024-09-21T12:20:36.930 INFO:tasks.workunit.client.1.smithi192.stdout:2/895: unlink d1b/d1e/fad 0 2024-09-21T12:20:36.930 INFO:tasks.workunit.client.1.smithi192.stdout:2/896: stat d1b/d1e/d5e/d75/d8d 0 2024-09-21T12:20:36.933 INFO:tasks.workunit.client.1.smithi192.stdout:1/930: mknod d2/d12/d2f/d51/d24/d65/d8e/d9d/c133 0 2024-09-21T12:20:36.935 INFO:tasks.workunit.client.0.smithi003.stdout:3/315: rename d0/d5/c22 to d0/d5/da/d28/d11/d49/d4c/c61 0 2024-09-21T12:20:36.935 INFO:tasks.workunit.client.0.smithi003.stdout:3/316: readlink d0/d5/d38/l4b 0 2024-09-21T12:20:36.936 INFO:tasks.workunit.client.0.smithi003.stdout:5/390: mkdir dc/d15/d21/d28/d41/d5b/d74/d7f/d82 0 2024-09-21T12:20:36.941 INFO:tasks.workunit.client.0.smithi003.stdout:9/435: creat d2/d20/d22/d5e/d87/fa1 x:0 0 0 2024-09-21T12:20:36.942 INFO:tasks.workunit.client.0.smithi003.stdout:5/391: dread dc/f10 [0,4194304] 0 2024-09-21T12:20:36.943 INFO:tasks.workunit.client.0.smithi003.stdout:5/392: chown dc/d15/d21/d30 0 1 2024-09-21T12:20:36.944 INFO:tasks.workunit.client.0.smithi003.stdout:6/359: symlink d4/d9/d59/l76 0 2024-09-21T12:20:36.945 INFO:tasks.workunit.client.0.smithi003.stdout:5/393: write dc/d15/d26/f2e [4802432,107681] 0 2024-09-21T12:20:36.946 INFO:tasks.workunit.client.0.smithi003.stdout:2/322: mkdir d0/d21/d2f/d77 0 2024-09-21T12:20:36.948 INFO:tasks.workunit.client.0.smithi003.stdout:4/272: truncate d9/da/fd 45827 0 2024-09-21T12:20:36.951 INFO:tasks.workunit.client.0.smithi003.stdout:4/273: chown d9/da/d47/d4b/f56 72929234 1 2024-09-21T12:20:36.955 INFO:tasks.workunit.client.0.smithi003.stdout:2/323: dwrite d0/d21/f4e [0,4194304] 0 2024-09-21T12:20:36.956 INFO:tasks.workunit.client.0.smithi003.stdout:7/307: dread d8/db/d13/f1a [0,4194304] 0 2024-09-21T12:20:36.957 INFO:tasks.workunit.client.0.smithi003.stdout:2/324: chown d0/d1c/c5f 9 1 2024-09-21T12:20:36.958 INFO:tasks.workunit.client.0.smithi003.stdout:2/325: fdatasync d0/d1c/f52 0 2024-09-21T12:20:36.961 INFO:tasks.workunit.client.0.smithi003.stdout:3/317: creat d0/d5/da/d28/d11/d49/d4c/d54/f62 x:0 0 0 2024-09-21T12:20:36.962 INFO:tasks.workunit.client.1.smithi192.stdout:0/995: mknod d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/d9b/c135 0 2024-09-21T12:20:36.963 INFO:tasks.workunit.client.0.smithi003.stdout:3/318: dread - d0/d5/da/d28/d11/f44 zero size 2024-09-21T12:20:36.965 INFO:tasks.workunit.client.1.smithi192.stdout:2/897: creat d1b/d38/d53/d8b/da2/f126 x:0 0 0 2024-09-21T12:20:36.967 INFO:tasks.workunit.client.1.smithi192.stdout:1/931: readlink d2/d45/l4e 0 2024-09-21T12:20:36.968 INFO:tasks.workunit.client.1.smithi192.stdout:1/932: stat d2/d12/d2f/d41/fb0 0 2024-09-21T12:20:36.969 INFO:tasks.workunit.client.0.smithi003.stdout:9/436: mkdir d2/da/d2a/d3c/da2 0 2024-09-21T12:20:36.971 INFO:tasks.workunit.client.0.smithi003.stdout:5/394: fdatasync dc/d15/d1c/f3e 0 2024-09-21T12:20:36.972 INFO:tasks.workunit.client.1.smithi192.stdout:8/972: creat d14/d1a/de9/d12e/d131/f147 x:0 0 0 2024-09-21T12:20:36.973 INFO:tasks.workunit.client.0.smithi003.stdout:6/360: dread d4/d13/f20 [0,4194304] 0 2024-09-21T12:20:36.974 INFO:tasks.workunit.client.0.smithi003.stdout:6/361: dread - d4/d13/d19/d23/f4d zero size 2024-09-21T12:20:36.975 INFO:tasks.workunit.client.0.smithi003.stdout:4/274: mknod d9/da/d36/c5a 0 2024-09-21T12:20:36.975 INFO:tasks.workunit.client.0.smithi003.stdout:6/362: chown d4/d13/l14 8 1 2024-09-21T12:20:36.976 INFO:tasks.workunit.client.1.smithi192.stdout:7/895: rename d6/d9/d2d/d7b to d6/d133 0 2024-09-21T12:20:36.978 INFO:tasks.workunit.client.1.smithi192.stdout:0/996: creat d3/d5/d28/d39/d50/dd9/f136 x:0 0 0 2024-09-21T12:20:36.978 INFO:tasks.workunit.client.1.smithi192.stdout:0/997: readlink d3/d5/d28/d39/l55 0 2024-09-21T12:20:36.979 INFO:tasks.workunit.client.1.smithi192.stdout:0/998: chown d3/d5/d69/c12a 14 1 2024-09-21T12:20:36.980 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:36 smithi192 ceph-mon[35641]: [21/Sep/2024:12:20:35] ENGINE Bus STARTING 2024-09-21T12:20:36.980 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:36 smithi192 ceph-mon[35641]: [21/Sep/2024:12:20:35] ENGINE Serving on https://172.21.15.192:7150 2024-09-21T12:20:36.980 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:36 smithi192 ceph-mon[35641]: [21/Sep/2024:12:20:35] ENGINE Error in HTTPServer.serve 2024-09-21T12:20:36.980 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: Traceback (most recent call last): 2024-09-21T12:20:36.980 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T12:20:36.980 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: self._connections.run(self.expiration_interval) 2024-09-21T12:20:36.980 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T12:20:36.981 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: self._run(expiration_interval) 2024-09-21T12:20:36.981 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T12:20:36.981 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T12:20:36.981 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T12:20:36.981 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T12:20:36.981 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T12:20:36.981 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: s = self.context.wrap_socket( 2024-09-21T12:20:36.981 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T12:20:36.981 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: return self.sslsocket_class._create( 2024-09-21T12:20:36.981 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T12:20:36.981 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: self.do_handshake() 2024-09-21T12:20:36.981 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T12:20:36.981 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: self._sslobj.do_handshake() 2024-09-21T12:20:36.982 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T12:20:36.982 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:36 smithi192 ceph-mon[35641]: [21/Sep/2024:12:20:35] ENGINE Serving on http://172.21.15.192:8765 2024-09-21T12:20:36.982 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:36 smithi192 ceph-mon[35641]: [21/Sep/2024:12:20:35] ENGINE Bus STARTED 2024-09-21T12:20:36.982 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:36 smithi192 ceph-mon[35641]: mgrmap e24: smithi192.qsaprd(active, since 4s) 2024-09-21T12:20:36.982 INFO:tasks.workunit.client.0.smithi003.stdout:4/275: dwrite d9/f24 [4194304,4194304] 0 2024-09-21T12:20:36.982 INFO:tasks.workunit.client.1.smithi192.stdout:2/898: dread - d1b/d1e/d5e/d88/fd1 zero size 2024-09-21T12:20:36.984 INFO:tasks.workunit.client.0.smithi003.stdout:2/326: mkdir d0/d21/d30/d78 0 2024-09-21T12:20:36.987 INFO:tasks.workunit.client.0.smithi003.stdout:8/330: rename d7/df/c34 to d7/d57/c70 0 2024-09-21T12:20:36.991 INFO:tasks.workunit.client.1.smithi192.stdout:8/973: dread d14/d1a/fca [0,4194304] 0 2024-09-21T12:20:36.992 INFO:tasks.workunit.client.1.smithi192.stdout:3/882: creat db/d16/d18/da7/d10e/d2e/f13c x:0 0 0 2024-09-21T12:20:36.994 INFO:tasks.workunit.client.1.smithi192.stdout:7/896: mknod d6/d3a/d63/c134 0 2024-09-21T12:20:36.995 INFO:tasks.workunit.client.0.smithi003.stdout:3/319: creat d0/d5/da/d28/d31/f63 x:0 0 0 2024-09-21T12:20:36.996 INFO:tasks.workunit.client.1.smithi192.stdout:2/899: rmdir d1b/d1e/d5e/d88/d95 39 2024-09-21T12:20:36.999 INFO:tasks.workunit.client.1.smithi192.stdout:4/883: getdents d2/db/d1a 0 2024-09-21T12:20:36.999 INFO:tasks.workunit.client.0.smithi003.stdout:0/370: truncate d9/d6c/d26/f3c 2902885 0 2024-09-21T12:20:37.000 INFO:tasks.workunit.client.1.smithi192.stdout:4/884: fsync d2/d36/d55/d89/dc8/df7/d83/f95 0 2024-09-21T12:20:37.000 INFO:tasks.workunit.client.1.smithi192.stdout:8/974: mkdir d14/d1a/d1d/d46/d4e/d83/d8d/d9c/dee/d80/d148 0 2024-09-21T12:20:37.002 INFO:tasks.workunit.client.1.smithi192.stdout:3/883: rename db/d16/d18/lcd to db/d16/dc1/def/l13d 0 2024-09-21T12:20:37.004 INFO:tasks.workunit.client.1.smithi192.stdout:3/884: dread - db/d16/d18/d40/dd1/f10c zero size 2024-09-21T12:20:37.004 INFO:tasks.workunit.client.1.smithi192.stdout:7/897: unlink d6/d9/d2d/lcb 0 2024-09-21T12:20:37.005 INFO:tasks.workunit.client.1.smithi192.stdout:0/999: creat d3/d5/d28/d39/d50/dd9/d7a/dbe/de7/d11d/f137 x:0 0 0 2024-09-21T12:20:37.006 INFO:tasks.workunit.client.1.smithi192.stdout:7/898: dread - d6/d3a/dba/f124 zero size 2024-09-21T12:20:37.006 INFO:tasks.workunit.client.1.smithi192.stdout:1/933: dwrite d2/da/d6b/dc8/fa3 [0,4194304] 0 2024-09-21T12:20:37.007 INFO:tasks.workunit.client.1.smithi192.stdout:7/899: readlink d6/d9/le9 0 2024-09-21T12:20:37.007 INFO:tasks.workunit.client.1.smithi192.stdout:1/934: chown d2/d12/l42 111867648 1 2024-09-21T12:20:37.009 INFO:tasks.workunit.client.1.smithi192.stdout:4/885: rename d2/d36/d55/d89 to d2/d36/d7f/df5/d4f/d71/d12b 0 2024-09-21T12:20:37.012 INFO:tasks.workunit.client.0.smithi003.stdout:9/437: creat d2/da/d2a/d89/d9c/fa3 x:0 0 0 2024-09-21T12:20:37.013 INFO:tasks.workunit.client.1.smithi192.stdout:2/900: write d1b/d1e/d5e/d88/d95/d9c/fce [5600075,47611] 0 2024-09-21T12:20:37.015 INFO:tasks.workunit.client.1.smithi192.stdout:8/975: mkdir d14/d1a/d149 0 2024-09-21T12:20:37.016 INFO:tasks.workunit.client.1.smithi192.stdout:8/976: truncate d14/d18/daf/ddd/fe3 995658 0 2024-09-21T12:20:37.021 INFO:tasks.workunit.client.1.smithi192.stdout:1/935: read d2/f3e [574347,68420] 0 2024-09-21T12:20:37.021 INFO:tasks.workunit.client.0.smithi003.stdout:6/363: creat d4/d9/d59/f77 x:0 0 0 2024-09-21T12:20:37.022 INFO:tasks.workunit.client.0.smithi003.stdout:6/364: chown d4/d13/d2e/d37/d58 1817659 1 2024-09-21T12:20:37.026 INFO:tasks.workunit.client.1.smithi192.stdout:4/886: mknod d2/d36/d7f/df5/d4f/d71/d12b/dc8/df7/d83/d93/c12c 0 2024-09-21T12:20:37.029 INFO:tasks.workunit.client.0.smithi003.stdout:6/365: dwrite d4/d13/d2e/f44 [0,4194304] 0 2024-09-21T12:20:37.030 INFO:tasks.workunit.client.0.smithi003.stdout:6/366: readlink d4/l5e 0 2024-09-21T12:20:37.030 INFO:tasks.workunit.client.0.smithi003.stdout:4/276: dwrite d9/da/f57 [0,4194304] 0 2024-09-21T12:20:37.031 INFO:tasks.workunit.client.1.smithi192.stdout:2/901: truncate d1b/d1e/d62/f86 1772648 0 2024-09-21T12:20:37.033 INFO:tasks.workunit.client.0.smithi003.stdout:7/308: rename d8/d2c/f37 to d8/db/d32/d43/f76 0 2024-09-21T12:20:37.033 INFO:tasks.workunit.client.0.smithi003.stdout:8/331: creat d7/d57/f71 x:0 0 0 2024-09-21T12:20:37.035 INFO:tasks.workunit.client.0.smithi003.stdout:3/320: mknod d0/d5/da/d28/d11/d49/d4c/d54/c64 0 2024-09-21T12:20:37.038 INFO:tasks.workunit.client.1.smithi192.stdout:7/900: mknod d6/d3a/c135 0 2024-09-21T12:20:37.039 INFO:tasks.workunit.client.1.smithi192.stdout:1/936: rmdir d2/da/d6b/d108 39 2024-09-21T12:20:37.041 INFO:tasks.workunit.client.0.smithi003.stdout:9/438: creat d2/d20/d22/d3f/fa4 x:0 0 0 2024-09-21T12:20:37.046 INFO:tasks.workunit.client.0.smithi003.stdout:2/327: rename d0/d21/d62/f6f to d0/dd/d22/f79 0 2024-09-21T12:20:37.051 INFO:tasks.workunit.client.0.smithi003.stdout:8/332: mknod d7/df/d20/d24/c72 0 2024-09-21T12:20:37.053 INFO:tasks.workunit.client.1.smithi192.stdout:3/885: dwrite db/d16/dc1/def/d111/f113 [0,4194304] 0 2024-09-21T12:20:37.054 INFO:tasks.workunit.client.1.smithi192.stdout:3/886: readlink db/d16/d18/d33/l5a 0 2024-09-21T12:20:37.055 INFO:tasks.workunit.client.1.smithi192.stdout:3/887: chown db/d16/d18/d33/d3b/d99/f13a 23 1 2024-09-21T12:20:37.056 INFO:tasks.workunit.client.1.smithi192.stdout:1/937: dread d2/d4d/f6f [0,4194304] 0 2024-09-21T12:20:37.076 INFO:tasks.workunit.client.0.smithi003.stdout:3/321: creat d0/d5/d38/d55/f65 x:0 0 0 2024-09-21T12:20:37.078 INFO:tasks.workunit.client.0.smithi003.stdout:9/439: mkdir d2/d20/d42/da5 0 2024-09-21T12:20:37.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:36 smithi003 ceph-mon[28057]: [21/Sep/2024:12:20:35] ENGINE Bus STARTING 2024-09-21T12:20:37.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:36 smithi003 ceph-mon[28057]: [21/Sep/2024:12:20:35] ENGINE Serving on https://172.21.15.192:7150 2024-09-21T12:20:37.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:36 smithi003 ceph-mon[28057]: [21/Sep/2024:12:20:35] ENGINE Error in HTTPServer.serve 2024-09-21T12:20:37.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: Traceback (most recent call last): 2024-09-21T12:20:37.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T12:20:37.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: self._connections.run(self.expiration_interval) 2024-09-21T12:20:37.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T12:20:37.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: self._run(expiration_interval) 2024-09-21T12:20:37.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T12:20:37.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T12:20:37.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T12:20:37.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T12:20:37.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T12:20:37.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: s = self.context.wrap_socket( 2024-09-21T12:20:37.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T12:20:37.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: return self.sslsocket_class._create( 2024-09-21T12:20:37.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T12:20:37.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: self.do_handshake() 2024-09-21T12:20:37.081 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T12:20:37.081 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: self._sslobj.do_handshake() 2024-09-21T12:20:37.081 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T12:20:37.081 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:36 smithi003 ceph-mon[28057]: [21/Sep/2024:12:20:35] ENGINE Serving on http://172.21.15.192:8765 2024-09-21T12:20:37.081 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:36 smithi003 ceph-mon[28057]: [21/Sep/2024:12:20:35] ENGINE Bus STARTED 2024-09-21T12:20:37.081 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:36 smithi003 ceph-mon[28057]: mgrmap e24: smithi192.qsaprd(active, since 4s) 2024-09-21T12:20:37.081 INFO:tasks.workunit.client.1.smithi192.stdout:2/902: rename d1b/d38/f79 to d1b/d1e/d5e/d75/f127 0 2024-09-21T12:20:37.083 INFO:tasks.workunit.client.0.smithi003.stdout:3/322: dwrite d0/d5/d38/d55/f60 [0,4194304] 0 2024-09-21T12:20:37.084 INFO:tasks.workunit.client.1.smithi192.stdout:3/888: mkdir db/d16/d18/d21/d23/d71/d77/d13e 0 2024-09-21T12:20:37.085 INFO:tasks.workunit.client.0.smithi003.stdout:3/323: dread - d0/d5/da/d28/d11/d49/d4c/d54/f62 zero size 2024-09-21T12:20:37.085 INFO:tasks.workunit.client.1.smithi192.stdout:3/889: dread db/d16/db4/fa2 [0,4194304] 0 2024-09-21T12:20:37.088 INFO:tasks.workunit.client.1.smithi192.stdout:1/938: fdatasync d2/d45/f9c 0 2024-09-21T12:20:37.088 INFO:tasks.workunit.client.1.smithi192.stdout:8/977: write d14/d1a/d1d/d46/d4e/d83/d8d/d9c/dbe/fc8 [2693518,16528] 0 2024-09-21T12:20:37.091 INFO:tasks.workunit.client.1.smithi192.stdout:4/887: write d2/d36/d7f/f63 [1579271,51759] 0 2024-09-21T12:20:37.095 INFO:tasks.workunit.client.1.smithi192.stdout:3/890: mkdir db/d16/d18/d21/dde/d13f 0 2024-09-21T12:20:37.096 INFO:tasks.workunit.client.0.smithi003.stdout:5/395: getdents dc/d15/d21/d30/d35 0 2024-09-21T12:20:37.099 INFO:tasks.workunit.client.0.smithi003.stdout:4/277: dwrite d9/d16/f28 [0,4194304] 0 2024-09-21T12:20:37.099 INFO:tasks.workunit.client.0.smithi003.stdout:2/328: creat d0/dd/d22/d68/f7a x:0 0 0 2024-09-21T12:20:37.099 INFO:tasks.workunit.client.0.smithi003.stdout:7/309: dwrite d8/d31/f74 [0,4194304] 0 2024-09-21T12:20:37.105 INFO:tasks.workunit.client.0.smithi003.stdout:2/329: write d0/dd/d22/d68/f7a [376907,29609] 0 2024-09-21T12:20:37.107 INFO:tasks.workunit.client.0.smithi003.stdout:9/440: dwrite d2/d20/f21 [0,4194304] 0 2024-09-21T12:20:37.114 INFO:tasks.workunit.client.1.smithi192.stdout:2/903: truncate d1b/d9e/f10c 243251 0 2024-09-21T12:20:37.114 INFO:tasks.workunit.client.0.smithi003.stdout:2/330: dread d0/f36 [0,4194304] 0 2024-09-21T12:20:37.115 INFO:tasks.workunit.client.0.smithi003.stdout:7/310: fdatasync d8/db/d13/f44 0 2024-09-21T12:20:37.115 INFO:tasks.workunit.client.0.smithi003.stdout:2/331: write d0/d21/f6b [359840,31623] 0 2024-09-21T12:20:37.116 INFO:tasks.workunit.client.1.smithi192.stdout:1/939: mknod d2/d12/c134 0 2024-09-21T12:20:37.117 INFO:tasks.workunit.client.0.smithi003.stdout:7/311: write d8/d31/f74 [1945159,108233] 0 2024-09-21T12:20:37.118 INFO:tasks.workunit.client.0.smithi003.stdout:9/441: unlink d2/da/d17/d40/f44 0 2024-09-21T12:20:37.120 INFO:tasks.workunit.client.1.smithi192.stdout:4/888: mkdir d2/db/d12d 0 2024-09-21T12:20:37.121 INFO:tasks.workunit.client.1.smithi192.stdout:7/901: rename d6/d3a/d6d/cfe to d6/d9/d1f/c136 0 2024-09-21T12:20:37.123 INFO:tasks.workunit.client.1.smithi192.stdout:2/904: mknod d1b/d1e/d5e/d88/d95/c128 0 2024-09-21T12:20:37.123 INFO:tasks.workunit.client.1.smithi192.stdout:2/905: chown d1b/d1e/d7b/cb3 58 1 2024-09-21T12:20:37.127 INFO:tasks.workunit.client.1.smithi192.stdout:7/902: write d6/d9/d1f/d3e/d7a/d8a/f103 [858138,77199] 0 2024-09-21T12:20:37.128 INFO:tasks.workunit.client.1.smithi192.stdout:7/903: readlink d6/d9/d2d/l45 0 2024-09-21T12:20:37.129 INFO:tasks.workunit.client.0.smithi003.stdout:2/332: unlink d0/dd/d22/f4a 0 2024-09-21T12:20:37.130 INFO:tasks.workunit.client.0.smithi003.stdout:1/336: sync 2024-09-21T12:20:37.132 INFO:tasks.workunit.client.1.smithi192.stdout:2/906: chown d1b/l67 405197 1 2024-09-21T12:20:37.133 INFO:tasks.workunit.client.1.smithi192.stdout:8/978: getdents d14/d1a/d82/de0 0 2024-09-21T12:20:37.134 INFO:tasks.workunit.client.0.smithi003.stdout:7/312: write d8/f17 [2281739,6326] 0 2024-09-21T12:20:37.137 INFO:tasks.workunit.client.0.smithi003.stdout:0/371: rename d9/d6c/d26/f39 to d9/d12/f82 0 2024-09-21T12:20:37.140 INFO:tasks.workunit.client.0.smithi003.stdout:2/333: dwrite d0/dd/d22/d37/f73 [0,4194304] 0 2024-09-21T12:20:37.142 INFO:tasks.workunit.client.0.smithi003.stdout:2/334: dread d0/f25 [0,4194304] 0 2024-09-21T12:20:37.143 INFO:tasks.workunit.client.0.smithi003.stdout:5/396: dread dc/d2b/d4e/f53 [0,4194304] 0 2024-09-21T12:20:37.145 INFO:tasks.workunit.client.0.smithi003.stdout:2/335: chown d0/dd/d22/d37/f48 5 1 2024-09-21T12:20:37.147 INFO:tasks.workunit.client.1.smithi192.stdout:4/889: creat d2/d36/d7f/df5/d4f/d71/d12b/dc8/df7/d6c/db8/d88/d100/f12e x:0 0 0 2024-09-21T12:20:37.147 INFO:tasks.workunit.client.0.smithi003.stdout:9/442: getdents d2/da0 0 2024-09-21T12:20:37.149 INFO:tasks.workunit.client.1.smithi192.stdout:7/904: dwrite d6/d133/dee/ff7 [0,4194304] 0 2024-09-21T12:20:37.150 INFO:tasks.workunit.client.1.smithi192.stdout:2/907: creat d1b/d38/d7d/f129 x:0 0 0 2024-09-21T12:20:37.151 INFO:tasks.workunit.client.1.smithi192.stdout:8/979: dread d14/d1a/d1d/f49 [4194304,4194304] 0 2024-09-21T12:20:37.153 INFO:tasks.workunit.client.1.smithi192.stdout:8/980: read d14/d1a/d1d/db6/fb8 [4287607,108925] 0 2024-09-21T12:20:37.154 INFO:tasks.workunit.client.0.smithi003.stdout:4/278: dwrite d9/da/fd [0,4194304] 0 2024-09-21T12:20:37.154 INFO:tasks.workunit.client.0.smithi003.stdout:1/337: dread d4/f13 [0,4194304] 0 2024-09-21T12:20:37.156 INFO:tasks.workunit.client.1.smithi192.stdout:7/905: dread d6/d9/d1f/f72 [0,4194304] 0 2024-09-21T12:20:37.157 INFO:tasks.workunit.client.0.smithi003.stdout:1/338: read - d4/d11/d14/d25/d59/d65/d68/f7a zero size 2024-09-21T12:20:37.157 INFO:tasks.workunit.client.0.smithi003.stdout:4/279: truncate d9/d48/f51 269599 0 2024-09-21T12:20:37.157 INFO:tasks.workunit.client.0.smithi003.stdout:6/367: rename d4/d11/d17/l52 to d4/d13/d5b/l78 0 2024-09-21T12:20:37.158 INFO:tasks.workunit.client.1.smithi192.stdout:1/940: dwrite d2/d12/d2f/d51/d24/d65/d8b/fd7 [0,4194304] 0 2024-09-21T12:20:37.159 INFO:tasks.workunit.client.0.smithi003.stdout:6/368: readlink l0 0 2024-09-21T12:20:37.161 INFO:tasks.workunit.client.0.smithi003.stdout:1/339: truncate d4/d11/d14/f6a 875061 0 2024-09-21T12:20:37.161 INFO:tasks.workunit.client.0.smithi003.stdout:6/369: fdatasync d4/d13/d19/f26 0 2024-09-21T12:20:37.169 INFO:tasks.workunit.client.0.smithi003.stdout:6/370: dwrite d4/d9/f50 [0,4194304] 0 2024-09-21T12:20:37.171 INFO:tasks.workunit.client.0.smithi003.stdout:5/397: mknod dc/d15/d21/d28/d3c/c83 0 2024-09-21T12:20:37.174 INFO:tasks.workunit.client.1.smithi192.stdout:1/941: mkdir d2/d12/d2f/d51/d24/d65/dd4/d135 0 2024-09-21T12:20:37.176 INFO:tasks.workunit.client.0.smithi003.stdout:4/280: creat d9/d16/f5b x:0 0 0 2024-09-21T12:20:37.181 INFO:tasks.workunit.client.1.smithi192.stdout:7/906: unlink d6/d9/d70/d77/dcd/deb/c106 0 2024-09-21T12:20:37.183 INFO:tasks.workunit.client.0.smithi003.stdout:8/333: rename d7/de/d11/c13 to d7/df/d20/d24/c73 0 2024-09-21T12:20:37.185 INFO:tasks.workunit.client.1.smithi192.stdout:1/942: symlink d2/da/d6b/d7d/l136 0 2024-09-21T12:20:37.186 INFO:tasks.workunit.client.0.smithi003.stdout:0/372: creat d9/d12/d17/d38/d3a/d46/d55/d7b/f83 x:0 0 0 2024-09-21T12:20:37.187 INFO:tasks.workunit.client.1.smithi192.stdout:4/890: link d2/d36/d7f/df5/d4f/d71/d9d/dad/d4b/f64 d2/d36/d7f/df5/d4f/d71/d12b/dc8/df7/d6c/de3/f12f 0 2024-09-21T12:20:37.188 INFO:tasks.workunit.client.0.smithi003.stdout:6/371: mkdir d4/d9/d79 0 2024-09-21T12:20:37.189 INFO:tasks.workunit.client.1.smithi192.stdout:8/981: dwrite ff [0,4194304] 0 2024-09-21T12:20:37.190 INFO:tasks.workunit.client.0.smithi003.stdout:0/373: write d9/d12/d17/d38/d3a/d46/d55/d67/f64 [3745729,15685] 0 2024-09-21T12:20:37.190 INFO:tasks.workunit.client.0.smithi003.stdout:5/398: rmdir dc/d15/d21/d28/d41 39 2024-09-21T12:20:37.192 INFO:tasks.workunit.client.0.smithi003.stdout:0/374: chown d9/d12/d17/d38/d47 27335 1 2024-09-21T12:20:37.194 INFO:tasks.workunit.client.1.smithi192.stdout:2/908: write d1b/f6a [1150558,72722] 0 2024-09-21T12:20:37.195 INFO:tasks.workunit.client.1.smithi192.stdout:7/907: fsync d6/d3a/fe6 0 2024-09-21T12:20:37.195 INFO:tasks.workunit.client.1.smithi192.stdout:2/909: fsync d1b/d38/f4d 0 2024-09-21T12:20:37.197 INFO:tasks.workunit.client.1.smithi192.stdout:2/910: dread - d1b/d1e/d5e/ffe zero size 2024-09-21T12:20:37.198 INFO:tasks.workunit.client.1.smithi192.stdout:8/982: dwrite d14/d1a/d1d/d46/d4e/d83/d8d/d9c/dd0/d8e/fb1 [0,4194304] 0 2024-09-21T12:20:37.199 INFO:tasks.workunit.client.0.smithi003.stdout:1/340: truncate d4/f3a 1545253 0 2024-09-21T12:20:37.201 INFO:tasks.workunit.client.0.smithi003.stdout:5/399: dwrite dc/d15/d21/d30/f34 [0,4194304] 0 2024-09-21T12:20:37.203 INFO:tasks.workunit.client.1.smithi192.stdout:2/911: dwrite d1b/d38/d53/d8b/da2/f126 [0,4194304] 0 2024-09-21T12:20:37.204 INFO:tasks.workunit.client.0.smithi003.stdout:7/313: dwrite d8/d3c/d57/f73 [0,4194304] 0 2024-09-21T12:20:37.204 INFO:tasks.workunit.client.1.smithi192.stdout:2/912: write d1b/f2a [1596682,126152] 0 2024-09-21T12:20:37.206 INFO:tasks.workunit.client.0.smithi003.stdout:3/324: rename d0/d5/da/d28/d11/d49/d4c/d54/f62 to d0/d5/da/d28/d11/d49/d4c/f66 0 2024-09-21T12:20:37.215 INFO:tasks.workunit.client.1.smithi192.stdout:1/943: symlink d2/d12/d2f/d51/d24/d65/d8e/d9d/l137 0 2024-09-21T12:20:37.215 INFO:tasks.workunit.client.0.smithi003.stdout:4/281: dread d9/f18 [0,4194304] 0 2024-09-21T12:20:37.216 INFO:tasks.workunit.client.0.smithi003.stdout:6/372: symlink d4/d13/d19/d23/l7a 0 2024-09-21T12:20:37.217 INFO:tasks.workunit.client.1.smithi192.stdout:1/944: write d2/dae/f121 [106644,17981] 0 2024-09-21T12:20:37.217 INFO:tasks.workunit.client.0.smithi003.stdout:6/373: dread - d4/d13/d63/f72 zero size 2024-09-21T12:20:37.223 INFO:tasks.workunit.client.1.smithi192.stdout:1/945: dwrite d2/d4d/fb8 [0,4194304] 0 2024-09-21T12:20:37.226 INFO:tasks.workunit.client.1.smithi192.stdout:2/913: symlink d1b/d1e/d62/l12a 0 2024-09-21T12:20:37.227 INFO:tasks.workunit.client.0.smithi003.stdout:5/400: write dc/d2b/d4e/f53 [2940940,17731] 0 2024-09-21T12:20:37.229 INFO:tasks.workunit.client.0.smithi003.stdout:2/336: rename d0/dd/d22/f6d to d0/d21/d2f/f7b 0 2024-09-21T12:20:37.232 INFO:tasks.workunit.client.0.smithi003.stdout:6/374: creat d4/d13/f7b x:0 0 0 2024-09-21T12:20:37.233 INFO:tasks.workunit.client.0.smithi003.stdout:6/375: read - d4/d13/d63/f72 zero size 2024-09-21T12:20:37.235 INFO:tasks.workunit.client.0.smithi003.stdout:6/376: readlink d4/d11/l46 0 2024-09-21T12:20:37.235 INFO:tasks.workunit.client.0.smithi003.stdout:0/375: mknod d9/d12/c84 0 2024-09-21T12:20:37.237 INFO:tasks.workunit.client.1.smithi192.stdout:1/946: mknod d2/de/dcf/c138 0 2024-09-21T12:20:37.241 INFO:tasks.workunit.client.0.smithi003.stdout:2/337: dwrite d0/dd/d22/d37/f73 [0,4194304] 0 2024-09-21T12:20:37.242 INFO:tasks.workunit.client.0.smithi003.stdout:8/334: rename d7/df/d20/d21/l4a to d7/d57/l74 0 2024-09-21T12:20:37.242 INFO:tasks.workunit.client.1.smithi192.stdout:7/908: rmdir d6/de4 0 2024-09-21T12:20:37.246 INFO:tasks.workunit.client.1.smithi192.stdout:4/891: getdents d2/d36/d7f/df5/d4f/d71/d9d 0 2024-09-21T12:20:37.248 INFO:tasks.workunit.client.0.smithi003.stdout:6/377: dwrite d4/f10 [8388608,4194304] 0 2024-09-21T12:20:37.249 INFO:tasks.workunit.client.1.smithi192.stdout:1/947: mkdir d2/d12/d2f/d41/d5c/d101/d139 0 2024-09-21T12:20:37.254 INFO:tasks.workunit.client.1.smithi192.stdout:4/892: readlink d2/db/l6b 0 2024-09-21T12:20:37.255 INFO:tasks.workunit.client.1.smithi192.stdout:1/948: unlink d2/d4d/cb3 0 2024-09-21T12:20:37.257 INFO:tasks.workunit.client.0.smithi003.stdout:3/325: rename d0/d5/da/d28/d11/f5d to d0/d5/da/d28/d31/f67 0 2024-09-21T12:20:37.258 INFO:tasks.workunit.client.0.smithi003.stdout:3/326: dread - d0/d5/d38/d55/f65 zero size 2024-09-21T12:20:37.259 INFO:tasks.workunit.client.0.smithi003.stdout:3/327: readlink d0/d5/da/d28/dd/l12 0 2024-09-21T12:20:37.260 INFO:tasks.workunit.client.1.smithi192.stdout:4/893: unlink d2/db/d3e/fcd 0 2024-09-21T12:20:37.262 INFO:tasks.workunit.client.0.smithi003.stdout:3/328: truncate d0/d5/da/d28/d11/f34 267280 0 2024-09-21T12:20:37.264 INFO:tasks.workunit.client.0.smithi003.stdout:8/335: mkdir d7/df/d20/d21/d4c/d4d/d75 0 2024-09-21T12:20:37.266 INFO:tasks.workunit.client.1.smithi192.stdout:8/983: truncate d14/d18/fed 1293696 0 2024-09-21T12:20:37.268 INFO:tasks.workunit.client.0.smithi003.stdout:7/314: dwrite d8/fe [0,4194304] 0 2024-09-21T12:20:37.268 INFO:tasks.workunit.client.1.smithi192.stdout:1/949: unlink d2/d12/d2f/d81/fab 0 2024-09-21T12:20:37.269 INFO:tasks.workunit.client.0.smithi003.stdout:7/315: write d8/db/f58 [638941,3547] 0 2024-09-21T12:20:37.271 INFO:tasks.workunit.client.1.smithi192.stdout:2/914: dwrite d1b/d1e/d62/d99/fd3 [0,4194304] 0 2024-09-21T12:20:37.273 INFO:tasks.workunit.client.1.smithi192.stdout:4/894: symlink d2/l130 0 2024-09-21T12:20:37.275 INFO:tasks.workunit.client.1.smithi192.stdout:8/984: mkdir d14/d1a/d1d/d46/d4e/d83/d8d/d9c/dee/d80/d9a/d14a 0 2024-09-21T12:20:37.277 INFO:tasks.workunit.client.0.smithi003.stdout:5/401: write dc/d15/d21/d30/f42 [338771,116699] 0 2024-09-21T12:20:37.279 INFO:tasks.workunit.client.1.smithi192.stdout:1/950: dread d2/d12/d2f/d41/d5c/d101/d12a/f9e [0,4194304] 0 2024-09-21T12:20:37.283 INFO:tasks.workunit.client.0.smithi003.stdout:0/376: rename d9/f5e to d9/d12/d17/d38/d3a/d46/d55/d67/f85 0 2024-09-21T12:20:37.286 INFO:tasks.workunit.client.0.smithi003.stdout:4/282: truncate f8 696882 0 2024-09-21T12:20:37.288 INFO:tasks.workunit.client.1.smithi192.stdout:8/985: fdatasync d14/d1a/d1d/d20/d5f/fa3 0 2024-09-21T12:20:37.289 INFO:tasks.workunit.client.0.smithi003.stdout:3/329: symlink d0/d5/d38/d55/l68 0 2024-09-21T12:20:37.289 INFO:tasks.workunit.client.0.smithi003.stdout:8/336: symlink d7/de/d1a/l76 0 2024-09-21T12:20:37.290 INFO:tasks.workunit.client.1.smithi192.stdout:8/986: chown d14/d1a/d1d/d20/d5f/ca6 485 1 2024-09-21T12:20:37.290 INFO:tasks.workunit.client.0.smithi003.stdout:3/330: dread - d0/d5/da/d28/f33 zero size 2024-09-21T12:20:37.291 INFO:tasks.workunit.client.1.smithi192.stdout:4/895: dwrite d2/d36/d7f/df5/ffe [4194304,4194304] 0 2024-09-21T12:20:37.291 INFO:tasks.workunit.client.1.smithi192.stdout:8/987: truncate d14/d18/f93 8588226 0 2024-09-21T12:20:37.292 INFO:tasks.workunit.client.1.smithi192.stdout:2/915: mkdir d1b/d1e/d5e/d75/d8d/d10b/d12b 0 2024-09-21T12:20:37.292 INFO:tasks.workunit.client.0.smithi003.stdout:8/337: truncate d7/df/d36/f41 990288 0 2024-09-21T12:20:37.293 INFO:tasks.workunit.client.0.smithi003.stdout:7/316: creat d8/db/d13/f77 x:0 0 0 2024-09-21T12:20:37.293 INFO:tasks.workunit.client.1.smithi192.stdout:8/988: fsync d14/d1a/d1d/d46/d4e/d83/d8d/d9c/dd0/d8e/fb1 0 2024-09-21T12:20:37.296 INFO:tasks.workunit.client.1.smithi192.stdout:1/951: mkdir d2/d12/d2f/d13a 0 2024-09-21T12:20:37.296 INFO:tasks.workunit.client.0.smithi003.stdout:7/317: dread d8/d2c/f2a [0,4194304] 0 2024-09-21T12:20:37.304 INFO:tasks.workunit.client.0.smithi003.stdout:0/377: rename d9/d12 to d9/d12/d1e/d86 22 2024-09-21T12:20:37.304 INFO:tasks.workunit.client.0.smithi003.stdout:7/318: dread d8/db/f58 [0,4194304] 0 2024-09-21T12:20:37.305 INFO:tasks.workunit.client.1.smithi192.stdout:2/916: truncate d1b/d1e/d3d/f5a 4525504 0 2024-09-21T12:20:37.306 INFO:tasks.workunit.client.0.smithi003.stdout:5/402: dwrite dc/d15/d21/d28/d41/f7d [0,4194304] 0 2024-09-21T12:20:37.306 INFO:tasks.workunit.client.0.smithi003.stdout:7/319: chown d8/d2c/f2a 188 1 2024-09-21T12:20:37.308 INFO:tasks.workunit.client.0.smithi003.stdout:0/378: write d9/d12/d17/d38/d3a/d46/d55/d67/f64 [3461341,37248] 0 2024-09-21T12:20:37.311 INFO:tasks.workunit.client.0.smithi003.stdout:2/338: link d0/d21/d2f/d50/f69 d0/f7c 0 2024-09-21T12:20:37.312 INFO:tasks.workunit.client.1.smithi192.stdout:2/917: dwrite d1b/d1e/d10d/f11e [0,4194304] 0 2024-09-21T12:20:37.313 INFO:tasks.workunit.client.0.smithi003.stdout:3/331: symlink d0/d5/da/d28/d11/d49/l69 0 2024-09-21T12:20:37.317 INFO:tasks.workunit.client.0.smithi003.stdout:8/338: mkdir d7/d57/d77 0 2024-09-21T12:20:37.317 INFO:tasks.workunit.client.0.smithi003.stdout:4/283: dwrite d9/f18 [0,4194304] 0 2024-09-21T12:20:37.319 INFO:tasks.workunit.client.0.smithi003.stdout:4/284: read d9/f1a [519486,101815] 0 2024-09-21T12:20:37.319 INFO:tasks.workunit.client.0.smithi003.stdout:3/332: truncate d0/d5/d38/d55/f65 608353 0 2024-09-21T12:20:37.323 INFO:tasks.workunit.client.0.smithi003.stdout:6/378: creat d4/f7c x:0 0 0 2024-09-21T12:20:37.324 INFO:tasks.workunit.client.0.smithi003.stdout:6/379: readlink d4/d11/d17/l1c 0 2024-09-21T12:20:37.326 INFO:tasks.workunit.client.0.smithi003.stdout:6/380: chown d4/d13/d22/f2b 515135 1 2024-09-21T12:20:37.326 INFO:tasks.workunit.client.0.smithi003.stdout:6/381: chown d4/d11 116748760 1 2024-09-21T12:20:37.328 INFO:tasks.workunit.client.1.smithi192.stdout:1/952: mkdir d2/da/d6b/dfa/d13b 0 2024-09-21T12:20:37.328 INFO:tasks.workunit.client.1.smithi192.stdout:1/953: fdatasync d2/da/d6b/ff7 0 2024-09-21T12:20:37.329 INFO:tasks.workunit.client.1.smithi192.stdout:1/954: stat d2/da/d6b 0 2024-09-21T12:20:37.331 INFO:tasks.workunit.client.1.smithi192.stdout:1/955: dread - d2/d12/d2f/d51/d24/d65/dd4/f125 zero size 2024-09-21T12:20:37.332 INFO:tasks.workunit.client.1.smithi192.stdout:2/918: read d1b/d1e/d5e/d88/d95/dbe/f110 [162045,30292] 0 2024-09-21T12:20:37.333 INFO:tasks.workunit.client.0.smithi003.stdout:5/403: creat dc/d15/d26/f84 x:0 0 0 2024-09-21T12:20:37.333 INFO:tasks.workunit.client.0.smithi003.stdout:6/382: dwrite d4/fe [0,4194304] 0 2024-09-21T12:20:37.335 INFO:tasks.workunit.client.0.smithi003.stdout:5/404: write dc/f1a [1356176,66630] 0 2024-09-21T12:20:37.337 INFO:tasks.workunit.client.0.smithi003.stdout:7/320: symlink d8/d3c/d6b/l78 0 2024-09-21T12:20:37.339 INFO:tasks.workunit.client.1.smithi192.stdout:1/956: mknod d2/d12/d2f/d41/d5c/c13c 0 2024-09-21T12:20:37.340 INFO:tasks.workunit.client.1.smithi192.stdout:8/989: dwrite d14/d1a/f27 [0,4194304] 0 2024-09-21T12:20:37.340 INFO:tasks.workunit.client.1.smithi192.stdout:1/957: chown d2/da/d6b/d7d/f87 8 1 2024-09-21T12:20:37.341 INFO:tasks.workunit.client.0.smithi003.stdout:0/379: creat d9/d12/d17/d38/d3a/f87 x:0 0 0 2024-09-21T12:20:37.342 INFO:tasks.workunit.client.1.smithi192.stdout:4/896: write d2/db/d1a/dee/f5f [118153,52910] 0 2024-09-21T12:20:37.343 INFO:tasks.workunit.client.0.smithi003.stdout:0/380: read d9/d12/d17/f36 [3679338,107558] 0 2024-09-21T12:20:37.346 INFO:tasks.workunit.client.1.smithi192.stdout:1/958: creat d2/de/f13d x:0 0 0 2024-09-21T12:20:37.346 INFO:tasks.workunit.client.1.smithi192.stdout:1/959: fsync d2/d12/d2f/d51/d24/d65/d8e/d9d/db6/fbd 0 2024-09-21T12:20:37.348 INFO:tasks.workunit.client.0.smithi003.stdout:4/285: creat d9/da/d47/f5c x:0 0 0 2024-09-21T12:20:37.349 INFO:tasks.workunit.client.1.smithi192.stdout:8/990: dread d14/d18/d94/dc3/f10a [0,4194304] 0 2024-09-21T12:20:37.353 INFO:tasks.workunit.client.1.smithi192.stdout:4/897: fdatasync d2/d36/d7f/df5/d4f/d71/d12b/fbc 0 2024-09-21T12:20:37.355 INFO:tasks.workunit.client.1.smithi192.stdout:1/960: stat d2/da/fd2 0 2024-09-21T12:20:37.355 INFO:tasks.workunit.client.1.smithi192.stdout:4/898: fsync d2/d36/d7f/df5/d4f/d71/d12b/dc8/df7/d6c/db8/d88/fb2 0 2024-09-21T12:20:37.357 INFO:tasks.workunit.client.1.smithi192.stdout:8/991: dwrite d14/d1a/d1d/d46/d4e/d83/d8d/d9c/dbe/fc8 [0,4194304] 0 2024-09-21T12:20:37.357 INFO:tasks.workunit.client.1.smithi192.stdout:4/899: chown d2/d36/d7f/df5/d4f/d71/d12b/da6/f113 15552 1 2024-09-21T12:20:37.357 INFO:tasks.workunit.client.1.smithi192.stdout:8/992: stat d14/d1a/l1c 0 2024-09-21T12:20:37.358 INFO:tasks.workunit.client.0.smithi003.stdout:7/321: rename d8/d3c/f61 to d8/d3c/d64/f79 0 2024-09-21T12:20:37.358 INFO:tasks.workunit.client.0.smithi003.stdout:7/322: stat d8/db/d13/f3a 0 2024-09-21T12:20:37.359 INFO:tasks.workunit.client.1.smithi192.stdout:2/919: creat d1b/d1e/d5e/f12c x:0 0 0 2024-09-21T12:20:37.368 INFO:tasks.workunit.client.1.smithi192.stdout:1/961: mkdir d2/da/d6b/d7d/d13e 0 2024-09-21T12:20:37.368 INFO:tasks.workunit.client.0.smithi003.stdout:4/286: rmdir d9 39 2024-09-21T12:20:37.370 INFO:tasks.workunit.client.1.smithi192.stdout:8/993: creat d14/d1a/de9/d12e/d131/f14b x:0 0 0 2024-09-21T12:20:37.372 INFO:tasks.workunit.client.1.smithi192.stdout:4/900: truncate d2/d36/d7f/d68/f78 2184541 0 2024-09-21T12:20:37.373 INFO:tasks.workunit.client.0.smithi003.stdout:3/333: truncate d0/d5/f36 4145487 0 2024-09-21T12:20:37.374 INFO:tasks.workunit.client.1.smithi192.stdout:2/920: fdatasync d1b/d1e/d5e/d88/faa 0 2024-09-21T12:20:37.374 INFO:tasks.workunit.client.1.smithi192.stdout:1/962: dwrite d2/d12/d2f/d51/d24/d65/d8e/d9d/ff8 [0,4194304] 0 2024-09-21T12:20:37.376 INFO:tasks.workunit.client.1.smithi192.stdout:1/963: write d2/d12/d2f/d41/d5c/d99/f11e [1241007,118287] 0 2024-09-21T12:20:37.378 INFO:tasks.workunit.client.1.smithi192.stdout:3/891: sync 2024-09-21T12:20:37.380 INFO:tasks.workunit.client.1.smithi192.stdout:8/994: truncate d14/d1a/d1d/d46/d4e/db5/f120 2534207 0 2024-09-21T12:20:37.381 INFO:tasks.workunit.client.0.smithi003.stdout:0/381: write d9/d12/d17/d21/f40 [3364130,58154] 0 2024-09-21T12:20:37.385 INFO:tasks.workunit.client.0.smithi003.stdout:8/339: creat d7/f78 x:0 0 0 2024-09-21T12:20:37.385 INFO:tasks.workunit.client.1.smithi192.stdout:3/892: dwrite db/d16/d18/d21/d23/f95 [0,4194304] 0 2024-09-21T12:20:37.385 INFO:tasks.workunit.client.1.smithi192.stdout:2/921: rmdir d1b/d38/d53/d107 39 2024-09-21T12:20:37.387 INFO:tasks.workunit.client.0.smithi003.stdout:4/287: fsync d9/f23 0 2024-09-21T12:20:37.391 INFO:tasks.workunit.client.1.smithi192.stdout:1/964: rename d2/d12/d2f/d81/l106 to d2/da/d6b/dfa/l13f 0 2024-09-21T12:20:37.392 INFO:tasks.workunit.client.1.smithi192.stdout:1/965: fdatasync d2/d12/fe4 0 2024-09-21T12:20:37.393 INFO:tasks.workunit.client.0.smithi003.stdout:3/334: creat d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/f6a x:0 0 0 2024-09-21T12:20:37.400 INFO:tasks.workunit.client.0.smithi003.stdout:7/323: mkdir d8/d7a 0 2024-09-21T12:20:37.402 INFO:tasks.workunit.client.1.smithi192.stdout:2/922: mkdir d1b/d65/d77/d12d 0 2024-09-21T12:20:37.403 INFO:tasks.workunit.client.1.smithi192.stdout:2/923: chown d1b/d1e/d3d/c81 581876 1 2024-09-21T12:20:37.404 INFO:tasks.workunit.client.1.smithi192.stdout:2/924: dread - d1b/d1e/d5e/d88/d95/dbe/dd0/f103 zero size 2024-09-21T12:20:37.404 INFO:tasks.workunit.client.0.smithi003.stdout:8/340: rename d7/de/d11 to d7/df/d20/d24/d47/d79 0 2024-09-21T12:20:37.404 INFO:tasks.workunit.client.1.smithi192.stdout:2/925: read d1b/d1e/d5e/d75/d8d/fb1 [672894,73990] 0 2024-09-21T12:20:37.408 INFO:tasks.workunit.client.0.smithi003.stdout:6/383: truncate d4/d11/d32/f3b 1179903 0 2024-09-21T12:20:37.409 INFO:tasks.workunit.client.1.smithi192.stdout:8/995: creat d14/d1a/d1d/d46/d4e/d83/d8d/d9c/dee/d80/d9a/d14a/f14c x:0 0 0 2024-09-21T12:20:37.410 INFO:tasks.workunit.client.1.smithi192.stdout:8/996: dread d14/d1a/f96 [0,4194304] 0 2024-09-21T12:20:37.412 INFO:tasks.workunit.client.0.smithi003.stdout:3/335: mkdir d0/d5/da/d28/d31/d6b 0 2024-09-21T12:20:37.412 INFO:tasks.workunit.client.1.smithi192.stdout:8/997: write d14/d1a/d1d/d46/d4e/d83/d8d/d9c/dee/d80/d9a/f126 [170181,34447] 0 2024-09-21T12:20:37.413 INFO:tasks.workunit.client.0.smithi003.stdout:3/336: dread - d0/d5/f46 zero size 2024-09-21T12:20:37.414 INFO:tasks.workunit.client.0.smithi003.stdout:6/384: dwrite d4/f4a [0,4194304] 0 2024-09-21T12:20:37.414 INFO:tasks.workunit.client.0.smithi003.stdout:7/324: unlink d8/db/f3d 0 2024-09-21T12:20:37.415 INFO:tasks.workunit.client.0.smithi003.stdout:7/325: chown d8/d31/f67 91946315 1 2024-09-21T12:20:37.417 INFO:tasks.workunit.client.0.smithi003.stdout:7/326: truncate d8/db/d32/f5d 1031818 0 2024-09-21T12:20:37.422 INFO:tasks.workunit.client.0.smithi003.stdout:8/341: mkdir d7/df/d20/d54/d7a 0 2024-09-21T12:20:37.424 INFO:tasks.workunit.client.0.smithi003.stdout:8/342: write d7/df/d20/d21/f6d [718570,95517] 0 2024-09-21T12:20:37.425 INFO:tasks.workunit.client.1.smithi192.stdout:1/966: mknod d2/d12/d2f/d51/d24/d65/d8e/d9d/c140 0 2024-09-21T12:20:37.430 INFO:tasks.workunit.client.1.smithi192.stdout:4/901: link d2/db/fd9 d2/d36/d7f/df5/d4f/f131 0 2024-09-21T12:20:37.432 INFO:tasks.workunit.client.0.smithi003.stdout:4/288: dwrite d9/da/f22 [4194304,4194304] 0 2024-09-21T12:20:37.432 INFO:tasks.workunit.client.0.smithi003.stdout:0/382: write d9/d12/d17/d21/f42 [1393708,64814] 0 2024-09-21T12:20:37.434 INFO:tasks.workunit.client.0.smithi003.stdout:8/343: dwrite d7/df/d20/d24/f2e [0,4194304] 0 2024-09-21T12:20:37.437 INFO:tasks.workunit.client.1.smithi192.stdout:8/998: unlink d14/d1a/d1d/d46/d4e/d83/d8d/d9c/dd0/la1 0 2024-09-21T12:20:37.437 INFO:tasks.workunit.client.1.smithi192.stdout:8/999: chown d14/d18/d7b/ld7 27 1 2024-09-21T12:20:37.439 INFO:tasks.workunit.client.0.smithi003.stdout:3/337: unlink d0/d5/da/d28/d11/d49/d4c/d54/d5e/d48/c5b 0 2024-09-21T12:20:37.439 INFO:tasks.workunit.client.0.smithi003.stdout:8/344: write d7/df/d20/d24/d47/d79/f6c [372222,112456] 0 2024-09-21T12:20:37.441 INFO:tasks.workunit.client.0.smithi003.stdout:3/338: fsync d0/d5/f4a 0 2024-09-21T12:20:37.446 INFO:tasks.workunit.client.0.smithi003.stdout:0/383: dwrite d9/d12/d1e/f1f [4194304,4194304] 0 2024-09-21T12:20:37.446 INFO:tasks.workunit.client.1.smithi192.stdout:4/902: creat d2/d36/d7f/df5/d4f/d71/d9d/dad/f132 x:0 0 0 2024-09-21T12:20:37.446 INFO:tasks.workunit.client.1.smithi192.stdout:3/893: getdents db/d16/db4 0 2024-09-21T12:20:37.448 INFO:tasks.workunit.client.1.smithi192.stdout:2/926: rename d1b/d1e/d5e/d75/da1/de3/fe6 to d1b/d1e/d5e/d88/f12e 0 2024-09-21T12:20:37.449 INFO:tasks.workunit.client.1.smithi192.stdout:1/967: fdatasync d2/d12/d2f/f5f 0 2024-09-21T12:20:37.451 INFO:tasks.workunit.client.0.smithi003.stdout:4/289: rename d9/d48/f58 to d9/d25/f5d 0 2024-09-21T12:20:37.453 INFO:tasks.workunit.client.1.smithi192.stdout:3/894: mknod db/d16/d18/da7/d10e/d2e/db8/c140 0 2024-09-21T12:20:37.456 INFO:tasks.workunit.client.1.smithi192.stdout:2/927: truncate d1b/d1e/fbd 1447805 0 2024-09-21T12:20:37.457 INFO:tasks.workunit.client.0.smithi003.stdout:3/339: creat d0/d5/da/d28/d31/f6c x:0 0 0 2024-09-21T12:20:37.458 INFO:tasks.workunit.client.1.smithi192.stdout:3/895: mknod db/d16/db4/d8c/c141 0 2024-09-21T12:20:37.459 INFO:tasks.workunit.client.1.smithi192.stdout:7/909: sync 2024-09-21T12:20:37.460 INFO:tasks.workunit.client.0.smithi003.stdout:0/384: mkdir d9/d6c/d26/d54/d88 0 2024-09-21T12:20:37.460 INFO:tasks.workunit.client.0.smithi003.stdout:3/340: write d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/f35 [8001,18216] 0 2024-09-21T12:20:37.461 INFO:tasks.workunit.client.1.smithi192.stdout:1/968: creat d2/da/d6b/d108/f141 x:0 0 0 2024-09-21T12:20:37.462 INFO:tasks.workunit.client.0.smithi003.stdout:0/385: write d9/d12/d17/f19 [246922,106513] 0 2024-09-21T12:20:37.462 INFO:tasks.workunit.client.0.smithi003.stdout:6/385: link d4/d11/d1d/l1e d4/d13/d2e/l7d 0 2024-09-21T12:20:37.463 INFO:tasks.workunit.client.0.smithi003.stdout:6/386: dread - d4/d11/d32/f5f zero size 2024-09-21T12:20:37.463 INFO:tasks.workunit.client.1.smithi192.stdout:2/928: mknod d1b/d1e/d7b/dfb/c12f 0 2024-09-21T12:20:37.464 INFO:tasks.workunit.client.0.smithi003.stdout:0/386: dread d9/d12/d17/d21/f31 [0,4194304] 0 2024-09-21T12:20:37.465 INFO:tasks.workunit.client.1.smithi192.stdout:7/910: dwrite d6/d9/d51/f10b [0,4194304] 0 2024-09-21T12:20:37.465 INFO:tasks.workunit.client.0.smithi003.stdout:6/387: fsync d4/d13/d2e/d37/d58/f5c 0 2024-09-21T12:20:37.466 INFO:tasks.workunit.client.0.smithi003.stdout:0/387: fdatasync d9/d6c/f1b 0 2024-09-21T12:20:37.466 INFO:tasks.workunit.client.1.smithi192.stdout:3/896: mkdir db/d16/d18/d40/d142 0 2024-09-21T12:20:37.469 INFO:tasks.workunit.client.0.smithi003.stdout:4/290: creat d9/d25/f5e x:0 0 0 2024-09-21T12:20:37.470 INFO:tasks.workunit.client.1.smithi192.stdout:1/969: readlink d2/da/d9f/lcb 0 2024-09-21T12:20:37.470 INFO:tasks.workunit.client.0.smithi003.stdout:4/291: chown d9/da/f27 96 1 2024-09-21T12:20:37.473 INFO:tasks.workunit.client.1.smithi192.stdout:3/897: dwrite db/d16/d18/d40/dd1/f10c [0,4194304] 0 2024-09-21T12:20:37.474 INFO:tasks.workunit.client.0.smithi003.stdout:7/327: creat d8/f7b x:0 0 0 2024-09-21T12:20:37.474 INFO:tasks.workunit.client.0.smithi003.stdout:4/292: chown d9/f18 593205295 1 2024-09-21T12:20:37.476 INFO:tasks.workunit.client.0.smithi003.stdout:0/388: dread d9/d12/d17/d38/d3a/d46/d55/d67/f64 [0,4194304] 0 2024-09-21T12:20:37.479 INFO:tasks.workunit.client.1.smithi192.stdout:7/911: mkdir d6/d20/d137 0 2024-09-21T12:20:37.486 INFO:tasks.workunit.client.0.smithi003.stdout:7/328: dwrite d8/db/f16 [0,4194304] 0 2024-09-21T12:20:37.486 INFO:tasks.workunit.client.1.smithi192.stdout:1/970: fdatasync d2/da/d6b/f109 0 2024-09-21T12:20:37.486 INFO:tasks.workunit.client.1.smithi192.stdout:4/903: dread d2/d21/f2e [0,4194304] 0 2024-09-21T12:20:37.487 INFO:tasks.workunit.client.1.smithi192.stdout:4/904: chown d2/d21/f2e 568 1 2024-09-21T12:20:37.489 INFO:tasks.workunit.client.0.smithi003.stdout:8/345: write d7/de/f3e [95549,102508] 0 2024-09-21T12:20:37.489 INFO:tasks.workunit.client.1.smithi192.stdout:2/929: dread d1b/d1e/d62/f7f [0,4194304] 0 2024-09-21T12:20:37.489 INFO:tasks.workunit.client.1.smithi192.stdout:2/930: stat d1b/d1e/c78 0 2024-09-21T12:20:37.500 INFO:tasks.workunit.client.0.smithi003.stdout:0/389: mknod d9/d12/d17/d38/d3a/d46/d55/d57/c89 0 2024-09-21T12:20:37.503 INFO:tasks.workunit.client.0.smithi003.stdout:3/341: mkdir d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d3d/d42/d6d 0 2024-09-21T12:20:37.508 INFO:tasks.workunit.client.0.smithi003.stdout:4/293: dread d9/da/f22 [0,4194304] 0 2024-09-21T12:20:37.508 INFO:tasks.workunit.client.1.smithi192.stdout:4/905: creat d2/db/dd5/f133 x:0 0 0 2024-09-21T12:20:37.513 INFO:tasks.workunit.client.1.smithi192.stdout:7/912: dwrite d6/d9/d1f/d3e/f8c [0,4194304] 0 2024-09-21T12:20:37.514 INFO:tasks.workunit.client.0.smithi003.stdout:6/388: write d4/d11/d32/f3b [1493643,19677] 0 2024-09-21T12:20:37.516 INFO:tasks.workunit.client.0.smithi003.stdout:8/346: symlink d7/d57/d77/l7b 0 2024-09-21T12:20:37.516 INFO:tasks.workunit.client.1.smithi192.stdout:3/898: dwrite db/d16/d18/d33/d4a/de4/f114 [0,4194304] 0 2024-09-21T12:20:37.517 INFO:tasks.workunit.client.0.smithi003.stdout:4/294: symlink d9/da/d47/d4b/l5f 0 2024-09-21T12:20:37.517 INFO:tasks.workunit.client.0.smithi003.stdout:8/347: dread - d7/df/d20/d21/f3f zero size 2024-09-21T12:20:37.518 INFO:tasks.workunit.client.1.smithi192.stdout:2/931: truncate d1b/f87 4128876 0 2024-09-21T12:20:37.519 INFO:tasks.workunit.client.0.smithi003.stdout:6/389: dread d4/d13/f20 [0,4194304] 0 2024-09-21T12:20:37.520 INFO:tasks.workunit.client.1.smithi192.stdout:1/971: dwrite d2/d12/d2f/d51/f38 [0,4194304] 0 2024-09-21T12:20:37.521 INFO:tasks.workunit.client.0.smithi003.stdout:6/390: read d4/f5 [3627062,104894] 0 2024-09-21T12:20:37.522 INFO:tasks.workunit.client.1.smithi192.stdout:4/906: creat d2/d36/d7f/df5/d4f/d71/d9d/dad/d9c/d9e/f134 x:0 0 0 2024-09-21T12:20:37.522 INFO:tasks.workunit.client.1.smithi192.stdout:2/932: truncate d1b/d1e/d3d/fea 953401 0 2024-09-21T12:20:37.523 INFO:tasks.workunit.client.0.smithi003.stdout:7/329: creat d8/f7c x:0 0 0 2024-09-21T12:20:37.524 INFO:tasks.workunit.client.0.smithi003.stdout:7/330: fsync d8/db/f38 0 2024-09-21T12:20:37.525 INFO:tasks.workunit.client.0.smithi003.stdout:0/390: dread d9/fb [0,4194304] 0 2024-09-21T12:20:37.526 INFO:tasks.workunit.client.1.smithi192.stdout:7/913: unlink d6/d9/d51/l9d 0 2024-09-21T12:20:37.528 INFO:tasks.workunit.client.1.smithi192.stdout:3/899: dread db/d16/d18/da7/d10e/d2e/f45 [8388608,4194304] 0 2024-09-21T12:20:37.529 INFO:tasks.workunit.client.1.smithi192.stdout:4/907: truncate d2/f66 407889 0 2024-09-21T12:20:37.533 INFO:tasks.workunit.client.1.smithi192.stdout:1/972: dwrite d2/d12/d2f/d51/d24/d65/d8b/fd7 [0,4194304] 0 2024-09-21T12:20:37.537 INFO:tasks.workunit.client.1.smithi192.stdout:2/933: rename d1b/d1e/d5e/d75/da1/daf to d1b/d1e/d62/d99/d130 0 2024-09-21T12:20:37.539 INFO:tasks.workunit.client.0.smithi003.stdout:6/391: creat d4/d13/f7e x:0 0 0 2024-09-21T12:20:37.540 INFO:tasks.workunit.client.0.smithi003.stdout:9/443: sync 2024-09-21T12:20:37.540 INFO:tasks.workunit.client.1.smithi192.stdout:7/914: fsync d6/d9/f74 0 2024-09-21T12:20:37.541 INFO:tasks.workunit.client.0.smithi003.stdout:7/331: symlink d8/db/l7d 0 2024-09-21T12:20:37.542 INFO:tasks.workunit.client.1.smithi192.stdout:7/915: chown d6/d9/d51/la9 112048377 1 2024-09-21T12:20:37.543 INFO:tasks.workunit.client.1.smithi192.stdout:3/900: unlink db/d16/d18/d21/d23/d71/d77/d118/l120 0 2024-09-21T12:20:37.543 INFO:tasks.workunit.client.0.smithi003.stdout:3/342: link d0/d5/da/d28/c3c d0/d5/da/d28/d11/c6e 0 2024-09-21T12:20:37.546 INFO:tasks.workunit.client.0.smithi003.stdout:0/391: mkdir d9/d12/d1e/d5f/d8a 0 2024-09-21T12:20:37.546 INFO:tasks.workunit.client.1.smithi192.stdout:1/973: rmdir d2/de 39 2024-09-21T12:20:37.549 INFO:tasks.workunit.client.1.smithi192.stdout:2/934: creat d1b/d1e/d10d/f131 x:0 0 0 2024-09-21T12:20:37.550 INFO:tasks.workunit.client.1.smithi192.stdout:2/935: write d1b/d1e/d7b/dfb/f102 [613425,62860] 0 2024-09-21T12:20:37.554 INFO:tasks.workunit.client.0.smithi003.stdout:8/348: write d7/df/d16/f5c [1777261,66041] 0 2024-09-21T12:20:37.556 INFO:tasks.workunit.client.1.smithi192.stdout:7/916: mknod d6/d9/d11c/c138 0 2024-09-21T12:20:37.559 INFO:tasks.workunit.client.1.smithi192.stdout:3/901: mkdir db/d16/d18/d21/d23/d71/d77/d11c/d143 0 2024-09-21T12:20:37.559 INFO:tasks.workunit.client.0.smithi003.stdout:7/332: fdatasync d8/db/f58 0 2024-09-21T12:20:37.561 INFO:tasks.workunit.client.0.smithi003.stdout:3/343: fdatasync d0/f16 0 2024-09-21T12:20:37.565 INFO:tasks.workunit.client.1.smithi192.stdout:3/902: dwrite db/d16/d18/da7/d10e/f116 [0,4194304] 0 2024-09-21T12:20:37.566 INFO:tasks.workunit.client.0.smithi003.stdout:4/295: dread d9/da/f12 [0,4194304] 0 2024-09-21T12:20:37.566 INFO:tasks.workunit.client.0.smithi003.stdout:6/392: rename d4/d13/d19/d38/c48 to d4/d13/d19/d38/c7f 0 2024-09-21T12:20:37.569 INFO:tasks.workunit.client.1.smithi192.stdout:4/908: dwrite d2/d36/d7f/df5/d4f/d71/d12b/dc8/df7/d6c/f103 [0,4194304] 0 2024-09-21T12:20:37.570 INFO:tasks.workunit.client.0.smithi003.stdout:8/349: unlink d7/df/l44 0 2024-09-21T12:20:37.572 INFO:tasks.workunit.client.1.smithi192.stdout:4/909: dread - d2/d36/d7f/df5/d4f/d71/d12b/dc8/df7/d6c/db8/d88/f11c zero size 2024-09-21T12:20:37.572 INFO:tasks.workunit.client.0.smithi003.stdout:3/344: dread d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/f2c [0,4194304] 0 2024-09-21T12:20:37.575 INFO:tasks.workunit.client.0.smithi003.stdout:4/296: dwrite d9/d48/f51 [0,4194304] 0 2024-09-21T12:20:37.578 INFO:tasks.workunit.client.0.smithi003.stdout:3/345: truncate d0/d5/da/d28/d31/f63 1019545 0 2024-09-21T12:20:37.578 INFO:tasks.workunit.client.0.smithi003.stdout:7/333: mkdir d8/db/d32/d43/d7e 0 2024-09-21T12:20:37.586 INFO:tasks.workunit.client.1.smithi192.stdout:3/903: symlink db/d16/d18/d40/d60/d7b/dc0/l144 0 2024-09-21T12:20:37.586 INFO:tasks.workunit.client.1.smithi192.stdout:3/904: chown db/d16/d18/d21 30 1 2024-09-21T12:20:37.588 INFO:tasks.workunit.client.0.smithi003.stdout:8/350: mknod d7/de/d1a/c7c 0 2024-09-21T12:20:37.588 INFO:tasks.workunit.client.0.smithi003.stdout:8/351: chown d7/f78 1636 1 2024-09-21T12:20:37.593 INFO:tasks.workunit.client.1.smithi192.stdout:4/910: unlink d2/d36/d7f/df5/d4f/d71/d12b/dc8/df7/d6c/lb6 0 2024-09-21T12:20:37.594 INFO:tasks.workunit.client.0.smithi003.stdout:9/444: creat d2/d20/d22/d5e/d87/fa6 x:0 0 0 2024-09-21T12:20:37.598 INFO:tasks.workunit.client.1.smithi192.stdout:2/936: creat d1b/d1e/f132 x:0 0 0 2024-09-21T12:20:37.599 INFO:tasks.workunit.client.1.smithi192.stdout:2/937: chown d1b/d1e/d5e/d75/dfa/ffc 220563871 1 2024-09-21T12:20:37.599 INFO:tasks.workunit.client.0.smithi003.stdout:3/346: fdatasync d0/d5/da/d28/dd/f41 0 2024-09-21T12:20:37.602 INFO:tasks.workunit.client.1.smithi192.stdout:4/911: creat d2/d36/d7f/df5/d4f/d71/d9d/dad/f135 x:0 0 0 2024-09-21T12:20:37.602 INFO:tasks.workunit.client.0.smithi003.stdout:9/445: dwrite d2/f86 [0,4194304] 0 2024-09-21T12:20:37.604 INFO:tasks.workunit.client.1.smithi192.stdout:1/974: getdents d2/d12/d2f/d51 0 2024-09-21T12:20:37.606 INFO:tasks.workunit.client.0.smithi003.stdout:4/297: mknod d9/da/c60 0 2024-09-21T12:20:37.606 INFO:tasks.workunit.client.1.smithi192.stdout:2/938: creat d1b/d9e/f133 x:0 0 0 2024-09-21T12:20:37.609 INFO:tasks.workunit.client.1.smithi192.stdout:4/912: mkdir d2/db/d1a/d136 0 2024-09-21T12:20:37.611 INFO:tasks.workunit.client.1.smithi192.stdout:2/939: dread d1b/f52 [0,4194304] 0 2024-09-21T12:20:37.613 INFO:tasks.workunit.client.1.smithi192.stdout:3/905: getdents db/d16/d18/d33/d3b/db1/df1 0 2024-09-21T12:20:37.615 INFO:tasks.workunit.client.1.smithi192.stdout:7/917: dwrite d6/d133/ff8 [0,4194304] 0 2024-09-21T12:20:37.616 INFO:tasks.workunit.client.1.smithi192.stdout:4/913: unlink d2/db/d3e/d57/c106 0 2024-09-21T12:20:37.618 INFO:tasks.workunit.client.0.smithi003.stdout:4/298: write d9/d25/f5d [611423,44881] 0 2024-09-21T12:20:37.620 INFO:tasks.workunit.client.0.smithi003.stdout:0/392: dwrite d9/d6c/d26/f35 [0,4194304] 0 2024-09-21T12:20:37.620 INFO:tasks.workunit.client.0.smithi003.stdout:3/347: fsync d0/d5/f36 0 2024-09-21T12:20:37.621 INFO:tasks.workunit.client.1.smithi192.stdout:7/918: dwrite d6/d20/d69/d90/da7/dc1/f109 [4194304,4194304] 0 2024-09-21T12:20:37.623 INFO:tasks.workunit.client.1.smithi192.stdout:7/919: write d6/d9/d11c/f125 [461949,109838] 0 2024-09-21T12:20:37.629 INFO:tasks.workunit.client.1.smithi192.stdout:7/920: dwrite d6/d9/d1f/d3e/d7a/d8a/da2/fe8 [0,4194304] 0 2024-09-21T12:20:37.636 INFO:tasks.workunit.client.1.smithi192.stdout:3/906: rename db/l12 to db/d16/d18/d21/d23/d71/d77/d11c/d143/l145 0 2024-09-21T12:20:37.637 INFO:tasks.workunit.client.1.smithi192.stdout:3/907: chown db/d16/d18/da7/d10e/d2e/fc9 3872870 1 2024-09-21T12:20:37.639 INFO:tasks.workunit.client.0.smithi003.stdout:8/352: creat d7/de/f7d x:0 0 0 2024-09-21T12:20:37.642 INFO:tasks.workunit.client.1.smithi192.stdout:4/914: mkdir d2/d36/d7f/df5/d4f/d71/d9d/dad/d9c/d9e/dcf/d137 0 2024-09-21T12:20:37.643 INFO:tasks.workunit.client.0.smithi003.stdout:8/353: fsync d7/df/d20/d21/f50 0 2024-09-21T12:20:37.644 INFO:tasks.workunit.client.0.smithi003.stdout:4/299: truncate d9/f1a 1091826 0 2024-09-21T12:20:37.645 INFO:tasks.workunit.client.0.smithi003.stdout:8/354: dread - d7/d57/f71 zero size 2024-09-21T12:20:37.646 INFO:tasks.workunit.client.0.smithi003.stdout:4/300: readlink d9/d16/l44 0 2024-09-21T12:20:37.646 INFO:tasks.workunit.client.0.smithi003.stdout:3/348: mkdir d0/d5/da/d28/d11/d49/d4c/d6f 0 2024-09-21T12:20:37.647 INFO:tasks.workunit.client.0.smithi003.stdout:7/334: dwrite d8/db/f1c [4194304,4194304] 0 2024-09-21T12:20:37.650 INFO:tasks.workunit.client.0.smithi003.stdout:9/446: link d2/d53/f8d d2/d53/d83/fa7 0 2024-09-21T12:20:37.650 INFO:tasks.workunit.client.0.smithi003.stdout:0/393: symlink d9/d6c/l8b 0 2024-09-21T12:20:37.652 INFO:tasks.workunit.client.0.smithi003.stdout:8/355: unlink d7/lc 0 2024-09-21T12:20:37.654 INFO:tasks.workunit.client.0.smithi003.stdout:8/356: write d7/df/d20/d21/f6d [1540769,48118] 0 2024-09-21T12:20:37.656 INFO:tasks.workunit.client.1.smithi192.stdout:3/908: getdents db/d16/dc1/def/d125 0 2024-09-21T12:20:37.656 INFO:tasks.workunit.client.0.smithi003.stdout:3/349: creat d0/d5/da/f70 x:0 0 0 2024-09-21T12:20:37.657 INFO:tasks.workunit.client.1.smithi192.stdout:3/909: read db/d16/db4/fa2 [325914,8100] 0 2024-09-21T12:20:37.658 INFO:tasks.workunit.client.1.smithi192.stdout:2/940: link d1b/c28 d1b/d1e/d62/c134 0 2024-09-21T12:20:37.664 INFO:tasks.workunit.client.0.smithi003.stdout:7/335: dread d8/db/f2b [0,4194304] 0 2024-09-21T12:20:37.664 INFO:tasks.workunit.client.0.smithi003.stdout:3/350: rmdir d0 39 2024-09-21T12:20:37.666 INFO:tasks.workunit.client.1.smithi192.stdout:3/910: rename db/d16/d18/d21/d23/d71/fdb to db/d16/d18/f146 0 2024-09-21T12:20:37.670 INFO:tasks.workunit.client.0.smithi003.stdout:7/336: rename d8/db/d32/f50 to d8/d2c/f7f 0 2024-09-21T12:20:37.670 INFO:tasks.workunit.client.0.smithi003.stdout:0/394: dread d9/d12/d17/d38/d3a/d46/d55/d57/f76 [0,4194304] 0 2024-09-21T12:20:37.670 INFO:tasks.workunit.client.1.smithi192.stdout:3/911: write db/d16/d18/d33/d3b/db1/df1/f86 [1654611,81497] 0 2024-09-21T12:20:37.672 INFO:tasks.workunit.client.0.smithi003.stdout:0/395: write d9/d12/d17/f18 [3328951,40771] 0 2024-09-21T12:20:37.675 INFO:tasks.workunit.client.0.smithi003.stdout:8/357: getdents d7/de/d1a 0 2024-09-21T12:20:37.676 INFO:tasks.workunit.client.1.smithi192.stdout:3/912: symlink db/d16/d18/d40/d60/d7b/dc0/l147 0 2024-09-21T12:20:37.678 INFO:tasks.workunit.client.0.smithi003.stdout:7/337: symlink d8/db/d32/d43/d7e/l80 0 2024-09-21T12:20:37.681 INFO:tasks.workunit.client.0.smithi003.stdout:3/351: dwrite d0/d5/da/d28/d11/f34 [0,4194304] 0 2024-09-21T12:20:37.685 INFO:tasks.workunit.client.1.smithi192.stdout:3/913: truncate db/d16/d18/d33/d3b/faf 883587 0 2024-09-21T12:20:37.687 INFO:tasks.workunit.client.1.smithi192.stdout:2/941: dread d1b/d9e/de1/fc7 [0,4194304] 0 2024-09-21T12:20:37.688 INFO:tasks.workunit.client.0.smithi003.stdout:0/396: dwrite d9/d12/d17/d38/d47/f7a [0,4194304] 0 2024-09-21T12:20:37.690 INFO:tasks.workunit.client.0.smithi003.stdout:7/338: mkdir d8/d3c/d57/d81 0 2024-09-21T12:20:37.699 INFO:tasks.workunit.client.1.smithi192.stdout:4/915: dwrite d2/d36/fba [0,4194304] 0 2024-09-21T12:20:37.701 INFO:tasks.workunit.client.0.smithi003.stdout:9/447: dwrite d2/da/d17/d40/f57 [0,4194304] 0 2024-09-21T12:20:37.702 INFO:tasks.workunit.client.1.smithi192.stdout:7/921: dwrite d6/d3a/faa [0,4194304] 0 2024-09-21T12:20:37.704 INFO:tasks.workunit.client.0.smithi003.stdout:0/397: mknod d9/d12/d17/d21/d30/c8c 0 2024-09-21T12:20:37.707 INFO:tasks.workunit.client.0.smithi003.stdout:4/301: write d9/fc [986761,123861] 0 2024-09-21T12:20:37.710 INFO:tasks.workunit.client.1.smithi192.stdout:4/916: dwrite d2/d36/d7f/df5/d4f/d71/d12b/dc8/df7/d6c/db8/d88/d100/f12e [0,4194304] 0 2024-09-21T12:20:37.719 INFO:tasks.workunit.client.0.smithi003.stdout:9/448: unlink d2/da/d2a/l8b 0 2024-09-21T12:20:37.723 INFO:tasks.workunit.client.0.smithi003.stdout:4/302: rmdir d9/da 39 2024-09-21T12:20:37.723 INFO:tasks.workunit.client.0.smithi003.stdout:8/358: link d7/d57/l74 d7/df/d16/l7e 0 2024-09-21T12:20:37.726 INFO:tasks.workunit.client.0.smithi003.stdout:9/449: mkdir d2/da/d2a/d3c/da8 0 2024-09-21T12:20:37.727 INFO:tasks.workunit.client.0.smithi003.stdout:3/352: link d0/d5/f36 d0/f71 0 2024-09-21T12:20:37.732 INFO:tasks.workunit.client.0.smithi003.stdout:8/359: dwrite d7/de/f3e [0,4194304] 0 2024-09-21T12:20:37.733 INFO:tasks.workunit.client.0.smithi003.stdout:2/339: sync 2024-09-21T12:20:37.733 INFO:tasks.workunit.client.0.smithi003.stdout:1/341: sync 2024-09-21T12:20:37.733 INFO:tasks.workunit.client.0.smithi003.stdout:5/405: sync 2024-09-21T12:20:37.737 INFO:tasks.workunit.client.0.smithi003.stdout:0/398: write d9/d6c/d32/f6e [652,62464] 0 2024-09-21T12:20:37.739 INFO:tasks.workunit.client.0.smithi003.stdout:9/450: dwrite d2/d20/f21 [4194304,4194304] 0 2024-09-21T12:20:37.742 INFO:tasks.workunit.client.0.smithi003.stdout:4/303: dread d9/da/f22 [4194304,4194304] 0 2024-09-21T12:20:37.745 INFO:tasks.workunit.client.0.smithi003.stdout:0/399: write d9/d6c/d26/d54/f6f [1973540,6917] 0 2024-09-21T12:20:37.746 INFO:tasks.workunit.client.0.smithi003.stdout:2/340: mkdir d0/d21/d7d 0 2024-09-21T12:20:37.746 INFO:tasks.workunit.client.1.smithi192.stdout:1/975: sync 2024-09-21T12:20:37.748 INFO:tasks.workunit.client.0.smithi003.stdout:5/406: mknod dc/c85 0 2024-09-21T12:20:37.749 INFO:tasks.workunit.client.0.smithi003.stdout:8/360: dwrite d7/de/f3e [0,4194304] 0 2024-09-21T12:20:37.750 INFO:tasks.workunit.client.0.smithi003.stdout:7/339: write d8/db/f20 [1561350,54019] 0 2024-09-21T12:20:37.759 INFO:tasks.workunit.client.0.smithi003.stdout:1/342: rename d4/d11/d14/d25/d59/d65/d68 to d4/d11/d14/d25/d42/d7b 0 2024-09-21T12:20:37.759 INFO:tasks.workunit.client.0.smithi003.stdout:9/451: dwrite d2/da/d2a/f33 [0,4194304] 0 2024-09-21T12:20:37.761 INFO:tasks.workunit.client.0.smithi003.stdout:4/304: rmdir d9/d48/d49 39 2024-09-21T12:20:37.775 INFO:tasks.workunit.client.0.smithi003.stdout:5/407: rmdir dc/d15/d21 39 2024-09-21T12:20:37.779 INFO:tasks.workunit.client.0.smithi003.stdout:3/353: link d0/f19 d0/d5/da/d28/dd/f72 0 2024-09-21T12:20:37.783 INFO:tasks.workunit.client.0.smithi003.stdout:2/341: rename d0/d21/d7d to d0/dd/d22/d68/d7e 0 2024-09-21T12:20:37.787 INFO:tasks.workunit.client.0.smithi003.stdout:3/354: dwrite d0/d5/d38/f50 [0,4194304] 0 2024-09-21T12:20:37.788 INFO:tasks.workunit.client.0.smithi003.stdout:0/400: creat d9/d6c/d66/f8d x:0 0 0 2024-09-21T12:20:37.790 INFO:tasks.workunit.client.0.smithi003.stdout:8/361: symlink d7/df/d20/d21/d4c/d4d/d75/l7f 0 2024-09-21T12:20:37.793 INFO:tasks.workunit.client.0.smithi003.stdout:8/362: truncate d7/df/d20/d21/f3f 980963 0 2024-09-21T12:20:37.793 INFO:tasks.workunit.client.0.smithi003.stdout:5/408: rename dc/d2b/f80 to dc/d15/d26/f86 0 2024-09-21T12:20:37.798 INFO:tasks.workunit.client.0.smithi003.stdout:1/343: dread d4/f3a [0,4194304] 0 2024-09-21T12:20:37.799 INFO:tasks.workunit.client.0.smithi003.stdout:1/344: chown d4/d11/d14 27161 1 2024-09-21T12:20:37.802 INFO:tasks.workunit.client.0.smithi003.stdout:2/342: dwrite d0/d21/d2c/f58 [0,4194304] 0 2024-09-21T12:20:37.804 INFO:tasks.workunit.client.0.smithi003.stdout:0/401: creat d9/d6c/d26/d54/f8e x:0 0 0 2024-09-21T12:20:37.805 INFO:tasks.workunit.client.0.smithi003.stdout:3/355: creat d0/d5/da/d28/d11/d49/f73 x:0 0 0 2024-09-21T12:20:37.807 INFO:tasks.workunit.client.0.smithi003.stdout:3/356: read d0/d5/da/d28/d31/f63 [728713,77689] 0 2024-09-21T12:20:37.809 INFO:tasks.workunit.client.0.smithi003.stdout:3/357: truncate d0/d5/da/d28/f33 595768 0 2024-09-21T12:20:37.811 INFO:tasks.workunit.client.0.smithi003.stdout:8/363: mkdir d7/df/d20/d21/d4c/d4d/d80 0 2024-09-21T12:20:37.817 INFO:tasks.workunit.client.1.smithi192.stdout:3/914: mknod db/d16/d18/da7/c148 0 2024-09-21T12:20:37.819 INFO:tasks.workunit.client.0.smithi003.stdout:1/345: fdatasync d4/dc/f16 0 2024-09-21T12:20:37.820 INFO:tasks.workunit.client.1.smithi192.stdout:2/942: symlink d1b/d1e/d10d/l135 0 2024-09-21T12:20:37.827 INFO:tasks.workunit.client.1.smithi192.stdout:7/922: unlink d6/d20/dc9/ffd 0 2024-09-21T12:20:37.830 INFO:tasks.workunit.client.0.smithi003.stdout:3/358: mkdir d0/d5/da/d74 0 2024-09-21T12:20:37.832 INFO:tasks.workunit.client.0.smithi003.stdout:5/409: dread dc/d15/d21/f24 [0,4194304] 0 2024-09-21T12:20:37.832 INFO:tasks.workunit.client.0.smithi003.stdout:9/452: truncate d2/da/d35/d76/d94/f9b 2403200 0 2024-09-21T12:20:37.833 INFO:tasks.workunit.client.0.smithi003.stdout:3/359: truncate d0/d5/da/d28/dd/f2b 4373024 0 2024-09-21T12:20:37.834 INFO:tasks.workunit.client.0.smithi003.stdout:5/410: write dc/d15/d21/d28/d41/f7d [5186003,22256] 0 2024-09-21T12:20:37.834 INFO:tasks.workunit.client.0.smithi003.stdout:9/453: read d2/da/d17/d40/f57 [1960328,3540] 0 2024-09-21T12:20:37.836 INFO:tasks.workunit.client.0.smithi003.stdout:9/454: fsync d2/da/d2a/d89/d9c/f9d 0 2024-09-21T12:20:37.838 INFO:tasks.workunit.client.0.smithi003.stdout:9/455: write d2/da/d2a/f8c [709101,20588] 0 2024-09-21T12:20:37.839 INFO:tasks.workunit.client.0.smithi003.stdout:9/456: fsync d2/f86 0 2024-09-21T12:20:37.854 INFO:tasks.workunit.client.0.smithi003.stdout:3/360: dread d0/d5/f1e [0,4194304] 0 2024-09-21T12:20:37.899 INFO:tasks.workunit.client.1.smithi192.stdout:2/943: read - d1b/d38/d7d/fcb zero size 2024-09-21T12:20:37.910 INFO:tasks.workunit.client.0.smithi003.stdout:8/364: mkdir d7/de/d81 0 2024-09-21T12:20:37.910 INFO:tasks.workunit.client.0.smithi003.stdout:8/365: readlink d7/df/d16/l61 0 2024-09-21T12:20:37.918 INFO:tasks.workunit.client.0.smithi003.stdout:8/366: dread f4 [0,4194304] 0 2024-09-21T12:20:37.918 INFO:tasks.workunit.client.1.smithi192.stdout:2/944: rename d1b/d1e/d7b/dfb/d112/f11c to d1b/d65/d77/f136 0 2024-09-21T12:20:37.918 INFO:tasks.workunit.client.0.smithi003.stdout:6/393: sync 2024-09-21T12:20:37.920 INFO:tasks.workunit.client.0.smithi003.stdout:0/402: dwrite d9/d12/d17/d21/f31 [0,4194304] 0 2024-09-21T12:20:37.924 INFO:tasks.workunit.client.0.smithi003.stdout:4/305: link l2 d9/d48/l61 0 2024-09-21T12:20:37.926 INFO:tasks.workunit.client.0.smithi003.stdout:4/306: write d9/f15 [776540,121065] 0 2024-09-21T12:20:37.929 INFO:tasks.workunit.client.0.smithi003.stdout:8/367: dwrite d7/df/d20/d24/f2e [0,4194304] 0 2024-09-21T12:20:37.934 INFO:tasks.workunit.client.0.smithi003.stdout:0/403: dwrite d9/d12/d17/d38/d3a/d46/d55/d67/f28 [0,4194304] 0 2024-09-21T12:20:37.942 INFO:tasks.workunit.client.1.smithi192.stdout:2/945: mknod d1b/d1e/d5e/d88/d95/dbe/dd0/c137 0 2024-09-21T12:20:37.944 INFO:tasks.workunit.client.1.smithi192.stdout:7/923: mknod d6/d3a/d6d/d10c/c139 0 2024-09-21T12:20:37.947 INFO:tasks.workunit.client.0.smithi003.stdout:3/361: creat d0/d5/d38/f75 x:0 0 0 2024-09-21T12:20:37.950 INFO:tasks.workunit.client.1.smithi192.stdout:1/976: dwrite d2/d12/d2f/d41/d5c/d101/d12a/fbf [4194304,4194304] 0 2024-09-21T12:20:37.951 INFO:tasks.workunit.client.0.smithi003.stdout:1/346: getdents d4/d11/d14/d25/d42/d7b/d77 0 2024-09-21T12:20:37.953 INFO:tasks.workunit.client.1.smithi192.stdout:2/946: dwrite d1b/d1e/f116 [0,4194304] 0 2024-09-21T12:20:37.953 INFO:tasks.workunit.client.0.smithi003.stdout:1/347: dread - d4/d11/d14/d25/d42/f6e zero size 2024-09-21T12:20:37.961 INFO:tasks.workunit.client.1.smithi192.stdout:1/977: symlink d2/dae/l142 0 2024-09-21T12:20:37.966 INFO:tasks.workunit.client.1.smithi192.stdout:2/947: mkdir d1b/d1e/d5e/d88/d95/df2/d138 0 2024-09-21T12:20:37.966 INFO:tasks.workunit.client.1.smithi192.stdout:2/948: chown d1b/d38/d53/d8b/da2 5548 1 2024-09-21T12:20:37.967 INFO:tasks.workunit.client.0.smithi003.stdout:6/394: mkdir d4/d9/d59/d80 0 2024-09-21T12:20:37.969 INFO:tasks.workunit.client.1.smithi192.stdout:1/978: rename d2/d12/d2f/d51/d24/d65/dd4/lde to d2/d12/d2f/d51/d24/d65/d8e/d9d/db6/dc6/l143 0 2024-09-21T12:20:37.975 INFO:tasks.workunit.client.1.smithi192.stdout:1/979: dwrite d2/d12/fe4 [0,4194304] 0 2024-09-21T12:20:37.983 INFO:tasks.workunit.client.0.smithi003.stdout:7/340: sync 2024-09-21T12:20:37.984 INFO:tasks.workunit.client.1.smithi192.stdout:1/980: dread d2/da/d89/fc0 [0,4194304] 0 2024-09-21T12:20:37.988 INFO:tasks.workunit.client.1.smithi192.stdout:2/949: link d1b/d1e/la5 d1b/d65/d77/l139 0 2024-09-21T12:20:37.989 INFO:tasks.workunit.client.1.smithi192.stdout:2/950: chown d1b/d1e/l58 113265543 1 2024-09-21T12:20:37.989 INFO:tasks.workunit.client.0.smithi003.stdout:0/404: mknod d9/d6c/d32/c8f 0 2024-09-21T12:20:37.990 INFO:tasks.workunit.client.0.smithi003.stdout:2/343: getdents d0/d21/d30 0 2024-09-21T12:20:37.991 INFO:tasks.workunit.client.0.smithi003.stdout:0/405: write d9/d12/d17/f6d [476474,120840] 0 2024-09-21T12:20:37.994 INFO:tasks.workunit.client.1.smithi192.stdout:1/981: creat d2/d12/d2f/d51/d24/d65/dd4/f144 x:0 0 0 2024-09-21T12:20:37.994 INFO:tasks.workunit.client.0.smithi003.stdout:2/344: chown d0/dd/d22/d37/d3f/l60 80854040 1 2024-09-21T12:20:37.995 INFO:tasks.workunit.client.1.smithi192.stdout:1/982: write d2/d12/fa5 [597704,121474] 0 2024-09-21T12:20:37.998 INFO:tasks.workunit.client.1.smithi192.stdout:1/983: read d2/d12/d2f/d51/d24/d65/d5a/f5d [654460,97483] 0 2024-09-21T12:20:37.999 INFO:tasks.workunit.client.1.smithi192.stdout:1/984: write d2/da/d6b/ff7 [1973359,55285] 0 2024-09-21T12:20:38.001 INFO:tasks.workunit.client.0.smithi003.stdout:3/362: dwrite d0/d5/da/d28/dd/f2b [0,4194304] 0 2024-09-21T12:20:38.006 INFO:tasks.workunit.client.1.smithi192.stdout:2/951: dread ff [0,4194304] 0 2024-09-21T12:20:38.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:37 smithi192 ceph-mon[35641]: pgmap v5: 65 pgs: 65 active+clean; 2.3 GiB data, 6.9 GiB used, 529 GiB / 536 GiB avail 2024-09-21T12:20:38.024 INFO:tasks.workunit.client.1.smithi192.stdout:1/985: link d2/d12/d2f/d51/d24/l119 d2/da/l145 0 2024-09-21T12:20:38.028 INFO:tasks.workunit.client.1.smithi192.stdout:1/986: mkdir d2/d12/d2f/d51/d24/d65/d8e/d9d/db6/dc6/d146 0 2024-09-21T12:20:38.030 INFO:tasks.workunit.client.0.smithi003.stdout:3/363: unlink d0/f27 0 2024-09-21T12:20:38.031 INFO:tasks.workunit.client.0.smithi003.stdout:6/395: getdents d4/d11/d1d/d36 0 2024-09-21T12:20:38.035 INFO:tasks.workunit.client.0.smithi003.stdout:2/345: dwrite d0/f36 [0,4194304] 0 2024-09-21T12:20:38.038 INFO:tasks.workunit.client.0.smithi003.stdout:6/396: rmdir d4/d11/d32 39 2024-09-21T12:20:38.040 INFO:tasks.workunit.client.0.smithi003.stdout:6/397: write d4/d13/d2e/d37/d64/f74 [459693,31629] 0 2024-09-21T12:20:38.043 INFO:tasks.workunit.client.0.smithi003.stdout:2/346: mkdir d0/d21/d2f/d77/d7f 0 2024-09-21T12:20:38.045 INFO:tasks.workunit.client.0.smithi003.stdout:6/398: dread d4/f4a [0,4194304] 0 2024-09-21T12:20:38.047 INFO:tasks.workunit.client.0.smithi003.stdout:2/347: symlink d0/dd/d22/l80 0 2024-09-21T12:20:38.048 INFO:tasks.workunit.client.0.smithi003.stdout:6/399: write d4/f4a [3366959,98672] 0 2024-09-21T12:20:38.051 INFO:tasks.workunit.client.0.smithi003.stdout:6/400: fdatasync d4/f21 0 2024-09-21T12:20:38.053 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:37 smithi003 ceph-mon[28057]: pgmap v5: 65 pgs: 65 active+clean; 2.3 GiB data, 6.9 GiB used, 529 GiB / 536 GiB avail 2024-09-21T12:20:38.055 INFO:tasks.workunit.client.0.smithi003.stdout:6/401: rename d4/d11/f6e to d4/d9/d79/f81 0 2024-09-21T12:20:38.062 INFO:tasks.workunit.client.0.smithi003.stdout:6/402: dwrite d4/f10 [4194304,4194304] 0 2024-09-21T12:20:38.069 INFO:tasks.workunit.client.1.smithi192.stdout:3/915: truncate db/f4f 3925639 0 2024-09-21T12:20:38.072 INFO:tasks.workunit.client.1.smithi192.stdout:4/917: dwrite d2/d36/d7f/df5/f121 [4194304,4194304] 0 2024-09-21T12:20:38.073 INFO:tasks.workunit.client.1.smithi192.stdout:3/916: creat db/d16/d18/d40/d60/f149 x:0 0 0 2024-09-21T12:20:38.075 INFO:tasks.workunit.client.1.smithi192.stdout:4/918: truncate d2/d36/d7f/f63 4902622 0 2024-09-21T12:20:38.078 INFO:tasks.workunit.client.1.smithi192.stdout:3/917: creat db/d16/dc1/def/f14a x:0 0 0 2024-09-21T12:20:38.079 INFO:tasks.workunit.client.0.smithi003.stdout:2/348: dread d0/f3b [4194304,4194304] 0 2024-09-21T12:20:38.080 INFO:tasks.workunit.client.1.smithi192.stdout:4/919: read d2/f23 [1535302,49742] 0 2024-09-21T12:20:38.084 INFO:tasks.workunit.client.0.smithi003.stdout:2/349: creat d0/d21/f81 x:0 0 0 2024-09-21T12:20:38.092 INFO:tasks.workunit.client.1.smithi192.stdout:4/920: creat d2/d36/d7f/df5/d4f/d71/d12b/dc8/df7/d6c/db8/d111/f138 x:0 0 0 2024-09-21T12:20:38.095 INFO:tasks.workunit.client.0.smithi003.stdout:2/350: rename d0/d21/d2c/c4f to d0/d21/d2f/d49/c82 0 2024-09-21T12:20:38.098 INFO:tasks.workunit.client.0.smithi003.stdout:2/351: write d0/dd/d22/d37/f48 [225746,118958] 0 2024-09-21T12:20:38.099 INFO:tasks.workunit.client.1.smithi192.stdout:4/921: creat d2/db/d12d/f139 x:0 0 0 2024-09-21T12:20:38.102 INFO:tasks.workunit.client.0.smithi003.stdout:2/352: mkdir d0/d21/d2f/d49/d83 0 2024-09-21T12:20:38.102 INFO:tasks.workunit.client.1.smithi192.stdout:4/922: mkdir d2/d36/d7f/df5/d4f/d71/d9d/d13a 0 2024-09-21T12:20:38.103 INFO:tasks.workunit.client.1.smithi192.stdout:7/924: write d6/d9/d70/d77/f79 [584276,93128] 0 2024-09-21T12:20:38.105 INFO:tasks.workunit.client.1.smithi192.stdout:4/923: write d2/d36/d7f/df5/d4f/d71/d9d/dad/f135 [976879,31341] 0 2024-09-21T12:20:38.110 INFO:tasks.workunit.client.0.smithi003.stdout:2/353: link d0/dd/d22/f23 d0/dd/f84 0 2024-09-21T12:20:38.111 INFO:tasks.workunit.client.1.smithi192.stdout:7/925: getdents d6/d9/d2d 0 2024-09-21T12:20:38.113 INFO:tasks.workunit.client.1.smithi192.stdout:4/924: dread d2/d36/d7f/df5/d4f/d71/d12b/fbc [0,4194304] 0 2024-09-21T12:20:38.120 INFO:tasks.workunit.client.1.smithi192.stdout:4/925: fsync d2/db/d1a/dee/f77 0 2024-09-21T12:20:38.126 INFO:tasks.workunit.client.0.smithi003.stdout:2/354: dread d0/dd/f1b [0,4194304] 0 2024-09-21T12:20:38.127 INFO:tasks.workunit.client.1.smithi192.stdout:7/926: dread d6/d3a/d6d/f78 [4194304,4194304] 0 2024-09-21T12:20:38.128 INFO:tasks.workunit.client.0.smithi003.stdout:2/355: chown d0/d1c/d6a/f31 184353 1 2024-09-21T12:20:38.128 INFO:tasks.workunit.client.1.smithi192.stdout:7/927: fdatasync d6/d9/d70/d119/f121 0 2024-09-21T12:20:38.129 INFO:tasks.workunit.client.1.smithi192.stdout:4/926: truncate d2/d36/d7f/df5/d4f/d71/d12b/dc8/df7/d6c/db8/f79 3280468 0 2024-09-21T12:20:38.134 INFO:tasks.workunit.client.1.smithi192.stdout:2/952: getdents d1b/d65/d77 0 2024-09-21T12:20:38.137 INFO:tasks.workunit.client.0.smithi003.stdout:2/356: link d0/d21/d2f/f3a d0/dd/d22/f85 0 2024-09-21T12:20:38.140 INFO:tasks.workunit.client.1.smithi192.stdout:4/927: rename d2/d36/d7f/d68/f78 to d2/d36/d7f/df5/d4f/d71/d12b/dc8/df7/d6c/db8/d88/dd0/f13b 0 2024-09-21T12:20:38.145 INFO:tasks.workunit.client.0.smithi003.stdout:5/411: truncate dc/d15/d21/f64 1619600 0 2024-09-21T12:20:38.146 INFO:tasks.workunit.client.0.smithi003.stdout:8/368: write f0 [2767476,64014] 0 2024-09-21T12:20:38.150 INFO:tasks.workunit.client.0.smithi003.stdout:1/348: write d4/df/d19/f36 [244921,93478] 0 2024-09-21T12:20:38.153 INFO:tasks.workunit.client.0.smithi003.stdout:1/349: dread d4/d11/d14/f6a [0,4194304] 0 2024-09-21T12:20:38.161 INFO:tasks.workunit.client.0.smithi003.stdout:7/341: unlink d8/f4a 0 2024-09-21T12:20:38.164 INFO:tasks.workunit.client.0.smithi003.stdout:7/342: symlink d8/l82 0 2024-09-21T12:20:38.165 INFO:tasks.workunit.client.0.smithi003.stdout:7/343: write d8/db/ff [3503243,34910] 0 2024-09-21T12:20:38.165 INFO:tasks.workunit.client.0.smithi003.stdout:9/457: creat d2/da/d17/fa9 x:0 0 0 2024-09-21T12:20:38.167 INFO:tasks.workunit.client.0.smithi003.stdout:9/458: dread - d2/d20/f71 zero size 2024-09-21T12:20:38.172 INFO:tasks.workunit.client.0.smithi003.stdout:0/406: truncate d9/d12/d17/d38/d47/f7a 2720419 0 2024-09-21T12:20:38.173 INFO:tasks.workunit.client.0.smithi003.stdout:7/344: getdents d8/d3c 0 2024-09-21T12:20:38.175 INFO:tasks.workunit.client.1.smithi192.stdout:1/987: dwrite d2/d12/f92 [0,4194304] 0 2024-09-21T12:20:38.181 INFO:tasks.workunit.client.0.smithi003.stdout:7/345: creat d8/db/d32/d43/d7e/f83 x:0 0 0 2024-09-21T12:20:38.182 INFO:tasks.workunit.client.1.smithi192.stdout:1/988: read d2/d12/f94 [1597543,126928] 0 2024-09-21T12:20:38.183 INFO:tasks.workunit.client.0.smithi003.stdout:9/459: getdents d2/d20/d22 0 2024-09-21T12:20:38.184 INFO:tasks.workunit.client.0.smithi003.stdout:9/460: dread - d2/da/d2a/d89/d9c/f9d zero size 2024-09-21T12:20:38.186 INFO:tasks.workunit.client.1.smithi192.stdout:1/989: dwrite d2/d12/fe4 [0,4194304] 0 2024-09-21T12:20:38.188 INFO:tasks.workunit.client.0.smithi003.stdout:3/364: unlink d0/d5/da/d28/dd/f2d 0 2024-09-21T12:20:38.190 INFO:tasks.workunit.client.0.smithi003.stdout:7/346: chown d8/db/d13/l70 0 1 2024-09-21T12:20:38.193 INFO:tasks.workunit.client.0.smithi003.stdout:9/461: creat d2/d53/faa x:0 0 0 2024-09-21T12:20:38.194 INFO:tasks.workunit.client.1.smithi192.stdout:1/990: creat d2/d12/d2f/d41/d5c/d101/f147 x:0 0 0 2024-09-21T12:20:38.196 INFO:tasks.workunit.client.0.smithi003.stdout:3/365: creat d0/d5/da/d28/d11/d49/f76 x:0 0 0 2024-09-21T12:20:38.198 INFO:tasks.workunit.client.1.smithi192.stdout:1/991: mknod d2/d12/d2f/d41/d5c/d101/d12a/c148 0 2024-09-21T12:20:38.199 INFO:tasks.workunit.client.0.smithi003.stdout:6/403: truncate d4/d9/f50 3821921 0 2024-09-21T12:20:38.203 INFO:tasks.workunit.client.1.smithi192.stdout:2/953: rmdir d1b/d1e/d62 39 2024-09-21T12:20:38.206 INFO:tasks.workunit.client.0.smithi003.stdout:6/404: rename d4/d13/d19/c1b to d4/d13/d19/d23/c82 0 2024-09-21T12:20:38.207 INFO:tasks.workunit.client.0.smithi003.stdout:6/405: dread d4/d11/f2f [0,4194304] 0 2024-09-21T12:20:38.211 INFO:tasks.workunit.client.1.smithi192.stdout:2/954: unlink d1b/d38/d53/d8b/da7/fd4 0 2024-09-21T12:20:38.211 INFO:tasks.workunit.client.1.smithi192.stdout:2/955: fdatasync d1b/d9e/fa9 0 2024-09-21T12:20:38.214 INFO:tasks.workunit.client.0.smithi003.stdout:6/406: dwrite d4/d13/d22/f2b [0,4194304] 0 2024-09-21T12:20:38.215 INFO:tasks.workunit.client.1.smithi192.stdout:2/956: chown d1b/l9a 24 1 2024-09-21T12:20:38.217 INFO:tasks.workunit.client.0.smithi003.stdout:9/462: dread d2/da/d35/d76/f7e [0,4194304] 0 2024-09-21T12:20:38.218 INFO:tasks.workunit.client.1.smithi192.stdout:2/957: symlink d1b/d1e/d5e/d75/da1/de3/l13a 0 2024-09-21T12:20:38.219 INFO:tasks.workunit.client.1.smithi192.stdout:3/918: truncate db/d16/d18/d21/ffd 1294511 0 2024-09-21T12:20:38.224 INFO:tasks.workunit.client.1.smithi192.stdout:3/919: read db/d16/d18/d33/d4a/ff8 [11427690,60120] 0 2024-09-21T12:20:38.224 INFO:tasks.workunit.client.0.smithi003.stdout:9/463: rename d2/da/d2a/d89/d9c/fa3 to d2/da/d2a/d89/fab 0 2024-09-21T12:20:38.225 INFO:tasks.workunit.client.0.smithi003.stdout:9/464: fsync d2/d53/f90 0 2024-09-21T12:20:38.226 INFO:tasks.workunit.client.1.smithi192.stdout:2/958: symlink d1b/d1e/d5e/d88/l13b 0 2024-09-21T12:20:38.226 INFO:tasks.workunit.client.1.smithi192.stdout:2/959: fsync d1b/d38/f4d 0 2024-09-21T12:20:38.227 INFO:tasks.workunit.client.0.smithi003.stdout:4/307: symlink d9/l62 0 2024-09-21T12:20:38.229 INFO:tasks.workunit.client.1.smithi192.stdout:3/920: fsync db/d16/d18/da7/d10e/d2e/db8/dd0/fe0 0 2024-09-21T12:20:38.230 INFO:tasks.workunit.client.0.smithi003.stdout:9/465: dread d2/da/d2a/f8c [0,4194304] 0 2024-09-21T12:20:38.232 INFO:tasks.workunit.client.0.smithi003.stdout:1/350: unlink d4/c73 0 2024-09-21T12:20:38.233 INFO:tasks.workunit.client.1.smithi192.stdout:2/960: fsync d1b/d1e/f36 0 2024-09-21T12:20:38.235 INFO:tasks.workunit.client.1.smithi192.stdout:3/921: dwrite db/d16/d18/da7/d10e/d2e/f100 [0,4194304] 0 2024-09-21T12:20:38.236 INFO:tasks.workunit.client.1.smithi192.stdout:3/922: readlink db/d16/d112/l136 0 2024-09-21T12:20:38.238 INFO:tasks.workunit.client.0.smithi003.stdout:9/466: creat d2/da/d35/d76/d94/fac x:0 0 0 2024-09-21T12:20:38.242 INFO:tasks.workunit.client.0.smithi003.stdout:1/351: rename d4/f56 to d4/d11/d49/f7c 0 2024-09-21T12:20:38.245 INFO:tasks.workunit.client.0.smithi003.stdout:4/308: mknod d9/c63 0 2024-09-21T12:20:38.246 INFO:tasks.workunit.client.0.smithi003.stdout:4/309: stat d9/l43 0 2024-09-21T12:20:38.248 INFO:tasks.workunit.client.1.smithi192.stdout:2/961: mkdir d1b/d1e/d62/d13c 0 2024-09-21T12:20:38.250 INFO:tasks.workunit.client.1.smithi192.stdout:3/923: mknod db/d16/dc1/c14b 0 2024-09-21T12:20:38.250 INFO:tasks.workunit.client.1.smithi192.stdout:7/928: write d6/d9/d1f/f37 [3608135,62680] 0 2024-09-21T12:20:38.251 INFO:tasks.workunit.client.0.smithi003.stdout:9/467: symlink d2/da/d2a/d3c/da2/lad 0 2024-09-21T12:20:38.252 INFO:tasks.workunit.client.1.smithi192.stdout:3/924: write db/d16/db4/d8c/fd4 [1071074,78765] 0 2024-09-21T12:20:38.253 INFO:tasks.workunit.client.0.smithi003.stdout:2/357: write d0/dd/d22/d37/f74 [592620,121429] 0 2024-09-21T12:20:38.254 INFO:tasks.workunit.client.1.smithi192.stdout:4/928: write d2/d36/d7f/df5/d4f/d71/d9d/dad/d9c/d9e/dcf/f11b [2336916,28408] 0 2024-09-21T12:20:38.254 INFO:tasks.workunit.client.0.smithi003.stdout:9/468: read - d2/d20/f77 zero size 2024-09-21T12:20:38.257 INFO:tasks.workunit.client.0.smithi003.stdout:4/310: dwrite d9/d25/f5e [0,4194304] 0 2024-09-21T12:20:38.257 INFO:tasks.workunit.client.0.smithi003.stdout:9/469: dread - d2/d53/f93 zero size 2024-09-21T12:20:38.257 INFO:tasks.workunit.client.1.smithi192.stdout:2/962: read d1b/d1e/f2d [936643,64485] 0 2024-09-21T12:20:38.257 INFO:tasks.workunit.client.1.smithi192.stdout:7/929: mkdir d6/d133/dee/d13a 0 2024-09-21T12:20:38.262 INFO:tasks.workunit.client.0.smithi003.stdout:2/358: creat d0/dd/d22/d68/d7e/f86 x:0 0 0 2024-09-21T12:20:38.263 INFO:tasks.workunit.client.0.smithi003.stdout:2/359: truncate d0/d21/f4e 4304911 0 2024-09-21T12:20:38.264 INFO:tasks.workunit.client.1.smithi192.stdout:4/929: creat d2/d21/f13c x:0 0 0 2024-09-21T12:20:38.269 INFO:tasks.workunit.client.0.smithi003.stdout:1/352: dread d4/f3c [0,4194304] 0 2024-09-21T12:20:38.272 INFO:tasks.workunit.client.0.smithi003.stdout:2/360: unlink d0/d21/f39 0 2024-09-21T12:20:38.273 INFO:tasks.workunit.client.0.smithi003.stdout:2/361: chown d0/d1c/d6a/f19 3 1 2024-09-21T12:20:38.274 INFO:tasks.workunit.client.0.smithi003.stdout:2/362: write d0/f36 [4596961,58253] 0 2024-09-21T12:20:38.275 INFO:tasks.workunit.client.1.smithi192.stdout:4/930: creat d2/d36/d7f/df5/d4f/d71/d9d/dad/d4b/f13d x:0 0 0 2024-09-21T12:20:38.279 INFO:tasks.workunit.client.0.smithi003.stdout:4/311: creat d9/f64 x:0 0 0 2024-09-21T12:20:38.280 INFO:tasks.workunit.client.1.smithi192.stdout:7/930: unlink d6/d3a/f88 0 2024-09-21T12:20:38.285 INFO:tasks.workunit.client.1.smithi192.stdout:7/931: rmdir d6/d20/dc9 39 2024-09-21T12:20:38.287 INFO:tasks.workunit.client.0.smithi003.stdout:0/407: dwrite d9/d6c/d26/f3c [0,4194304] 0 2024-09-21T12:20:38.288 INFO:tasks.workunit.client.0.smithi003.stdout:1/353: dwrite d4/dc/f1c [0,4194304] 0 2024-09-21T12:20:38.289 INFO:tasks.workunit.client.0.smithi003.stdout:1/354: stat d4/d11/f2f 0 2024-09-21T12:20:38.289 INFO:tasks.workunit.client.1.smithi192.stdout:7/932: dread - d6/d20/d69/fb6 zero size 2024-09-21T12:20:38.294 INFO:tasks.workunit.client.0.smithi003.stdout:2/363: mknod d0/dd/d22/d68/c87 0 2024-09-21T12:20:38.298 INFO:tasks.workunit.client.0.smithi003.stdout:4/312: mkdir d9/d16/d65 0 2024-09-21T12:20:38.301 INFO:tasks.workunit.client.0.smithi003.stdout:3/366: mkdir d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d3d/d77 0 2024-09-21T12:20:38.302 INFO:tasks.workunit.client.0.smithi003.stdout:6/407: write d4/f5 [6672985,118896] 0 2024-09-21T12:20:38.306 INFO:tasks.workunit.client.0.smithi003.stdout:9/470: link d2/f97 d2/da/d99/fae 0 2024-09-21T12:20:38.308 INFO:tasks.workunit.client.0.smithi003.stdout:9/471: fdatasync d2/d20/d22/d5e/d87/fa1 0 2024-09-21T12:20:38.309 INFO:tasks.workunit.client.0.smithi003.stdout:3/367: mknod d0/d5/da/d28/d31/c78 0 2024-09-21T12:20:38.310 INFO:tasks.workunit.client.0.smithi003.stdout:3/368: dread - d0/d5/da/f70 zero size 2024-09-21T12:20:38.310 INFO:tasks.workunit.client.0.smithi003.stdout:1/355: symlink d4/l7d 0 2024-09-21T12:20:38.312 INFO:tasks.workunit.client.0.smithi003.stdout:0/408: link d9/d12/d1e/f1f d9/d12/d17/d38/d3a/d46/d55/f90 0 2024-09-21T12:20:38.314 INFO:tasks.workunit.client.0.smithi003.stdout:6/408: symlink d4/d9/l83 0 2024-09-21T12:20:38.315 INFO:tasks.workunit.client.0.smithi003.stdout:2/364: truncate d0/dd/d22/f23 237077 0 2024-09-21T12:20:38.316 INFO:tasks.workunit.client.0.smithi003.stdout:4/313: mkdir d9/da/d66 0 2024-09-21T12:20:38.318 INFO:tasks.workunit.client.0.smithi003.stdout:2/365: read d0/dd/d22/d68/f7a [291072,66910] 0 2024-09-21T12:20:38.319 INFO:tasks.workunit.client.0.smithi003.stdout:9/472: rename d2/d29 to d2/da/d2a/d3c/da2/daf 0 2024-09-21T12:20:38.320 INFO:tasks.workunit.client.0.smithi003.stdout:0/409: dwrite d9/d12/f81 [0,4194304] 0 2024-09-21T12:20:38.323 INFO:tasks.workunit.client.0.smithi003.stdout:6/409: mknod d4/d13/d2e/d37/d64/c84 0 2024-09-21T12:20:38.330 INFO:tasks.workunit.client.0.smithi003.stdout:3/369: mkdir d0/d5/da/d28/d31/d6b/d79 0 2024-09-21T12:20:38.330 INFO:tasks.workunit.client.0.smithi003.stdout:2/366: dwrite d0/dd/f29 [0,4194304] 0 2024-09-21T12:20:38.335 INFO:tasks.workunit.client.0.smithi003.stdout:0/410: mkdir d9/d12/d17/d38/d3a/d46/d55/d67/d2d/d91 0 2024-09-21T12:20:38.335 INFO:tasks.workunit.client.0.smithi003.stdout:9/473: dwrite d2/da/d2a/d3c/da2/daf/f7d [0,4194304] 0 2024-09-21T12:20:38.337 INFO:tasks.workunit.client.0.smithi003.stdout:3/370: stat d0/d5/da/d28/d11/l2a 0 2024-09-21T12:20:38.338 INFO:tasks.workunit.client.0.smithi003.stdout:4/314: unlink c7 0 2024-09-21T12:20:38.339 INFO:tasks.workunit.client.1.smithi192.stdout:3/925: write db/d16/d18/d21/d23/d71/d77/f7f [744837,105127] 0 2024-09-21T12:20:38.340 INFO:tasks.workunit.client.0.smithi003.stdout:3/371: fdatasync d0/d5/da/d28/d31/f6c 0 2024-09-21T12:20:38.342 INFO:tasks.workunit.client.0.smithi003.stdout:2/367: read d0/dd/d22/f57 [49502,89746] 0 2024-09-21T12:20:38.342 INFO:tasks.workunit.client.0.smithi003.stdout:4/315: dread d9/f1a [0,4194304] 0 2024-09-21T12:20:38.345 INFO:tasks.workunit.client.0.smithi003.stdout:6/410: creat d4/d11/d1d/d36/f85 x:0 0 0 2024-09-21T12:20:38.347 INFO:tasks.workunit.client.1.smithi192.stdout:3/926: dwrite db/d16/d18/d33/fbc [0,4194304] 0 2024-09-21T12:20:38.355 INFO:tasks.workunit.client.1.smithi192.stdout:2/963: dwrite d1b/d1e/d3d/f5a [4194304,4194304] 0 2024-09-21T12:20:38.355 INFO:tasks.workunit.client.1.smithi192.stdout:2/964: chown d1b/d65/ff7 8343 1 2024-09-21T12:20:38.357 INFO:tasks.workunit.client.1.smithi192.stdout:3/927: unlink db/d16/d18/d21/d23/d71/d77/d11c/d143/l145 0 2024-09-21T12:20:38.360 INFO:tasks.workunit.client.0.smithi003.stdout:0/411: truncate d9/d12/d17/d38/d3a/d46/d55/d57/f76 996414 0 2024-09-21T12:20:38.361 INFO:tasks.workunit.client.0.smithi003.stdout:0/412: read d9/d12/d17/f2f [184280,469] 0 2024-09-21T12:20:38.363 INFO:tasks.workunit.client.0.smithi003.stdout:6/411: symlink d4/d11/d17/l86 0 2024-09-21T12:20:38.364 INFO:tasks.workunit.client.0.smithi003.stdout:0/413: write d9/d12/d17/d38/d3a/d46/d55/d7b/f83 [327776,25818] 0 2024-09-21T12:20:38.367 INFO:tasks.workunit.client.1.smithi192.stdout:7/933: dwrite d6/d133/fea [0,4194304] 0 2024-09-21T12:20:38.372 INFO:tasks.workunit.client.0.smithi003.stdout:4/316: mkdir d9/da/d66/d67 0 2024-09-21T12:20:38.373 INFO:tasks.workunit.client.1.smithi192.stdout:2/965: getdents d1b/d1e/d5e/d75/d8d/dde 0 2024-09-21T12:20:38.383 INFO:tasks.workunit.client.1.smithi192.stdout:7/934: creat d6/d133/dee/d13a/f13b x:0 0 0 2024-09-21T12:20:38.384 INFO:tasks.workunit.client.1.smithi192.stdout:7/935: write d6/d9/d2d/dc4/f117 [423886,15012] 0 2024-09-21T12:20:38.385 INFO:tasks.workunit.client.0.smithi003.stdout:0/414: write d9/d6c/d26/f73 [1170492,31989] 0 2024-09-21T12:20:38.386 INFO:tasks.workunit.client.1.smithi192.stdout:2/966: rename d1b/ca6 to d1b/d38/d53/d8b/da7/c13d 0 2024-09-21T12:20:38.387 INFO:tasks.workunit.client.1.smithi192.stdout:2/967: fsync d1b/d1e/d62/d99/f124 0 2024-09-21T12:20:38.387 INFO:tasks.workunit.client.1.smithi192.stdout:3/928: dread db/fbe [0,4194304] 0 2024-09-21T12:20:38.388 INFO:tasks.workunit.client.1.smithi192.stdout:2/968: chown d1b/d1e/d62 12670 1 2024-09-21T12:20:38.388 INFO:tasks.workunit.client.0.smithi003.stdout:1/356: dwrite d4/f26 [0,4194304] 0 2024-09-21T12:20:38.389 INFO:tasks.workunit.client.1.smithi192.stdout:2/969: chown d1b/d1e/d5e/d88/faa 1743172065 1 2024-09-21T12:20:38.389 INFO:tasks.workunit.client.1.smithi192.stdout:2/970: chown d1b/d1e/d7b/dfb/f102 83305 1 2024-09-21T12:20:38.390 INFO:tasks.workunit.client.0.smithi003.stdout:1/357: chown d4/d11/d14/c2c 698709 1 2024-09-21T12:20:38.395 INFO:tasks.workunit.client.0.smithi003.stdout:6/412: rename d4/d11/d1d/l3a to d4/d11/d32/l87 0 2024-09-21T12:20:38.400 INFO:tasks.workunit.client.0.smithi003.stdout:4/317: symlink d9/da/d66/d67/l68 0 2024-09-21T12:20:38.401 INFO:tasks.workunit.client.1.smithi192.stdout:7/936: dread d6/d9/f11 [0,4194304] 0 2024-09-21T12:20:38.403 INFO:tasks.workunit.client.0.smithi003.stdout:9/474: truncate d2/f10 1404408 0 2024-09-21T12:20:38.407 INFO:tasks.workunit.client.0.smithi003.stdout:3/372: write d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d3d/f53 [851989,44980] 0 2024-09-21T12:20:38.409 INFO:tasks.workunit.client.1.smithi192.stdout:2/971: getdents d1b/d1e/d5e/d88/d95/dbe/dd0/ddd 0 2024-09-21T12:20:38.411 INFO:tasks.workunit.client.1.smithi192.stdout:7/937: symlink d6/d9/d70/d119/d120/l13c 0 2024-09-21T12:20:38.413 INFO:tasks.workunit.client.0.smithi003.stdout:1/358: symlink d4/d11/l7e 0 2024-09-21T12:20:38.415 INFO:tasks.workunit.client.0.smithi003.stdout:3/373: dwrite d0/d5/d38/d55/f65 [0,4194304] 0 2024-09-21T12:20:38.417 INFO:tasks.workunit.client.0.smithi003.stdout:3/374: fsync d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/f30 0 2024-09-21T12:20:38.419 INFO:tasks.workunit.client.0.smithi003.stdout:9/475: dread d2/d20/f39 [0,4194304] 0 2024-09-21T12:20:38.419 INFO:tasks.workunit.client.1.smithi192.stdout:2/972: getdents d1b/d1e/d5e/d88/d95/dbe/dd0/ddd 0 2024-09-21T12:20:38.420 INFO:tasks.workunit.client.1.smithi192.stdout:2/973: truncate d1b/d1e/d10d/f131 971075 0 2024-09-21T12:20:38.422 INFO:tasks.workunit.client.0.smithi003.stdout:0/415: creat d9/f92 x:0 0 0 2024-09-21T12:20:38.426 INFO:tasks.workunit.client.1.smithi192.stdout:2/974: creat d1b/d1e/d5e/d75/da1/de3/f13e x:0 0 0 2024-09-21T12:20:38.426 INFO:tasks.workunit.client.0.smithi003.stdout:2/368: link d0/dd/d22/f23 d0/d21/d2f/d77/d7f/f88 0 2024-09-21T12:20:38.426 INFO:tasks.workunit.client.1.smithi192.stdout:2/975: dread - d1b/d1e/d62/d99/fe2 zero size 2024-09-21T12:20:38.430 INFO:tasks.workunit.client.1.smithi192.stdout:3/929: write db/d16/d18/da7/d10e/f84 [11043,102433] 0 2024-09-21T12:20:38.430 INFO:tasks.workunit.client.0.smithi003.stdout:3/375: rmdir d0/d5/da/d28/d11/d49/d4c 39 2024-09-21T12:20:38.439 INFO:tasks.workunit.client.0.smithi003.stdout:2/369: rename d0/f2 to d0/d21/d2f/d77/f89 0 2024-09-21T12:20:38.440 INFO:tasks.workunit.client.1.smithi192.stdout:3/930: creat db/d16/d18/d40/d142/f14c x:0 0 0 2024-09-21T12:20:38.442 INFO:tasks.workunit.client.0.smithi003.stdout:6/413: dwrite d4/d13/f20 [0,4194304] 0 2024-09-21T12:20:38.445 INFO:tasks.workunit.client.1.smithi192.stdout:3/931: mkdir db/d16/d18/d33/d3b/d99/d14d 0 2024-09-21T12:20:38.447 INFO:tasks.workunit.client.1.smithi192.stdout:7/938: dwrite d6/d133/f97 [0,4194304] 0 2024-09-21T12:20:38.449 INFO:tasks.workunit.client.0.smithi003.stdout:6/414: dwrite d4/d9/f15 [0,4194304] 0 2024-09-21T12:20:38.450 INFO:tasks.workunit.client.1.smithi192.stdout:3/932: truncate db/d16/d18/d33/d4a/f52 5159880 0 2024-09-21T12:20:38.452 INFO:tasks.workunit.client.0.smithi003.stdout:0/416: link d9/d12/d17/d38/d3a/d46/d55/d67/f4a d9/d12/d17/f93 0 2024-09-21T12:20:38.454 INFO:tasks.workunit.client.0.smithi003.stdout:6/415: chown d4/d11/l46 901 1 2024-09-21T12:20:38.455 INFO:tasks.workunit.client.1.smithi192.stdout:2/976: dwrite d1b/d38/d53/d8b/da0/fb9 [0,4194304] 0 2024-09-21T12:20:38.456 INFO:tasks.workunit.client.0.smithi003.stdout:2/370: creat d0/d21/d2c/d6c/f8a x:0 0 0 2024-09-21T12:20:38.457 INFO:tasks.workunit.client.1.smithi192.stdout:2/977: truncate d1b/d1e/d5e/d88/d95/dbe/dd0/f103 500322 0 2024-09-21T12:20:38.458 INFO:tasks.workunit.client.1.smithi192.stdout:3/933: creat db/d16/d18/d33/d3b/db1/f14e x:0 0 0 2024-09-21T12:20:38.459 INFO:tasks.workunit.client.0.smithi003.stdout:9/476: dwrite d2/d20/f71 [0,4194304] 0 2024-09-21T12:20:38.460 INFO:tasks.workunit.client.1.smithi192.stdout:2/978: dread d1b/d1e/d10d/f11e [0,4194304] 0 2024-09-21T12:20:38.463 INFO:tasks.workunit.client.0.smithi003.stdout:1/359: getdents d4/d11/d14/d25/d59 0 2024-09-21T12:20:38.465 INFO:tasks.workunit.client.1.smithi192.stdout:7/939: mkdir d6/d20/dc9/d13d 0 2024-09-21T12:20:38.472 INFO:tasks.workunit.client.1.smithi192.stdout:2/979: rmdir d1b/d1e/d5e/d88/d95/dbe/d111 39 2024-09-21T12:20:38.472 INFO:tasks.workunit.client.1.smithi192.stdout:3/934: creat db/d16/dc1/def/d111/f14f x:0 0 0 2024-09-21T12:20:38.481 INFO:tasks.workunit.client.1.smithi192.stdout:2/980: dwrite d1b/d1e/f69 [0,4194304] 0 2024-09-21T12:20:38.481 INFO:tasks.workunit.client.1.smithi192.stdout:3/935: dwrite db/d16/d18/d21/d23/f95 [0,4194304] 0 2024-09-21T12:20:38.483 INFO:tasks.workunit.client.1.smithi192.stdout:2/981: chown d1b/d1e/d5e/d75/d8d/d10b/d12b 0 1 2024-09-21T12:20:38.499 INFO:tasks.workunit.client.1.smithi192.stdout:7/940: dread d6/f38 [0,4194304] 0 2024-09-21T12:20:38.530 INFO:tasks.workunit.client.1.smithi192.stdout:1/992: sync 2024-09-21T12:20:38.589 INFO:tasks.workunit.client.1.smithi192.stdout:4/931: sync 2024-09-21T12:20:38.590 INFO:tasks.workunit.client.1.smithi192.stdout:4/932: dread - d2/d36/d7f/df5/d4f/d71/d9d/dad/d4b/f13d zero size 2024-09-21T12:20:38.594 INFO:tasks.workunit.client.1.smithi192.stdout:4/933: dread d2/f5 [0,4194304] 0 2024-09-21T12:20:38.646 INFO:tasks.workunit.client.0.smithi003.stdout:1/360: rename d4/d11/d49/f4b to d4/df/d41/f7f 0 2024-09-21T12:20:38.652 INFO:tasks.workunit.client.0.smithi003.stdout:0/417: link d9/f4c d9/d12/d17/d38/d3a/d46/f94 0 2024-09-21T12:20:38.652 INFO:tasks.workunit.client.0.smithi003.stdout:1/361: dread d4/d11/d14/d25/d42/d63/f6b [0,4194304] 0 2024-09-21T12:20:38.653 INFO:tasks.workunit.client.1.smithi192.stdout:3/936: symlink db/d16/d18/d33/d3b/d99/l150 0 2024-09-21T12:20:38.654 INFO:tasks.workunit.client.1.smithi192.stdout:3/937: chown db/d16/d18/da7/d10e/f116 7372009 1 2024-09-21T12:20:38.656 INFO:tasks.workunit.client.1.smithi192.stdout:2/982: creat d1b/d1e/d5e/d75/dfa/f13f x:0 0 0 2024-09-21T12:20:38.657 INFO:tasks.workunit.client.1.smithi192.stdout:3/938: dread db/d16/fa8 [0,4194304] 0 2024-09-21T12:20:38.659 INFO:tasks.workunit.client.1.smithi192.stdout:1/993: unlink d2/d12/d2f/d51/fef 0 2024-09-21T12:20:38.660 INFO:tasks.workunit.client.1.smithi192.stdout:4/934: truncate d2/d36/d7f/df5/d4f/d71/d9d/dad/d4b/f62 1439709 0 2024-09-21T12:20:38.667 INFO:tasks.workunit.client.0.smithi003.stdout:0/418: write d9/d12/d17/d38/d3a/d46/f94 [947060,2465] 0 2024-09-21T12:20:38.667 INFO:tasks.workunit.client.0.smithi003.stdout:3/376: truncate d0/d5/da/d28/dd/f2b 632228 0 2024-09-21T12:20:38.670 INFO:tasks.workunit.client.0.smithi003.stdout:2/371: dwrite d0/d21/d2f/d50/f69 [0,4194304] 0 2024-09-21T12:20:38.670 INFO:tasks.workunit.client.1.smithi192.stdout:7/941: rename d6/d20/d69/l7d to d6/d20/d137/l13e 0 2024-09-21T12:20:38.670 INFO:tasks.workunit.client.0.smithi003.stdout:0/419: readlink d9/d12/d17/d38/d3a/d46/d55/d67/l5d 0 2024-09-21T12:20:38.672 INFO:tasks.workunit.client.0.smithi003.stdout:1/362: rename d4/d11/d14/d25/d42/d7b/d77 to d4/dc/d80 0 2024-09-21T12:20:38.674 INFO:tasks.workunit.client.0.smithi003.stdout:9/477: creat d2/da/d35/fb0 x:0 0 0 2024-09-21T12:20:38.675 INFO:tasks.workunit.client.0.smithi003.stdout:9/478: stat d2/da/d17/c1e 0 2024-09-21T12:20:38.675 INFO:tasks.workunit.client.1.smithi192.stdout:3/939: symlink db/d16/d18/d21/d23/d71/l151 0 2024-09-21T12:20:38.675 INFO:tasks.workunit.client.0.smithi003.stdout:9/479: fsync d2/da/d2a/d3c/f4b 0 2024-09-21T12:20:38.676 INFO:tasks.workunit.client.1.smithi192.stdout:3/940: write db/d16/db4/fe8 [1399783,73524] 0 2024-09-21T12:20:38.679 INFO:tasks.workunit.client.0.smithi003.stdout:6/416: truncate d4/f10 9764409 0 2024-09-21T12:20:38.681 INFO:tasks.workunit.client.1.smithi192.stdout:4/935: dread d2/d36/d7f/df5/d4f/d71/d9d/dad/d9c/fab [0,4194304] 0 2024-09-21T12:20:38.684 INFO:tasks.workunit.client.1.smithi192.stdout:1/994: creat d2/da/d6b/d108/f149 x:0 0 0 2024-09-21T12:20:38.688 INFO:tasks.workunit.client.0.smithi003.stdout:3/377: rmdir d0/d5/da/d28/dd 39 2024-09-21T12:20:38.690 INFO:tasks.workunit.client.0.smithi003.stdout:2/372: rmdir d0/d1c/d6a 39 2024-09-21T12:20:38.695 INFO:tasks.workunit.client.0.smithi003.stdout:9/480: dread d2/d53/f7f [0,4194304] 0 2024-09-21T12:20:38.696 INFO:tasks.workunit.client.0.smithi003.stdout:0/420: dwrite d9/f4c [0,4194304] 0 2024-09-21T12:20:38.698 INFO:tasks.workunit.client.0.smithi003.stdout:0/421: write d9/d12/f13 [5179395,81812] 0 2024-09-21T12:20:38.700 INFO:tasks.workunit.client.0.smithi003.stdout:0/422: chown d9/d12/d17/d38/d3a/d46/d55/d67 23 1 2024-09-21T12:20:38.700 INFO:tasks.workunit.client.1.smithi192.stdout:2/983: mknod d1b/d1e/d5e/d75/da1/d105/d118/c140 0 2024-09-21T12:20:38.706 INFO:tasks.workunit.client.1.smithi192.stdout:3/941: dread - db/d16/d18/d21/d23/d71/fd8 zero size 2024-09-21T12:20:38.707 INFO:tasks.workunit.client.0.smithi003.stdout:6/417: mknod d4/d9/d59/c88 0 2024-09-21T12:20:38.707 INFO:tasks.workunit.client.1.smithi192.stdout:3/942: write db/d16/d18/d40/d60/fce [133111,123717] 0 2024-09-21T12:20:38.708 INFO:tasks.workunit.client.1.smithi192.stdout:3/943: chown db/ff7 177916 1 2024-09-21T12:20:38.711 INFO:tasks.workunit.client.1.smithi192.stdout:1/995: mkdir d2/d12/d2f/d51/d24/d14a 0 2024-09-21T12:20:38.716 INFO:tasks.workunit.client.0.smithi003.stdout:0/423: mknod d9/d12/d17/d21/c95 0 2024-09-21T12:20:38.717 INFO:tasks.workunit.client.0.smithi003.stdout:1/363: dread d4/dc/f10 [0,4194304] 0 2024-09-21T12:20:38.718 INFO:tasks.workunit.client.0.smithi003.stdout:0/424: fdatasync d9/d12/d17/d21/d30/f68 0 2024-09-21T12:20:38.720 INFO:tasks.workunit.client.0.smithi003.stdout:6/418: creat d4/d13/d22/f89 x:0 0 0 2024-09-21T12:20:38.721 INFO:tasks.workunit.client.0.smithi003.stdout:3/378: stat d0/d5/da/d28/d11/d49/d4c/c61 0 2024-09-21T12:20:38.722 INFO:tasks.workunit.client.0.smithi003.stdout:2/373: truncate d0/dd/d22/f85 1217360 0 2024-09-21T12:20:38.725 INFO:tasks.workunit.client.0.smithi003.stdout:1/364: dwrite d4/df/f74 [0,4194304] 0 2024-09-21T12:20:38.735 INFO:tasks.workunit.client.0.smithi003.stdout:6/419: fdatasync d4/d9/f50 0 2024-09-21T12:20:38.741 INFO:tasks.workunit.client.0.smithi003.stdout:9/481: getdents d2/da/d17 0 2024-09-21T12:20:38.742 INFO:tasks.workunit.client.0.smithi003.stdout:9/482: readlink d2/d20/l68 0 2024-09-21T12:20:38.748 INFO:tasks.workunit.client.0.smithi003.stdout:0/425: dread d9/d12/d17/f36 [0,4194304] 0 2024-09-21T12:20:38.749 INFO:tasks.workunit.client.0.smithi003.stdout:6/420: fsync d4/d9/f50 0 2024-09-21T12:20:38.753 INFO:tasks.workunit.client.0.smithi003.stdout:3/379: rmdir d0/d5/da/d74 0 2024-09-21T12:20:38.756 INFO:tasks.workunit.client.0.smithi003.stdout:9/483: rename d2/c98 to d2/da/d2a/d89/d9c/cb1 0 2024-09-21T12:20:38.756 INFO:tasks.workunit.client.0.smithi003.stdout:2/374: dread d0/ff [0,4194304] 0 2024-09-21T12:20:38.757 INFO:tasks.workunit.client.0.smithi003.stdout:2/375: truncate d0/d21/d30/f43 4542583 0 2024-09-21T12:20:38.757 INFO:tasks.workunit.client.0.smithi003.stdout:1/365: creat d4/f81 x:0 0 0 2024-09-21T12:20:38.761 INFO:tasks.workunit.client.0.smithi003.stdout:0/426: rmdir d9/d12/d17/d38/d3a/d46 39 2024-09-21T12:20:38.763 INFO:tasks.workunit.client.0.smithi003.stdout:2/376: dwrite d0/dd/d22/d68/d7e/f86 [0,4194304] 0 2024-09-21T12:20:38.764 INFO:tasks.workunit.client.0.smithi003.stdout:0/427: write d9/d12/d17/d21/f40 [2350120,129567] 0 2024-09-21T12:20:38.764 INFO:tasks.workunit.client.0.smithi003.stdout:6/421: creat d4/d9/f8a x:0 0 0 2024-09-21T12:20:38.768 INFO:tasks.workunit.client.1.smithi192.stdout:7/942: write d6/d9/d1f/f114 [1683197,70512] 0 2024-09-21T12:20:38.768 INFO:tasks.workunit.client.0.smithi003.stdout:3/380: creat d0/d5/d38/d55/f7a x:0 0 0 2024-09-21T12:20:38.769 INFO:tasks.workunit.client.1.smithi192.stdout:7/943: chown d6/d9/d1f/d3e/d7a/faf 296701458 1 2024-09-21T12:20:38.769 INFO:tasks.workunit.client.0.smithi003.stdout:3/381: stat d0/d5/da/l25 0 2024-09-21T12:20:38.771 INFO:tasks.workunit.client.1.smithi192.stdout:2/984: unlink d1b/d38/d53/d8b/da2/f126 0 2024-09-21T12:20:38.774 INFO:tasks.workunit.client.0.smithi003.stdout:9/484: read d2/da/d35/d76/d94/f9b [1682487,104096] 0 2024-09-21T12:20:38.775 INFO:tasks.workunit.client.1.smithi192.stdout:4/936: unlink d2/d36/d7f/df5/d4f/d71/d9d/dad/l10b 0 2024-09-21T12:20:38.777 INFO:tasks.workunit.client.1.smithi192.stdout:4/937: read d2/d36/d7f/df5/f121 [1171224,79225] 0 2024-09-21T12:20:38.782 INFO:tasks.workunit.client.1.smithi192.stdout:1/996: fsync d2/d12/d2f/ff6 0 2024-09-21T12:20:38.782 INFO:tasks.workunit.client.1.smithi192.stdout:1/997: truncate d2/d12/d2f/d51/d24/d65/dd4/f144 780962 0 2024-09-21T12:20:38.782 INFO:tasks.workunit.client.0.smithi003.stdout:3/382: dread d0/f16 [0,4194304] 0 2024-09-21T12:20:38.783 INFO:tasks.workunit.client.0.smithi003.stdout:6/422: mkdir d4/d13/d63/d8b 0 2024-09-21T12:20:38.784 INFO:tasks.workunit.client.0.smithi003.stdout:0/428: unlink d9/d12/d17/d38/d3a/c52 0 2024-09-21T12:20:38.793 INFO:tasks.workunit.client.1.smithi192.stdout:3/944: truncate db/d16/d18/d21/ffd 2113065 0 2024-09-21T12:20:38.795 INFO:tasks.workunit.client.0.smithi003.stdout:6/423: mkdir d4/d13/d5b/d8c 0 2024-09-21T12:20:38.804 INFO:tasks.workunit.client.0.smithi003.stdout:2/377: write d0/d1c/f61 [4662104,61333] 0 2024-09-21T12:20:38.806 INFO:tasks.workunit.client.0.smithi003.stdout:6/424: creat d4/d13/d63/f8d x:0 0 0 2024-09-21T12:20:38.807 INFO:tasks.workunit.client.0.smithi003.stdout:3/383: dread d0/d5/da/d28/d11/f1d [0,4194304] 0 2024-09-21T12:20:38.809 INFO:tasks.workunit.client.0.smithi003.stdout:0/429: rename d9/d12/d1e/f61 to d9/d12/d17/d38/d3a/d46/d55/d7b/f96 0 2024-09-21T12:20:38.810 INFO:tasks.workunit.client.0.smithi003.stdout:0/430: read - d9/d12/d17/d38/d3a/f72 zero size 2024-09-21T12:20:38.814 INFO:tasks.workunit.client.0.smithi003.stdout:2/378: mkdir d0/dd/d22/d8b 0 2024-09-21T12:20:38.816 INFO:tasks.workunit.client.0.smithi003.stdout:2/379: chown d0/f1d 8 1 2024-09-21T12:20:38.817 INFO:tasks.workunit.client.1.smithi192.stdout:2/985: dwrite d1b/d9e/ff5 [4194304,4194304] 0 2024-09-21T12:20:38.817 INFO:tasks.workunit.client.0.smithi003.stdout:3/384: chown d0/d5/d38/c56 4897 1 2024-09-21T12:20:38.818 INFO:tasks.workunit.client.0.smithi003.stdout:1/366: dwrite d4/df/f31 [0,4194304] 0 2024-09-21T12:20:38.819 INFO:tasks.workunit.client.0.smithi003.stdout:0/431: dread d9/d12/d17/d38/d3a/d46/d55/d67/f28 [0,4194304] 0 2024-09-21T12:20:38.819 INFO:tasks.workunit.client.1.smithi192.stdout:3/945: rmdir db/d16/dee 39 2024-09-21T12:20:38.820 INFO:tasks.workunit.client.1.smithi192.stdout:7/944: truncate d6/d9/d70/d77/f9a 894241 0 2024-09-21T12:20:38.821 INFO:tasks.workunit.client.0.smithi003.stdout:0/432: fsync d9/d12/d17/d38/d3a/d46/d55/d67/f74 0 2024-09-21T12:20:38.821 INFO:tasks.workunit.client.0.smithi003.stdout:9/485: link d2/c13 d2/da/d2a/d3c/da8/cb2 0 2024-09-21T12:20:38.828 INFO:tasks.workunit.client.1.smithi192.stdout:1/998: rmdir d2/d12/d2f/d51/d24/d65/dd4/d135 0 2024-09-21T12:20:38.830 INFO:tasks.workunit.client.1.smithi192.stdout:2/986: creat d1b/d1e/d5e/d88/d95/dbe/dd0/ddd/f141 x:0 0 0 2024-09-21T12:20:38.832 INFO:tasks.workunit.client.1.smithi192.stdout:4/938: dwrite d2/d36/d7f/df5/d4f/d71/d9d/dad/d4b/f64 [0,4194304] 0 2024-09-21T12:20:38.833 INFO:tasks.workunit.client.0.smithi003.stdout:1/367: creat d4/d11/d14/d25/d59/f82 x:0 0 0 2024-09-21T12:20:38.836 INFO:tasks.workunit.client.1.smithi192.stdout:1/999: dwrite d2/d12/f63 [0,4194304] 0 2024-09-21T12:20:38.839 INFO:tasks.workunit.client.0.smithi003.stdout:0/433: fsync d9/d12/d17/d38/d3a/d46/d55/d67/f64 0 2024-09-21T12:20:38.844 INFO:tasks.workunit.client.0.smithi003.stdout:1/368: creat d4/dc/d80/f83 x:0 0 0 2024-09-21T12:20:38.845 INFO:tasks.workunit.client.0.smithi003.stdout:1/369: read - d4/d11/d49/f7c zero size 2024-09-21T12:20:38.846 INFO:tasks.workunit.client.0.smithi003.stdout:9/486: mkdir d2/da0/db3 0 2024-09-21T12:20:38.848 INFO:tasks.workunit.client.0.smithi003.stdout:9/487: chown d2/d20/d42/l6d 213 1 2024-09-21T12:20:38.849 INFO:tasks.workunit.client.1.smithi192.stdout:2/987: rename d1b/d1e/d5e/d88/d95/le7 to d1b/d1e/d5e/d75/da1/d105/l142 0 2024-09-21T12:20:38.853 INFO:tasks.workunit.client.0.smithi003.stdout:1/370: chown d4/d11/d14/d25/d42/d63/l6c 0 1 2024-09-21T12:20:38.855 INFO:tasks.workunit.client.1.smithi192.stdout:3/946: creat db/d16/d18/f152 x:0 0 0 2024-09-21T12:20:38.859 INFO:tasks.workunit.client.0.smithi003.stdout:0/434: getdents d9/d12/d17/d38/d3a/d46/d55/d67/d2d/d91 0 2024-09-21T12:20:38.859 INFO:tasks.workunit.client.0.smithi003.stdout:0/435: chown d9/fb 976 1 2024-09-21T12:20:38.861 INFO:tasks.workunit.client.1.smithi192.stdout:7/945: write d6/d20/d69/d90/da7/dc1/fdf [194770,39156] 0 2024-09-21T12:20:38.862 INFO:tasks.workunit.client.1.smithi192.stdout:2/988: stat d1b/f6b 0 2024-09-21T12:20:38.862 INFO:tasks.workunit.client.1.smithi192.stdout:7/946: write d6/d133/fea [2628757,74544] 0 2024-09-21T12:20:38.863 INFO:tasks.workunit.client.1.smithi192.stdout:7/947: chown d6/d20/d69/cd2 3570 1 2024-09-21T12:20:38.864 INFO:tasks.workunit.client.0.smithi003.stdout:9/488: rename d2/d20/d22/d5e/f65 to d2/d53/d75/fb4 0 2024-09-21T12:20:38.867 INFO:tasks.workunit.client.1.smithi192.stdout:3/947: creat db/d16/d18/d21/d23/d71/d77/d11c/f153 x:0 0 0 2024-09-21T12:20:38.868 INFO:tasks.workunit.client.0.smithi003.stdout:0/436: creat d9/d6c/d26/d54/f97 x:0 0 0 2024-09-21T12:20:38.869 INFO:tasks.workunit.client.0.smithi003.stdout:1/371: dread f2 [0,4194304] 0 2024-09-21T12:20:38.870 INFO:tasks.workunit.client.1.smithi192.stdout:4/939: write d2/db/d1a/dee/f5e [1216561,6452] 0 2024-09-21T12:20:38.870 INFO:tasks.workunit.client.0.smithi003.stdout:3/385: dread d0/d5/da/d28/dd/f72 [0,4194304] 0 2024-09-21T12:20:38.871 INFO:tasks.workunit.client.1.smithi192.stdout:4/940: readlink d2/d36/d7f/df5/d4f/d71/la0 0 2024-09-21T12:20:38.872 INFO:tasks.workunit.client.1.smithi192.stdout:4/941: write d2/db/f26 [2236429,91785] 0 2024-09-21T12:20:38.872 INFO:tasks.workunit.client.0.smithi003.stdout:9/489: chown d2/da/d2a/d89/d9c/cb1 168225762 1 2024-09-21T12:20:38.875 INFO:tasks.workunit.client.0.smithi003.stdout:0/437: mknod d9/d12/d17/d38/d3a/d46/d55/d57/c98 0 2024-09-21T12:20:38.876 INFO:tasks.workunit.client.1.smithi192.stdout:7/948: dread d6/d9/d1f/f114 [0,4194304] 0 2024-09-21T12:20:38.877 INFO:tasks.workunit.client.1.smithi192.stdout:2/989: mknod d1b/d38/d53/d107/c143 0 2024-09-21T12:20:38.878 INFO:tasks.workunit.client.0.smithi003.stdout:0/438: chown d9/d12/d17/d38/d3a/d46/d55/d7b/f83 935022 1 2024-09-21T12:20:38.879 INFO:tasks.workunit.client.0.smithi003.stdout:3/386: dwrite d0/d5/da/d28/d31/f6c [0,4194304] 0 2024-09-21T12:20:38.881 INFO:tasks.workunit.client.0.smithi003.stdout:9/490: rename d2/da/d2a/d89/fab to d2/d53/fb5 0 2024-09-21T12:20:38.881 INFO:tasks.workunit.client.0.smithi003.stdout:1/372: getdents d4/d11/d14/d78 0 2024-09-21T12:20:38.883 INFO:tasks.workunit.client.0.smithi003.stdout:0/439: mknod d9/d6c/d26/c99 0 2024-09-21T12:20:38.883 INFO:tasks.workunit.client.0.smithi003.stdout:1/373: dread d4/f3a [0,4194304] 0 2024-09-21T12:20:38.886 INFO:tasks.workunit.client.1.smithi192.stdout:7/949: read d6/d9/d51/f32 [953903,79094] 0 2024-09-21T12:20:38.893 INFO:tasks.workunit.client.1.smithi192.stdout:3/948: rename db/d16/d18/d33/d3b/lb6 to db/l154 0 2024-09-21T12:20:38.894 INFO:tasks.workunit.client.0.smithi003.stdout:0/440: mkdir d9/d12/d17/d38/d3a/d46/d55/d7b/d9a 0 2024-09-21T12:20:38.895 INFO:tasks.workunit.client.0.smithi003.stdout:0/441: stat d9/la 0 2024-09-21T12:20:38.896 INFO:tasks.workunit.client.1.smithi192.stdout:7/950: unlink d6/f11f 0 2024-09-21T12:20:38.896 INFO:tasks.workunit.client.0.smithi003.stdout:3/387: truncate d0/d5/da/f3f 1484338 0 2024-09-21T12:20:38.897 INFO:tasks.workunit.client.0.smithi003.stdout:9/491: truncate d2/da/d99/fae 229576 0 2024-09-21T12:20:38.899 INFO:tasks.workunit.client.0.smithi003.stdout:3/388: chown d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d3d/d42/d6d 0 1 2024-09-21T12:20:38.899 INFO:tasks.workunit.client.1.smithi192.stdout:4/942: getdents d2/d36/d7f/df5/d4f/d71/d12b/dc8/df7/d6c/db8 0 2024-09-21T12:20:38.899 INFO:tasks.workunit.client.0.smithi003.stdout:1/374: creat d4/d66/f84 x:0 0 0 2024-09-21T12:20:38.901 INFO:tasks.workunit.client.0.smithi003.stdout:0/442: mknod d9/d12/d1e/d5f/c9b 0 2024-09-21T12:20:38.903 INFO:tasks.workunit.client.1.smithi192.stdout:2/990: rename d1b/d1e/d5e/d75/da1/d105/l142 to d1b/d9e/l144 0 2024-09-21T12:20:38.906 INFO:tasks.workunit.client.1.smithi192.stdout:3/949: rename db/d16/d18/d40/d60/d7b/dc0 to db/d16/dc1/dd5/d155 0 2024-09-21T12:20:38.909 INFO:tasks.workunit.client.0.smithi003.stdout:0/443: dwrite d9/f59 [0,4194304] 0 2024-09-21T12:20:38.911 INFO:tasks.workunit.client.0.smithi003.stdout:1/375: link d4/d11/f2a d4/df/d41/f85 0 2024-09-21T12:20:38.912 INFO:tasks.workunit.client.0.smithi003.stdout:1/376: dread - d4/d11/d14/d25/d42/f55 zero size 2024-09-21T12:20:38.913 INFO:tasks.workunit.client.0.smithi003.stdout:1/377: write d4/df/d19/f4e [3049290,61104] 0 2024-09-21T12:20:38.914 INFO:tasks.workunit.client.1.smithi192.stdout:7/951: rename d6/d9/c7f to d6/d20/dcc/d10e/c13f 0 2024-09-21T12:20:38.915 INFO:tasks.workunit.client.0.smithi003.stdout:1/378: write d4/df/f74 [5077133,116446] 0 2024-09-21T12:20:38.917 INFO:tasks.workunit.client.0.smithi003.stdout:1/379: dread - d4/df/d19/f6f zero size 2024-09-21T12:20:38.918 INFO:tasks.workunit.client.1.smithi192.stdout:3/950: creat db/d16/dc1/def/d111/f156 x:0 0 0 2024-09-21T12:20:38.918 INFO:tasks.workunit.client.0.smithi003.stdout:1/380: readlink d4/d11/d14/d25/d42/d63/l6c 0 2024-09-21T12:20:38.922 INFO:tasks.workunit.client.0.smithi003.stdout:3/389: write d0/d5/da/d28/dd/f72 [3783152,16533] 0 2024-09-21T12:20:38.923 INFO:tasks.workunit.client.1.smithi192.stdout:2/991: rename d1b/d1e/d3d/c81 to d1b/d1e/d5e/d88/d95/dbe/dd0/c145 0 2024-09-21T12:20:38.926 INFO:tasks.workunit.client.1.smithi192.stdout:7/952: readlink d6/d3a/l12b 0 2024-09-21T12:20:38.926 INFO:tasks.workunit.client.1.smithi192.stdout:7/953: chown d6/d9/d2d/fae 19166557 1 2024-09-21T12:20:38.927 INFO:tasks.workunit.client.0.smithi003.stdout:3/390: dread d0/d5/da/d28/dd/f72 [0,4194304] 0 2024-09-21T12:20:38.931 INFO:tasks.workunit.client.1.smithi192.stdout:3/951: creat db/d16/d18/d33/d4a/f157 x:0 0 0 2024-09-21T12:20:38.931 INFO:tasks.workunit.client.0.smithi003.stdout:1/381: mknod d4/d11/d14/c86 0 2024-09-21T12:20:38.932 INFO:tasks.workunit.client.1.smithi192.stdout:2/992: rmdir d1b/d1e/d5e/d75/d8d 39 2024-09-21T12:20:38.933 INFO:tasks.workunit.client.1.smithi192.stdout:2/993: chown d1b/d1e/d5e/d88/c11f 896942439 1 2024-09-21T12:20:38.933 INFO:tasks.workunit.client.0.smithi003.stdout:0/444: symlink d9/d12/d17/d38/d3a/d46/d55/d67/d2d/d91/l9c 0 2024-09-21T12:20:38.937 INFO:tasks.workunit.client.1.smithi192.stdout:3/952: mkdir db/d16/d18/d40/d142/d158 0 2024-09-21T12:20:38.939 INFO:tasks.workunit.client.0.smithi003.stdout:9/492: dwrite d2/da/d99/fae [0,4194304] 0 2024-09-21T12:20:38.939 INFO:tasks.workunit.client.1.smithi192.stdout:7/954: dwrite d6/d9/f11 [0,4194304] 0 2024-09-21T12:20:38.949 INFO:tasks.workunit.client.0.smithi003.stdout:9/493: dwrite d2/da/d17/f7a [0,4194304] 0 2024-09-21T12:20:38.956 INFO:tasks.workunit.client.1.smithi192.stdout:3/953: read db/d16/d18/d33/d4a/f5f [2568081,112278] 0 2024-09-21T12:20:38.957 INFO:tasks.workunit.client.1.smithi192.stdout:3/954: chown db/d16/d138 12086673 1 2024-09-21T12:20:38.958 INFO:tasks.workunit.client.1.smithi192.stdout:7/955: creat d6/d9/d70/d77/d100/f140 x:0 0 0 2024-09-21T12:20:38.963 INFO:tasks.workunit.client.0.smithi003.stdout:1/382: unlink d4/dc/f32 0 2024-09-21T12:20:38.966 INFO:tasks.workunit.client.1.smithi192.stdout:2/994: dread d1b/d1e/d3d/f5a [0,4194304] 0 2024-09-21T12:20:38.966 INFO:tasks.workunit.client.1.smithi192.stdout:3/955: creat db/d16/d138/f159 x:0 0 0 2024-09-21T12:20:38.966 INFO:tasks.workunit.client.0.smithi003.stdout:0/445: getdents d9/d12/d17/d38/d3a/d46/d55/d7b/d9a 0 2024-09-21T12:20:38.976 INFO:tasks.workunit.client.1.smithi192.stdout:7/956: mkdir d6/d9/d1f/d99/d141 0 2024-09-21T12:20:38.976 INFO:tasks.workunit.client.0.smithi003.stdout:1/383: symlink d4/d11/d14/d78/l87 0 2024-09-21T12:20:38.977 INFO:tasks.workunit.client.1.smithi192.stdout:7/957: write d6/d9/d70/d77/fb7 [456029,32987] 0 2024-09-21T12:20:38.977 INFO:tasks.workunit.client.0.smithi003.stdout:1/384: fsync d4/f5e 0 2024-09-21T12:20:38.978 INFO:tasks.workunit.client.0.smithi003.stdout:1/385: write d4/f81 [496829,127723] 0 2024-09-21T12:20:38.980 INFO:tasks.workunit.client.0.smithi003.stdout:9/494: creat d2/da/d35/fb6 x:0 0 0 2024-09-21T12:20:38.980 INFO:tasks.workunit.client.1.smithi192.stdout:2/995: dread d1b/d1e/d3d/f4b [4194304,4194304] 0 2024-09-21T12:20:38.984 INFO:tasks.workunit.client.1.smithi192.stdout:3/956: creat db/d16/dc1/def/d125/f15a x:0 0 0 2024-09-21T12:20:38.986 INFO:tasks.workunit.client.1.smithi192.stdout:2/996: dwrite d1b/d1e/d5e/d88/d95/dbe/dd0/f103 [0,4194304] 0 2024-09-21T12:20:38.986 INFO:tasks.workunit.client.1.smithi192.stdout:7/958: unlink d6/d9/c1b 0 2024-09-21T12:20:38.987 INFO:tasks.workunit.client.0.smithi003.stdout:9/495: dwrite d2/d53/faa [0,4194304] 0 2024-09-21T12:20:38.987 INFO:tasks.workunit.client.1.smithi192.stdout:2/997: write d1b/d1e/d5e/d88/d95/fb8 [1861237,15279] 0 2024-09-21T12:20:38.988 INFO:tasks.workunit.client.0.smithi003.stdout:9/496: fdatasync d2/f97 0 2024-09-21T12:20:38.988 INFO:tasks.workunit.client.1.smithi192.stdout:2/998: chown d1b/d1e/f2f 131175456 1 2024-09-21T12:20:38.989 INFO:tasks.workunit.client.1.smithi192.stdout:2/999: chown d1b/d65/d77/fcd 441860 1 2024-09-21T12:20:38.998 INFO:tasks.workunit.client.1.smithi192.stdout:7/959: unlink d6/ldd 0 2024-09-21T12:20:38.999 INFO:tasks.workunit.client.1.smithi192.stdout:3/957: fsync db/d16/d18/d33/d3b/fca 0 2024-09-21T12:20:39.000 INFO:tasks.workunit.client.1.smithi192.stdout:3/958: read db/d16/d18/da7/d10e/f116 [4803,28931] 0 2024-09-21T12:20:39.002 INFO:tasks.workunit.client.1.smithi192.stdout:3/959: mknod db/d16/d18/d21/d23/d71/d77/d118/c15b 0 2024-09-21T12:20:39.003 INFO:tasks.workunit.client.1.smithi192.stdout:3/960: chown db/d16/db4/d8c/fd4 129 1 2024-09-21T12:20:39.004 INFO:tasks.workunit.client.0.smithi003.stdout:9/497: mknod d2/d53/d83/cb7 0 2024-09-21T12:20:39.005 INFO:tasks.workunit.client.1.smithi192.stdout:7/960: creat d6/d9/d1f/d3e/d7a/d8a/f142 x:0 0 0 2024-09-21T12:20:39.006 INFO:tasks.workunit.client.1.smithi192.stdout:3/961: mknod db/d16/dc1/dd5/d155/c15c 0 2024-09-21T12:20:39.007 INFO:tasks.workunit.client.1.smithi192.stdout:7/961: chown d6/d9/d1f/f72 1441171 1 2024-09-21T12:20:39.008 INFO:tasks.workunit.client.0.smithi003.stdout:0/446: rename d9/d6c/d26/c45 to d9/d12/d17/c9d 0 2024-09-21T12:20:39.009 INFO:tasks.workunit.client.0.smithi003.stdout:9/498: symlink d2/da/d2a/d3c/lb8 0 2024-09-21T12:20:39.009 INFO:tasks.workunit.client.1.smithi192.stdout:7/962: chown d6/d3a/d63/f65 2 1 2024-09-21T12:20:39.009 INFO:tasks.workunit.client.0.smithi003.stdout:0/447: chown d9/d12/d17/d38/d3a/d46/d55/d67/d2d/d44 0 1 2024-09-21T12:20:39.010 INFO:tasks.workunit.client.1.smithi192.stdout:3/962: mknod db/d16/d18/d21/d23/d71/d77/d11c/d143/c15d 0 2024-09-21T12:20:39.011 INFO:tasks.workunit.client.0.smithi003.stdout:0/448: chown d9/d12/d17/d21/f42 236 1 2024-09-21T12:20:39.011 INFO:tasks.workunit.client.0.smithi003.stdout:0/449: chown d9/d12/f81 11605 1 2024-09-21T12:20:39.013 INFO:tasks.workunit.client.0.smithi003.stdout:0/450: read d9/d12/d17/f6d [92471,64461] 0 2024-09-21T12:20:39.013 INFO:tasks.workunit.client.1.smithi192.stdout:3/963: creat db/d16/d18/d33/d3b/d99/f15e x:0 0 0 2024-09-21T12:20:39.014 INFO:tasks.workunit.client.0.smithi003.stdout:0/451: fdatasync d9/d12/d17/f19 0 2024-09-21T12:20:39.015 INFO:tasks.workunit.client.0.smithi003.stdout:9/499: link d2/da/d35/fb0 d2/da0/fb9 0 2024-09-21T12:20:39.016 INFO:tasks.workunit.client.1.smithi192.stdout:7/963: dread d6/d9/d70/d77/fb0 [0,4194304] 0 2024-09-21T12:20:39.016 INFO:tasks.workunit.client.1.smithi192.stdout:7/964: stat d6/d9/d2d/dc4/cfc 0 2024-09-21T12:20:39.017 INFO:tasks.workunit.client.1.smithi192.stdout:3/964: creat db/d16/d18/d40/f15f x:0 0 0 2024-09-21T12:20:39.018 INFO:tasks.workunit.client.1.smithi192.stdout:3/965: read db/d16/d18/d33/d4a/de4/f114 [852938,15391] 0 2024-09-21T12:20:39.019 INFO:tasks.workunit.client.0.smithi003.stdout:0/452: unlink d9/d6c/d26/d54/f97 0 2024-09-21T12:20:39.022 INFO:tasks.workunit.client.0.smithi003.stdout:9/500: dwrite d2/da/d35/d76/f7e [0,4194304] 0 2024-09-21T12:20:39.025 INFO:tasks.workunit.client.0.smithi003.stdout:0/453: mkdir d9/d12/d17/d38/d3a/d46/d55/d9e 0 2024-09-21T12:20:39.029 INFO:tasks.workunit.client.0.smithi003.stdout:0/454: truncate d9/d12/d17/d38/d3a/d46/d55/d67/f74 4659206 0 2024-09-21T12:20:39.030 INFO:tasks.workunit.client.0.smithi003.stdout:9/501: symlink d2/d20/lba 0 2024-09-21T12:20:39.030 INFO:tasks.workunit.client.1.smithi192.stdout:3/966: dread db/d16/d18/da7/fbd [0,4194304] 0 2024-09-21T12:20:39.031 INFO:tasks.workunit.client.0.smithi003.stdout:0/455: creat d9/d12/d17/d21/f9f x:0 0 0 2024-09-21T12:20:39.033 INFO:tasks.workunit.client.1.smithi192.stdout:3/967: readlink db/d16/d18/d33/d3b/lcb 0 2024-09-21T12:20:39.034 INFO:tasks.workunit.client.1.smithi192.stdout:3/968: chown db/d16/d18/d21/d23/d71 51361 1 2024-09-21T12:20:39.036 INFO:tasks.workunit.client.0.smithi003.stdout:9/502: getdents d2/da/d2a/d3c/da2 0 2024-09-21T12:20:39.038 INFO:tasks.workunit.client.0.smithi003.stdout:9/503: fdatasync d2/da/d17/d40/f57 0 2024-09-21T12:20:39.039 INFO:tasks.workunit.client.0.smithi003.stdout:1/386: truncate d4/f26 3838915 0 2024-09-21T12:20:39.040 INFO:tasks.workunit.client.0.smithi003.stdout:9/504: chown d2/da/d2a/d3c/da2/lad 22163498 1 2024-09-21T12:20:39.041 INFO:tasks.workunit.client.0.smithi003.stdout:1/387: chown d4/d11/d14/c4d 6926 1 2024-09-21T12:20:39.044 INFO:tasks.workunit.client.0.smithi003.stdout:1/388: mknod d4/d11/d14/d25/d59/c88 0 2024-09-21T12:20:39.049 INFO:tasks.workunit.client.0.smithi003.stdout:1/389: fsync d4/dc/f16 0 2024-09-21T12:20:39.049 INFO:tasks.workunit.client.0.smithi003.stdout:9/505: dwrite d2/d53/f8d [0,4194304] 0 2024-09-21T12:20:39.054 INFO:tasks.workunit.client.0.smithi003.stdout:0/456: dread d9/d12/d17/d21/d30/f68 [0,4194304] 0 2024-09-21T12:20:39.054 INFO:tasks.workunit.client.0.smithi003.stdout:9/506: rename d2/da/d2a/d3c/c9f to d2/d53/d83/cbb 0 2024-09-21T12:20:39.059 INFO:tasks.workunit.client.1.smithi192.stdout:7/965: dwrite d6/d20/d69/d90/da7/dc1/fac [0,4194304] 0 2024-09-21T12:20:39.060 INFO:tasks.workunit.client.0.smithi003.stdout:0/457: dread d9/d12/d17/d38/d3a/d46/f94 [0,4194304] 0 2024-09-21T12:20:39.060 INFO:tasks.workunit.client.0.smithi003.stdout:9/507: mknod d2/d53/d83/cbc 0 2024-09-21T12:20:39.060 INFO:tasks.workunit.client.1.smithi192.stdout:7/966: readlink d6/d20/d69/l9c 0 2024-09-21T12:20:39.067 INFO:tasks.workunit.client.1.smithi192.stdout:7/967: dread - d6/d9/d1f/d3e/d7a/d8a/fbc zero size 2024-09-21T12:20:39.067 INFO:tasks.workunit.client.0.smithi003.stdout:9/508: creat d2/d53/d75/fbd x:0 0 0 2024-09-21T12:20:39.069 INFO:tasks.workunit.client.0.smithi003.stdout:0/458: dwrite d9/d6c/d32/f62 [0,4194304] 0 2024-09-21T12:20:39.073 INFO:tasks.workunit.client.0.smithi003.stdout:9/509: mknod d2/da/d2a/cbe 0 2024-09-21T12:20:39.074 INFO:tasks.workunit.client.0.smithi003.stdout:1/390: truncate d4/d11/f50 2050257 0 2024-09-21T12:20:39.076 INFO:tasks.workunit.client.0.smithi003.stdout:5/412: sync 2024-09-21T12:20:39.076 INFO:tasks.workunit.client.0.smithi003.stdout:4/318: sync 2024-09-21T12:20:39.076 INFO:tasks.workunit.client.0.smithi003.stdout:7/347: sync 2024-09-21T12:20:39.076 INFO:tasks.workunit.client.0.smithi003.stdout:8/369: sync 2024-09-21T12:20:39.083 INFO:tasks.workunit.client.0.smithi003.stdout:9/510: creat d2/d20/d42/da5/fbf x:0 0 0 2024-09-21T12:20:39.087 INFO:tasks.workunit.client.0.smithi003.stdout:5/413: symlink dc/d15/l87 0 2024-09-21T12:20:39.089 INFO:tasks.workunit.client.0.smithi003.stdout:9/511: creat d2/da/d35/d76/fc0 x:0 0 0 2024-09-21T12:20:39.092 INFO:tasks.workunit.client.0.smithi003.stdout:5/414: symlink dc/d15/d21/d28/l88 0 2024-09-21T12:20:39.092 INFO:tasks.workunit.client.1.smithi192.stdout:7/968: dwrite d6/d3a/f46 [4194304,4194304] 0 2024-09-21T12:20:39.095 INFO:tasks.workunit.client.0.smithi003.stdout:7/348: write d8/d2c/f2e [411903,60969] 0 2024-09-21T12:20:39.096 INFO:tasks.workunit.client.0.smithi003.stdout:0/459: dwrite d9/d12/d17/d38/d3a/d46/d55/f90 [8388608,4194304] 0 2024-09-21T12:20:39.099 INFO:tasks.workunit.client.0.smithi003.stdout:9/512: fsync d2/d53/d75/fb4 0 2024-09-21T12:20:39.102 INFO:tasks.workunit.client.0.smithi003.stdout:7/349: mkdir d8/d31/d84 0 2024-09-21T12:20:39.104 INFO:tasks.workunit.client.0.smithi003.stdout:5/415: mknod dc/d15/d21/d28/d41/d5b/d74/d7f/c89 0 2024-09-21T12:20:39.105 INFO:tasks.workunit.client.0.smithi003.stdout:5/416: read dc/d15/d21/f24 [2145615,84544] 0 2024-09-21T12:20:39.107 INFO:tasks.workunit.client.1.smithi192.stdout:7/969: rmdir d6/d20/d69/ddc 0 2024-09-21T12:20:39.108 INFO:tasks.workunit.client.0.smithi003.stdout:8/370: dread d7/de/f19 [0,4194304] 0 2024-09-21T12:20:39.111 INFO:tasks.workunit.client.0.smithi003.stdout:1/391: write d4/f26 [2344066,127471] 0 2024-09-21T12:20:39.112 INFO:tasks.workunit.client.0.smithi003.stdout:1/392: dread - d4/d11/d14/d25/d59/f82 zero size 2024-09-21T12:20:39.113 INFO:tasks.workunit.client.0.smithi003.stdout:9/513: rename d2/d20/d42/l6d to d2/da/d99/lc1 0 2024-09-21T12:20:39.113 INFO:tasks.workunit.client.0.smithi003.stdout:0/460: dread d9/d12/d17/f6d [0,4194304] 0 2024-09-21T12:20:39.118 INFO:tasks.workunit.client.0.smithi003.stdout:0/461: dread - d9/d12/d17/d38/d3a/d46/d55/d67/f4a zero size 2024-09-21T12:20:39.120 INFO:tasks.workunit.client.0.smithi003.stdout:0/462: write d9/d6c/d32/f6e [704004,68452] 0 2024-09-21T12:20:39.121 INFO:tasks.workunit.client.0.smithi003.stdout:7/350: dwrite d8/db/d32/d43/f76 [0,4194304] 0 2024-09-21T12:20:39.126 INFO:tasks.workunit.client.0.smithi003.stdout:0/463: mkdir d9/d12/d17/d38/d3a/d46/d55/d7b/da0 0 2024-09-21T12:20:39.127 INFO:tasks.workunit.client.0.smithi003.stdout:7/351: mkdir d8/db/d13/d85 0 2024-09-21T12:20:39.128 INFO:tasks.workunit.client.0.smithi003.stdout:8/371: write d7/df/d20/d21/f45 [898292,42662] 0 2024-09-21T12:20:39.131 INFO:tasks.workunit.client.0.smithi003.stdout:0/464: truncate d9/d12/d17/d38/d3a/d46/d55/d67/d2d/f77 951898 0 2024-09-21T12:20:39.131 INFO:tasks.workunit.client.0.smithi003.stdout:7/352: unlink d8/db/f20 0 2024-09-21T12:20:39.135 INFO:tasks.workunit.client.0.smithi003.stdout:1/393: dwrite d4/df/d41/f85 [4194304,4194304] 0 2024-09-21T12:20:39.136 INFO:tasks.workunit.client.0.smithi003.stdout:1/394: chown d4/dc 139557840 1 2024-09-21T12:20:39.137 INFO:tasks.workunit.client.0.smithi003.stdout:0/465: truncate d9/d12/d17/d38/d3a/d46/d55/d67/d2d/f77 1533551 0 2024-09-21T12:20:39.142 INFO:tasks.workunit.client.0.smithi003.stdout:1/395: getdents d4/df/d12 0 2024-09-21T12:20:39.144 INFO:tasks.workunit.client.0.smithi003.stdout:0/466: rmdir d9/d12/d17/d38/d3a/d46/d55/d67/d2d/d44 0 2024-09-21T12:20:39.149 INFO:tasks.workunit.client.0.smithi003.stdout:1/396: dwrite d4/dc/d80/f83 [0,4194304] 0 2024-09-21T12:20:39.151 INFO:tasks.workunit.client.0.smithi003.stdout:0/467: dread d9/d12/f81 [0,4194304] 0 2024-09-21T12:20:39.155 INFO:tasks.workunit.client.0.smithi003.stdout:0/468: dread d9/d12/d17/d38/d3a/d46/d55/d7b/f96 [0,4194304] 0 2024-09-21T12:20:39.157 INFO:tasks.workunit.client.0.smithi003.stdout:0/469: truncate d9/f4c 247758 0 2024-09-21T12:20:39.163 INFO:tasks.workunit.client.0.smithi003.stdout:1/397: dread d4/df/d19/f2b [0,4194304] 0 2024-09-21T12:20:39.165 INFO:tasks.workunit.client.0.smithi003.stdout:1/398: truncate d4/df/d12/f3b 238636 0 2024-09-21T12:20:39.165 INFO:tasks.workunit.client.0.smithi003.stdout:5/417: dread dc/d15/f19 [0,4194304] 0 2024-09-21T12:20:39.169 INFO:tasks.workunit.client.0.smithi003.stdout:5/418: rename dc/d15/f79 to dc/d15/d21/d28/d41/f8a 0 2024-09-21T12:20:39.170 INFO:tasks.workunit.client.0.smithi003.stdout:0/470: write d9/d12/d17/d38/d3a/d46/d55/d67/f4a [334505,123186] 0 2024-09-21T12:20:39.170 INFO:tasks.workunit.client.0.smithi003.stdout:1/399: dread d4/f26 [0,4194304] 0 2024-09-21T12:20:39.172 INFO:tasks.workunit.client.0.smithi003.stdout:5/419: fdatasync dc/d15/d21/d30/f34 0 2024-09-21T12:20:39.176 INFO:tasks.workunit.client.0.smithi003.stdout:0/471: rename d9/d12/d1e/l2a to d9/d6c/d26/d54/d88/la1 0 2024-09-21T12:20:39.176 INFO:tasks.workunit.client.0.smithi003.stdout:8/372: write d7/df/f1b [2724783,99772] 0 2024-09-21T12:20:39.176 INFO:tasks.workunit.client.0.smithi003.stdout:5/420: rmdir dc/d15/d21/d30/d35 39 2024-09-21T12:20:39.177 INFO:tasks.workunit.client.0.smithi003.stdout:0/472: dread - d9/d12/d17/d21/f9f zero size 2024-09-21T12:20:39.178 INFO:tasks.workunit.client.0.smithi003.stdout:8/373: stat d7/df/d20/d54/d7a 0 2024-09-21T12:20:39.180 INFO:tasks.workunit.client.0.smithi003.stdout:8/374: chown d7/df/d20/d21/d4c/c6a 57038796 1 2024-09-21T12:20:39.181 INFO:tasks.workunit.client.0.smithi003.stdout:8/375: dread - d7/d57/f71 zero size 2024-09-21T12:20:39.185 INFO:tasks.workunit.client.0.smithi003.stdout:8/376: rename d7/de/f7d to d7/df/f82 0 2024-09-21T12:20:39.186 INFO:tasks.workunit.client.0.smithi003.stdout:5/421: symlink dc/d15/d21/d28/d41/d5b/d74/d7f/d82/l8b 0 2024-09-21T12:20:39.187 INFO:tasks.workunit.client.0.smithi003.stdout:0/473: getdents d9/d12/d17/d38/d47 0 2024-09-21T12:20:39.189 INFO:tasks.workunit.client.0.smithi003.stdout:1/400: dwrite d4/d11/f4a [0,4194304] 0 2024-09-21T12:20:39.191 INFO:tasks.workunit.client.0.smithi003.stdout:5/422: chown dc/l18 20142331 1 2024-09-21T12:20:39.193 INFO:tasks.workunit.client.0.smithi003.stdout:0/474: getdents d9/d12/d1e/d5f/d8a 0 2024-09-21T12:20:39.193 INFO:tasks.workunit.client.0.smithi003.stdout:1/401: truncate d4/df/d41/f7f 976101 0 2024-09-21T12:20:39.196 INFO:tasks.workunit.client.0.smithi003.stdout:0/475: write d9/d12/d17/d38/d3a/d46/d55/d67/f4a [1142002,29767] 0 2024-09-21T12:20:39.199 INFO:tasks.workunit.client.1.smithi192.stdout:3/969: sync 2024-09-21T12:20:39.199 INFO:tasks.workunit.client.1.smithi192.stdout:4/943: sync 2024-09-21T12:20:39.201 INFO:tasks.workunit.client.0.smithi003.stdout:5/423: creat dc/f8c x:0 0 0 2024-09-21T12:20:39.202 INFO:tasks.workunit.client.0.smithi003.stdout:0/476: symlink d9/la2 0 2024-09-21T12:20:39.202 INFO:tasks.workunit.client.1.smithi192.stdout:3/970: fdatasync db/d16/d18/d33/fa1 0 2024-09-21T12:20:39.204 INFO:tasks.workunit.client.1.smithi192.stdout:4/944: mknod d2/d36/d7f/d68/c13e 0 2024-09-21T12:20:39.206 INFO:tasks.workunit.client.0.smithi003.stdout:8/377: dwrite f4 [0,4194304] 0 2024-09-21T12:20:39.207 INFO:tasks.workunit.client.0.smithi003.stdout:0/477: write d9/d12/d17/d38/d3a/d46/d55/d67/f74 [4910294,49535] 0 2024-09-21T12:20:39.209 INFO:tasks.workunit.client.0.smithi003.stdout:1/402: truncate d4/df/d41/f85 652420 0 2024-09-21T12:20:39.210 INFO:tasks.workunit.client.0.smithi003.stdout:1/403: chown d4/df/f74 0 1 2024-09-21T12:20:39.212 INFO:tasks.workunit.client.1.smithi192.stdout:4/945: rename d2/d36/d7f/df5/d4f/d71/d12b/dc8/f116 to d2/d36/d7f/df5/d4f/d71/d12b/dc8/df7/d6c/db8/d88/d100/f13f 0 2024-09-21T12:20:39.215 INFO:tasks.workunit.client.0.smithi003.stdout:0/478: dwrite d9/d6c/d66/f8d [0,4194304] 0 2024-09-21T12:20:39.219 INFO:tasks.workunit.client.0.smithi003.stdout:8/378: unlink d7/df/f82 0 2024-09-21T12:20:39.219 INFO:tasks.workunit.client.0.smithi003.stdout:0/479: dread - d9/d12/d17/d38/d3a/d46/d55/d67/d2d/f65 zero size 2024-09-21T12:20:39.221 INFO:tasks.workunit.client.0.smithi003.stdout:0/480: stat d9/d6c/d32 0 2024-09-21T12:20:39.222 INFO:tasks.workunit.client.0.smithi003.stdout:1/404: creat d4/d11/d14/d25/d42/f89 x:0 0 0 2024-09-21T12:20:39.223 INFO:tasks.workunit.client.0.smithi003.stdout:0/481: truncate d9/f92 848846 0 2024-09-21T12:20:39.225 INFO:tasks.workunit.client.0.smithi003.stdout:1/405: dread - d4/d11/d14/d25/d42/d7b/f7a zero size 2024-09-21T12:20:39.226 INFO:tasks.workunit.client.1.smithi192.stdout:3/971: dread db/d16/d18/d33/d4a/f52 [0,4194304] 0 2024-09-21T12:20:39.227 INFO:tasks.workunit.client.0.smithi003.stdout:1/406: truncate d4/d11/d14/f3f 3142069 0 2024-09-21T12:20:39.227 INFO:tasks.workunit.client.0.smithi003.stdout:0/482: rmdir d9/d6c/d26 39 2024-09-21T12:20:39.227 INFO:tasks.workunit.client.0.smithi003.stdout:1/407: fdatasync d4/df/f74 0 2024-09-21T12:20:39.233 INFO:tasks.workunit.client.0.smithi003.stdout:0/483: readlink d9/d6c/l5b 0 2024-09-21T12:20:39.233 INFO:tasks.workunit.client.0.smithi003.stdout:8/379: dread d7/df/d16/f5c [0,4194304] 0 2024-09-21T12:20:39.235 INFO:tasks.workunit.client.0.smithi003.stdout:8/380: readlink d7/df/d20/d21/l25 0 2024-09-21T12:20:39.236 INFO:tasks.workunit.client.0.smithi003.stdout:0/484: mknod d9/d12/ca3 0 2024-09-21T12:20:39.238 INFO:tasks.workunit.client.0.smithi003.stdout:5/424: dwrite dc/d15/d1c/f23 [0,4194304] 0 2024-09-21T12:20:39.241 INFO:tasks.workunit.client.1.smithi192.stdout:4/946: dread d2/d36/d7f/df5/d4f/d71/d12b/dc8/df7/d6c/ff0 [0,4194304] 0 2024-09-21T12:20:39.241 INFO:tasks.workunit.client.0.smithi003.stdout:5/425: fdatasync dc/d15/d1c/f58 0 2024-09-21T12:20:39.242 INFO:tasks.workunit.client.1.smithi192.stdout:3/972: dwrite db/ff7 [0,4194304] 0 2024-09-21T12:20:39.243 INFO:tasks.workunit.client.0.smithi003.stdout:8/381: rename d7/df/f1b to d7/df/f83 0 2024-09-21T12:20:39.243 INFO:tasks.workunit.client.0.smithi003.stdout:0/485: rmdir d9/d12/d1e/d5f 39 2024-09-21T12:20:39.244 INFO:tasks.workunit.client.0.smithi003.stdout:1/408: dwrite d4/f3c [4194304,4194304] 0 2024-09-21T12:20:39.253 INFO:tasks.workunit.client.1.smithi192.stdout:4/947: link d2/d36/d7f/df5/d4f/d71/d9d/dad/d4b/ccb d2/d36/d55/c140 0 2024-09-21T12:20:39.253 INFO:tasks.workunit.client.0.smithi003.stdout:1/409: dread d4/df/d19/f2b [0,4194304] 0 2024-09-21T12:20:39.254 INFO:tasks.workunit.client.1.smithi192.stdout:4/948: readlink d2/d36/d7f/d68/l73 0 2024-09-21T12:20:39.255 INFO:tasks.workunit.client.1.smithi192.stdout:3/973: rename db/d16/d18/d33/d3b/db1 to db/d16/d18/d160 0 2024-09-21T12:20:39.257 INFO:tasks.workunit.client.0.smithi003.stdout:5/426: rename dc/d15/d21/d30/d35/c71 to dc/d15/d21/d30/d4b/c8d 0 2024-09-21T12:20:39.258 INFO:tasks.workunit.client.1.smithi192.stdout:4/949: creat d2/d36/d7f/df5/d4f/d71/d9d/dad/d9c/d9e/f141 x:0 0 0 2024-09-21T12:20:39.260 INFO:tasks.workunit.client.0.smithi003.stdout:5/427: read dc/d15/d21/d30/f42 [1002336,4074] 0 2024-09-21T12:20:39.260 INFO:tasks.workunit.client.1.smithi192.stdout:3/974: read db/d16/d18/d33/d3b/faf [391778,109496] 0 2024-09-21T12:20:39.261 INFO:tasks.workunit.client.0.smithi003.stdout:1/410: mkdir d4/df/d19/d8a 0 2024-09-21T12:20:39.262 INFO:tasks.workunit.client.0.smithi003.stdout:0/486: mknod d9/d12/d17/d21/d30/d4d/ca4 0 2024-09-21T12:20:39.262 INFO:tasks.workunit.client.1.smithi192.stdout:4/950: fsync d2/d36/d7f/df5/d4f/d71/d9d/dad/d4b/f5a 0 2024-09-21T12:20:39.263 INFO:tasks.workunit.client.0.smithi003.stdout:1/411: truncate d4/d11/d14/d25/d42/f6e 185790 0 2024-09-21T12:20:39.266 INFO:tasks.workunit.client.1.smithi192.stdout:4/951: creat d2/d36/d55/f142 x:0 0 0 2024-09-21T12:20:39.267 INFO:tasks.workunit.client.1.smithi192.stdout:4/952: write d2/d36/d7f/df5/d4f/d82/fa1 [3889507,99317] 0 2024-09-21T12:20:39.268 INFO:tasks.workunit.client.0.smithi003.stdout:0/487: dread d9/d12/d17/f2f [0,4194304] 0 2024-09-21T12:20:39.269 INFO:tasks.workunit.client.1.smithi192.stdout:4/953: write d2/d36/d7f/df5/d4f/d71/d9d/dad/d9c/d9e/f124 [3934932,106380] 0 2024-09-21T12:20:39.270 INFO:tasks.workunit.client.0.smithi003.stdout:1/412: mkdir d4/d66/d8b 0 2024-09-21T12:20:39.274 INFO:tasks.workunit.client.0.smithi003.stdout:1/413: creat d4/d11/d14/d25/d42/f8c x:0 0 0 2024-09-21T12:20:39.275 INFO:tasks.workunit.client.1.smithi192.stdout:4/954: mkdir d2/d36/d7f/df5/d4f/d71/d9d/dad/d9c/d9e/dcf/d137/d143 0 2024-09-21T12:20:39.276 INFO:tasks.workunit.client.0.smithi003.stdout:0/488: dread d9/d12/d17/d38/d3a/d46/d55/d57/f76 [0,4194304] 0 2024-09-21T12:20:39.276 INFO:tasks.workunit.client.1.smithi192.stdout:7/970: sync 2024-09-21T12:20:39.276 INFO:tasks.workunit.client.1.smithi192.stdout:7/971: chown d6/d9/f5d 33488834 1 2024-09-21T12:20:39.278 INFO:tasks.workunit.client.1.smithi192.stdout:7/972: readlink d6/d9/d1f/l9b 0 2024-09-21T12:20:39.281 INFO:tasks.workunit.client.0.smithi003.stdout:0/489: fsync d9/d12/d17/d38/d3a/d46/d55/d67/f85 0 2024-09-21T12:20:39.282 INFO:tasks.workunit.client.0.smithi003.stdout:5/428: dread dc/d15/d21/f64 [0,4194304] 0 2024-09-21T12:20:39.283 INFO:tasks.workunit.client.1.smithi192.stdout:7/973: mkdir d6/d133/d143 0 2024-09-21T12:20:39.283 INFO:tasks.workunit.client.0.smithi003.stdout:5/429: write dc/f1a [754928,26799] 0 2024-09-21T12:20:39.285 INFO:tasks.workunit.client.0.smithi003.stdout:1/414: dwrite d4/d11/d49/f7c [0,4194304] 0 2024-09-21T12:20:39.289 INFO:tasks.workunit.client.0.smithi003.stdout:1/415: mknod d4/df/d41/c8d 0 2024-09-21T12:20:39.290 INFO:tasks.workunit.client.0.smithi003.stdout:0/490: symlink d9/d12/d17/la5 0 2024-09-21T12:20:39.292 INFO:tasks.workunit.client.0.smithi003.stdout:5/430: symlink dc/d15/l8e 0 2024-09-21T12:20:39.296 INFO:tasks.workunit.client.0.smithi003.stdout:8/382: dwrite d7/de/f56 [0,4194304] 0 2024-09-21T12:20:39.298 INFO:tasks.workunit.client.1.smithi192.stdout:3/975: truncate db/d16/d18/da7/ffc 614205 0 2024-09-21T12:20:39.298 INFO:tasks.workunit.client.0.smithi003.stdout:1/416: dread d4/d11/d14/f6a [0,4194304] 0 2024-09-21T12:20:39.299 INFO:tasks.workunit.client.1.smithi192.stdout:3/976: write db/d16/dc1/def/d111/f156 [507555,44140] 0 2024-09-21T12:20:39.301 INFO:tasks.workunit.client.0.smithi003.stdout:6/425: sync 2024-09-21T12:20:39.301 INFO:tasks.workunit.client.0.smithi003.stdout:5/431: dwrite dc/d15/f1f [0,4194304] 0 2024-09-21T12:20:39.304 INFO:tasks.workunit.client.1.smithi192.stdout:3/977: fdatasync db/d16/d18/da7/d10e/d2e/db8/dd0/fe0 0 2024-09-21T12:20:39.305 INFO:tasks.workunit.client.1.smithi192.stdout:3/978: readlink db/d16/d18/da7/d10e/lc8 0 2024-09-21T12:20:39.305 INFO:tasks.workunit.client.1.smithi192.stdout:3/979: chown db/d16/dc1/dd5 63601 1 2024-09-21T12:20:39.306 INFO:tasks.workunit.client.1.smithi192.stdout:4/955: write d2/d36/d7f/fbb [458771,48714] 0 2024-09-21T12:20:39.307 INFO:tasks.workunit.client.0.smithi003.stdout:6/426: dread - d4/d13/d2e/d37/d58/f5c zero size 2024-09-21T12:20:39.307 INFO:tasks.workunit.client.0.smithi003.stdout:0/491: link d9/c20 d9/d6c/ca6 0 2024-09-21T12:20:39.309 INFO:tasks.workunit.client.1.smithi192.stdout:7/974: dread d6/d9/d1f/d3e/d7a/d8a/fab [0,4194304] 0 2024-09-21T12:20:39.310 INFO:tasks.workunit.client.0.smithi003.stdout:5/432: mknod dc/d15/d21/d30/d4b/c8f 0 2024-09-21T12:20:39.310 INFO:tasks.workunit.client.1.smithi192.stdout:3/980: rmdir db/d16/d18/d21/d23/d71 39 2024-09-21T12:20:39.311 INFO:tasks.workunit.client.0.smithi003.stdout:5/433: chown dc/d15/l87 1697531909 1 2024-09-21T12:20:39.313 INFO:tasks.workunit.client.1.smithi192.stdout:7/975: truncate d6/d9/d51/fed 113014 0 2024-09-21T12:20:39.314 INFO:tasks.workunit.client.1.smithi192.stdout:7/976: truncate d6/d20/dc9/fff 1619024 0 2024-09-21T12:20:39.316 INFO:tasks.workunit.client.0.smithi003.stdout:5/434: write dc/d15/d26/f86 [316139,113924] 0 2024-09-21T12:20:39.318 INFO:tasks.workunit.client.0.smithi003.stdout:5/435: chown dc/d2b/d4e/f70 1090929 1 2024-09-21T12:20:39.322 INFO:tasks.workunit.client.0.smithi003.stdout:1/417: creat d4/d11/f8e x:0 0 0 2024-09-21T12:20:39.324 INFO:tasks.workunit.client.0.smithi003.stdout:1/418: fsync d4/f30 0 2024-09-21T12:20:39.325 INFO:tasks.workunit.client.0.smithi003.stdout:8/383: link d7/df/d16/c6e d7/df/d16/c84 0 2024-09-21T12:20:39.329 INFO:tasks.workunit.client.0.smithi003.stdout:6/427: write d4/d11/d32/f3b [4325757,26055] 0 2024-09-21T12:20:39.330 INFO:tasks.workunit.client.0.smithi003.stdout:1/419: creat d4/df/d19/f8f x:0 0 0 2024-09-21T12:20:39.332 INFO:tasks.workunit.client.1.smithi192.stdout:3/981: truncate db/d16/db4/d8c/fd4 2288110 0 2024-09-21T12:20:39.333 INFO:tasks.workunit.client.0.smithi003.stdout:1/420: write d4/df/d19/f8f [422122,31494] 0 2024-09-21T12:20:39.335 INFO:tasks.workunit.client.0.smithi003.stdout:6/428: symlink d4/d13/d2e/d37/l8e 0 2024-09-21T12:20:39.336 INFO:tasks.workunit.client.0.smithi003.stdout:8/384: mkdir d7/de/d85 0 2024-09-21T12:20:39.336 INFO:tasks.workunit.client.1.smithi192.stdout:4/956: dread d2/d36/d7f/df5/d4f/d71/d12b/dc8/df7/d83/d93/fe4 [0,4194304] 0 2024-09-21T12:20:39.337 INFO:tasks.workunit.client.1.smithi192.stdout:4/957: dread - d2/d36/d7f/df5/d4f/d71/d12b/dc8/df7/d6c/db8/d88/f11c zero size 2024-09-21T12:20:39.339 INFO:tasks.workunit.client.0.smithi003.stdout:0/492: dwrite d9/d12/d17/d38/d3a/d46/d55/d67/f28 [0,4194304] 0 2024-09-21T12:20:39.340 INFO:tasks.workunit.client.0.smithi003.stdout:6/429: write d4/d9/d59/f77 [476337,114074] 0 2024-09-21T12:20:39.342 INFO:tasks.workunit.client.1.smithi192.stdout:7/977: dwrite d6/d9/d51/f32 [0,4194304] 0 2024-09-21T12:20:39.342 INFO:tasks.workunit.client.1.smithi192.stdout:4/958: mkdir d2/d36/d7f/df5/d4f/d71/d12b/dc8/df7/d6c/db8/d88/dd0/d144 0 2024-09-21T12:20:39.345 INFO:tasks.workunit.client.0.smithi003.stdout:5/436: dread dc/d15/d1c/f29 [0,4194304] 0 2024-09-21T12:20:39.345 INFO:tasks.workunit.client.0.smithi003.stdout:6/430: dread - d4/f7c zero size 2024-09-21T12:20:39.347 INFO:tasks.workunit.client.0.smithi003.stdout:1/421: creat d4/f90 x:0 0 0 2024-09-21T12:20:39.348 INFO:tasks.workunit.client.1.smithi192.stdout:7/978: symlink d6/d9/d70/d77/l144 0 2024-09-21T12:20:39.349 INFO:tasks.workunit.client.0.smithi003.stdout:5/437: dread dc/d15/f19 [0,4194304] 0 2024-09-21T12:20:39.352 INFO:tasks.workunit.client.0.smithi003.stdout:0/493: rename d9/d12/d17/d38/d3a/d46/d55/d67/f74 to d9/d12/d17/d21/fa7 0 2024-09-21T12:20:39.353 INFO:tasks.workunit.client.1.smithi192.stdout:3/982: dwrite db/d16/d18/d40/fac [0,4194304] 0 2024-09-21T12:20:39.354 INFO:tasks.workunit.client.1.smithi192.stdout:7/979: mknod d6/d9/d11c/c145 0 2024-09-21T12:20:39.354 INFO:tasks.workunit.client.0.smithi003.stdout:0/494: chown d9/d12/d17/f18 3175 1 2024-09-21T12:20:39.355 INFO:tasks.workunit.client.0.smithi003.stdout:6/431: dwrite d4/d13/d19/f26 [0,4194304] 0 2024-09-21T12:20:39.359 INFO:tasks.workunit.client.0.smithi003.stdout:8/385: link d7/d57/l74 d7/df/d20/d24/d47/l86 0 2024-09-21T12:20:39.360 INFO:tasks.workunit.client.1.smithi192.stdout:7/980: symlink d6/d20/d69/l146 0 2024-09-21T12:20:39.361 INFO:tasks.workunit.client.0.smithi003.stdout:5/438: mkdir dc/d15/d21/d30/d90 0 2024-09-21T12:20:39.363 INFO:tasks.workunit.client.0.smithi003.stdout:8/386: creat d7/de/d1a/f87 x:0 0 0 2024-09-21T12:20:39.366 INFO:tasks.workunit.client.0.smithi003.stdout:5/439: chown dc/d15/l2f 1 1 2024-09-21T12:20:39.370 INFO:tasks.workunit.client.0.smithi003.stdout:6/432: dwrite d4/d9/f45 [0,4194304] 0 2024-09-21T12:20:39.371 INFO:tasks.workunit.client.0.smithi003.stdout:6/433: fdatasync d4/fe 0 2024-09-21T12:20:39.372 INFO:tasks.workunit.client.0.smithi003.stdout:8/387: truncate d7/df/d20/d54/f5e 738831 0 2024-09-21T12:20:39.373 INFO:tasks.workunit.client.1.smithi192.stdout:7/981: chown d6/d133/f97 1748 1 2024-09-21T12:20:39.374 INFO:tasks.workunit.client.1.smithi192.stdout:7/982: chown d6/d20/lf0 1329327 1 2024-09-21T12:20:39.374 INFO:tasks.workunit.client.0.smithi003.stdout:6/434: creat d4/d13/d56/f8f x:0 0 0 2024-09-21T12:20:39.375 INFO:tasks.workunit.client.0.smithi003.stdout:6/435: write d4/d13/d19/f26 [4599369,68202] 0 2024-09-21T12:20:39.375 INFO:tasks.workunit.client.0.smithi003.stdout:8/388: rename d7/de/f3b to d7/de/d85/f88 0 2024-09-21T12:20:39.377 INFO:tasks.workunit.client.0.smithi003.stdout:8/389: fsync d7/df/d20/d21/f6d 0 2024-09-21T12:20:39.378 INFO:tasks.workunit.client.1.smithi192.stdout:7/983: creat d6/d20/dcc/d10e/f147 x:0 0 0 2024-09-21T12:20:39.379 INFO:tasks.workunit.client.1.smithi192.stdout:7/984: fsync d6/d9/d1f/d3e/d7a/d8a/da2/f12f 0 2024-09-21T12:20:39.381 INFO:tasks.workunit.client.0.smithi003.stdout:8/390: symlink d7/df/d20/d54/d7a/l89 0 2024-09-21T12:20:39.383 INFO:tasks.workunit.client.0.smithi003.stdout:0/495: dread d9/d12/d17/f19 [0,4194304] 0 2024-09-21T12:20:39.383 INFO:tasks.workunit.client.0.smithi003.stdout:8/391: fsync d7/df/d20/d24/d47/d79/f67 0 2024-09-21T12:20:39.385 INFO:tasks.workunit.client.1.smithi192.stdout:7/985: rename d6/d9/d1f/d3e/f123 to d6/d133/dee/d13a/f148 0 2024-09-21T12:20:39.388 INFO:tasks.workunit.client.0.smithi003.stdout:8/392: mkdir d7/df/d20/d21/d4c/d8a 0 2024-09-21T12:20:39.388 INFO:tasks.workunit.client.1.smithi192.stdout:7/986: readlink d6/d20/d69/d90/da7/dc1/l9f 0 2024-09-21T12:20:39.390 INFO:tasks.workunit.client.0.smithi003.stdout:0/496: dwrite d9/d12/d17/f93 [0,4194304] 0 2024-09-21T12:20:39.390 INFO:tasks.workunit.client.0.smithi003.stdout:8/393: creat d7/df/d20/d21/f8b x:0 0 0 2024-09-21T12:20:39.395 INFO:tasks.workunit.client.0.smithi003.stdout:0/497: symlink d9/d12/d1e/d5f/la8 0 2024-09-21T12:20:39.396 INFO:tasks.workunit.client.1.smithi192.stdout:3/983: dread db/d16/d18/d160/df1/fb7 [0,4194304] 0 2024-09-21T12:20:39.398 INFO:tasks.workunit.client.0.smithi003.stdout:0/498: mkdir d9/d12/d17/d38/d47/da9 0 2024-09-21T12:20:39.398 INFO:tasks.workunit.client.0.smithi003.stdout:8/394: dwrite d7/df/d36/f41 [0,4194304] 0 2024-09-21T12:20:39.398 INFO:tasks.workunit.client.0.smithi003.stdout:0/499: chown d9/d6c 97603308 1 2024-09-21T12:20:39.400 INFO:tasks.workunit.client.1.smithi192.stdout:3/984: mknod db/d16/d18/da7/d10e/d2e/db8/dd0/c161 0 2024-09-21T12:20:39.401 INFO:tasks.workunit.client.0.smithi003.stdout:0/500: symlink d9/d12/laa 0 2024-09-21T12:20:39.404 INFO:tasks.workunit.client.1.smithi192.stdout:3/985: rmdir db/d16/d18/d21/d23/d71 39 2024-09-21T12:20:39.405 INFO:tasks.workunit.client.0.smithi003.stdout:0/501: mknod d9/d12/d17/d38/d3a/d46/d55/d7b/d9a/cab 0 2024-09-21T12:20:39.407 INFO:tasks.workunit.client.1.smithi192.stdout:3/986: unlink db/d16/d18/d40/f15f 0 2024-09-21T12:20:39.408 INFO:tasks.workunit.client.0.smithi003.stdout:0/502: symlink d9/d12/d17/d38/d47/lac 0 2024-09-21T12:20:39.410 INFO:tasks.workunit.client.0.smithi003.stdout:0/503: symlink d9/d12/d17/lad 0 2024-09-21T12:20:39.411 INFO:tasks.workunit.client.0.smithi003.stdout:0/504: chown d9/d12/d17/d38/d3a/d46/d55/d67/d2d/f65 0 1 2024-09-21T12:20:39.412 INFO:tasks.workunit.client.1.smithi192.stdout:3/987: dwrite db/d16/d18/d40/d60/f87 [4194304,4194304] 0 2024-09-21T12:20:39.413 INFO:tasks.workunit.client.0.smithi003.stdout:0/505: creat d9/d6c/d66/fae x:0 0 0 2024-09-21T12:20:39.414 INFO:tasks.workunit.client.0.smithi003.stdout:0/506: fsync d9/d12/d17/d21/f31 0 2024-09-21T12:20:39.416 INFO:tasks.workunit.client.1.smithi192.stdout:3/988: truncate db/d16/d18/d40/f7e 3851058 0 2024-09-21T12:20:39.417 INFO:tasks.workunit.client.0.smithi003.stdout:0/507: mknod d9/d12/d17/d38/d3a/d46/d55/d67/d2d/caf 0 2024-09-21T12:20:39.420 INFO:tasks.workunit.client.1.smithi192.stdout:3/989: rename db/d16/db4/cb5 to db/d16/d18/d33/d3b/d99/c162 0 2024-09-21T12:20:39.421 INFO:tasks.workunit.client.0.smithi003.stdout:0/508: mkdir d9/d12/d17/d38/d3a/d46/d55/db0 0 2024-09-21T12:20:39.422 INFO:tasks.workunit.client.0.smithi003.stdout:8/395: dread d7/df/f83 [0,4194304] 0 2024-09-21T12:20:39.422 INFO:tasks.workunit.client.1.smithi192.stdout:3/990: read db/d16/d18/f3e [2719689,67441] 0 2024-09-21T12:20:39.424 INFO:tasks.workunit.client.0.smithi003.stdout:0/509: unlink d9/d12/d1e/d5f/c7f 0 2024-09-21T12:20:39.426 INFO:tasks.workunit.client.1.smithi192.stdout:3/991: dread db/d16/d18/d160/df1/fb7 [0,4194304] 0 2024-09-21T12:20:39.427 INFO:tasks.workunit.client.0.smithi003.stdout:0/510: mknod d9/d6c/cb1 0 2024-09-21T12:20:39.429 INFO:tasks.workunit.client.0.smithi003.stdout:8/396: dwrite d7/de/f3e [4194304,4194304] 0 2024-09-21T12:20:39.436 INFO:tasks.workunit.client.0.smithi003.stdout:8/397: mkdir d7/df/d20/d21/d4c/d4d/d8c 0 2024-09-21T12:20:39.436 INFO:tasks.workunit.client.0.smithi003.stdout:0/511: dread d9/d12/d17/d38/d3a/d46/d55/d67/f28 [0,4194304] 0 2024-09-21T12:20:39.440 INFO:tasks.workunit.client.0.smithi003.stdout:8/398: rmdir d7/df/d20/d54/d7a 39 2024-09-21T12:20:39.447 INFO:tasks.workunit.client.0.smithi003.stdout:8/399: creat d7/df/d20/d24/f8d x:0 0 0 2024-09-21T12:20:39.447 INFO:tasks.workunit.client.0.smithi003.stdout:0/512: dwrite d9/d12/d17/d38/d3a/d46/f79 [0,4194304] 0 2024-09-21T12:20:39.451 INFO:tasks.workunit.client.0.smithi003.stdout:0/513: fsync d9/d12/f82 0 2024-09-21T12:20:39.458 INFO:tasks.workunit.client.0.smithi003.stdout:8/400: creat d7/df/d20/d54/f8e x:0 0 0 2024-09-21T12:20:39.465 INFO:tasks.workunit.client.0.smithi003.stdout:0/514: link d9/d6c/d26/f3c d9/d12/d17/d38/d3a/d46/d55/db0/fb2 0 2024-09-21T12:20:39.467 INFO:tasks.workunit.client.0.smithi003.stdout:0/515: mkdir d9/d6c/d26/db3 0 2024-09-21T12:20:39.469 INFO:tasks.workunit.client.0.smithi003.stdout:0/516: readlink d9/d12/d17/d38/d3a/d46/d55/d67/d2d/d91/l9c 0 2024-09-21T12:20:39.473 INFO:tasks.workunit.client.0.smithi003.stdout:5/440: dread dc/d15/d21/f5d [0,4194304] 0 2024-09-21T12:20:39.474 INFO:tasks.workunit.client.0.smithi003.stdout:6/436: dwrite d4/d9/f50 [0,4194304] 0 2024-09-21T12:20:39.474 INFO:tasks.workunit.client.0.smithi003.stdout:0/517: creat d9/d12/d1e/d5f/d8a/fb4 x:0 0 0 2024-09-21T12:20:39.475 INFO:tasks.workunit.client.1.smithi192.stdout:7/987: dwrite d6/f15 [0,4194304] 0 2024-09-21T12:20:39.475 INFO:tasks.workunit.client.1.smithi192.stdout:4/959: sync 2024-09-21T12:20:39.476 INFO:tasks.workunit.client.1.smithi192.stdout:7/988: write d6/d20/d69/d90/da7/dc1/fac [1199372,71260] 0 2024-09-21T12:20:39.477 INFO:tasks.workunit.client.0.smithi003.stdout:0/518: chown d9/c20 1958 1 2024-09-21T12:20:39.480 INFO:tasks.workunit.client.0.smithi003.stdout:5/441: unlink dc/d15/f3f 0 2024-09-21T12:20:39.480 INFO:tasks.workunit.client.0.smithi003.stdout:0/519: chown d9/d12/d17/d38/d3a/d46/d55/d67/f64 0 1 2024-09-21T12:20:39.485 INFO:tasks.workunit.client.0.smithi003.stdout:6/437: rename d4/d11/d17/f5d to d4/d13/d2e/d37/f90 0 2024-09-21T12:20:39.489 INFO:tasks.workunit.client.0.smithi003.stdout:6/438: creat d4/d13/d56/f91 x:0 0 0 2024-09-21T12:20:39.490 INFO:tasks.workunit.client.0.smithi003.stdout:6/439: dread - d4/d13/d2e/d37/f90 zero size 2024-09-21T12:20:39.491 INFO:tasks.workunit.client.0.smithi003.stdout:6/440: chown d4/d11/d53 6592465 1 2024-09-21T12:20:39.494 INFO:tasks.workunit.client.0.smithi003.stdout:0/520: creat d9/d6c/d26/db3/fb5 x:0 0 0 2024-09-21T12:20:39.497 INFO:tasks.workunit.client.0.smithi003.stdout:6/441: mknod d4/d13/d2e/c92 0 2024-09-21T12:20:39.498 INFO:tasks.workunit.client.0.smithi003.stdout:5/442: getdents dc/d15/d21/d28/d41/d5b/d74/d7f 0 2024-09-21T12:20:39.498 INFO:tasks.workunit.client.0.smithi003.stdout:6/442: fdatasync d4/d13/d22/f2b 0 2024-09-21T12:20:39.499 INFO:tasks.workunit.client.0.smithi003.stdout:5/443: fdatasync dc/d15/d26/f86 0 2024-09-21T12:20:39.499 INFO:tasks.workunit.client.0.smithi003.stdout:5/444: readlink dc/l65 0 2024-09-21T12:20:39.500 INFO:tasks.workunit.client.0.smithi003.stdout:5/445: chown c8 198 1 2024-09-21T12:20:39.501 INFO:tasks.workunit.client.0.smithi003.stdout:0/521: symlink d9/d12/d17/d38/d3a/d46/lb6 0 2024-09-21T12:20:39.502 INFO:tasks.workunit.client.1.smithi192.stdout:3/992: rmdir db/d16/db4/d8c 39 2024-09-21T12:20:39.502 INFO:tasks.workunit.client.0.smithi003.stdout:0/522: write d9/d6c/d26/f73 [1245716,8137] 0 2024-09-21T12:20:39.504 INFO:tasks.workunit.client.1.smithi192.stdout:3/993: truncate db/d16/d18/da7/d10e/d2e/db8/dd0/df0/f106 1004196 0 2024-09-21T12:20:39.505 INFO:tasks.workunit.client.0.smithi003.stdout:5/446: creat dc/d15/d21/d28/d3c/f91 x:0 0 0 2024-09-21T12:20:39.507 INFO:tasks.workunit.client.1.smithi192.stdout:3/994: chown db/d16/d18/d21/ffd 1116777 1 2024-09-21T12:20:39.511 INFO:tasks.workunit.client.0.smithi003.stdout:5/447: creat dc/d15/d21/d28/d41/d5b/d74/d7f/d82/f92 x:0 0 0 2024-09-21T12:20:39.512 INFO:tasks.workunit.client.0.smithi003.stdout:8/401: dwrite d7/f18 [0,4194304] 0 2024-09-21T12:20:39.515 INFO:tasks.workunit.client.0.smithi003.stdout:0/523: symlink d9/d12/d1e/lb7 0 2024-09-21T12:20:39.517 INFO:tasks.workunit.client.0.smithi003.stdout:5/448: dread dc/d15/f1f [0,4194304] 0 2024-09-21T12:20:39.518 INFO:tasks.workunit.client.0.smithi003.stdout:5/449: write dc/d2b/f54 [248876,121981] 0 2024-09-21T12:20:39.521 INFO:tasks.workunit.client.0.smithi003.stdout:6/443: getdents d4 0 2024-09-21T12:20:39.522 INFO:tasks.workunit.client.1.smithi192.stdout:3/995: link db/c12b db/d16/dee/c163 0 2024-09-21T12:20:39.523 INFO:tasks.workunit.client.0.smithi003.stdout:8/402: mkdir d7/df/d20/d24/d47/d79/d8f 0 2024-09-21T12:20:39.524 INFO:tasks.workunit.client.0.smithi003.stdout:0/524: mkdir d9/d6c/d32/db8 0 2024-09-21T12:20:39.525 INFO:tasks.workunit.client.1.smithi192.stdout:3/996: rmdir db/d16/d18/d40/dd1/d127 39 2024-09-21T12:20:39.527 INFO:tasks.workunit.client.0.smithi003.stdout:5/450: creat dc/d15/d21/d28/d41/d5b/d74/d7f/f93 x:0 0 0 2024-09-21T12:20:39.529 INFO:tasks.workunit.client.0.smithi003.stdout:6/444: mknod d4/d13/d2e/d37/d64/c93 0 2024-09-21T12:20:39.529 INFO:tasks.workunit.client.0.smithi003.stdout:5/451: dread - dc/d15/d21/d28/d41/d5b/d74/d7f/f93 zero size 2024-09-21T12:20:39.532 INFO:tasks.workunit.client.1.smithi192.stdout:3/997: unlink db/d16/d18/d40/c64 0 2024-09-21T12:20:39.532 INFO:tasks.workunit.client.0.smithi003.stdout:0/525: dwrite d9/d12/d17/d21/f9f [0,4194304] 0 2024-09-21T12:20:39.534 INFO:tasks.workunit.client.0.smithi003.stdout:6/445: mkdir d4/d9/d79/d94 0 2024-09-21T12:20:39.535 INFO:tasks.workunit.client.1.smithi192.stdout:3/998: chown db/f4f 91 1 2024-09-21T12:20:39.536 INFO:tasks.workunit.client.0.smithi003.stdout:5/452: creat dc/d2b/d4e/f94 x:0 0 0 2024-09-21T12:20:39.537 INFO:tasks.workunit.client.0.smithi003.stdout:0/526: mknod d9/d12/d17/d21/d30/cb9 0 2024-09-21T12:20:39.539 INFO:tasks.workunit.client.1.smithi192.stdout:3/999: creat db/d16/d18/da7/d10e/d2e/db8/f164 x:0 0 0 2024-09-21T12:20:39.539 INFO:tasks.workunit.client.0.smithi003.stdout:0/527: chown d9/d12/d17/d38/d3a/d46/d55/d67/d2d/caf 340430 1 2024-09-21T12:20:39.540 INFO:tasks.workunit.client.0.smithi003.stdout:5/453: mknod dc/d15/d21/d28/d41/c95 0 2024-09-21T12:20:39.541 INFO:tasks.workunit.client.0.smithi003.stdout:5/454: fdatasync dc/d15/d21/d28/f6a 0 2024-09-21T12:20:39.547 INFO:tasks.workunit.client.0.smithi003.stdout:5/455: rename dc/d15/d21/f5d to dc/d15/d21/d28/d3c/d73/f96 0 2024-09-21T12:20:39.549 INFO:tasks.workunit.client.0.smithi003.stdout:5/456: fdatasync dc/f4d 0 2024-09-21T12:20:39.551 INFO:tasks.workunit.client.0.smithi003.stdout:5/457: mknod dc/d2b/c97 0 2024-09-21T12:20:39.554 INFO:tasks.workunit.client.0.smithi003.stdout:5/458: truncate dc/d2b/f43 298788 0 2024-09-21T12:20:39.558 INFO:tasks.workunit.client.0.smithi003.stdout:5/459: dread dc/d15/d1c/f29 [0,4194304] 0 2024-09-21T12:20:39.559 INFO:tasks.workunit.client.0.smithi003.stdout:0/528: truncate d9/d12/d17/d38/d3a/d46/d55/d67/f4a 3337853 0 2024-09-21T12:20:39.563 INFO:tasks.workunit.client.0.smithi003.stdout:0/529: fdatasync d9/d12/d17/d38/d3a/d46/d55/d57/f76 0 2024-09-21T12:20:39.565 INFO:tasks.workunit.client.0.smithi003.stdout:0/530: chown d9/d12/d17/f18 182 1 2024-09-21T12:20:39.569 INFO:tasks.workunit.client.0.smithi003.stdout:0/531: creat d9/d6c/d26/d54/d88/fba x:0 0 0 2024-09-21T12:20:39.569 INFO:tasks.workunit.client.0.smithi003.stdout:5/460: link dc/d15/d21/d28/l88 dc/d15/d21/l98 0 2024-09-21T12:20:39.570 INFO:tasks.workunit.client.0.smithi003.stdout:5/461: chown dc/d15/d21/d28/d3c/c83 3 1 2024-09-21T12:20:39.571 INFO:tasks.workunit.client.0.smithi003.stdout:5/462: chown dc/c85 33 1 2024-09-21T12:20:39.572 INFO:tasks.workunit.client.0.smithi003.stdout:0/532: mknod d9/d12/d17/d38/d3a/d46/d55/d9e/cbb 0 2024-09-21T12:20:39.575 INFO:tasks.workunit.client.0.smithi003.stdout:5/463: rename dc/d15/d21/d28/d41/f7d to dc/d15/d21/d30/d4b/d5c/f99 0 2024-09-21T12:20:39.575 INFO:tasks.workunit.client.0.smithi003.stdout:0/533: mkdir d9/d6c/d26/d54/dbc 0 2024-09-21T12:20:39.577 INFO:tasks.workunit.client.0.smithi003.stdout:0/534: mknod d9/d12/d17/d38/d47/da9/cbd 0 2024-09-21T12:20:39.590 INFO:tasks.workunit.client.0.smithi003.stdout:5/464: dwrite dc/d15/f19 [0,4194304] 0 2024-09-21T12:20:39.592 INFO:tasks.workunit.client.0.smithi003.stdout:0/535: dwrite d9/d12/d17/d38/d3a/d46/d55/d67/f4a [0,4194304] 0 2024-09-21T12:20:39.593 INFO:tasks.workunit.client.0.smithi003.stdout:0/536: chown d9/d12/f1c 108362 1 2024-09-21T12:20:39.593 INFO:tasks.workunit.client.0.smithi003.stdout:5/465: rmdir dc/d15/d21/d30 39 2024-09-21T12:20:39.593 INFO:tasks.workunit.client.1.smithi192.stdout:7/989: sync 2024-09-21T12:20:39.593 INFO:tasks.workunit.client.1.smithi192.stdout:4/960: sync 2024-09-21T12:20:39.594 INFO:tasks.workunit.client.1.smithi192.stdout:4/961: fdatasync d2/d36/d7f/df5/d4f/d71/d12b/dc8/df7/d6c/db8/d88/d100/f12e 0 2024-09-21T12:20:39.596 INFO:tasks.workunit.client.0.smithi003.stdout:5/466: chown dc/d15/d21/d28/l88 2 1 2024-09-21T12:20:39.598 INFO:tasks.workunit.client.1.smithi192.stdout:7/990: unlink d6/d9/d11c/c138 0 2024-09-21T12:20:39.601 INFO:tasks.workunit.client.0.smithi003.stdout:5/467: creat dc/d15/f9a x:0 0 0 2024-09-21T12:20:39.602 INFO:tasks.workunit.client.0.smithi003.stdout:5/468: write dc/f3a [2885507,55675] 0 2024-09-21T12:20:39.603 INFO:tasks.workunit.client.1.smithi192.stdout:7/991: mkdir d6/d9/d70/d77/d149 0 2024-09-21T12:20:39.604 INFO:tasks.workunit.client.1.smithi192.stdout:4/962: creat d2/d36/d10c/f145 x:0 0 0 2024-09-21T12:20:39.608 INFO:tasks.workunit.client.0.smithi003.stdout:0/537: truncate d9/d12/f81 2721807 0 2024-09-21T12:20:39.610 INFO:tasks.workunit.client.1.smithi192.stdout:7/992: getdents d6/d9/d2d/dc4 0 2024-09-21T12:20:39.611 INFO:tasks.workunit.client.0.smithi003.stdout:5/469: dwrite dc/f10 [0,4194304] 0 2024-09-21T12:20:39.611 INFO:tasks.workunit.client.1.smithi192.stdout:4/963: getdents d2/d21 0 2024-09-21T12:20:39.613 INFO:tasks.workunit.client.1.smithi192.stdout:7/993: chown d6/d9/d70/d77/le0 1435 1 2024-09-21T12:20:39.613 INFO:tasks.workunit.client.0.smithi003.stdout:5/470: dread - dc/d15/d21/d28/d41/d5b/d74/f7b zero size 2024-09-21T12:20:39.615 INFO:tasks.workunit.client.0.smithi003.stdout:0/538: creat d9/d6c/fbe x:0 0 0 2024-09-21T12:20:39.616 INFO:tasks.workunit.client.1.smithi192.stdout:7/994: mknod d6/d20/c14a 0 2024-09-21T12:20:39.616 INFO:tasks.workunit.client.1.smithi192.stdout:4/964: dwrite d2/db/f26 [0,4194304] 0 2024-09-21T12:20:39.617 INFO:tasks.workunit.client.0.smithi003.stdout:5/471: mknod dc/d15/d21/d28/d41/d5b/c9b 0 2024-09-21T12:20:39.619 INFO:tasks.workunit.client.1.smithi192.stdout:7/995: symlink d6/d3a/d6d/l14b 0 2024-09-21T12:20:39.620 INFO:tasks.workunit.client.0.smithi003.stdout:5/472: unlink dc/c38 0 2024-09-21T12:20:39.622 INFO:tasks.workunit.client.0.smithi003.stdout:5/473: dread - dc/d15/d21/d28/d3c/f91 zero size 2024-09-21T12:20:39.622 INFO:tasks.workunit.client.1.smithi192.stdout:4/965: truncate d2/d36/d7f/df5/d4f/d71/d12b/da6/fff 670434 0 2024-09-21T12:20:39.625 INFO:tasks.workunit.client.0.smithi003.stdout:0/539: rename d9/d12/d17/c9d to d9/d12/d17/d38/d3a/d46/d55/d9e/cbf 0 2024-09-21T12:20:39.627 INFO:tasks.workunit.client.1.smithi192.stdout:4/966: chown d2/d36/d7f/df5/d4f/d71/d9d/dad/c65 92993835 1 2024-09-21T12:20:39.628 INFO:tasks.workunit.client.1.smithi192.stdout:4/967: chown d2/d36/d7f 0 1 2024-09-21T12:20:39.630 INFO:tasks.workunit.client.1.smithi192.stdout:4/968: read d2/d36/d7f/df5/d4f/d71/d9d/dad/f25 [4097759,59670] 0 2024-09-21T12:20:39.634 INFO:tasks.workunit.client.1.smithi192.stdout:4/969: creat d2/d36/d10c/f146 x:0 0 0 2024-09-21T12:20:39.634 INFO:tasks.workunit.client.1.smithi192.stdout:4/970: chown d2/d36/d10c/f145 1707 1 2024-09-21T12:20:39.635 INFO:tasks.workunit.client.0.smithi003.stdout:0/540: dwrite d9/d12/d1e/d5f/d8a/fb4 [0,4194304] 0 2024-09-21T12:20:39.636 INFO:tasks.workunit.client.0.smithi003.stdout:5/474: dwrite dc/d15/d21/d28/d41/f8a [0,4194304] 0 2024-09-21T12:20:39.638 INFO:tasks.workunit.client.0.smithi003.stdout:0/541: chown d9/d12/d17/d38/d47 7116 1 2024-09-21T12:20:39.640 INFO:tasks.workunit.client.0.smithi003.stdout:0/542: stat d9/d6c/d26/d54/f6f 0 2024-09-21T12:20:39.640 INFO:tasks.workunit.client.0.smithi003.stdout:5/475: read dc/f3a [915820,59510] 0 2024-09-21T12:20:39.643 INFO:tasks.workunit.client.1.smithi192.stdout:4/971: rename d2/d36/d7f/df5/c4e to d2/db/d3e/d57/c147 0 2024-09-21T12:20:39.644 INFO:tasks.workunit.client.1.smithi192.stdout:4/972: stat d2/d36/d7f/f118 0 2024-09-21T12:20:39.645 INFO:tasks.workunit.client.0.smithi003.stdout:0/543: rename d9/d12/d1e/lb7 to d9/d12/d17/d38/d3a/d46/d55/d7b/d9a/lc0 0 2024-09-21T12:20:39.653 INFO:tasks.workunit.client.1.smithi192.stdout:4/973: dwrite d2/d36/d7f/df5/d4f/d71/d9d/dad/d9c/fab [0,4194304] 0 2024-09-21T12:20:39.654 INFO:tasks.workunit.client.0.smithi003.stdout:0/544: dwrite d9/d6c/d26/d54/f6f [0,4194304] 0 2024-09-21T12:20:39.656 INFO:tasks.workunit.client.0.smithi003.stdout:0/545: fsync d9/d6c/d26/d54/d88/fba 0 2024-09-21T12:20:39.656 INFO:tasks.workunit.client.1.smithi192.stdout:7/996: dwrite d6/d133/dee/d13a/f148 [0,4194304] 0 2024-09-21T12:20:39.659 INFO:tasks.workunit.client.1.smithi192.stdout:4/974: fsync d2/fc9 0 2024-09-21T12:20:39.675 INFO:tasks.workunit.client.1.smithi192.stdout:4/975: dread d2/d21/f7a [0,4194304] 0 2024-09-21T12:20:39.678 INFO:tasks.workunit.client.1.smithi192.stdout:4/976: symlink d2/df/l148 0 2024-09-21T12:20:39.678 INFO:tasks.workunit.client.1.smithi192.stdout:4/977: chown d2/d36/d7f/d68 210293 1 2024-09-21T12:20:39.679 INFO:tasks.workunit.client.1.smithi192.stdout:4/978: chown d2/d36/d7f/df5/d4f/d71/d12b/dc8/df7/d6c/fea 336279364 1 2024-09-21T12:20:39.681 INFO:tasks.workunit.client.1.smithi192.stdout:4/979: mkdir d2/d36/d7f/df5/d4f/d71/d12b/dc8/df7/d6c/db8/d88/dd0/d149 0 2024-09-21T12:20:39.683 INFO:tasks.workunit.client.1.smithi192.stdout:4/980: mknod d2/d36/d7f/df5/d4f/d71/d12b/c14a 0 2024-09-21T12:20:39.685 INFO:tasks.workunit.client.1.smithi192.stdout:4/981: truncate d2/d36/d7f/df5/f121 8269123 0 2024-09-21T12:20:39.689 INFO:tasks.workunit.client.0.smithi003.stdout:0/546: getdents d9/d12/d17/d38/d3a/d46/d55/d7b/d9a 0 2024-09-21T12:20:39.696 INFO:tasks.workunit.client.0.smithi003.stdout:0/547: fsync d9/d12/d17/d38/d3a/d46/d55/db0/fb2 0 2024-09-21T12:20:39.701 INFO:tasks.workunit.client.1.smithi192.stdout:7/997: truncate d6/d9/d70/d77/fb7 1116824 0 2024-09-21T12:20:39.701 INFO:tasks.workunit.client.1.smithi192.stdout:7/998: read d6/f38 [1503932,45679] 0 2024-09-21T12:20:39.702 INFO:tasks.workunit.client.0.smithi003.stdout:0/548: creat d9/d12/d17/d38/fc1 x:0 0 0 2024-09-21T12:20:39.723 INFO:tasks.workunit.client.0.smithi003.stdout:0/549: truncate d9/f59 2277873 0 2024-09-21T12:20:39.733 INFO:tasks.workunit.client.1.smithi192.stdout:4/982: truncate d2/d36/d7f/df5/d4f/d71/d12b/dc8/df7/d83/f95 3936190 0 2024-09-21T12:20:39.753 INFO:tasks.workunit.client.1.smithi192.stdout:4/983: dread d2/d36/d7f/df5/d4f/d71/d9d/dad/f25 [0,4194304] 0 2024-09-21T12:20:39.753 INFO:tasks.workunit.client.1.smithi192.stdout:7/999: dwrite d6/d9/d70/d77/fb7 [0,4194304] 0 2024-09-21T12:20:39.754 INFO:tasks.workunit.client.1.smithi192.stdout:4/984: dread - d2/d36/d10c/f146 zero size 2024-09-21T12:20:39.756 INFO:tasks.workunit.client.1.smithi192.stdout:4/985: rmdir d2/d36/d7f/df5/d4f/d71/d12b/dc8/df7/d6c 39 2024-09-21T12:20:39.763 INFO:tasks.workunit.client.1.smithi192.stdout:4/986: dread d2/db/d1a/dee/f77 [0,4194304] 0 2024-09-21T12:20:39.767 INFO:tasks.workunit.client.1.smithi192.stdout:4/987: mknod d2/d36/d7f/df5/d4f/d71/d9d/dad/c14b 0 2024-09-21T12:20:39.769 INFO:tasks.workunit.client.1.smithi192.stdout:4/988: unlink d2/db/l1d 0 2024-09-21T12:20:39.776 INFO:tasks.workunit.client.1.smithi192.stdout:4/989: link d2/d36/d7f/df5/d4f/d71/d12b/dc8/df7/d6c/db8/d88/fb2 d2/d36/d7f/df5/d4f/d71/f14c 0 2024-09-21T12:20:39.777 INFO:tasks.workunit.client.1.smithi192.stdout:4/990: chown d2/d36/d7f/df5/d4f/d71/d12b/dc8/df7/c76 412454 1 2024-09-21T12:20:39.778 INFO:tasks.workunit.client.1.smithi192.stdout:4/991: readlink d2/d21/l107 0 2024-09-21T12:20:39.781 INFO:tasks.workunit.client.1.smithi192.stdout:4/992: getdents d2/d36/d7f/df5/d4f/d71/d9d/dad/d9c/df8 0 2024-09-21T12:20:39.793 INFO:tasks.workunit.client.1.smithi192.stdout:4/993: dwrite d2/f66 [0,4194304] 0 2024-09-21T12:20:39.796 INFO:tasks.workunit.client.1.smithi192.stdout:4/994: creat d2/d36/d7f/df5/d4f/d82/f14d x:0 0 0 2024-09-21T12:20:39.799 INFO:tasks.workunit.client.1.smithi192.stdout:4/995: mknod d2/d36/d7f/df5/d4f/d71/d12b/dc8/df7/d6c/db8/d99/dd7/c14e 0 2024-09-21T12:20:39.808 INFO:tasks.workunit.client.1.smithi192.stdout:4/996: write d2/f84 [1708636,69150] 0 2024-09-21T12:20:39.811 INFO:tasks.workunit.client.1.smithi192.stdout:4/997: mknod d2/d36/d7f/df5/d4f/d71/d9d/dad/d9c/d9e/dcf/d137/d143/c14f 0 2024-09-21T12:20:39.814 INFO:tasks.workunit.client.1.smithi192.stdout:4/998: creat d2/d36/d7f/df5/d4f/d71/d12b/dc8/df7/d6c/db8/d99/dd7/f150 x:0 0 0 2024-09-21T12:20:39.817 INFO:tasks.workunit.client.1.smithi192.stdout:4/999: creat d2/db/d1a/f151 x:0 0 0 2024-09-21T12:20:39.820 INFO:tasks.workunit.client.1.smithi192.stderr:+ rm -rf -- ./tmp.mjjFytj4Ae 2024-09-21T12:20:39.943 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:39 smithi192 ceph-mon[35641]: pgmap v6: 65 pgs: 65 active+clean; 2.9 GiB data, 8.4 GiB used, 528 GiB / 536 GiB avail; 79 MiB/s rd, 241 MiB/s wr, 490 op/s 2024-09-21T12:20:40.055 INFO:tasks.workunit.client.0.smithi003.stdout:2/380: sync 2024-09-21T12:20:40.060 INFO:tasks.workunit.client.0.smithi003.stdout:2/381: creat d0/dd/f8c x:0 0 0 2024-09-21T12:20:40.061 INFO:tasks.workunit.client.0.smithi003.stdout:2/382: creat d0/d21/d62/f8d x:0 0 0 2024-09-21T12:20:40.063 INFO:tasks.workunit.client.0.smithi003.stdout:2/383: symlink d0/d21/d62/l8e 0 2024-09-21T12:20:40.064 INFO:tasks.workunit.client.0.smithi003.stdout:2/384: stat d0/dd/d22/d68/d7e/f86 0 2024-09-21T12:20:40.078 INFO:tasks.workunit.client.0.smithi003.stdout:2/385: dread d0/d1c/d6a/f19 [0,4194304] 0 2024-09-21T12:20:40.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:39 smithi003 ceph-mon[28057]: pgmap v6: 65 pgs: 65 active+clean; 2.9 GiB data, 8.4 GiB used, 528 GiB / 536 GiB avail; 79 MiB/s rd, 241 MiB/s wr, 490 op/s 2024-09-21T12:20:40.087 INFO:tasks.workunit.client.0.smithi003.stdout:2/386: dwrite d0/f1d [0,4194304] 0 2024-09-21T12:20:40.090 INFO:tasks.workunit.client.0.smithi003.stdout:2/387: creat d0/d21/d2f/f8f x:0 0 0 2024-09-21T12:20:40.113 INFO:tasks.workunit.client.0.smithi003.stdout:2/388: dread d0/d1c/f2e [0,4194304] 0 2024-09-21T12:20:40.117 INFO:tasks.workunit.client.0.smithi003.stdout:2/389: rename d0/d21/d2f/f3a to d0/d21/d2f/d50/f90 0 2024-09-21T12:20:40.121 INFO:tasks.workunit.client.0.smithi003.stdout:2/390: creat d0/d21/f91 x:0 0 0 2024-09-21T12:20:40.123 INFO:tasks.workunit.client.0.smithi003.stdout:2/391: mknod d0/dd/d22/d68/c92 0 2024-09-21T12:20:40.124 INFO:tasks.workunit.client.0.smithi003.stdout:2/392: chown d0/dd/c4b 2299 1 2024-09-21T12:20:40.126 INFO:tasks.workunit.client.0.smithi003.stdout:2/393: creat d0/d21/d30/f93 x:0 0 0 2024-09-21T12:20:40.130 INFO:tasks.workunit.client.0.smithi003.stdout:3/391: sync 2024-09-21T12:20:40.131 INFO:tasks.workunit.client.0.smithi003.stdout:2/394: rename d0/d46/c55 to d0/d21/d2f/d77/c94 0 2024-09-21T12:20:40.134 INFO:tasks.workunit.client.0.smithi003.stdout:3/392: write d0/d5/da/d28/d11/d49/d4c/d54/d5e/f5f [286652,18067] 0 2024-09-21T12:20:40.134 INFO:tasks.workunit.client.0.smithi003.stdout:2/395: mknod d0/dd/d22/d8b/c95 0 2024-09-21T12:20:40.135 INFO:tasks.workunit.client.0.smithi003.stdout:2/396: stat d0/dd/f1b 0 2024-09-21T12:20:40.136 INFO:tasks.workunit.client.0.smithi003.stdout:2/397: fsync d0/d21/d2c/f58 0 2024-09-21T12:20:40.137 INFO:tasks.workunit.client.0.smithi003.stdout:2/398: write d0/f1d [4714818,74178] 0 2024-09-21T12:20:40.139 INFO:tasks.workunit.client.0.smithi003.stdout:3/393: unlink d0/d5/da/d28/d31/c3a 0 2024-09-21T12:20:40.139 INFO:tasks.workunit.client.0.smithi003.stdout:2/399: read d0/f3b [2795230,110497] 0 2024-09-21T12:20:40.143 INFO:tasks.workunit.client.0.smithi003.stdout:3/394: creat d0/d5/da/d28/d31/f7b x:0 0 0 2024-09-21T12:20:40.143 INFO:tasks.workunit.client.0.smithi003.stdout:3/395: readlink d0/d5/d38/l4b 0 2024-09-21T12:20:40.145 INFO:tasks.workunit.client.0.smithi003.stdout:2/400: truncate d0/dd/d22/d68/f7a 661305 0 2024-09-21T12:20:40.151 INFO:tasks.workunit.client.0.smithi003.stdout:3/396: mknod d0/c7c 0 2024-09-21T12:20:40.154 INFO:tasks.workunit.client.0.smithi003.stdout:3/397: read d0/d5/f36 [4078814,44648] 0 2024-09-21T12:20:40.154 INFO:tasks.workunit.client.0.smithi003.stdout:2/401: creat d0/d1c/f96 x:0 0 0 2024-09-21T12:20:40.155 INFO:tasks.workunit.client.0.smithi003.stdout:2/402: stat d0/d46/c54 0 2024-09-21T12:20:40.157 INFO:tasks.workunit.client.0.smithi003.stdout:3/398: creat d0/d5/da/d28/d31/f7d x:0 0 0 2024-09-21T12:20:40.158 INFO:tasks.workunit.client.0.smithi003.stdout:3/399: chown d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/f2c 211 1 2024-09-21T12:20:40.160 INFO:tasks.workunit.client.0.smithi003.stdout:2/403: unlink d0/d21/f6b 0 2024-09-21T12:20:40.160 INFO:tasks.workunit.client.0.smithi003.stdout:2/404: chown d0/dd/l5b 34 1 2024-09-21T12:20:40.161 INFO:tasks.workunit.client.0.smithi003.stdout:3/400: truncate d0/d5/da/d28/d11/f44 464713 0 2024-09-21T12:20:40.162 INFO:tasks.workunit.client.0.smithi003.stdout:3/401: chown d0/d5/d38/c56 110 1 2024-09-21T12:20:40.162 INFO:tasks.workunit.client.0.smithi003.stdout:2/405: mkdir d0/dd/d22/d68/d7e/d97 0 2024-09-21T12:20:40.165 INFO:tasks.workunit.client.0.smithi003.stdout:3/402: mkdir d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e 0 2024-09-21T12:20:40.166 INFO:tasks.workunit.client.0.smithi003.stdout:3/403: unlink d0/d5/da/d28/f29 0 2024-09-21T12:20:40.169 INFO:tasks.workunit.client.0.smithi003.stdout:3/404: mknod d0/d5/da/d28/d11/d49/d4c/d54/c7f 0 2024-09-21T12:20:40.171 INFO:tasks.workunit.client.0.smithi003.stdout:3/405: symlink d0/l80 0 2024-09-21T12:20:40.172 INFO:tasks.workunit.client.0.smithi003.stdout:3/406: readlink d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/l43 0 2024-09-21T12:20:40.174 INFO:tasks.workunit.client.0.smithi003.stdout:3/407: mknod d0/d5/d38/d55/c81 0 2024-09-21T12:20:40.178 INFO:tasks.workunit.client.0.smithi003.stdout:3/408: mknod d0/d5/da/d28/d11/d49/d4c/d6f/c82 0 2024-09-21T12:20:40.179 INFO:tasks.workunit.client.0.smithi003.stdout:3/409: fdatasync d0/d5/d38/d55/f65 0 2024-09-21T12:20:40.184 INFO:tasks.workunit.client.0.smithi003.stdout:3/410: truncate d0/d5/da/d28/d31/f32 969726 0 2024-09-21T12:20:40.187 INFO:tasks.workunit.client.0.smithi003.stdout:3/411: truncate d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d3d/f53 1578419 0 2024-09-21T12:20:40.199 INFO:tasks.workunit.client.0.smithi003.stdout:3/412: getdents d0/d5/da/d28/d31 0 2024-09-21T12:20:40.200 INFO:tasks.workunit.client.0.smithi003.stdout:3/413: write d0/d5/da/d28/d11/d49/f73 [487014,71272] 0 2024-09-21T12:20:40.204 INFO:tasks.workunit.client.0.smithi003.stdout:3/414: write d0/d5/da/d28/d31/f67 [552855,12951] 0 2024-09-21T12:20:40.209 INFO:tasks.workunit.client.0.smithi003.stdout:3/415: rename d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d3d to d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83 0 2024-09-21T12:20:40.211 INFO:tasks.workunit.client.0.smithi003.stdout:3/416: dread - d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/f6a zero size 2024-09-21T12:20:40.232 INFO:tasks.workunit.client.0.smithi003.stdout:3/417: rmdir d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83 39 2024-09-21T12:20:40.232 INFO:tasks.workunit.client.0.smithi003.stdout:3/418: chown d0/d5/da/d28 7199520 1 2024-09-21T12:20:40.238 INFO:tasks.workunit.client.0.smithi003.stdout:3/419: rename d0/d5/d38/f50 to d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/d77/f84 0 2024-09-21T12:20:40.242 INFO:tasks.workunit.client.0.smithi003.stdout:3/420: creat d0/d5/da/d28/d11/d49/d4c/f85 x:0 0 0 2024-09-21T12:20:40.250 INFO:tasks.workunit.client.0.smithi003.stdout:3/421: getdents d0/d5/d38/d55 0 2024-09-21T12:20:40.254 INFO:tasks.workunit.client.0.smithi003.stdout:3/422: mkdir d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/d42/d6d/d86 0 2024-09-21T12:20:40.257 INFO:tasks.workunit.client.0.smithi003.stdout:3/423: getdents d0/d5 0 2024-09-21T12:20:40.259 INFO:tasks.workunit.client.0.smithi003.stdout:3/424: unlink d0/d5/d38/d55/c81 0 2024-09-21T12:20:40.263 INFO:tasks.workunit.client.0.smithi003.stdout:3/425: symlink d0/d5/da/d28/d11/d49/d4c/d54/d5e/l87 0 2024-09-21T12:20:40.263 INFO:tasks.workunit.client.0.smithi003.stdout:3/426: write d0/d5/f46 [437182,57496] 0 2024-09-21T12:20:40.267 INFO:tasks.workunit.client.0.smithi003.stdout:3/427: creat d0/d5/da/d28/f88 x:0 0 0 2024-09-21T12:20:40.268 INFO:tasks.workunit.client.0.smithi003.stdout:3/428: readlink d0/l80 0 2024-09-21T12:20:40.270 INFO:tasks.workunit.client.0.smithi003.stdout:3/429: mkdir d0/d5/da/d28/d11/d49/d4c/d89 0 2024-09-21T12:20:40.272 INFO:tasks.workunit.client.0.smithi003.stdout:3/430: stat d0/d5/da/d28/d11/d49/d4c/d54/d5e/f4f 0 2024-09-21T12:20:40.275 INFO:tasks.workunit.client.0.smithi003.stdout:3/431: creat d0/d5/da/d28/d11/d49/f8a x:0 0 0 2024-09-21T12:20:40.276 INFO:tasks.workunit.client.0.smithi003.stdout:3/432: chown d0/d5/d38/d55/l68 470904515 1 2024-09-21T12:20:40.278 INFO:tasks.workunit.client.0.smithi003.stdout:3/433: creat d0/d5/da/d28/d11/d49/d4c/d6f/f8b x:0 0 0 2024-09-21T12:20:40.279 INFO:tasks.workunit.client.0.smithi003.stdout:3/434: write d0/d5/da/d28/d31/f67 [1569710,64713] 0 2024-09-21T12:20:40.282 INFO:tasks.workunit.client.0.smithi003.stdout:3/435: symlink d0/d5/da/d28/dd/l8c 0 2024-09-21T12:20:40.286 INFO:tasks.workunit.client.0.smithi003.stdout:3/436: mknod d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/d42/d6d/c8d 0 2024-09-21T12:20:40.287 INFO:tasks.workunit.client.0.smithi003.stdout:3/437: fsync d0/f16 0 2024-09-21T12:20:40.291 INFO:tasks.workunit.client.0.smithi003.stdout:3/438: creat d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/d42/d6d/d86/f8e x:0 0 0 2024-09-21T12:20:40.292 INFO:tasks.workunit.client.0.smithi003.stdout:3/439: write d0/d5/da/d28/d11/f34 [2512211,23745] 0 2024-09-21T12:20:40.298 INFO:tasks.workunit.client.0.smithi003.stdout:3/440: creat d0/d5/da/d28/d11/d49/d4c/d54/d5e/d48/f8f x:0 0 0 2024-09-21T12:20:40.305 INFO:tasks.workunit.client.0.smithi003.stdout:6/446: sync 2024-09-21T12:20:40.305 INFO:tasks.workunit.client.0.smithi003.stdout:1/422: sync 2024-09-21T12:20:40.305 INFO:tasks.workunit.client.0.smithi003.stdout:7/353: sync 2024-09-21T12:20:40.305 INFO:tasks.workunit.client.0.smithi003.stdout:9/514: sync 2024-09-21T12:20:40.305 INFO:tasks.workunit.client.0.smithi003.stdout:0/550: sync 2024-09-21T12:20:40.305 INFO:tasks.workunit.client.0.smithi003.stdout:5/476: sync 2024-09-21T12:20:40.306 INFO:tasks.workunit.client.0.smithi003.stdout:8/403: sync 2024-09-21T12:20:40.306 INFO:tasks.workunit.client.0.smithi003.stdout:4/319: sync 2024-09-21T12:20:40.307 INFO:tasks.workunit.client.0.smithi003.stdout:6/447: read - d4/d13/d2e/d37/d64/f69 zero size 2024-09-21T12:20:40.309 INFO:tasks.workunit.client.0.smithi003.stdout:5/477: chown dc/d15/d21/d30/l7e 62 1 2024-09-21T12:20:40.309 INFO:tasks.workunit.client.0.smithi003.stdout:6/448: dread - d4/d11/d1d/d36/f85 zero size 2024-09-21T12:20:40.312 INFO:tasks.workunit.client.0.smithi003.stdout:1/423: rename d4/dc/c3e to d4/d66/c91 0 2024-09-21T12:20:40.314 INFO:tasks.workunit.client.0.smithi003.stdout:8/404: creat d7/df/d20/d21/d4c/f90 x:0 0 0 2024-09-21T12:20:40.315 INFO:tasks.workunit.client.0.smithi003.stdout:8/405: chown d7/df/d20/d24 8 1 2024-09-21T12:20:40.317 INFO:tasks.workunit.client.0.smithi003.stdout:0/551: symlink d9/d12/d17/d38/d3a/d46/d55/lc2 0 2024-09-21T12:20:40.321 INFO:tasks.workunit.client.0.smithi003.stdout:4/320: dwrite f8 [0,4194304] 0 2024-09-21T12:20:40.322 INFO:tasks.workunit.client.0.smithi003.stdout:5/478: truncate dc/f3a 3108540 0 2024-09-21T12:20:40.323 INFO:tasks.workunit.client.0.smithi003.stdout:6/449: creat d4/d11/d17/f95 x:0 0 0 2024-09-21T12:20:40.325 INFO:tasks.workunit.client.0.smithi003.stdout:6/450: write f3 [8971709,25370] 0 2024-09-21T12:20:40.327 INFO:tasks.workunit.client.0.smithi003.stdout:8/406: dwrite d7/df/d20/d21/f3f [0,4194304] 0 2024-09-21T12:20:40.328 INFO:tasks.workunit.client.0.smithi003.stdout:8/407: readlink d7/de/d1a/l76 0 2024-09-21T12:20:40.331 INFO:tasks.workunit.client.0.smithi003.stdout:0/552: mkdir d9/d6c/d32/dc3 0 2024-09-21T12:20:40.335 INFO:tasks.workunit.client.0.smithi003.stdout:5/479: rename dc/d15/d21/d28/d41/d5b/d74/d7f/c89 to dc/d15/d6f/c9c 0 2024-09-21T12:20:40.336 INFO:tasks.workunit.client.0.smithi003.stdout:6/451: symlink d4/d13/d19/d38/l96 0 2024-09-21T12:20:40.337 INFO:tasks.workunit.client.0.smithi003.stdout:9/515: link d2/da/d17/c48 d2/da0/db3/cc2 0 2024-09-21T12:20:40.338 INFO:tasks.workunit.client.0.smithi003.stdout:5/480: readlink dc/d15/l87 0 2024-09-21T12:20:40.339 INFO:tasks.workunit.client.0.smithi003.stdout:6/452: readlink d4/d11/d17/l86 0 2024-09-21T12:20:40.339 INFO:tasks.workunit.client.0.smithi003.stdout:8/408: dwrite d7/df/d36/f5b [0,4194304] 0 2024-09-21T12:20:40.340 INFO:tasks.workunit.client.0.smithi003.stdout:6/453: chown d4/d13/l42 0 1 2024-09-21T12:20:40.342 INFO:tasks.workunit.client.0.smithi003.stdout:0/553: stat d9/d12/f81 0 2024-09-21T12:20:40.348 INFO:tasks.workunit.client.0.smithi003.stdout:8/409: creat d7/df/d16/f91 x:0 0 0 2024-09-21T12:20:40.348 INFO:tasks.workunit.client.0.smithi003.stdout:0/554: dread - d9/d6c/d26/db3/fb5 zero size 2024-09-21T12:20:40.351 INFO:tasks.workunit.client.0.smithi003.stdout:6/454: read f3 [6773477,27446] 0 2024-09-21T12:20:40.351 INFO:tasks.workunit.client.0.smithi003.stdout:5/481: dwrite dc/d2b/d4e/f70 [0,4194304] 0 2024-09-21T12:20:40.352 INFO:tasks.workunit.client.0.smithi003.stdout:8/410: write d7/de/f56 [1949935,111819] 0 2024-09-21T12:20:40.353 INFO:tasks.workunit.client.0.smithi003.stdout:6/455: chown d4/d13/d2e/d37/d64/f74 336724 1 2024-09-21T12:20:40.355 INFO:tasks.workunit.client.0.smithi003.stdout:8/411: stat d7/df/d16/l61 0 2024-09-21T12:20:40.355 INFO:tasks.workunit.client.0.smithi003.stdout:5/482: chown dc/d15/c27 970673 1 2024-09-21T12:20:40.359 INFO:tasks.workunit.client.0.smithi003.stdout:5/483: read - dc/d15/d21/d28/d41/d5b/d74/d7f/f93 zero size 2024-09-21T12:20:40.360 INFO:tasks.workunit.client.0.smithi003.stdout:1/424: write d4/f7 [4149987,116416] 0 2024-09-21T12:20:40.361 INFO:tasks.workunit.client.0.smithi003.stdout:5/484: dread - dc/d15/d1c/f4c zero size 2024-09-21T12:20:40.363 INFO:tasks.workunit.client.0.smithi003.stdout:8/412: creat d7/df/d20/d21/d4c/d4d/f92 x:0 0 0 2024-09-21T12:20:40.365 INFO:tasks.workunit.client.0.smithi003.stdout:8/413: dread - d7/de/d1a/f68 zero size 2024-09-21T12:20:40.367 INFO:tasks.workunit.client.0.smithi003.stdout:5/485: mknod dc/d15/d21/d30/d35/c9d 0 2024-09-21T12:20:40.368 INFO:tasks.workunit.client.0.smithi003.stdout:4/321: write d9/da/f31 [3140738,110953] 0 2024-09-21T12:20:40.368 INFO:tasks.workunit.client.0.smithi003.stdout:8/414: read d7/df/d16/f5c [1378204,80321] 0 2024-09-21T12:20:40.371 INFO:tasks.workunit.client.0.smithi003.stdout:6/456: getdents d4/d11/d17 0 2024-09-21T12:20:40.374 INFO:tasks.workunit.client.0.smithi003.stdout:5/486: unlink dc/d15/d1c/c2a 0 2024-09-21T12:20:40.376 INFO:tasks.workunit.client.0.smithi003.stdout:1/425: link d4/d11/d14/d25/d42/f5f d4/d11/d14/d25/d59/f92 0 2024-09-21T12:20:40.381 INFO:tasks.workunit.client.0.smithi003.stdout:8/415: creat d7/df/d16/f93 x:0 0 0 2024-09-21T12:20:40.381 INFO:tasks.workunit.client.0.smithi003.stdout:0/555: dread d9/d6c/f1b [4194304,4194304] 0 2024-09-21T12:20:40.382 INFO:tasks.workunit.client.0.smithi003.stdout:0/556: chown d9/d6c/d26/f3c 346797145 1 2024-09-21T12:20:40.383 INFO:tasks.workunit.client.0.smithi003.stdout:5/487: mknod dc/d15/d21/d28/d41/d5b/d74/d7f/c9e 0 2024-09-21T12:20:40.384 INFO:tasks.workunit.client.0.smithi003.stdout:0/557: dread - d9/d12/d17/d38/d3a/f87 zero size 2024-09-21T12:20:40.388 INFO:tasks.workunit.client.0.smithi003.stdout:4/322: dread d9/d25/f5e [0,4194304] 0 2024-09-21T12:20:40.389 INFO:tasks.workunit.client.0.smithi003.stdout:4/323: chown d9/da/d66/d67/l68 2 1 2024-09-21T12:20:40.391 INFO:tasks.workunit.client.0.smithi003.stdout:1/426: rename d4/df/d41/c48 to d4/d11/d14/d25/d59/d65/c93 0 2024-09-21T12:20:40.392 INFO:tasks.workunit.client.0.smithi003.stdout:6/457: dread d4/d13/d2e/f44 [0,4194304] 0 2024-09-21T12:20:40.395 INFO:tasks.workunit.client.0.smithi003.stdout:5/488: mkdir dc/d15/d21/d28/d41/d9f 0 2024-09-21T12:20:40.399 INFO:tasks.workunit.client.0.smithi003.stdout:8/416: mknod d7/df/d20/c94 0 2024-09-21T12:20:40.400 INFO:tasks.workunit.client.0.smithi003.stdout:8/417: write d7/d57/f71 [884454,100612] 0 2024-09-21T12:20:40.406 INFO:tasks.workunit.client.0.smithi003.stdout:5/489: rename dc/d15/d21/d30 to dc/d15/d21/d28/d41/da0 0 2024-09-21T12:20:40.409 INFO:tasks.workunit.client.0.smithi003.stdout:8/418: unlink c2 0 2024-09-21T12:20:40.410 INFO:tasks.workunit.client.0.smithi003.stdout:6/458: dwrite d4/d13/d19/d38/f41 [4194304,4194304] 0 2024-09-21T12:20:40.411 INFO:tasks.workunit.client.0.smithi003.stdout:8/419: dread - d7/f78 zero size 2024-09-21T12:20:40.417 INFO:tasks.workunit.client.0.smithi003.stdout:4/324: dwrite d9/da/fb [0,4194304] 0 2024-09-21T12:20:40.419 INFO:tasks.workunit.client.0.smithi003.stdout:0/558: link d9/d12/d17/d21/d30/c3d d9/cc4 0 2024-09-21T12:20:40.423 INFO:tasks.workunit.client.0.smithi003.stdout:6/459: dwrite d4/d9/fd [4194304,4194304] 0 2024-09-21T12:20:40.427 INFO:tasks.workunit.client.0.smithi003.stdout:1/427: getdents d4/d11/d14/d78 0 2024-09-21T12:20:40.428 INFO:tasks.workunit.client.0.smithi003.stdout:4/325: rmdir d9/da/d47/d4b 39 2024-09-21T12:20:40.432 INFO:tasks.workunit.client.0.smithi003.stdout:0/559: dwrite d9/d6c/d26/d54/f8e [0,4194304] 0 2024-09-21T12:20:40.435 INFO:tasks.workunit.client.0.smithi003.stdout:8/420: creat d7/df/d20/d21/d4c/d4d/d8c/f95 x:0 0 0 2024-09-21T12:20:40.438 INFO:tasks.workunit.client.0.smithi003.stdout:6/460: rename d4/d13/d19/d23/c4e to d4/c97 0 2024-09-21T12:20:40.441 INFO:tasks.workunit.client.0.smithi003.stdout:1/428: truncate d4/dc/f10 776830 0 2024-09-21T12:20:40.442 INFO:tasks.workunit.client.0.smithi003.stdout:5/490: link dc/d2b/l60 dc/d15/la1 0 2024-09-21T12:20:40.445 INFO:tasks.workunit.client.0.smithi003.stdout:8/421: rename d7/df/d20/d24/d47/d79/c1c to d7/de/d52/c96 0 2024-09-21T12:20:40.450 INFO:tasks.workunit.client.0.smithi003.stdout:5/491: symlink dc/d15/d21/d28/d3c/d73/la2 0 2024-09-21T12:20:40.450 INFO:tasks.workunit.client.0.smithi003.stdout:1/429: dwrite d4/dc/d80/f83 [0,4194304] 0 2024-09-21T12:20:40.452 INFO:tasks.workunit.client.0.smithi003.stdout:5/492: chown dc/d15/d21/l98 1065266 1 2024-09-21T12:20:40.452 INFO:tasks.workunit.client.0.smithi003.stdout:1/430: write d4/fa [2726096,43959] 0 2024-09-21T12:20:40.454 INFO:tasks.workunit.client.0.smithi003.stdout:4/326: getdents d9/d48/d49 0 2024-09-21T12:20:40.460 INFO:tasks.workunit.client.0.smithi003.stdout:1/431: truncate d4/dc/f16 1270777 0 2024-09-21T12:20:40.462 INFO:tasks.workunit.client.0.smithi003.stdout:4/327: write d9/da/d47/d4b/f56 [580939,76123] 0 2024-09-21T12:20:40.463 INFO:tasks.workunit.client.0.smithi003.stdout:4/328: stat d9/d16/c41 0 2024-09-21T12:20:40.467 INFO:tasks.workunit.client.0.smithi003.stdout:8/422: getdents d7/d57 0 2024-09-21T12:20:40.468 INFO:tasks.workunit.client.0.smithi003.stdout:5/493: unlink dc/d2b/d4e/c5e 0 2024-09-21T12:20:40.470 INFO:tasks.workunit.client.0.smithi003.stdout:1/432: stat d4/fb 0 2024-09-21T12:20:40.474 INFO:tasks.workunit.client.0.smithi003.stdout:4/329: creat d9/d25/f69 x:0 0 0 2024-09-21T12:20:40.475 INFO:tasks.workunit.client.0.smithi003.stdout:0/560: dwrite d9/d12/d17/d38/d3a/d46/f94 [0,4194304] 0 2024-09-21T12:20:40.482 INFO:tasks.workunit.client.0.smithi003.stdout:6/461: mkdir d4/d13/d2e/d37/d98 0 2024-09-21T12:20:40.483 INFO:tasks.workunit.client.0.smithi003.stdout:1/433: creat d4/d11/d14/d25/d42/d63/f94 x:0 0 0 2024-09-21T12:20:40.485 INFO:tasks.workunit.client.0.smithi003.stdout:0/561: symlink d9/d12/d17/d38/d3a/d46/d55/d7b/lc5 0 2024-09-21T12:20:40.491 INFO:tasks.workunit.client.0.smithi003.stdout:6/462: dwrite d4/d13/d2e/d37/d58/f5c [0,4194304] 0 2024-09-21T12:20:40.493 INFO:tasks.workunit.client.0.smithi003.stdout:1/434: rename d4/f13 to d4/df/d19/f95 0 2024-09-21T12:20:40.494 INFO:tasks.workunit.client.0.smithi003.stdout:0/562: dread d9/f4c [0,4194304] 0 2024-09-21T12:20:40.495 INFO:tasks.workunit.client.0.smithi003.stdout:6/463: dread - d4/d13/d2e/d37/f90 zero size 2024-09-21T12:20:40.497 INFO:tasks.workunit.client.0.smithi003.stdout:0/563: fdatasync d9/d12/d17/d38/d3a/d46/f94 0 2024-09-21T12:20:40.499 INFO:tasks.workunit.client.0.smithi003.stdout:4/330: dread d9/da/d36/f50 [0,4194304] 0 2024-09-21T12:20:40.499 INFO:tasks.workunit.client.0.smithi003.stdout:8/423: getdents d7/df/d20/d24/d47/d79 0 2024-09-21T12:20:40.501 INFO:tasks.workunit.client.0.smithi003.stdout:1/435: dread d4/d11/f4a [0,4194304] 0 2024-09-21T12:20:40.505 INFO:tasks.workunit.client.0.smithi003.stdout:5/494: write dc/f3a [1046763,25638] 0 2024-09-21T12:20:40.507 INFO:tasks.workunit.client.0.smithi003.stdout:6/464: mknod d4/c99 0 2024-09-21T12:20:40.510 INFO:tasks.workunit.client.0.smithi003.stdout:8/424: creat d7/df/d20/d24/d47/d79/f97 x:0 0 0 2024-09-21T12:20:40.513 INFO:tasks.workunit.client.0.smithi003.stdout:1/436: symlink d4/df/d41/l96 0 2024-09-21T12:20:40.514 INFO:tasks.workunit.client.0.smithi003.stdout:0/564: mkdir d9/d6c/d32/dc3/dc6 0 2024-09-21T12:20:40.515 INFO:tasks.workunit.client.0.smithi003.stdout:0/565: chown d9/d12/d1e/d5f/la8 1 1 2024-09-21T12:20:40.518 INFO:tasks.workunit.client.0.smithi003.stdout:8/425: creat d7/d57/f98 x:0 0 0 2024-09-21T12:20:40.520 INFO:tasks.workunit.client.0.smithi003.stdout:1/437: dread d4/d11/d14/d25/d59/f92 [0,4194304] 0 2024-09-21T12:20:40.521 INFO:tasks.workunit.client.0.smithi003.stdout:0/566: write d9/d12/d17/d21/fa7 [3894447,80136] 0 2024-09-21T12:20:40.522 INFO:tasks.workunit.client.0.smithi003.stdout:6/465: mknod d4/d13/d22/c9a 0 2024-09-21T12:20:40.523 INFO:tasks.workunit.client.0.smithi003.stdout:1/438: dread - d4/d11/d14/d25/d42/f89 zero size 2024-09-21T12:20:40.523 INFO:tasks.workunit.client.0.smithi003.stdout:0/567: write d9/d6c/f1b [7279880,98372] 0 2024-09-21T12:20:40.526 INFO:tasks.workunit.client.0.smithi003.stdout:8/426: mkdir d7/df/d20/d21/d99 0 2024-09-21T12:20:40.526 INFO:tasks.workunit.client.0.smithi003.stdout:5/495: dread dc/d15/d1c/f3e [0,4194304] 0 2024-09-21T12:20:40.528 INFO:tasks.workunit.client.0.smithi003.stdout:5/496: write dc/d15/d21/d28/d3c/f91 [231448,18300] 0 2024-09-21T12:20:40.532 INFO:tasks.workunit.client.0.smithi003.stdout:1/439: mknod d4/d11/d14/d25/d42/d7b/c97 0 2024-09-21T12:20:40.533 INFO:tasks.workunit.client.0.smithi003.stdout:8/427: dread d7/df/d20/d21/f6d [0,4194304] 0 2024-09-21T12:20:40.533 INFO:tasks.workunit.client.0.smithi003.stdout:0/568: truncate d9/d12/f81 2157235 0 2024-09-21T12:20:40.534 INFO:tasks.workunit.client.0.smithi003.stdout:8/428: chown d7/df/d36/c38 106 1 2024-09-21T12:20:40.535 INFO:tasks.workunit.client.0.smithi003.stdout:4/331: link d9/c1e d9/d48/c6a 0 2024-09-21T12:20:40.537 INFO:tasks.workunit.client.0.smithi003.stdout:6/466: creat d4/d9/d79/d94/f9b x:0 0 0 2024-09-21T12:20:40.539 INFO:tasks.workunit.client.0.smithi003.stdout:8/429: creat d7/df/d16/f9a x:0 0 0 2024-09-21T12:20:40.541 INFO:tasks.workunit.client.0.smithi003.stdout:4/332: mknod d9/da/d66/c6b 0 2024-09-21T12:20:40.544 INFO:tasks.workunit.client.0.smithi003.stdout:6/467: rmdir d4/d13/d2e/d37/d64 39 2024-09-21T12:20:40.545 INFO:tasks.workunit.client.0.smithi003.stdout:6/468: chown d4/d13/d19/d23/l51 503 1 2024-09-21T12:20:40.548 INFO:tasks.workunit.client.0.smithi003.stdout:8/430: symlink d7/df/d20/d21/d4c/d4d/l9b 0 2024-09-21T12:20:40.551 INFO:tasks.workunit.client.0.smithi003.stdout:8/431: write d7/de/f56 [2340081,68203] 0 2024-09-21T12:20:40.551 INFO:tasks.workunit.client.0.smithi003.stdout:0/569: fsync d9/d12/f81 0 2024-09-21T12:20:40.553 INFO:tasks.workunit.client.0.smithi003.stdout:0/570: chown d9/d6c/d66 44683 1 2024-09-21T12:20:40.553 INFO:tasks.workunit.client.0.smithi003.stdout:6/469: dwrite d4/d13/d19/d23/f4d [0,4194304] 0 2024-09-21T12:20:40.554 INFO:tasks.workunit.client.0.smithi003.stdout:4/333: creat d9/d48/d49/f6c x:0 0 0 2024-09-21T12:20:40.554 INFO:tasks.workunit.client.0.smithi003.stdout:8/432: read - d7/df/d20/d24/d47/d79/f67 zero size 2024-09-21T12:20:40.556 INFO:tasks.workunit.client.0.smithi003.stdout:4/334: read d9/da/f27 [3323657,97503] 0 2024-09-21T12:20:40.557 INFO:tasks.workunit.client.0.smithi003.stdout:5/497: getdents dc/d15/d21/d28/d41/da0/d4b/d5c 0 2024-09-21T12:20:40.561 INFO:tasks.workunit.client.0.smithi003.stdout:1/440: link d4/d11/d14/c2c d4/df/c98 0 2024-09-21T12:20:40.565 INFO:tasks.workunit.client.0.smithi003.stdout:6/470: mknod d4/d13/d63/c9c 0 2024-09-21T12:20:40.567 INFO:tasks.workunit.client.0.smithi003.stdout:0/571: creat d9/d6c/d66/fc7 x:0 0 0 2024-09-21T12:20:40.572 INFO:tasks.workunit.client.0.smithi003.stdout:1/441: dwrite d4/d11/d14/d25/d42/d7b/f7a [0,4194304] 0 2024-09-21T12:20:40.574 INFO:tasks.workunit.client.0.smithi003.stdout:0/572: creat d9/d12/d17/d38/d3a/d46/d55/d9e/fc8 x:0 0 0 2024-09-21T12:20:40.576 INFO:tasks.workunit.client.0.smithi003.stdout:6/471: fsync d4/f21 0 2024-09-21T12:20:40.577 INFO:tasks.workunit.client.0.smithi003.stdout:8/433: dread d7/df/d20/d24/f2e [0,4194304] 0 2024-09-21T12:20:40.579 INFO:tasks.workunit.client.0.smithi003.stdout:5/498: dwrite dc/d15/d1c/f29 [0,4194304] 0 2024-09-21T12:20:40.580 INFO:tasks.workunit.client.0.smithi003.stdout:6/472: write d4/d13/d22/f6f [1259453,90106] 0 2024-09-21T12:20:40.581 INFO:tasks.workunit.client.0.smithi003.stdout:1/442: symlink d4/d11/d14/d25/l99 0 2024-09-21T12:20:40.584 INFO:tasks.workunit.client.0.smithi003.stdout:5/499: dread - dc/d15/d21/d28/d41/d5b/d74/d7f/f93 zero size 2024-09-21T12:20:40.585 INFO:tasks.workunit.client.0.smithi003.stdout:5/500: dread - dc/d2b/d4e/f94 zero size 2024-09-21T12:20:40.586 INFO:tasks.workunit.client.0.smithi003.stdout:4/335: link d9/l20 d9/da/d66/d67/l6d 0 2024-09-21T12:20:40.589 INFO:tasks.workunit.client.0.smithi003.stdout:1/443: creat d4/d11/d14/d25/f9a x:0 0 0 2024-09-21T12:20:40.590 INFO:tasks.workunit.client.0.smithi003.stdout:1/444: readlink d4/d11/l7e 0 2024-09-21T12:20:40.590 INFO:tasks.workunit.client.0.smithi003.stdout:6/473: getdents d4/d13/d2e/d37/d58 0 2024-09-21T12:20:40.592 INFO:tasks.workunit.client.0.smithi003.stdout:1/445: truncate d4/df/d19/f6f 1042314 0 2024-09-21T12:20:40.593 INFO:tasks.workunit.client.0.smithi003.stdout:0/573: rename d9/c20 to d9/cc9 0 2024-09-21T12:20:40.594 INFO:tasks.workunit.client.0.smithi003.stdout:6/474: creat d4/d9/d79/f9d x:0 0 0 2024-09-21T12:20:40.596 INFO:tasks.workunit.client.0.smithi003.stdout:1/446: symlink d4/d11/d14/d25/d42/d7b/l9b 0 2024-09-21T12:20:40.597 INFO:tasks.workunit.client.0.smithi003.stdout:1/447: chown d4/d11/d14/d78 61014301 1 2024-09-21T12:20:40.599 INFO:tasks.workunit.client.0.smithi003.stdout:6/475: chown d4/d13/d5b/l78 62 1 2024-09-21T12:20:40.603 INFO:tasks.workunit.client.0.smithi003.stdout:0/574: rmdir d9/d6c/d26/d54/dbc 0 2024-09-21T12:20:40.604 INFO:tasks.workunit.client.0.smithi003.stdout:6/476: stat d4/f10 0 2024-09-21T12:20:40.605 INFO:tasks.workunit.client.0.smithi003.stdout:0/575: write d9/d6c/f1b [4518244,20027] 0 2024-09-21T12:20:40.605 INFO:tasks.workunit.client.0.smithi003.stdout:6/477: chown d4/d13 314393 1 2024-09-21T12:20:40.606 INFO:tasks.workunit.client.0.smithi003.stdout:4/336: write d9/da/f12 [4716416,107830] 0 2024-09-21T12:20:40.608 INFO:tasks.workunit.client.0.smithi003.stdout:6/478: truncate d4/d13/d63/f71 181197 0 2024-09-21T12:20:40.608 INFO:tasks.workunit.client.0.smithi003.stdout:1/448: link d4/df/d12/f3b d4/d11/d14/d78/f9c 0 2024-09-21T12:20:40.609 INFO:tasks.workunit.client.0.smithi003.stdout:8/434: dread d7/df/d20/d21/f3a [0,4194304] 0 2024-09-21T12:20:40.611 INFO:tasks.workunit.client.0.smithi003.stdout:5/501: truncate dc/d2b/f44 399237 0 2024-09-21T12:20:40.612 INFO:tasks.workunit.client.0.smithi003.stdout:1/449: symlink d4/d11/d14/d25/l9d 0 2024-09-21T12:20:40.613 INFO:tasks.workunit.client.0.smithi003.stdout:8/435: mknod d7/df/d20/d21/d4c/c9c 0 2024-09-21T12:20:40.616 INFO:tasks.workunit.client.0.smithi003.stdout:5/502: symlink dc/d15/d21/d28/d41/d5b/la3 0 2024-09-21T12:20:40.618 INFO:tasks.workunit.client.0.smithi003.stdout:0/576: creat d9/d6c/fca x:0 0 0 2024-09-21T12:20:40.619 INFO:tasks.workunit.client.0.smithi003.stdout:4/337: rename d9/d16/c32 to d9/da/d47/c6e 0 2024-09-21T12:20:40.620 INFO:tasks.workunit.client.0.smithi003.stdout:5/503: write dc/d15/d21/f24 [1732814,119716] 0 2024-09-21T12:20:40.622 INFO:tasks.workunit.client.0.smithi003.stdout:6/479: rename d4/d13/d19/d38/l96 to d4/d9/l9e 0 2024-09-21T12:20:40.623 INFO:tasks.workunit.client.0.smithi003.stdout:6/480: fsync d4/d13/d56/f8f 0 2024-09-21T12:20:40.623 INFO:tasks.workunit.client.0.smithi003.stdout:4/338: creat d9/d48/d49/f6f x:0 0 0 2024-09-21T12:20:40.669 INFO:tasks.workunit.client.0.smithi003.stdout:1/450: getdents d4/d11/d14/d25/d42 0 2024-09-21T12:20:40.672 INFO:tasks.workunit.client.0.smithi003.stdout:4/339: dread - d9/da/d47/f4c zero size 2024-09-21T12:20:40.673 INFO:tasks.workunit.client.0.smithi003.stdout:4/340: write d9/da/d47/d4b/f56 [874845,60010] 0 2024-09-21T12:20:40.674 INFO:tasks.workunit.client.0.smithi003.stdout:4/341: stat d9/d48/d49/l52 0 2024-09-21T12:20:40.676 INFO:tasks.workunit.client.0.smithi003.stdout:6/481: mknod d4/d11/c9f 0 2024-09-21T12:20:40.676 INFO:tasks.workunit.client.0.smithi003.stdout:0/577: dread d9/d12/d17/d21/d30/f68 [0,4194304] 0 2024-09-21T12:20:40.679 INFO:tasks.workunit.client.0.smithi003.stdout:4/342: creat d9/d16/f70 x:0 0 0 2024-09-21T12:20:40.681 INFO:tasks.workunit.client.0.smithi003.stdout:1/451: dwrite d4/df/d41/f7f [0,4194304] 0 2024-09-21T12:20:40.681 INFO:tasks.workunit.client.0.smithi003.stdout:4/343: stat d9/d48/d49/c59 0 2024-09-21T12:20:40.683 INFO:tasks.workunit.client.0.smithi003.stdout:6/482: rename d4/d9/c25 to d4/d9/d59/ca0 0 2024-09-21T12:20:40.685 INFO:tasks.workunit.client.0.smithi003.stdout:6/483: readlink d4/d13/d19/d23/l7a 0 2024-09-21T12:20:40.686 INFO:tasks.workunit.client.0.smithi003.stdout:1/452: fdatasync d4/d11/d14/d78/f9c 0 2024-09-21T12:20:40.687 INFO:tasks.workunit.client.0.smithi003.stdout:0/578: dread d9/d12/d17/d38/d3a/d46/f79 [0,4194304] 0 2024-09-21T12:20:40.690 INFO:tasks.workunit.client.0.smithi003.stdout:1/453: fsync d4/d11/d14/d25/d42/d63/f94 0 2024-09-21T12:20:40.691 INFO:tasks.workunit.client.0.smithi003.stdout:4/344: dwrite d9/da/f31 [0,4194304] 0 2024-09-21T12:20:40.694 INFO:tasks.workunit.client.0.smithi003.stdout:1/454: write d4/df/d12/f75 [372745,124202] 0 2024-09-21T12:20:40.695 INFO:tasks.workunit.client.0.smithi003.stdout:1/455: dread d4/df/d12/f3b [0,4194304] 0 2024-09-21T12:20:40.696 INFO:tasks.workunit.client.0.smithi003.stdout:6/484: creat d4/d13/d19/fa1 x:0 0 0 2024-09-21T12:20:40.697 INFO:tasks.workunit.client.0.smithi003.stdout:4/345: mknod d9/d25/c71 0 2024-09-21T12:20:40.704 INFO:tasks.workunit.client.0.smithi003.stdout:4/346: rename d9/d48/d49 to d9/da/d47/d4b/d72 0 2024-09-21T12:20:40.708 INFO:tasks.workunit.client.0.smithi003.stdout:0/579: link d9/d12/d17/d38/d3a/d46/d55/d57/c70 d9/d6c/d26/d54/d88/ccb 0 2024-09-21T12:20:40.712 INFO:tasks.workunit.client.0.smithi003.stdout:0/580: rename d9/d12/d17/f2f to d9/d6c/d32/fcc 0 2024-09-21T12:20:40.713 INFO:tasks.workunit.client.0.smithi003.stdout:0/581: fdatasync d9/d6c/d32/f6e 0 2024-09-21T12:20:40.714 INFO:tasks.workunit.client.0.smithi003.stdout:6/485: getdents d4/d11/d1d 0 2024-09-21T12:20:40.716 INFO:tasks.workunit.client.0.smithi003.stdout:1/456: dread d4/f3c [4194304,4194304] 0 2024-09-21T12:20:40.718 INFO:tasks.workunit.client.0.smithi003.stdout:0/582: dread d9/d12/d17/d38/d3a/d46/d55/d7b/f83 [0,4194304] 0 2024-09-21T12:20:40.719 INFO:tasks.workunit.client.0.smithi003.stdout:0/583: rename d9/d12 to d9/d12/d17/d38/dcd 22 2024-09-21T12:20:40.721 INFO:tasks.workunit.client.0.smithi003.stdout:6/486: creat d4/d13/d63/fa2 x:0 0 0 2024-09-21T12:20:40.722 INFO:tasks.workunit.client.0.smithi003.stdout:6/487: write d4/d13/d63/f72 [274986,127658] 0 2024-09-21T12:20:40.730 INFO:tasks.workunit.client.0.smithi003.stdout:0/584: mknod d9/d12/d1e/d5f/cce 0 2024-09-21T12:20:40.731 INFO:tasks.workunit.client.0.smithi003.stdout:0/585: fdatasync d9/d12/d17/d38/d3a/d46/d55/d67/f4a 0 2024-09-21T12:20:40.733 INFO:tasks.workunit.client.0.smithi003.stdout:6/488: mkdir d4/d13/d19/d38/da3 0 2024-09-21T12:20:40.734 INFO:tasks.workunit.client.0.smithi003.stdout:6/489: fdatasync d4/d13/d2e/d37/f6b 0 2024-09-21T12:20:40.737 INFO:tasks.workunit.client.0.smithi003.stdout:4/347: write f6 [2912221,73415] 0 2024-09-21T12:20:40.739 INFO:tasks.workunit.client.0.smithi003.stdout:4/348: fsync d9/da/fb 0 2024-09-21T12:20:40.740 INFO:tasks.workunit.client.0.smithi003.stdout:1/457: getdents d4/d11/d14/d25/d42 0 2024-09-21T12:20:40.742 INFO:tasks.workunit.client.0.smithi003.stdout:6/490: dwrite d4/d13/d63/f71 [0,4194304] 0 2024-09-21T12:20:40.748 INFO:tasks.workunit.client.0.smithi003.stdout:4/349: truncate d9/fc 1597086 0 2024-09-21T12:20:40.750 INFO:tasks.workunit.client.0.smithi003.stdout:1/458: rename d4/df/d12/c5c to d4/df/d12/c9e 0 2024-09-21T12:20:40.752 INFO:tasks.workunit.client.0.smithi003.stdout:6/491: creat d4/d11/d17/fa4 x:0 0 0 2024-09-21T12:20:40.753 INFO:tasks.workunit.client.0.smithi003.stdout:6/492: write d4/d9/d59/f77 [101491,21396] 0 2024-09-21T12:20:40.761 INFO:tasks.workunit.client.0.smithi003.stdout:1/459: creat d4/d11/d14/d25/d59/f9f x:0 0 0 2024-09-21T12:20:40.764 INFO:tasks.workunit.client.0.smithi003.stdout:6/493: creat d4/d13/d22/fa5 x:0 0 0 2024-09-21T12:20:40.765 INFO:tasks.workunit.client.0.smithi003.stdout:0/586: getdents d9/d12/d17/d21/d30/d4d 0 2024-09-21T12:20:40.766 INFO:tasks.workunit.client.0.smithi003.stdout:4/350: mkdir d9/d16/d65/d73 0 2024-09-21T12:20:40.773 INFO:tasks.workunit.client.0.smithi003.stdout:6/494: symlink d4/d13/d2e/d37/la6 0 2024-09-21T12:20:40.782 INFO:tasks.workunit.client.0.smithi003.stdout:0/587: creat d9/fcf x:0 0 0 2024-09-21T12:20:40.784 INFO:tasks.workunit.client.0.smithi003.stdout:6/495: mknod d4/d13/d63/d8b/ca7 0 2024-09-21T12:20:40.786 INFO:tasks.workunit.client.0.smithi003.stdout:0/588: mknod d9/d12/d1e/d5f/d8a/cd0 0 2024-09-21T12:20:40.791 INFO:tasks.workunit.client.0.smithi003.stdout:0/589: mknod d9/d6c/d26/d54/d7e/cd1 0 2024-09-21T12:20:40.793 INFO:tasks.workunit.client.0.smithi003.stdout:0/590: rmdir d9/d6c/d26/d54/d7e 39 2024-09-21T12:20:40.793 INFO:tasks.workunit.client.0.smithi003.stdout:0/591: readlink d9/d6c/l71 0 2024-09-21T12:20:40.794 INFO:tasks.workunit.client.0.smithi003.stdout:1/460: truncate d4/df/d19/f95 50082 0 2024-09-21T12:20:40.798 INFO:tasks.workunit.client.0.smithi003.stdout:0/592: unlink d9/d6c/d32/fcc 0 2024-09-21T12:20:40.798 INFO:tasks.workunit.client.0.smithi003.stdout:4/351: dwrite d9/d16/f3b [0,4194304] 0 2024-09-21T12:20:40.800 INFO:tasks.workunit.client.0.smithi003.stdout:1/461: mknod d4/d66/d8b/ca0 0 2024-09-21T12:20:40.802 INFO:tasks.workunit.client.0.smithi003.stdout:6/496: rename d4/d13/d63/d8b to d4/d11/d32/da8 0 2024-09-21T12:20:40.803 INFO:tasks.workunit.client.0.smithi003.stdout:6/497: readlink d4/d13/d19/d23/l7a 0 2024-09-21T12:20:40.803 INFO:tasks.workunit.client.0.smithi003.stdout:0/593: mknod d9/d6c/cd2 0 2024-09-21T12:20:40.805 INFO:tasks.workunit.client.0.smithi003.stdout:4/352: symlink d9/da/l74 0 2024-09-21T12:20:40.809 INFO:tasks.workunit.client.0.smithi003.stdout:0/594: symlink d9/d12/d17/d38/d47/da9/ld3 0 2024-09-21T12:20:40.810 INFO:tasks.workunit.client.0.smithi003.stdout:0/595: chown d9 121575 1 2024-09-21T12:20:40.811 INFO:tasks.workunit.client.0.smithi003.stdout:6/498: dwrite d4/d9/f8a [0,4194304] 0 2024-09-21T12:20:40.811 INFO:tasks.workunit.client.0.smithi003.stdout:1/462: rename d4/dc/f43 to d4/df/d12/fa1 0 2024-09-21T12:20:40.816 INFO:tasks.workunit.client.0.smithi003.stdout:1/463: mknod d4/dc/d80/ca2 0 2024-09-21T12:20:40.817 INFO:tasks.workunit.client.0.smithi003.stdout:6/499: creat d4/d13/d19/d23/fa9 x:0 0 0 2024-09-21T12:20:40.826 INFO:tasks.workunit.client.0.smithi003.stdout:1/464: creat d4/dc/d80/fa3 x:0 0 0 2024-09-21T12:20:40.829 INFO:tasks.workunit.client.0.smithi003.stdout:1/465: write d4/d11/d14/d25/d59/f9f [434586,113760] 0 2024-09-21T12:20:40.830 INFO:tasks.workunit.client.0.smithi003.stdout:6/500: rename d4/d11/d32/l87 to d4/d13/d63/laa 0 2024-09-21T12:20:40.832 INFO:tasks.workunit.client.0.smithi003.stdout:0/596: write d9/d12/d17/d38/d3a/d46/d55/d67/f64 [13383,80113] 0 2024-09-21T12:20:40.835 INFO:tasks.workunit.client.0.smithi003.stdout:6/501: rename d4/d13/d19/f26 to d4/d13/d19/d38/fab 0 2024-09-21T12:20:40.836 INFO:tasks.workunit.client.0.smithi003.stdout:6/502: chown d4/d11/d32 1970811 1 2024-09-21T12:20:40.837 INFO:tasks.workunit.client.0.smithi003.stdout:6/503: fsync d4/d13/f7e 0 2024-09-21T12:20:40.840 INFO:tasks.workunit.client.0.smithi003.stdout:4/353: truncate d9/d16/f3d 306275 0 2024-09-21T12:20:40.841 INFO:tasks.workunit.client.0.smithi003.stdout:1/466: creat d4/df/fa4 x:0 0 0 2024-09-21T12:20:40.844 INFO:tasks.workunit.client.0.smithi003.stdout:6/504: stat d4/d13/d19/d38/c7f 0 2024-09-21T12:20:40.845 INFO:tasks.workunit.client.0.smithi003.stdout:6/505: read - d4/d13/d63/f8d zero size 2024-09-21T12:20:40.849 INFO:tasks.workunit.client.0.smithi003.stdout:4/354: dwrite d9/da/f12 [4194304,4194304] 0 2024-09-21T12:20:40.849 INFO:tasks.workunit.client.0.smithi003.stdout:0/597: dread d9/d6c/d26/f73 [0,4194304] 0 2024-09-21T12:20:40.850 INFO:tasks.workunit.client.0.smithi003.stdout:6/506: creat d4/d11/d32/fac x:0 0 0 2024-09-21T12:20:40.850 INFO:tasks.workunit.client.0.smithi003.stdout:4/355: chown d9/d25/f69 16828778 1 2024-09-21T12:20:40.851 INFO:tasks.workunit.client.0.smithi003.stdout:1/467: creat d4/df/fa5 x:0 0 0 2024-09-21T12:20:40.852 INFO:tasks.workunit.client.0.smithi003.stdout:6/507: write d4/d9/f45 [47277,120011] 0 2024-09-21T12:20:40.852 INFO:tasks.workunit.client.0.smithi003.stdout:1/468: chown d4/d11 0 1 2024-09-21T12:20:40.853 INFO:tasks.workunit.client.0.smithi003.stdout:0/598: write d9/d12/d17/d38/d3a/d46/d55/d67/f4a [332206,21791] 0 2024-09-21T12:20:40.855 INFO:tasks.workunit.client.0.smithi003.stdout:4/356: creat d9/da/d47/d4b/f75 x:0 0 0 2024-09-21T12:20:40.856 INFO:tasks.workunit.client.0.smithi003.stdout:6/508: write d4/fe [3644688,33971] 0 2024-09-21T12:20:40.859 INFO:tasks.workunit.client.0.smithi003.stdout:0/599: unlink d9/c60 0 2024-09-21T12:20:40.859 INFO:tasks.workunit.client.0.smithi003.stdout:2/406: sync 2024-09-21T12:20:40.860 INFO:tasks.workunit.client.0.smithi003.stdout:2/407: dread - d0/d21/d30/f93 zero size 2024-09-21T12:20:40.866 INFO:tasks.workunit.client.0.smithi003.stdout:1/469: symlink d4/df/d19/d8a/la6 0 2024-09-21T12:20:40.867 INFO:tasks.workunit.client.0.smithi003.stdout:1/470: read d4/df/d19/f6f [470561,34826] 0 2024-09-21T12:20:40.992 INFO:tasks.workunit.client.0.smithi003.stdout:1/471: rmdir d4/d11/d14 39 2024-09-21T12:20:40.993 INFO:tasks.workunit.client.0.smithi003.stdout:6/509: creat d4/d13/d19/fad x:0 0 0 2024-09-21T12:20:40.993 INFO:tasks.workunit.client.0.smithi003.stdout:3/441: sync 2024-09-21T12:20:40.994 INFO:tasks.workunit.client.0.smithi003.stdout:7/354: sync 2024-09-21T12:20:40.995 INFO:tasks.workunit.client.0.smithi003.stdout:2/408: dwrite d0/d21/d2f/f7b [0,4194304] 0 2024-09-21T12:20:40.996 INFO:tasks.workunit.client.0.smithi003.stdout:7/355: write d8/db/d32/f5d [1037022,120818] 0 2024-09-21T12:20:40.996 INFO:tasks.workunit.client.0.smithi003.stdout:3/442: dread - d0/d5/da/d28/d11/d49/d4c/f66 zero size 2024-09-21T12:20:41.003 INFO:tasks.workunit.client.0.smithi003.stdout:7/356: dwrite d8/db/ff [0,4194304] 0 2024-09-21T12:20:41.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:40 smithi192 ceph-mon[35641]: Standby manager daemon smithi003.wztftl started 2024-09-21T12:20:41.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:40 smithi192 ceph-mon[35641]: from='mgr.? 172.21.15.3:0/1290280288' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi003.wztftl/crt"}]: dispatch 2024-09-21T12:20:41.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:40 smithi192 ceph-mon[35641]: from='mgr.? 172.21.15.3:0/1290280288' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T12:20:41.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:40 smithi192 ceph-mon[35641]: from='mgr.? 172.21.15.3:0/1290280288' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi003.wztftl/key"}]: dispatch 2024-09-21T12:20:41.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:40 smithi192 ceph-mon[35641]: from='mgr.? 172.21.15.3:0/1290280288' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T12:20:41.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:40 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' 2024-09-21T12:20:41.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:40 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' 2024-09-21T12:20:41.020 INFO:tasks.workunit.client.0.smithi003.stdout:6/510: dread d4/d9/f45 [0,4194304] 0 2024-09-21T12:20:41.022 INFO:tasks.workunit.client.0.smithi003.stdout:7/357: creat d8/db/d13/f86 x:0 0 0 2024-09-21T12:20:41.022 INFO:tasks.workunit.client.0.smithi003.stdout:1/472: symlink d4/la7 0 2024-09-21T12:20:41.031 INFO:tasks.workunit.client.0.smithi003.stdout:3/443: creat d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/f90 x:0 0 0 2024-09-21T12:20:41.034 INFO:tasks.workunit.client.0.smithi003.stdout:1/473: rmdir d4/d11/d14/d25/d42/d63 39 2024-09-21T12:20:41.035 INFO:tasks.workunit.client.0.smithi003.stdout:1/474: dread - d4/df/d41/f60 zero size 2024-09-21T12:20:41.038 INFO:tasks.workunit.client.0.smithi003.stdout:3/444: mkdir d0/d5/da/d28/d11/d49/d4c/d6f/d91 0 2024-09-21T12:20:41.038 INFO:tasks.workunit.client.0.smithi003.stdout:3/445: chown d0/d5/f4a 258 1 2024-09-21T12:20:41.038 INFO:tasks.workunit.client.0.smithi003.stdout:3/446: dread - d0/d5/da/d28/d11/d49/f76 zero size 2024-09-21T12:20:41.038 INFO:tasks.workunit.client.0.smithi003.stdout:1/475: rmdir d4/d11/d14/d25 39 2024-09-21T12:20:41.039 INFO:tasks.workunit.client.0.smithi003.stdout:6/511: getdents d4/d9/d79/d94 0 2024-09-21T12:20:41.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:40 smithi003 ceph-mon[28057]: Standby manager daemon smithi003.wztftl started 2024-09-21T12:20:41.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:40 smithi003 ceph-mon[28057]: from='mgr.? 172.21.15.3:0/1290280288' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi003.wztftl/crt"}]: dispatch 2024-09-21T12:20:41.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:40 smithi003 ceph-mon[28057]: from='mgr.? 172.21.15.3:0/1290280288' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T12:20:41.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:40 smithi003 ceph-mon[28057]: from='mgr.? 172.21.15.3:0/1290280288' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi003.wztftl/key"}]: dispatch 2024-09-21T12:20:41.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:40 smithi003 ceph-mon[28057]: from='mgr.? 172.21.15.3:0/1290280288' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T12:20:41.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:40 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' 2024-09-21T12:20:41.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:40 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' 2024-09-21T12:20:41.096 INFO:tasks.workunit.client.0.smithi003.stdout:6/512: unlink d4/fe 0 2024-09-21T12:20:41.096 INFO:tasks.workunit.client.0.smithi003.stdout:3/447: symlink d0/d5/da/d28/d11/d49/l92 0 2024-09-21T12:20:41.097 INFO:tasks.workunit.client.0.smithi003.stdout:1/476: rename d4/d11/c53 to d4/dc/d80/ca8 0 2024-09-21T12:20:41.097 INFO:tasks.workunit.client.0.smithi003.stdout:7/358: write d8/f52 [358888,69785] 0 2024-09-21T12:20:41.099 INFO:tasks.workunit.client.0.smithi003.stdout:2/409: dwrite d0/d1c/f42 [0,4194304] 0 2024-09-21T12:20:41.103 INFO:tasks.workunit.client.0.smithi003.stdout:2/410: write d0/d21/d62/f8d [552517,130718] 0 2024-09-21T12:20:41.104 INFO:tasks.workunit.client.0.smithi003.stdout:7/359: mknod d8/db/d32/d43/d7e/c87 0 2024-09-21T12:20:41.109 INFO:tasks.workunit.client.0.smithi003.stdout:7/360: creat d8/db/d32/d43/f88 x:0 0 0 2024-09-21T12:20:41.110 INFO:tasks.workunit.client.0.smithi003.stdout:1/477: dwrite d4/df/d19/f6d [0,4194304] 0 2024-09-21T12:20:41.112 INFO:tasks.workunit.client.0.smithi003.stdout:6/513: dwrite d4/d13/d2e/d37/d58/f5c [4194304,4194304] 0 2024-09-21T12:20:41.112 INFO:tasks.workunit.client.0.smithi003.stdout:2/411: write d0/dd/d22/f57 [44226,6599] 0 2024-09-21T12:20:41.113 INFO:tasks.workunit.client.0.smithi003.stdout:7/361: truncate d8/f7b 213094 0 2024-09-21T12:20:41.115 INFO:tasks.workunit.client.0.smithi003.stdout:6/514: read d4/d9/f45 [1206643,30650] 0 2024-09-21T12:20:41.116 INFO:tasks.workunit.client.0.smithi003.stdout:2/412: write d0/d21/d62/f8d [686921,81199] 0 2024-09-21T12:20:41.123 INFO:tasks.workunit.client.0.smithi003.stdout:3/448: dread d0/d5/f1e [0,4194304] 0 2024-09-21T12:20:41.123 INFO:tasks.workunit.client.0.smithi003.stdout:6/515: mkdir d4/d11/d1d/d36/dae 0 2024-09-21T12:20:41.128 INFO:tasks.workunit.client.0.smithi003.stdout:2/413: mknod d0/d21/d2f/d49/c98 0 2024-09-21T12:20:41.133 INFO:tasks.workunit.client.0.smithi003.stdout:6/516: rename d4/d9/d79/d94/f9b to d4/d13/d5b/d8c/faf 0 2024-09-21T12:20:41.133 INFO:tasks.workunit.client.0.smithi003.stdout:7/362: dwrite d8/db/d13/f30 [0,4194304] 0 2024-09-21T12:20:41.134 INFO:tasks.workunit.client.0.smithi003.stdout:7/363: fsync d8/f52 0 2024-09-21T12:20:41.134 INFO:tasks.workunit.client.0.smithi003.stdout:6/517: read - d4/d13/d56/f91 zero size 2024-09-21T12:20:41.135 INFO:tasks.workunit.client.0.smithi003.stdout:2/414: read - d0/d1c/d6a/f31 zero size 2024-09-21T12:20:41.136 INFO:tasks.workunit.client.0.smithi003.stdout:1/478: creat d4/d11/d14/d25/d42/d63/fa9 x:0 0 0 2024-09-21T12:20:41.137 INFO:tasks.workunit.client.0.smithi003.stdout:2/415: dread - d0/dd/d22/f79 zero size 2024-09-21T12:20:41.137 INFO:tasks.workunit.client.0.smithi003.stdout:3/449: mknod d0/d5/da/d28/d11/d49/d4c/d54/d5e/c93 0 2024-09-21T12:20:41.139 INFO:tasks.workunit.client.0.smithi003.stdout:6/518: dread d4/d9/f8a [0,4194304] 0 2024-09-21T12:20:41.148 INFO:tasks.workunit.client.0.smithi003.stdout:6/519: symlink d4/d13/d19/lb0 0 2024-09-21T12:20:41.149 INFO:tasks.workunit.client.0.smithi003.stdout:3/450: getdents d0/d5/da/d28 0 2024-09-21T12:20:41.150 INFO:tasks.workunit.client.0.smithi003.stdout:3/451: chown d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83 1952603 1 2024-09-21T12:20:41.152 INFO:tasks.workunit.client.0.smithi003.stdout:3/452: truncate d0/d5/da/d28/d11/d49/f76 660287 0 2024-09-21T12:20:41.154 INFO:tasks.workunit.client.0.smithi003.stdout:7/364: dread d8/d2c/f7f [0,4194304] 0 2024-09-21T12:20:41.155 INFO:tasks.workunit.client.0.smithi003.stdout:3/453: mkdir d0/d5/da/d28/d11/d49/d94 0 2024-09-21T12:20:41.156 INFO:tasks.workunit.client.0.smithi003.stdout:7/365: creat d8/db/d13/f89 x:0 0 0 2024-09-21T12:20:41.158 INFO:tasks.workunit.client.0.smithi003.stdout:7/366: truncate d8/d31/f5f 933929 0 2024-09-21T12:20:41.159 INFO:tasks.workunit.client.0.smithi003.stdout:7/367: write d8/d3c/d57/f73 [1924310,86419] 0 2024-09-21T12:20:41.162 INFO:tasks.workunit.client.0.smithi003.stdout:7/368: creat d8/db/d13/d60/f8a x:0 0 0 2024-09-21T12:20:41.164 INFO:tasks.workunit.client.0.smithi003.stdout:3/454: getdents d0/d5/da 0 2024-09-21T12:20:41.172 INFO:tasks.workunit.client.0.smithi003.stdout:7/369: dwrite d8/db/d13/f44 [0,4194304] 0 2024-09-21T12:20:41.174 INFO:tasks.workunit.client.0.smithi003.stdout:1/479: dwrite d4/df/d12/f46 [0,4194304] 0 2024-09-21T12:20:41.174 INFO:tasks.workunit.client.0.smithi003.stdout:7/370: fdatasync d8/fe 0 2024-09-21T12:20:41.176 INFO:tasks.workunit.client.0.smithi003.stdout:3/455: dwrite d0/d5/da/d28/f33 [0,4194304] 0 2024-09-21T12:20:41.179 INFO:tasks.workunit.client.0.smithi003.stdout:3/456: stat d0/d5/da/d28/d31/f63 0 2024-09-21T12:20:41.184 INFO:tasks.workunit.client.0.smithi003.stdout:3/457: write d0/d5/da/d28/d11/d49/d4c/d54/d5e/d48/f8f [380851,37013] 0 2024-09-21T12:20:41.185 INFO:tasks.workunit.client.0.smithi003.stdout:7/371: mknod d8/db/d32/d43/d7e/c8b 0 2024-09-21T12:20:41.187 INFO:tasks.workunit.client.0.smithi003.stdout:1/480: dwrite d4/d11/d49/f7c [0,4194304] 0 2024-09-21T12:20:41.189 INFO:tasks.workunit.client.0.smithi003.stdout:3/458: truncate d0/d5/da/d28/f88 148321 0 2024-09-21T12:20:41.194 INFO:tasks.workunit.client.0.smithi003.stdout:1/481: dread d4/d11/f4a [0,4194304] 0 2024-09-21T12:20:41.194 INFO:tasks.workunit.client.0.smithi003.stdout:3/459: fdatasync d0/d5/da/d28/f51 0 2024-09-21T12:20:41.197 INFO:tasks.workunit.client.0.smithi003.stdout:1/482: read d4/d11/d14/d25/d42/d63/f6b [748888,79515] 0 2024-09-21T12:20:41.199 INFO:tasks.workunit.client.0.smithi003.stdout:1/483: write d4/df/fa5 [107550,78776] 0 2024-09-21T12:20:41.199 INFO:tasks.workunit.client.0.smithi003.stdout:3/460: rename d0/d5/da/d28/d31/c78 to d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/c95 0 2024-09-21T12:20:41.203 INFO:tasks.workunit.client.0.smithi003.stdout:3/461: dread d0/f19 [0,4194304] 0 2024-09-21T12:20:41.206 INFO:tasks.workunit.client.0.smithi003.stdout:3/462: fdatasync d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/f2c 0 2024-09-21T12:20:41.208 INFO:tasks.workunit.client.0.smithi003.stdout:3/463: mkdir d0/d5/da/d28/d11/d96 0 2024-09-21T12:20:41.210 INFO:tasks.workunit.client.0.smithi003.stdout:3/464: truncate d0/d5/f1e 1902207 0 2024-09-21T12:20:41.211 INFO:tasks.workunit.client.0.smithi003.stdout:3/465: fdatasync d0/d5/da/d28/d11/d49/f8a 0 2024-09-21T12:20:41.212 INFO:tasks.workunit.client.0.smithi003.stdout:3/466: chown d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/d42/d6d/c8d 102 1 2024-09-21T12:20:41.214 INFO:tasks.workunit.client.0.smithi003.stdout:3/467: creat d0/d5/f97 x:0 0 0 2024-09-21T12:20:41.219 INFO:tasks.workunit.client.0.smithi003.stdout:3/468: creat d0/f98 x:0 0 0 2024-09-21T12:20:41.221 INFO:tasks.workunit.client.0.smithi003.stdout:3/469: chown d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/l43 1 1 2024-09-21T12:20:41.225 INFO:tasks.workunit.client.0.smithi003.stdout:3/470: rename d0/d5/d38/c39 to d0/d5/da/d28/d11/d49/d94/c99 0 2024-09-21T12:20:41.225 INFO:tasks.workunit.client.0.smithi003.stdout:7/372: dread d8/db/ff [4194304,4194304] 0 2024-09-21T12:20:41.226 INFO:tasks.workunit.client.0.smithi003.stdout:3/471: stat d0/d5/c4e 0 2024-09-21T12:20:41.228 INFO:tasks.workunit.client.0.smithi003.stdout:1/484: dwrite d4/df/d19/f6f [0,4194304] 0 2024-09-21T12:20:41.230 INFO:tasks.workunit.client.0.smithi003.stdout:7/373: creat d8/db/d32/f8c x:0 0 0 2024-09-21T12:20:41.231 INFO:tasks.workunit.client.0.smithi003.stdout:7/374: dread - d8/d31/f67 zero size 2024-09-21T12:20:41.237 INFO:tasks.workunit.client.0.smithi003.stdout:7/375: unlink d8/db/d32/d43/d7e/c8b 0 2024-09-21T12:20:41.243 INFO:tasks.workunit.client.0.smithi003.stdout:3/472: getdents d0/d5/d38 0 2024-09-21T12:20:41.243 INFO:tasks.workunit.client.0.smithi003.stdout:7/376: getdents d8/d31/d84 0 2024-09-21T12:20:41.245 INFO:tasks.workunit.client.0.smithi003.stdout:3/473: stat d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/f53 0 2024-09-21T12:20:41.245 INFO:tasks.workunit.client.0.smithi003.stdout:3/474: fsync d0/d5/f4a 0 2024-09-21T12:20:41.246 INFO:tasks.workunit.client.0.smithi003.stdout:3/475: chown d0/d5/da/d28/d11/d49/d94 13 1 2024-09-21T12:20:41.248 INFO:tasks.workunit.client.0.smithi003.stdout:7/377: dread d8/db/d32/f5d [0,4194304] 0 2024-09-21T12:20:41.249 INFO:tasks.workunit.client.0.smithi003.stdout:7/378: write d8/db/d13/f86 [258367,117481] 0 2024-09-21T12:20:41.250 INFO:tasks.workunit.client.0.smithi003.stdout:1/485: truncate d4/dc/f28 2802365 0 2024-09-21T12:20:41.253 INFO:tasks.workunit.client.0.smithi003.stdout:3/476: rename d0/d5/da/d28/d11/d49/d4c/d54/c7f to d0/c9a 0 2024-09-21T12:20:41.255 INFO:tasks.workunit.client.0.smithi003.stdout:1/486: dread d4/f3a [0,4194304] 0 2024-09-21T12:20:41.256 INFO:tasks.workunit.client.0.smithi003.stdout:3/477: mknod d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/c9b 0 2024-09-21T12:20:41.257 INFO:tasks.workunit.client.0.smithi003.stdout:1/487: write d4/df/d19/f36 [2842445,118254] 0 2024-09-21T12:20:41.260 INFO:tasks.workunit.client.0.smithi003.stdout:1/488: mknod d4/d66/d8b/caa 0 2024-09-21T12:20:41.260 INFO:tasks.workunit.client.0.smithi003.stdout:3/478: write d0/d5/da/d28/d11/d49/d4c/d54/d5e/f5f [682333,65300] 0 2024-09-21T12:20:41.263 INFO:tasks.workunit.client.0.smithi003.stdout:3/479: symlink d0/d5/da/d28/d31/l9c 0 2024-09-21T12:20:41.264 INFO:tasks.workunit.client.0.smithi003.stdout:1/489: truncate d4/d11/f2a 1018444 0 2024-09-21T12:20:41.268 INFO:tasks.workunit.client.0.smithi003.stdout:3/480: creat d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/d77/f9d x:0 0 0 2024-09-21T12:20:41.268 INFO:tasks.workunit.client.0.smithi003.stdout:3/481: chown d0/f71 51239463 1 2024-09-21T12:20:41.280 INFO:tasks.workunit.client.0.smithi003.stdout:3/482: write d0/d5/da/d28/dd/f2e [797986,95208] 0 2024-09-21T12:20:41.283 INFO:tasks.workunit.client.0.smithi003.stdout:1/490: dwrite d4/d11/d14/f6a [0,4194304] 0 2024-09-21T12:20:41.285 INFO:tasks.workunit.client.0.smithi003.stdout:3/483: symlink d0/d5/da/d28/d11/d49/d4c/l9e 0 2024-09-21T12:20:41.290 INFO:tasks.workunit.client.0.smithi003.stdout:3/484: mkdir d0/d5/da/d28/dd/d9f 0 2024-09-21T12:20:41.291 INFO:tasks.workunit.client.0.smithi003.stdout:1/491: creat d4/d11/d14/fab x:0 0 0 2024-09-21T12:20:41.292 INFO:tasks.workunit.client.0.smithi003.stdout:1/492: chown d4/df/d41/c76 324 1 2024-09-21T12:20:41.293 INFO:tasks.workunit.client.0.smithi003.stdout:3/485: creat d0/d5/da/d28/d11/d49/d94/fa0 x:0 0 0 2024-09-21T12:20:41.294 INFO:tasks.workunit.client.0.smithi003.stdout:1/493: write d4/d11/f8e [70344,98955] 0 2024-09-21T12:20:41.296 INFO:tasks.workunit.client.0.smithi003.stdout:3/486: rmdir d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/d42 39 2024-09-21T12:20:41.297 INFO:tasks.workunit.client.0.smithi003.stdout:1/494: truncate d4/dc/f28 1599411 0 2024-09-21T12:20:41.298 INFO:tasks.workunit.client.0.smithi003.stdout:1/495: write d4/f7 [348241,43890] 0 2024-09-21T12:20:41.301 INFO:tasks.workunit.client.0.smithi003.stdout:3/487: symlink d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/la1 0 2024-09-21T12:20:41.302 INFO:tasks.workunit.client.0.smithi003.stdout:1/496: creat d4/d11/d14/d25/d59/fac x:0 0 0 2024-09-21T12:20:41.304 INFO:tasks.workunit.client.0.smithi003.stdout:1/497: symlink d4/d66/lad 0 2024-09-21T12:20:41.305 INFO:tasks.workunit.client.0.smithi003.stdout:3/488: getdents d0/d5/da/d28/dd/d9f 0 2024-09-21T12:20:41.307 INFO:tasks.workunit.client.0.smithi003.stdout:1/498: mkdir d4/d11/d14/d78/dae 0 2024-09-21T12:20:41.308 INFO:tasks.workunit.client.0.smithi003.stdout:1/499: write d4/d11/d14/f6a [4603596,59233] 0 2024-09-21T12:20:41.310 INFO:tasks.workunit.client.0.smithi003.stdout:1/500: fdatasync d4/d11/d14/d25/d59/f82 0 2024-09-21T12:20:41.314 INFO:tasks.workunit.client.0.smithi003.stdout:3/489: dwrite d0/d5/da/d28/d11/d49/f73 [0,4194304] 0 2024-09-21T12:20:41.316 INFO:tasks.workunit.client.0.smithi003.stdout:3/490: readlink d0/d5/da/d28/d11/d49/d4c/l9e 0 2024-09-21T12:20:41.319 INFO:tasks.workunit.client.0.smithi003.stdout:1/501: dwrite d4/dc/f1c [4194304,4194304] 0 2024-09-21T12:20:41.320 INFO:tasks.workunit.client.0.smithi003.stdout:3/491: write d0/d5/da/d28/d11/d49/d4c/d54/d5e/f5f [1247131,90757] 0 2024-09-21T12:20:41.324 INFO:tasks.workunit.client.0.smithi003.stdout:1/502: mkdir d4/d11/d49/daf 0 2024-09-21T12:20:41.330 INFO:tasks.workunit.client.0.smithi003.stdout:3/492: dwrite d0/d5/da/d28/d11/d49/d4c/d54/d5e/f5f [0,4194304] 0 2024-09-21T12:20:41.332 INFO:tasks.workunit.client.0.smithi003.stdout:3/493: chown d0/d5/da/d28/d11/d49/d4c/d6f/c82 53767 1 2024-09-21T12:20:41.337 INFO:tasks.workunit.client.0.smithi003.stdout:3/494: rename d0/d5/da/d28/d11/l57 to d0/d5/da/d28/d11/d96/la2 0 2024-09-21T12:20:41.344 INFO:tasks.workunit.client.0.smithi003.stdout:1/503: truncate d4/d11/d14/d25/d59/f9f 416687 0 2024-09-21T12:20:41.349 INFO:tasks.workunit.client.0.smithi003.stdout:1/504: getdents d4/d11 0 2024-09-21T12:20:41.352 INFO:tasks.workunit.client.0.smithi003.stdout:3/495: dwrite d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/f2c [0,4194304] 0 2024-09-21T12:20:41.354 INFO:tasks.workunit.client.0.smithi003.stdout:1/505: dread d4/f81 [0,4194304] 0 2024-09-21T12:20:41.356 INFO:tasks.workunit.client.0.smithi003.stdout:3/496: read d0/d5/d38/d55/f60 [3826930,39130] 0 2024-09-21T12:20:41.359 INFO:tasks.workunit.client.0.smithi003.stdout:9/516: sync 2024-09-21T12:20:41.360 INFO:tasks.workunit.client.0.smithi003.stdout:1/506: symlink d4/df/d12/lb0 0 2024-09-21T12:20:41.363 INFO:tasks.workunit.client.0.smithi003.stdout:9/517: creat d2/d20/d22/fc3 x:0 0 0 2024-09-21T12:20:41.364 INFO:tasks.workunit.client.0.smithi003.stdout:1/507: mkdir d4/d11/db1 0 2024-09-21T12:20:41.510 INFO:tasks.workunit.client.0.smithi003.stdout:3/497: write d0/d5/f1e [2242510,39728] 0 2024-09-21T12:20:41.513 INFO:tasks.workunit.client.0.smithi003.stdout:3/498: symlink d0/d5/d38/d55/la3 0 2024-09-21T12:20:41.514 INFO:tasks.workunit.client.0.smithi003.stdout:1/508: mknod d4/d11/d14/d25/d42/cb2 0 2024-09-21T12:20:41.516 INFO:tasks.workunit.client.0.smithi003.stdout:3/499: creat d0/d5/d38/d55/fa4 x:0 0 0 2024-09-21T12:20:41.517 INFO:tasks.workunit.client.0.smithi003.stdout:1/509: truncate d4/d11/d14/d25/d42/f5f 1675201 0 2024-09-21T12:20:41.517 INFO:tasks.workunit.client.0.smithi003.stdout:3/500: write d0/d5/d38/d55/fa4 [881304,109007] 0 2024-09-21T12:20:41.518 INFO:tasks.workunit.client.0.smithi003.stdout:1/510: chown d4/d11/d14/d25/l2d 76606200 1 2024-09-21T12:20:41.519 INFO:tasks.workunit.client.0.smithi003.stdout:3/501: readlink d0/d5/d38/d55/la3 0 2024-09-21T12:20:41.522 INFO:tasks.workunit.client.0.smithi003.stdout:3/502: symlink d0/d5/da/d28/la5 0 2024-09-21T12:20:41.526 INFO:tasks.workunit.client.0.smithi003.stdout:1/511: dwrite d4/f81 [0,4194304] 0 2024-09-21T12:20:41.526 INFO:tasks.workunit.client.0.smithi003.stdout:3/503: creat d0/d5/d38/fa6 x:0 0 0 2024-09-21T12:20:41.528 INFO:tasks.workunit.client.0.smithi003.stdout:3/504: chown d0/d5/da/d28/d11/d49/d94 389241359 1 2024-09-21T12:20:41.530 INFO:tasks.workunit.client.0.smithi003.stdout:3/505: read d0/d5/da/d28/d11/d49/f76 [382267,59626] 0 2024-09-21T12:20:41.531 INFO:tasks.workunit.client.0.smithi003.stdout:3/506: chown d0/d5/d38/c56 383424129 1 2024-09-21T12:20:41.533 INFO:tasks.workunit.client.0.smithi003.stdout:1/512: truncate d4/df/d19/f95 1031311 0 2024-09-21T12:20:41.542 INFO:tasks.workunit.client.0.smithi003.stdout:8/436: sync 2024-09-21T12:20:41.542 INFO:tasks.workunit.client.0.smithi003.stdout:1/513: dwrite d4/d11/f72 [0,4194304] 0 2024-09-21T12:20:41.546 INFO:tasks.workunit.client.0.smithi003.stdout:8/437: dread d7/df/d20/d21/f3a [0,4194304] 0 2024-09-21T12:20:41.552 INFO:tasks.workunit.client.0.smithi003.stdout:8/438: rmdir d7/df/d20/d21/d99 0 2024-09-21T12:20:41.552 INFO:tasks.workunit.client.0.smithi003.stdout:3/507: dwrite d0/d5/da/d28/d31/f32 [0,4194304] 0 2024-09-21T12:20:41.609 INFO:tasks.workunit.client.0.smithi003.stdout:3/508: creat d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/fa7 x:0 0 0 2024-09-21T12:20:41.610 INFO:tasks.workunit.client.0.smithi003.stdout:3/509: fdatasync d0/d5/da/d28/dd/f2e 0 2024-09-21T12:20:41.660 INFO:tasks.workunit.client.0.smithi003.stdout:2/416: sync 2024-09-21T12:20:41.660 INFO:tasks.workunit.client.0.smithi003.stdout:5/504: sync 2024-09-21T12:20:41.690 INFO:tasks.workunit.client.0.smithi003.stdout:5/505: write dc/d15/d21/d28/d41/da0/d4b/d5c/f99 [3252273,58787] 0 2024-09-21T12:20:41.690 INFO:tasks.workunit.client.0.smithi003.stdout:8/439: rename d7/df/d20/d54/d7a to d7/df/d20/d54/d9d 0 2024-09-21T12:20:41.692 INFO:tasks.workunit.client.0.smithi003.stdout:5/506: fdatasync dc/d2b/d4e/f94 0 2024-09-21T12:20:41.695 INFO:tasks.workunit.client.0.smithi003.stdout:3/510: dwrite d0/d5/da/d28/dd/f41 [0,4194304] 0 2024-09-21T12:20:41.697 INFO:tasks.workunit.client.0.smithi003.stdout:2/417: rename d0/d1c/d6a/c76 to d0/dd/c99 0 2024-09-21T12:20:41.702 INFO:tasks.workunit.client.0.smithi003.stdout:8/440: dwrite d7/df/d20/d24/d47/d79/f67 [0,4194304] 0 2024-09-21T12:20:41.704 INFO:tasks.workunit.client.0.smithi003.stdout:8/441: dread - d7/df/d20/d24/f8d zero size 2024-09-21T12:20:41.705 INFO:tasks.workunit.client.0.smithi003.stdout:3/511: dread d0/d5/da/d28/d11/d49/d4c/d54/d5e/f5f [0,4194304] 0 2024-09-21T12:20:41.708 INFO:tasks.workunit.client.0.smithi003.stdout:5/507: write dc/d15/f1f [3072997,13659] 0 2024-09-21T12:20:41.712 INFO:tasks.workunit.client.0.smithi003.stdout:8/442: creat d7/de/d52/f9e x:0 0 0 2024-09-21T12:20:41.713 INFO:tasks.workunit.client.0.smithi003.stdout:3/512: mknod d0/d5/da/d28/ca8 0 2024-09-21T12:20:41.716 INFO:tasks.workunit.client.0.smithi003.stdout:5/508: creat dc/d15/d21/d28/d41/d5b/d74/d7f/d82/fa4 x:0 0 0 2024-09-21T12:20:41.719 INFO:tasks.workunit.client.0.smithi003.stdout:2/418: rename d0/d21/d2f/d49/c82 to d0/d21/d2f/d50/c9a 0 2024-09-21T12:20:41.719 INFO:tasks.workunit.client.0.smithi003.stdout:8/443: dwrite d7/df/d16/f9a [0,4194304] 0 2024-09-21T12:20:41.722 INFO:tasks.workunit.client.0.smithi003.stdout:3/513: creat d0/d5/da/fa9 x:0 0 0 2024-09-21T12:20:41.722 INFO:tasks.workunit.client.0.smithi003.stdout:5/509: dread dc/d15/d1c/f3e [0,4194304] 0 2024-09-21T12:20:41.722 INFO:tasks.workunit.client.0.smithi003.stdout:3/514: stat d0/c18 0 2024-09-21T12:20:41.724 INFO:tasks.workunit.client.0.smithi003.stdout:2/419: rmdir d0/dd/d22/d68 39 2024-09-21T12:20:41.729 INFO:tasks.workunit.client.0.smithi003.stdout:3/515: mkdir d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/daa 0 2024-09-21T12:20:41.733 INFO:tasks.workunit.client.0.smithi003.stdout:3/516: creat d0/d5/fab x:0 0 0 2024-09-21T12:20:41.737 INFO:tasks.workunit.client.0.smithi003.stdout:3/517: dread - d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/d42/d6d/d86/f8e zero size 2024-09-21T12:20:41.742 INFO:tasks.workunit.client.0.smithi003.stdout:5/510: dread dc/d15/d21/d28/d41/da0/f34 [0,4194304] 0 2024-09-21T12:20:41.742 INFO:tasks.workunit.client.0.smithi003.stdout:3/518: mknod d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/d42/d6d/d86/cac 0 2024-09-21T12:20:41.743 INFO:tasks.workunit.client.0.smithi003.stdout:5/511: readlink dc/d15/d21/d28/d3c/l6d 0 2024-09-21T12:20:41.748 INFO:tasks.workunit.client.0.smithi003.stdout:5/512: dwrite dc/d2b/d4e/f53 [0,4194304] 0 2024-09-21T12:20:41.748 INFO:tasks.workunit.client.0.smithi003.stdout:3/519: mknod d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/d42/d6d/d86/cad 0 2024-09-21T12:20:41.750 INFO:tasks.workunit.client.0.smithi003.stdout:3/520: dread - d0/d5/da/d28/d11/d49/d94/fa0 zero size 2024-09-21T12:20:41.751 INFO:tasks.workunit.client.0.smithi003.stdout:3/521: write d0/d5/da/d28/d11/d49/d4c/d54/d5e/d48/f8f [274478,53654] 0 2024-09-21T12:20:41.752 INFO:tasks.workunit.client.0.smithi003.stdout:3/522: readlink d0/d5/da/d28/dd/l8c 0 2024-09-21T12:20:41.752 INFO:tasks.workunit.client.0.smithi003.stdout:5/513: creat dc/d15/d21/d28/d41/d5b/fa5 x:0 0 0 2024-09-21T12:20:41.753 INFO:tasks.workunit.client.0.smithi003.stdout:5/514: write dc/d2b/d4e/f94 [709274,92998] 0 2024-09-21T12:20:41.755 INFO:tasks.workunit.client.0.smithi003.stdout:5/515: write dc/d2b/f54 [1419380,120651] 0 2024-09-21T12:20:41.758 INFO:tasks.workunit.client.0.smithi003.stdout:3/523: creat d0/d5/da/d28/dd/fae x:0 0 0 2024-09-21T12:20:41.762 INFO:tasks.workunit.client.0.smithi003.stdout:3/524: rmdir d0/d5/da/d28 39 2024-09-21T12:20:41.762 INFO:tasks.workunit.client.0.smithi003.stdout:5/516: dwrite dc/f1a [0,4194304] 0 2024-09-21T12:20:41.766 INFO:tasks.workunit.client.0.smithi003.stdout:5/517: mknod dc/d15/d21/d28/d3c/ca6 0 2024-09-21T12:20:41.771 INFO:tasks.workunit.client.0.smithi003.stdout:3/525: creat d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/daa/faf x:0 0 0 2024-09-21T12:20:41.773 INFO:tasks.workunit.client.0.smithi003.stdout:3/526: write d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/f30 [536648,76396] 0 2024-09-21T12:20:41.784 INFO:tasks.workunit.client.0.smithi003.stdout:3/527: dread d0/d5/da/d28/dd/f2b [0,4194304] 0 2024-09-21T12:20:41.784 INFO:tasks.workunit.client.0.smithi003.stdout:3/528: chown d0/d5 797678060 1 2024-09-21T12:20:41.787 INFO:tasks.workunit.client.0.smithi003.stdout:3/529: mknod d0/d5/da/d28/d11/cb0 0 2024-09-21T12:20:41.788 INFO:tasks.workunit.client.0.smithi003.stdout:3/530: chown d0/d5/d38/d55/f60 115 1 2024-09-21T12:20:41.791 INFO:tasks.workunit.client.0.smithi003.stdout:3/531: creat d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/fb1 x:0 0 0 2024-09-21T12:20:41.793 INFO:tasks.workunit.client.0.smithi003.stdout:3/532: chown d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/d42/d6d/d86/cad 0 1 2024-09-21T12:20:41.799 INFO:tasks.workunit.client.0.smithi003.stdout:5/518: getdents dc/d15/d21/d28/d41/d5b 0 2024-09-21T12:20:41.799 INFO:tasks.workunit.client.0.smithi003.stdout:3/533: dwrite d0/f16 [0,4194304] 0 2024-09-21T12:20:41.801 INFO:tasks.workunit.client.0.smithi003.stdout:3/534: truncate d0/d5/d38/f75 105778 0 2024-09-21T12:20:41.805 INFO:tasks.workunit.client.0.smithi003.stdout:3/535: dread d0/f71 [0,4194304] 0 2024-09-21T12:20:41.809 INFO:tasks.workunit.client.0.smithi003.stdout:5/519: dread dc/d2b/f44 [0,4194304] 0 2024-09-21T12:20:41.812 INFO:tasks.workunit.client.0.smithi003.stdout:3/536: dwrite d0/d5/da/d28/d31/f32 [0,4194304] 0 2024-09-21T12:20:41.818 INFO:tasks.workunit.client.0.smithi003.stdout:5/520: dwrite dc/d15/d1c/f58 [0,4194304] 0 2024-09-21T12:20:41.825 INFO:tasks.workunit.client.0.smithi003.stdout:3/537: dwrite d0/d5/da/d28/d11/d49/f8a [0,4194304] 0 2024-09-21T12:20:41.827 INFO:tasks.workunit.client.0.smithi003.stdout:3/538: chown d0/d5/fab 199284 1 2024-09-21T12:20:41.827 INFO:tasks.workunit.client.0.smithi003.stdout:5/521: symlink dc/d15/la7 0 2024-09-21T12:20:41.836 INFO:tasks.workunit.client.0.smithi003.stdout:5/522: link dc/d15/d21/f24 dc/d15/d21/d28/fa8 0 2024-09-21T12:20:41.838 INFO:tasks.workunit.client.0.smithi003.stdout:3/539: rename d0/d5/f1e to d0/d5/da/d28/dd/fb2 0 2024-09-21T12:20:41.840 INFO:tasks.workunit.client.0.smithi003.stdout:3/540: write d0/d5/da/d28/dd/fae [148567,89274] 0 2024-09-21T12:20:41.840 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:41 smithi192 ceph-mon[35641]: pgmap v7: 65 pgs: 65 active+clean; 2.9 GiB data, 8.4 GiB used, 528 GiB / 536 GiB avail; 56 MiB/s rd, 172 MiB/s wr, 350 op/s 2024-09-21T12:20:41.840 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:41 smithi192 ceph-mon[35641]: mgrmap e25: smithi192.qsaprd(active, since 8s), standbys: smithi003.wztftl 2024-09-21T12:20:41.840 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:41 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "mgr metadata", "who": "smithi003.wztftl", "id": "smithi003.wztftl"}]: dispatch 2024-09-21T12:20:41.840 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:41 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' 2024-09-21T12:20:41.841 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:41 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' 2024-09-21T12:20:41.845 INFO:tasks.workunit.client.0.smithi003.stdout:5/523: creat dc/d15/d21/fa9 x:0 0 0 2024-09-21T12:20:41.845 INFO:tasks.workunit.client.0.smithi003.stdout:5/524: fdatasync dc/d2b/f54 0 2024-09-21T12:20:41.849 INFO:tasks.workunit.client.0.smithi003.stdout:0/600: sync 2024-09-21T12:20:41.849 INFO:tasks.workunit.client.0.smithi003.stdout:4/357: sync 2024-09-21T12:20:41.850 INFO:tasks.workunit.client.0.smithi003.stdout:3/541: rename d0/d5/da/d28/d11/d49/d4c/d54/d5e/f4f to d0/d5/da/fb3 0 2024-09-21T12:20:41.851 INFO:tasks.workunit.client.0.smithi003.stdout:0/601: chown d9/d12/d17/d38/d3a/d46/d55/d67/d2d/d91 34 1 2024-09-21T12:20:41.854 INFO:tasks.workunit.client.0.smithi003.stdout:4/358: mknod d9/d48/c76 0 2024-09-21T12:20:41.855 INFO:tasks.workunit.client.0.smithi003.stdout:4/359: fsync d9/d48/f51 0 2024-09-21T12:20:41.857 INFO:tasks.workunit.client.0.smithi003.stdout:0/602: unlink d9/d6c/cb1 0 2024-09-21T12:20:41.861 INFO:tasks.workunit.client.0.smithi003.stdout:0/603: chown d9/d6c/d32/c3f 9844589 1 2024-09-21T12:20:41.863 INFO:tasks.workunit.client.0.smithi003.stdout:5/525: dread dc/d15/d1c/f23 [0,4194304] 0 2024-09-21T12:20:41.864 INFO:tasks.workunit.client.0.smithi003.stdout:3/542: rmdir d0/d5/da/d28/d11/d49/d4c/d89 0 2024-09-21T12:20:41.864 INFO:tasks.workunit.client.0.smithi003.stdout:5/526: write dc/d15/d21/d28/f6a [235558,121957] 0 2024-09-21T12:20:41.869 INFO:tasks.workunit.client.0.smithi003.stdout:4/360: creat d9/da/d47/f77 x:0 0 0 2024-09-21T12:20:41.871 INFO:tasks.workunit.client.0.smithi003.stdout:3/543: mknod d0/d5/da/d28/d11/d49/d4c/d6f/cb4 0 2024-09-21T12:20:41.873 INFO:tasks.workunit.client.0.smithi003.stdout:0/604: rename d9/d12/d1e/l53 to d9/d12/d17/d38/d47/ld4 0 2024-09-21T12:20:41.874 INFO:tasks.workunit.client.0.smithi003.stdout:4/361: creat d9/d16/f78 x:0 0 0 2024-09-21T12:20:41.877 INFO:tasks.workunit.client.0.smithi003.stdout:3/544: mknod d0/d5/d38/d55/cb5 0 2024-09-21T12:20:41.878 INFO:tasks.workunit.client.0.smithi003.stdout:5/527: getdents dc/d15/d21/d28/d41/d5b 0 2024-09-21T12:20:41.879 INFO:tasks.workunit.client.0.smithi003.stdout:3/545: truncate d0/d5/da/d28/d11/d49/d94/fa0 782926 0 2024-09-21T12:20:41.880 INFO:tasks.workunit.client.0.smithi003.stdout:4/362: mkdir d9/da/d36/d55/d79 0 2024-09-21T12:20:41.880 INFO:tasks.workunit.client.0.smithi003.stdout:3/546: chown d0/d5/d38 2937605 1 2024-09-21T12:20:41.880 INFO:tasks.workunit.client.0.smithi003.stdout:5/528: read dc/f3a [1322695,56006] 0 2024-09-21T12:20:41.881 INFO:tasks.workunit.client.0.smithi003.stdout:5/529: chown dc/d15/d21 901415 1 2024-09-21T12:20:41.882 INFO:tasks.workunit.client.0.smithi003.stdout:3/547: readlink d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/la1 0 2024-09-21T12:20:41.882 INFO:tasks.workunit.client.0.smithi003.stdout:5/530: dread - dc/d15/d21/d28/d41/d5b/d74/f7b zero size 2024-09-21T12:20:41.884 INFO:tasks.workunit.client.0.smithi003.stdout:0/605: link d9/d12/d17/d38/d3a/d46/d55/d7b/lc5 d9/d12/d17/d38/d3a/d46/d55/d57/ld5 0 2024-09-21T12:20:41.884 INFO:tasks.workunit.client.0.smithi003.stdout:5/531: write dc/d2b/d4e/f94 [1119020,101550] 0 2024-09-21T12:20:41.884 INFO:tasks.workunit.client.0.smithi003.stdout:3/548: fsync d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/daa/faf 0 2024-09-21T12:20:41.887 INFO:tasks.workunit.client.0.smithi003.stdout:5/532: write dc/d15/f19 [3225782,11559] 0 2024-09-21T12:20:41.889 INFO:tasks.workunit.client.0.smithi003.stdout:5/533: write dc/d15/d21/d28/d41/da0/d4b/d5c/f99 [2544088,54767] 0 2024-09-21T12:20:41.889 INFO:tasks.workunit.client.0.smithi003.stdout:0/606: mknod d9/d12/d17/d21/cd6 0 2024-09-21T12:20:41.891 INFO:tasks.workunit.client.0.smithi003.stdout:5/534: write dc/d15/d21/d28/d41/da0/f34 [1087820,42771] 0 2024-09-21T12:20:41.905 INFO:tasks.workunit.client.0.smithi003.stdout:3/549: dwrite d0/d5/da/d28/d11/d49/d4c/f66 [0,4194304] 0 2024-09-21T12:20:41.905 INFO:tasks.workunit.client.0.smithi003.stdout:4/363: dwrite d9/fc [0,4194304] 0 2024-09-21T12:20:41.907 INFO:tasks.workunit.client.0.smithi003.stdout:4/364: chown d9/da/c60 0 1 2024-09-21T12:20:41.908 INFO:tasks.workunit.client.0.smithi003.stdout:5/535: link dc/d15/d21/d28/d41/d5b/d74/d7f/d82/fa4 dc/d15/d21/d28/d41/da0/d4b/faa 0 2024-09-21T12:20:41.908 INFO:tasks.workunit.client.0.smithi003.stdout:0/607: link d9/d12/d17/la5 d9/d6c/d26/ld7 0 2024-09-21T12:20:41.913 INFO:tasks.workunit.client.0.smithi003.stdout:4/365: dread d9/fc [0,4194304] 0 2024-09-21T12:20:41.916 INFO:tasks.workunit.client.0.smithi003.stdout:5/536: mkdir dc/d15/d21/d28/d41/d5b/dab 0 2024-09-21T12:20:41.916 INFO:tasks.workunit.client.0.smithi003.stdout:0/608: mknod d9/d12/d1e/d5f/d8a/cd8 0 2024-09-21T12:20:41.921 INFO:tasks.workunit.client.0.smithi003.stdout:3/550: truncate d0/d5/f4a 1278921 0 2024-09-21T12:20:41.921 INFO:tasks.workunit.client.0.smithi003.stdout:3/551: write d0/d5/da/d28/f88 [216068,939] 0 2024-09-21T12:20:41.926 INFO:tasks.workunit.client.0.smithi003.stdout:3/552: creat d0/d5/da/d28/d11/d49/d4c/d54/fb6 x:0 0 0 2024-09-21T12:20:41.927 INFO:tasks.workunit.client.0.smithi003.stdout:3/553: dread - d0/d5/d38/d55/f7a zero size 2024-09-21T12:20:41.927 INFO:tasks.workunit.client.0.smithi003.stdout:0/609: mknod d9/d6c/d32/db8/cd9 0 2024-09-21T12:20:41.928 INFO:tasks.workunit.client.0.smithi003.stdout:5/537: creat dc/d15/d21/fac x:0 0 0 2024-09-21T12:20:41.932 INFO:tasks.workunit.client.0.smithi003.stdout:5/538: unlink dc/d15/d21/d28/d41/da0/d35/c9d 0 2024-09-21T12:20:41.934 INFO:tasks.workunit.client.0.smithi003.stdout:0/610: link d9/fcf d9/fda 0 2024-09-21T12:20:41.937 INFO:tasks.workunit.client.0.smithi003.stdout:4/366: truncate d9/da/d36/f50 7426860 0 2024-09-21T12:20:41.939 INFO:tasks.workunit.client.0.smithi003.stdout:5/539: unlink dc/d15/d21/d28/d41/d5b/d74/f7b 0 2024-09-21T12:20:41.939 INFO:tasks.workunit.client.0.smithi003.stdout:0/611: readlink d9/d6c/l6b 0 2024-09-21T12:20:41.941 INFO:tasks.workunit.client.0.smithi003.stdout:3/554: getdents d0/d5/d38 0 2024-09-21T12:20:41.944 INFO:tasks.workunit.client.0.smithi003.stdout:4/367: creat d9/d25/f7a x:0 0 0 2024-09-21T12:20:41.950 INFO:tasks.workunit.client.0.smithi003.stdout:0/612: symlink d9/d12/d1e/d5f/ldb 0 2024-09-21T12:20:41.954 INFO:tasks.workunit.client.0.smithi003.stdout:3/555: symlink d0/d5/da/d28/d11/d49/d4c/d6f/d91/lb7 0 2024-09-21T12:20:41.958 INFO:tasks.workunit.client.0.smithi003.stdout:3/556: mkdir d0/d5/d38/db8 0 2024-09-21T12:20:41.960 INFO:tasks.workunit.client.0.smithi003.stdout:0/613: symlink d9/ldc 0 2024-09-21T12:20:41.963 INFO:tasks.workunit.client.0.smithi003.stdout:4/368: rename d9/d25/f5d to d9/da/d47/f7b 0 2024-09-21T12:20:41.963 INFO:tasks.workunit.client.0.smithi003.stdout:7/379: sync 2024-09-21T12:20:41.964 INFO:tasks.workunit.client.0.smithi003.stdout:6/520: sync 2024-09-21T12:20:41.964 INFO:tasks.workunit.client.0.smithi003.stdout:0/614: dread d9/d12/d17/d38/d3a/d46/d55/d57/f76 [0,4194304] 0 2024-09-21T12:20:41.965 INFO:tasks.workunit.client.0.smithi003.stdout:7/380: chown d8/db/f16 194482 1 2024-09-21T12:20:41.968 INFO:tasks.workunit.client.0.smithi003.stdout:3/557: mknod d0/d5/da/d28/dd/d9f/cb9 0 2024-09-21T12:20:41.970 INFO:tasks.workunit.client.0.smithi003.stdout:6/521: dread d4/d13/d22/f6f [0,4194304] 0 2024-09-21T12:20:41.973 INFO:tasks.workunit.client.0.smithi003.stdout:5/540: truncate dc/f10 1452968 0 2024-09-21T12:20:41.976 INFO:tasks.workunit.client.0.smithi003.stdout:4/369: symlink d9/d16/d65/d73/l7c 0 2024-09-21T12:20:41.977 INFO:tasks.workunit.client.0.smithi003.stdout:5/541: dread dc/d15/d1c/f23 [0,4194304] 0 2024-09-21T12:20:41.977 INFO:tasks.workunit.client.0.smithi003.stdout:0/615: symlink d9/d6c/ldd 0 2024-09-21T12:20:41.978 INFO:tasks.workunit.client.0.smithi003.stdout:7/381: mknod d8/d3c/d57/d81/c8d 0 2024-09-21T12:20:41.978 INFO:tasks.workunit.client.0.smithi003.stdout:0/616: write d9/f92 [433816,11750] 0 2024-09-21T12:20:41.980 INFO:tasks.workunit.client.0.smithi003.stdout:0/617: stat d9/d6c/d26/c99 0 2024-09-21T12:20:41.980 INFO:tasks.workunit.client.0.smithi003.stdout:7/382: write d8/db/d32/f8c [735795,56581] 0 2024-09-21T12:20:41.987 INFO:tasks.workunit.client.0.smithi003.stdout:7/383: dwrite d8/db/d13/f86 [0,4194304] 0 2024-09-21T12:20:41.988 INFO:tasks.workunit.client.0.smithi003.stdout:3/558: getdents d0/d5/da/d28/d11/d49/d4c/d6f 0 2024-09-21T12:20:41.990 INFO:tasks.workunit.client.0.smithi003.stdout:7/384: write d8/f17 [5040540,102619] 0 2024-09-21T12:20:41.990 INFO:tasks.workunit.client.0.smithi003.stdout:3/559: chown d0/d5/da/d28/d11/cb0 4043 1 2024-09-21T12:20:41.990 INFO:tasks.workunit.client.0.smithi003.stdout:0/618: mkdir d9/d6c/d26/d54/d7e/dde 0 2024-09-21T12:20:41.997 INFO:tasks.workunit.client.0.smithi003.stdout:7/385: write d8/db/ff [219852,43294] 0 2024-09-21T12:20:42.010 INFO:tasks.workunit.client.0.smithi003.stdout:2/420: sync 2024-09-21T12:20:42.010 INFO:tasks.workunit.client.0.smithi003.stdout:8/444: sync 2024-09-21T12:20:42.011 INFO:tasks.workunit.client.0.smithi003.stdout:9/518: sync 2024-09-21T12:20:42.011 INFO:tasks.workunit.client.0.smithi003.stdout:1/514: sync 2024-09-21T12:20:42.020 INFO:tasks.workunit.client.0.smithi003.stdout:6/522: truncate d4/d13/d2e/f61 3805489 0 2024-09-21T12:20:42.020 INFO:tasks.workunit.client.0.smithi003.stdout:2/421: dread d0/d1c/f2e [0,4194304] 0 2024-09-21T12:20:42.022 INFO:tasks.workunit.client.0.smithi003.stdout:6/523: write d4/d13/d19/fa1 [301106,128679] 0 2024-09-21T12:20:42.024 INFO:tasks.workunit.client.0.smithi003.stdout:5/542: write dc/d15/d21/d28/fa8 [463619,54154] 0 2024-09-21T12:20:42.026 INFO:tasks.workunit.client.0.smithi003.stdout:5/543: fsync dc/d15/d21/d28/d3c/f91 0 2024-09-21T12:20:42.027 INFO:tasks.workunit.client.0.smithi003.stdout:0/619: mknod d9/d12/d17/d38/d3a/d46/d55/d7b/da0/cdf 0 2024-09-21T12:20:42.028 INFO:tasks.workunit.client.0.smithi003.stdout:7/386: chown d8/db/d32/l6d 5 1 2024-09-21T12:20:42.029 INFO:tasks.workunit.client.0.smithi003.stdout:1/515: write f2 [2579769,51424] 0 2024-09-21T12:20:42.030 INFO:tasks.workunit.client.0.smithi003.stdout:1/516: fsync d4/d11/f72 0 2024-09-21T12:20:42.030 INFO:tasks.workunit.client.0.smithi003.stdout:9/519: fdatasync d2/d20/f77 0 2024-09-21T12:20:42.031 INFO:tasks.workunit.client.0.smithi003.stdout:1/517: chown d4/dc 56 1 2024-09-21T12:20:42.034 INFO:tasks.workunit.client.0.smithi003.stdout:6/524: mknod d4/d9/d59/cb1 0 2024-09-21T12:20:42.037 INFO:tasks.workunit.client.0.smithi003.stdout:3/560: creat d0/fba x:0 0 0 2024-09-21T12:20:42.039 INFO:tasks.workunit.client.0.smithi003.stdout:0/620: readlink l1 0 2024-09-21T12:20:42.040 INFO:tasks.workunit.client.0.smithi003.stdout:0/621: readlink d9/ldc 0 2024-09-21T12:20:42.047 INFO:tasks.workunit.client.0.smithi003.stdout:4/370: dread d9/da/d36/f50 [0,4194304] 0 2024-09-21T12:20:42.048 INFO:tasks.workunit.client.0.smithi003.stdout:1/518: symlink d4/dc/d80/lb3 0 2024-09-21T12:20:42.054 INFO:tasks.workunit.client.0.smithi003.stdout:3/561: mkdir d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/d77/dbb 0 2024-09-21T12:20:42.058 INFO:tasks.workunit.client.0.smithi003.stdout:9/520: dwrite d2/da/d2a/d3c/da2/daf/f7b [0,4194304] 0 2024-09-21T12:20:42.058 INFO:tasks.workunit.client.0.smithi003.stdout:1/519: dwrite d4/d11/d14/f6a [0,4194304] 0 2024-09-21T12:20:42.059 INFO:tasks.workunit.client.0.smithi003.stdout:4/371: creat d9/da/d47/d4b/d72/f7d x:0 0 0 2024-09-21T12:20:42.061 INFO:tasks.workunit.client.0.smithi003.stdout:6/525: dread d4/d9/f8a [0,4194304] 0 2024-09-21T12:20:42.077 INFO:tasks.workunit.client.0.smithi003.stdout:9/521: chown d2/da/d35/l54 1053705743 1 2024-09-21T12:20:42.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:41 smithi003 ceph-mon[28057]: pgmap v7: 65 pgs: 65 active+clean; 2.9 GiB data, 8.4 GiB used, 528 GiB / 536 GiB avail; 56 MiB/s rd, 172 MiB/s wr, 350 op/s 2024-09-21T12:20:42.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:41 smithi003 ceph-mon[28057]: mgrmap e25: smithi192.qsaprd(active, since 8s), standbys: smithi003.wztftl 2024-09-21T12:20:42.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:41 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "mgr metadata", "who": "smithi003.wztftl", "id": "smithi003.wztftl"}]: dispatch 2024-09-21T12:20:42.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:41 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' 2024-09-21T12:20:42.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:41 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' 2024-09-21T12:20:42.084 INFO:tasks.workunit.client.0.smithi003.stdout:2/422: getdents d0/d21/d62 0 2024-09-21T12:20:42.084 INFO:tasks.workunit.client.0.smithi003.stdout:3/562: getdents d0/d5/d38/db8 0 2024-09-21T12:20:42.085 INFO:tasks.workunit.client.0.smithi003.stdout:9/522: fsync d2/da/d17/d40/f4c 0 2024-09-21T12:20:42.087 INFO:tasks.workunit.client.0.smithi003.stdout:1/520: mknod d4/d11/db1/cb4 0 2024-09-21T12:20:42.093 INFO:tasks.workunit.client.0.smithi003.stdout:6/526: symlink d4/d11/d53/lb2 0 2024-09-21T12:20:42.096 INFO:tasks.workunit.client.0.smithi003.stdout:4/372: rename d9/da/d47/f4e to d9/da/d47/f7e 0 2024-09-21T12:20:42.098 INFO:tasks.workunit.client.0.smithi003.stdout:1/521: rename d4/df/d19/f36 to d4/d11/d14/d25/d42/d7b/fb5 0 2024-09-21T12:20:42.101 INFO:tasks.workunit.client.0.smithi003.stdout:2/423: fsync d0/fa 0 2024-09-21T12:20:42.104 INFO:tasks.workunit.client.0.smithi003.stdout:6/527: creat d4/d13/d19/d38/fb3 x:0 0 0 2024-09-21T12:20:42.107 INFO:tasks.workunit.client.0.smithi003.stdout:9/523: creat d2/da/d2a/d3c/da8/fc4 x:0 0 0 2024-09-21T12:20:42.107 INFO:tasks.workunit.client.0.smithi003.stdout:6/528: chown d4/d13/d63/f72 243671 1 2024-09-21T12:20:42.110 INFO:tasks.workunit.client.0.smithi003.stdout:4/373: rename d9/da/d47/f77 to d9/d16/d65/f7f 0 2024-09-21T12:20:42.111 INFO:tasks.workunit.client.0.smithi003.stdout:1/522: rmdir d4/dc/d80 39 2024-09-21T12:20:42.113 INFO:tasks.workunit.client.0.smithi003.stdout:8/445: write d7/df/d20/f35 [4165764,17906] 0 2024-09-21T12:20:42.117 INFO:tasks.workunit.client.0.smithi003.stdout:9/524: dwrite d2/da/d2a/f33 [4194304,4194304] 0 2024-09-21T12:20:42.122 INFO:tasks.workunit.client.0.smithi003.stdout:7/387: write d8/db/d13/f3a [138598,19205] 0 2024-09-21T12:20:42.128 INFO:tasks.workunit.client.0.smithi003.stdout:2/424: stat d0/dd/d22/d37/f74 0 2024-09-21T12:20:42.130 INFO:tasks.workunit.client.0.smithi003.stdout:8/446: mkdir d7/df/d20/d21/d4c/d4d/d9f 0 2024-09-21T12:20:42.132 INFO:tasks.workunit.client.0.smithi003.stdout:4/374: symlink d9/d48/l80 0 2024-09-21T12:20:42.132 INFO:tasks.workunit.client.0.smithi003.stdout:7/388: dwrite d8/f17 [4194304,4194304] 0 2024-09-21T12:20:42.137 INFO:tasks.workunit.client.0.smithi003.stdout:3/563: link d0/d5/da/c1c d0/d5/da/d28/d11/d49/cbc 0 2024-09-21T12:20:42.140 INFO:tasks.workunit.client.0.smithi003.stdout:9/525: link d2/da/d2a/d3c/da8/fc4 d2/d53/fc5 0 2024-09-21T12:20:42.140 INFO:tasks.workunit.client.0.smithi003.stdout:4/375: read f6 [3965730,46449] 0 2024-09-21T12:20:42.145 INFO:tasks.workunit.client.0.smithi003.stdout:7/389: symlink d8/d3c/d64/l8e 0 2024-09-21T12:20:42.146 INFO:tasks.workunit.client.0.smithi003.stdout:7/390: chown d8/d3c/f3e 3846 1 2024-09-21T12:20:42.148 INFO:tasks.workunit.client.0.smithi003.stdout:2/425: link d0/d1c/f61 d0/d21/d2f/d77/f9b 0 2024-09-21T12:20:42.149 INFO:tasks.workunit.client.0.smithi003.stdout:9/526: creat d2/d20/d22/d3f/fc6 x:0 0 0 2024-09-21T12:20:42.151 INFO:tasks.workunit.client.0.smithi003.stdout:4/376: mknod d9/da/d66/c81 0 2024-09-21T12:20:42.156 INFO:tasks.workunit.client.0.smithi003.stdout:7/391: creat d8/db/d13/d60/f8f x:0 0 0 2024-09-21T12:20:42.157 INFO:tasks.workunit.client.0.smithi003.stdout:0/622: dwrite d9/d12/d17/d38/d47/f7a [0,4194304] 0 2024-09-21T12:20:42.158 INFO:tasks.workunit.client.0.smithi003.stdout:2/426: fsync d0/d1c/f2e 0 2024-09-21T12:20:42.167 INFO:tasks.workunit.client.0.smithi003.stdout:8/447: creat d7/df/d20/d54/fa0 x:0 0 0 2024-09-21T12:20:42.172 INFO:tasks.workunit.client.0.smithi003.stdout:7/392: dwrite d8/f7c [0,4194304] 0 2024-09-21T12:20:42.174 INFO:tasks.workunit.client.0.smithi003.stdout:2/427: dwrite d0/d21/d2f/d50/f69 [0,4194304] 0 2024-09-21T12:20:42.176 INFO:tasks.workunit.client.0.smithi003.stdout:8/448: write d7/de/d1a/f87 [911500,97673] 0 2024-09-21T12:20:42.177 INFO:tasks.workunit.client.0.smithi003.stdout:4/377: mkdir d9/da/d47/d82 0 2024-09-21T12:20:42.177 INFO:tasks.workunit.client.0.smithi003.stdout:2/428: stat d0/d1c/l2b 0 2024-09-21T12:20:42.179 INFO:tasks.workunit.client.0.smithi003.stdout:9/527: dwrite d2/d53/fc5 [0,4194304] 0 2024-09-21T12:20:42.183 INFO:tasks.workunit.client.0.smithi003.stdout:7/393: dread d8/db/f58 [0,4194304] 0 2024-09-21T12:20:42.186 INFO:tasks.workunit.client.0.smithi003.stdout:7/394: fdatasync d8/db/d13/f77 0 2024-09-21T12:20:42.186 INFO:tasks.workunit.client.0.smithi003.stdout:8/449: fdatasync d7/df/d16/f5c 0 2024-09-21T12:20:42.188 INFO:tasks.workunit.client.0.smithi003.stdout:1/523: write d4/df/d41/f85 [1784759,92794] 0 2024-09-21T12:20:42.191 INFO:tasks.workunit.client.0.smithi003.stdout:6/529: dwrite d4/fa [0,4194304] 0 2024-09-21T12:20:42.192 INFO:tasks.workunit.client.0.smithi003.stdout:7/395: creat d8/d3c/f90 x:0 0 0 2024-09-21T12:20:42.193 INFO:tasks.workunit.client.0.smithi003.stdout:7/396: chown d8/db/d13 12 1 2024-09-21T12:20:42.194 INFO:tasks.workunit.client.0.smithi003.stdout:9/528: symlink d2/da/lc7 0 2024-09-21T12:20:42.199 INFO:tasks.workunit.client.0.smithi003.stdout:2/429: truncate d0/d1c/f2e 2397803 0 2024-09-21T12:20:42.203 INFO:tasks.workunit.client.0.smithi003.stdout:4/378: link d9/l3e d9/da/d36/d55/d79/l83 0 2024-09-21T12:20:42.204 INFO:tasks.workunit.client.0.smithi003.stdout:4/379: write d9/d16/f3b [2646498,16702] 0 2024-09-21T12:20:42.208 INFO:tasks.workunit.client.0.smithi003.stdout:7/397: symlink d8/db/d32/d43/d7e/l91 0 2024-09-21T12:20:42.211 INFO:tasks.workunit.client.0.smithi003.stdout:9/529: truncate d2/d20/f77 473467 0 2024-09-21T12:20:42.213 INFO:tasks.workunit.client.0.smithi003.stdout:1/524: dread d4/df/d19/f95 [0,4194304] 0 2024-09-21T12:20:42.214 INFO:tasks.workunit.client.0.smithi003.stdout:9/530: chown d2/da/d17/d40 8641372 1 2024-09-21T12:20:42.214 INFO:tasks.workunit.client.0.smithi003.stdout:0/623: dwrite d9/d12/f81 [0,4194304] 0 2024-09-21T12:20:42.217 INFO:tasks.workunit.client.0.smithi003.stdout:9/531: chown d2/da/d2a/d3c/c49 0 1 2024-09-21T12:20:42.224 INFO:tasks.workunit.client.0.smithi003.stdout:0/624: mknod d9/d6c/d26/db3/ce0 0 2024-09-21T12:20:42.224 INFO:tasks.workunit.client.0.smithi003.stdout:6/530: dread d4/f4a [0,4194304] 0 2024-09-21T12:20:42.228 INFO:tasks.workunit.client.0.smithi003.stdout:8/450: dwrite d7/df/d20/f5a [0,4194304] 0 2024-09-21T12:20:42.228 INFO:tasks.workunit.client.0.smithi003.stdout:9/532: unlink d2/cb 0 2024-09-21T12:20:42.230 INFO:tasks.workunit.client.0.smithi003.stdout:8/451: rename d7/de to d7/de/d85/da1 22 2024-09-21T12:20:42.231 INFO:tasks.workunit.client.0.smithi003.stdout:8/452: write d7/df/f12 [1755214,74918] 0 2024-09-21T12:20:42.234 INFO:tasks.workunit.client.0.smithi003.stdout:1/525: symlink d4/dc/d80/lb6 0 2024-09-21T12:20:42.237 INFO:tasks.workunit.client.0.smithi003.stdout:4/380: creat d9/f84 x:0 0 0 2024-09-21T12:20:42.239 INFO:tasks.workunit.client.0.smithi003.stdout:7/398: dwrite d8/db/f58 [0,4194304] 0 2024-09-21T12:20:42.239 INFO:tasks.workunit.client.0.smithi003.stdout:6/531: fdatasync d4/d13/d22/f40 0 2024-09-21T12:20:42.241 INFO:tasks.workunit.client.0.smithi003.stdout:0/625: creat d9/d12/d17/d38/d3a/d46/d55/d67/fe1 x:0 0 0 2024-09-21T12:20:42.244 INFO:tasks.workunit.client.0.smithi003.stdout:1/526: mknod d4/df/d19/d8a/cb7 0 2024-09-21T12:20:42.246 INFO:tasks.workunit.client.0.smithi003.stdout:7/399: chown l5 30618 1 2024-09-21T12:20:42.247 INFO:tasks.workunit.client.0.smithi003.stdout:6/532: symlink d4/d11/d32/lb4 0 2024-09-21T12:20:42.249 INFO:tasks.workunit.client.0.smithi003.stdout:9/533: symlink d2/d20/d22/d5e/lc8 0 2024-09-21T12:20:42.252 INFO:tasks.workunit.client.0.smithi003.stdout:1/527: readlink d4/df/l2e 0 2024-09-21T12:20:42.254 INFO:tasks.workunit.client.0.smithi003.stdout:1/528: readlink d4/df/l2e 0 2024-09-21T12:20:42.254 INFO:tasks.workunit.client.0.smithi003.stdout:6/533: chown d4/d13/d2e/d37/d64 2181 1 2024-09-21T12:20:42.254 INFO:tasks.workunit.client.0.smithi003.stdout:2/430: truncate d0/dd/d22/d37/f48 566383 0 2024-09-21T12:20:42.257 INFO:tasks.workunit.client.0.smithi003.stdout:7/400: dwrite d8/db/d32/d43/d7e/f83 [0,4194304] 0 2024-09-21T12:20:42.259 INFO:tasks.workunit.client.0.smithi003.stdout:8/453: creat d7/df/d20/fa2 x:0 0 0 2024-09-21T12:20:42.264 INFO:tasks.workunit.client.0.smithi003.stdout:1/529: dwrite d4/df/d12/f46 [0,4194304] 0 2024-09-21T12:20:42.266 INFO:tasks.workunit.client.0.smithi003.stdout:1/530: truncate d4/df/f74 5566093 0 2024-09-21T12:20:42.267 INFO:tasks.workunit.client.0.smithi003.stdout:9/534: symlink d2/da/lc9 0 2024-09-21T12:20:42.268 INFO:tasks.workunit.client.0.smithi003.stdout:7/401: mkdir d8/db/d32/d43/d92 0 2024-09-21T12:20:42.269 INFO:tasks.workunit.client.0.smithi003.stdout:8/454: rename d7/de/d1a/c7c to d7/de/d1a/ca3 0 2024-09-21T12:20:42.273 INFO:tasks.workunit.client.0.smithi003.stdout:0/626: getdents d9/d6c/d66 0 2024-09-21T12:20:42.274 INFO:tasks.workunit.client.0.smithi003.stdout:2/431: mknod d0/d21/d30/d78/c9c 0 2024-09-21T12:20:42.275 INFO:tasks.workunit.client.0.smithi003.stdout:0/627: write d9/d12/d17/d38/d3a/f72 [342471,2700] 0 2024-09-21T12:20:42.278 INFO:tasks.workunit.client.0.smithi003.stdout:0/628: chown d9/d12/d17/d38/d3a/d46/d55/d7b/d9a 33 1 2024-09-21T12:20:42.280 INFO:tasks.workunit.client.0.smithi003.stdout:0/629: chown d9/f4c 25 1 2024-09-21T12:20:42.283 INFO:tasks.workunit.client.0.smithi003.stdout:1/531: symlink d4/dc/d80/lb8 0 2024-09-21T12:20:42.290 INFO:tasks.workunit.client.0.smithi003.stdout:0/630: creat d9/d6c/d26/d54/d7e/fe2 x:0 0 0 2024-09-21T12:20:42.292 INFO:tasks.workunit.client.0.smithi003.stdout:6/534: dread d4/d9/f45 [0,4194304] 0 2024-09-21T12:20:42.294 INFO:tasks.workunit.client.0.smithi003.stdout:2/432: dread d0/dd/f84 [0,4194304] 0 2024-09-21T12:20:42.294 INFO:tasks.workunit.client.0.smithi003.stdout:6/535: write d4/d11/d32/fac [736184,105119] 0 2024-09-21T12:20:42.298 INFO:tasks.workunit.client.0.smithi003.stdout:8/455: dread f0 [0,4194304] 0 2024-09-21T12:20:42.302 INFO:tasks.workunit.client.0.smithi003.stdout:8/456: chown d7/df/d20/d24/d47/d79/c32 818530127 1 2024-09-21T12:20:42.304 INFO:tasks.workunit.client.0.smithi003.stdout:8/457: chown d7 5 1 2024-09-21T12:20:42.304 INFO:tasks.workunit.client.0.smithi003.stdout:1/532: dwrite d4/d11/d49/f7c [0,4194304] 0 2024-09-21T12:20:42.305 INFO:tasks.workunit.client.0.smithi003.stdout:6/536: creat d4/d13/d63/fb5 x:0 0 0 2024-09-21T12:20:42.308 INFO:tasks.workunit.client.0.smithi003.stdout:2/433: mkdir d0/dd/d22/d9d 0 2024-09-21T12:20:42.311 INFO:tasks.workunit.client.0.smithi003.stdout:8/458: creat d7/de/d81/fa4 x:0 0 0 2024-09-21T12:20:42.312 INFO:tasks.workunit.client.0.smithi003.stdout:9/535: dwrite d2/da/d17/f27 [0,4194304] 0 2024-09-21T12:20:42.315 INFO:tasks.workunit.client.0.smithi003.stdout:7/402: dwrite d8/db/d13/f1a [0,4194304] 0 2024-09-21T12:20:42.317 INFO:tasks.workunit.client.0.smithi003.stdout:7/403: fsync d8/db/f1c 0 2024-09-21T12:20:42.318 INFO:tasks.workunit.client.0.smithi003.stdout:6/537: mknod d4/d13/d19/d38/da3/cb6 0 2024-09-21T12:20:42.319 INFO:tasks.workunit.client.0.smithi003.stdout:8/459: mkdir d7/d57/d77/da5 0 2024-09-21T12:20:42.319 INFO:tasks.workunit.client.0.smithi003.stdout:7/404: fsync d8/db/d32/f6f 0 2024-09-21T12:20:42.324 INFO:tasks.workunit.client.0.smithi003.stdout:6/538: mknod d4/d13/d2e/d37/d58/cb7 0 2024-09-21T12:20:42.328 INFO:tasks.workunit.client.0.smithi003.stdout:9/536: dwrite d2/d20/d22/fc3 [0,4194304] 0 2024-09-21T12:20:42.328 INFO:tasks.workunit.client.0.smithi003.stdout:8/460: symlink d7/df/d20/d21/d4c/d4d/d8c/la6 0 2024-09-21T12:20:42.330 INFO:tasks.workunit.client.0.smithi003.stdout:1/533: creat d4/d11/d14/fb9 x:0 0 0 2024-09-21T12:20:42.334 INFO:tasks.workunit.client.0.smithi003.stdout:0/631: dread d9/d12/d17/d38/d3a/d46/f94 [0,4194304] 0 2024-09-21T12:20:42.337 INFO:tasks.workunit.client.0.smithi003.stdout:6/539: mknod d4/d13/d5b/cb8 0 2024-09-21T12:20:42.337 INFO:tasks.workunit.client.0.smithi003.stdout:8/461: rename d7/df/d20 to d7/df/d20/d24/d47/da7 22 2024-09-21T12:20:42.337 INFO:tasks.workunit.client.0.smithi003.stdout:7/405: mkdir d8/d93 0 2024-09-21T12:20:42.338 INFO:tasks.workunit.client.0.smithi003.stdout:1/534: creat d4/df/d19/fba x:0 0 0 2024-09-21T12:20:42.339 INFO:tasks.workunit.client.0.smithi003.stdout:9/537: read d2/da/f50 [816942,50858] 0 2024-09-21T12:20:42.348 INFO:tasks.workunit.client.0.smithi003.stdout:1/535: rename d4/df/d19/d8a/la6 to d4/dc/d80/lbb 0 2024-09-21T12:20:42.349 INFO:tasks.workunit.client.0.smithi003.stdout:1/536: stat d4/df/d41/f60 0 2024-09-21T12:20:42.350 INFO:tasks.workunit.client.0.smithi003.stdout:7/406: mknod d8/d31/d84/c94 0 2024-09-21T12:20:42.355 INFO:tasks.workunit.client.0.smithi003.stdout:0/632: creat d9/d12/d17/fe3 x:0 0 0 2024-09-21T12:20:42.358 INFO:tasks.workunit.client.0.smithi003.stdout:9/538: symlink d2/da/lca 0 2024-09-21T12:20:42.358 INFO:tasks.workunit.client.0.smithi003.stdout:6/540: dread d4/d13/d2e/f61 [0,4194304] 0 2024-09-21T12:20:42.360 INFO:tasks.workunit.client.0.smithi003.stdout:9/539: truncate d2/da/d35/d76/d94/fac 848366 0 2024-09-21T12:20:42.360 INFO:tasks.workunit.client.0.smithi003.stdout:1/537: symlink d4/d66/d8b/lbc 0 2024-09-21T12:20:42.363 INFO:tasks.workunit.client.0.smithi003.stdout:7/407: rename d8/l82 to d8/db/d13/d60/l95 0 2024-09-21T12:20:42.364 INFO:tasks.workunit.client.0.smithi003.stdout:7/408: chown d8/db/d32/d43/d92 1 1 2024-09-21T12:20:42.365 INFO:tasks.workunit.client.0.smithi003.stdout:8/462: rmdir d7/df/d20/d21/d4c/d4d/d9f 0 2024-09-21T12:20:42.368 INFO:tasks.workunit.client.0.smithi003.stdout:9/540: symlink d2/d20/d42/da5/lcb 0 2024-09-21T12:20:42.369 INFO:tasks.workunit.client.0.smithi003.stdout:1/538: creat d4/d11/d14/d25/d59/d65/fbd x:0 0 0 2024-09-21T12:20:42.371 INFO:tasks.workunit.client.0.smithi003.stdout:1/539: dread d4/d11/d14/d78/f9c [0,4194304] 0 2024-09-21T12:20:42.371 INFO:tasks.workunit.client.0.smithi003.stdout:6/541: rename d4/d9/d79/d94 to d4/d11/d1d/db9 0 2024-09-21T12:20:42.373 INFO:tasks.workunit.client.0.smithi003.stdout:7/409: mkdir d8/db/d13/d96 0 2024-09-21T12:20:42.376 INFO:tasks.workunit.client.0.smithi003.stdout:9/541: mkdir d2/d20/d42/dcc 0 2024-09-21T12:20:42.376 INFO:tasks.workunit.client.0.smithi003.stdout:9/542: fdatasync d2/f97 0 2024-09-21T12:20:42.380 INFO:tasks.workunit.client.0.smithi003.stdout:6/542: unlink d4/d11/d17/fa4 0 2024-09-21T12:20:42.381 INFO:tasks.workunit.client.0.smithi003.stdout:7/410: dread - d8/d2c/f39 zero size 2024-09-21T12:20:42.382 INFO:tasks.workunit.client.0.smithi003.stdout:6/543: write d4/d13/d2e/d37/d58/f5c [2630607,556] 0 2024-09-21T12:20:42.382 INFO:tasks.workunit.client.0.smithi003.stdout:1/540: dread d4/df/f38 [0,4194304] 0 2024-09-21T12:20:42.386 INFO:tasks.workunit.client.0.smithi003.stdout:9/543: symlink d2/da/d17/lcd 0 2024-09-21T12:20:42.390 INFO:tasks.workunit.client.0.smithi003.stdout:1/541: dwrite d4/d11/f72 [0,4194304] 0 2024-09-21T12:20:42.390 INFO:tasks.workunit.client.0.smithi003.stdout:7/411: chown d8/f1d 176132 1 2024-09-21T12:20:42.391 INFO:tasks.workunit.client.0.smithi003.stdout:1/542: fdatasync d4/df/fa4 0 2024-09-21T12:20:42.392 INFO:tasks.workunit.client.0.smithi003.stdout:6/544: truncate d4/d11/f2f 873245 0 2024-09-21T12:20:42.392 INFO:tasks.workunit.client.0.smithi003.stdout:1/543: write d4/df/d41/f7f [3411481,128387] 0 2024-09-21T12:20:42.394 INFO:tasks.workunit.client.0.smithi003.stdout:0/633: getdents d9/d6c/d32 0 2024-09-21T12:20:42.398 INFO:tasks.workunit.client.0.smithi003.stdout:9/544: read - d2/da/d2a/d3c/da2/daf/f70 zero size 2024-09-21T12:20:42.399 INFO:tasks.workunit.client.0.smithi003.stdout:9/545: readlink d2/d20/d42/da5/lcb 0 2024-09-21T12:20:42.400 INFO:tasks.workunit.client.0.smithi003.stdout:7/412: creat d8/db/d13/d60/f97 x:0 0 0 2024-09-21T12:20:42.402 INFO:tasks.workunit.client.0.smithi003.stdout:8/463: write d7/df/d16/f46 [1667389,95879] 0 2024-09-21T12:20:42.404 INFO:tasks.workunit.client.0.smithi003.stdout:8/464: chown d7/df/f83 181448 1 2024-09-21T12:20:42.404 INFO:tasks.workunit.client.0.smithi003.stdout:7/413: dread d8/db/f2b [0,4194304] 0 2024-09-21T12:20:42.406 INFO:tasks.workunit.client.0.smithi003.stdout:6/545: mkdir d4/d9/d59/dba 0 2024-09-21T12:20:42.414 INFO:tasks.workunit.client.0.smithi003.stdout:6/546: dwrite d4/d13/d63/f71 [0,4194304] 0 2024-09-21T12:20:42.416 INFO:tasks.workunit.client.0.smithi003.stdout:9/546: symlink d2/da/d2a/d3c/da8/lce 0 2024-09-21T12:20:42.417 INFO:tasks.workunit.client.0.smithi003.stdout:7/414: mknod d8/db/d13/d60/c98 0 2024-09-21T12:20:42.420 INFO:tasks.workunit.client.0.smithi003.stdout:0/634: dread d9/d12/d17/d21/f9f [0,4194304] 0 2024-09-21T12:20:42.427 INFO:tasks.workunit.client.0.smithi003.stdout:8/465: link d7/f18 d7/d57/d77/fa8 0 2024-09-21T12:20:42.431 INFO:tasks.workunit.client.0.smithi003.stdout:1/544: link d4/f90 d4/d11/fbe 0 2024-09-21T12:20:42.432 INFO:tasks.workunit.client.0.smithi003.stdout:0/635: readlink d9/d12/d17/la5 0 2024-09-21T12:20:42.435 INFO:tasks.workunit.client.0.smithi003.stdout:9/547: mknod d2/d20/d42/dcc/ccf 0 2024-09-21T12:20:42.437 INFO:tasks.workunit.client.0.smithi003.stdout:9/548: chown d2/d20/d42/da5/fbf 327 1 2024-09-21T12:20:42.440 INFO:tasks.workunit.client.0.smithi003.stdout:7/415: dwrite d8/d31/f6e [0,4194304] 0 2024-09-21T12:20:42.441 INFO:tasks.workunit.client.0.smithi003.stdout:6/547: link d4/d13/d22/f40 d4/d9/d59/d80/fbb 0 2024-09-21T12:20:42.442 INFO:tasks.workunit.client.0.smithi003.stdout:0/636: symlink d9/d6c/d26/d54/d7e/le4 0 2024-09-21T12:20:42.444 INFO:tasks.workunit.client.0.smithi003.stdout:6/548: stat d4/d13/d19/d23/l7a 0 2024-09-21T12:20:42.448 INFO:tasks.workunit.client.0.smithi003.stdout:1/545: dwrite d4/f26 [0,4194304] 0 2024-09-21T12:20:42.454 INFO:tasks.workunit.client.0.smithi003.stdout:9/549: mkdir d2/da/d2a/d3c/da2/daf/dd0 0 2024-09-21T12:20:42.454 INFO:tasks.workunit.client.0.smithi003.stdout:7/416: mknod d8/db/d32/d43/d7e/c99 0 2024-09-21T12:20:42.456 INFO:tasks.workunit.client.0.smithi003.stdout:8/466: creat d7/de/fa9 x:0 0 0 2024-09-21T12:20:42.457 INFO:tasks.workunit.client.0.smithi003.stdout:6/549: creat d4/d11/d1d/fbc x:0 0 0 2024-09-21T12:20:42.460 INFO:tasks.workunit.client.0.smithi003.stdout:7/417: unlink d8/fe 0 2024-09-21T12:20:42.460 INFO:tasks.workunit.client.0.smithi003.stdout:1/546: dwrite d4/df/fa5 [0,4194304] 0 2024-09-21T12:20:42.460 INFO:tasks.workunit.client.0.smithi003.stdout:9/550: read d2/da/d17/d40/f57 [3616287,57561] 0 2024-09-21T12:20:42.462 INFO:tasks.workunit.client.0.smithi003.stdout:8/467: truncate d7/df/d16/f46 1917136 0 2024-09-21T12:20:42.469 INFO:tasks.workunit.client.0.smithi003.stdout:6/550: creat d4/d11/d1d/d36/dae/fbd x:0 0 0 2024-09-21T12:20:42.470 INFO:tasks.workunit.client.0.smithi003.stdout:7/418: unlink d8/d3c/d57/f72 0 2024-09-21T12:20:42.471 INFO:tasks.workunit.client.0.smithi003.stdout:8/468: creat d7/df/d20/d21/d4c/d4d/d75/faa x:0 0 0 2024-09-21T12:20:42.474 INFO:tasks.workunit.client.0.smithi003.stdout:8/469: truncate d7/df/d20/d24/d47/d79/f6c 970221 0 2024-09-21T12:20:42.474 INFO:tasks.workunit.client.0.smithi003.stdout:6/551: creat d4/d11/d1d/d36/fbe x:0 0 0 2024-09-21T12:20:42.475 INFO:tasks.workunit.client.0.smithi003.stdout:8/470: fsync d7/df/d20/d21/d4c/f90 0 2024-09-21T12:20:42.477 INFO:tasks.workunit.client.0.smithi003.stdout:6/552: write d4/d11/d1d/d36/fbe [839024,36068] 0 2024-09-21T12:20:42.477 INFO:tasks.workunit.client.0.smithi003.stdout:1/547: creat d4/fbf x:0 0 0 2024-09-21T12:20:42.477 INFO:tasks.workunit.client.0.smithi003.stdout:8/471: chown d7/df/d20/d24/d47/d79/d8f 64 1 2024-09-21T12:20:42.478 INFO:tasks.workunit.client.0.smithi003.stdout:6/553: readlink d4/d11/l46 0 2024-09-21T12:20:42.478 INFO:tasks.workunit.client.0.smithi003.stdout:9/551: creat d2/da/fd1 x:0 0 0 2024-09-21T12:20:42.480 INFO:tasks.workunit.client.0.smithi003.stdout:0/637: write d9/d12/d17/d38/d3a/d46/d55/d7b/f83 [743681,68413] 0 2024-09-21T12:20:42.481 INFO:tasks.workunit.client.0.smithi003.stdout:6/554: write d4/d9/d79/f9d [451786,39792] 0 2024-09-21T12:20:42.481 INFO:tasks.workunit.client.0.smithi003.stdout:8/472: mknod d7/df/d20/d21/cab 0 2024-09-21T12:20:42.483 INFO:tasks.workunit.client.0.smithi003.stdout:9/552: mknod d2/da/d2a/d3c/da2/daf/cd2 0 2024-09-21T12:20:42.484 INFO:tasks.workunit.client.0.smithi003.stdout:8/473: dread - d7/df/d20/d21/d4c/d4d/f92 zero size 2024-09-21T12:20:42.485 INFO:tasks.workunit.client.0.smithi003.stdout:1/548: creat d4/d11/fc0 x:0 0 0 2024-09-21T12:20:42.487 INFO:tasks.workunit.client.0.smithi003.stdout:0/638: creat d9/d6c/d32/db8/fe5 x:0 0 0 2024-09-21T12:20:42.488 INFO:tasks.workunit.client.0.smithi003.stdout:6/555: mknod d4/d13/d5b/d8c/cbf 0 2024-09-21T12:20:42.491 INFO:tasks.workunit.client.0.smithi003.stdout:0/639: read d9/d12/d17/d38/d3a/d46/d55/db0/fb2 [3666890,78545] 0 2024-09-21T12:20:42.491 INFO:tasks.workunit.client.0.smithi003.stdout:9/553: dread d2/da/d2a/d3c/da8/fc4 [0,4194304] 0 2024-09-21T12:20:42.492 INFO:tasks.workunit.client.0.smithi003.stdout:8/474: creat d7/de/d52/fac x:0 0 0 2024-09-21T12:20:42.494 INFO:tasks.workunit.client.0.smithi003.stdout:6/556: dread d4/d11/d1d/d36/fbe [0,4194304] 0 2024-09-21T12:20:42.498 INFO:tasks.workunit.client.0.smithi003.stdout:8/475: mknod d7/df/d20/d54/d9d/cad 0 2024-09-21T12:20:42.501 INFO:tasks.workunit.client.0.smithi003.stdout:1/549: unlink d4/d11/d14/d25/d42/d7b/c69 0 2024-09-21T12:20:42.503 INFO:tasks.workunit.client.0.smithi003.stdout:6/557: rename d4/f4a to d4/d11/d1d/db9/fc0 0 2024-09-21T12:20:42.504 INFO:tasks.workunit.client.0.smithi003.stdout:6/558: readlink d4/d11/d17/l1c 0 2024-09-21T12:20:42.505 INFO:tasks.workunit.client.0.smithi003.stdout:6/559: fdatasync d4/d13/d19/d38/f41 0 2024-09-21T12:20:42.507 INFO:tasks.workunit.client.0.smithi003.stdout:8/476: unlink d7/df/d20/d21/d4c/d4d/d8c/la6 0 2024-09-21T12:20:42.508 INFO:tasks.workunit.client.0.smithi003.stdout:0/640: dread d9/d6c/d26/f3c [0,4194304] 0 2024-09-21T12:20:42.511 INFO:tasks.workunit.client.0.smithi003.stdout:9/554: write d2/da/f50 [3584430,130663] 0 2024-09-21T12:20:42.512 INFO:tasks.workunit.client.0.smithi003.stdout:6/560: dread d4/d11/d1d/d36/fbe [0,4194304] 0 2024-09-21T12:20:42.513 INFO:tasks.workunit.client.0.smithi003.stdout:8/477: symlink d7/df/d20/d24/d47/lae 0 2024-09-21T12:20:42.521 INFO:tasks.workunit.client.0.smithi003.stdout:0/641: dwrite d9/d6c/d26/f73 [4194304,4194304] 0 2024-09-21T12:20:42.523 INFO:tasks.workunit.client.0.smithi003.stdout:8/478: rename d7/df/d20/d24/d47/d79/f67 to d7/df/d20/d21/d4c/d4d/d8c/faf 0 2024-09-21T12:20:42.529 INFO:tasks.workunit.client.0.smithi003.stdout:0/642: symlink d9/d12/d17/d38/d3a/d46/d55/d67/le6 0 2024-09-21T12:20:42.531 INFO:tasks.workunit.client.0.smithi003.stdout:8/479: mknod d7/df/d36/cb0 0 2024-09-21T12:20:42.534 INFO:tasks.workunit.client.0.smithi003.stdout:8/480: write d7/de/d85/f88 [1831494,117644] 0 2024-09-21T12:20:42.536 INFO:tasks.workunit.client.0.smithi003.stdout:0/643: mkdir d9/d12/de7 0 2024-09-21T12:20:42.536 INFO:tasks.workunit.client.0.smithi003.stdout:8/481: dread - d7/df/d20/d24/d47/d79/f97 zero size 2024-09-21T12:20:42.536 INFO:tasks.workunit.client.0.smithi003.stdout:9/555: write d2/da/d35/d76/f91 [114075,54814] 0 2024-09-21T12:20:42.537 INFO:tasks.workunit.client.0.smithi003.stdout:9/556: stat d2/d20/d22/d3f 0 2024-09-21T12:20:42.539 INFO:tasks.workunit.client.0.smithi003.stdout:6/561: write d4/d11/f2f [1579240,58036] 0 2024-09-21T12:20:42.542 INFO:tasks.workunit.client.0.smithi003.stdout:6/562: readlink d4/d9/l2a 0 2024-09-21T12:20:42.548 INFO:tasks.workunit.client.0.smithi003.stdout:9/557: dwrite d2/d53/d75/fbd [0,4194304] 0 2024-09-21T12:20:42.551 INFO:tasks.workunit.client.0.smithi003.stdout:8/482: dwrite d7/df/d20/d54/f5e [0,4194304] 0 2024-09-21T12:20:42.554 INFO:tasks.workunit.client.0.smithi003.stdout:6/563: rename d4/d13/d2e/d37 to d4/d11/dc1 0 2024-09-21T12:20:42.559 INFO:tasks.workunit.client.0.smithi003.stdout:0/644: dwrite d9/d12/f1c [0,4194304] 0 2024-09-21T12:20:42.562 INFO:tasks.workunit.client.0.smithi003.stdout:8/483: rename d7/df/d20/d21/d4c/c4f to d7/df/d36/cb1 0 2024-09-21T12:20:42.562 INFO:tasks.workunit.client.0.smithi003.stdout:0/645: chown d9/d12/d17/d21/d30/c8c 95036694 1 2024-09-21T12:20:42.564 INFO:tasks.workunit.client.0.smithi003.stdout:9/558: dwrite d2/da/d2a/d3c/f4b [0,4194304] 0 2024-09-21T12:20:42.567 INFO:tasks.workunit.client.0.smithi003.stdout:8/484: write d7/df/d20/d54/fa0 [119248,118334] 0 2024-09-21T12:20:42.567 INFO:tasks.workunit.client.0.smithi003.stdout:0/646: rmdir d9/d12/d17 39 2024-09-21T12:20:42.573 INFO:tasks.workunit.client.0.smithi003.stdout:6/564: dwrite d4/f7c [0,4194304] 0 2024-09-21T12:20:42.576 INFO:tasks.workunit.client.0.smithi003.stdout:0/647: rmdir d9/d12/d17/d38/d3a/d46/d55/d7b/d9a 39 2024-09-21T12:20:42.584 INFO:tasks.workunit.client.0.smithi003.stdout:9/559: link d2/d20/d22/d3f/fc6 d2/da/d2a/d3c/da2/fd3 0 2024-09-21T12:20:42.589 INFO:tasks.workunit.client.0.smithi003.stdout:6/565: mknod d4/d9/d59/d80/cc2 0 2024-09-21T12:20:42.591 INFO:tasks.workunit.client.0.smithi003.stdout:9/560: rmdir d2/d20/d42/da5 39 2024-09-21T12:20:42.592 INFO:tasks.workunit.client.0.smithi003.stdout:9/561: dread - d2/d20/d22/d3f/fc6 zero size 2024-09-21T12:20:42.692 INFO:tasks.workunit.client.0.smithi003.stdout:5/544: sync 2024-09-21T12:20:42.702 INFO:tasks.workunit.client.0.smithi003.stdout:5/545: readlink dc/d15/d21/d28/d41/da0/l51 0 2024-09-21T12:20:42.706 INFO:tasks.workunit.client.0.smithi003.stdout:8/485: dwrite d7/d57/d77/fa8 [0,4194304] 0 2024-09-21T12:20:42.733 INFO:tasks.workunit.client.0.smithi003.stdout:5/546: symlink dc/d15/d21/d28/d41/d5b/dab/lad 0 2024-09-21T12:20:42.734 INFO:tasks.workunit.client.0.smithi003.stdout:5/547: chown dc/d15/d26/f84 856963 1 2024-09-21T12:20:42.735 INFO:tasks.workunit.client.0.smithi003.stdout:6/566: write d4/d9/f8a [2496728,82063] 0 2024-09-21T12:20:42.736 INFO:tasks.workunit.client.0.smithi003.stdout:5/548: chown dc/d15/l8e 5 1 2024-09-21T12:20:42.737 INFO:tasks.workunit.client.0.smithi003.stdout:0/648: dwrite d9/d12/d17/d38/d3a/d46/f94 [0,4194304] 0 2024-09-21T12:20:42.738 INFO:tasks.workunit.client.0.smithi003.stdout:8/486: link d7/de/d52/f60 d7/de/d85/fb2 0 2024-09-21T12:20:42.739 INFO:tasks.workunit.client.0.smithi003.stdout:5/549: readlink dc/d15/d21/d28/d3c/d73/la2 0 2024-09-21T12:20:42.741 INFO:tasks.workunit.client.0.smithi003.stdout:6/567: mkdir d4/d13/d22/dc3 0 2024-09-21T12:20:42.745 INFO:tasks.workunit.client.0.smithi003.stdout:0/649: creat d9/d12/d17/d38/d47/fe8 x:0 0 0 2024-09-21T12:20:42.748 INFO:tasks.workunit.client.0.smithi003.stdout:9/562: dwrite d2/f10 [0,4194304] 0 2024-09-21T12:20:42.750 INFO:tasks.workunit.client.0.smithi003.stdout:6/568: mknod d4/d13/d22/dc3/cc4 0 2024-09-21T12:20:42.754 INFO:tasks.workunit.client.0.smithi003.stdout:5/550: dwrite dc/d15/d21/d28/d41/d5b/d74/d7f/d82/f92 [0,4194304] 0 2024-09-21T12:20:42.759 INFO:tasks.workunit.client.0.smithi003.stdout:9/563: symlink d2/da/d2a/d3c/da2/ld4 0 2024-09-21T12:20:42.763 INFO:tasks.workunit.client.0.smithi003.stdout:0/650: rename d9/d12/d17/d38/d3a/d46/d55/d67/d2d/d91 to d9/d12/d1e/d5f/de9 0 2024-09-21T12:20:42.764 INFO:tasks.workunit.client.0.smithi003.stdout:5/551: dwrite dc/d15/f1f [0,4194304] 0 2024-09-21T12:20:42.765 INFO:tasks.workunit.client.0.smithi003.stdout:6/569: symlink d4/d13/d56/lc5 0 2024-09-21T12:20:42.771 INFO:tasks.workunit.client.0.smithi003.stdout:9/564: creat d2/da/d2a/d3c/da2/fd5 x:0 0 0 2024-09-21T12:20:42.772 INFO:tasks.workunit.client.0.smithi003.stdout:0/651: dwrite d9/d6c/d32/f62 [0,4194304] 0 2024-09-21T12:20:42.775 INFO:tasks.workunit.client.0.smithi003.stdout:6/570: mknod d4/d13/d2e/cc6 0 2024-09-21T12:20:42.778 INFO:tasks.workunit.client.0.smithi003.stdout:5/552: mkdir dc/d15/d21/d28/d41/da0/d4b/d5c/dae 0 2024-09-21T12:20:42.780 INFO:tasks.workunit.client.0.smithi003.stdout:9/565: mknod d2/da/d2a/d89/d9c/cd6 0 2024-09-21T12:20:42.787 INFO:tasks.workunit.client.0.smithi003.stdout:5/553: mknod dc/d15/d26/caf 0 2024-09-21T12:20:42.789 INFO:tasks.workunit.client.0.smithi003.stdout:5/554: write dc/d15/d21/d28/d41/d5b/fa5 [130194,580] 0 2024-09-21T12:20:42.798 INFO:tasks.workunit.client.0.smithi003.stdout:6/571: link d4/d13/d22/c9a d4/d13/d22/cc7 0 2024-09-21T12:20:42.801 INFO:tasks.workunit.client.0.smithi003.stdout:6/572: chown d4/d9/d59/ca0 49007 1 2024-09-21T12:20:42.803 INFO:tasks.workunit.client.0.smithi003.stdout:5/555: dread dc/d15/d1c/f58 [0,4194304] 0 2024-09-21T12:20:42.804 INFO:tasks.workunit.client.0.smithi003.stdout:6/573: creat d4/d13/d2e/fc8 x:0 0 0 2024-09-21T12:20:42.810 INFO:tasks.workunit.client.0.smithi003.stdout:0/652: dwrite f8 [0,4194304] 0 2024-09-21T12:20:42.815 INFO:tasks.workunit.client.0.smithi003.stdout:9/566: dwrite d2/da/d2a/d3c/f37 [0,4194304] 0 2024-09-21T12:20:42.818 INFO:tasks.workunit.client.0.smithi003.stdout:0/653: rmdir d9/d12/d17/d38/d3a/d46 39 2024-09-21T12:20:42.819 INFO:tasks.workunit.client.0.smithi003.stdout:0/654: chown d9/d12/d17/d38/c56 3 1 2024-09-21T12:20:42.819 INFO:tasks.workunit.client.0.smithi003.stdout:6/574: link d4/d13/d22/cc7 d4/d13/d63/cc9 0 2024-09-21T12:20:42.822 INFO:tasks.workunit.client.0.smithi003.stdout:9/567: mknod d2/da/d2a/d3c/da2/cd7 0 2024-09-21T12:20:42.824 INFO:tasks.workunit.client.0.smithi003.stdout:0/655: mknod d9/d6c/d26/d54/d88/cea 0 2024-09-21T12:20:42.827 INFO:tasks.workunit.client.0.smithi003.stdout:9/568: creat d2/da0/fd8 x:0 0 0 2024-09-21T12:20:42.827 INFO:tasks.workunit.client.0.smithi003.stdout:5/556: write dc/d15/d21/d28/d41/d5b/d74/d7f/d82/fa4 [266644,18609] 0 2024-09-21T12:20:42.827 INFO:tasks.workunit.client.0.smithi003.stdout:6/575: dwrite d4/d13/d22/f2b [0,4194304] 0 2024-09-21T12:20:42.829 INFO:tasks.workunit.client.0.smithi003.stdout:0/656: mkdir d9/d6c/d32/dc3/deb 0 2024-09-21T12:20:42.830 INFO:tasks.workunit.client.0.smithi003.stdout:5/557: chown dc/d15/d21/d28/d41/da0/f55 75 1 2024-09-21T12:20:42.831 INFO:tasks.workunit.client.0.smithi003.stdout:0/657: unlink d9/fda 0 2024-09-21T12:20:42.834 INFO:tasks.workunit.client.0.smithi003.stdout:6/576: rename d4/d13/d19/d23/l51 to d4/d11/d1d/d36/lca 0 2024-09-21T12:20:42.836 INFO:tasks.workunit.client.0.smithi003.stdout:0/658: creat d9/d12/d1e/d5f/de9/fec x:0 0 0 2024-09-21T12:20:42.837 INFO:tasks.workunit.client.0.smithi003.stdout:6/577: fsync d4/d11/dc1/f90 0 2024-09-21T12:20:42.860 INFO:tasks.workunit.client.0.smithi003.stdout:3/564: sync 2024-09-21T12:20:42.889 INFO:tasks.workunit.client.0.smithi003.stdout:6/578: chown d4/d13/d22/f40 300944 1 2024-09-21T12:20:42.894 INFO:tasks.workunit.client.0.smithi003.stdout:3/565: mknod d0/d5/da/d28/cbd 0 2024-09-21T12:20:42.896 INFO:tasks.workunit.client.0.smithi003.stdout:3/566: read d0/d5/da/d28/d11/d49/f73 [2145024,2406] 0 2024-09-21T12:20:42.897 INFO:tasks.workunit.client.0.smithi003.stdout:3/567: chown d0/d5/da/d28/d31/f7b 212623958 1 2024-09-21T12:20:42.898 INFO:tasks.workunit.client.0.smithi003.stdout:5/558: link dc/d15/d1c/c6b dc/d15/d21/d28/d3c/cb0 0 2024-09-21T12:20:42.901 INFO:tasks.workunit.client.0.smithi003.stdout:0/659: creat d9/d12/d17/d38/d3a/d46/d55/db0/fed x:0 0 0 2024-09-21T12:20:42.902 INFO:tasks.workunit.client.0.smithi003.stdout:0/660: chown d9/d6c/ldd 1 1 2024-09-21T12:20:42.904 INFO:tasks.workunit.client.0.smithi003.stdout:0/661: chown d9/d12/d17/d38/d3a/d46/d55/lc2 806776606 1 2024-09-21T12:20:42.907 INFO:tasks.workunit.client.0.smithi003.stdout:0/662: mkdir d9/d12/d17/d21/dee 0 2024-09-21T12:20:42.982 INFO:tasks.workunit.client.0.smithi003.stdout:6/579: symlink d4/d11/dc1/lcb 0 2024-09-21T12:20:42.989 INFO:tasks.workunit.client.0.smithi003.stdout:6/580: dwrite d4/d9/d79/f9d [0,4194304] 0 2024-09-21T12:20:42.994 INFO:tasks.workunit.client.0.smithi003.stdout:6/581: getdents d4/d13/d19/d38/da3 0 2024-09-21T12:20:43.026 INFO:tasks.workunit.client.0.smithi003.stdout:0/663: truncate d9/d6c/d66/f8d 961729 0 2024-09-21T12:20:43.027 INFO:tasks.workunit.client.0.smithi003.stdout:0/664: write d9/d6c/f1b [5216296,93314] 0 2024-09-21T12:20:43.043 INFO:tasks.workunit.client.0.smithi003.stdout:6/582: link d4/d13/d2e/l39 d4/d11/dc1/d64/lcc 0 2024-09-21T12:20:43.045 INFO:tasks.workunit.client.0.smithi003.stdout:0/665: link d9/d12/d17/d21/f31 d9/d12/d17/d38/d3a/d46/d55/d7b/d9a/fef 0 2024-09-21T12:20:43.050 INFO:tasks.workunit.client.0.smithi003.stdout:6/583: creat d4/d13/d63/fcd x:0 0 0 2024-09-21T12:20:43.056 INFO:tasks.workunit.client.0.smithi003.stdout:0/666: link d9/d12/d17/d38/d3a/d46/d55/d67/f64 d9/d12/de7/ff0 0 2024-09-21T12:20:43.065 INFO:tasks.workunit.client.0.smithi003.stdout:0/667: dwrite d9/d12/d17/d38/d3a/f72 [0,4194304] 0 2024-09-21T12:20:43.069 INFO:tasks.workunit.client.0.smithi003.stdout:0/668: symlink d9/d6c/d26/d54/d7e/dde/lf1 0 2024-09-21T12:20:43.080 INFO:tasks.workunit.client.0.smithi003.stdout:0/669: dwrite d9/d12/d17/d21/f31 [0,4194304] 0 2024-09-21T12:20:43.083 INFO:tasks.workunit.client.0.smithi003.stdout:0/670: creat d9/d12/d17/d21/d30/ff2 x:0 0 0 2024-09-21T12:20:43.083 INFO:tasks.workunit.client.0.smithi003.stdout:0/671: dread - d9/d12/d17/d38/fc1 zero size 2024-09-21T12:20:43.115 INFO:tasks.workunit.client.0.smithi003.stdout:5/559: mknod dc/d15/d21/d28/cb1 0 2024-09-21T12:20:43.121 INFO:tasks.workunit.client.0.smithi003.stdout:5/560: getdents dc/d15/d21/d28/d41/d5b/d74/d7f 0 2024-09-21T12:20:43.123 INFO:tasks.workunit.client.0.smithi003.stdout:5/561: mknod dc/d15/d21/d28/d41/d5b/d74/d7f/cb2 0 2024-09-21T12:20:43.124 INFO:tasks.workunit.client.0.smithi003.stdout:5/562: dread - dc/d15/d1c/f4c zero size 2024-09-21T12:20:43.125 INFO:tasks.workunit.client.0.smithi003.stdout:5/563: rmdir dc/d15/d6f 39 2024-09-21T12:20:43.129 INFO:tasks.workunit.client.0.smithi003.stdout:5/564: rename dc/c14 to dc/d15/cb3 0 2024-09-21T12:20:43.130 INFO:tasks.workunit.client.0.smithi003.stdout:5/565: write dc/d15/d21/fac [324781,16951] 0 2024-09-21T12:20:43.130 INFO:tasks.workunit.client.0.smithi003.stdout:5/566: chown dc/f4d 26403 1 2024-09-21T12:20:43.142 INFO:tasks.workunit.client.0.smithi003.stdout:5/567: dread dc/d15/d21/d28/d41/da0/f34 [0,4194304] 0 2024-09-21T12:20:43.144 INFO:tasks.workunit.client.0.smithi003.stdout:5/568: creat dc/d15/d21/d28/d3c/fb4 x:0 0 0 2024-09-21T12:20:43.158 INFO:tasks.workunit.client.0.smithi003.stdout:5/569: dread dc/d2b/d4e/f53 [0,4194304] 0 2024-09-21T12:20:43.162 INFO:tasks.workunit.client.0.smithi003.stdout:5/570: mknod dc/d15/d21/d28/d41/d5b/d74/cb5 0 2024-09-21T12:20:43.164 INFO:tasks.workunit.client.0.smithi003.stdout:5/571: mknod dc/d15/d21/d28/d41/d5b/d74/d7f/cb6 0 2024-09-21T12:20:43.166 INFO:tasks.workunit.client.0.smithi003.stdout:5/572: chown dc/d15/d21/d28/d41/d5b/d74/d7f/c9e 57 1 2024-09-21T12:20:43.171 INFO:tasks.workunit.client.0.smithi003.stdout:5/573: dwrite dc/d15/d21/d28/d3c/f91 [0,4194304] 0 2024-09-21T12:20:43.180 INFO:tasks.workunit.client.0.smithi003.stdout:5/574: getdents dc/d15/d21/d28/d41/da0/d4b 0 2024-09-21T12:20:43.374 INFO:tasks.workunit.client.0.smithi003.stdout:4/381: sync 2024-09-21T12:20:43.374 INFO:tasks.workunit.client.0.smithi003.stdout:2/434: sync 2024-09-21T12:20:43.374 INFO:tasks.workunit.client.0.smithi003.stdout:7/419: sync 2024-09-21T12:20:43.376 INFO:tasks.workunit.client.0.smithi003.stdout:4/382: rmdir d9/da/d66 39 2024-09-21T12:20:43.376 INFO:tasks.workunit.client.0.smithi003.stdout:2/435: rmdir d0/d21/d62 39 2024-09-21T12:20:43.378 INFO:tasks.workunit.client.0.smithi003.stdout:2/436: truncate d0/d21/d30/f43 4971393 0 2024-09-21T12:20:43.381 INFO:tasks.workunit.client.0.smithi003.stdout:4/383: link d9/d25/c71 d9/da/d47/d82/c85 0 2024-09-21T12:20:43.384 INFO:tasks.workunit.client.0.smithi003.stdout:2/437: getdents d0/dd/d22/d68/d7e/d97 0 2024-09-21T12:20:43.390 INFO:tasks.workunit.client.0.smithi003.stdout:2/438: rename d0/d21/f51 to d0/f9e 0 2024-09-21T12:20:43.392 INFO:tasks.workunit.client.0.smithi003.stdout:7/420: dread d8/d3c/d57/f73 [0,4194304] 0 2024-09-21T12:20:43.394 INFO:tasks.workunit.client.0.smithi003.stdout:2/439: getdents d0/dd/d22/d68 0 2024-09-21T12:20:43.396 INFO:tasks.workunit.client.0.smithi003.stdout:7/421: rename d8/d3c/f4b to d8/d3c/f9a 0 2024-09-21T12:20:43.398 INFO:tasks.workunit.client.0.smithi003.stdout:4/384: dread d9/f23 [0,4194304] 0 2024-09-21T12:20:43.398 INFO:tasks.workunit.client.0.smithi003.stdout:2/440: mkdir d0/d21/d2f/d9f 0 2024-09-21T12:20:43.399 INFO:tasks.workunit.client.0.smithi003.stdout:2/441: fsync d0/dd/d22/f57 0 2024-09-21T12:20:43.403 INFO:tasks.workunit.client.0.smithi003.stdout:7/422: rename d8/d3c/d6b/c48 to d8/d31/d84/c9b 0 2024-09-21T12:20:43.404 INFO:tasks.workunit.client.0.smithi003.stdout:2/442: creat d0/d21/d2c/fa0 x:0 0 0 2024-09-21T12:20:43.406 INFO:tasks.workunit.client.0.smithi003.stdout:7/423: mknod d8/db/d13/c9c 0 2024-09-21T12:20:43.407 INFO:tasks.workunit.client.0.smithi003.stdout:4/385: write d9/d25/f39 [4555647,79870] 0 2024-09-21T12:20:43.409 INFO:tasks.workunit.client.0.smithi003.stdout:4/386: write d9/d16/f2e [2771334,76161] 0 2024-09-21T12:20:43.425 INFO:tasks.workunit.client.0.smithi003.stdout:7/424: dread d8/db/d32/d43/f76 [0,4194304] 0 2024-09-21T12:20:43.426 INFO:tasks.workunit.client.0.smithi003.stdout:2/443: dread d0/d1c/f42 [0,4194304] 0 2024-09-21T12:20:43.427 INFO:tasks.workunit.client.0.smithi003.stdout:7/425: write d8/d31/f74 [330039,124994] 0 2024-09-21T12:20:43.428 INFO:tasks.workunit.client.0.smithi003.stdout:7/426: stat d8/db/d13/c9c 0 2024-09-21T12:20:43.428 INFO:tasks.workunit.client.0.smithi003.stdout:4/387: dread d9/f1a [0,4194304] 0 2024-09-21T12:20:43.430 INFO:tasks.workunit.client.0.smithi003.stdout:4/388: read d9/d16/f2e [4745454,24219] 0 2024-09-21T12:20:43.431 INFO:tasks.workunit.client.0.smithi003.stdout:7/427: mknod d8/d31/d84/c9d 0 2024-09-21T12:20:43.435 INFO:tasks.workunit.client.0.smithi003.stdout:2/444: dwrite d0/dd/d22/f79 [0,4194304] 0 2024-09-21T12:20:43.435 INFO:tasks.workunit.client.0.smithi003.stdout:7/428: truncate d8/f1d 58198 0 2024-09-21T12:20:43.438 INFO:tasks.workunit.client.0.smithi003.stdout:7/429: fdatasync d8/db/f16 0 2024-09-21T12:20:43.440 INFO:tasks.workunit.client.0.smithi003.stdout:4/389: rename d9/c33 to d9/da/d47/c86 0 2024-09-21T12:20:43.443 INFO:tasks.workunit.client.0.smithi003.stdout:7/430: truncate d8/db/d32/d43/f88 662882 0 2024-09-21T12:20:43.444 INFO:tasks.workunit.client.0.smithi003.stdout:2/445: dwrite d0/d21/f81 [0,4194304] 0 2024-09-21T12:20:43.450 INFO:tasks.workunit.client.0.smithi003.stdout:2/446: mknod d0/d21/d2c/ca1 0 2024-09-21T12:20:43.452 INFO:tasks.workunit.client.0.smithi003.stdout:4/390: truncate d9/d48/f51 886733 0 2024-09-21T12:20:43.454 INFO:tasks.workunit.client.0.smithi003.stdout:7/431: fdatasync d8/d3c/d6b/f5a 0 2024-09-21T12:20:43.457 INFO:tasks.workunit.client.0.smithi003.stdout:2/447: rmdir d0/d1c/d6a 39 2024-09-21T12:20:43.462 INFO:tasks.workunit.client.0.smithi003.stdout:7/432: truncate d8/db/f16 4609652 0 2024-09-21T12:20:43.464 INFO:tasks.workunit.client.0.smithi003.stdout:2/448: read d0/dd/d22/d37/f48 [385206,67079] 0 2024-09-21T12:20:43.465 INFO:tasks.workunit.client.0.smithi003.stdout:7/433: read d8/f17 [2315009,103365] 0 2024-09-21T12:20:43.468 INFO:tasks.workunit.client.0.smithi003.stdout:7/434: dread d8/d2c/f2a [0,4194304] 0 2024-09-21T12:20:43.475 INFO:tasks.workunit.client.0.smithi003.stdout:7/435: dwrite d8/d31/f67 [0,4194304] 0 2024-09-21T12:20:43.476 INFO:tasks.workunit.client.0.smithi003.stdout:7/436: truncate d8/d2c/f2e 529651 0 2024-09-21T12:20:43.477 INFO:tasks.workunit.client.0.smithi003.stdout:4/391: dread f6 [0,4194304] 0 2024-09-21T12:20:43.478 INFO:tasks.workunit.client.0.smithi003.stdout:4/392: fdatasync d9/da/d47/d4b/d72/f7d 0 2024-09-21T12:20:43.479 INFO:tasks.workunit.client.0.smithi003.stdout:2/449: rename d0/f9e to d0/d21/d2f/fa2 0 2024-09-21T12:20:43.483 INFO:tasks.workunit.client.0.smithi003.stdout:7/437: mkdir d8/d3c/d57/d9e 0 2024-09-21T12:20:43.490 INFO:tasks.workunit.client.0.smithi003.stdout:4/393: creat d9/da/d36/d55/d79/f87 x:0 0 0 2024-09-21T12:20:43.490 INFO:tasks.workunit.client.0.smithi003.stdout:7/438: dread d8/d2c/f7f [0,4194304] 0 2024-09-21T12:20:43.493 INFO:tasks.workunit.client.0.smithi003.stdout:2/450: symlink d0/dd/d22/la3 0 2024-09-21T12:20:43.495 INFO:tasks.workunit.client.0.smithi003.stdout:7/439: mknod d8/db/d32/c9f 0 2024-09-21T12:20:43.497 INFO:tasks.workunit.client.0.smithi003.stdout:2/451: rmdir d0/d21 39 2024-09-21T12:20:43.497 INFO:tasks.workunit.client.0.smithi003.stdout:4/394: dwrite d9/da/d47/d4b/f75 [0,4194304] 0 2024-09-21T12:20:43.499 INFO:tasks.workunit.client.0.smithi003.stdout:4/395: truncate d9/fc 5213454 0 2024-09-21T12:20:43.501 INFO:tasks.workunit.client.0.smithi003.stdout:7/440: creat d8/fa0 x:0 0 0 2024-09-21T12:20:43.510 INFO:tasks.workunit.client.0.smithi003.stdout:7/441: creat d8/d31/fa1 x:0 0 0 2024-09-21T12:20:43.514 INFO:tasks.workunit.client.0.smithi003.stdout:4/396: dread d9/da/d36/f50 [4194304,4194304] 0 2024-09-21T12:20:43.515 INFO:tasks.workunit.client.0.smithi003.stdout:7/442: creat d8/d3c/d57/d9e/fa2 x:0 0 0 2024-09-21T12:20:43.517 INFO:tasks.workunit.client.0.smithi003.stdout:4/397: symlink d9/d48/l88 0 2024-09-21T12:20:43.519 INFO:tasks.workunit.client.0.smithi003.stdout:7/443: getdents d8/db/d32/d43/d7e 0 2024-09-21T12:20:43.521 INFO:tasks.workunit.client.0.smithi003.stdout:7/444: creat d8/d31/fa3 x:0 0 0 2024-09-21T12:20:43.522 INFO:tasks.workunit.client.0.smithi003.stdout:4/398: read d9/d16/f3d [267381,113075] 0 2024-09-21T12:20:43.522 INFO:tasks.workunit.client.0.smithi003.stdout:7/445: read d8/db/d13/f3a [367496,108982] 0 2024-09-21T12:20:43.523 INFO:tasks.workunit.client.0.smithi003.stdout:7/446: write d8/f52 [103161,127351] 0 2024-09-21T12:20:43.524 INFO:tasks.workunit.client.0.smithi003.stdout:7/447: chown d8/db/d13/d60/f8a 952401 1 2024-09-21T12:20:43.525 INFO:tasks.workunit.client.0.smithi003.stdout:2/452: truncate d0/f36 4359102 0 2024-09-21T12:20:43.526 INFO:tasks.workunit.client.0.smithi003.stdout:4/399: dread d9/da/d36/f3f [0,4194304] 0 2024-09-21T12:20:43.527 INFO:tasks.workunit.client.0.smithi003.stdout:7/448: chown d8/d31/l62 503585011 1 2024-09-21T12:20:43.530 INFO:tasks.workunit.client.0.smithi003.stdout:2/453: mknod d0/d21/d30/ca4 0 2024-09-21T12:20:43.531 INFO:tasks.workunit.client.0.smithi003.stdout:7/449: mknod d8/ca4 0 2024-09-21T12:20:43.532 INFO:tasks.workunit.client.0.smithi003.stdout:4/400: rename d9/d16/f5b to d9/d48/f89 0 2024-09-21T12:20:43.532 INFO:tasks.workunit.client.0.smithi003.stdout:4/401: chown d9/l43 117727015 1 2024-09-21T12:20:43.533 INFO:tasks.workunit.client.0.smithi003.stdout:7/450: creat d8/d3c/d57/d81/fa5 x:0 0 0 2024-09-21T12:20:43.535 INFO:tasks.workunit.client.0.smithi003.stdout:4/402: truncate d9/f23 4924226 0 2024-09-21T12:20:43.538 INFO:tasks.workunit.client.0.smithi003.stdout:7/451: mkdir d8/db/d13/d75/da6 0 2024-09-21T12:20:43.544 INFO:tasks.workunit.client.0.smithi003.stdout:4/403: creat d9/f8a x:0 0 0 2024-09-21T12:20:43.547 INFO:tasks.workunit.client.0.smithi003.stdout:0/672: sync 2024-09-21T12:20:43.547 INFO:tasks.workunit.client.0.smithi003.stdout:3/568: sync 2024-09-21T12:20:43.547 INFO:tasks.workunit.client.0.smithi003.stdout:1/550: sync 2024-09-21T12:20:43.547 INFO:tasks.workunit.client.0.smithi003.stdout:8/487: sync 2024-09-21T12:20:43.547 INFO:tasks.workunit.client.0.smithi003.stdout:6/584: sync 2024-09-21T12:20:43.547 INFO:tasks.workunit.client.0.smithi003.stdout:9/569: sync 2024-09-21T12:20:43.547 INFO:tasks.workunit.client.0.smithi003.stdout:5/575: sync 2024-09-21T12:20:43.548 INFO:tasks.workunit.client.0.smithi003.stdout:4/404: rename d9/d25/l4a to d9/d16/l8b 0 2024-09-21T12:20:43.549 INFO:tasks.workunit.client.0.smithi003.stdout:2/454: write d0/d21/d2f/d50/f90 [1273425,90656] 0 2024-09-21T12:20:43.550 INFO:tasks.workunit.client.0.smithi003.stdout:1/551: readlink d4/d11/d14/d25/d42/d7b/l9b 0 2024-09-21T12:20:43.551 INFO:tasks.workunit.client.0.smithi003.stdout:9/570: symlink d2/d53/d75/ld9 0 2024-09-21T12:20:43.553 INFO:tasks.workunit.client.0.smithi003.stdout:8/488: creat d7/d57/d77/fb3 x:0 0 0 2024-09-21T12:20:43.556 INFO:tasks.workunit.client.0.smithi003.stdout:7/452: write d8/db/f38 [671422,1139] 0 2024-09-21T12:20:43.557 INFO:tasks.workunit.client.0.smithi003.stdout:0/673: rename d9/d6c/d26/d54/d7e/le4 to d9/d6c/d26/d54/d7e/dde/lf3 0 2024-09-21T12:20:43.560 INFO:tasks.workunit.client.0.smithi003.stdout:9/571: readlink d2/da/d99/lc1 0 2024-09-21T12:20:43.561 INFO:tasks.workunit.client.0.smithi003.stdout:7/453: truncate d8/fa0 986149 0 2024-09-21T12:20:43.562 INFO:tasks.workunit.client.0.smithi003.stdout:2/455: dwrite d0/d21/d2c/d6c/f8a [0,4194304] 0 2024-09-21T12:20:43.568 INFO:tasks.workunit.client.0.smithi003.stdout:7/454: chown d8/db/d32/d43/c4c 34780634 1 2024-09-21T12:20:43.569 INFO:tasks.workunit.client.0.smithi003.stdout:4/405: dread d9/d16/f3b [0,4194304] 0 2024-09-21T12:20:43.576 INFO:tasks.workunit.client.0.smithi003.stdout:2/456: dwrite d0/dd/d22/f79 [0,4194304] 0 2024-09-21T12:20:43.576 INFO:tasks.workunit.client.0.smithi003.stdout:3/569: creat d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/d77/fbe x:0 0 0 2024-09-21T12:20:43.578 INFO:tasks.workunit.client.0.smithi003.stdout:0/674: dread d9/d12/d17/d38/d3a/d46/d55/d67/f29 [0,4194304] 0 2024-09-21T12:20:43.578 INFO:tasks.workunit.client.0.smithi003.stdout:3/570: dread - d0/f98 zero size 2024-09-21T12:20:43.579 INFO:tasks.workunit.client.0.smithi003.stdout:6/585: dread d4/d9/fd [0,4194304] 0 2024-09-21T12:20:43.579 INFO:tasks.workunit.client.0.smithi003.stdout:5/576: mknod dc/d15/d21/d28/d41/d5b/d74/d7f/d82/cb7 0 2024-09-21T12:20:43.581 INFO:tasks.workunit.client.0.smithi003.stdout:8/489: creat d7/df/d20/fb4 x:0 0 0 2024-09-21T12:20:43.582 INFO:tasks.workunit.client.0.smithi003.stdout:3/571: write d0/d5/da/d28/d11/d49/d4c/d54/d5e/d48/f8f [145357,46713] 0 2024-09-21T12:20:43.585 INFO:tasks.workunit.client.0.smithi003.stdout:1/552: rename d4/df/c70 to d4/d11/d14/d78/cc1 0 2024-09-21T12:20:43.586 INFO:tasks.workunit.client.0.smithi003.stdout:3/572: dread d0/d5/da/d28/f88 [0,4194304] 0 2024-09-21T12:20:43.588 INFO:tasks.workunit.client.0.smithi003.stdout:7/455: creat d8/db/fa7 x:0 0 0 2024-09-21T12:20:43.590 INFO:tasks.workunit.client.0.smithi003.stdout:7/456: fsync d8/db/d13/d60/f97 0 2024-09-21T12:20:43.594 INFO:tasks.workunit.client.0.smithi003.stdout:5/577: creat dc/d15/d26/fb8 x:0 0 0 2024-09-21T12:20:43.595 INFO:tasks.workunit.client.0.smithi003.stdout:6/586: write d4/d11/d1d/db9/fc0 [2336700,37744] 0 2024-09-21T12:20:43.598 INFO:tasks.workunit.client.0.smithi003.stdout:7/457: dread d8/d3c/d57/f73 [0,4194304] 0 2024-09-21T12:20:43.600 INFO:tasks.workunit.client.0.smithi003.stdout:7/458: fsync d8/d31/f6e 0 2024-09-21T12:20:43.603 INFO:tasks.workunit.client.0.smithi003.stdout:7/459: write d8/f7b [966242,34721] 0 2024-09-21T12:20:43.604 INFO:tasks.workunit.client.0.smithi003.stdout:1/553: readlink d4/d11/l15 0 2024-09-21T12:20:43.605 INFO:tasks.workunit.client.0.smithi003.stdout:6/587: dwrite d4/d13/d19/fad [0,4194304] 0 2024-09-21T12:20:43.606 INFO:tasks.workunit.client.0.smithi003.stdout:6/588: readlink d4/d11/d17/l1c 0 2024-09-21T12:20:43.608 INFO:tasks.workunit.client.0.smithi003.stdout:9/572: write d2/da/d2a/d3c/da2/daf/f60 [4730333,62799] 0 2024-09-21T12:20:43.609 INFO:tasks.workunit.client.0.smithi003.stdout:3/573: creat d0/d5/da/d28/d31/fbf x:0 0 0 2024-09-21T12:20:43.611 INFO:tasks.workunit.client.0.smithi003.stdout:8/490: dread d7/df/d20/d21/f3f [0,4194304] 0 2024-09-21T12:20:43.614 INFO:tasks.workunit.client.0.smithi003.stdout:0/675: link d9/d6c/d26/f73 d9/d12/d17/d38/ff4 0 2024-09-21T12:20:43.623 INFO:tasks.workunit.client.0.smithi003.stdout:4/406: dwrite d9/da/f57 [4194304,4194304] 0 2024-09-21T12:20:43.623 INFO:tasks.workunit.client.0.smithi003.stdout:2/457: dwrite d0/dd/d22/f23 [0,4194304] 0 2024-09-21T12:20:43.626 INFO:tasks.workunit.client.0.smithi003.stdout:6/589: creat d4/d11/d1d/fce x:0 0 0 2024-09-21T12:20:43.630 INFO:tasks.workunit.client.0.smithi003.stdout:9/573: rmdir d2/da/d2a/d3c/da8 39 2024-09-21T12:20:43.634 INFO:tasks.workunit.client.0.smithi003.stdout:7/460: dread d8/db/d13/f86 [0,4194304] 0 2024-09-21T12:20:43.634 INFO:tasks.workunit.client.0.smithi003.stdout:5/578: mknod dc/d15/d21/d28/d41/da0/d90/cb9 0 2024-09-21T12:20:43.636 INFO:tasks.workunit.client.0.smithi003.stdout:0/676: unlink d9/d6c/l71 0 2024-09-21T12:20:43.637 INFO:tasks.workunit.client.0.smithi003.stdout:0/677: chown d9/d6c/d32/dc3 7 1 2024-09-21T12:20:43.642 INFO:tasks.workunit.client.0.smithi003.stdout:8/491: dread d7/df/f12 [0,4194304] 0 2024-09-21T12:20:43.643 INFO:tasks.workunit.client.0.smithi003.stdout:1/554: rename d4/df/d12/f3b to d4/d11/d49/fc2 0 2024-09-21T12:20:43.644 INFO:tasks.workunit.client.0.smithi003.stdout:4/407: mkdir d9/da/d36/d8c 0 2024-09-21T12:20:43.646 INFO:tasks.workunit.client.0.smithi003.stdout:6/590: mkdir d4/d13/d22/dcf 0 2024-09-21T12:20:43.647 INFO:tasks.workunit.client.0.smithi003.stdout:9/574: unlink d2/d53/d83/fa7 0 2024-09-21T12:20:43.648 INFO:tasks.workunit.client.0.smithi003.stdout:7/461: mkdir d8/d31/d84/da8 0 2024-09-21T12:20:43.649 INFO:tasks.workunit.client.0.smithi003.stdout:7/462: chown d8/db/d32/d43/c4c 516654 1 2024-09-21T12:20:43.650 INFO:tasks.workunit.client.0.smithi003.stdout:3/574: link d0/d5/da/d28/d31/f32 d0/d5/da/d28/d31/d6b/fc0 0 2024-09-21T12:20:43.652 INFO:tasks.workunit.client.0.smithi003.stdout:8/492: creat d7/df/d20/d24/d47/fb5 x:0 0 0 2024-09-21T12:20:43.653 INFO:tasks.workunit.client.0.smithi003.stdout:1/555: creat d4/df/d12/fc3 x:0 0 0 2024-09-21T12:20:43.654 INFO:tasks.workunit.client.0.smithi003.stdout:1/556: write d4/dc/f1c [1245618,95546] 0 2024-09-21T12:20:43.655 INFO:tasks.workunit.client.0.smithi003.stdout:2/458: creat d0/d21/d2f/d9f/fa5 x:0 0 0 2024-09-21T12:20:43.656 INFO:tasks.workunit.client.0.smithi003.stdout:4/408: unlink d9/c63 0 2024-09-21T12:20:43.657 INFO:tasks.workunit.client.0.smithi003.stdout:4/409: chown d9/da/c21 2781 1 2024-09-21T12:20:43.658 INFO:tasks.workunit.client.0.smithi003.stdout:0/678: dread d9/d12/d17/d38/d3a/d46/f79 [0,4194304] 0 2024-09-21T12:20:43.660 INFO:tasks.workunit.client.0.smithi003.stdout:5/579: symlink dc/d15/d21/d28/lba 0 2024-09-21T12:20:43.662 INFO:tasks.workunit.client.0.smithi003.stdout:7/463: unlink d8/d31/fa1 0 2024-09-21T12:20:43.663 INFO:tasks.workunit.client.0.smithi003.stdout:3/575: creat d0/d5/da/d28/d11/fc1 x:0 0 0 2024-09-21T12:20:43.664 INFO:tasks.workunit.client.0.smithi003.stdout:3/576: stat d0/d5/d38/d55/f65 0 2024-09-21T12:20:43.665 INFO:tasks.workunit.client.0.smithi003.stdout:3/577: stat d0/d5/da/d28/d11/d49/d4c/d6f/cb4 0 2024-09-21T12:20:43.667 INFO:tasks.workunit.client.0.smithi003.stdout:2/459: unlink d0/d1c/l2b 0 2024-09-21T12:20:43.670 INFO:tasks.workunit.client.0.smithi003.stdout:4/410: readlink d9/l3e 0 2024-09-21T12:20:43.670 INFO:tasks.workunit.client.0.smithi003.stdout:6/591: getdents d4/d13/d22/dcf 0 2024-09-21T12:20:43.673 INFO:tasks.workunit.client.0.smithi003.stdout:8/493: dwrite d7/df/d20/d21/f50 [0,4194304] 0 2024-09-21T12:20:43.675 INFO:tasks.workunit.client.0.smithi003.stdout:6/592: write d4/d13/d56/f8f [929717,127619] 0 2024-09-21T12:20:43.676 INFO:tasks.workunit.client.0.smithi003.stdout:8/494: chown d7/df/d20/f5a 5 1 2024-09-21T12:20:43.677 INFO:tasks.workunit.client.0.smithi003.stdout:2/460: dwrite d0/d21/d2f/f7b [0,4194304] 0 2024-09-21T12:20:43.682 INFO:tasks.workunit.client.0.smithi003.stdout:3/578: creat d0/d5/da/d28/d11/d49/d4c/d6f/d91/fc2 x:0 0 0 2024-09-21T12:20:43.688 INFO:tasks.workunit.client.0.smithi003.stdout:4/411: fdatasync d9/f24 0 2024-09-21T12:20:43.690 INFO:tasks.workunit.client.0.smithi003.stdout:5/580: rename dc/d15/l2f to dc/d15/d6f/lbb 0 2024-09-21T12:20:43.691 INFO:tasks.workunit.client.0.smithi003.stdout:5/581: chown dc/d15/d26/f86 19668 1 2024-09-21T12:20:43.693 INFO:tasks.workunit.client.0.smithi003.stdout:5/582: fsync dc/d15/d21/d28/d41/d5b/d74/d7f/f93 0 2024-09-21T12:20:43.694 INFO:tasks.workunit.client.0.smithi003.stdout:6/593: truncate d4/d11/dc1/f31 290189 0 2024-09-21T12:20:43.698 INFO:tasks.workunit.client.0.smithi003.stdout:4/412: mkdir d9/d16/d65/d73/d8d 0 2024-09-21T12:20:43.699 INFO:tasks.workunit.client.0.smithi003.stdout:4/413: unlink d9/da/d47/d4b/d72/f7d 0 2024-09-21T12:20:43.702 INFO:tasks.workunit.client.0.smithi003.stdout:4/414: creat d9/d16/d65/f8e x:0 0 0 2024-09-21T12:20:43.703 INFO:tasks.workunit.client.0.smithi003.stdout:3/579: rename d0/d5/da/d28/d11/d96/la2 to d0/d5/da/lc3 0 2024-09-21T12:20:43.703 INFO:tasks.workunit.client.0.smithi003.stdout:6/594: getdents d4/d13/d5b/d8c 0 2024-09-21T12:20:43.706 INFO:tasks.workunit.client.0.smithi003.stdout:6/595: write d4/d11/d32/fac [1203063,17095] 0 2024-09-21T12:20:43.707 INFO:tasks.workunit.client.0.smithi003.stdout:5/583: rename dc/d2b/d4e/l52 to dc/d15/d21/d28/d41/da0/d4b/d5c/dae/lbc 0 2024-09-21T12:20:43.707 INFO:tasks.workunit.client.0.smithi003.stdout:6/596: dread - d4/d11/d1d/fbc zero size 2024-09-21T12:20:43.727 INFO:tasks.workunit.client.0.smithi003.stdout:3/580: dread d0/d5/da/d28/d11/d49/d4c/f66 [0,4194304] 0 2024-09-21T12:20:43.728 INFO:tasks.workunit.client.0.smithi003.stdout:5/584: creat dc/d15/d26/fbd x:0 0 0 2024-09-21T12:20:43.731 INFO:tasks.workunit.client.0.smithi003.stdout:6/597: truncate d4/d11/dc1/f2d 3324538 0 2024-09-21T12:20:43.731 INFO:tasks.workunit.client.0.smithi003.stdout:5/585: write dc/d15/d21/d28/d3c/f91 [4044659,52990] 0 2024-09-21T12:20:43.732 INFO:tasks.workunit.client.0.smithi003.stdout:7/464: dwrite d8/f17 [0,4194304] 0 2024-09-21T12:20:43.738 INFO:tasks.workunit.client.0.smithi003.stdout:6/598: creat d4/d13/d63/fd0 x:0 0 0 2024-09-21T12:20:43.738 INFO:tasks.workunit.client.0.smithi003.stdout:9/575: truncate d2/da/d2a/d3c/da8/fc4 2941272 0 2024-09-21T12:20:43.740 INFO:tasks.workunit.client.0.smithi003.stdout:6/599: fsync d4/d9/d59/f77 0 2024-09-21T12:20:43.741 INFO:tasks.workunit.client.0.smithi003.stdout:2/461: dwrite d0/dd/f5a [0,4194304] 0 2024-09-21T12:20:43.743 INFO:tasks.workunit.client.0.smithi003.stdout:6/600: write d4/d13/d63/fa2 [501812,101456] 0 2024-09-21T12:20:43.745 INFO:tasks.workunit.client.0.smithi003.stdout:7/465: mkdir d8/d31/d84/da9 0 2024-09-21T12:20:43.747 INFO:tasks.workunit.client.0.smithi003.stdout:7/466: write d8/db/ff [2880981,38023] 0 2024-09-21T12:20:43.750 INFO:tasks.workunit.client.0.smithi003.stdout:5/586: unlink dc/d15/d21/d28/d41/da0/d35/c6e 0 2024-09-21T12:20:43.752 INFO:tasks.workunit.client.0.smithi003.stdout:9/576: dwrite d2/da/d35/d76/f7e [0,4194304] 0 2024-09-21T12:20:43.753 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:43 smithi192 ceph-mon[35641]: pgmap v8: 65 pgs: 65 active+clean; 2.9 GiB data, 8.4 GiB used, 528 GiB / 536 GiB avail; 44 MiB/s rd, 134 MiB/s wr, 272 op/s 2024-09-21T12:20:43.754 INFO:tasks.workunit.client.0.smithi003.stdout:5/587: truncate dc/d15/d26/fb8 770673 0 2024-09-21T12:20:43.756 INFO:tasks.workunit.client.0.smithi003.stdout:5/588: write dc/d15/d21/d28/d3c/f91 [2594102,101381] 0 2024-09-21T12:20:43.759 INFO:tasks.workunit.client.0.smithi003.stdout:4/415: dwrite f6 [0,4194304] 0 2024-09-21T12:20:43.766 INFO:tasks.workunit.client.0.smithi003.stdout:5/589: dwrite dc/f8c [0,4194304] 0 2024-09-21T12:20:43.771 INFO:tasks.workunit.client.0.smithi003.stdout:6/601: rename d4/d11/c28 to d4/d13/d5b/d8c/cd1 0 2024-09-21T12:20:43.772 INFO:tasks.workunit.client.0.smithi003.stdout:6/602: chown d4/d9/f8a 349 1 2024-09-21T12:20:43.781 INFO:tasks.workunit.client.0.smithi003.stdout:7/467: dwrite d8/db/d13/f86 [0,4194304] 0 2024-09-21T12:20:43.781 INFO:tasks.workunit.client.0.smithi003.stdout:4/416: fsync d9/da/d47/f7b 0 2024-09-21T12:20:43.783 INFO:tasks.workunit.client.0.smithi003.stdout:4/417: read d9/d16/f3b [807296,45952] 0 2024-09-21T12:20:43.787 INFO:tasks.workunit.client.0.smithi003.stdout:4/418: dread d9/da/f27 [4194304,4194304] 0 2024-09-21T12:20:43.788 INFO:tasks.workunit.client.0.smithi003.stdout:4/419: read d9/fc [456428,120393] 0 2024-09-21T12:20:43.793 INFO:tasks.workunit.client.0.smithi003.stdout:3/581: truncate d0/d5/da/d28/d11/d49/d94/fa0 711367 0 2024-09-21T12:20:43.797 INFO:tasks.workunit.client.0.smithi003.stdout:6/603: truncate d4/f5 3994764 0 2024-09-21T12:20:43.805 INFO:tasks.workunit.client.0.smithi003.stdout:9/577: dwrite d2/da/f14 [0,4194304] 0 2024-09-21T12:20:43.806 INFO:tasks.workunit.client.0.smithi003.stdout:9/578: dread - d2/da/d35/d76/fc0 zero size 2024-09-21T12:20:43.816 INFO:tasks.workunit.client.0.smithi003.stdout:2/462: dwrite d0/d1c/d6a/f71 [0,4194304] 0 2024-09-21T12:20:43.818 INFO:tasks.workunit.client.0.smithi003.stdout:4/420: getdents d9/da/d47 0 2024-09-21T12:20:43.822 INFO:tasks.workunit.client.0.smithi003.stdout:5/590: dwrite dc/d15/d21/d28/d41/da0/d35/f78 [0,4194304] 0 2024-09-21T12:20:43.822 INFO:tasks.workunit.client.0.smithi003.stdout:3/582: unlink d0/d5/da/d28/d11/d49/d94/fa0 0 2024-09-21T12:20:43.825 INFO:tasks.workunit.client.0.smithi003.stdout:5/591: fsync dc/d15/d21/d28/d41/d5b/d74/d7f/f93 0 2024-09-21T12:20:43.826 INFO:tasks.workunit.client.0.smithi003.stdout:6/604: dread d4/d13/f20 [0,4194304] 0 2024-09-21T12:20:43.827 INFO:tasks.workunit.client.0.smithi003.stdout:5/592: readlink dc/d15/la7 0 2024-09-21T12:20:43.828 INFO:tasks.workunit.client.0.smithi003.stdout:2/463: symlink d0/d21/d30/d78/la6 0 2024-09-21T12:20:43.834 INFO:tasks.workunit.client.0.smithi003.stdout:3/583: mkdir d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/daa/dc4 0 2024-09-21T12:20:43.837 INFO:tasks.workunit.client.0.smithi003.stdout:2/464: truncate d0/dd/d22/d37/f48 1132027 0 2024-09-21T12:20:43.838 INFO:tasks.workunit.client.0.smithi003.stdout:5/593: dwrite dc/d15/d21/d28/d41/da0/d4b/faa [0,4194304] 0 2024-09-21T12:20:43.839 INFO:tasks.workunit.client.0.smithi003.stdout:2/465: fdatasync d0/dd/d22/d68/d7e/f86 0 2024-09-21T12:20:43.839 INFO:tasks.workunit.client.0.smithi003.stdout:9/579: link d2/da/d35/l54 d2/d20/d42/lda 0 2024-09-21T12:20:43.842 INFO:tasks.workunit.client.0.smithi003.stdout:6/605: read d4/f5 [576592,97697] 0 2024-09-21T12:20:43.847 INFO:tasks.workunit.client.0.smithi003.stdout:2/466: dread - d0/d1c/f52 zero size 2024-09-21T12:20:43.848 INFO:tasks.workunit.client.0.smithi003.stdout:9/580: creat d2/d53/d83/fdb x:0 0 0 2024-09-21T12:20:43.848 INFO:tasks.workunit.client.0.smithi003.stdout:3/584: symlink d0/d5/da/d28/dd/lc5 0 2024-09-21T12:20:43.851 INFO:tasks.workunit.client.0.smithi003.stdout:3/585: fsync d0/d5/da/d28/d11/d49/d4c/d6f/f8b 0 2024-09-21T12:20:43.852 INFO:tasks.workunit.client.0.smithi003.stdout:4/421: dwrite d9/da/f22 [0,4194304] 0 2024-09-21T12:20:43.854 INFO:tasks.workunit.client.0.smithi003.stdout:6/606: creat d4/d13/d56/fd2 x:0 0 0 2024-09-21T12:20:43.854 INFO:tasks.workunit.client.0.smithi003.stdout:6/607: stat d4/f10 0 2024-09-21T12:20:43.855 INFO:tasks.workunit.client.0.smithi003.stdout:6/608: chown d4/d13/d56/f8f 26 1 2024-09-21T12:20:43.857 INFO:tasks.workunit.client.0.smithi003.stdout:2/467: unlink d0/d1c/f52 0 2024-09-21T12:20:43.858 INFO:tasks.workunit.client.0.smithi003.stdout:9/581: mknod d2/da/d99/cdc 0 2024-09-21T12:20:43.859 INFO:tasks.workunit.client.0.smithi003.stdout:9/582: readlink d2/d20/d22/d3f/l7c 0 2024-09-21T12:20:43.859 INFO:tasks.workunit.client.0.smithi003.stdout:4/422: creat d9/da/d47/d4b/f8f x:0 0 0 2024-09-21T12:20:43.860 INFO:tasks.workunit.client.0.smithi003.stdout:3/586: truncate d0/d5/da/d28/f51 1237041 0 2024-09-21T12:20:43.862 INFO:tasks.workunit.client.0.smithi003.stdout:6/609: creat d4/d13/d22/dc3/fd3 x:0 0 0 2024-09-21T12:20:43.863 INFO:tasks.workunit.client.0.smithi003.stdout:9/583: mkdir d2/da/d2a/d3c/da2/ddd 0 2024-09-21T12:20:43.865 INFO:tasks.workunit.client.0.smithi003.stdout:9/584: write d2/da0/fd8 [844522,15582] 0 2024-09-21T12:20:43.865 INFO:tasks.workunit.client.0.smithi003.stdout:4/423: rename d9/l43 to d9/da/d47/d82/l90 0 2024-09-21T12:20:43.867 INFO:tasks.workunit.client.0.smithi003.stdout:5/594: getdents dc 0 2024-09-21T12:20:43.868 INFO:tasks.workunit.client.0.smithi003.stdout:3/587: chown d0/d5/da/d28/d11/d49/cbc 1 1 2024-09-21T12:20:43.868 INFO:tasks.workunit.client.0.smithi003.stdout:5/595: chown dc/d2b/f44 56099935 1 2024-09-21T12:20:43.869 INFO:tasks.workunit.client.0.smithi003.stdout:2/468: symlink d0/la7 0 2024-09-21T12:20:43.870 INFO:tasks.workunit.client.0.smithi003.stdout:6/610: creat d4/d13/fd4 x:0 0 0 2024-09-21T12:20:43.877 INFO:tasks.workunit.client.0.smithi003.stdout:5/596: unlink dc/d15/d21/d28/cb1 0 2024-09-21T12:20:43.877 INFO:tasks.workunit.client.0.smithi003.stdout:6/611: dwrite d4/d13/d63/fb5 [0,4194304] 0 2024-09-21T12:20:43.878 INFO:tasks.workunit.client.0.smithi003.stdout:5/597: fdatasync dc/d15/d1c/f29 0 2024-09-21T12:20:43.888 INFO:tasks.workunit.client.0.smithi003.stdout:3/588: unlink d0/d5/da/fb3 0 2024-09-21T12:20:43.888 INFO:tasks.workunit.client.0.smithi003.stdout:2/469: creat d0/d21/d2c/d63/fa8 x:0 0 0 2024-09-21T12:20:43.892 INFO:tasks.workunit.client.0.smithi003.stdout:5/598: chown dc/cd 3147095 1 2024-09-21T12:20:43.893 INFO:tasks.workunit.client.0.smithi003.stdout:5/599: truncate dc/d2b/d4e/f53 4746120 0 2024-09-21T12:20:43.894 INFO:tasks.workunit.client.0.smithi003.stdout:6/612: dread - d4/d13/d19/d23/f3c zero size 2024-09-21T12:20:43.894 INFO:tasks.workunit.client.0.smithi003.stdout:5/600: chown dc/d15/d21/d28/d41/da0/l51 2221 1 2024-09-21T12:20:43.897 INFO:tasks.workunit.client.0.smithi003.stdout:5/601: read dc/d15/d21/d28/d41/da0/d4b/d5c/f99 [1637833,120500] 0 2024-09-21T12:20:43.929 INFO:tasks.workunit.client.0.smithi003.stdout:4/424: write d9/da/fb [3943058,39420] 0 2024-09-21T12:20:43.930 INFO:tasks.workunit.client.0.smithi003.stdout:6/613: readlink d4/d9/l9e 0 2024-09-21T12:20:43.932 INFO:tasks.workunit.client.0.smithi003.stdout:2/470: symlink d0/d1c/la9 0 2024-09-21T12:20:43.934 INFO:tasks.workunit.client.0.smithi003.stdout:4/425: write d9/da/f12 [9401640,14028] 0 2024-09-21T12:20:44.020 INFO:tasks.workunit.client.0.smithi003.stdout:3/589: getdents d0/d5 0 2024-09-21T12:20:44.021 INFO:tasks.workunit.client.0.smithi003.stdout:5/602: dwrite dc/f8c [0,4194304] 0 2024-09-21T12:20:44.023 INFO:tasks.workunit.client.0.smithi003.stdout:3/590: readlink d0/d5/d38/l4b 0 2024-09-21T12:20:44.024 INFO:tasks.workunit.client.0.smithi003.stdout:9/585: dwrite d2/d20/f77 [0,4194304] 0 2024-09-21T12:20:44.026 INFO:tasks.workunit.client.0.smithi003.stdout:5/603: chown dc/d15/d21/d28/d41/l62 86195979 1 2024-09-21T12:20:44.028 INFO:tasks.workunit.client.0.smithi003.stdout:6/614: dwrite d4/d11/d32/f3b [0,4194304] 0 2024-09-21T12:20:44.029 INFO:tasks.workunit.client.0.smithi003.stdout:5/604: write dc/d15/d21/fac [624763,19143] 0 2024-09-21T12:20:44.036 INFO:tasks.workunit.client.0.smithi003.stdout:9/586: fdatasync d2/da/d17/d40/f4a 0 2024-09-21T12:20:44.040 INFO:tasks.workunit.client.0.smithi003.stdout:5/605: creat dc/d15/d21/d28/d41/d5b/fbe x:0 0 0 2024-09-21T12:20:44.042 INFO:tasks.workunit.client.0.smithi003.stdout:2/471: truncate d0/dd/d22/d37/d3f/f67 1122564 0 2024-09-21T12:20:44.042 INFO:tasks.workunit.client.0.smithi003.stdout:2/472: stat d0/d46/c47 0 2024-09-21T12:20:44.043 INFO:tasks.workunit.client.0.smithi003.stdout:9/587: fdatasync d2/da/d17/f7a 0 2024-09-21T12:20:44.044 INFO:tasks.workunit.client.0.smithi003.stdout:3/591: symlink d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/lc6 0 2024-09-21T12:20:44.046 INFO:tasks.workunit.client.0.smithi003.stdout:6/615: rename d4/d13/d2e/l7d to d4/d11/d32/ld5 0 2024-09-21T12:20:44.049 INFO:tasks.workunit.client.0.smithi003.stdout:9/588: creat d2/d20/d22/d5e/d87/fde x:0 0 0 2024-09-21T12:20:44.050 INFO:tasks.workunit.client.0.smithi003.stdout:3/592: symlink d0/d5/da/d28/d11/d49/d94/lc7 0 2024-09-21T12:20:44.051 INFO:tasks.workunit.client.0.smithi003.stdout:4/426: getdents d9/da/d47 0 2024-09-21T12:20:44.052 INFO:tasks.workunit.client.0.smithi003.stdout:5/606: creat dc/d15/d21/d28/d41/d9f/fbf x:0 0 0 2024-09-21T12:20:44.054 INFO:tasks.workunit.client.0.smithi003.stdout:2/473: mkdir d0/d21/d2f/d77/d7f/daa 0 2024-09-21T12:20:44.054 INFO:tasks.workunit.client.0.smithi003.stdout:6/616: dwrite d4/d13/d63/fcd [0,4194304] 0 2024-09-21T12:20:44.057 INFO:tasks.workunit.client.0.smithi003.stdout:5/607: write dc/d15/d1c/f3e [3810582,1369] 0 2024-09-21T12:20:44.057 INFO:tasks.workunit.client.0.smithi003.stdout:2/474: mknod d0/d21/d2f/d50/cab 0 2024-09-21T12:20:44.059 INFO:tasks.workunit.client.0.smithi003.stdout:2/475: chown d0/dd/d22/d37/d3f/l60 449347037 1 2024-09-21T12:20:44.062 INFO:tasks.workunit.client.0.smithi003.stdout:4/427: rename d9/d16/d65/d73/l7c to d9/da/d36/d8c/l91 0 2024-09-21T12:20:44.064 INFO:tasks.workunit.client.0.smithi003.stdout:2/476: creat d0/d21/d2f/fac x:0 0 0 2024-09-21T12:20:44.065 INFO:tasks.workunit.client.0.smithi003.stdout:3/593: getdents d0/d5/da/d28/d11/d49/d4c/d6f 0 2024-09-21T12:20:44.069 INFO:tasks.workunit.client.0.smithi003.stdout:5/608: rename dc/d15/d21/d28/d41/d9f/fbf to dc/d15/d21/d28/d41/d5b/fc0 0 2024-09-21T12:20:44.072 INFO:tasks.workunit.client.0.smithi003.stdout:2/477: link d0/d1c/f96 d0/d1c/d6a/fad 0 2024-09-21T12:20:44.074 INFO:tasks.workunit.client.0.smithi003.stdout:5/609: dread dc/d15/d21/d28/d41/da0/d35/f78 [0,4194304] 0 2024-09-21T12:20:44.074 INFO:tasks.workunit.client.0.smithi003.stdout:2/478: fsync d0/d21/d2f/d50/f90 0 2024-09-21T12:20:44.075 INFO:tasks.workunit.client.0.smithi003.stdout:5/610: chown dc/d15/la7 8015313 1 2024-09-21T12:20:44.075 INFO:tasks.workunit.client.0.smithi003.stdout:4/428: creat d9/da/f92 x:0 0 0 2024-09-21T12:20:44.076 INFO:tasks.workunit.client.0.smithi003.stdout:4/429: chown d9/d16/f28 12 1 2024-09-21T12:20:44.077 INFO:tasks.workunit.client.0.smithi003.stdout:5/611: truncate dc/d2b/d4e/f94 1558079 0 2024-09-21T12:20:44.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:43 smithi003 ceph-mon[28057]: pgmap v8: 65 pgs: 65 active+clean; 2.9 GiB data, 8.4 GiB used, 528 GiB / 536 GiB avail; 44 MiB/s rd, 134 MiB/s wr, 272 op/s 2024-09-21T12:20:44.080 INFO:tasks.workunit.client.0.smithi003.stdout:3/594: getdents d0/d5/d38/d55 0 2024-09-21T12:20:44.080 INFO:tasks.workunit.client.0.smithi003.stdout:4/430: dread d9/da/d36/f50 [4194304,4194304] 0 2024-09-21T12:20:44.081 INFO:tasks.workunit.client.0.smithi003.stdout:5/612: fsync dc/d15/d21/f64 0 2024-09-21T12:20:44.083 INFO:tasks.workunit.client.0.smithi003.stdout:2/479: symlink d0/dd/d22/lae 0 2024-09-21T12:20:44.083 INFO:tasks.workunit.client.0.smithi003.stdout:4/431: chown d9/d16/d65/f8e 425865285 1 2024-09-21T12:20:44.086 INFO:tasks.workunit.client.0.smithi003.stdout:3/595: rmdir d0/d5/da/d28/d11/d49/d4c/d54 39 2024-09-21T12:20:44.091 INFO:tasks.workunit.client.0.smithi003.stdout:5/613: unlink dc/d15/d21/d28/d41/d5b/d74/d7f/c9e 0 2024-09-21T12:20:44.096 INFO:tasks.workunit.client.0.smithi003.stdout:3/596: unlink d0/l80 0 2024-09-21T12:20:44.101 INFO:tasks.workunit.client.0.smithi003.stdout:9/589: write d2/da/d2a/d3c/da2/fd3 [550225,44504] 0 2024-09-21T12:20:44.106 INFO:tasks.workunit.client.0.smithi003.stdout:3/597: truncate d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/d77/f9d 626804 0 2024-09-21T12:20:44.107 INFO:tasks.workunit.client.0.smithi003.stdout:9/590: creat d2/da/d35/d76/fdf x:0 0 0 2024-09-21T12:20:44.107 INFO:tasks.workunit.client.0.smithi003.stdout:3/598: readlink d0/d5/da/l25 0 2024-09-21T12:20:44.108 INFO:tasks.workunit.client.0.smithi003.stdout:6/617: dwrite d4/f5 [0,4194304] 0 2024-09-21T12:20:44.109 INFO:tasks.workunit.client.0.smithi003.stdout:9/591: creat d2/d53/fe0 x:0 0 0 2024-09-21T12:20:44.110 INFO:tasks.workunit.client.0.smithi003.stdout:9/592: chown d2/f86 20 1 2024-09-21T12:20:44.111 INFO:tasks.workunit.client.0.smithi003.stdout:3/599: read d0/d5/d38/d55/fa4 [305787,37678] 0 2024-09-21T12:20:44.114 INFO:tasks.workunit.client.0.smithi003.stdout:6/618: creat d4/d13/d56/fd6 x:0 0 0 2024-09-21T12:20:44.115 INFO:tasks.workunit.client.0.smithi003.stdout:6/619: chown d4/d13/d19/d23/l75 29057 1 2024-09-21T12:20:44.116 INFO:tasks.workunit.client.0.smithi003.stdout:9/593: creat d2/da/d17/d40/fe1 x:0 0 0 2024-09-21T12:20:44.117 INFO:tasks.workunit.client.0.smithi003.stdout:9/594: chown d2/d20/d22/d5e/d87 0 1 2024-09-21T12:20:44.119 INFO:tasks.workunit.client.0.smithi003.stdout:3/600: mknod d0/d5/da/d28/d31/cc8 0 2024-09-21T12:20:44.121 INFO:tasks.workunit.client.0.smithi003.stdout:3/601: read - d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/f6a zero size 2024-09-21T12:20:44.124 INFO:tasks.workunit.client.0.smithi003.stdout:2/480: write d0/dd/f29 [3029005,4642] 0 2024-09-21T12:20:44.129 INFO:tasks.workunit.client.0.smithi003.stdout:3/602: mknod d0/d5/da/d28/d11/d49/d4c/d6f/cc9 0 2024-09-21T12:20:44.130 INFO:tasks.workunit.client.0.smithi003.stdout:5/614: write dc/d2b/f44 [869174,68624] 0 2024-09-21T12:20:44.131 INFO:tasks.workunit.client.0.smithi003.stdout:4/432: dwrite d9/f24 [4194304,4194304] 0 2024-09-21T12:20:44.132 INFO:tasks.workunit.client.0.smithi003.stdout:9/595: dwrite d2/d20/f39 [0,4194304] 0 2024-09-21T12:20:44.132 INFO:tasks.workunit.client.0.smithi003.stdout:3/603: write d0/d5/fab [216271,114294] 0 2024-09-21T12:20:44.133 INFO:tasks.workunit.client.0.smithi003.stdout:2/481: rename d0/d1c/d6a/l40 to d0/dd/d22/d68/laf 0 2024-09-21T12:20:44.136 INFO:tasks.workunit.client.0.smithi003.stdout:5/615: chown dc/d15/la1 23 1 2024-09-21T12:20:44.138 INFO:tasks.workunit.client.0.smithi003.stdout:5/616: write dc/d15/f9a [624972,59094] 0 2024-09-21T12:20:44.141 INFO:tasks.workunit.client.0.smithi003.stdout:3/604: creat d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/fca x:0 0 0 2024-09-21T12:20:44.143 INFO:tasks.workunit.client.0.smithi003.stdout:2/482: dwrite d0/d1c/f34 [0,4194304] 0 2024-09-21T12:20:44.144 INFO:tasks.workunit.client.0.smithi003.stdout:5/617: symlink dc/d15/d21/d28/d41/d5b/dab/lc1 0 2024-09-21T12:20:44.146 INFO:tasks.workunit.client.0.smithi003.stdout:3/605: fdatasync d0/d5/da/d28/dd/f72 0 2024-09-21T12:20:44.149 INFO:tasks.workunit.client.0.smithi003.stdout:2/483: creat d0/d21/d2c/d63/fb0 x:0 0 0 2024-09-21T12:20:44.151 INFO:tasks.workunit.client.0.smithi003.stdout:5/618: mknod dc/d2b/d4e/cc2 0 2024-09-21T12:20:44.151 INFO:tasks.workunit.client.0.smithi003.stdout:2/484: stat d0/d1c/la9 0 2024-09-21T12:20:44.153 INFO:tasks.workunit.client.0.smithi003.stdout:5/619: write dc/d15/d21/d28/d3c/f91 [4814334,7962] 0 2024-09-21T12:20:44.153 INFO:tasks.workunit.client.0.smithi003.stdout:6/620: dwrite d4/d11/d1d/f43 [0,4194304] 0 2024-09-21T12:20:44.156 INFO:tasks.workunit.client.0.smithi003.stdout:3/606: mknod d0/d5/da/d28/ccb 0 2024-09-21T12:20:44.159 INFO:tasks.workunit.client.0.smithi003.stdout:6/621: symlink d4/d13/ld7 0 2024-09-21T12:20:44.164 INFO:tasks.workunit.client.0.smithi003.stdout:6/622: creat d4/d13/d19/d38/da3/fd8 x:0 0 0 2024-09-21T12:20:44.166 INFO:tasks.workunit.client.0.smithi003.stdout:4/433: dwrite d9/f3a [0,4194304] 0 2024-09-21T12:20:44.166 INFO:tasks.workunit.client.0.smithi003.stdout:5/620: dread dc/d15/d21/d28/d41/d5b/d74/d7f/d82/fa4 [0,4194304] 0 2024-09-21T12:20:44.171 INFO:tasks.workunit.client.0.smithi003.stdout:5/621: creat dc/fc3 x:0 0 0 2024-09-21T12:20:44.172 INFO:tasks.workunit.client.0.smithi003.stdout:6/623: rename d4/d13/d56/lc5 to d4/d13/d19/d38/ld9 0 2024-09-21T12:20:44.173 INFO:tasks.workunit.client.0.smithi003.stdout:3/607: dwrite d0/d5/da/d28/d11/d49/d4c/d54/d5e/d48/f8f [0,4194304] 0 2024-09-21T12:20:44.173 INFO:tasks.workunit.client.0.smithi003.stdout:6/624: chown d4/d9/fd 7093132 1 2024-09-21T12:20:44.175 INFO:tasks.workunit.client.0.smithi003.stdout:4/434: read d9/da/f31 [2427241,93268] 0 2024-09-21T12:20:44.176 INFO:tasks.workunit.client.0.smithi003.stdout:4/435: chown d9/da/d47/d82 878 1 2024-09-21T12:20:44.176 INFO:tasks.workunit.client.0.smithi003.stdout:6/625: write d4/d9/fd [6880463,3522] 0 2024-09-21T12:20:44.179 INFO:tasks.workunit.client.0.smithi003.stdout:3/608: creat d0/d5/da/d28/d11/d49/d4c/fcc x:0 0 0 2024-09-21T12:20:44.181 INFO:tasks.workunit.client.0.smithi003.stdout:5/622: dwrite dc/d15/d21/d28/d3c/fb4 [0,4194304] 0 2024-09-21T12:20:44.181 INFO:tasks.workunit.client.0.smithi003.stdout:3/609: chown d0/d5/d38/l4b 34 1 2024-09-21T12:20:44.187 INFO:tasks.workunit.client.0.smithi003.stdout:4/436: rename d9/d48/l61 to d9/d16/d65/l93 0 2024-09-21T12:20:44.187 INFO:tasks.workunit.client.0.smithi003.stdout:5/623: symlink dc/d15/d21/d28/d3c/d73/lc4 0 2024-09-21T12:20:44.188 INFO:tasks.workunit.client.0.smithi003.stdout:6/626: getdents d4/d11/dc1/d58 0 2024-09-21T12:20:44.189 INFO:tasks.workunit.client.0.smithi003.stdout:3/610: write d0/d5/da/d28/d11/d49/d4c/f66 [1162608,82425] 0 2024-09-21T12:20:44.189 INFO:tasks.workunit.client.0.smithi003.stdout:4/437: mknod d9/d25/c94 0 2024-09-21T12:20:44.190 INFO:tasks.workunit.client.0.smithi003.stdout:4/438: readlink d9/d25/l2b 0 2024-09-21T12:20:44.190 INFO:tasks.workunit.client.0.smithi003.stdout:6/627: dread - d4/d11/d1d/fce zero size 2024-09-21T12:20:44.191 INFO:tasks.workunit.client.0.smithi003.stdout:4/439: chown d9/da/d36/l40 35218 1 2024-09-21T12:20:44.192 INFO:tasks.workunit.client.0.smithi003.stdout:4/440: fdatasync f6 0 2024-09-21T12:20:44.193 INFO:tasks.workunit.client.0.smithi003.stdout:3/611: creat d0/d5/da/d28/d31/d6b/fcd x:0 0 0 2024-09-21T12:20:44.193 INFO:tasks.workunit.client.0.smithi003.stdout:4/441: chown d9/l62 721 1 2024-09-21T12:20:44.194 INFO:tasks.workunit.client.0.smithi003.stdout:5/624: dread dc/d15/d21/d28/d41/da0/d35/f78 [0,4194304] 0 2024-09-21T12:20:44.194 INFO:tasks.workunit.client.0.smithi003.stdout:6/628: mknod d4/d13/d5b/cda 0 2024-09-21T12:20:44.195 INFO:tasks.workunit.client.0.smithi003.stdout:3/612: write d0/d5/da/d28/f33 [1145303,81782] 0 2024-09-21T12:20:44.197 INFO:tasks.workunit.client.0.smithi003.stdout:3/613: chown d0/d5/da/d28/d31/f7b 57726368 1 2024-09-21T12:20:44.198 INFO:tasks.workunit.client.0.smithi003.stdout:6/629: dread - d4/d11/d32/f5f zero size 2024-09-21T12:20:44.199 INFO:tasks.workunit.client.0.smithi003.stdout:4/442: creat d9/da/d66/f95 x:0 0 0 2024-09-21T12:20:44.202 INFO:tasks.workunit.client.0.smithi003.stdout:5/625: creat dc/d15/d1c/fc5 x:0 0 0 2024-09-21T12:20:44.203 INFO:tasks.workunit.client.0.smithi003.stdout:4/443: mknod d9/da/d36/d55/c96 0 2024-09-21T12:20:44.204 INFO:tasks.workunit.client.0.smithi003.stdout:3/614: creat d0/d5/d38/db8/fce x:0 0 0 2024-09-21T12:20:44.205 INFO:tasks.workunit.client.0.smithi003.stdout:6/630: truncate d4/d13/d19/d62/f67 120239 0 2024-09-21T12:20:44.206 INFO:tasks.workunit.client.0.smithi003.stdout:4/444: mkdir d9/d16/d65/d97 0 2024-09-21T12:20:44.207 INFO:tasks.workunit.client.0.smithi003.stdout:6/631: fsync d4/d13/d19/d23/f4d 0 2024-09-21T12:20:44.208 INFO:tasks.workunit.client.0.smithi003.stdout:3/615: fsync d0/d5/da/d28/d11/d49/f73 0 2024-09-21T12:20:44.210 INFO:tasks.workunit.client.0.smithi003.stdout:6/632: chown d4/d11/dc1/d98 3 1 2024-09-21T12:20:44.210 INFO:tasks.workunit.client.0.smithi003.stdout:5/626: dwrite dc/d15/d26/fbd [0,4194304] 0 2024-09-21T12:20:44.210 INFO:tasks.workunit.client.0.smithi003.stdout:4/445: symlink d9/da/d36/d8c/l98 0 2024-09-21T12:20:44.211 INFO:tasks.workunit.client.0.smithi003.stdout:6/633: fsync d4/d13/d56/fd2 0 2024-09-21T12:20:44.213 INFO:tasks.workunit.client.0.smithi003.stdout:4/446: symlink d9/da/d36/l99 0 2024-09-21T12:20:44.214 INFO:tasks.workunit.client.0.smithi003.stdout:4/447: write d9/d16/f2e [4332575,28127] 0 2024-09-21T12:20:44.215 INFO:tasks.workunit.client.0.smithi003.stdout:6/634: rename d4/d13/d22/f6f to d4/d11/d32/fdb 0 2024-09-21T12:20:44.217 INFO:tasks.workunit.client.0.smithi003.stdout:4/448: read d9/da/d47/f7b [655930,103220] 0 2024-09-21T12:20:44.217 INFO:tasks.workunit.client.0.smithi003.stdout:3/616: truncate d0/d5/d38/d55/f65 3160515 0 2024-09-21T12:20:44.222 INFO:tasks.workunit.client.0.smithi003.stdout:6/635: link d4/d13/d19/f49 d4/d11/fdc 0 2024-09-21T12:20:44.226 INFO:tasks.workunit.client.0.smithi003.stdout:3/617: write d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/d77/f84 [5059776,78258] 0 2024-09-21T12:20:44.228 INFO:tasks.workunit.client.0.smithi003.stdout:4/449: dwrite d9/d16/d65/f8e [0,4194304] 0 2024-09-21T12:20:44.229 INFO:tasks.workunit.client.0.smithi003.stdout:5/627: dread dc/d15/d1c/f23 [0,4194304] 0 2024-09-21T12:20:44.230 INFO:tasks.workunit.client.0.smithi003.stdout:3/618: mknod d0/d5/d38/d55/ccf 0 2024-09-21T12:20:44.232 INFO:tasks.workunit.client.0.smithi003.stdout:6/636: dread d4/f21 [0,4194304] 0 2024-09-21T12:20:44.235 INFO:tasks.workunit.client.0.smithi003.stdout:4/450: getdents d9/d16/d65/d73 0 2024-09-21T12:20:44.235 INFO:tasks.workunit.client.0.smithi003.stdout:3/619: fsync d0/d5/da/d28/d11/d49/d4c/d54/fb6 0 2024-09-21T12:20:44.236 INFO:tasks.workunit.client.0.smithi003.stdout:4/451: write d9/f24 [7916888,52834] 0 2024-09-21T12:20:44.236 INFO:tasks.workunit.client.0.smithi003.stdout:6/637: unlink d4/d11/d1d/d36/fbe 0 2024-09-21T12:20:44.237 INFO:tasks.workunit.client.0.smithi003.stdout:6/638: chown d4/d13/d22 18852117 1 2024-09-21T12:20:44.238 INFO:tasks.workunit.client.0.smithi003.stdout:4/452: write d9/d25/f39 [4786389,85672] 0 2024-09-21T12:20:44.240 INFO:tasks.workunit.client.0.smithi003.stdout:4/453: rmdir d9/d25 39 2024-09-21T12:20:44.241 INFO:tasks.workunit.client.0.smithi003.stdout:3/620: rename d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/f35 to d0/d5/da/d28/dd/d9f/fd0 0 2024-09-21T12:20:44.244 INFO:tasks.workunit.client.0.smithi003.stdout:6/639: dwrite d4/d13/d19/d23/f4d [4194304,4194304] 0 2024-09-21T12:20:44.246 INFO:tasks.workunit.client.0.smithi003.stdout:4/454: dread d9/da/d47/f7b [0,4194304] 0 2024-09-21T12:20:44.248 INFO:tasks.workunit.client.0.smithi003.stdout:3/621: truncate d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/d77/f9d 947705 0 2024-09-21T12:20:44.250 INFO:tasks.workunit.client.0.smithi003.stdout:6/640: unlink d4/d13/l14 0 2024-09-21T12:20:44.251 INFO:tasks.workunit.client.0.smithi003.stdout:4/455: creat d9/d16/d65/d73/f9a x:0 0 0 2024-09-21T12:20:44.251 INFO:tasks.workunit.client.0.smithi003.stdout:6/641: write d4/d13/d22/dc3/fd3 [646940,17506] 0 2024-09-21T12:20:44.252 INFO:tasks.workunit.client.0.smithi003.stdout:3/622: dread - d0/f1f zero size 2024-09-21T12:20:44.252 INFO:tasks.workunit.client.0.smithi003.stdout:6/642: dread - d4/d11/dc1/f90 zero size 2024-09-21T12:20:44.252 INFO:tasks.workunit.client.0.smithi003.stdout:4/456: chown d9/d16/f78 49 1 2024-09-21T12:20:44.253 INFO:tasks.workunit.client.0.smithi003.stdout:4/457: dread - d9/da/d47/f5c zero size 2024-09-21T12:20:44.275 INFO:tasks.workunit.client.0.smithi003.stdout:6/643: dread d4/d13/d22/dc3/fd3 [0,4194304] 0 2024-09-21T12:20:44.282 INFO:tasks.workunit.client.0.smithi003.stdout:6/644: mknod d4/d13/d19/cdd 0 2024-09-21T12:20:44.290 INFO:tasks.workunit.client.0.smithi003.stdout:6/645: link d4/d13/d5b/l78 d4/d13/d19/d62/lde 0 2024-09-21T12:20:44.294 INFO:tasks.workunit.client.0.smithi003.stdout:5/628: getdents dc/d15/d1c 0 2024-09-21T12:20:44.297 INFO:tasks.workunit.client.0.smithi003.stdout:6/646: dwrite d4/d9/d59/f77 [0,4194304] 0 2024-09-21T12:20:44.306 INFO:tasks.workunit.client.0.smithi003.stdout:6/647: creat d4/d11/fdf x:0 0 0 2024-09-21T12:20:44.312 INFO:tasks.workunit.client.0.smithi003.stdout:6/648: dwrite d4/d13/f2c [0,4194304] 0 2024-09-21T12:20:44.312 INFO:tasks.workunit.client.0.smithi003.stdout:6/649: readlink d4/d11/dc1/la6 0 2024-09-21T12:20:44.317 INFO:tasks.workunit.client.0.smithi003.stdout:6/650: fdatasync d4/d9/f45 0 2024-09-21T12:20:44.318 INFO:tasks.workunit.client.0.smithi003.stdout:6/651: fsync d4/d11/d1d/d36/f85 0 2024-09-21T12:20:44.320 INFO:tasks.workunit.client.0.smithi003.stdout:4/458: write d9/da/d47/f4c [978127,24491] 0 2024-09-21T12:20:44.325 INFO:tasks.workunit.client.0.smithi003.stdout:4/459: write d9/d25/f39 [2412916,48455] 0 2024-09-21T12:20:44.329 INFO:tasks.workunit.client.0.smithi003.stdout:4/460: creat d9/da/d47/f9b x:0 0 0 2024-09-21T12:20:44.331 INFO:tasks.workunit.client.0.smithi003.stdout:4/461: fdatasync d9/d48/f89 0 2024-09-21T12:20:44.334 INFO:tasks.workunit.client.0.smithi003.stdout:5/629: truncate dc/d15/d1c/f58 1804101 0 2024-09-21T12:20:44.336 INFO:tasks.workunit.client.0.smithi003.stdout:4/462: creat d9/d48/f9c x:0 0 0 2024-09-21T12:20:44.341 INFO:tasks.workunit.client.0.smithi003.stdout:4/463: creat d9/d16/d65/d97/f9d x:0 0 0 2024-09-21T12:20:44.347 INFO:tasks.workunit.client.0.smithi003.stdout:4/464: dwrite d9/da/f12 [4194304,4194304] 0 2024-09-21T12:20:44.349 INFO:tasks.workunit.client.0.smithi003.stdout:5/630: truncate dc/d15/d21/d28/d41/d5b/fa5 89136 0 2024-09-21T12:20:44.351 INFO:tasks.workunit.client.0.smithi003.stdout:5/631: dread - dc/d15/d26/f84 zero size 2024-09-21T12:20:44.371 INFO:tasks.workunit.client.0.smithi003.stdout:5/632: dwrite dc/d15/d26/f2e [0,4194304] 0 2024-09-21T12:20:44.373 INFO:tasks.workunit.client.0.smithi003.stdout:5/633: write dc/d15/d21/d28/f6a [190118,30311] 0 2024-09-21T12:20:44.380 INFO:tasks.workunit.client.0.smithi003.stdout:5/634: dread dc/d15/d1c/f58 [0,4194304] 0 2024-09-21T12:20:44.382 INFO:tasks.workunit.client.0.smithi003.stdout:5/635: mknod dc/d15/d21/d28/d3c/d73/cc6 0 2024-09-21T12:20:44.383 INFO:tasks.workunit.client.0.smithi003.stdout:5/636: chown dc/d15/d1c/f4c 46829332 1 2024-09-21T12:20:44.384 INFO:tasks.workunit.client.0.smithi003.stdout:5/637: readlink dc/d15/d21/d28/d41/da0/l7e 0 2024-09-21T12:20:44.385 INFO:tasks.workunit.client.0.smithi003.stdout:5/638: chown dc/f8c 112 1 2024-09-21T12:20:44.385 INFO:tasks.workunit.client.0.smithi003.stdout:5/639: fdatasync dc/f1a 0 2024-09-21T12:20:44.386 INFO:tasks.workunit.client.0.smithi003.stdout:5/640: readlink dc/d15/d21/d28/d41/da0/l4f 0 2024-09-21T12:20:44.390 INFO:tasks.workunit.client.0.smithi003.stdout:5/641: symlink dc/d15/d21/d28/d41/da0/lc7 0 2024-09-21T12:20:44.390 INFO:tasks.workunit.client.0.smithi003.stdout:5/642: dread - dc/fc3 zero size 2024-09-21T12:20:44.391 INFO:tasks.workunit.client.0.smithi003.stdout:5/643: readlink dc/d15/d21/d28/d41/da0/l7e 0 2024-09-21T12:20:44.392 INFO:tasks.workunit.client.0.smithi003.stdout:5/644: readlink dc/d15/d21/d28/d41/d5b/d74/d7f/d82/l8b 0 2024-09-21T12:20:44.393 INFO:tasks.workunit.client.0.smithi003.stdout:5/645: stat dc/d15/d21/fa9 0 2024-09-21T12:20:44.395 INFO:tasks.workunit.client.0.smithi003.stdout:5/646: rmdir dc/d15/d21/d28/d41/d5b/d74/d7f 39 2024-09-21T12:20:44.397 INFO:tasks.workunit.client.0.smithi003.stdout:5/647: rename dc/f8c to dc/d15/d21/d28/d3c/fc8 0 2024-09-21T12:20:44.398 INFO:tasks.workunit.client.0.smithi003.stdout:5/648: fdatasync dc/d15/d21/d28/d41/f8a 0 2024-09-21T12:20:44.402 INFO:tasks.workunit.client.0.smithi003.stdout:5/649: rename dc/d15/d21/d28/fa8 to dc/d15/d21/d28/d41/da0/d4b/fc9 0 2024-09-21T12:20:44.403 INFO:tasks.workunit.client.0.smithi003.stdout:5/650: chown dc/d15/d21/d28/d41/d5b/fbe 14953446 1 2024-09-21T12:20:44.405 INFO:tasks.workunit.client.0.smithi003.stdout:5/651: dread dc/d15/d1c/f58 [0,4194304] 0 2024-09-21T12:20:44.407 INFO:tasks.workunit.client.0.smithi003.stdout:5/652: rename cb to dc/d15/d21/d28/d3c/d73/cca 0 2024-09-21T12:20:44.409 INFO:tasks.workunit.client.0.smithi003.stdout:5/653: creat dc/d2b/fcb x:0 0 0 2024-09-21T12:20:44.410 INFO:tasks.workunit.client.0.smithi003.stdout:5/654: fsync dc/d15/d21/fa9 0 2024-09-21T12:20:44.413 INFO:tasks.workunit.client.0.smithi003.stdout:5/655: symlink dc/d2b/d4e/lcc 0 2024-09-21T12:20:44.413 INFO:tasks.workunit.client.0.smithi003.stdout:5/656: dread - dc/d15/d21/fa9 zero size 2024-09-21T12:20:44.414 INFO:tasks.workunit.client.0.smithi003.stdout:5/657: readlink dc/d15/d21/d28/lba 0 2024-09-21T12:20:44.415 INFO:tasks.workunit.client.0.smithi003.stdout:5/658: write dc/d15/d21/d28/d41/f8a [4660291,59918] 0 2024-09-21T12:20:44.418 INFO:tasks.workunit.client.0.smithi003.stdout:5/659: creat dc/d15/d21/d28/d41/d5b/fcd x:0 0 0 2024-09-21T12:20:44.427 INFO:tasks.workunit.client.0.smithi003.stdout:5/660: dread dc/d2b/d4e/f53 [0,4194304] 0 2024-09-21T12:20:44.441 INFO:tasks.workunit.client.0.smithi003.stdout:5/661: dread dc/f1a [0,4194304] 0 2024-09-21T12:20:44.442 INFO:tasks.workunit.client.0.smithi003.stdout:5/662: chown dc/d15/d21/l56 1651901177 1 2024-09-21T12:20:44.446 INFO:tasks.workunit.client.0.smithi003.stdout:5/663: rename dc/d15/d26/f2e to dc/d15/d21/fce 0 2024-09-21T12:20:44.448 INFO:tasks.workunit.client.0.smithi003.stdout:5/664: creat dc/fcf x:0 0 0 2024-09-21T12:20:44.451 INFO:tasks.workunit.client.0.smithi003.stdout:5/665: getdents dc/d15/d21/d28/d41/d9f 0 2024-09-21T12:20:44.470 INFO:tasks.workunit.client.0.smithi003.stdout:5/666: write dc/d15/d21/d28/d41/da0/f33 [1082745,77830] 0 2024-09-21T12:20:44.471 INFO:tasks.workunit.client.0.smithi003.stdout:5/667: chown dc/d15/d21/d28/d41/d5b/fc0 2 1 2024-09-21T12:20:44.476 INFO:tasks.workunit.client.0.smithi003.stdout:5/668: stat dc/d15/d21/d28/c32 0 2024-09-21T12:20:44.477 INFO:tasks.workunit.client.0.smithi003.stdout:5/669: write dc/d15/d21/d28/d41/da0/f33 [1365132,87063] 0 2024-09-21T12:20:44.481 INFO:tasks.workunit.client.0.smithi003.stdout:5/670: dread dc/d15/d1c/f29 [4194304,4194304] 0 2024-09-21T12:20:44.490 INFO:tasks.workunit.client.0.smithi003.stdout:5/671: truncate dc/d15/f1f 643438 0 2024-09-21T12:20:44.497 INFO:tasks.workunit.client.0.smithi003.stdout:5/672: creat dc/d15/d21/fd0 x:0 0 0 2024-09-21T12:20:44.502 INFO:tasks.workunit.client.0.smithi003.stdout:5/673: creat dc/d15/d21/d28/d41/fd1 x:0 0 0 2024-09-21T12:20:44.502 INFO:tasks.workunit.client.0.smithi003.stdout:5/674: chown dc/d15 4920629 1 2024-09-21T12:20:44.504 INFO:tasks.workunit.client.0.smithi003.stdout:5/675: rmdir dc/d2b 39 2024-09-21T12:20:44.508 INFO:tasks.workunit.client.0.smithi003.stdout:5/676: dread dc/d15/d21/d28/d3c/fb4 [0,4194304] 0 2024-09-21T12:20:44.522 INFO:tasks.workunit.client.0.smithi003.stdout:5/677: dread dc/d15/d21/d28/d3c/d73/f96 [0,4194304] 0 2024-09-21T12:20:44.524 INFO:tasks.workunit.client.0.smithi003.stdout:5/678: mknod dc/d15/d21/d28/d41/da0/d90/cd2 0 2024-09-21T12:20:44.525 INFO:tasks.workunit.client.0.smithi003.stdout:5/679: write dc/d2b/d4e/f70 [1050045,28754] 0 2024-09-21T12:20:44.532 INFO:tasks.workunit.client.0.smithi003.stdout:5/680: getdents dc/d15 0 2024-09-21T12:20:44.537 INFO:tasks.workunit.client.0.smithi003.stdout:5/681: truncate dc/d15/d26/fb8 381228 0 2024-09-21T12:20:44.539 INFO:tasks.workunit.client.0.smithi003.stdout:5/682: symlink dc/d2b/ld3 0 2024-09-21T12:20:44.540 INFO:tasks.workunit.client.0.smithi003.stdout:5/683: read dc/d15/d1c/f23 [367424,124506] 0 2024-09-21T12:20:44.542 INFO:tasks.workunit.client.0.smithi003.stdout:5/684: creat dc/d2b/fd4 x:0 0 0 2024-09-21T12:20:44.545 INFO:tasks.workunit.client.0.smithi003.stdout:5/685: fdatasync dc/d15/d26/f84 0 2024-09-21T12:20:44.551 INFO:tasks.workunit.client.0.smithi003.stdout:5/686: dread dc/d15/d21/d28/d41/d5b/fa5 [0,4194304] 0 2024-09-21T12:20:44.552 INFO:tasks.workunit.client.0.smithi003.stdout:5/687: write dc/d15/d26/fbd [3546926,67086] 0 2024-09-21T12:20:44.559 INFO:tasks.workunit.client.0.smithi003.stdout:5/688: creat dc/d15/d21/fd5 x:0 0 0 2024-09-21T12:20:44.560 INFO:tasks.workunit.client.0.smithi003.stdout:5/689: write dc/d15/d21/fd5 [501175,16540] 0 2024-09-21T12:20:44.564 INFO:tasks.workunit.client.0.smithi003.stdout:5/690: creat dc/d15/d21/d28/d41/d5b/d74/d7f/d82/fd6 x:0 0 0 2024-09-21T12:20:44.568 INFO:tasks.workunit.client.0.smithi003.stdout:5/691: getdents dc/d15/d21/d28/d41/da0/d4b/d5c 0 2024-09-21T12:20:44.569 INFO:tasks.workunit.client.0.smithi003.stdout:5/692: chown dc/d15/d21/d28/d3c/c75 1425 1 2024-09-21T12:20:44.569 INFO:tasks.workunit.client.0.smithi003.stdout:5/693: chown dc/d2b/fd4 184359 1 2024-09-21T12:20:44.570 INFO:tasks.workunit.client.0.smithi003.stdout:5/694: fdatasync dc/d2b/d4e/f70 0 2024-09-21T12:20:44.578 INFO:tasks.workunit.client.0.smithi003.stdout:5/695: rename dc/d15/d21/d28 to dc/dd7 0 2024-09-21T12:20:44.579 INFO:tasks.workunit.client.0.smithi003.stdout:5/696: write dc/d2b/fcb [744108,18550] 0 2024-09-21T12:20:44.585 INFO:tasks.workunit.client.0.smithi003.stdout:5/697: dwrite dc/dd7/d41/d5b/d74/d7f/d82/f92 [0,4194304] 0 2024-09-21T12:20:44.589 INFO:tasks.workunit.client.0.smithi003.stdout:5/698: getdents dc/d15/d26 0 2024-09-21T12:20:44.678 INFO:tasks.workunit.client.0.smithi003.stdout:5/699: dwrite dc/dd7/d41/da0/d4b/d5c/f99 [0,4194304] 0 2024-09-21T12:20:44.691 INFO:tasks.workunit.client.0.smithi003.stdout:5/700: dread dc/dd7/d41/da0/d4b/fc9 [0,4194304] 0 2024-09-21T12:20:44.692 INFO:tasks.workunit.client.0.smithi003.stdout:5/701: fdatasync dc/dd7/d41/d5b/fcd 0 2024-09-21T12:20:44.694 INFO:tasks.workunit.client.0.smithi003.stdout:5/702: unlink dc/d15/d21/l56 0 2024-09-21T12:20:44.701 INFO:tasks.workunit.client.0.smithi003.stdout:5/703: dwrite dc/d15/d1c/f29 [4194304,4194304] 0 2024-09-21T12:20:44.706 INFO:tasks.workunit.client.0.smithi003.stdout:5/704: getdents dc/d2b 0 2024-09-21T12:20:44.707 INFO:tasks.workunit.client.0.smithi003.stdout:5/705: mknod dc/d15/cd8 0 2024-09-21T12:20:44.711 INFO:tasks.workunit.client.0.smithi003.stdout:5/706: mknod dc/d2b/cd9 0 2024-09-21T12:20:44.729 INFO:tasks.workunit.client.0.smithi003.stdout:5/707: dwrite dc/d15/d1c/f5f [0,4194304] 0 2024-09-21T12:20:44.735 INFO:tasks.workunit.client.0.smithi003.stdout:1/557: sync 2024-09-21T12:20:44.869 INFO:tasks.workunit.client.0.smithi003.stdout:1/558: dwrite d4/dc/f16 [0,4194304] 0 2024-09-21T12:20:44.871 INFO:tasks.workunit.client.0.smithi003.stdout:1/559: truncate d4/df/d19/f6f 4440642 0 2024-09-21T12:20:44.873 INFO:tasks.workunit.client.0.smithi003.stdout:1/560: mknod d4/dc/d80/cc4 0 2024-09-21T12:20:44.875 INFO:tasks.workunit.client.0.smithi003.stdout:1/561: mknod d4/d11/d14/d25/d59/d65/cc5 0 2024-09-21T12:20:44.878 INFO:tasks.workunit.client.0.smithi003.stdout:1/562: creat d4/d11/d49/fc6 x:0 0 0 2024-09-21T12:20:44.887 INFO:tasks.workunit.client.0.smithi003.stdout:1/563: rename d4/d11/d14/d25/d59/d65 to d4/d66/dc7 0 2024-09-21T12:20:44.888 INFO:tasks.workunit.client.0.smithi003.stdout:1/564: fdatasync d4/d11/d14/d25/d59/f82 0 2024-09-21T12:20:44.888 INFO:tasks.workunit.client.0.smithi003.stdout:1/565: stat d4/df/fa5 0 2024-09-21T12:20:44.960 INFO:tasks.workunit.client.0.smithi003.stdout:0/679: sync 2024-09-21T12:20:44.991 INFO:tasks.workunit.client.0.smithi003.stdout:0/680: rename d9/d12/d17/f19 to d9/d12/d17/d38/d3a/d46/d55/d67/d2d/ff5 0 2024-09-21T12:20:44.995 INFO:tasks.workunit.client.0.smithi003.stdout:0/681: mknod d9/d12/d17/d38/d3a/d46/d55/d7b/da0/cf6 0 2024-09-21T12:20:44.999 INFO:tasks.workunit.client.0.smithi003.stdout:0/682: symlink d9/d12/d17/d38/d3a/d46/d55/db0/lf7 0 2024-09-21T12:20:45.012 INFO:tasks.workunit.client.0.smithi003.stdout:0/683: dread d9/d6c/d26/d54/f6f [0,4194304] 0 2024-09-21T12:20:45.024 INFO:tasks.workunit.client.0.smithi003.stdout:0/684: dwrite d9/d12/d17/d38/d3a/d46/d55/d67/d2d/f65 [0,4194304] 0 2024-09-21T12:20:45.038 INFO:tasks.workunit.client.0.smithi003.stdout:0/685: dread - d9/d12/d17/d38/d3a/d46/d55/d67/f85 zero size 2024-09-21T12:20:45.045 INFO:tasks.workunit.client.0.smithi003.stdout:0/686: dwrite d9/d12/d17/d21/d30/ff2 [0,4194304] 0 2024-09-21T12:20:45.047 INFO:tasks.workunit.client.0.smithi003.stdout:0/687: write d9/d12/d17/f93 [3863073,106934] 0 2024-09-21T12:20:45.052 INFO:tasks.workunit.client.0.smithi003.stdout:0/688: mkdir d9/d6c/d26/d54/df8 0 2024-09-21T12:20:45.056 INFO:tasks.workunit.client.0.smithi003.stdout:0/689: readlink d9/d6c/d26/d54/d7e/dde/lf3 0 2024-09-21T12:20:45.057 INFO:tasks.workunit.client.0.smithi003.stdout:0/690: chown d9/d12/d17/d38/d3a/d46/d55/d67/le6 14168105 1 2024-09-21T12:20:45.062 INFO:tasks.workunit.client.0.smithi003.stdout:0/691: creat d9/d12/d17/d21/d30/ff9 x:0 0 0 2024-09-21T12:20:45.062 INFO:tasks.workunit.client.0.smithi003.stdout:8/495: sync 2024-09-21T12:20:45.063 INFO:tasks.workunit.client.0.smithi003.stdout:8/496: stat d7/de/d52/f9e 0 2024-09-21T12:20:45.072 INFO:tasks.workunit.client.0.smithi003.stdout:8/497: dwrite d7/de/d1a/f68 [0,4194304] 0 2024-09-21T12:20:45.082 INFO:tasks.workunit.client.0.smithi003.stdout:8/498: dwrite d7/df/d20/d21/d4c/d4d/f92 [0,4194304] 0 2024-09-21T12:20:45.086 INFO:tasks.workunit.client.0.smithi003.stdout:0/692: dread d9/d12/d17/d38/d3a/d46/d55/db0/fb2 [0,4194304] 0 2024-09-21T12:20:45.099 INFO:tasks.workunit.client.0.smithi003.stdout:8/499: link d7/df/d20/d24/d47/d79/l4e d7/df/d20/d21/d4c/d4d/d8c/lb6 0 2024-09-21T12:20:45.102 INFO:tasks.workunit.client.0.smithi003.stdout:8/500: rename d7/df/d20/d54/fa0 to d7/de/d52/fb7 0 2024-09-21T12:20:45.105 INFO:tasks.workunit.client.0.smithi003.stdout:8/501: symlink d7/d57/d77/lb8 0 2024-09-21T12:20:45.113 INFO:tasks.workunit.client.0.smithi003.stdout:8/502: dwrite d7/df/d20/fb4 [0,4194304] 0 2024-09-21T12:20:45.115 INFO:tasks.workunit.client.0.smithi003.stdout:8/503: readlink d7/de/d1a/l76 0 2024-09-21T12:20:45.124 INFO:tasks.workunit.client.0.smithi003.stdout:8/504: truncate d7/de/d52/f60 723596 0 2024-09-21T12:20:45.126 INFO:tasks.workunit.client.0.smithi003.stdout:0/693: truncate d9/d12/f81 2564741 0 2024-09-21T12:20:45.128 INFO:tasks.workunit.client.0.smithi003.stdout:0/694: readlink d9/d12/d17/d38/d3a/d46/d55/d57/l7d 0 2024-09-21T12:20:45.134 INFO:tasks.workunit.client.0.smithi003.stdout:8/505: link d7/de/l28 d7/lb9 0 2024-09-21T12:20:45.135 INFO:tasks.workunit.client.0.smithi003.stdout:0/695: getdents d9/d12/d17/d38/d3a/d46/d55/d67/d2d 0 2024-09-21T12:20:45.139 INFO:tasks.workunit.client.0.smithi003.stdout:8/506: rename d7/df/d20/d21/f3a to d7/df/d20/d21/d4c/fba 0 2024-09-21T12:20:45.140 INFO:tasks.workunit.client.0.smithi003.stdout:8/507: chown d7/df/d20/d54/c69 1354 1 2024-09-21T12:20:45.142 INFO:tasks.workunit.client.0.smithi003.stdout:9/596: sync 2024-09-21T12:20:45.142 INFO:tasks.workunit.client.0.smithi003.stdout:7/468: sync 2024-09-21T12:20:45.142 INFO:tasks.workunit.client.0.smithi003.stdout:4/465: sync 2024-09-21T12:20:45.142 INFO:tasks.workunit.client.0.smithi003.stdout:6/652: sync 2024-09-21T12:20:45.142 INFO:tasks.workunit.client.0.smithi003.stdout:1/566: sync 2024-09-21T12:20:45.142 INFO:tasks.workunit.client.0.smithi003.stdout:2/485: sync 2024-09-21T12:20:45.142 INFO:tasks.workunit.client.0.smithi003.stdout:3/623: sync 2024-09-21T12:20:45.142 INFO:tasks.workunit.client.0.smithi003.stdout:5/708: sync 2024-09-21T12:20:45.144 INFO:tasks.workunit.client.0.smithi003.stdout:6/653: stat d4/d9/d59/cb1 0 2024-09-21T12:20:45.148 INFO:tasks.workunit.client.0.smithi003.stdout:0/696: dread d9/fb [0,4194304] 0 2024-09-21T12:20:45.148 INFO:tasks.workunit.client.0.smithi003.stdout:8/508: rename d7/df/d36/f3d to d7/df/d20/d21/d4c/fbb 0 2024-09-21T12:20:45.150 INFO:tasks.workunit.client.0.smithi003.stdout:0/697: chown d9/d6c/fca 92 1 2024-09-21T12:20:45.152 INFO:tasks.workunit.client.0.smithi003.stdout:7/469: creat d8/d3c/faa x:0 0 0 2024-09-21T12:20:45.152 INFO:tasks.workunit.client.0.smithi003.stdout:0/698: chown d9/d12/d17/d38/d3a/d46/d55/d7b/d9a 131448 1 2024-09-21T12:20:45.153 INFO:tasks.workunit.client.0.smithi003.stdout:2/486: dread d0/dd/d22/d37/f74 [0,4194304] 0 2024-09-21T12:20:45.153 INFO:tasks.workunit.client.0.smithi003.stdout:6/654: dwrite d4/d9/f8a [0,4194304] 0 2024-09-21T12:20:45.154 INFO:tasks.workunit.client.0.smithi003.stdout:1/567: creat d4/d66/d8b/fc8 x:0 0 0 2024-09-21T12:20:45.154 INFO:tasks.workunit.client.0.smithi003.stdout:7/470: chown d8/db/d13/d75 646532 1 2024-09-21T12:20:45.155 INFO:tasks.workunit.client.0.smithi003.stdout:6/655: readlink d4/d11/d53/lb2 0 2024-09-21T12:20:45.155 INFO:tasks.workunit.client.0.smithi003.stdout:1/568: fdatasync d4/d11/fc0 0 2024-09-21T12:20:45.156 INFO:tasks.workunit.client.0.smithi003.stdout:9/597: mkdir d2/d20/d22/d5e/d87/de2 0 2024-09-21T12:20:45.157 INFO:tasks.workunit.client.0.smithi003.stdout:9/598: dread - d2/da/d2a/d3c/da2/fd5 zero size 2024-09-21T12:20:45.158 INFO:tasks.workunit.client.0.smithi003.stdout:9/599: chown d2/d20/lba 197388 1 2024-09-21T12:20:45.162 INFO:tasks.workunit.client.0.smithi003.stdout:3/624: creat d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/d42/d6d/fd1 x:0 0 0 2024-09-21T12:20:45.164 INFO:tasks.workunit.client.0.smithi003.stdout:5/709: symlink dc/dd7/lda 0 2024-09-21T12:20:45.165 INFO:tasks.workunit.client.0.smithi003.stdout:5/710: chown dc/d15/d1c/f23 0 1 2024-09-21T12:20:45.167 INFO:tasks.workunit.client.0.smithi003.stdout:7/471: creat d8/d2c/fab x:0 0 0 2024-09-21T12:20:45.169 INFO:tasks.workunit.client.0.smithi003.stdout:6/656: rename d4/d13 to d4/d13/d19/de0 22 2024-09-21T12:20:45.171 INFO:tasks.workunit.client.0.smithi003.stdout:4/466: creat d9/da/f9e x:0 0 0 2024-09-21T12:20:45.171 INFO:tasks.workunit.client.0.smithi003.stdout:2/487: dread d0/dd/d22/d37/f5c [0,4194304] 0 2024-09-21T12:20:45.176 INFO:tasks.workunit.client.0.smithi003.stdout:5/711: creat dc/dd7/d41/da0/d4b/d5c/fdb x:0 0 0 2024-09-21T12:20:45.178 INFO:tasks.workunit.client.0.smithi003.stdout:8/509: write d7/f14 [3375817,12270] 0 2024-09-21T12:20:45.249 INFO:tasks.workunit.client.0.smithi003.stdout:6/657: mknod d4/d13/d22/ce1 0 2024-09-21T12:20:45.251 INFO:tasks.workunit.client.0.smithi003.stdout:4/467: creat d9/d16/d65/f9f x:0 0 0 2024-09-21T12:20:45.253 INFO:tasks.workunit.client.0.smithi003.stdout:2/488: mkdir d0/d21/d2f/d49/db1 0 2024-09-21T12:20:45.256 INFO:tasks.workunit.client.0.smithi003.stdout:6/658: dwrite d4/d13/d19/d23/fa9 [0,4194304] 0 2024-09-21T12:20:45.258 INFO:tasks.workunit.client.0.smithi003.stdout:3/625: mkdir d0/d5/da/d28/d11/d49/d4c/d54/d5e/dd2 0 2024-09-21T12:20:45.262 INFO:tasks.workunit.client.0.smithi003.stdout:1/569: write d4/d11/d49/fc2 [1108315,38528] 0 2024-09-21T12:20:45.264 INFO:tasks.workunit.client.0.smithi003.stdout:7/472: mknod d8/d7a/cac 0 2024-09-21T12:20:45.266 INFO:tasks.workunit.client.0.smithi003.stdout:8/510: unlink d7/df/d20/d24/d47/fb5 0 2024-09-21T12:20:45.266 INFO:tasks.workunit.client.0.smithi003.stdout:9/600: dwrite d2/da/d17/d40/f57 [0,4194304] 0 2024-09-21T12:20:45.271 INFO:tasks.workunit.client.0.smithi003.stdout:3/626: dread d0/d5/da/d28/dd/f2b [0,4194304] 0 2024-09-21T12:20:45.274 INFO:tasks.workunit.client.0.smithi003.stdout:2/489: mkdir d0/d21/d2c/d6c/db2 0 2024-09-21T12:20:45.276 INFO:tasks.workunit.client.0.smithi003.stdout:6/659: fdatasync d4/f21 0 2024-09-21T12:20:45.277 INFO:tasks.workunit.client.0.smithi003.stdout:6/660: write d4/d9/f45 [4935015,76928] 0 2024-09-21T12:20:45.280 INFO:tasks.workunit.client.0.smithi003.stdout:5/712: mkdir dc/dd7/ddc 0 2024-09-21T12:20:45.281 INFO:tasks.workunit.client.0.smithi003.stdout:6/661: dread d4/d13/d63/f72 [0,4194304] 0 2024-09-21T12:20:45.286 INFO:tasks.workunit.client.0.smithi003.stdout:4/468: write d9/d16/f3d [456464,24959] 0 2024-09-21T12:20:45.287 INFO:tasks.workunit.client.0.smithi003.stdout:6/662: dread d4/d11/f2f [0,4194304] 0 2024-09-21T12:20:45.288 INFO:tasks.workunit.client.0.smithi003.stdout:9/601: fdatasync d2/d20/f21 0 2024-09-21T12:20:45.290 INFO:tasks.workunit.client.0.smithi003.stdout:3/627: chown d0/d5/da/d28/dd/l12 365 1 2024-09-21T12:20:45.292 INFO:tasks.workunit.client.0.smithi003.stdout:1/570: mknod d4/d11/cc9 0 2024-09-21T12:20:45.293 INFO:tasks.workunit.client.0.smithi003.stdout:5/713: mkdir dc/dd7/d41/d5b/dab/ddd 0 2024-09-21T12:20:45.296 INFO:tasks.workunit.client.0.smithi003.stdout:8/511: dwrite d7/df/d20/d24/f2e [0,4194304] 0 2024-09-21T12:20:45.302 INFO:tasks.workunit.client.0.smithi003.stdout:9/602: dwrite d2/da/f14 [0,4194304] 0 2024-09-21T12:20:45.307 INFO:tasks.workunit.client.0.smithi003.stdout:3/628: dwrite d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/d42/d6d/d86/f8e [0,4194304] 0 2024-09-21T12:20:45.308 INFO:tasks.workunit.client.0.smithi003.stdout:7/473: dread d8/d31/f67 [0,4194304] 0 2024-09-21T12:20:45.310 INFO:tasks.workunit.client.0.smithi003.stdout:2/490: fdatasync d0/d21/f4e 0 2024-09-21T12:20:45.313 INFO:tasks.workunit.client.0.smithi003.stdout:5/714: mkdir dc/dd7/d41/d9f/dde 0 2024-09-21T12:20:45.316 INFO:tasks.workunit.client.0.smithi003.stdout:8/512: creat d7/de/d52/fbc x:0 0 0 2024-09-21T12:20:45.317 INFO:tasks.workunit.client.0.smithi003.stdout:4/469: creat d9/d16/d65/d73/d8d/fa0 x:0 0 0 2024-09-21T12:20:45.318 INFO:tasks.workunit.client.0.smithi003.stdout:7/474: dwrite d8/d31/f74 [0,4194304] 0 2024-09-21T12:20:45.322 INFO:tasks.workunit.client.0.smithi003.stdout:9/603: unlink d2/da/d2a/d3c/da2/daf/cd2 0 2024-09-21T12:20:45.324 INFO:tasks.workunit.client.0.smithi003.stdout:6/663: symlink d4/d9/d59/dba/le2 0 2024-09-21T12:20:45.332 INFO:tasks.workunit.client.0.smithi003.stdout:3/629: mkdir d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/d77/dd3 0 2024-09-21T12:20:45.332 INFO:tasks.workunit.client.0.smithi003.stdout:3/630: chown d0/d5/d38 4992 1 2024-09-21T12:20:45.333 INFO:tasks.workunit.client.0.smithi003.stdout:3/631: stat d0/d5/da/d28/d31/d6b/fc0 0 2024-09-21T12:20:45.339 INFO:tasks.workunit.client.0.smithi003.stdout:8/513: symlink d7/df/d36/lbd 0 2024-09-21T12:20:45.339 INFO:tasks.workunit.client.0.smithi003.stdout:8/514: chown d7/df/d16/l53 0 1 2024-09-21T12:20:45.339 INFO:tasks.workunit.client.0.smithi003.stdout:8/515: chown d7/de 1 1 2024-09-21T12:20:45.339 INFO:tasks.workunit.client.0.smithi003.stdout:1/571: write d4/f30 [1397534,79453] 0 2024-09-21T12:20:45.341 INFO:tasks.workunit.client.0.smithi003.stdout:4/470: mknod d9/da/d36/d55/d79/ca1 0 2024-09-21T12:20:45.345 INFO:tasks.workunit.client.0.smithi003.stdout:7/475: dwrite d8/db/d32/f5d [0,4194304] 0 2024-09-21T12:20:45.346 INFO:tasks.workunit.client.0.smithi003.stdout:6/664: rename d4/d9/d59/d80 to d4/d13/d2e/de3 0 2024-09-21T12:20:45.349 INFO:tasks.workunit.client.0.smithi003.stdout:6/665: read d4/d9/fd [7137195,49019] 0 2024-09-21T12:20:45.350 INFO:tasks.workunit.client.0.smithi003.stdout:2/491: symlink d0/d1c/lb3 0 2024-09-21T12:20:45.355 INFO:tasks.workunit.client.0.smithi003.stdout:4/471: chown d9/d25/c71 2634 1 2024-09-21T12:20:45.358 INFO:tasks.workunit.client.0.smithi003.stdout:4/472: dread - d9/d48/f9c zero size 2024-09-21T12:20:45.358 INFO:tasks.workunit.client.0.smithi003.stdout:2/492: dwrite d0/dd/d22/f23 [4194304,4194304] 0 2024-09-21T12:20:45.360 INFO:tasks.workunit.client.0.smithi003.stdout:2/493: readlink d0/d21/d30/d78/la6 0 2024-09-21T12:20:45.361 INFO:tasks.workunit.client.0.smithi003.stdout:8/516: rename d7/de/d52/fb7 to d7/df/d20/d54/d9d/fbe 0 2024-09-21T12:20:45.368 INFO:tasks.workunit.client.0.smithi003.stdout:8/517: dwrite d7/de/d81/fa4 [0,4194304] 0 2024-09-21T12:20:45.373 INFO:tasks.workunit.client.0.smithi003.stdout:3/632: write d0/d5/da/d28/dd/f2b [835721,78497] 0 2024-09-21T12:20:45.374 INFO:tasks.workunit.client.0.smithi003.stdout:7/476: write d8/d3c/f3e [4025784,109806] 0 2024-09-21T12:20:45.376 INFO:tasks.workunit.client.0.smithi003.stdout:7/477: dread - d8/d3c/d57/d9e/fa2 zero size 2024-09-21T12:20:45.378 INFO:tasks.workunit.client.0.smithi003.stdout:4/473: mkdir d9/da/d66/da2 0 2024-09-21T12:20:45.383 INFO:tasks.workunit.client.0.smithi003.stdout:3/633: dwrite d0/d5/da/d28/d11/d49/d4c/d6f/d91/fc2 [0,4194304] 0 2024-09-21T12:20:45.385 INFO:tasks.workunit.client.0.smithi003.stdout:1/572: truncate d4/f26 804166 0 2024-09-21T12:20:45.387 INFO:tasks.workunit.client.0.smithi003.stdout:8/518: symlink d7/df/d36/lbf 0 2024-09-21T12:20:45.389 INFO:tasks.workunit.client.0.smithi003.stdout:6/666: dread d4/d11/d32/f3b [0,4194304] 0 2024-09-21T12:20:45.389 INFO:tasks.workunit.client.0.smithi003.stdout:9/604: link d2/da/d35/c3e d2/da/d35/d4d/ce3 0 2024-09-21T12:20:45.391 INFO:tasks.workunit.client.0.smithi003.stdout:9/605: write d2/d20/f77 [4909435,34549] 0 2024-09-21T12:20:45.399 INFO:tasks.workunit.client.0.smithi003.stdout:4/474: rename d9/da/f22 to d9/d16/d65/d73/fa3 0 2024-09-21T12:20:45.404 INFO:tasks.workunit.client.0.smithi003.stdout:6/667: creat d4/d11/dc1/d64/fe4 x:0 0 0 2024-09-21T12:20:45.406 INFO:tasks.workunit.client.0.smithi003.stdout:9/606: mkdir d2/d53/d75/de4 0 2024-09-21T12:20:45.408 INFO:tasks.workunit.client.0.smithi003.stdout:4/475: stat d9/c1e 0 2024-09-21T12:20:45.410 INFO:tasks.workunit.client.0.smithi003.stdout:8/519: rename d7/de/d1a/c1e to d7/df/d20/d21/d4c/d4d/d8c/cc0 0 2024-09-21T12:20:45.411 INFO:tasks.workunit.client.0.smithi003.stdout:8/520: chown d7/d57/f71 76 1 2024-09-21T12:20:45.412 INFO:tasks.workunit.client.0.smithi003.stdout:8/521: truncate d7/df/d20/d21/f6d 1765284 0 2024-09-21T12:20:45.414 INFO:tasks.workunit.client.0.smithi003.stdout:8/522: write d7/df/d16/f93 [251165,118664] 0 2024-09-21T12:20:45.414 INFO:tasks.workunit.client.0.smithi003.stdout:8/523: dread - d7/de/d52/f9e zero size 2024-09-21T12:20:45.417 INFO:tasks.workunit.client.0.smithi003.stdout:6/668: rename d4/d11/f57 to d4/d11/dc1/d58/fe5 0 2024-09-21T12:20:45.419 INFO:tasks.workunit.client.0.smithi003.stdout:8/524: write d7/df/d20/d21/d4c/f90 [2280,11721] 0 2024-09-21T12:20:45.419 INFO:tasks.workunit.client.0.smithi003.stdout:1/573: creat d4/d11/d14/d25/d42/fca x:0 0 0 2024-09-21T12:20:45.421 INFO:tasks.workunit.client.0.smithi003.stdout:7/478: getdents d8/d3c/d57/d9e 0 2024-09-21T12:20:45.422 INFO:tasks.workunit.client.0.smithi003.stdout:2/494: link d0/d1c/d6a/c53 d0/d21/d62/cb4 0 2024-09-21T12:20:45.426 INFO:tasks.workunit.client.0.smithi003.stdout:2/495: dread d0/d21/d2f/d77/d7f/f88 [4194304,4194304] 0 2024-09-21T12:20:45.430 INFO:tasks.workunit.client.0.smithi003.stdout:3/634: getdents d0/d5/da/d28/d11/d96 0 2024-09-21T12:20:45.431 INFO:tasks.workunit.client.0.smithi003.stdout:6/669: mknod d4/d9/ce6 0 2024-09-21T12:20:45.433 INFO:tasks.workunit.client.0.smithi003.stdout:6/670: truncate d4/d11/d1d/d36/f85 843852 0 2024-09-21T12:20:45.433 INFO:tasks.workunit.client.0.smithi003.stdout:8/525: rmdir d7/df/d20/d21 39 2024-09-21T12:20:45.434 INFO:tasks.workunit.client.0.smithi003.stdout:6/671: chown d4/d13/d2e/c4f 23960314 1 2024-09-21T12:20:45.434 INFO:tasks.workunit.client.0.smithi003.stdout:8/526: chown d7/df/d16/f91 132368681 1 2024-09-21T12:20:45.435 INFO:tasks.workunit.client.0.smithi003.stdout:1/574: creat d4/d11/d49/fcb x:0 0 0 2024-09-21T12:20:45.437 INFO:tasks.workunit.client.0.smithi003.stdout:7/479: mkdir d8/db/d32/d43/d7e/dad 0 2024-09-21T12:20:45.438 INFO:tasks.workunit.client.0.smithi003.stdout:7/480: stat d8/d3c/d64 0 2024-09-21T12:20:45.443 INFO:tasks.workunit.client.0.smithi003.stdout:6/672: readlink d4/d11/d1d/l1e 0 2024-09-21T12:20:45.444 INFO:tasks.workunit.client.0.smithi003.stdout:8/527: mknod d7/df/d20/d24/cc1 0 2024-09-21T12:20:45.445 INFO:tasks.workunit.client.0.smithi003.stdout:9/607: truncate d2/d20/f77 1847226 0 2024-09-21T12:20:45.447 INFO:tasks.workunit.client.0.smithi003.stdout:7/481: mkdir d8/d7a/dae 0 2024-09-21T12:20:45.448 INFO:tasks.workunit.client.0.smithi003.stdout:4/476: truncate d9/f3a 491269 0 2024-09-21T12:20:45.448 INFO:tasks.workunit.client.0.smithi003.stdout:7/482: dread - d8/d3c/f90 zero size 2024-09-21T12:20:45.449 INFO:tasks.workunit.client.0.smithi003.stdout:7/483: dread - d8/d2c/fab zero size 2024-09-21T12:20:45.455 INFO:tasks.workunit.client.0.smithi003.stdout:9/608: mknod d2/da/d17/d40/ce5 0 2024-09-21T12:20:45.457 INFO:tasks.workunit.client.0.smithi003.stdout:2/496: creat d0/d21/fb5 x:0 0 0 2024-09-21T12:20:45.459 INFO:tasks.workunit.client.0.smithi003.stdout:4/477: truncate d9/da/d47/f5c 409075 0 2024-09-21T12:20:45.462 INFO:tasks.workunit.client.0.smithi003.stdout:7/484: creat d8/db/d32/d43/faf x:0 0 0 2024-09-21T12:20:45.464 INFO:tasks.workunit.client.0.smithi003.stdout:3/635: rename d0/d5/da/d28/d11/d49/d4c/d54/fb6 to d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/fd4 0 2024-09-21T12:20:45.466 INFO:tasks.workunit.client.0.smithi003.stdout:3/636: write d0/d5/da/d28/d11/d49/d4c/d54/d5e/d48/f8f [2726337,22110] 0 2024-09-21T12:20:45.467 INFO:tasks.workunit.client.0.smithi003.stdout:1/575: creat d4/dc/fcc x:0 0 0 2024-09-21T12:20:45.468 INFO:tasks.workunit.client.0.smithi003.stdout:3/637: truncate d0/d5/d38/d55/f7a 960728 0 2024-09-21T12:20:45.469 INFO:tasks.workunit.client.0.smithi003.stdout:3/638: write d0/d5/f97 [295045,62634] 0 2024-09-21T12:20:45.469 INFO:tasks.workunit.client.0.smithi003.stdout:2/497: symlink d0/d21/d2f/d49/lb6 0 2024-09-21T12:20:45.471 INFO:tasks.workunit.client.0.smithi003.stdout:2/498: write d0/d21/d2f/d50/f69 [2772562,114278] 0 2024-09-21T12:20:45.472 INFO:tasks.workunit.client.0.smithi003.stdout:4/478: readlink d9/da/d36/d8c/l91 0 2024-09-21T12:20:45.474 INFO:tasks.workunit.client.0.smithi003.stdout:7/485: creat d8/db/d13/d60/fb0 x:0 0 0 2024-09-21T12:20:45.478 INFO:tasks.workunit.client.0.smithi003.stdout:9/609: symlink d2/le6 0 2024-09-21T12:20:45.479 INFO:tasks.workunit.client.0.smithi003.stdout:4/479: dwrite d9/da/f92 [0,4194304] 0 2024-09-21T12:20:45.480 INFO:tasks.workunit.client.0.smithi003.stdout:9/610: chown d2/da/d2a/d3c/da2/daf/f7d 124 1 2024-09-21T12:20:45.481 INFO:tasks.workunit.client.0.smithi003.stdout:4/480: read d9/f24 [1422936,105607] 0 2024-09-21T12:20:45.483 INFO:tasks.workunit.client.0.smithi003.stdout:4/481: truncate d9/d16/f78 764110 0 2024-09-21T12:20:45.488 INFO:tasks.workunit.client.0.smithi003.stdout:6/673: getdents d4/d11/d1d/db9 0 2024-09-21T12:20:45.488 INFO:tasks.workunit.client.0.smithi003.stdout:6/674: fdatasync d4/d13/d63/fb5 0 2024-09-21T12:20:45.491 INFO:tasks.workunit.client.0.smithi003.stdout:8/528: getdents d7/de/d81 0 2024-09-21T12:20:45.494 INFO:tasks.workunit.client.0.smithi003.stdout:9/611: creat d2/da/d35/d76/fe7 x:0 0 0 2024-09-21T12:20:45.495 INFO:tasks.workunit.client.0.smithi003.stdout:4/482: fdatasync d9/da/fd 0 2024-09-21T12:20:45.496 INFO:tasks.workunit.client.0.smithi003.stdout:2/499: symlink d0/dd/d22/d68/d7e/d97/lb7 0 2024-09-21T12:20:45.497 INFO:tasks.workunit.client.0.smithi003.stdout:3/639: dwrite d0/d5/f36 [0,4194304] 0 2024-09-21T12:20:45.499 INFO:tasks.workunit.client.0.smithi003.stdout:3/640: readlink d0/d5/da/d28/dd/l8c 0 2024-09-21T12:20:45.503 INFO:tasks.workunit.client.0.smithi003.stdout:3/641: write d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/d77/fbe [789853,126336] 0 2024-09-21T12:20:45.505 INFO:tasks.workunit.client.0.smithi003.stdout:3/642: dread - d0/d5/da/d28/d11/d49/d4c/d6f/f8b zero size 2024-09-21T12:20:45.505 INFO:tasks.workunit.client.0.smithi003.stdout:1/576: creat d4/df/fcd x:0 0 0 2024-09-21T12:20:45.510 INFO:tasks.workunit.client.0.smithi003.stdout:4/483: rmdir d9/da/d36/d8c 39 2024-09-21T12:20:45.511 INFO:tasks.workunit.client.0.smithi003.stdout:4/484: write d9/d16/d65/d97/f9d [154756,58279] 0 2024-09-21T12:20:45.514 INFO:tasks.workunit.client.0.smithi003.stdout:6/675: mknod d4/ce7 0 2024-09-21T12:20:45.515 INFO:tasks.workunit.client.0.smithi003.stdout:7/486: link d8/db/f2b d8/d3c/fb1 0 2024-09-21T12:20:45.520 INFO:tasks.workunit.client.0.smithi003.stdout:4/485: dwrite d9/d48/f9c [0,4194304] 0 2024-09-21T12:20:45.520 INFO:tasks.workunit.client.0.smithi003.stdout:8/529: truncate d7/de/d52/f60 1052009 0 2024-09-21T12:20:45.521 INFO:tasks.workunit.client.0.smithi003.stdout:4/486: truncate d9/f84 519317 0 2024-09-21T12:20:45.523 INFO:tasks.workunit.client.0.smithi003.stdout:6/676: symlink d4/d11/d1d/d36/dae/le8 0 2024-09-21T12:20:45.525 INFO:tasks.workunit.client.0.smithi003.stdout:1/577: getdents d4/d11/d49/daf 0 2024-09-21T12:20:45.525 INFO:tasks.workunit.client.0.smithi003.stdout:6/677: stat d4/d13/d19/fad 0 2024-09-21T12:20:45.527 INFO:tasks.workunit.client.0.smithi003.stdout:6/678: chown d4/d13/d63 133792421 1 2024-09-21T12:20:45.527 INFO:tasks.workunit.client.0.smithi003.stdout:7/487: mkdir d8/db/d32/d43/d7e/dad/db2 0 2024-09-21T12:20:45.530 INFO:tasks.workunit.client.0.smithi003.stdout:9/612: dwrite d2/d53/f90 [0,4194304] 0 2024-09-21T12:20:45.530 INFO:tasks.workunit.client.0.smithi003.stdout:7/488: fsync d8/d3c/d57/f65 0 2024-09-21T12:20:45.531 INFO:tasks.workunit.client.0.smithi003.stdout:6/679: dread - d4/d11/fdf zero size 2024-09-21T12:20:45.532 INFO:tasks.workunit.client.0.smithi003.stdout:8/530: unlink d7/df/d20/d21/d4c/f90 0 2024-09-21T12:20:45.533 INFO:tasks.workunit.client.0.smithi003.stdout:6/680: readlink d4/d13/d19/d23/l7a 0 2024-09-21T12:20:45.533 INFO:tasks.workunit.client.0.smithi003.stdout:8/531: dread - d7/f78 zero size 2024-09-21T12:20:45.534 INFO:tasks.workunit.client.0.smithi003.stdout:2/500: dread d0/d21/d2c/f58 [0,4194304] 0 2024-09-21T12:20:45.534 INFO:tasks.workunit.client.0.smithi003.stdout:7/489: write d8/fa0 [890579,114167] 0 2024-09-21T12:20:45.535 INFO:tasks.workunit.client.0.smithi003.stdout:2/501: write d0/d21/d30/f43 [3600764,117625] 0 2024-09-21T12:20:45.542 INFO:tasks.workunit.client.0.smithi003.stdout:1/578: write d4/d11/d14/f61 [399154,14522] 0 2024-09-21T12:20:45.545 INFO:tasks.workunit.client.0.smithi003.stdout:6/681: chown d4/d11/d32/da8 1899261 1 2024-09-21T12:20:45.547 INFO:tasks.workunit.client.0.smithi003.stdout:8/532: creat d7/de/d85/fc2 x:0 0 0 2024-09-21T12:20:45.548 INFO:tasks.workunit.client.0.smithi003.stdout:8/533: write d7/df/d20/f35 [4568113,126743] 0 2024-09-21T12:20:45.550 INFO:tasks.workunit.client.0.smithi003.stdout:8/534: dread d7/df/f26 [0,4194304] 0 2024-09-21T12:20:45.551 INFO:tasks.workunit.client.0.smithi003.stdout:8/535: stat d7/d57/d77/l7b 0 2024-09-21T12:20:45.552 INFO:tasks.workunit.client.0.smithi003.stdout:8/536: chown d7/f78 3 1 2024-09-21T12:20:45.552 INFO:tasks.workunit.client.0.smithi003.stdout:8/537: dread - d7/de/fa9 zero size 2024-09-21T12:20:45.553 INFO:tasks.workunit.client.0.smithi003.stdout:1/579: mkdir d4/d66/dc7/dce 0 2024-09-21T12:20:45.554 INFO:tasks.workunit.client.0.smithi003.stdout:1/580: stat d4/d11 0 2024-09-21T12:20:45.558 INFO:tasks.workunit.client.0.smithi003.stdout:6/682: mknod d4/d11/d1d/d36/ce9 0 2024-09-21T12:20:45.561 INFO:tasks.workunit.client.0.smithi003.stdout:8/538: mknod d7/df/d16/cc3 0 2024-09-21T12:20:45.564 INFO:tasks.workunit.client.0.smithi003.stdout:9/613: dwrite d2/d53/f6e [0,4194304] 0 2024-09-21T12:20:45.566 INFO:tasks.workunit.client.0.smithi003.stdout:6/683: creat d4/d13/d5b/fea x:0 0 0 2024-09-21T12:20:45.570 INFO:tasks.workunit.client.0.smithi003.stdout:2/502: dwrite d0/f25 [0,4194304] 0 2024-09-21T12:20:45.570 INFO:tasks.workunit.client.0.smithi003.stdout:8/539: truncate d7/de/d81/fa4 5169560 0 2024-09-21T12:20:45.573 INFO:tasks.workunit.client.0.smithi003.stdout:9/614: mkdir d2/d53/de8 0 2024-09-21T12:20:45.573 INFO:tasks.workunit.client.0.smithi003.stdout:2/503: chown d0/dd/d22/la3 314683 1 2024-09-21T12:20:45.575 INFO:tasks.workunit.client.0.smithi003.stdout:7/490: dwrite d8/fa [4194304,4194304] 0 2024-09-21T12:20:45.579 INFO:tasks.workunit.client.0.smithi003.stdout:8/540: readlink d7/d57/l74 0 2024-09-21T12:20:45.579 INFO:tasks.workunit.client.0.smithi003.stdout:1/581: dread d4/df/d19/f6f [0,4194304] 0 2024-09-21T12:20:45.581 INFO:tasks.workunit.client.0.smithi003.stdout:7/491: unlink d8/db/d13/f77 0 2024-09-21T12:20:45.585 INFO:tasks.workunit.client.0.smithi003.stdout:1/582: chown d4/c1b 8549178 1 2024-09-21T12:20:45.586 INFO:tasks.workunit.client.0.smithi003.stdout:1/583: stat d4/df/d19/d8a 0 2024-09-21T12:20:45.586 INFO:tasks.workunit.client.0.smithi003.stdout:9/615: mknod d2/da/d2a/d3c/da2/ddd/ce9 0 2024-09-21T12:20:45.590 INFO:tasks.workunit.client.0.smithi003.stdout:6/684: write d4/d13/d19/d23/f3c [409901,89230] 0 2024-09-21T12:20:45.591 INFO:tasks.workunit.client.0.smithi003.stdout:6/685: chown d4/d13/l42 103 1 2024-09-21T12:20:45.593 INFO:tasks.workunit.client.0.smithi003.stdout:6/686: fdatasync f3 0 2024-09-21T12:20:45.593 INFO:tasks.workunit.client.0.smithi003.stdout:8/541: mknod d7/df/d20/d21/d4c/d4d/d80/cc4 0 2024-09-21T12:20:45.595 INFO:tasks.workunit.client.0.smithi003.stdout:1/584: creat d4/d11/d14/d25/d42/d63/fcf x:0 0 0 2024-09-21T12:20:45.595 INFO:tasks.workunit.client.0.smithi003.stdout:9/616: symlink d2/da/d2a/d3c/da2/ddd/lea 0 2024-09-21T12:20:45.596 INFO:tasks.workunit.client.0.smithi003.stdout:2/504: link d0/d21/d2f/d77/d7f/f88 d0/d21/d30/fb8 0 2024-09-21T12:20:45.596 INFO:tasks.workunit.client.0.smithi003.stdout:1/585: write d4/dc/f16 [894223,56380] 0 2024-09-21T12:20:45.598 INFO:tasks.workunit.client.0.smithi003.stdout:7/492: creat d8/d93/fb3 x:0 0 0 2024-09-21T12:20:45.599 INFO:tasks.workunit.client.0.smithi003.stdout:6/687: mkdir d4/d11/d1d/deb 0 2024-09-21T12:20:45.600 INFO:tasks.workunit.client.0.smithi003.stdout:9/617: dread - d2/d20/d22/d3f/fa4 zero size 2024-09-21T12:20:45.601 INFO:tasks.workunit.client.0.smithi003.stdout:6/688: fsync d4/d11/fdf 0 2024-09-21T12:20:45.603 INFO:tasks.workunit.client.0.smithi003.stdout:7/493: unlink d8/db/fa7 0 2024-09-21T12:20:45.605 INFO:tasks.workunit.client.0.smithi003.stdout:6/689: rename d4/d13/d5b/cb8 to d4/d13/d19/d38/da3/cec 0 2024-09-21T12:20:45.606 INFO:tasks.workunit.client.0.smithi003.stdout:9/618: read - d2/d20/d42/da5/fbf zero size 2024-09-21T12:20:45.606 INFO:tasks.workunit.client.0.smithi003.stdout:6/690: read - d4/d11/dc1/f6b zero size 2024-09-21T12:20:45.607 INFO:tasks.workunit.client.0.smithi003.stdout:7/494: creat d8/d93/fb4 x:0 0 0 2024-09-21T12:20:45.607 INFO:tasks.workunit.client.0.smithi003.stdout:9/619: dread - d2/da/d35/d76/fdf zero size 2024-09-21T12:20:45.609 INFO:tasks.workunit.client.0.smithi003.stdout:6/691: mknod d4/d11/d1d/d36/ced 0 2024-09-21T12:20:45.610 INFO:tasks.workunit.client.0.smithi003.stdout:7/495: creat d8/db/d13/d75/fb5 x:0 0 0 2024-09-21T12:20:45.613 INFO:tasks.workunit.client.0.smithi003.stdout:6/692: symlink d4/d9/d59/lee 0 2024-09-21T12:20:45.614 INFO:tasks.workunit.client.0.smithi003.stdout:6/693: readlink d4/d11/d53/lb2 0 2024-09-21T12:20:45.620 INFO:tasks.workunit.client.0.smithi003.stdout:7/496: link d8/db/d13/d75/fb5 d8/d7a/dae/fb6 0 2024-09-21T12:20:45.621 INFO:tasks.workunit.client.0.smithi003.stdout:7/497: chown d8/db/d13/l70 110418224 1 2024-09-21T12:20:45.621 INFO:tasks.workunit.client.0.smithi003.stdout:1/586: dread d4/fa [0,4194304] 0 2024-09-21T12:20:45.623 INFO:tasks.workunit.client.0.smithi003.stdout:1/587: write d4/df/fa5 [759208,105589] 0 2024-09-21T12:20:45.624 INFO:tasks.workunit.client.0.smithi003.stdout:8/542: write d7/df/d20/d21/f8b [1002625,71401] 0 2024-09-21T12:20:45.625 INFO:tasks.workunit.client.0.smithi003.stdout:8/543: dread - d7/df/d20/fa2 zero size 2024-09-21T12:20:45.627 INFO:tasks.workunit.client.0.smithi003.stdout:2/505: write d0/dd/f65 [626159,49663] 0 2024-09-21T12:20:45.632 INFO:tasks.workunit.client.0.smithi003.stdout:7/498: symlink d8/db/d13/d96/lb7 0 2024-09-21T12:20:45.633 INFO:tasks.workunit.client.0.smithi003.stdout:7/499: write d8/d3c/d57/f65 [74707,68244] 0 2024-09-21T12:20:45.635 INFO:tasks.workunit.client.0.smithi003.stdout:2/506: creat d0/d21/d2f/d9f/fb9 x:0 0 0 2024-09-21T12:20:45.636 INFO:tasks.workunit.client.0.smithi003.stdout:2/507: readlink d0/d21/d30/d78/la6 0 2024-09-21T12:20:45.640 INFO:tasks.workunit.client.0.smithi003.stdout:6/694: write d4/d13/d19/d62/f67 [889115,126872] 0 2024-09-21T12:20:45.641 INFO:tasks.workunit.client.0.smithi003.stdout:8/544: creat d7/df/d20/fc5 x:0 0 0 2024-09-21T12:20:45.642 INFO:tasks.workunit.client.0.smithi003.stdout:9/620: dwrite d2/d53/d75/fb4 [0,4194304] 0 2024-09-21T12:20:45.648 INFO:tasks.workunit.client.0.smithi003.stdout:8/545: mknod d7/df/d20/cc6 0 2024-09-21T12:20:45.650 INFO:tasks.workunit.client.0.smithi003.stdout:0/699: sync 2024-09-21T12:20:45.654 INFO:tasks.workunit.client.0.smithi003.stdout:9/621: write d2/d20/d22/d5e/d87/fde [579165,103183] 0 2024-09-21T12:20:45.656 INFO:tasks.workunit.client.0.smithi003.stdout:2/508: dwrite d0/d21/d2c/fa0 [0,4194304] 0 2024-09-21T12:20:45.660 INFO:tasks.workunit.client.0.smithi003.stdout:7/500: dwrite d8/d3c/d57/f73 [0,4194304] 0 2024-09-21T12:20:45.663 INFO:tasks.workunit.client.0.smithi003.stdout:1/588: dwrite d4/df/d41/f54 [0,4194304] 0 2024-09-21T12:20:45.663 INFO:tasks.workunit.client.0.smithi003.stdout:9/622: mknod d2/da/d2a/ceb 0 2024-09-21T12:20:45.665 INFO:tasks.workunit.client.0.smithi003.stdout:0/700: mknod d9/d12/d17/d38/d3a/d46/d55/d7b/cfa 0 2024-09-21T12:20:45.666 INFO:tasks.workunit.client.0.smithi003.stdout:6/695: dwrite d4/d13/fd4 [0,4194304] 0 2024-09-21T12:20:45.670 INFO:tasks.workunit.client.0.smithi003.stdout:2/509: truncate d0/d21/d2f/d50/f90 4663393 0 2024-09-21T12:20:45.670 INFO:tasks.workunit.client.0.smithi003.stdout:7/501: mkdir d8/db/d13/d96/db8 0 2024-09-21T12:20:45.727 INFO:tasks.workunit.client.0.smithi003.stdout:2/510: rename d0/d21 to d0/d21/d2f/d9f/dba 22 2024-09-21T12:20:45.727 INFO:tasks.workunit.client.0.smithi003.stdout:6/696: rmdir d4/d13/d19 39 2024-09-21T12:20:45.727 INFO:tasks.workunit.client.0.smithi003.stdout:0/701: chown d9/d12/d17/d38/d3a/d46/d55/d9e/cbf 1 1 2024-09-21T12:20:45.727 INFO:tasks.workunit.client.0.smithi003.stdout:7/502: dread - d8/d31/f69 zero size 2024-09-21T12:20:45.728 INFO:tasks.workunit.client.0.smithi003.stdout:1/589: write d4/df/f31 [2624836,88222] 0 2024-09-21T12:20:45.730 INFO:tasks.workunit.client.0.smithi003.stdout:6/697: creat d4/d9/fef x:0 0 0 2024-09-21T12:20:45.730 INFO:tasks.workunit.client.0.smithi003.stdout:7/503: rmdir d8/db/d13/d96 39 2024-09-21T12:20:45.787 INFO:tasks.workunit.client.0.smithi003.stdout:5/715: sync 2024-09-21T12:20:45.787 INFO:tasks.workunit.client.0.smithi003.stdout:0/702: mkdir d9/d12/d17/d38/dfb 0 2024-09-21T12:20:45.788 INFO:tasks.workunit.client.0.smithi003.stdout:1/590: creat d4/df/d12/fd0 x:0 0 0 2024-09-21T12:20:45.788 INFO:tasks.workunit.client.0.smithi003.stdout:6/698: mknod d4/d11/dc1/d58/cf0 0 2024-09-21T12:20:45.794 INFO:tasks.workunit.client.0.smithi003.stdout:0/703: creat d9/d6c/d32/ffc x:0 0 0 2024-09-21T12:20:45.796 INFO:tasks.workunit.client.0.smithi003.stdout:9/623: dread d2/d53/d75/fbd [0,4194304] 0 2024-09-21T12:20:45.797 INFO:tasks.workunit.client.0.smithi003.stdout:7/504: dwrite d8/db/d32/d43/f76 [0,4194304] 0 2024-09-21T12:20:45.797 INFO:tasks.workunit.client.0.smithi003.stdout:5/716: dwrite dc/d15/d1c/f3e [0,4194304] 0 2024-09-21T12:20:45.799 INFO:tasks.workunit.client.0.smithi003.stdout:9/624: fsync d2/da/d2a/d3c/f4b 0 2024-09-21T12:20:45.800 INFO:tasks.workunit.client.0.smithi003.stdout:2/511: getdents d0/d21/d30/d78 0 2024-09-21T12:20:45.802 INFO:tasks.workunit.client.0.smithi003.stdout:7/505: readlink d8/db/d32/d43/d7e/l80 0 2024-09-21T12:20:45.803 INFO:tasks.workunit.client.0.smithi003.stdout:6/699: getdents d4/d13/d22/dcf 0 2024-09-21T12:20:45.803 INFO:tasks.workunit.client.0.smithi003.stdout:2/512: truncate d0/dd/d22/f57 1031887 0 2024-09-21T12:20:45.804 INFO:tasks.workunit.client.0.smithi003.stdout:5/717: mknod dc/d15/d26/cdf 0 2024-09-21T12:20:45.806 INFO:tasks.workunit.client.0.smithi003.stdout:5/718: chown dc/d15/d21/fd5 17 1 2024-09-21T12:20:45.808 INFO:tasks.workunit.client.0.smithi003.stdout:1/591: write d4/df/d19/f8f [769543,55610] 0 2024-09-21T12:20:45.809 INFO:tasks.workunit.client.0.smithi003.stdout:9/625: write d2/d53/fb5 [464256,82105] 0 2024-09-21T12:20:45.810 INFO:tasks.workunit.client.0.smithi003.stdout:9/626: fdatasync d2/d53/d83/fdb 0 2024-09-21T12:20:45.812 INFO:tasks.workunit.client.0.smithi003.stdout:7/506: dread d8/db/d32/f8c [0,4194304] 0 2024-09-21T12:20:45.813 INFO:tasks.workunit.client.0.smithi003.stdout:7/507: write d8/fa0 [816961,18208] 0 2024-09-21T12:20:45.814 INFO:tasks.workunit.client.0.smithi003.stdout:5/719: mknod dc/d2b/d4e/ce0 0 2024-09-21T12:20:45.815 INFO:tasks.workunit.client.0.smithi003.stdout:1/592: readlink d4/l29 0 2024-09-21T12:20:45.816 INFO:tasks.workunit.client.0.smithi003.stdout:5/720: write dc/fc3 [695391,8437] 0 2024-09-21T12:20:45.817 INFO:tasks.workunit.client.0.smithi003.stdout:6/700: dread d4/d11/d32/fdb [0,4194304] 0 2024-09-21T12:20:45.818 INFO:tasks.workunit.client.0.smithi003.stdout:1/593: dread - d4/d11/d14/d25/d59/fac zero size 2024-09-21T12:20:45.818 INFO:tasks.workunit.client.0.smithi003.stdout:6/701: chown l0 29 1 2024-09-21T12:20:45.821 INFO:tasks.workunit.client.0.smithi003.stdout:6/702: write d4/d11/d1d/d36/dae/fbd [40942,93390] 0 2024-09-21T12:20:45.826 INFO:tasks.workunit.client.0.smithi003.stdout:7/508: creat d8/d7a/fb9 x:0 0 0 2024-09-21T12:20:45.827 INFO:tasks.workunit.client.0.smithi003.stdout:2/513: write d0/d1c/f61 [178123,97783] 0 2024-09-21T12:20:45.829 INFO:tasks.workunit.client.0.smithi003.stdout:6/703: dwrite d4/d13/d22/fa5 [0,4194304] 0 2024-09-21T12:20:45.830 INFO:tasks.workunit.client.0.smithi003.stdout:2/514: chown d0/d21/d2f/d77/d7f 105712614 1 2024-09-21T12:20:45.831 INFO:tasks.workunit.client.0.smithi003.stdout:2/515: chown d0/d1c/d6a/f19 3 1 2024-09-21T12:20:45.832 INFO:tasks.workunit.client.0.smithi003.stdout:0/704: truncate d9/d12/d17/d21/fa7 3785985 0 2024-09-21T12:20:45.833 INFO:tasks.workunit.client.0.smithi003.stdout:7/509: mknod d8/db/cba 0 2024-09-21T12:20:45.834 INFO:tasks.workunit.client.0.smithi003.stdout:7/510: fsync d8/db/d32/f6f 0 2024-09-21T12:20:45.836 INFO:tasks.workunit.client.0.smithi003.stdout:6/704: creat d4/d11/dc1/d58/ff1 x:0 0 0 2024-09-21T12:20:45.836 INFO:tasks.workunit.client.0.smithi003.stdout:7/511: chown d8/db/d13/d60/f8f 56045059 1 2024-09-21T12:20:45.837 INFO:tasks.workunit.client.0.smithi003.stdout:9/627: dread d2/d53/f8d [0,4194304] 0 2024-09-21T12:20:45.837 INFO:tasks.workunit.client.0.smithi003.stdout:1/594: symlink d4/d66/dc7/dce/ld1 0 2024-09-21T12:20:45.839 INFO:tasks.workunit.client.0.smithi003.stdout:1/595: read d4/fb [1926422,118460] 0 2024-09-21T12:20:45.842 INFO:tasks.workunit.client.0.smithi003.stdout:1/596: dread - d4/d11/d49/fcb zero size 2024-09-21T12:20:45.842 INFO:tasks.workunit.client.0.smithi003.stdout:0/705: fdatasync d9/d6c/d66/fae 0 2024-09-21T12:20:45.845 INFO:tasks.workunit.client.0.smithi003.stdout:7/512: dread d8/d31/f5f [0,4194304] 0 2024-09-21T12:20:45.846 INFO:tasks.workunit.client.0.smithi003.stdout:5/721: dwrite dc/d15/d26/fb8 [0,4194304] 0 2024-09-21T12:20:45.848 INFO:tasks.workunit.client.0.smithi003.stdout:6/705: symlink d4/d11/d1d/d36/lf2 0 2024-09-21T12:20:45.851 INFO:tasks.workunit.client.0.smithi003.stdout:6/706: read d4/d13/d56/f8f [271934,29790] 0 2024-09-21T12:20:45.855 INFO:tasks.workunit.client.0.smithi003.stdout:5/722: rmdir dc/d2b 39 2024-09-21T12:20:45.857 INFO:tasks.workunit.client.0.smithi003.stdout:7/513: mkdir d8/d3c/d57/d81/dbb 0 2024-09-21T12:20:45.859 INFO:tasks.workunit.client.0.smithi003.stdout:6/707: creat d4/d13/d5b/d8c/ff3 x:0 0 0 2024-09-21T12:20:45.860 INFO:tasks.workunit.client.0.smithi003.stdout:6/708: dread - d4/d13/d5b/fea zero size 2024-09-21T12:20:45.864 INFO:tasks.workunit.client.0.smithi003.stdout:5/723: mknod dc/d15/ce1 0 2024-09-21T12:20:45.866 INFO:tasks.workunit.client.0.smithi003.stdout:7/514: symlink d8/db/d32/d43/lbc 0 2024-09-21T12:20:45.867 INFO:tasks.workunit.client.0.smithi003.stdout:2/516: dwrite d0/dd/d22/d37/f73 [0,4194304] 0 2024-09-21T12:20:45.870 INFO:tasks.workunit.client.0.smithi003.stdout:6/709: creat d4/d13/d56/ff4 x:0 0 0 2024-09-21T12:20:45.871 INFO:tasks.workunit.client.0.smithi003.stdout:0/706: creat d9/d6c/d26/d54/ffd x:0 0 0 2024-09-21T12:20:45.873 INFO:tasks.workunit.client.0.smithi003.stdout:1/597: link d4/df/d41/f54 d4/dc/fd2 0 2024-09-21T12:20:45.873 INFO:tasks.workunit.client.0.smithi003.stdout:0/707: chown d9/d12/d17/d38/d3a/d46/d55/d67/fe1 40873956 1 2024-09-21T12:20:45.875 INFO:tasks.workunit.client.0.smithi003.stdout:9/628: getdents d2/da/d17 0 2024-09-21T12:20:45.878 INFO:tasks.workunit.client.0.smithi003.stdout:5/724: mknod dc/d15/d21/ce2 0 2024-09-21T12:20:45.880 INFO:tasks.workunit.client.0.smithi003.stdout:1/598: stat d4/d11/f4a 0 2024-09-21T12:20:45.883 INFO:tasks.workunit.client.0.smithi003.stdout:6/710: dwrite d4/d13/d19/d23/f3c [0,4194304] 0 2024-09-21T12:20:45.884 INFO:tasks.workunit.client.0.smithi003.stdout:9/629: rename d2/da/d35/d76/fdf to d2/d53/d75/de4/fec 0 2024-09-21T12:20:45.889 INFO:tasks.workunit.client.0.smithi003.stdout:5/725: mknod dc/dd7/d41/d5b/ce3 0 2024-09-21T12:20:45.890 INFO:tasks.workunit.client.0.smithi003.stdout:7/515: write d8/d7a/dae/fb6 [624006,104719] 0 2024-09-21T12:20:45.894 INFO:tasks.workunit.client.0.smithi003.stdout:9/630: rename d2/d53/d83/cbc to d2/d53/ced 0 2024-09-21T12:20:45.897 INFO:tasks.workunit.client.0.smithi003.stdout:2/517: getdents d0/d21 0 2024-09-21T12:20:45.900 INFO:tasks.workunit.client.0.smithi003.stdout:5/726: truncate dc/d15/d26/f84 808158 0 2024-09-21T12:20:45.902 INFO:tasks.workunit.client.0.smithi003.stdout:5/727: write dc/dd7/d41/d5b/d74/d7f/d82/f92 [4764888,68509] 0 2024-09-21T12:20:45.902 INFO:tasks.workunit.client.0.smithi003.stdout:7/516: creat d8/d93/fbd x:0 0 0 2024-09-21T12:20:45.905 INFO:tasks.workunit.client.0.smithi003.stdout:0/708: link d9/d12/d17/d38/d3a/d46/d55/d67/d2d/f77 d9/d12/d17/d38/d3a/d46/d55/d9e/ffe 0 2024-09-21T12:20:45.908 INFO:tasks.workunit.client.0.smithi003.stdout:9/631: rename d2/da/d17/f84 to d2/d20/d22/d5e/d87/fee 0 2024-09-21T12:20:45.909 INFO:tasks.workunit.client.0.smithi003.stdout:1/599: write d4/dc/f10 [1074649,36483] 0 2024-09-21T12:20:45.910 INFO:tasks.workunit.client.0.smithi003.stdout:1/600: chown d4/d11/d14/d25/d59/fac 276876462 1 2024-09-21T12:20:45.913 INFO:tasks.workunit.client.0.smithi003.stdout:6/711: rmdir d4/d13/d22/dcf 0 2024-09-21T12:20:45.914 INFO:tasks.workunit.client.0.smithi003.stdout:0/709: mkdir d9/d6c/d32/dc3/dff 0 2024-09-21T12:20:45.915 INFO:tasks.workunit.client.0.smithi003.stdout:9/632: fdatasync d2/d53/faa 0 2024-09-21T12:20:45.916 INFO:tasks.workunit.client.0.smithi003.stdout:2/518: mkdir d0/d21/d2c/d6c/db2/dbb 0 2024-09-21T12:20:45.917 INFO:tasks.workunit.client.0.smithi003.stdout:1/601: mknod d4/d11/db1/cd3 0 2024-09-21T12:20:45.918 INFO:tasks.workunit.client.0.smithi003.stdout:1/602: read - d4/df/fcd zero size 2024-09-21T12:20:45.919 INFO:tasks.workunit.client.0.smithi003.stdout:5/728: dwrite dc/d2b/f44 [0,4194304] 0 2024-09-21T12:20:45.920 INFO:tasks.workunit.client.0.smithi003.stdout:2/519: truncate d0/d21/d2f/f8f 695725 0 2024-09-21T12:20:45.923 INFO:tasks.workunit.client.0.smithi003.stdout:6/712: readlink d4/d13/d19/d62/lde 0 2024-09-21T12:20:45.925 INFO:tasks.workunit.client.0.smithi003.stdout:0/710: truncate d9/fcf 1027390 0 2024-09-21T12:20:45.926 INFO:tasks.workunit.client.0.smithi003.stdout:0/711: read d9/d12/f82 [2614888,128223] 0 2024-09-21T12:20:45.927 INFO:tasks.workunit.client.0.smithi003.stdout:3/643: sync 2024-09-21T12:20:45.927 INFO:tasks.workunit.client.0.smithi003.stdout:8/546: sync 2024-09-21T12:20:45.927 INFO:tasks.workunit.client.0.smithi003.stdout:4/487: sync 2024-09-21T12:20:45.933 INFO:tasks.workunit.client.0.smithi003.stdout:7/517: rmdir d8/d3c/d57/d81/dbb 0 2024-09-21T12:20:45.936 INFO:tasks.workunit.client.0.smithi003.stdout:4/488: rmdir d9/d25 39 2024-09-21T12:20:45.937 INFO:tasks.workunit.client.0.smithi003.stdout:5/729: dwrite dc/dd7/d41/da0/f55 [0,4194304] 0 2024-09-21T12:20:45.938 INFO:tasks.workunit.client.0.smithi003.stdout:3/644: mknod d0/d5/da/d28/d11/d49/d4c/d6f/d91/cd5 0 2024-09-21T12:20:45.939 INFO:tasks.workunit.client.0.smithi003.stdout:1/603: dread d4/f5e [0,4194304] 0 2024-09-21T12:20:45.939 INFO:tasks.workunit.client.0.smithi003.stdout:2/520: mknod d0/d21/d2f/d49/d83/cbc 0 2024-09-21T12:20:45.940 INFO:tasks.workunit.client.0.smithi003.stdout:4/489: dread - d9/da/d47/f7e zero size 2024-09-21T12:20:45.944 INFO:tasks.workunit.client.0.smithi003.stdout:6/713: mkdir d4/d11/df5 0 2024-09-21T12:20:45.944 INFO:tasks.workunit.client.0.smithi003.stdout:8/547: write d7/f65 [355327,74234] 0 2024-09-21T12:20:45.946 INFO:tasks.workunit.client.0.smithi003.stdout:9/633: dwrite d2/da/d2a/f8c [0,4194304] 0 2024-09-21T12:20:45.946 INFO:tasks.workunit.client.0.smithi003.stdout:7/518: unlink d8/db/d13/l51 0 2024-09-21T12:20:45.951 INFO:tasks.workunit.client.0.smithi003.stdout:3/645: rmdir d0/d5/da/d28/dd 39 2024-09-21T12:20:45.952 INFO:tasks.workunit.client.0.smithi003.stdout:0/712: creat d9/d6c/d26/d54/f100 x:0 0 0 2024-09-21T12:20:45.952 INFO:tasks.workunit.client.0.smithi003.stdout:6/714: mkdir d4/d13/d2e/de3/df6 0 2024-09-21T12:20:45.953 INFO:tasks.workunit.client.0.smithi003.stdout:8/548: stat d7/df/d20/d24/c73 0 2024-09-21T12:20:45.956 INFO:tasks.workunit.client.0.smithi003.stdout:1/604: symlink d4/d11/d14/d78/dae/ld4 0 2024-09-21T12:20:45.959 INFO:tasks.workunit.client.0.smithi003.stdout:0/713: unlink d9/d12/f1c 0 2024-09-21T12:20:45.961 INFO:tasks.workunit.client.0.smithi003.stdout:4/490: rename d9/d25/l42 to d9/d16/d65/d73/d8d/la4 0 2024-09-21T12:20:45.962 INFO:tasks.workunit.client.0.smithi003.stdout:4/491: dread - d9/d16/d65/f7f zero size 2024-09-21T12:20:45.963 INFO:tasks.workunit.client.0.smithi003.stdout:3/646: symlink d0/d5/da/d28/d11/d49/d4c/d6f/d91/ld6 0 2024-09-21T12:20:45.965 INFO:tasks.workunit.client.0.smithi003.stdout:3/647: fdatasync d0/d5/da/d28/d31/f7d 0 2024-09-21T12:20:45.965 INFO:tasks.workunit.client.0.smithi003.stdout:7/519: mkdir d8/db/d13/d85/dbe 0 2024-09-21T12:20:45.966 INFO:tasks.workunit.client.0.smithi003.stdout:7/520: dread - d8/d93/fb4 zero size 2024-09-21T12:20:45.969 INFO:tasks.workunit.client.0.smithi003.stdout:5/730: creat dc/dd7/d41/da0/fe4 x:0 0 0 2024-09-21T12:20:45.969 INFO:tasks.workunit.client.0.smithi003.stdout:9/634: write d2/da/d17/f8e [731719,12540] 0 2024-09-21T12:20:45.972 INFO:tasks.workunit.client.0.smithi003.stdout:6/715: dread d4/d13/d2e/f61 [0,4194304] 0 2024-09-21T12:20:45.974 INFO:tasks.workunit.client.0.smithi003.stdout:6/716: chown d4/d13/d2e/f61 45715890 1 2024-09-21T12:20:45.975 INFO:tasks.workunit.client.0.smithi003.stdout:8/549: symlink d7/lc7 0 2024-09-21T12:20:45.975 INFO:tasks.workunit.client.0.smithi003.stdout:6/717: chown d4/d13/d5b/cda 258360 1 2024-09-21T12:20:45.979 INFO:tasks.workunit.client.0.smithi003.stdout:3/648: rename d0/d5/da/d28/cbd to d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/d42/cd7 0 2024-09-21T12:20:45.979 INFO:tasks.workunit.client.0.smithi003.stdout:1/605: dread d4/f30 [0,4194304] 0 2024-09-21T12:20:45.980 INFO:tasks.workunit.client.0.smithi003.stdout:2/521: getdents d0/dd/d22/d68/d7e/d97 0 2024-09-21T12:20:45.980 INFO:tasks.workunit.client.0.smithi003.stdout:3/649: dread - d0/d5/da/d28/d31/fbf zero size 2024-09-21T12:20:45.981 INFO:tasks.workunit.client.0.smithi003.stdout:1/606: chown d4/d11/d14/d25/d42/d7b 2 1 2024-09-21T12:20:45.981 INFO:tasks.workunit.client.0.smithi003.stdout:9/635: creat d2/d20/d22/d3f/fef x:0 0 0 2024-09-21T12:20:45.982 INFO:tasks.workunit.client.0.smithi003.stdout:5/731: dread dc/f1a [0,4194304] 0 2024-09-21T12:20:45.983 INFO:tasks.workunit.client.0.smithi003.stdout:0/714: mkdir d9/d12/d101 0 2024-09-21T12:20:45.983 INFO:tasks.workunit.client.0.smithi003.stdout:3/650: chown d0/d5/d38/d55/l68 343 1 2024-09-21T12:20:45.986 INFO:tasks.workunit.client.0.smithi003.stdout:2/522: truncate d0/d21/d2c/d63/fa8 589305 0 2024-09-21T12:20:45.988 INFO:tasks.workunit.client.0.smithi003.stdout:3/651: write d0/d5/da/fa9 [573036,31911] 0 2024-09-21T12:20:45.990 INFO:tasks.workunit.client.0.smithi003.stdout:2/523: read d0/f1d [19401,47826] 0 2024-09-21T12:20:45.991 INFO:tasks.workunit.client.0.smithi003.stdout:0/715: dread d9/d12/d17/d38/d3a/d46/d55/d9e/ffe [0,4194304] 0 2024-09-21T12:20:45.992 INFO:tasks.workunit.client.0.smithi003.stdout:2/524: fsync d0/dd/d22/f79 0 2024-09-21T12:20:45.993 INFO:tasks.workunit.client.0.smithi003.stdout:2/525: chown d0 54508 1 2024-09-21T12:20:45.998 INFO:tasks.workunit.client.0.smithi003.stdout:3/652: dwrite d0/d5/da/d28/d11/d49/d4c/fcc [0,4194304] 0 2024-09-21T12:20:46.001 INFO:tasks.workunit.client.0.smithi003.stdout:4/492: getdents d9/da/d36/d55 0 2024-09-21T12:20:46.003 INFO:tasks.workunit.client.0.smithi003.stdout:9/636: mknod d2/da0/db3/cf0 0 2024-09-21T12:20:46.006 INFO:tasks.workunit.client.0.smithi003.stdout:1/607: truncate d4/f26 139194 0 2024-09-21T12:20:46.008 INFO:tasks.workunit.client.0.smithi003.stdout:1/608: write d4/dc/d80/f83 [4525455,16792] 0 2024-09-21T12:20:46.017 INFO:tasks.workunit.client.0.smithi003.stdout:6/718: write d4/d13/f7b [941809,44462] 0 2024-09-21T12:20:46.027 INFO:tasks.workunit.client.0.smithi003.stdout:0/716: rename d9/d12/d1e/d5f/de9 to d9/d6c/d32/dc3/d102 0 2024-09-21T12:20:46.028 INFO:tasks.workunit.client.0.smithi003.stdout:3/653: rmdir d0/d5/da/d28/d11 39 2024-09-21T12:20:46.029 INFO:tasks.workunit.client.0.smithi003.stdout:7/521: dwrite d8/db/f2b [0,4194304] 0 2024-09-21T12:20:46.029 INFO:tasks.workunit.client.0.smithi003.stdout:9/637: creat d2/da/d2a/d3c/da8/ff1 x:0 0 0 2024-09-21T12:20:46.032 INFO:tasks.workunit.client.0.smithi003.stdout:7/522: chown d8/d3c/d6b 7 1 2024-09-21T12:20:46.035 INFO:tasks.workunit.client.0.smithi003.stdout:1/609: mknod d4/d66/d8b/cd5 0 2024-09-21T12:20:46.036 INFO:tasks.workunit.client.0.smithi003.stdout:8/550: dwrite d7/de/d52/f60 [0,4194304] 0 2024-09-21T12:20:46.036 INFO:tasks.workunit.client.0.smithi003.stdout:3/654: truncate d0/fba 21028 0 2024-09-21T12:20:46.039 INFO:tasks.workunit.client.0.smithi003.stdout:3/655: dread - d0/d5/d38/fa6 zero size 2024-09-21T12:20:46.039 INFO:tasks.workunit.client.0.smithi003.stdout:6/719: chown d4/d13/d19/d23/c82 231 1 2024-09-21T12:20:46.040 INFO:tasks.workunit.client.0.smithi003.stdout:1/610: readlink d4/d11/d14/d78/dae/ld4 0 2024-09-21T12:20:46.043 INFO:tasks.workunit.client.0.smithi003.stdout:9/638: dread d2/d20/d22/d5e/d87/fde [0,4194304] 0 2024-09-21T12:20:46.043 INFO:tasks.workunit.client.0.smithi003.stdout:2/526: dread d0/f36 [0,4194304] 0 2024-09-21T12:20:46.066 INFO:tasks.workunit.client.0.smithi003.stdout:5/732: truncate dc/dd7/d41/f8a 402133 0 2024-09-21T12:20:46.124 INFO:tasks.workunit.client.0.smithi003.stdout:0/717: mknod d9/d12/d17/d21/d30/c103 0 2024-09-21T12:20:46.125 INFO:tasks.workunit.client.0.smithi003.stdout:0/718: fsync d9/d12/d17/d21/d30/ff9 0 2024-09-21T12:20:46.127 INFO:tasks.workunit.client.0.smithi003.stdout:8/551: creat d7/df/d20/d21/d4c/d4d/fc8 x:0 0 0 2024-09-21T12:20:46.129 INFO:tasks.workunit.client.0.smithi003.stdout:1/611: write d4/df/d19/f6f [4636806,118614] 0 2024-09-21T12:20:46.129 INFO:tasks.workunit.client.0.smithi003.stdout:9/639: rmdir d2/d53/d83 39 2024-09-21T12:20:46.130 INFO:tasks.workunit.client.0.smithi003.stdout:3/656: fsync d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/d77/f9d 0 2024-09-21T12:20:46.131 INFO:tasks.workunit.client.0.smithi003.stdout:9/640: write d2/f10 [5227238,48813] 0 2024-09-21T12:20:46.132 INFO:tasks.workunit.client.0.smithi003.stdout:2/527: unlink d0/d21/d2f/d49/lb6 0 2024-09-21T12:20:46.132 INFO:tasks.workunit.client.0.smithi003.stdout:9/641: readlink d2/d53/l6b 0 2024-09-21T12:20:46.133 INFO:tasks.workunit.client.0.smithi003.stdout:2/528: fsync d0/dd/f65 0 2024-09-21T12:20:46.134 INFO:tasks.workunit.client.0.smithi003.stdout:3/657: write d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/f90 [53323,84448] 0 2024-09-21T12:20:46.135 INFO:tasks.workunit.client.0.smithi003.stdout:4/493: creat d9/da/fa5 x:0 0 0 2024-09-21T12:20:46.135 INFO:tasks.workunit.client.0.smithi003.stdout:2/529: chown d0/d21/d2c/d63/fb0 60018181 1 2024-09-21T12:20:46.136 INFO:tasks.workunit.client.0.smithi003.stdout:7/523: mkdir d8/db/d32/d43/d7e/dad/db2/dbf 0 2024-09-21T12:20:46.136 INFO:tasks.workunit.client.0.smithi003.stdout:4/494: write d9/da/fd [5158558,36358] 0 2024-09-21T12:20:46.137 INFO:tasks.workunit.client.0.smithi003.stdout:7/524: dread - d8/d93/fb4 zero size 2024-09-21T12:20:46.138 INFO:tasks.workunit.client.0.smithi003.stdout:6/720: fsync d4/d11/d32/f5f 0 2024-09-21T12:20:46.140 INFO:tasks.workunit.client.0.smithi003.stdout:0/719: fdatasync d9/d12/d1e/d5f/d8a/fb4 0 2024-09-21T12:20:46.143 INFO:tasks.workunit.client.0.smithi003.stdout:8/552: read d7/df/d36/f41 [4124708,85770] 0 2024-09-21T12:20:46.144 INFO:tasks.workunit.client.0.smithi003.stdout:1/612: truncate d4/df/d41/f60 81977 0 2024-09-21T12:20:46.145 INFO:tasks.workunit.client.0.smithi003.stdout:8/553: readlink d7/lb 0 2024-09-21T12:20:46.146 INFO:tasks.workunit.client.0.smithi003.stdout:9/642: creat d2/da/d2a/d3c/da8/ff2 x:0 0 0 2024-09-21T12:20:46.148 INFO:tasks.workunit.client.0.smithi003.stdout:2/530: creat d0/d21/d2f/d9f/fbd x:0 0 0 2024-09-21T12:20:46.148 INFO:tasks.workunit.client.0.smithi003.stdout:4/495: dwrite d9/f18 [0,4194304] 0 2024-09-21T12:20:46.153 INFO:tasks.workunit.client.0.smithi003.stdout:9/643: dread - d2/da/d35/d76/fc0 zero size 2024-09-21T12:20:46.156 INFO:tasks.workunit.client.0.smithi003.stdout:7/525: write d8/db/d13/f3a [755803,106700] 0 2024-09-21T12:20:46.157 INFO:tasks.workunit.client.0.smithi003.stdout:6/721: dwrite d4/d11/d1d/d36/f85 [0,4194304] 0 2024-09-21T12:20:46.161 INFO:tasks.workunit.client.0.smithi003.stdout:8/554: creat d7/de/d1a/fc9 x:0 0 0 2024-09-21T12:20:46.161 INFO:tasks.workunit.client.0.smithi003.stdout:3/658: creat d0/d5/da/d28/d11/d49/d4c/d54/d5e/dd2/fd8 x:0 0 0 2024-09-21T12:20:46.162 INFO:tasks.workunit.client.0.smithi003.stdout:1/613: dwrite d4/dc/fcc [0,4194304] 0 2024-09-21T12:20:46.164 INFO:tasks.workunit.client.0.smithi003.stdout:1/614: dread - d4/d11/d14/fab zero size 2024-09-21T12:20:46.167 INFO:tasks.workunit.client.0.smithi003.stdout:3/659: chown d0/d5/da/d28/d11/d49/d4c/d54/d5e/d48 68283035 1 2024-09-21T12:20:46.172 INFO:tasks.workunit.client.0.smithi003.stdout:9/644: fdatasync d2/da/d17/fa9 0 2024-09-21T12:20:46.173 INFO:tasks.workunit.client.0.smithi003.stdout:6/722: dwrite d4/d9/d59/f77 [0,4194304] 0 2024-09-21T12:20:46.174 INFO:tasks.workunit.client.0.smithi003.stdout:8/555: creat d7/df/d16/fca x:0 0 0 2024-09-21T12:20:46.175 INFO:tasks.workunit.client.0.smithi003.stdout:1/615: stat d4/d11/c34 0 2024-09-21T12:20:46.179 INFO:tasks.workunit.client.0.smithi003.stdout:8/556: write d7/d57/d77/fa8 [2060956,21162] 0 2024-09-21T12:20:46.180 INFO:tasks.workunit.client.0.smithi003.stdout:2/531: creat d0/d21/d2f/d77/d7f/daa/fbe x:0 0 0 2024-09-21T12:20:46.182 INFO:tasks.workunit.client.0.smithi003.stdout:2/532: chown d0/d1c 527 1 2024-09-21T12:20:46.184 INFO:tasks.workunit.client.0.smithi003.stdout:2/533: dread - d0/d21/d2f/d9f/fb9 zero size 2024-09-21T12:20:46.184 INFO:tasks.workunit.client.0.smithi003.stdout:6/723: truncate d4/d13/d19/d38/fb3 645850 0 2024-09-21T12:20:46.189 INFO:tasks.workunit.client.0.smithi003.stdout:9/645: fdatasync d2/da/d35/f79 0 2024-09-21T12:20:46.196 INFO:tasks.workunit.client.0.smithi003.stdout:6/724: creat d4/d11/dc1/d64/ff7 x:0 0 0 2024-09-21T12:20:46.199 INFO:tasks.workunit.client.0.smithi003.stdout:1/616: mknod d4/cd6 0 2024-09-21T12:20:46.205 INFO:tasks.workunit.client.0.smithi003.stdout:3/660: creat d0/d5/da/d28/d11/d49/d4c/fd9 x:0 0 0 2024-09-21T12:20:46.206 INFO:tasks.workunit.client.0.smithi003.stdout:6/725: dread f3 [0,4194304] 0 2024-09-21T12:20:46.207 INFO:tasks.workunit.client.0.smithi003.stdout:1/617: chown d4/df/d12/fa1 485 1 2024-09-21T12:20:46.210 INFO:tasks.workunit.client.0.smithi003.stdout:3/661: chown d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/d77/fbe 123134 1 2024-09-21T12:20:46.212 INFO:tasks.workunit.client.0.smithi003.stdout:0/720: dread d9/d12/d17/d21/f42 [4194304,4194304] 0 2024-09-21T12:20:46.212 INFO:tasks.workunit.client.0.smithi003.stdout:6/726: mknod d4/d13/d19/d23/cf8 0 2024-09-21T12:20:46.218 INFO:tasks.workunit.client.0.smithi003.stdout:6/727: mkdir d4/d11/dc1/d58/df9 0 2024-09-21T12:20:46.220 INFO:tasks.workunit.client.0.smithi003.stdout:8/557: dread d7/de/d85/f88 [0,4194304] 0 2024-09-21T12:20:46.221 INFO:tasks.workunit.client.0.smithi003.stdout:8/558: fsync d7/df/d20/fa2 0 2024-09-21T12:20:46.223 INFO:tasks.workunit.client.0.smithi003.stdout:8/559: chown d7/de/d1a/f87 21367 1 2024-09-21T12:20:46.225 INFO:tasks.workunit.client.0.smithi003.stdout:0/721: symlink d9/d6c/d32/dc3/deb/l104 0 2024-09-21T12:20:46.225 INFO:tasks.workunit.client.0.smithi003.stdout:8/560: write d7/df/d20/d21/d4c/d4d/f92 [488355,23422] 0 2024-09-21T12:20:46.229 INFO:tasks.workunit.client.0.smithi003.stdout:1/618: rename d4/d11/d14/d25/d42/d63/f94 to d4/df/fd7 0 2024-09-21T12:20:46.234 INFO:tasks.workunit.client.0.smithi003.stdout:1/619: write d4/dc/f16 [5162081,78623] 0 2024-09-21T12:20:46.234 INFO:tasks.workunit.client.0.smithi003.stdout:6/728: mkdir d4/d11/d1d/deb/dfa 0 2024-09-21T12:20:46.238 INFO:tasks.workunit.client.0.smithi003.stdout:9/646: dread d2/f86 [0,4194304] 0 2024-09-21T12:20:46.241 INFO:tasks.workunit.client.0.smithi003.stdout:1/620: chown d4/d11/d14/d25/d59/f92 1383925 1 2024-09-21T12:20:46.243 INFO:tasks.workunit.client.0.smithi003.stdout:1/621: stat d4/df/d41/f54 0 2024-09-21T12:20:46.244 INFO:tasks.workunit.client.0.smithi003.stdout:0/722: dwrite d9/d12/d17/d21/f9f [0,4194304] 0 2024-09-21T12:20:46.246 INFO:tasks.workunit.client.0.smithi003.stdout:0/723: stat d9/d6c/d32/dc3/deb 0 2024-09-21T12:20:46.249 INFO:tasks.workunit.client.0.smithi003.stdout:1/622: creat d4/d11/d14/d78/fd8 x:0 0 0 2024-09-21T12:20:46.250 INFO:tasks.workunit.client.0.smithi003.stdout:9/647: dwrite d2/da/d2a/d3c/da2/fd3 [0,4194304] 0 2024-09-21T12:20:46.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:45 smithi192 ceph-mon[35641]: pgmap v9: 65 pgs: 65 active+clean; 3.1 GiB data, 9.4 GiB used, 527 GiB / 536 GiB avail; 61 MiB/s rd, 174 MiB/s wr, 383 op/s 2024-09-21T12:20:46.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:45 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' 2024-09-21T12:20:46.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:45 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' 2024-09-21T12:20:46.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:45 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:20:46.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:45 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:20:46.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:45 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:20:46.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:45 smithi192 ceph-mon[35641]: Adjusting osd_memory_target on smithi192 to 2240M 2024-09-21T12:20:46.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:45 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' 2024-09-21T12:20:46.259 INFO:tasks.workunit.client.0.smithi003.stdout:1/623: dwrite f2 [0,4194304] 0 2024-09-21T12:20:46.261 INFO:tasks.workunit.client.0.smithi003.stdout:0/724: link c7 d9/d12/d17/d38/d3a/d46/d55/db0/c105 0 2024-09-21T12:20:46.263 INFO:tasks.workunit.client.0.smithi003.stdout:6/729: dread d4/d11/dc1/f2d [0,4194304] 0 2024-09-21T12:20:46.264 INFO:tasks.workunit.client.0.smithi003.stdout:9/648: link d2/da/d2a/d3c/da2/daf/f7b d2/d53/d75/ff3 0 2024-09-21T12:20:46.265 INFO:tasks.workunit.client.0.smithi003.stdout:1/624: truncate d4/d11/d14/d78/fd8 605414 0 2024-09-21T12:20:46.266 INFO:tasks.workunit.client.0.smithi003.stdout:0/725: mkdir d9/d6c/d26/d54/d7e/dde/d106 0 2024-09-21T12:20:46.271 INFO:tasks.workunit.client.0.smithi003.stdout:4/496: write d9/da/d47/f5c [102229,99823] 0 2024-09-21T12:20:46.272 INFO:tasks.workunit.client.0.smithi003.stdout:6/730: dwrite d4/d9/f45 [0,4194304] 0 2024-09-21T12:20:46.273 INFO:tasks.workunit.client.0.smithi003.stdout:4/497: dread - d9/d16/d65/f9f zero size 2024-09-21T12:20:46.274 INFO:tasks.workunit.client.0.smithi003.stdout:4/498: readlink d9/da/d47/d4b/l5f 0 2024-09-21T12:20:46.275 INFO:tasks.workunit.client.0.smithi003.stdout:1/625: getdents d4/d11/d49/daf 0 2024-09-21T12:20:46.277 INFO:tasks.workunit.client.0.smithi003.stdout:6/731: rmdir d4/d13/d19 39 2024-09-21T12:20:46.279 INFO:tasks.workunit.client.0.smithi003.stdout:1/626: dread - d4/d11/d14/d25/d42/f89 zero size 2024-09-21T12:20:46.282 INFO:tasks.workunit.client.0.smithi003.stdout:6/732: mkdir d4/d11/d1d/db9/dfb 0 2024-09-21T12:20:46.284 INFO:tasks.workunit.client.0.smithi003.stdout:4/499: dwrite d9/da/d36/d55/d79/f87 [0,4194304] 0 2024-09-21T12:20:46.287 INFO:tasks.workunit.client.0.smithi003.stdout:3/662: write d0/d5/da/d28/f88 [702923,19651] 0 2024-09-21T12:20:46.287 INFO:tasks.workunit.client.0.smithi003.stdout:4/500: chown d9/d16/d65/f8e 84553783 1 2024-09-21T12:20:46.290 INFO:tasks.workunit.client.0.smithi003.stdout:4/501: write d9/fc [2930659,51546] 0 2024-09-21T12:20:46.292 INFO:tasks.workunit.client.0.smithi003.stdout:1/627: dwrite d4/d11/d49/fcb [0,4194304] 0 2024-09-21T12:20:46.292 INFO:tasks.workunit.client.0.smithi003.stdout:6/733: creat d4/d9/d59/dba/ffc x:0 0 0 2024-09-21T12:20:46.295 INFO:tasks.workunit.client.0.smithi003.stdout:0/726: rename d9/d6c/d32/dc3 to d9/d6c/d26/d54/d7e/dde/d106/d107 0 2024-09-21T12:20:46.299 INFO:tasks.workunit.client.0.smithi003.stdout:4/502: creat d9/d25/fa6 x:0 0 0 2024-09-21T12:20:46.300 INFO:tasks.workunit.client.0.smithi003.stdout:8/561: write d7/df/d16/f91 [956082,72961] 0 2024-09-21T12:20:46.303 INFO:tasks.workunit.client.0.smithi003.stdout:6/734: dwrite d4/d13/d63/fcd [0,4194304] 0 2024-09-21T12:20:46.304 INFO:tasks.workunit.client.0.smithi003.stdout:1/628: creat d4/d11/d14/d78/fd9 x:0 0 0 2024-09-21T12:20:46.306 INFO:tasks.workunit.client.0.smithi003.stdout:3/663: unlink d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/f6a 0 2024-09-21T12:20:46.310 INFO:tasks.workunit.client.0.smithi003.stdout:8/562: unlink d7/df/d20/d24/d47/c55 0 2024-09-21T12:20:46.311 INFO:tasks.workunit.client.0.smithi003.stdout:8/563: truncate d7/df/d20/fc5 756434 0 2024-09-21T12:20:46.312 INFO:tasks.workunit.client.0.smithi003.stdout:4/503: readlink d9/da/d47/d82/l90 0 2024-09-21T12:20:46.315 INFO:tasks.workunit.client.0.smithi003.stdout:6/735: rmdir d4/d13/d5b 39 2024-09-21T12:20:46.316 INFO:tasks.workunit.client.0.smithi003.stdout:6/736: dread - d4/d13/d56/ff4 zero size 2024-09-21T12:20:46.317 INFO:tasks.workunit.client.0.smithi003.stdout:1/629: creat d4/d11/db1/fda x:0 0 0 2024-09-21T12:20:46.319 INFO:tasks.workunit.client.0.smithi003.stdout:4/504: rmdir d9/da/d66 39 2024-09-21T12:20:46.320 INFO:tasks.workunit.client.0.smithi003.stdout:8/564: dwrite d7/de/d1a/fc9 [0,4194304] 0 2024-09-21T12:20:46.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:45 smithi003 ceph-mon[28057]: pgmap v9: 65 pgs: 65 active+clean; 3.1 GiB data, 9.4 GiB used, 527 GiB / 536 GiB avail; 61 MiB/s rd, 174 MiB/s wr, 383 op/s 2024-09-21T12:20:46.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:45 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' 2024-09-21T12:20:46.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:45 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' 2024-09-21T12:20:46.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:45 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:20:46.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:45 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:20:46.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:45 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:20:46.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:45 smithi003 ceph-mon[28057]: Adjusting osd_memory_target on smithi192 to 2240M 2024-09-21T12:20:46.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:45 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' 2024-09-21T12:20:46.429 INFO:tasks.workunit.client.0.smithi003.stdout:0/727: rename d9/d12/d17/d38/d3a/d46/d55/d67 to d9/d12/d1e/d108 0 2024-09-21T12:20:46.430 INFO:tasks.workunit.client.0.smithi003.stdout:8/565: write d7/de/d85/fb2 [3766550,117802] 0 2024-09-21T12:20:46.432 INFO:tasks.workunit.client.0.smithi003.stdout:0/728: chown d9/d6c/d26/d54/d7e/dde/d106/d107/d102 381 1 2024-09-21T12:20:46.433 INFO:tasks.workunit.client.0.smithi003.stdout:4/505: dread d9/d16/f3d [0,4194304] 0 2024-09-21T12:20:46.447 INFO:tasks.workunit.client.0.smithi003.stdout:4/506: dread d9/da/f31 [0,4194304] 0 2024-09-21T12:20:46.450 INFO:tasks.workunit.client.0.smithi003.stdout:1/630: unlink d4/d11/d14/d25/d42/f57 0 2024-09-21T12:20:46.451 INFO:tasks.workunit.client.0.smithi003.stdout:8/566: fdatasync d7/de/f3e 0 2024-09-21T12:20:46.452 INFO:tasks.workunit.client.0.smithi003.stdout:8/567: chown d7/de/d85/fb2 289246586 1 2024-09-21T12:20:46.453 INFO:tasks.workunit.client.0.smithi003.stdout:0/729: chown d9/d12/d17/d38/d3a/c75 361 1 2024-09-21T12:20:46.454 INFO:tasks.workunit.client.0.smithi003.stdout:3/664: getdents d0/d5/da/d28/d11/d49/d94 0 2024-09-21T12:20:46.456 INFO:tasks.workunit.client.0.smithi003.stdout:8/568: mknod d7/df/d20/d24/d47/ccb 0 2024-09-21T12:20:46.456 INFO:tasks.workunit.client.0.smithi003.stdout:0/730: symlink d9/d12/d17/d21/l109 0 2024-09-21T12:20:46.458 INFO:tasks.workunit.client.0.smithi003.stdout:0/731: readlink d9/d12/d17/d38/d3a/d46/d55/d57/l7d 0 2024-09-21T12:20:46.458 INFO:tasks.workunit.client.0.smithi003.stdout:6/737: getdents d4/d13/d2e/de3 0 2024-09-21T12:20:46.459 INFO:tasks.workunit.client.0.smithi003.stdout:1/631: symlink d4/df/ldb 0 2024-09-21T12:20:46.461 INFO:tasks.workunit.client.0.smithi003.stdout:8/569: mknod d7/df/d20/d21/d4c/d4d/d75/ccc 0 2024-09-21T12:20:46.462 INFO:tasks.workunit.client.0.smithi003.stdout:6/738: readlink d4/d13/d5b/l78 0 2024-09-21T12:20:46.463 INFO:tasks.workunit.client.0.smithi003.stdout:0/732: unlink d9/d12/d1e/d5f/d8a/cd0 0 2024-09-21T12:20:46.466 INFO:tasks.workunit.client.0.smithi003.stdout:8/570: read d7/d57/f71 [68967,24575] 0 2024-09-21T12:20:46.466 INFO:tasks.workunit.client.0.smithi003.stdout:1/632: dread d4/d11/d14/d25/d59/f9f [0,4194304] 0 2024-09-21T12:20:46.468 INFO:tasks.workunit.client.0.smithi003.stdout:0/733: rename d9/d12/c4f to d9/d6c/d66/c10a 0 2024-09-21T12:20:46.470 INFO:tasks.workunit.client.0.smithi003.stdout:3/665: creat d0/d5/da/d28/dd/fda x:0 0 0 2024-09-21T12:20:46.473 INFO:tasks.workunit.client.0.smithi003.stdout:8/571: dwrite d7/df/d20/d24/f2e [0,4194304] 0 2024-09-21T12:20:46.474 INFO:tasks.workunit.client.0.smithi003.stdout:1/633: write d4/df/d19/f4e [3080475,60383] 0 2024-09-21T12:20:46.474 INFO:tasks.workunit.client.0.smithi003.stdout:0/734: creat d9/d12/d17/d38/d3a/d46/d55/d7b/d9a/f10b x:0 0 0 2024-09-21T12:20:46.476 INFO:tasks.workunit.client.0.smithi003.stdout:6/739: link d4/d11/dc1/d64/fe4 d4/d13/d19/d38/ffd 0 2024-09-21T12:20:46.479 INFO:tasks.workunit.client.0.smithi003.stdout:3/666: mkdir d0/d5/d38/d55/ddb 0 2024-09-21T12:20:46.480 INFO:tasks.workunit.client.0.smithi003.stdout:3/667: dread - d0/d5/da/d28/d11/fc1 zero size 2024-09-21T12:20:46.481 INFO:tasks.workunit.client.0.smithi003.stdout:3/668: chown d0/f71 2059910 1 2024-09-21T12:20:46.481 INFO:tasks.workunit.client.0.smithi003.stdout:8/572: creat d7/df/d20/d24/d47/fcd x:0 0 0 2024-09-21T12:20:46.482 INFO:tasks.workunit.client.0.smithi003.stdout:0/735: stat d9/d12/f81 0 2024-09-21T12:20:46.483 INFO:tasks.workunit.client.0.smithi003.stdout:3/669: chown d0/d5/c40 125630121 1 2024-09-21T12:20:46.484 INFO:tasks.workunit.client.0.smithi003.stdout:6/740: mkdir d4/d11/d1d/db9/dfb/dfe 0 2024-09-21T12:20:46.485 INFO:tasks.workunit.client.0.smithi003.stdout:0/736: write d9/d12/d17/d38/d3a/d46/d55/d7b/d9a/f10b [765243,34576] 0 2024-09-21T12:20:46.486 INFO:tasks.workunit.client.0.smithi003.stdout:1/634: creat d4/dc/fdc x:0 0 0 2024-09-21T12:20:46.487 INFO:tasks.workunit.client.0.smithi003.stdout:8/573: write d7/df/d20/d54/d9d/fbe [56608,83821] 0 2024-09-21T12:20:46.491 INFO:tasks.workunit.client.0.smithi003.stdout:8/574: fdatasync d7/df/d36/f5b 0 2024-09-21T12:20:46.492 INFO:tasks.workunit.client.0.smithi003.stdout:8/575: fdatasync d7/f78 0 2024-09-21T12:20:46.493 INFO:tasks.workunit.client.0.smithi003.stdout:6/741: dread d4/f5 [0,4194304] 0 2024-09-21T12:20:46.494 INFO:tasks.workunit.client.0.smithi003.stdout:6/742: chown d4/d13/fd4 189188 1 2024-09-21T12:20:46.495 INFO:tasks.workunit.client.0.smithi003.stdout:0/737: rename d9/d12/f82 to d9/d6c/d26/d54/d7e/dde/d106/d107/deb/f10c 0 2024-09-21T12:20:46.495 INFO:tasks.workunit.client.0.smithi003.stdout:6/743: chown d4/d13/d5b/d8c/faf 15482 1 2024-09-21T12:20:46.496 INFO:tasks.workunit.client.0.smithi003.stdout:3/670: dread d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/d77/fbe [0,4194304] 0 2024-09-21T12:20:46.500 INFO:tasks.workunit.client.0.smithi003.stdout:3/671: unlink d0/f16 0 2024-09-21T12:20:46.500 INFO:tasks.workunit.client.0.smithi003.stdout:8/576: dwrite d7/df/d16/fca [0,4194304] 0 2024-09-21T12:20:46.502 INFO:tasks.workunit.client.0.smithi003.stdout:3/672: write d0/d5/da/d28/dd/fda [487258,26241] 0 2024-09-21T12:20:46.504 INFO:tasks.workunit.client.0.smithi003.stdout:3/673: read - d0/d5/da/d28/d11/d49/d4c/d54/d5e/dd2/fd8 zero size 2024-09-21T12:20:46.507 INFO:tasks.workunit.client.0.smithi003.stdout:3/674: read d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/d77/f9d [878018,48862] 0 2024-09-21T12:20:46.510 INFO:tasks.workunit.client.0.smithi003.stdout:6/744: link d4/d13/d63/fb5 d4/d9/d59/fff 0 2024-09-21T12:20:46.515 INFO:tasks.workunit.client.0.smithi003.stdout:3/675: dwrite d0/d5/da/d28/dd/fda [0,4194304] 0 2024-09-21T12:20:46.519 INFO:tasks.workunit.client.0.smithi003.stdout:8/577: dread d7/df/d20/d21/f3f [0,4194304] 0 2024-09-21T12:20:46.521 INFO:tasks.workunit.client.0.smithi003.stdout:3/676: mkdir d0/d5/da/d28/d31/d6b/ddc 0 2024-09-21T12:20:46.522 INFO:tasks.workunit.client.0.smithi003.stdout:8/578: unlink d7/df/d20/d54/d9d/cad 0 2024-09-21T12:20:46.525 INFO:tasks.workunit.client.0.smithi003.stdout:8/579: rmdir d7/df/d20/d24/d47 39 2024-09-21T12:20:46.529 INFO:tasks.workunit.client.0.smithi003.stdout:8/580: mknod d7/df/d20/d21/d4c/d4d/cce 0 2024-09-21T12:20:46.531 INFO:tasks.workunit.client.0.smithi003.stdout:8/581: read d7/df/d20/d21/f3f [3548734,29272] 0 2024-09-21T12:20:46.534 INFO:tasks.workunit.client.0.smithi003.stdout:1/635: dwrite d4/dc/f67 [0,4194304] 0 2024-09-21T12:20:46.536 INFO:tasks.workunit.client.0.smithi003.stdout:1/636: chown d4/dc/f1c 82157 1 2024-09-21T12:20:46.539 INFO:tasks.workunit.client.0.smithi003.stdout:8/582: rename d7/lc7 to d7/df/d20/d54/lcf 0 2024-09-21T12:20:46.539 INFO:tasks.workunit.client.0.smithi003.stdout:6/745: truncate d4/d9/d59/fff 720553 0 2024-09-21T12:20:46.543 INFO:tasks.workunit.client.0.smithi003.stdout:8/583: truncate d7/df/d20/d21/f45 301006 0 2024-09-21T12:20:46.546 INFO:tasks.workunit.client.0.smithi003.stdout:6/746: mkdir d4/d100 0 2024-09-21T12:20:46.547 INFO:tasks.workunit.client.0.smithi003.stdout:8/584: fsync d7/df/d20/d54/f8e 0 2024-09-21T12:20:46.550 INFO:tasks.workunit.client.0.smithi003.stdout:6/747: readlink d4/l5e 0 2024-09-21T12:20:46.553 INFO:tasks.workunit.client.0.smithi003.stdout:3/677: dwrite d0/d5/da/d28/d11/f44 [0,4194304] 0 2024-09-21T12:20:46.554 INFO:tasks.workunit.client.0.smithi003.stdout:8/585: rmdir d7/d57/d77 39 2024-09-21T12:20:46.563 INFO:tasks.workunit.client.0.smithi003.stdout:1/637: dwrite d4/d11/d14/d25/d42/d7b/f7a [4194304,4194304] 0 2024-09-21T12:20:46.569 INFO:tasks.workunit.client.0.smithi003.stdout:1/638: symlink d4/d66/ldd 0 2024-09-21T12:20:46.569 INFO:tasks.workunit.client.0.smithi003.stdout:3/678: dwrite d0/d5/da/d28/dd/f72 [0,4194304] 0 2024-09-21T12:20:46.570 INFO:tasks.workunit.client.0.smithi003.stdout:8/586: dwrite d7/df/d20/d24/f8d [0,4194304] 0 2024-09-21T12:20:46.575 INFO:tasks.workunit.client.0.smithi003.stdout:8/587: mkdir d7/df/d16/dd0 0 2024-09-21T12:20:46.583 INFO:tasks.workunit.client.0.smithi003.stdout:1/639: dread d4/df/d19/f6f [0,4194304] 0 2024-09-21T12:20:46.583 INFO:tasks.workunit.client.0.smithi003.stdout:6/748: dwrite d4/d9/d79/f9d [4194304,4194304] 0 2024-09-21T12:20:46.586 INFO:tasks.workunit.client.0.smithi003.stdout:3/679: creat d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/d77/dd3/fdd x:0 0 0 2024-09-21T12:20:46.588 INFO:tasks.workunit.client.0.smithi003.stdout:6/749: truncate d4/d13/d63/fd0 708365 0 2024-09-21T12:20:46.589 INFO:tasks.workunit.client.0.smithi003.stdout:8/588: dwrite d7/df/d20/f5a [0,4194304] 0 2024-09-21T12:20:46.590 INFO:tasks.workunit.client.0.smithi003.stdout:1/640: creat d4/d11/d14/fde x:0 0 0 2024-09-21T12:20:46.594 INFO:tasks.workunit.client.0.smithi003.stdout:6/750: creat d4/d100/f101 x:0 0 0 2024-09-21T12:20:46.597 INFO:tasks.workunit.client.0.smithi003.stdout:3/680: dwrite d0/d5/da/d28/d31/d6b/fcd [0,4194304] 0 2024-09-21T12:20:46.627 INFO:tasks.workunit.client.0.smithi003.stdout:6/751: dread d4/fa [0,4194304] 0 2024-09-21T12:20:46.714 INFO:tasks.workunit.client.0.smithi003.stdout:3/681: rename d0/d5/d38/c56 to d0/d5/da/d28/d11/d49/d4c/cde 0 2024-09-21T12:20:46.715 INFO:tasks.workunit.client.0.smithi003.stdout:6/752: symlink d4/d13/d19/l102 0 2024-09-21T12:20:46.740 INFO:tasks.workunit.client.0.smithi003.stdout:5/733: sync 2024-09-21T12:20:46.743 INFO:tasks.workunit.client.0.smithi003.stdout:3/682: rmdir d0/d5/da/d28/d31/d6b/ddc 0 2024-09-21T12:20:46.744 INFO:tasks.workunit.client.0.smithi003.stdout:6/753: dwrite d4/d13/d19/d38/da3/fd8 [0,4194304] 0 2024-09-21T12:20:46.746 INFO:tasks.workunit.client.0.smithi003.stdout:8/589: dwrite d7/df/f49 [0,4194304] 0 2024-09-21T12:20:46.749 INFO:tasks.workunit.client.0.smithi003.stdout:3/683: fdatasync d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/d77/dd3/fdd 0 2024-09-21T12:20:46.752 INFO:tasks.workunit.client.0.smithi003.stdout:8/590: unlink d7/de/f56 0 2024-09-21T12:20:46.752 INFO:tasks.workunit.client.0.smithi003.stdout:8/591: chown d7/de/d81 13636 1 2024-09-21T12:20:46.756 INFO:tasks.workunit.client.0.smithi003.stdout:5/734: rename dc/dd7/d3c/d73/cca to dc/dd7/d41/d5b/ce5 0 2024-09-21T12:20:46.762 INFO:tasks.workunit.client.0.smithi003.stdout:5/735: mknod dc/d15/d6f/ce6 0 2024-09-21T12:20:46.766 INFO:tasks.workunit.client.0.smithi003.stdout:3/684: getdents d0/d5/d38/d55 0 2024-09-21T12:20:46.766 INFO:tasks.workunit.client.0.smithi003.stdout:6/754: dwrite d4/d13/d22/f2b [0,4194304] 0 2024-09-21T12:20:46.766 INFO:tasks.workunit.client.0.smithi003.stdout:5/736: mkdir dc/dd7/d41/d5b/dab/ddd/de7 0 2024-09-21T12:20:46.767 INFO:tasks.workunit.client.0.smithi003.stdout:3/685: mkdir d0/d5/d38/db8/ddf 0 2024-09-21T12:20:46.767 INFO:tasks.workunit.client.0.smithi003.stdout:5/737: chown dc/d15/d1c/l66 330 1 2024-09-21T12:20:46.770 INFO:tasks.workunit.client.0.smithi003.stdout:5/738: truncate dc/dd7/d41/da0/d4b/d5c/fdb 724466 0 2024-09-21T12:20:46.772 INFO:tasks.workunit.client.0.smithi003.stdout:3/686: creat d0/d5/da/d28/d11/d49/d4c/d6f/d91/fe0 x:0 0 0 2024-09-21T12:20:46.773 INFO:tasks.workunit.client.0.smithi003.stdout:6/755: link d4/d11/dc1/d64/l6d d4/d9/l103 0 2024-09-21T12:20:46.774 INFO:tasks.workunit.client.0.smithi003.stdout:5/739: rename dc/f10 to dc/dd7/d41/da0/d4b/d5c/dae/fe8 0 2024-09-21T12:20:46.780 INFO:tasks.workunit.client.0.smithi003.stdout:3/687: mkdir d0/d5/da/d28/de1 0 2024-09-21T12:20:46.781 INFO:tasks.workunit.client.0.smithi003.stdout:5/740: symlink dc/dd7/ddc/le9 0 2024-09-21T12:20:46.782 INFO:tasks.workunit.client.0.smithi003.stdout:8/592: dwrite d7/de/f3e [4194304,4194304] 0 2024-09-21T12:20:46.783 INFO:tasks.workunit.client.0.smithi003.stdout:6/756: creat d4/d11/d32/f104 x:0 0 0 2024-09-21T12:20:46.784 INFO:tasks.workunit.client.0.smithi003.stdout:3/688: write d0/d5/da/d28/d11/d49/d4c/d6f/f8b [285545,36449] 0 2024-09-21T12:20:46.787 INFO:tasks.workunit.client.0.smithi003.stdout:6/757: write d4/d13/fd4 [2405825,24138] 0 2024-09-21T12:20:46.792 INFO:tasks.workunit.client.0.smithi003.stdout:6/758: mkdir d4/d13/d56/d105 0 2024-09-21T12:20:46.794 INFO:tasks.workunit.client.0.smithi003.stdout:3/689: dread - d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/d42/d6d/fd1 zero size 2024-09-21T12:20:46.796 INFO:tasks.workunit.client.0.smithi003.stdout:5/741: dwrite dc/d15/d26/fb8 [0,4194304] 0 2024-09-21T12:20:46.797 INFO:tasks.workunit.client.0.smithi003.stdout:8/593: dwrite d7/de/d52/fbc [0,4194304] 0 2024-09-21T12:20:46.798 INFO:tasks.workunit.client.0.smithi003.stdout:6/759: creat d4/d13/d5b/f106 x:0 0 0 2024-09-21T12:20:46.799 INFO:tasks.workunit.client.0.smithi003.stdout:3/690: read - d0/d5/da/d28/d11/d49/d4c/fd9 zero size 2024-09-21T12:20:46.803 INFO:tasks.workunit.client.0.smithi003.stdout:5/742: chown dc/dd7/d41/da0/f34 14185900 1 2024-09-21T12:20:46.804 INFO:tasks.workunit.client.0.smithi003.stdout:3/691: fdatasync d0/d5/f97 0 2024-09-21T12:20:46.808 INFO:tasks.workunit.client.0.smithi003.stdout:6/760: rename d4/d13/d56/f8f to d4/d13/d63/f107 0 2024-09-21T12:20:46.810 INFO:tasks.workunit.client.0.smithi003.stdout:5/743: symlink dc/dd7/d41/da0/d35/lea 0 2024-09-21T12:20:46.811 INFO:tasks.workunit.client.0.smithi003.stdout:8/594: getdents d7/df/d20/d24/d47/d79/d8f 0 2024-09-21T12:20:46.812 INFO:tasks.workunit.client.0.smithi003.stdout:3/692: rmdir d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/d77 39 2024-09-21T12:20:46.813 INFO:tasks.workunit.client.0.smithi003.stdout:6/761: mkdir d4/d11/d1d/db9/d108 0 2024-09-21T12:20:46.815 INFO:tasks.workunit.client.0.smithi003.stdout:8/595: mkdir d7/df/d20/d54/d9d/dd1 0 2024-09-21T12:20:46.816 INFO:tasks.workunit.client.0.smithi003.stdout:5/744: rename dc/dd7/d41/d5b/d74/d7f/d82/f92 to dc/d15/d6f/feb 0 2024-09-21T12:20:46.818 INFO:tasks.workunit.client.0.smithi003.stdout:3/693: read d0/d5/da/d28/d11/f34 [3335443,27353] 0 2024-09-21T12:20:46.820 INFO:tasks.workunit.client.0.smithi003.stdout:8/596: rename d7/de/d85/f88 to d7/de/d52/fd2 0 2024-09-21T12:20:46.821 INFO:tasks.workunit.client.0.smithi003.stdout:8/597: chown d7/df/d20/d21/l25 1913 1 2024-09-21T12:20:46.821 INFO:tasks.workunit.client.0.smithi003.stdout:5/745: unlink dc/l18 0 2024-09-21T12:20:46.825 INFO:tasks.workunit.client.0.smithi003.stdout:3/694: rename d0/d5/da/d28/d11/d49/d94 to d0/d5/da/d28/d11/d96/de2 0 2024-09-21T12:20:46.827 INFO:tasks.workunit.client.0.smithi003.stdout:3/695: chown d0/d5/da/d28/d31/f7b 19 1 2024-09-21T12:20:46.866 INFO:tasks.workunit.client.0.smithi003.stdout:6/762: getdents d4/d11/d53 0 2024-09-21T12:20:46.868 INFO:tasks.workunit.client.0.smithi003.stdout:5/746: dwrite dc/d15/d1c/f4c [0,4194304] 0 2024-09-21T12:20:46.869 INFO:tasks.workunit.client.0.smithi003.stdout:8/598: truncate d7/f18 1379607 0 2024-09-21T12:20:46.869 INFO:tasks.workunit.client.0.smithi003.stdout:6/763: chown d4/d11/dc1/d98 111 1 2024-09-21T12:20:46.871 INFO:tasks.workunit.client.0.smithi003.stdout:8/599: chown d7/de/d81/fa4 32501037 1 2024-09-21T12:20:46.872 INFO:tasks.workunit.client.0.smithi003.stdout:6/764: write d4/d9/d59/f77 [4741374,123943] 0 2024-09-21T12:20:46.878 INFO:tasks.workunit.client.0.smithi003.stdout:5/747: creat dc/dd7/d41/d5b/d74/fec x:0 0 0 2024-09-21T12:20:46.879 INFO:tasks.workunit.client.0.smithi003.stdout:3/696: dwrite d0/d5/da/d28/d11/f44 [4194304,4194304] 0 2024-09-21T12:20:46.880 INFO:tasks.workunit.client.0.smithi003.stdout:6/765: mknod d4/d11/d1d/db9/d108/c109 0 2024-09-21T12:20:46.882 INFO:tasks.workunit.client.0.smithi003.stdout:3/697: chown d0/f98 466 1 2024-09-21T12:20:46.885 INFO:tasks.workunit.client.0.smithi003.stdout:8/600: dwrite d7/de/d52/f9e [0,4194304] 0 2024-09-21T12:20:46.885 INFO:tasks.workunit.client.0.smithi003.stdout:5/748: mknod dc/dd7/d41/da0/d4b/d5c/dae/ced 0 2024-09-21T12:20:46.885 INFO:tasks.workunit.client.0.smithi003.stdout:3/698: truncate d0/d5/d38/f75 1076140 0 2024-09-21T12:20:46.888 INFO:tasks.workunit.client.0.smithi003.stdout:5/749: chown dc/d15/l87 627 1 2024-09-21T12:20:46.895 INFO:tasks.workunit.client.0.smithi003.stdout:3/699: mkdir d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/de3 0 2024-09-21T12:20:46.898 INFO:tasks.workunit.client.0.smithi003.stdout:5/750: link dc/d15/l1b dc/dd7/d41/d5b/lee 0 2024-09-21T12:20:46.902 INFO:tasks.workunit.client.0.smithi003.stdout:3/700: mknod d0/d5/d38/d55/ddb/ce4 0 2024-09-21T12:20:46.903 INFO:tasks.workunit.client.0.smithi003.stdout:5/751: rmdir dc/dd7/d3c/d73 39 2024-09-21T12:20:46.906 INFO:tasks.workunit.client.0.smithi003.stdout:6/766: write d4/d13/d63/f107 [256331,88383] 0 2024-09-21T12:20:46.908 INFO:tasks.workunit.client.0.smithi003.stdout:3/701: symlink d0/d5/da/d28/d11/d49/d4c/d54/d5e/le5 0 2024-09-21T12:20:46.909 INFO:tasks.workunit.client.0.smithi003.stdout:5/752: mkdir dc/dd7/d3c/d73/def 0 2024-09-21T12:20:46.911 INFO:tasks.workunit.client.0.smithi003.stdout:3/702: symlink d0/d5/da/d28/d11/d49/d4c/d54/d5e/d48/le6 0 2024-09-21T12:20:46.913 INFO:tasks.workunit.client.0.smithi003.stdout:3/703: creat d0/d5/da/d28/d31/d6b/fe7 x:0 0 0 2024-09-21T12:20:46.917 INFO:tasks.workunit.client.0.smithi003.stdout:3/704: read d0/d5/da/d28/d11/d49/f73 [4095172,100486] 0 2024-09-21T12:20:46.918 INFO:tasks.workunit.client.0.smithi003.stdout:8/601: dread d7/de/d1a/f3c [0,4194304] 0 2024-09-21T12:20:46.919 INFO:tasks.workunit.client.0.smithi003.stdout:8/602: fdatasync d7/de/d52/f9e 0 2024-09-21T12:20:46.919 INFO:tasks.workunit.client.0.smithi003.stdout:3/705: creat d0/d5/fe8 x:0 0 0 2024-09-21T12:20:46.923 INFO:tasks.workunit.client.0.smithi003.stdout:3/706: dread d0/d5/f36 [0,4194304] 0 2024-09-21T12:20:46.936 INFO:tasks.workunit.client.0.smithi003.stdout:8/603: dread d7/f8 [4194304,4194304] 0 2024-09-21T12:20:46.938 INFO:tasks.workunit.client.0.smithi003.stdout:3/707: dwrite d0/d5/da/d28/d31/f63 [0,4194304] 0 2024-09-21T12:20:46.945 INFO:tasks.workunit.client.0.smithi003.stdout:8/604: dwrite d7/df/d16/f9a [0,4194304] 0 2024-09-21T12:20:46.946 INFO:tasks.workunit.client.0.smithi003.stdout:3/708: dread - d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/d77/dd3/fdd zero size 2024-09-21T12:20:46.947 INFO:tasks.workunit.client.0.smithi003.stdout:3/709: stat d0/d5/da/d28/d11/d49/l92 0 2024-09-21T12:20:46.947 INFO:tasks.workunit.client.0.smithi003.stdout:3/710: readlink d0/d5/da/d28/d11/d49/l92 0 2024-09-21T12:20:46.949 INFO:tasks.workunit.client.0.smithi003.stdout:8/605: rmdir d7/df/d20/d21 39 2024-09-21T12:20:46.951 INFO:tasks.workunit.client.0.smithi003.stdout:3/711: chown d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/d42/cd7 69393 1 2024-09-21T12:20:46.955 INFO:tasks.workunit.client.0.smithi003.stdout:8/606: creat d7/de/d85/fd3 x:0 0 0 2024-09-21T12:20:46.962 INFO:tasks.workunit.client.0.smithi003.stdout:3/712: dwrite d0/d5/da/d28/d11/d49/d4c/d6f/d91/fe0 [0,4194304] 0 2024-09-21T12:20:46.962 INFO:tasks.workunit.client.0.smithi003.stdout:8/607: dread - d7/df/d20/d21/d4c/d4d/d8c/f95 zero size 2024-09-21T12:20:46.975 INFO:tasks.workunit.client.0.smithi003.stdout:3/713: dread d0/d5/d38/d55/f60 [0,4194304] 0 2024-09-21T12:20:46.977 INFO:tasks.workunit.client.0.smithi003.stdout:3/714: mkdir d0/d5/da/d28/d31/d6b/de9 0 2024-09-21T12:20:46.978 INFO:tasks.workunit.client.0.smithi003.stdout:3/715: rmdir d0/d5/da/d28/d11/d49 39 2024-09-21T12:20:46.983 INFO:tasks.workunit.client.0.smithi003.stdout:3/716: rename d0/d5/da/d28/f33 to d0/d5/da/d28/d11/d49/d4c/d6f/d91/fea 0 2024-09-21T12:20:46.984 INFO:tasks.workunit.client.0.smithi003.stdout:3/717: chown d0/d5/fe8 1289615 1 2024-09-21T12:20:46.988 INFO:tasks.workunit.client.0.smithi003.stdout:3/718: creat d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/daa/feb x:0 0 0 2024-09-21T12:20:46.990 INFO:tasks.workunit.client.0.smithi003.stdout:3/719: rename d0/d5/d38/d55/ddb/ce4 to d0/d5/d38/cec 0 2024-09-21T12:20:46.994 INFO:tasks.workunit.client.0.smithi003.stdout:3/720: creat d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/d77/dd3/fed x:0 0 0 2024-09-21T12:20:46.996 INFO:tasks.workunit.client.0.smithi003.stdout:3/721: creat d0/d5/da/d28/d31/fee x:0 0 0 2024-09-21T12:20:47.005 INFO:tasks.workunit.client.0.smithi003.stdout:3/722: dwrite d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/fb1 [0,4194304] 0 2024-09-21T12:20:47.010 INFO:tasks.workunit.client.0.smithi003.stdout:3/723: write d0/d5/da/d28/d11/d49/d4c/d6f/d91/fea [4416277,65854] 0 2024-09-21T12:20:47.012 INFO:tasks.workunit.client.0.smithi003.stdout:3/724: chown d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/de3 2 1 2024-09-21T12:20:47.021 INFO:tasks.workunit.client.0.smithi003.stdout:3/725: dread d0/d5/da/d28/d11/d49/d4c/f66 [0,4194304] 0 2024-09-21T12:20:47.032 INFO:tasks.workunit.client.0.smithi003.stdout:3/726: fsync d0/d5/da/d28/d31/f67 0 2024-09-21T12:20:47.066 INFO:tasks.workunit.client.0.smithi003.stdout:3/727: rename d0/f71 to d0/d5/da/d28/d31/d6b/fef 0 2024-09-21T12:20:47.066 INFO:tasks.workunit.client.0.smithi003.stdout:3/728: chown d0/d5 3667 1 2024-09-21T12:20:47.086 INFO:tasks.workunit.client.0.smithi003.stdout:3/729: write d0/d5/da/f3f [1080645,5304] 0 2024-09-21T12:20:47.090 INFO:tasks.workunit.client.0.smithi003.stdout:3/730: symlink d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/de3/lf0 0 2024-09-21T12:20:47.094 INFO:tasks.workunit.client.0.smithi003.stdout:3/731: rename d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/c4d to d0/d5/d38/d55/ddb/cf1 0 2024-09-21T12:20:47.095 INFO:tasks.workunit.client.0.smithi003.stdout:3/732: chown d0/c18 1122810 1 2024-09-21T12:20:47.096 INFO:tasks.workunit.client.0.smithi003.stdout:3/733: truncate d0/d5/da/d28/dd/f2b 1686128 0 2024-09-21T12:20:47.098 INFO:tasks.workunit.client.0.smithi003.stdout:3/734: symlink d0/d5/da/d28/d11/d49/d4c/d54/lf2 0 2024-09-21T12:20:47.100 INFO:tasks.workunit.client.0.smithi003.stdout:3/735: write d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/f90 [1108950,3424] 0 2024-09-21T12:20:47.103 INFO:tasks.workunit.client.0.smithi003.stdout:3/736: creat d0/d5/da/d28/d31/d6b/de9/ff3 x:0 0 0 2024-09-21T12:20:47.107 INFO:tasks.workunit.client.0.smithi003.stdout:3/737: symlink d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/lf4 0 2024-09-21T12:20:47.108 INFO:tasks.workunit.client.0.smithi003.stdout:3/738: chown d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/d77/dbb 0 1 2024-09-21T12:20:47.111 INFO:tasks.workunit.client.0.smithi003.stdout:3/739: creat d0/d5/d38/db8/ddf/ff5 x:0 0 0 2024-09-21T12:20:47.112 INFO:tasks.workunit.client.0.smithi003.stdout:3/740: write d0/d5/fe8 [408509,34589] 0 2024-09-21T12:20:47.119 INFO:tasks.workunit.client.0.smithi003.stdout:3/741: dwrite d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/d77/dd3/fdd [0,4194304] 0 2024-09-21T12:20:47.128 INFO:tasks.workunit.client.0.smithi003.stdout:3/742: dwrite d0/d5/da/d28/d11/f1d [0,4194304] 0 2024-09-21T12:20:47.134 INFO:tasks.workunit.client.0.smithi003.stdout:3/743: mknod d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/d42/d6d/d86/cf6 0 2024-09-21T12:20:47.141 INFO:tasks.workunit.client.0.smithi003.stdout:3/744: creat d0/d5/da/d28/ff7 x:0 0 0 2024-09-21T12:20:47.158 INFO:tasks.workunit.client.0.smithi003.stdout:3/745: write d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/f30 [1635580,25129] 0 2024-09-21T12:20:47.192 INFO:tasks.workunit.client.0.smithi003.stdout:7/526: sync 2024-09-21T12:20:47.195 INFO:tasks.workunit.client.0.smithi003.stdout:7/527: unlink d8/d2c/f39 0 2024-09-21T12:20:47.198 INFO:tasks.workunit.client.0.smithi003.stdout:7/528: link d8/d93/fb4 d8/db/d32/d43/d7e/fc0 0 2024-09-21T12:20:47.204 INFO:tasks.workunit.client.0.smithi003.stdout:7/529: dwrite d8/db/d32/d43/f76 [0,4194304] 0 2024-09-21T12:20:47.210 INFO:tasks.workunit.client.0.smithi003.stdout:7/530: unlink d8/db/cd 0 2024-09-21T12:20:47.229 INFO:tasks.workunit.client.0.smithi003.stdout:7/531: dread d8/db/f2b [0,4194304] 0 2024-09-21T12:20:47.231 INFO:tasks.workunit.client.0.smithi003.stdout:7/532: creat d8/d93/fc1 x:0 0 0 2024-09-21T12:20:47.243 INFO:tasks.workunit.client.0.smithi003.stdout:7/533: dwrite d8/d3c/f9a [0,4194304] 0 2024-09-21T12:20:47.244 INFO:tasks.workunit.client.0.smithi003.stdout:7/534: stat d8/db/cba 0 2024-09-21T12:20:47.248 INFO:tasks.workunit.client.0.smithi003.stdout:7/535: creat d8/db/d13/d96/db8/fc2 x:0 0 0 2024-09-21T12:20:47.255 INFO:tasks.workunit.client.0.smithi003.stdout:7/536: rename d8/db/d13/d60/l6c to d8/d31/d84/lc3 0 2024-09-21T12:20:47.274 INFO:tasks.workunit.client.0.smithi003.stdout:7/537: dread d8/db/d32/d43/d7e/f83 [0,4194304] 0 2024-09-21T12:20:47.280 INFO:tasks.workunit.client.0.smithi003.stdout:7/538: dwrite d8/db/d13/f44 [0,4194304] 0 2024-09-21T12:20:47.391 INFO:tasks.workunit.client.0.smithi003.stdout:9/649: sync 2024-09-21T12:20:47.391 INFO:tasks.workunit.client.0.smithi003.stdout:2/534: sync 2024-09-21T12:20:47.393 INFO:tasks.workunit.client.0.smithi003.stdout:9/650: chown d2/d20/d22/d3f/fef 8172 1 2024-09-21T12:20:47.395 INFO:tasks.workunit.client.0.smithi003.stdout:9/651: truncate d2/da/d35/d76/fc0 995747 0 2024-09-21T12:20:47.396 INFO:tasks.workunit.client.0.smithi003.stdout:2/535: rename d0/d21/d2c/ca1 to d0/d46/cbf 0 2024-09-21T12:20:47.396 INFO:tasks.workunit.client.0.smithi003.stdout:9/652: write d2/d53/f6e [716835,7260] 0 2024-09-21T12:20:47.399 INFO:tasks.workunit.client.0.smithi003.stdout:9/653: read d2/da/d2a/d89/f95 [2823865,59524] 0 2024-09-21T12:20:47.402 INFO:tasks.workunit.client.0.smithi003.stdout:9/654: read - d2/d20/d22/d5e/d87/fa6 zero size 2024-09-21T12:20:47.407 INFO:tasks.workunit.client.0.smithi003.stdout:9/655: rename d2/da/d99 to d2/d53/d75/de4/df4 0 2024-09-21T12:20:47.408 INFO:tasks.workunit.client.0.smithi003.stdout:9/656: fsync d2/d53/d75/fb4 0 2024-09-21T12:20:47.412 INFO:tasks.workunit.client.0.smithi003.stdout:2/536: dread d0/d21/d2c/fa0 [0,4194304] 0 2024-09-21T12:20:47.413 INFO:tasks.workunit.client.0.smithi003.stdout:9/657: creat d2/da/d35/d76/ff5 x:0 0 0 2024-09-21T12:20:47.415 INFO:tasks.workunit.client.0.smithi003.stdout:2/537: mkdir d0/d1c/d6a/dc0 0 2024-09-21T12:20:47.418 INFO:tasks.workunit.client.0.smithi003.stdout:2/538: mkdir d0/dd/dc1 0 2024-09-21T12:20:47.419 INFO:tasks.workunit.client.0.smithi003.stdout:9/658: mkdir d2/d53/d83/d96/df6 0 2024-09-21T12:20:47.421 INFO:tasks.workunit.client.0.smithi003.stdout:2/539: chown d0/dd/d22/d68/laf 441 1 2024-09-21T12:20:47.422 INFO:tasks.workunit.client.0.smithi003.stdout:9/659: fdatasync d2/da/d35/f79 0 2024-09-21T12:20:47.423 INFO:tasks.workunit.client.0.smithi003.stdout:9/660: chown d2/da/d35/d4d/c62 17 1 2024-09-21T12:20:47.436 INFO:tasks.workunit.client.0.smithi003.stdout:9/661: getdents d2/da/d2a/d3c/da2 0 2024-09-21T12:20:47.436 INFO:tasks.workunit.client.0.smithi003.stdout:2/540: dread d0/dd/f5a [0,4194304] 0 2024-09-21T12:20:47.441 INFO:tasks.workunit.client.0.smithi003.stdout:9/662: fsync d2/d20/d22/d5e/d87/fee 0 2024-09-21T12:20:47.445 INFO:tasks.workunit.client.0.smithi003.stdout:9/663: symlink d2/da/d2a/d3c/da2/lf7 0 2024-09-21T12:20:47.448 INFO:tasks.workunit.client.0.smithi003.stdout:9/664: write d2/d20/d22/d5e/d87/fee [893015,129028] 0 2024-09-21T12:20:47.451 INFO:tasks.workunit.client.0.smithi003.stdout:2/541: dread d0/f25 [0,4194304] 0 2024-09-21T12:20:47.453 INFO:tasks.workunit.client.0.smithi003.stdout:2/542: symlink d0/d46/lc2 0 2024-09-21T12:20:47.455 INFO:tasks.workunit.client.0.smithi003.stdout:2/543: mknod d0/dd/d22/d68/cc3 0 2024-09-21T12:20:47.460 INFO:tasks.workunit.client.0.smithi003.stdout:2/544: rename d0/d21/d2f/d77 to d0/d21/d2f/d50/dc4 0 2024-09-21T12:20:47.462 INFO:tasks.workunit.client.0.smithi003.stdout:2/545: read d0/dd/d22/d68/f7a [328776,119712] 0 2024-09-21T12:20:47.473 INFO:tasks.workunit.client.0.smithi003.stdout:2/546: write d0/dd/f8c [339303,5306] 0 2024-09-21T12:20:47.476 INFO:tasks.workunit.client.0.smithi003.stdout:2/547: rename d0/d21/d2f/d49/l4c to d0/d21/d2f/d50/dc4/d7f/lc5 0 2024-09-21T12:20:47.476 INFO:tasks.workunit.client.0.smithi003.stdout:4/507: sync 2024-09-21T12:20:47.477 INFO:tasks.workunit.client.0.smithi003.stdout:2/548: readlink d0/d1c/la9 0 2024-09-21T12:20:47.477 INFO:tasks.workunit.client.0.smithi003.stdout:4/508: readlink d9/d25/l2b 0 2024-09-21T12:20:47.477 INFO:tasks.workunit.client.0.smithi003.stdout:4/509: stat d9/da/d47/d4b/f75 0 2024-09-21T12:20:47.481 INFO:tasks.workunit.client.0.smithi003.stdout:2/549: dread d0/f25 [0,4194304] 0 2024-09-21T12:20:47.491 INFO:tasks.workunit.client.0.smithi003.stdout:4/510: dwrite d9/f64 [0,4194304] 0 2024-09-21T12:20:47.492 INFO:tasks.workunit.client.0.smithi003.stdout:2/550: dwrite d0/dd/d22/f23 [4194304,4194304] 0 2024-09-21T12:20:47.499 INFO:tasks.workunit.client.0.smithi003.stdout:4/511: readlink d9/da/d66/d67/l6d 0 2024-09-21T12:20:47.502 INFO:tasks.workunit.client.0.smithi003.stdout:4/512: rename d9/d25/l2c to d9/d25/la7 0 2024-09-21T12:20:47.505 INFO:tasks.workunit.client.0.smithi003.stdout:4/513: creat d9/da/d36/d55/fa8 x:0 0 0 2024-09-21T12:20:47.508 INFO:tasks.workunit.client.0.smithi003.stdout:2/551: dwrite d0/dd/d22/d37/f48 [0,4194304] 0 2024-09-21T12:20:47.512 INFO:tasks.workunit.client.0.smithi003.stdout:4/514: mkdir d9/da/d36/da9 0 2024-09-21T12:20:47.513 INFO:tasks.workunit.client.0.smithi003.stdout:2/552: creat d0/d1c/d6a/fc6 x:0 0 0 2024-09-21T12:20:47.514 INFO:tasks.workunit.client.0.smithi003.stdout:2/553: truncate d0/d21/fb5 227361 0 2024-09-21T12:20:47.515 INFO:tasks.workunit.client.0.smithi003.stdout:4/515: write d9/d16/d65/d73/fa3 [8084739,76788] 0 2024-09-21T12:20:47.518 INFO:tasks.workunit.client.0.smithi003.stdout:4/516: symlink d9/da/d66/d67/laa 0 2024-09-21T12:20:47.532 INFO:tasks.workunit.client.0.smithi003.stdout:4/517: write d9/d16/f70 [624167,115758] 0 2024-09-21T12:20:47.535 INFO:tasks.workunit.client.0.smithi003.stdout:4/518: mkdir d9/da/dab 0 2024-09-21T12:20:47.535 INFO:tasks.workunit.client.0.smithi003.stdout:2/554: dread d0/fc [0,4194304] 0 2024-09-21T12:20:47.536 INFO:tasks.workunit.client.0.smithi003.stdout:2/555: chown d0/ff 58 1 2024-09-21T12:20:47.542 INFO:tasks.workunit.client.0.smithi003.stdout:4/519: dwrite d9/f8a [0,4194304] 0 2024-09-21T12:20:47.544 INFO:tasks.workunit.client.0.smithi003.stdout:4/520: write d9/da/fa5 [224947,17490] 0 2024-09-21T12:20:47.548 INFO:tasks.workunit.client.0.smithi003.stdout:2/556: dwrite d0/d1c/f2e [0,4194304] 0 2024-09-21T12:20:47.550 INFO:tasks.workunit.client.0.smithi003.stdout:2/557: mkdir d0/d21/d2f/d50/dc4/dc7 0 2024-09-21T12:20:47.551 INFO:tasks.workunit.client.0.smithi003.stdout:4/521: getdents d9/da/d36/d8c 0 2024-09-21T12:20:47.551 INFO:tasks.workunit.client.0.smithi003.stdout:2/558: chown d0/d46/lc2 749920 1 2024-09-21T12:20:47.552 INFO:tasks.workunit.client.0.smithi003.stdout:2/559: stat d0/d21/d30/d78/c9c 0 2024-09-21T12:20:47.554 INFO:tasks.workunit.client.0.smithi003.stdout:4/522: rename d9/da/d47/d4b/f8f to d9/da/d66/da2/fac 0 2024-09-21T12:20:47.555 INFO:tasks.workunit.client.0.smithi003.stdout:2/560: rmdir d0/d21/d2f/d50 39 2024-09-21T12:20:47.556 INFO:tasks.workunit.client.0.smithi003.stdout:4/523: dread - d9/d25/f7a zero size 2024-09-21T12:20:47.558 INFO:tasks.workunit.client.0.smithi003.stdout:2/561: creat d0/d21/d2f/d50/fc8 x:0 0 0 2024-09-21T12:20:47.559 INFO:tasks.workunit.client.0.smithi003.stdout:4/524: creat d9/d16/d65/d73/d8d/fad x:0 0 0 2024-09-21T12:20:47.560 INFO:tasks.workunit.client.0.smithi003.stdout:2/562: dread - d0/d21/f91 zero size 2024-09-21T12:20:47.565 INFO:tasks.workunit.client.0.smithi003.stdout:4/525: dwrite d9/da/fb [0,4194304] 0 2024-09-21T12:20:47.567 INFO:tasks.workunit.client.0.smithi003.stdout:2/563: creat d0/d1c/fc9 x:0 0 0 2024-09-21T12:20:47.567 INFO:tasks.workunit.client.0.smithi003.stdout:2/564: chown d0/dd/d22/l80 72 1 2024-09-21T12:20:47.568 INFO:tasks.workunit.client.0.smithi003.stdout:4/526: mknod d9/da/d36/d55/cae 0 2024-09-21T12:20:47.569 INFO:tasks.workunit.client.0.smithi003.stdout:4/527: chown d9/l2d 45002923 1 2024-09-21T12:20:47.571 INFO:tasks.workunit.client.0.smithi003.stdout:4/528: getdents d9/da/d36/d8c 0 2024-09-21T12:20:47.572 INFO:tasks.workunit.client.0.smithi003.stdout:4/529: write d9/f64 [4150962,39965] 0 2024-09-21T12:20:47.577 INFO:tasks.workunit.client.0.smithi003.stdout:4/530: creat d9/d16/d65/d97/faf x:0 0 0 2024-09-21T12:20:47.581 INFO:tasks.workunit.client.0.smithi003.stdout:4/531: mknod d9/da/d66/cb0 0 2024-09-21T12:20:47.581 INFO:tasks.workunit.client.0.smithi003.stdout:4/532: fsync f6 0 2024-09-21T12:20:47.587 INFO:tasks.workunit.client.0.smithi003.stdout:4/533: dwrite f6 [0,4194304] 0 2024-09-21T12:20:47.587 INFO:tasks.workunit.client.0.smithi003.stdout:2/565: write d0/f1d [1613077,20635] 0 2024-09-21T12:20:47.592 INFO:tasks.workunit.client.0.smithi003.stdout:4/534: link d9/da/f57 d9/da/d47/d4b/fb1 0 2024-09-21T12:20:47.594 INFO:tasks.workunit.client.0.smithi003.stdout:2/566: dwrite d0/dd/f84 [0,4194304] 0 2024-09-21T12:20:47.595 INFO:tasks.workunit.client.0.smithi003.stdout:4/535: mkdir d9/da/d66/d67/db2 0 2024-09-21T12:20:47.600 INFO:tasks.workunit.client.0.smithi003.stdout:4/536: fdatasync d9/da/f57 0 2024-09-21T12:20:47.601 INFO:tasks.workunit.client.0.smithi003.stdout:2/567: creat d0/dd/d22/d9d/fca x:0 0 0 2024-09-21T12:20:47.605 INFO:tasks.workunit.client.0.smithi003.stdout:4/537: mknod d9/da/d47/d4b/d72/cb3 0 2024-09-21T12:20:47.605 INFO:tasks.workunit.client.0.smithi003.stdout:2/568: creat d0/d21/d30/fcb x:0 0 0 2024-09-21T12:20:47.609 INFO:tasks.workunit.client.0.smithi003.stdout:4/538: rmdir d9/da 39 2024-09-21T12:20:47.610 INFO:tasks.workunit.client.0.smithi003.stdout:4/539: fsync d9/fc 0 2024-09-21T12:20:47.610 INFO:tasks.workunit.client.0.smithi003.stdout:2/569: mkdir d0/d46/dcc 0 2024-09-21T12:20:47.611 INFO:tasks.workunit.client.0.smithi003.stdout:2/570: chown d0/d21/d30/ca4 47166 1 2024-09-21T12:20:47.614 INFO:tasks.workunit.client.0.smithi003.stdout:4/540: stat d9/da/d66/d67/l6d 0 2024-09-21T12:20:47.621 INFO:tasks.workunit.client.0.smithi003.stdout:2/571: getdents d0/d21/d2f/d50 0 2024-09-21T12:20:47.622 INFO:tasks.workunit.client.0.smithi003.stdout:2/572: chown d0/d21/d2f/d50/dc4/d7f/f88 31 1 2024-09-21T12:20:47.623 INFO:tasks.workunit.client.0.smithi003.stdout:2/573: fdatasync d0/d1c/d6a/f71 0 2024-09-21T12:20:47.626 INFO:tasks.workunit.client.0.smithi003.stdout:4/541: write d9/da/d47/d4b/f56 [668964,26051] 0 2024-09-21T12:20:47.629 INFO:tasks.workunit.client.0.smithi003.stdout:4/542: rename d9/d48/f51 to d9/da/dab/fb4 0 2024-09-21T12:20:47.635 INFO:tasks.workunit.client.0.smithi003.stdout:4/543: dwrite d9/d16/d65/f8e [0,4194304] 0 2024-09-21T12:20:47.636 INFO:tasks.workunit.client.0.smithi003.stdout:4/544: fsync d9/da/f12 0 2024-09-21T12:20:47.640 INFO:tasks.workunit.client.0.smithi003.stdout:4/545: mknod d9/da/dab/cb5 0 2024-09-21T12:20:47.643 INFO:tasks.workunit.client.0.smithi003.stdout:4/546: creat d9/da/d66/d67/fb6 x:0 0 0 2024-09-21T12:20:47.645 INFO:tasks.workunit.client.0.smithi003.stdout:4/547: creat d9/da/dab/fb7 x:0 0 0 2024-09-21T12:20:47.647 INFO:tasks.workunit.client.0.smithi003.stdout:4/548: mknod d9/cb8 0 2024-09-21T12:20:47.648 INFO:tasks.workunit.client.0.smithi003.stdout:4/549: symlink d9/d25/lb9 0 2024-09-21T12:20:47.649 INFO:tasks.workunit.client.0.smithi003.stdout:4/550: chown d9/da/dab 232274462 1 2024-09-21T12:20:47.655 INFO:tasks.workunit.client.0.smithi003.stdout:4/551: dwrite d9/da/fa5 [0,4194304] 0 2024-09-21T12:20:47.666 INFO:tasks.workunit.client.0.smithi003.stdout:4/552: truncate d9/da/f31 2467575 0 2024-09-21T12:20:47.675 INFO:tasks.workunit.client.0.smithi003.stdout:4/553: getdents d9/d16/d65 0 2024-09-21T12:20:47.679 INFO:tasks.workunit.client.0.smithi003.stdout:4/554: mknod d9/da/d36/da9/cba 0 2024-09-21T12:20:47.680 INFO:tasks.workunit.client.0.smithi003.stdout:4/555: dread - d9/d25/f69 zero size 2024-09-21T12:20:47.682 INFO:tasks.workunit.client.0.smithi003.stdout:4/556: mknod d9/da/d36/d8c/cbb 0 2024-09-21T12:20:47.688 INFO:tasks.workunit.client.0.smithi003.stdout:4/557: dwrite d9/f8a [0,4194304] 0 2024-09-21T12:20:47.708 INFO:tasks.workunit.client.0.smithi003.stdout:4/558: dread d9/da/d47/d4b/f75 [0,4194304] 0 2024-09-21T12:20:47.709 INFO:tasks.workunit.client.0.smithi003.stdout:4/559: dread - d9/da/d66/f95 zero size 2024-09-21T12:20:47.840 INFO:tasks.workunit.client.0.smithi003.stdout:1/641: sync 2024-09-21T12:20:47.840 INFO:tasks.workunit.client.0.smithi003.stdout:6/767: sync 2024-09-21T12:20:47.840 INFO:tasks.workunit.client.0.smithi003.stdout:0/738: sync 2024-09-21T12:20:47.892 INFO:tasks.workunit.client.0.smithi003.stdout:0/739: stat d9/cc9 0 2024-09-21T12:20:47.894 INFO:tasks.workunit.client.0.smithi003.stdout:0/740: write d9/d12/d17/d21/d30/ff2 [2397622,81570] 0 2024-09-21T12:20:47.898 INFO:tasks.workunit.client.0.smithi003.stdout:1/642: creat d4/d11/d14/d25/d42/d63/fdf x:0 0 0 2024-09-21T12:20:47.915 INFO:tasks.workunit.client.0.smithi003.stdout:0/741: rename d9/d12/d17/d38/d3a/d46/d55/d57/ld5 to d9/d12/d17/d38/d3a/d46/d55/d9e/l10d 0 2024-09-21T12:20:47.915 INFO:tasks.workunit.client.0.smithi003.stdout:0/742: chown d9/d6c/d66/c7c 2345995 1 2024-09-21T12:20:47.924 INFO:tasks.workunit.client.0.smithi003.stdout:0/743: dwrite d9/d12/d17/d38/d3a/d46/d55/d7b/d9a/f10b [0,4194304] 0 2024-09-21T12:20:47.931 INFO:tasks.workunit.client.0.smithi003.stdout:0/744: dread d9/d12/d17/f6d [0,4194304] 0 2024-09-21T12:20:47.960 INFO:tasks.workunit.client.0.smithi003.stdout:0/745: creat d9/d12/d1e/d108/d2d/f10e x:0 0 0 2024-09-21T12:20:47.973 INFO:tasks.workunit.client.0.smithi003.stdout:6/768: write d4/d13/d22/f89 [4198,56061] 0 2024-09-21T12:20:47.974 INFO:tasks.workunit.client.0.smithi003.stdout:6/769: fdatasync d4/d13/d63/fd0 0 2024-09-21T12:20:47.979 INFO:tasks.workunit.client.0.smithi003.stdout:6/770: getdents d4/d13/d63 0 2024-09-21T12:20:47.982 INFO:tasks.workunit.client.0.smithi003.stdout:6/771: rename d4/d13/d5b/d8c/ff3 to d4/d11/d1d/deb/f10a 0 2024-09-21T12:20:47.984 INFO:tasks.workunit.client.0.smithi003.stdout:6/772: creat d4/d13/d19/d23/f10b x:0 0 0 2024-09-21T12:20:47.984 INFO:tasks.workunit.client.0.smithi003.stdout:6/773: chown d4/d11/d1d/c60 506 1 2024-09-21T12:20:47.986 INFO:tasks.workunit.client.0.smithi003.stdout:1/643: truncate d4/d11/d14/d25/d42/d7b/f7a 924730 0 2024-09-21T12:20:47.997 INFO:tasks.workunit.client.0.smithi003.stdout:1/644: dread d4/f30 [0,4194304] 0 2024-09-21T12:20:47.999 INFO:tasks.workunit.client.0.smithi003.stdout:1/645: truncate d4/f7 1792095 0 2024-09-21T12:20:48.000 INFO:tasks.workunit.client.0.smithi003.stdout:1/646: truncate d4/df/d12/fa1 541989 0 2024-09-21T12:20:48.002 INFO:tasks.workunit.client.0.smithi003.stdout:1/647: creat d4/d11/d14/d25/d42/d63/fe0 x:0 0 0 2024-09-21T12:20:48.006 INFO:tasks.workunit.client.0.smithi003.stdout:1/648: mknod d4/d66/d8b/ce1 0 2024-09-21T12:20:48.009 INFO:tasks.workunit.client.0.smithi003.stdout:1/649: rename d4/d11/d49/fc2 to d4/d11/db1/fe2 0 2024-09-21T12:20:48.011 INFO:tasks.workunit.client.0.smithi003.stdout:1/650: symlink d4/d11/d49/le3 0 2024-09-21T12:20:48.016 INFO:tasks.workunit.client.0.smithi003.stdout:1/651: dwrite d4/df/d41/f7f [4194304,4194304] 0 2024-09-21T12:20:48.018 INFO:tasks.workunit.client.0.smithi003.stdout:1/652: symlink d4/dc/le4 0 2024-09-21T12:20:48.019 INFO:tasks.workunit.client.0.smithi003.stdout:1/653: write d4/d11/d49/fcb [2116170,30194] 0 2024-09-21T12:20:48.020 INFO:tasks.workunit.client.0.smithi003.stdout:1/654: write d4/df/d41/f85 [1569738,67255] 0 2024-09-21T12:20:48.047 INFO:tasks.workunit.client.0.smithi003.stdout:6/774: dread d4/f21 [0,4194304] 0 2024-09-21T12:20:48.048 INFO:tasks.workunit.client.0.smithi003.stdout:6/775: dread - d4/d13/d5b/f106 zero size 2024-09-21T12:20:48.077 INFO:tasks.workunit.client.0.smithi003.stdout:0/746: write d9/d12/de7/ff0 [1598527,108138] 0 2024-09-21T12:20:48.077 INFO:tasks.workunit.client.0.smithi003.stdout:0/747: readlink d9/lf 0 2024-09-21T12:20:48.085 INFO:tasks.workunit.client.0.smithi003.stdout:0/748: dwrite d9/d12/d17/d38/d3a/d46/d55/d7b/d9a/fef [0,4194304] 0 2024-09-21T12:20:48.087 INFO:tasks.workunit.client.0.smithi003.stdout:0/749: chown d9/d12/d17/d38/d3a/d46/d55/d7b/d9a/fef 10428814 1 2024-09-21T12:20:48.088 INFO:tasks.workunit.client.0.smithi003.stdout:6/776: creat d4/d13/d22/f10c x:0 0 0 2024-09-21T12:20:48.091 INFO:tasks.workunit.client.0.smithi003.stdout:6/777: creat d4/d13/d19/d38/f10d x:0 0 0 2024-09-21T12:20:48.095 INFO:tasks.workunit.client.0.smithi003.stdout:6/778: mkdir d4/d13/d10e 0 2024-09-21T12:20:48.099 INFO:tasks.workunit.client.0.smithi003.stdout:6/779: unlink d4/d11/l46 0 2024-09-21T12:20:48.117 INFO:tasks.workunit.client.0.smithi003.stdout:1/655: write d4/d66/f84 [217017,70319] 0 2024-09-21T12:20:48.118 INFO:tasks.workunit.client.0.smithi003.stdout:1/656: read - d4/d11/d14/d25/d59/f82 zero size 2024-09-21T12:20:48.121 INFO:tasks.workunit.client.0.smithi003.stdout:1/657: mknod d4/d66/d8b/ce5 0 2024-09-21T12:20:48.124 INFO:tasks.workunit.client.0.smithi003.stdout:1/658: truncate d4/d11/f4a 4114381 0 2024-09-21T12:20:48.139 INFO:tasks.workunit.client.0.smithi003.stdout:6/780: write d4/d13/d2e/f44 [216501,51676] 0 2024-09-21T12:20:48.144 INFO:tasks.workunit.client.0.smithi003.stdout:6/781: read d4/d13/d63/f71 [3276917,41691] 0 2024-09-21T12:20:48.156 INFO:tasks.workunit.client.0.smithi003.stdout:6/782: rename d4/d11/d32/ld5 to d4/d13/d19/d23/l10f 0 2024-09-21T12:20:48.157 INFO:tasks.workunit.client.0.smithi003.stdout:1/659: dwrite d4/d11/d14/fb9 [0,4194304] 0 2024-09-21T12:20:48.158 INFO:tasks.workunit.client.0.smithi003.stdout:6/783: chown d4/d13 25728 1 2024-09-21T12:20:48.159 INFO:tasks.workunit.client.0.smithi003.stdout:1/660: dread - d4/d11/d14/d25/d42/d63/fcf zero size 2024-09-21T12:20:48.169 INFO:tasks.workunit.client.0.smithi003.stdout:1/661: dread - d4/fbf zero size 2024-09-21T12:20:48.173 INFO:tasks.workunit.client.0.smithi003.stdout:1/662: creat d4/d66/d8b/fe6 x:0 0 0 2024-09-21T12:20:48.173 INFO:tasks.workunit.client.0.smithi003.stdout:1/663: chown d4/df/c79 7114124 1 2024-09-21T12:20:48.175 INFO:tasks.workunit.client.0.smithi003.stdout:1/664: getdents d4/d66/dc7/dce 0 2024-09-21T12:20:48.176 INFO:tasks.workunit.client.0.smithi003.stdout:1/665: write d4/d11/db1/fda [151926,122020] 0 2024-09-21T12:20:48.178 INFO:tasks.workunit.client.0.smithi003.stdout:1/666: unlink d4/dc/ce 0 2024-09-21T12:20:48.182 INFO:tasks.workunit.client.0.smithi003.stdout:1/667: creat d4/df/fe7 x:0 0 0 2024-09-21T12:20:48.183 INFO:tasks.workunit.client.0.smithi003.stdout:1/668: dread - d4/d11/d14/d25/d42/d63/fcf zero size 2024-09-21T12:20:48.186 INFO:tasks.workunit.client.0.smithi003.stdout:6/784: dwrite d4/f10 [0,4194304] 0 2024-09-21T12:20:48.186 INFO:tasks.workunit.client.0.smithi003.stdout:1/669: unlink d4/d66/d8b/fc8 0 2024-09-21T12:20:48.187 INFO:tasks.workunit.client.0.smithi003.stdout:1/670: dread - d4/d11/fc0 zero size 2024-09-21T12:20:48.192 INFO:tasks.workunit.client.0.smithi003.stdout:1/671: mkdir d4/d66/dc7/de8 0 2024-09-21T12:20:48.193 INFO:tasks.workunit.client.0.smithi003.stdout:6/785: creat d4/d13/d2e/de3/df6/f110 x:0 0 0 2024-09-21T12:20:48.194 INFO:tasks.workunit.client.0.smithi003.stdout:6/786: write d4/d9/fef [292561,31374] 0 2024-09-21T12:20:48.195 INFO:tasks.workunit.client.0.smithi003.stdout:1/672: creat d4/d66/dc7/de8/fe9 x:0 0 0 2024-09-21T12:20:48.198 INFO:tasks.workunit.client.0.smithi003.stdout:6/787: symlink d4/d13/d22/dc3/l111 0 2024-09-21T12:20:48.200 INFO:tasks.workunit.client.0.smithi003.stdout:1/673: mknod d4/d11/d49/daf/cea 0 2024-09-21T12:20:48.201 INFO:tasks.workunit.client.0.smithi003.stdout:1/674: chown d4/d11/fbe 137249 1 2024-09-21T12:20:48.202 INFO:tasks.workunit.client.0.smithi003.stdout:6/788: creat d4/d13/d56/f112 x:0 0 0 2024-09-21T12:20:48.204 INFO:tasks.workunit.client.0.smithi003.stdout:6/789: creat d4/d11/d17/f113 x:0 0 0 2024-09-21T12:20:48.207 INFO:tasks.workunit.client.0.smithi003.stdout:6/790: symlink d4/d11/d1d/l114 0 2024-09-21T12:20:48.208 INFO:tasks.workunit.client.0.smithi003.stdout:6/791: dread - d4/d13/d2e/fc8 zero size 2024-09-21T12:20:48.210 INFO:tasks.workunit.client.0.smithi003.stdout:6/792: symlink d4/d11/d1d/deb/dfa/l115 0 2024-09-21T12:20:48.212 INFO:tasks.workunit.client.0.smithi003.stdout:6/793: symlink d4/d13/d19/d23/l116 0 2024-09-21T12:20:48.214 INFO:tasks.workunit.client.0.smithi003.stdout:6/794: creat d4/d13/d5b/d8c/f117 x:0 0 0 2024-09-21T12:20:48.216 INFO:tasks.workunit.client.0.smithi003.stdout:6/795: mknod d4/d11/d1d/db9/dfb/c118 0 2024-09-21T12:20:48.223 INFO:tasks.workunit.client.0.smithi003.stdout:5/753: sync 2024-09-21T12:20:48.227 INFO:tasks.workunit.client.0.smithi003.stdout:1/675: write d4/d11/f50 [1502861,104732] 0 2024-09-21T12:20:48.236 INFO:tasks.workunit.client.0.smithi003.stdout:6/796: truncate d4/d11/d32/fac 1214966 0 2024-09-21T12:20:48.240 INFO:tasks.workunit.client.0.smithi003.stdout:6/797: truncate d4/d11/dc1/d64/f69 869137 0 2024-09-21T12:20:48.244 INFO:tasks.workunit.client.0.smithi003.stdout:5/754: dwrite dc/dd7/d41/da0/f42 [0,4194304] 0 2024-09-21T12:20:48.248 INFO:tasks.workunit.client.0.smithi003.stdout:5/755: chown dc/dd7/d41/c72 5280 1 2024-09-21T12:20:48.250 INFO:tasks.workunit.client.0.smithi003.stdout:1/676: dwrite d4/d11/d14/d25/d42/f55 [0,4194304] 0 2024-09-21T12:20:48.250 INFO:tasks.workunit.client.0.smithi003.stdout:5/756: write dc/d2b/d4e/f70 [130745,119039] 0 2024-09-21T12:20:48.255 INFO:tasks.workunit.client.0.smithi003.stdout:5/757: rmdir dc/dd7/d41/da0/d4b/d5c/dae 39 2024-09-21T12:20:48.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:47 smithi192 ceph-mon[35641]: pgmap v10: 65 pgs: 65 active+clean; 3.1 GiB data, 9.4 GiB used, 527 GiB / 536 GiB avail; 56 MiB/s rd, 160 MiB/s wr, 351 op/s 2024-09-21T12:20:48.259 INFO:tasks.workunit.client.0.smithi003.stdout:5/758: chown dc/d2b/fd4 262687893 1 2024-09-21T12:20:48.259 INFO:tasks.workunit.client.0.smithi003.stdout:1/677: rename d4/d66/d8b/ca0 to d4/df/ceb 0 2024-09-21T12:20:48.261 INFO:tasks.workunit.client.0.smithi003.stdout:5/759: dread - dc/dd7/d41/d5b/d74/fec zero size 2024-09-21T12:20:48.262 INFO:tasks.workunit.client.0.smithi003.stdout:6/798: dwrite d4/d13/d19/d23/f70 [0,4194304] 0 2024-09-21T12:20:48.265 INFO:tasks.workunit.client.0.smithi003.stdout:5/760: creat dc/dd7/d41/ff0 x:0 0 0 2024-09-21T12:20:48.266 INFO:tasks.workunit.client.0.smithi003.stdout:6/799: creat d4/d9/d79/f119 x:0 0 0 2024-09-21T12:20:48.267 INFO:tasks.workunit.client.0.smithi003.stdout:6/800: chown d4/d13/d63/f8d 4776084 1 2024-09-21T12:20:48.268 INFO:tasks.workunit.client.0.smithi003.stdout:5/761: symlink dc/dd7/d41/da0/lf1 0 2024-09-21T12:20:48.269 INFO:tasks.workunit.client.0.smithi003.stdout:5/762: dread - dc/dd7/d41/d5b/fc0 zero size 2024-09-21T12:20:48.281 INFO:tasks.workunit.client.0.smithi003.stdout:6/801: write d4/d9/f50 [3691270,125253] 0 2024-09-21T12:20:48.284 INFO:tasks.workunit.client.0.smithi003.stdout:5/763: truncate dc/d15/d1c/f3e 3177204 0 2024-09-21T12:20:48.286 INFO:tasks.workunit.client.0.smithi003.stdout:6/802: creat d4/d11/d1d/db9/dfb/dfe/f11a x:0 0 0 2024-09-21T12:20:48.288 INFO:tasks.workunit.client.0.smithi003.stdout:5/764: mknod dc/dd7/d3c/cf2 0 2024-09-21T12:20:48.290 INFO:tasks.workunit.client.0.smithi003.stdout:5/765: creat dc/d2b/ff3 x:0 0 0 2024-09-21T12:20:48.292 INFO:tasks.workunit.client.0.smithi003.stdout:6/803: dwrite d4/d11/d32/f3b [0,4194304] 0 2024-09-21T12:20:48.295 INFO:tasks.workunit.client.0.smithi003.stdout:6/804: symlink d4/d11/dc1/d64/l11b 0 2024-09-21T12:20:48.297 INFO:tasks.workunit.client.0.smithi003.stdout:6/805: chown d4/d13/d19/d38/ld9 115691 1 2024-09-21T12:20:48.298 INFO:tasks.workunit.client.0.smithi003.stdout:5/766: dwrite dc/dd7/d41/da0/d4b/d5c/f77 [0,4194304] 0 2024-09-21T12:20:48.298 INFO:tasks.workunit.client.0.smithi003.stdout:6/806: dread - d4/d13/d56/fd2 zero size 2024-09-21T12:20:48.301 INFO:tasks.workunit.client.0.smithi003.stdout:6/807: creat d4/d13/d22/dc3/f11c x:0 0 0 2024-09-21T12:20:48.302 INFO:tasks.workunit.client.0.smithi003.stdout:6/808: readlink d4/d13/d19/d23/l75 0 2024-09-21T12:20:48.304 INFO:tasks.workunit.client.0.smithi003.stdout:5/767: rename dc/dd7/d41/d5b/d74/d7f/f93 to dc/d15/ff4 0 2024-09-21T12:20:48.307 INFO:tasks.workunit.client.0.smithi003.stdout:5/768: creat dc/d15/d21/ff5 x:0 0 0 2024-09-21T12:20:48.308 INFO:tasks.workunit.client.0.smithi003.stdout:5/769: chown dc/dd7/d3c/d73/lc4 2472488 1 2024-09-21T12:20:48.315 INFO:tasks.workunit.client.0.smithi003.stdout:5/770: dread dc/d15/f9a [0,4194304] 0 2024-09-21T12:20:48.319 INFO:tasks.workunit.client.0.smithi003.stdout:5/771: dwrite dc/dd7/d41/da0/f33 [0,4194304] 0 2024-09-21T12:20:48.327 INFO:tasks.workunit.client.0.smithi003.stdout:5/772: link dc/dd7/d3c/d73/lc4 dc/dd7/d41/d5b/dab/ddd/de7/lf6 0 2024-09-21T12:20:48.328 INFO:tasks.workunit.client.0.smithi003.stdout:5/773: chown dc/dd7/d3c/c83 1035417 1 2024-09-21T12:20:48.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:47 smithi003 ceph-mon[28057]: pgmap v10: 65 pgs: 65 active+clean; 3.1 GiB data, 9.4 GiB used, 527 GiB / 536 GiB avail; 56 MiB/s rd, 160 MiB/s wr, 351 op/s 2024-09-21T12:20:48.332 INFO:tasks.workunit.client.0.smithi003.stdout:5/774: link dc/d15/d1c/f23 dc/dd7/d41/da0/d4b/d5c/dae/ff7 0 2024-09-21T12:20:48.334 INFO:tasks.workunit.client.0.smithi003.stdout:5/775: mkdir dc/dd7/d41/da0/df8 0 2024-09-21T12:20:48.611 INFO:tasks.workunit.client.0.smithi003.stdout:3/746: sync 2024-09-21T12:20:48.611 INFO:tasks.workunit.client.0.smithi003.stdout:8/608: sync 2024-09-21T12:20:48.611 INFO:tasks.workunit.client.0.smithi003.stdout:4/560: sync 2024-09-21T12:20:48.611 INFO:tasks.workunit.client.0.smithi003.stdout:9/665: sync 2024-09-21T12:20:48.611 INFO:tasks.workunit.client.0.smithi003.stdout:0/750: sync 2024-09-21T12:20:48.611 INFO:tasks.workunit.client.0.smithi003.stdout:2/574: sync 2024-09-21T12:20:48.611 INFO:tasks.workunit.client.0.smithi003.stdout:7/539: sync 2024-09-21T12:20:48.612 INFO:tasks.workunit.client.0.smithi003.stdout:8/609: stat d7/df/d20/cc6 0 2024-09-21T12:20:48.612 INFO:tasks.workunit.client.0.smithi003.stdout:2/575: fsync d0/d1c/d6a/f71 0 2024-09-21T12:20:48.614 INFO:tasks.workunit.client.0.smithi003.stdout:7/540: read d8/d3c/d57/f65 [6833460,124878] 0 2024-09-21T12:20:48.615 INFO:tasks.workunit.client.0.smithi003.stdout:8/610: write d7/df/d20/d24/f2e [2108926,4899] 0 2024-09-21T12:20:48.618 INFO:tasks.workunit.client.0.smithi003.stdout:3/747: dread d0/d5/da/d28/d11/d49/d4c/d6f/f8b [0,4194304] 0 2024-09-21T12:20:48.619 INFO:tasks.workunit.client.0.smithi003.stdout:3/748: chown d0/d5/da/d28/d31/d6b/d79 69184 1 2024-09-21T12:20:48.620 INFO:tasks.workunit.client.0.smithi003.stdout:4/561: creat d9/da/d47/d82/fbc x:0 0 0 2024-09-21T12:20:48.621 INFO:tasks.workunit.client.0.smithi003.stdout:4/562: fsync d9/da/d36/d55/d79/f87 0 2024-09-21T12:20:48.625 INFO:tasks.workunit.client.0.smithi003.stdout:0/751: creat d9/d12/d17/d38/d47/f10f x:0 0 0 2024-09-21T12:20:48.630 INFO:tasks.workunit.client.0.smithi003.stdout:9/666: truncate d2/da/d2a/f5a 3297640 0 2024-09-21T12:20:48.636 INFO:tasks.workunit.client.0.smithi003.stdout:2/576: rename d0/d21/d2c/d63 to d0/d46/dcd 0 2024-09-21T12:20:48.639 INFO:tasks.workunit.client.0.smithi003.stdout:7/541: mkdir d8/db/d13/d96/db8/dc4 0 2024-09-21T12:20:48.640 INFO:tasks.workunit.client.0.smithi003.stdout:7/542: fsync d8/d3c/d57/d81/fa5 0 2024-09-21T12:20:48.640 INFO:tasks.workunit.client.0.smithi003.stdout:3/749: truncate d0/d5/f5c 715230 0 2024-09-21T12:20:48.640 INFO:tasks.workunit.client.0.smithi003.stdout:7/543: fsync d8/d3c/faa 0 2024-09-21T12:20:48.644 INFO:tasks.workunit.client.0.smithi003.stdout:4/563: unlink d9/f18 0 2024-09-21T12:20:48.645 INFO:tasks.workunit.client.0.smithi003.stdout:4/564: stat d9/da/d47/d4b/d72/l52 0 2024-09-21T12:20:48.645 INFO:tasks.workunit.client.0.smithi003.stdout:7/544: dread d8/d7a/dae/fb6 [0,4194304] 0 2024-09-21T12:20:48.647 INFO:tasks.workunit.client.0.smithi003.stdout:7/545: dread d8/db/d13/d75/fb5 [0,4194304] 0 2024-09-21T12:20:48.651 INFO:tasks.workunit.client.0.smithi003.stdout:0/752: rename d9/d6c/d32/db8/cd9 to d9/d12/d17/d38/d47/c110 0 2024-09-21T12:20:48.652 INFO:tasks.workunit.client.0.smithi003.stdout:3/750: rename d0/d5 to d0/d5/da/d28/dd/d9f/df8 22 2024-09-21T12:20:48.656 INFO:tasks.workunit.client.0.smithi003.stdout:4/565: mkdir d9/da/d36/d8c/dbd 0 2024-09-21T12:20:48.661 INFO:tasks.workunit.client.0.smithi003.stdout:7/546: dread d8/db/f5e [0,4194304] 0 2024-09-21T12:20:48.663 INFO:tasks.workunit.client.0.smithi003.stdout:9/667: dread d2/da/d17/f27 [0,4194304] 0 2024-09-21T12:20:48.664 INFO:tasks.workunit.client.0.smithi003.stdout:1/678: sync 2024-09-21T12:20:48.664 INFO:tasks.workunit.client.0.smithi003.stdout:0/753: symlink d9/d6c/d26/d54/d7e/dde/d106/d107/l111 0 2024-09-21T12:20:48.664 INFO:tasks.workunit.client.0.smithi003.stdout:1/679: chown d4/d11/d14/d25/d42 31169308 1 2024-09-21T12:20:48.668 INFO:tasks.workunit.client.0.smithi003.stdout:8/611: mkdir d7/d57/d77/da5/dd4 0 2024-09-21T12:20:48.670 INFO:tasks.workunit.client.0.smithi003.stdout:3/751: symlink d0/d5/da/d28/d11/d49/d4c/d54/d5e/d48/lf9 0 2024-09-21T12:20:48.671 INFO:tasks.workunit.client.0.smithi003.stdout:9/668: dwrite d2/d53/f90 [0,4194304] 0 2024-09-21T12:20:48.675 INFO:tasks.workunit.client.0.smithi003.stdout:4/566: mkdir d9/da/d66/dbe 0 2024-09-21T12:20:48.680 INFO:tasks.workunit.client.0.smithi003.stdout:1/680: rmdir d4/d11/d14/d25/d59 39 2024-09-21T12:20:48.681 INFO:tasks.workunit.client.0.smithi003.stdout:0/754: truncate d9/d12/d17/d38/d3a/d46/d55/d9e/fc8 744022 0 2024-09-21T12:20:48.682 INFO:tasks.workunit.client.0.smithi003.stdout:8/612: mkdir d7/df/d20/d21/dd5 0 2024-09-21T12:20:48.684 INFO:tasks.workunit.client.0.smithi003.stdout:1/681: dread d4/d11/d14/fb9 [0,4194304] 0 2024-09-21T12:20:48.720 INFO:tasks.workunit.client.0.smithi003.stdout:9/669: unlink d2/l7 0 2024-09-21T12:20:48.720 INFO:tasks.workunit.client.0.smithi003.stdout:1/682: truncate d4/d11/d14/d25/d42/d63/fe0 90366 0 2024-09-21T12:20:48.721 INFO:tasks.workunit.client.0.smithi003.stdout:2/577: getdents d0/dd/d22/d8b 0 2024-09-21T12:20:48.721 INFO:tasks.workunit.client.0.smithi003.stdout:7/547: mkdir d8/d31/d84/da9/dc5 0 2024-09-21T12:20:48.722 INFO:tasks.workunit.client.0.smithi003.stdout:0/755: unlink l5 0 2024-09-21T12:20:48.723 INFO:tasks.workunit.client.0.smithi003.stdout:4/567: getdents d9/da/d66/d67/db2 0 2024-09-21T12:20:48.723 INFO:tasks.workunit.client.0.smithi003.stdout:1/683: creat d4/d66/fec x:0 0 0 2024-09-21T12:20:48.724 INFO:tasks.workunit.client.0.smithi003.stdout:1/684: fsync d4/d11/f50 0 2024-09-21T12:20:48.725 INFO:tasks.workunit.client.0.smithi003.stdout:8/613: creat d7/df/d16/dd0/fd6 x:0 0 0 2024-09-21T12:20:48.727 INFO:tasks.workunit.client.0.smithi003.stdout:7/548: mknod d8/d3c/d57/d9e/cc6 0 2024-09-21T12:20:48.730 INFO:tasks.workunit.client.0.smithi003.stdout:9/670: mkdir d2/d53/df8 0 2024-09-21T12:20:48.733 INFO:tasks.workunit.client.0.smithi003.stdout:4/568: symlink d9/da/d66/d67/lbf 0 2024-09-21T12:20:48.735 INFO:tasks.workunit.client.0.smithi003.stdout:0/756: rename d9/d12/d17/d38/d3a/d46/d55/d9e/cbb to d9/d6c/d26/d54/df8/c112 0 2024-09-21T12:20:48.735 INFO:tasks.workunit.client.0.smithi003.stdout:0/757: chown d9/d6c/d26/db3 217227498 1 2024-09-21T12:20:48.737 INFO:tasks.workunit.client.0.smithi003.stdout:8/614: mknod d7/df/cd7 0 2024-09-21T12:20:48.739 INFO:tasks.workunit.client.0.smithi003.stdout:1/685: rename d4/d66/dc7/de8 to d4/d66/dc7/ded 0 2024-09-21T12:20:48.743 INFO:tasks.workunit.client.0.smithi003.stdout:7/549: read d8/db/d13/f1a [79859,42697] 0 2024-09-21T12:20:48.745 INFO:tasks.workunit.client.0.smithi003.stdout:9/671: unlink d2/da/d2a/d3c/da2/daf/l88 0 2024-09-21T12:20:48.748 INFO:tasks.workunit.client.0.smithi003.stdout:2/578: dwrite d0/d1c/d6a/fad [0,4194304] 0 2024-09-21T12:20:48.748 INFO:tasks.workunit.client.0.smithi003.stdout:8/615: rename d7/df/d20/d21/f3f to d7/df/d20/d21/d4c/fd8 0 2024-09-21T12:20:48.749 INFO:tasks.workunit.client.0.smithi003.stdout:7/550: dread d8/db/f2b [0,4194304] 0 2024-09-21T12:20:48.750 INFO:tasks.workunit.client.0.smithi003.stdout:2/579: read d0/d21/fb5 [149261,73474] 0 2024-09-21T12:20:48.751 INFO:tasks.workunit.client.0.smithi003.stdout:8/616: write d7/df/d20/fa2 [331267,37768] 0 2024-09-21T12:20:48.754 INFO:tasks.workunit.client.0.smithi003.stdout:2/580: fsync d0/dd/d22/f79 0 2024-09-21T12:20:48.754 INFO:tasks.workunit.client.0.smithi003.stdout:7/551: chown d8/d31/d84/da9/dc5 412 1 2024-09-21T12:20:48.755 INFO:tasks.workunit.client.0.smithi003.stdout:1/686: symlink d4/d11/d14/lee 0 2024-09-21T12:20:48.756 INFO:tasks.workunit.client.0.smithi003.stdout:7/552: read d8/d3c/fb1 [1387139,126465] 0 2024-09-21T12:20:48.757 INFO:tasks.workunit.client.0.smithi003.stdout:7/553: chown d8/d31/d84/da8 1254053 1 2024-09-21T12:20:48.757 INFO:tasks.workunit.client.0.smithi003.stdout:4/569: creat d9/d16/d65/d97/fc0 x:0 0 0 2024-09-21T12:20:48.760 INFO:tasks.workunit.client.0.smithi003.stdout:9/672: truncate d2/da/d17/f7a 1426915 0 2024-09-21T12:20:48.761 INFO:tasks.workunit.client.0.smithi003.stdout:8/617: symlink d7/df/d20/d21/d4c/d4d/d75/ld9 0 2024-09-21T12:20:48.765 INFO:tasks.workunit.client.0.smithi003.stdout:2/581: fdatasync d0/dd/d22/d37/f5c 0 2024-09-21T12:20:48.767 INFO:tasks.workunit.client.0.smithi003.stdout:7/554: dwrite d8/d3c/faa [0,4194304] 0 2024-09-21T12:20:48.768 INFO:tasks.workunit.client.0.smithi003.stdout:4/570: mknod d9/d16/d65/d97/cc1 0 2024-09-21T12:20:48.772 INFO:tasks.workunit.client.0.smithi003.stdout:9/673: dwrite d2/d20/d22/d3f/fc6 [0,4194304] 0 2024-09-21T12:20:48.774 INFO:tasks.workunit.client.0.smithi003.stdout:4/571: read d9/fc [4481589,34639] 0 2024-09-21T12:20:48.776 INFO:tasks.workunit.client.0.smithi003.stdout:2/582: dread d0/dd/f56 [0,4194304] 0 2024-09-21T12:20:48.777 INFO:tasks.workunit.client.0.smithi003.stdout:2/583: fsync d0/ff 0 2024-09-21T12:20:48.783 INFO:tasks.workunit.client.0.smithi003.stdout:7/555: unlink d8/db/l53 0 2024-09-21T12:20:48.786 INFO:tasks.workunit.client.0.smithi003.stdout:0/758: write d9/d12/d17/d21/fa7 [1304894,65943] 0 2024-09-21T12:20:48.789 INFO:tasks.workunit.client.0.smithi003.stdout:9/674: rename d2/d53/fb5 to d2/da/d2a/d3c/da2/ff9 0 2024-09-21T12:20:48.791 INFO:tasks.workunit.client.0.smithi003.stdout:7/556: dwrite d8/db/d32/f5d [0,4194304] 0 2024-09-21T12:20:48.792 INFO:tasks.workunit.client.0.smithi003.stdout:7/557: write d8/d93/fc1 [1036095,26584] 0 2024-09-21T12:20:48.800 INFO:tasks.workunit.client.0.smithi003.stdout:4/572: symlink d9/d16/lc2 0 2024-09-21T12:20:48.804 INFO:tasks.workunit.client.0.smithi003.stdout:8/618: write d7/f8 [5060853,67020] 0 2024-09-21T12:20:48.805 INFO:tasks.workunit.client.0.smithi003.stdout:9/675: rename d2/d20/d22/l47 to d2/d53/d83/lfa 0 2024-09-21T12:20:48.806 INFO:tasks.workunit.client.0.smithi003.stdout:2/584: symlink d0/d21/d2f/lce 0 2024-09-21T12:20:48.807 INFO:tasks.workunit.client.0.smithi003.stdout:4/573: mknod d9/da/d47/d4b/cc3 0 2024-09-21T12:20:48.807 INFO:tasks.workunit.client.0.smithi003.stdout:2/585: write d0/dd/d22/d37/f73 [1513107,56763] 0 2024-09-21T12:20:48.808 INFO:tasks.workunit.client.0.smithi003.stdout:0/759: mknod d9/d12/d17/d38/d3a/c113 0 2024-09-21T12:20:48.811 INFO:tasks.workunit.client.0.smithi003.stdout:8/619: chown d7/df/d20/d21/d4c/d4d/d8c/cc0 475 1 2024-09-21T12:20:48.811 INFO:tasks.workunit.client.0.smithi003.stdout:9/676: unlink d2/da/d2a/c59 0 2024-09-21T12:20:48.815 INFO:tasks.workunit.client.0.smithi003.stdout:4/574: creat d9/da/d36/da9/fc4 x:0 0 0 2024-09-21T12:20:48.816 INFO:tasks.workunit.client.0.smithi003.stdout:4/575: truncate d9/f84 1496983 0 2024-09-21T12:20:48.818 INFO:tasks.workunit.client.0.smithi003.stdout:0/760: mkdir d9/d12/d114 0 2024-09-21T12:20:48.821 INFO:tasks.workunit.client.0.smithi003.stdout:4/576: creat d9/da/d47/d82/fc5 x:0 0 0 2024-09-21T12:20:48.821 INFO:tasks.workunit.client.0.smithi003.stdout:2/586: link d0/d21/d2c/f72 d0/dd/d22/d68/d7e/d97/fcf 0 2024-09-21T12:20:48.824 INFO:tasks.workunit.client.0.smithi003.stdout:0/761: mknod d9/d12/d17/d38/d3a/d46/d55/d7b/d9a/c115 0 2024-09-21T12:20:48.825 INFO:tasks.workunit.client.0.smithi003.stdout:8/620: getdents d7/de 0 2024-09-21T12:20:48.830 INFO:tasks.workunit.client.0.smithi003.stdout:9/677: dread d2/d20/f21 [4194304,4194304] 0 2024-09-21T12:20:48.831 INFO:tasks.workunit.client.0.smithi003.stdout:4/577: dwrite d9/da/d47/d82/fc5 [0,4194304] 0 2024-09-21T12:20:48.831 INFO:tasks.workunit.client.0.smithi003.stdout:8/621: write d7/df/d20/d54/d9d/fbe [918643,6165] 0 2024-09-21T12:20:48.833 INFO:tasks.workunit.client.0.smithi003.stdout:0/762: unlink d9/d12/d17/d38/d3a/d46/d55/d9e/ffe 0 2024-09-21T12:20:48.836 INFO:tasks.workunit.client.0.smithi003.stdout:0/763: chown d9/d12/d1e/d5f/ldb 0 1 2024-09-21T12:20:48.837 INFO:tasks.workunit.client.0.smithi003.stdout:4/578: rename d9/da/d36/d55/cae to d9/da/d47/d4b/d72/cc6 0 2024-09-21T12:20:48.838 INFO:tasks.workunit.client.0.smithi003.stdout:8/622: mknod d7/d57/cda 0 2024-09-21T12:20:48.840 INFO:tasks.workunit.client.0.smithi003.stdout:0/764: dread - d9/d12/d17/d38/d3a/d46/d55/db0/fed zero size 2024-09-21T12:20:48.844 INFO:tasks.workunit.client.0.smithi003.stdout:4/579: mknod d9/da/cc7 0 2024-09-21T12:20:48.846 INFO:tasks.workunit.client.0.smithi003.stdout:8/623: link d7/df/d16/f93 d7/df/d20/d21/d4c/d8a/fdb 0 2024-09-21T12:20:48.847 INFO:tasks.workunit.client.0.smithi003.stdout:0/765: mknod d9/d12/d17/d21/dee/c116 0 2024-09-21T12:20:48.847 INFO:tasks.workunit.client.0.smithi003.stdout:9/678: write d2/d20/d22/fc3 [79809,673] 0 2024-09-21T12:20:48.852 INFO:tasks.workunit.client.0.smithi003.stdout:4/580: mknod d9/da/d36/d8c/dbd/cc8 0 2024-09-21T12:20:48.853 INFO:tasks.workunit.client.0.smithi003.stdout:0/766: mkdir d9/d12/d101/d117 0 2024-09-21T12:20:48.853 INFO:tasks.workunit.client.0.smithi003.stdout:8/624: dwrite d7/de/fa9 [0,4194304] 0 2024-09-21T12:20:48.857 INFO:tasks.workunit.client.0.smithi003.stdout:0/767: mknod d9/d6c/d66/c118 0 2024-09-21T12:20:48.862 INFO:tasks.workunit.client.0.smithi003.stdout:4/581: mknod d9/da/d66/dbe/cc9 0 2024-09-21T12:20:48.863 INFO:tasks.workunit.client.0.smithi003.stdout:4/582: chown d9/da/l74 32879217 1 2024-09-21T12:20:48.863 INFO:tasks.workunit.client.0.smithi003.stdout:0/768: rename d9/d6c/d32/c8f to d9/d12/d101/c119 0 2024-09-21T12:20:48.869 INFO:tasks.workunit.client.0.smithi003.stdout:4/583: fsync d9/d16/f3b 0 2024-09-21T12:20:48.870 INFO:tasks.workunit.client.0.smithi003.stdout:0/769: symlink d9/d12/d114/l11a 0 2024-09-21T12:20:48.872 INFO:tasks.workunit.client.0.smithi003.stdout:0/770: fsync d9/f92 0 2024-09-21T12:20:48.874 INFO:tasks.workunit.client.0.smithi003.stdout:9/679: truncate d2/f10 4396514 0 2024-09-21T12:20:48.875 INFO:tasks.workunit.client.0.smithi003.stdout:0/771: fdatasync f8 0 2024-09-21T12:20:48.881 INFO:tasks.workunit.client.0.smithi003.stdout:8/625: dwrite d7/df/d20/d24/d47/d79/f6c [0,4194304] 0 2024-09-21T12:20:48.883 INFO:tasks.workunit.client.0.smithi003.stdout:9/680: rename d2/d20/d22/d5e/l66 to d2/d20/d22/d5e/d87/de2/lfb 0 2024-09-21T12:20:48.891 INFO:tasks.workunit.client.0.smithi003.stdout:8/626: creat d7/de/d52/fdc x:0 0 0 2024-09-21T12:20:48.895 INFO:tasks.workunit.client.0.smithi003.stdout:8/627: mkdir d7/df/d20/d21/d4c/d4d/d75/ddd 0 2024-09-21T12:20:48.896 INFO:tasks.workunit.client.0.smithi003.stdout:9/681: dread d2/d53/d75/fbd [0,4194304] 0 2024-09-21T12:20:48.899 INFO:tasks.workunit.client.0.smithi003.stdout:9/682: write d2/da/f14 [977155,94808] 0 2024-09-21T12:20:48.904 INFO:tasks.workunit.client.0.smithi003.stdout:0/772: dwrite d9/d6c/d66/f8d [0,4194304] 0 2024-09-21T12:20:48.905 INFO:tasks.workunit.client.0.smithi003.stdout:0/773: readlink d9/l5c 0 2024-09-21T12:20:48.907 INFO:tasks.workunit.client.0.smithi003.stdout:8/628: dwrite d7/df/d20/fa2 [0,4194304] 0 2024-09-21T12:20:48.911 INFO:tasks.workunit.client.0.smithi003.stdout:0/774: fdatasync d9/d12/d1e/f1f 0 2024-09-21T12:20:48.914 INFO:tasks.workunit.client.0.smithi003.stdout:9/683: truncate d2/da/f14 3127102 0 2024-09-21T12:20:48.917 INFO:tasks.workunit.client.0.smithi003.stdout:9/684: symlink d2/d20/d42/dcc/lfc 0 2024-09-21T12:20:48.917 INFO:tasks.workunit.client.0.smithi003.stdout:6/809: sync 2024-09-21T12:20:48.917 INFO:tasks.workunit.client.0.smithi003.stdout:5/776: sync 2024-09-21T12:20:48.919 INFO:tasks.workunit.client.0.smithi003.stdout:6/810: write d4/d13/d19/d23/f70 [224450,128815] 0 2024-09-21T12:20:48.921 INFO:tasks.workunit.client.0.smithi003.stdout:6/811: write d4/d13/d56/ff4 [948346,73345] 0 2024-09-21T12:20:48.925 INFO:tasks.workunit.client.0.smithi003.stdout:6/812: chown d4/d11/d32/fac 338 1 2024-09-21T12:20:48.933 INFO:tasks.workunit.client.0.smithi003.stdout:0/775: write d9/d6c/d26/d54/d88/fba [78384,111843] 0 2024-09-21T12:20:48.936 INFO:tasks.workunit.client.0.smithi003.stdout:0/776: rmdir d9/d12/d17/d21/d30 39 2024-09-21T12:20:48.936 INFO:tasks.workunit.client.0.smithi003.stdout:9/685: write f1 [8221578,54510] 0 2024-09-21T12:20:48.939 INFO:tasks.workunit.client.0.smithi003.stdout:0/777: stat d9/d12/d17/d38/d3a/d46/d55/d9e/cbf 0 2024-09-21T12:20:48.940 INFO:tasks.workunit.client.0.smithi003.stdout:9/686: mkdir d2/d20/d22/d3f/dfd 0 2024-09-21T12:20:48.942 INFO:tasks.workunit.client.0.smithi003.stdout:8/629: dread d7/de/d1a/f68 [0,4194304] 0 2024-09-21T12:20:48.942 INFO:tasks.workunit.client.0.smithi003.stdout:0/778: symlink d9/d6c/d26/d54/d7e/dde/d106/d107/deb/l11b 0 2024-09-21T12:20:48.943 INFO:tasks.workunit.client.0.smithi003.stdout:6/813: write d4/d13/f7e [1015837,105315] 0 2024-09-21T12:20:48.945 INFO:tasks.workunit.client.0.smithi003.stdout:5/777: dread dc/d15/d1c/f4c [0,4194304] 0 2024-09-21T12:20:48.946 INFO:tasks.workunit.client.0.smithi003.stdout:9/687: fsync d2/d53/f8d 0 2024-09-21T12:20:48.946 INFO:tasks.workunit.client.0.smithi003.stdout:0/779: fsync d9/d12/d17/d38/d3a/d46/d55/d7b/d9a/f10b 0 2024-09-21T12:20:48.948 INFO:tasks.workunit.client.0.smithi003.stdout:6/814: creat d4/d13/d19/d38/da3/f11d x:0 0 0 2024-09-21T12:20:48.949 INFO:tasks.workunit.client.0.smithi003.stdout:9/688: chown d2/da/d2a/d3c/da2/ddd/ce9 143431 1 2024-09-21T12:20:48.949 INFO:tasks.workunit.client.0.smithi003.stdout:6/815: fdatasync d4/d13/d22/dc3/f11c 0 2024-09-21T12:20:48.952 INFO:tasks.workunit.client.0.smithi003.stdout:8/630: mkdir d7/df/d20/d21/dd5/dde 0 2024-09-21T12:20:48.953 INFO:tasks.workunit.client.0.smithi003.stdout:8/631: chown d7/df/d20/d24/d47/ccb 575 1 2024-09-21T12:20:48.956 INFO:tasks.workunit.client.0.smithi003.stdout:0/780: rmdir d9/d12/d17/d38/d3a/d46/d55/d9e 39 2024-09-21T12:20:48.957 INFO:tasks.workunit.client.0.smithi003.stdout:9/689: fdatasync d2/da/d2a/d3c/f37 0 2024-09-21T12:20:48.957 INFO:tasks.workunit.client.0.smithi003.stdout:0/781: readlink d9/d6c/d26/d54/d7e/dde/lf1 0 2024-09-21T12:20:48.958 INFO:tasks.workunit.client.0.smithi003.stdout:0/782: chown d9/d6c/d26/f73 797250 1 2024-09-21T12:20:48.958 INFO:tasks.workunit.client.0.smithi003.stdout:9/690: chown d2/da/d2a/d3c/f37 501 1 2024-09-21T12:20:48.965 INFO:tasks.workunit.client.0.smithi003.stdout:6/816: write d4/d11/d32/fdb [1349349,47282] 0 2024-09-21T12:20:48.966 INFO:tasks.workunit.client.0.smithi003.stdout:9/691: rmdir d2/da/d35 39 2024-09-21T12:20:48.969 INFO:tasks.workunit.client.0.smithi003.stdout:8/632: unlink d7/df/d20/d24/d47/d79/l4e 0 2024-09-21T12:20:48.969 INFO:tasks.workunit.client.0.smithi003.stdout:0/783: write d9/d12/d17/d38/d47/f7a [1161350,35936] 0 2024-09-21T12:20:48.970 INFO:tasks.workunit.client.0.smithi003.stdout:5/778: rename dc/dd7/d41/d5b/d74/f7a to dc/dd7/d41/da0/ff9 0 2024-09-21T12:20:48.972 INFO:tasks.workunit.client.0.smithi003.stdout:6/817: symlink d4/d11/d1d/db9/l11e 0 2024-09-21T12:20:48.974 INFO:tasks.workunit.client.0.smithi003.stdout:8/633: symlink d7/de/ldf 0 2024-09-21T12:20:48.978 INFO:tasks.workunit.client.0.smithi003.stdout:0/784: mknod d9/d6c/d26/c11c 0 2024-09-21T12:20:48.978 INFO:tasks.workunit.client.0.smithi003.stdout:5/779: creat dc/d2b/d4e/ffa x:0 0 0 2024-09-21T12:20:48.978 INFO:tasks.workunit.client.0.smithi003.stdout:6/818: mkdir d4/d11/d1d/db9/d108/d11f 0 2024-09-21T12:20:48.979 INFO:tasks.workunit.client.0.smithi003.stdout:5/780: write dc/dd7/d41/da0/f42 [1338518,99800] 0 2024-09-21T12:20:48.982 INFO:tasks.workunit.client.0.smithi003.stdout:9/692: dread d2/f97 [0,4194304] 0 2024-09-21T12:20:48.985 INFO:tasks.workunit.client.0.smithi003.stdout:0/785: rename d9/d6c/d26/d54/d7e/dde/d106/d107/deb to d9/d12/d17/d21/d30/d4d/d11d 0 2024-09-21T12:20:48.994 INFO:tasks.workunit.client.0.smithi003.stdout:8/634: getdents d7/df/d20/d21/d4c/d4d/d75 0 2024-09-21T12:20:48.995 INFO:tasks.workunit.client.0.smithi003.stdout:5/781: dread dc/dd7/d41/da0/d4b/d5c/dae/fe8 [0,4194304] 0 2024-09-21T12:20:48.996 INFO:tasks.workunit.client.0.smithi003.stdout:5/782: fsync dc/d15/d26/fbd 0 2024-09-21T12:20:48.996 INFO:tasks.workunit.client.0.smithi003.stdout:0/786: mknod d9/d6c/d26/d54/d7e/dde/d106/c11e 0 2024-09-21T12:20:48.997 INFO:tasks.workunit.client.0.smithi003.stdout:6/819: write d4/d13/d19/f49 [897756,83029] 0 2024-09-21T12:20:49.001 INFO:tasks.workunit.client.0.smithi003.stdout:9/693: unlink d2/d53/ced 0 2024-09-21T12:20:49.002 INFO:tasks.workunit.client.0.smithi003.stdout:8/635: fdatasync d7/df/d16/f93 0 2024-09-21T12:20:49.003 INFO:tasks.workunit.client.0.smithi003.stdout:8/636: stat d7/df/d20/d21/d4c/d4d/fc8 0 2024-09-21T12:20:49.016 INFO:tasks.workunit.client.0.smithi003.stdout:0/787: mkdir d9/d6c/d26/d54/d7e/dde/d106/d107/d11f 0 2024-09-21T12:20:49.018 INFO:tasks.workunit.client.0.smithi003.stdout:5/783: rename dc/dd7/d41/da0/d90/cb9 to dc/dd7/d41/da0/d4b/cfb 0 2024-09-21T12:20:49.019 INFO:tasks.workunit.client.0.smithi003.stdout:5/784: fsync dc/dd7/d41/da0/d4b/d5c/f99 0 2024-09-21T12:20:49.024 INFO:tasks.workunit.client.0.smithi003.stdout:8/637: rmdir d7/df/d20/d24/d47 39 2024-09-21T12:20:49.028 INFO:tasks.workunit.client.0.smithi003.stdout:9/694: rename d2/da/d17/c28 to d2/da/d35/d4d/cfe 0 2024-09-21T12:20:49.028 INFO:tasks.workunit.client.0.smithi003.stdout:9/695: readlink d2/d20/d42/da5/lcb 0 2024-09-21T12:20:49.030 INFO:tasks.workunit.client.0.smithi003.stdout:6/820: rmdir d4/d11/dc1/d58/df9 0 2024-09-21T12:20:49.032 INFO:tasks.workunit.client.0.smithi003.stdout:9/696: dread d2/da/d17/f8e [0,4194304] 0 2024-09-21T12:20:49.033 INFO:tasks.workunit.client.0.smithi003.stdout:6/821: truncate d4/d11/dc1/d64/fe4 729638 0 2024-09-21T12:20:49.033 INFO:tasks.workunit.client.0.smithi003.stdout:6/822: chown d4/d9/d59 51689 1 2024-09-21T12:20:49.035 INFO:tasks.workunit.client.0.smithi003.stdout:9/697: truncate d2/da/d35/fb0 594540 0 2024-09-21T12:20:49.035 INFO:tasks.workunit.client.0.smithi003.stdout:6/823: truncate d4/d13/f20 4668926 0 2024-09-21T12:20:49.035 INFO:tasks.workunit.client.0.smithi003.stdout:8/638: creat d7/df/d20/fe0 x:0 0 0 2024-09-21T12:20:49.036 INFO:tasks.workunit.client.0.smithi003.stdout:9/698: dread - d2/d53/d83/fdb zero size 2024-09-21T12:20:49.042 INFO:tasks.workunit.client.0.smithi003.stdout:5/785: getdents dc/d2b 0 2024-09-21T12:20:49.042 INFO:tasks.workunit.client.0.smithi003.stdout:0/788: getdents d9/d12/d17/d21 0 2024-09-21T12:20:49.043 INFO:tasks.workunit.client.0.smithi003.stdout:8/639: chown d7/f14 4956 1 2024-09-21T12:20:49.043 INFO:tasks.workunit.client.0.smithi003.stdout:5/786: stat dc/d15/d26/c63 0 2024-09-21T12:20:49.044 INFO:tasks.workunit.client.0.smithi003.stdout:9/699: truncate d2/d53/f6e 4442433 0 2024-09-21T12:20:49.074 INFO:tasks.workunit.client.0.smithi003.stdout:6/824: creat d4/d11/d1d/d36/dae/f120 x:0 0 0 2024-09-21T12:20:49.074 INFO:tasks.workunit.client.0.smithi003.stdout:0/789: chown d9/d6c/d66/c10a 171430 1 2024-09-21T12:20:49.076 INFO:tasks.workunit.client.0.smithi003.stdout:8/640: write d7/df/d20/d21/f50 [3606607,90253] 0 2024-09-21T12:20:49.078 INFO:tasks.workunit.client.0.smithi003.stdout:0/790: truncate d9/d12/d17/d21/d30/ff2 5027154 0 2024-09-21T12:20:49.079 INFO:tasks.workunit.client.0.smithi003.stdout:5/787: mknod dc/dd7/d41/d5b/dab/ddd/de7/cfc 0 2024-09-21T12:20:49.082 INFO:tasks.workunit.client.0.smithi003.stdout:6/825: mkdir d4/d11/d1d/db9/d108/d11f/d121 0 2024-09-21T12:20:49.085 INFO:tasks.workunit.client.0.smithi003.stdout:5/788: fsync dc/d15/d1c/f23 0 2024-09-21T12:20:49.088 INFO:tasks.workunit.client.0.smithi003.stdout:6/826: mkdir d4/d13/d5b/d122 0 2024-09-21T12:20:49.089 INFO:tasks.workunit.client.0.smithi003.stdout:6/827: write d4/d13/d19/f49 [2844991,48448] 0 2024-09-21T12:20:49.090 INFO:tasks.workunit.client.0.smithi003.stdout:8/641: rename d7/df/d20/d21/d4c/d4d/fc8 to d7/de/d81/fe1 0 2024-09-21T12:20:49.092 INFO:tasks.workunit.client.0.smithi003.stdout:5/789: mkdir dc/dd7/d41/d5b/d74/d7f/d82/dfd 0 2024-09-21T12:20:49.093 INFO:tasks.workunit.client.0.smithi003.stdout:8/642: fsync d7/df/d20/d21/d4c/d4d/f92 0 2024-09-21T12:20:49.097 INFO:tasks.workunit.client.0.smithi003.stdout:6/828: dwrite d4/d11/dc1/f6b [0,4194304] 0 2024-09-21T12:20:49.097 INFO:tasks.workunit.client.0.smithi003.stdout:5/790: mkdir dc/dd7/d3c/d73/def/dfe 0 2024-09-21T12:20:49.099 INFO:tasks.workunit.client.0.smithi003.stdout:5/791: write dc/dd7/d41/da0/f55 [1971749,55787] 0 2024-09-21T12:20:49.099 INFO:tasks.workunit.client.0.smithi003.stdout:8/643: rename d7/df/d20/d24/f2e to d7/df/d20/d21/d4c/d4d/d75/ddd/fe2 0 2024-09-21T12:20:49.101 INFO:tasks.workunit.client.0.smithi003.stdout:5/792: readlink dc/dd7/ddc/le9 0 2024-09-21T12:20:49.106 INFO:tasks.workunit.client.0.smithi003.stdout:8/644: rename f4 to d7/df/d20/d21/dd5/dde/fe3 0 2024-09-21T12:20:49.108 INFO:tasks.workunit.client.0.smithi003.stdout:5/793: mknod dc/dd7/d41/d5b/d74/cff 0 2024-09-21T12:20:49.110 INFO:tasks.workunit.client.0.smithi003.stdout:5/794: readlink dc/dd7/d41/da0/d35/lea 0 2024-09-21T12:20:49.114 INFO:tasks.workunit.client.0.smithi003.stdout:8/645: dwrite d7/f78 [0,4194304] 0 2024-09-21T12:20:49.114 INFO:tasks.workunit.client.0.smithi003.stdout:5/795: mknod dc/dd7/d41/da0/d35/c100 0 2024-09-21T12:20:49.115 INFO:tasks.workunit.client.0.smithi003.stdout:5/796: stat dc/dd7/d41/ff0 0 2024-09-21T12:20:49.119 INFO:tasks.workunit.client.0.smithi003.stdout:5/797: mkdir dc/dd7/d41/d5b/d101 0 2024-09-21T12:20:49.135 INFO:tasks.workunit.client.0.smithi003.stdout:6/829: truncate d4/d11/d1d/fbc 203579 0 2024-09-21T12:20:49.137 INFO:tasks.workunit.client.0.smithi003.stdout:6/830: write d4/d13/d19/d23/f3c [1704542,61674] 0 2024-09-21T12:20:49.139 INFO:tasks.workunit.client.0.smithi003.stdout:6/831: write d4/d13/d19/d38/f10d [617621,110068] 0 2024-09-21T12:20:49.143 INFO:tasks.workunit.client.0.smithi003.stdout:8/646: dread d7/df/f49 [0,4194304] 0 2024-09-21T12:20:49.145 INFO:tasks.workunit.client.0.smithi003.stdout:6/832: unlink d4/d11/d1d/l1e 0 2024-09-21T12:20:49.147 INFO:tasks.workunit.client.0.smithi003.stdout:8/647: rmdir d7/df/d20/d54/d9d 39 2024-09-21T12:20:49.151 INFO:tasks.workunit.client.0.smithi003.stdout:6/833: readlink d4/d11/dc1/d64/l6d 0 2024-09-21T12:20:49.152 INFO:tasks.workunit.client.0.smithi003.stdout:6/834: dread - d4/d13/d56/fd2 zero size 2024-09-21T12:20:49.153 INFO:tasks.workunit.client.0.smithi003.stdout:9/700: dwrite d2/da/d35/fb0 [0,4194304] 0 2024-09-21T12:20:49.155 INFO:tasks.workunit.client.0.smithi003.stdout:6/835: dread - d4/d11/d1d/fce zero size 2024-09-21T12:20:49.157 INFO:tasks.workunit.client.0.smithi003.stdout:0/791: write d9/d12/d17/d38/ff4 [8998177,76455] 0 2024-09-21T12:20:49.161 INFO:tasks.workunit.client.0.smithi003.stdout:9/701: rename d2/da/d2a/d3c/da2/fd5 to d2/d20/d22/d5e/d87/de2/fff 0 2024-09-21T12:20:49.163 INFO:tasks.workunit.client.0.smithi003.stdout:8/648: creat d7/fe4 x:0 0 0 2024-09-21T12:20:49.168 INFO:tasks.workunit.client.0.smithi003.stdout:9/702: mknod d2/d53/d75/de4/df4/c100 0 2024-09-21T12:20:49.172 INFO:tasks.workunit.client.0.smithi003.stdout:6/836: creat d4/d11/f123 x:0 0 0 2024-09-21T12:20:49.174 INFO:tasks.workunit.client.0.smithi003.stdout:0/792: symlink d9/d12/de7/l120 0 2024-09-21T12:20:49.176 INFO:tasks.workunit.client.0.smithi003.stdout:9/703: fsync d2/da/d35/f79 0 2024-09-21T12:20:49.177 INFO:tasks.workunit.client.0.smithi003.stdout:9/704: chown d2/d53/f6e 0 1 2024-09-21T12:20:49.177 INFO:tasks.workunit.client.0.smithi003.stdout:8/649: chown d7/df/d20/d21/d4c/d4d/d8c/faf 4153 1 2024-09-21T12:20:49.179 INFO:tasks.workunit.client.0.smithi003.stdout:6/837: rename d4/d11/dc1/f2d to d4/d11/d1d/db9/f124 0 2024-09-21T12:20:49.180 INFO:tasks.workunit.client.0.smithi003.stdout:6/838: chown d4/d11/d17 589125388 1 2024-09-21T12:20:49.184 INFO:tasks.workunit.client.0.smithi003.stdout:9/705: truncate d2/d53/d75/de4/df4/fae 5195896 0 2024-09-21T12:20:49.196 INFO:tasks.workunit.client.0.smithi003.stdout:8/650: creat d7/df/d20/fe5 x:0 0 0 2024-09-21T12:20:49.196 INFO:tasks.workunit.client.0.smithi003.stdout:6/839: link d4/d13/d2e/fc8 d4/d13/d56/d105/f125 0 2024-09-21T12:20:49.200 INFO:tasks.workunit.client.0.smithi003.stdout:9/706: dwrite d2/d20/d22/d5e/d87/de2/fff [0,4194304] 0 2024-09-21T12:20:49.203 INFO:tasks.workunit.client.0.smithi003.stdout:0/793: dread d9/d6c/d32/f6e [0,4194304] 0 2024-09-21T12:20:49.204 INFO:tasks.workunit.client.0.smithi003.stdout:8/651: mkdir d7/df/d20/d21/de6 0 2024-09-21T12:20:49.206 INFO:tasks.workunit.client.0.smithi003.stdout:6/840: truncate d4/f5 844103 0 2024-09-21T12:20:49.210 INFO:tasks.workunit.client.0.smithi003.stdout:5/798: dwrite dc/dd7/d41/da0/d35/f46 [0,4194304] 0 2024-09-21T12:20:49.216 INFO:tasks.workunit.client.0.smithi003.stdout:0/794: creat d9/d12/d17/d38/d3a/d46/f121 x:0 0 0 2024-09-21T12:20:49.223 INFO:tasks.workunit.client.0.smithi003.stdout:0/795: unlink d9/d6c/d26/d54/d88/cea 0 2024-09-21T12:20:49.227 INFO:tasks.workunit.client.0.smithi003.stdout:5/799: dwrite dc/dd7/d41/da0/d4b/fc9 [0,4194304] 0 2024-09-21T12:20:49.235 INFO:tasks.workunit.client.0.smithi003.stdout:5/800: symlink dc/dd7/d41/da0/l102 0 2024-09-21T12:20:49.238 INFO:tasks.workunit.client.0.smithi003.stdout:5/801: creat dc/dd7/d3c/d73/def/f103 x:0 0 0 2024-09-21T12:20:49.242 INFO:tasks.workunit.client.0.smithi003.stdout:9/707: dwrite d2/da/d35/d76/d94/f9b [0,4194304] 0 2024-09-21T12:20:49.243 INFO:tasks.workunit.client.0.smithi003.stdout:9/708: read d2/da/d17/f8e [237044,94932] 0 2024-09-21T12:20:49.250 INFO:tasks.workunit.client.0.smithi003.stdout:9/709: rmdir d2/d53/d83 39 2024-09-21T12:20:49.250 INFO:tasks.workunit.client.0.smithi003.stdout:5/802: dwrite dc/dd7/d41/da0/d4b/d5c/f77 [0,4194304] 0 2024-09-21T12:20:49.253 INFO:tasks.workunit.client.0.smithi003.stdout:8/652: truncate d7/df/d20/fa2 253805 0 2024-09-21T12:20:49.253 INFO:tasks.workunit.client.0.smithi003.stdout:0/796: truncate d9/d12/d1e/d108/f28 3638383 0 2024-09-21T12:20:49.255 INFO:tasks.workunit.client.0.smithi003.stdout:0/797: chown d9/d12/d1e/d108/d2d/ff5 178885 1 2024-09-21T12:20:49.256 INFO:tasks.workunit.client.0.smithi003.stdout:5/803: mkdir dc/dd7/d41/d9f/d104 0 2024-09-21T12:20:49.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:48 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:20:49.260 INFO:tasks.workunit.client.0.smithi003.stdout:5/804: rmdir dc/dd7/d41/d9f 39 2024-09-21T12:20:49.261 INFO:tasks.workunit.client.0.smithi003.stdout:9/710: link d2/d20/c26 d2/d20/d22/c101 0 2024-09-21T12:20:49.262 INFO:tasks.workunit.client.0.smithi003.stdout:0/798: mkdir d9/d122 0 2024-09-21T12:20:49.264 INFO:tasks.workunit.client.0.smithi003.stdout:5/805: write dc/d15/d6f/feb [1706950,83311] 0 2024-09-21T12:20:49.279 INFO:tasks.workunit.client.0.smithi003.stdout:9/711: write d2/da/d2a/d3c/da2/daf/f70 [239880,57953] 0 2024-09-21T12:20:49.280 INFO:tasks.workunit.client.0.smithi003.stdout:0/799: write d9/d12/d17/fe3 [420020,43074] 0 2024-09-21T12:20:49.281 INFO:tasks.workunit.client.0.smithi003.stdout:0/800: readlink d9/d12/l27 0 2024-09-21T12:20:49.287 INFO:tasks.workunit.client.0.smithi003.stdout:8/653: dread d7/df/d20/d21/d4c/d4d/d75/ddd/fe2 [0,4194304] 0 2024-09-21T12:20:49.289 INFO:tasks.workunit.client.0.smithi003.stdout:0/801: write d9/d6c/d32/f62 [1065180,130139] 0 2024-09-21T12:20:49.291 INFO:tasks.workunit.client.0.smithi003.stdout:0/802: write d9/d12/d17/d21/f40 [436862,50580] 0 2024-09-21T12:20:49.293 INFO:tasks.workunit.client.0.smithi003.stdout:9/712: dwrite d2/da/f50 [0,4194304] 0 2024-09-21T12:20:49.294 INFO:tasks.workunit.client.0.smithi003.stdout:9/713: fsync d2/d53/fe0 0 2024-09-21T12:20:49.300 INFO:tasks.workunit.client.0.smithi003.stdout:0/803: chown d9/d12/d101/c119 1280 1 2024-09-21T12:20:49.302 INFO:tasks.workunit.client.0.smithi003.stdout:8/654: truncate d7/df/d16/f9a 1962194 0 2024-09-21T12:20:49.304 INFO:tasks.workunit.client.0.smithi003.stdout:8/655: chown d7/df/d16/f46 3479028 1 2024-09-21T12:20:49.305 INFO:tasks.workunit.client.0.smithi003.stdout:9/714: creat d2/da/f102 x:0 0 0 2024-09-21T12:20:49.307 INFO:tasks.workunit.client.0.smithi003.stdout:8/656: creat d7/df/d16/dd0/fe7 x:0 0 0 2024-09-21T12:20:49.322 INFO:tasks.workunit.client.0.smithi003.stdout:0/804: dread d9/d12/d17/d38/d3a/f72 [0,4194304] 0 2024-09-21T12:20:49.324 INFO:tasks.workunit.client.0.smithi003.stdout:8/657: dread d7/df/d20/d24/f8d [0,4194304] 0 2024-09-21T12:20:49.324 INFO:tasks.workunit.client.0.smithi003.stdout:9/715: write d2/da/d35/fb6 [425743,46361] 0 2024-09-21T12:20:49.329 INFO:tasks.workunit.client.0.smithi003.stdout:0/805: chown d9/d12/d17/d38/d3a/d46/d55/d9e/fc8 835541 1 2024-09-21T12:20:49.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:48 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:20:49.331 INFO:tasks.workunit.client.0.smithi003.stdout:9/716: truncate d2/d20/d42/f5d 478358 0 2024-09-21T12:20:49.335 INFO:tasks.workunit.client.0.smithi003.stdout:9/717: creat d2/d20/d22/d5e/d87/de2/f103 x:0 0 0 2024-09-21T12:20:49.335 INFO:tasks.workunit.client.0.smithi003.stdout:8/658: link d7/df/d36/f5b d7/d57/d77/fe8 0 2024-09-21T12:20:49.337 INFO:tasks.workunit.client.0.smithi003.stdout:0/806: dwrite d9/d12/d1e/d108/d2d/f10e [0,4194304] 0 2024-09-21T12:20:49.338 INFO:tasks.workunit.client.0.smithi003.stdout:0/807: chown d9/d12/d17/f6d 0 1 2024-09-21T12:20:49.340 INFO:tasks.workunit.client.0.smithi003.stdout:9/718: truncate d2/da/d2a/f33 6934990 0 2024-09-21T12:20:49.342 INFO:tasks.workunit.client.0.smithi003.stdout:0/808: mkdir d9/d12/d17/d38/d123 0 2024-09-21T12:20:49.344 INFO:tasks.workunit.client.0.smithi003.stdout:8/659: dwrite d7/de/fa9 [0,4194304] 0 2024-09-21T12:20:49.363 INFO:tasks.workunit.client.0.smithi003.stdout:9/719: getdents d2/d20/d22/d3f 0 2024-09-21T12:20:49.364 INFO:tasks.workunit.client.0.smithi003.stdout:0/809: getdents d9/d6c/d32 0 2024-09-21T12:20:49.367 INFO:tasks.workunit.client.0.smithi003.stdout:8/660: dread d7/de/d1a/f87 [0,4194304] 0 2024-09-21T12:20:49.368 INFO:tasks.workunit.client.0.smithi003.stdout:0/810: rename d9/d12/d17/d21/d30/f68 to d9/d12/d1e/d5f/d8a/f124 0 2024-09-21T12:20:49.368 INFO:tasks.workunit.client.0.smithi003.stdout:8/661: chown d7/df/d20/d21/d4c/d4d/d8c/faf 20848888 1 2024-09-21T12:20:49.372 INFO:tasks.workunit.client.0.smithi003.stdout:0/811: mkdir d9/d12/d1e/d5f/d8a/d125 0 2024-09-21T12:20:49.372 INFO:tasks.workunit.client.0.smithi003.stdout:9/720: write d2/da0/fd8 [1042946,119692] 0 2024-09-21T12:20:49.373 INFO:tasks.workunit.client.0.smithi003.stdout:9/721: read d2/da0/fb9 [3293740,3078] 0 2024-09-21T12:20:49.374 INFO:tasks.workunit.client.0.smithi003.stdout:8/662: mknod d7/df/d20/d21/dd5/dde/ce9 0 2024-09-21T12:20:49.376 INFO:tasks.workunit.client.0.smithi003.stdout:8/663: write d7/df/d20/d21/d4c/d4d/f92 [5207423,124932] 0 2024-09-21T12:20:49.377 INFO:tasks.workunit.client.0.smithi003.stdout:0/812: fdatasync d9/d12/d17/d38/d3a/d46/d55/f90 0 2024-09-21T12:20:49.379 INFO:tasks.workunit.client.0.smithi003.stdout:9/722: dread d2/da/d35/d76/d94/fac [0,4194304] 0 2024-09-21T12:20:49.383 INFO:tasks.workunit.client.0.smithi003.stdout:0/813: truncate d9/fb 3725220 0 2024-09-21T12:20:49.386 INFO:tasks.workunit.client.0.smithi003.stdout:0/814: mknod d9/d6c/d26/db3/c126 0 2024-09-21T12:20:49.392 INFO:tasks.workunit.client.0.smithi003.stdout:8/664: dwrite d7/df/d36/f5b [0,4194304] 0 2024-09-21T12:20:49.399 INFO:tasks.workunit.client.0.smithi003.stdout:8/665: getdents d7/df/d16 0 2024-09-21T12:20:49.402 INFO:tasks.workunit.client.0.smithi003.stdout:8/666: creat d7/de/d85/fea x:0 0 0 2024-09-21T12:20:49.403 INFO:tasks.workunit.client.0.smithi003.stdout:8/667: stat d7/df/d20/d21/f6d 0 2024-09-21T12:20:49.404 INFO:tasks.workunit.client.0.smithi003.stdout:8/668: dread - d7/df/d20/d21/d4c/d4d/d75/faa zero size 2024-09-21T12:20:49.405 INFO:tasks.workunit.client.0.smithi003.stdout:8/669: fsync d7/de/d85/fd3 0 2024-09-21T12:20:49.418 INFO:tasks.workunit.client.0.smithi003.stdout:8/670: dwrite d7/df/f26 [0,4194304] 0 2024-09-21T12:20:49.422 INFO:tasks.workunit.client.0.smithi003.stdout:8/671: mknod d7/de/ceb 0 2024-09-21T12:20:49.423 INFO:tasks.workunit.client.0.smithi003.stdout:8/672: mknod d7/d57/d77/da5/cec 0 2024-09-21T12:20:49.426 INFO:tasks.workunit.client.0.smithi003.stdout:8/673: creat d7/df/d20/d24/d47/fed x:0 0 0 2024-09-21T12:20:49.429 INFO:tasks.workunit.client.0.smithi003.stdout:8/674: creat d7/df/d20/d21/d4c/d4d/d75/ddd/fee x:0 0 0 2024-09-21T12:20:49.431 INFO:tasks.workunit.client.0.smithi003.stdout:8/675: symlink d7/df/d20/d21/d4c/d4d/d8c/lef 0 2024-09-21T12:20:49.435 INFO:tasks.workunit.client.0.smithi003.stdout:8/676: creat d7/df/d20/ff0 x:0 0 0 2024-09-21T12:20:49.446 INFO:tasks.workunit.client.0.smithi003.stdout:8/677: dwrite d7/df/d16/f46 [4194304,4194304] 0 2024-09-21T12:20:49.449 INFO:tasks.workunit.client.0.smithi003.stdout:8/678: mkdir d7/df/d20/d21/d4c/d4d/d80/df1 0 2024-09-21T12:20:49.453 INFO:tasks.workunit.client.0.smithi003.stdout:8/679: rename d7/f8 to d7/d57/d77/da5/ff2 0 2024-09-21T12:20:49.453 INFO:tasks.workunit.client.0.smithi003.stdout:8/680: stat d7/df/d16/l53 0 2024-09-21T12:20:49.456 INFO:tasks.workunit.client.0.smithi003.stdout:8/681: mkdir d7/df/d20/d24/d47/df3 0 2024-09-21T12:20:49.459 INFO:tasks.workunit.client.0.smithi003.stdout:8/682: mknod d7/de/d81/cf4 0 2024-09-21T12:20:49.460 INFO:tasks.workunit.client.0.smithi003.stdout:8/683: write d7/df/d20/ff0 [43442,102263] 0 2024-09-21T12:20:49.463 INFO:tasks.workunit.client.0.smithi003.stdout:8/684: dread d7/df/d20/fa2 [0,4194304] 0 2024-09-21T12:20:49.466 INFO:tasks.workunit.client.0.smithi003.stdout:8/685: stat d7/de/d52/fac 0 2024-09-21T12:20:49.473 INFO:tasks.workunit.client.0.smithi003.stdout:8/686: write d7/df/d20/d21/d4c/d8a/fdb [172039,72779] 0 2024-09-21T12:20:49.473 INFO:tasks.workunit.client.0.smithi003.stdout:8/687: chown d7/d57/f98 56 1 2024-09-21T12:20:49.475 INFO:tasks.workunit.client.0.smithi003.stdout:8/688: rmdir d7/de/d52 39 2024-09-21T12:20:49.482 INFO:tasks.workunit.client.0.smithi003.stdout:8/689: write f0 [2179317,11675] 0 2024-09-21T12:20:49.486 INFO:tasks.workunit.client.0.smithi003.stdout:8/690: rename d7/de/d85/fd3 to d7/df/d20/d21/ff5 0 2024-09-21T12:20:49.492 INFO:tasks.workunit.client.0.smithi003.stdout:8/691: dwrite d7/de/d52/fd2 [0,4194304] 0 2024-09-21T12:20:49.500 INFO:tasks.workunit.client.0.smithi003.stdout:8/692: dwrite d7/df/d16/f93 [0,4194304] 0 2024-09-21T12:20:49.506 INFO:tasks.workunit.client.0.smithi003.stdout:8/693: dwrite d7/df/d20/f5a [0,4194304] 0 2024-09-21T12:20:49.536 INFO:tasks.workunit.client.0.smithi003.stdout:8/694: dread d7/df/d20/d21/f50 [0,4194304] 0 2024-09-21T12:20:49.571 INFO:tasks.workunit.client.0.smithi003.stdout:8/695: creat d7/df/d20/ff6 x:0 0 0 2024-09-21T12:20:49.573 INFO:tasks.workunit.client.0.smithi003.stdout:8/696: dread - d7/d57/f98 zero size 2024-09-21T12:20:49.574 INFO:tasks.workunit.client.0.smithi003.stdout:8/697: dread - d7/de/d52/f59 zero size 2024-09-21T12:20:49.577 INFO:tasks.workunit.client.0.smithi003.stdout:8/698: mkdir d7/df/d20/d21/d4c/d4d/d8c/df7 0 2024-09-21T12:20:49.580 INFO:tasks.workunit.client.0.smithi003.stdout:8/699: mkdir d7/df/d20/d21/d4c/d4d/d8c/df8 0 2024-09-21T12:20:49.581 INFO:tasks.workunit.client.0.smithi003.stdout:8/700: mknod d7/df/d20/d21/d4c/d4d/cf9 0 2024-09-21T12:20:49.582 INFO:tasks.workunit.client.0.smithi003.stdout:8/701: readlink d7/df/d20/d24/d47/lae 0 2024-09-21T12:20:49.584 INFO:tasks.workunit.client.0.smithi003.stdout:8/702: mkdir d7/d57/d77/da5/dd4/dfa 0 2024-09-21T12:20:49.586 INFO:tasks.workunit.client.0.smithi003.stdout:8/703: symlink d7/df/d20/d21/d4c/d4d/lfb 0 2024-09-21T12:20:49.587 INFO:tasks.workunit.client.0.smithi003.stdout:8/704: chown d7/df/d20/d24/d47/d79/f6c 76 1 2024-09-21T12:20:49.589 INFO:tasks.workunit.client.0.smithi003.stdout:8/705: creat d7/de/d52/ffc x:0 0 0 2024-09-21T12:20:49.593 INFO:tasks.workunit.client.0.smithi003.stdout:8/706: dread d7/de/fa9 [0,4194304] 0 2024-09-21T12:20:49.595 INFO:tasks.workunit.client.0.smithi003.stdout:8/707: write d7/de/f3e [6918646,70016] 0 2024-09-21T12:20:49.596 INFO:tasks.workunit.client.0.smithi003.stdout:8/708: write d7/df/d20/d21/f8b [1621299,78808] 0 2024-09-21T12:20:49.603 INFO:tasks.workunit.client.0.smithi003.stdout:8/709: dwrite d7/df/d20/d21/d4c/fd8 [0,4194304] 0 2024-09-21T12:20:49.629 INFO:tasks.workunit.client.0.smithi003.stdout:8/710: dread d7/de/d81/fa4 [0,4194304] 0 2024-09-21T12:20:49.630 INFO:tasks.workunit.client.0.smithi003.stdout:3/752: sync 2024-09-21T12:20:49.630 INFO:tasks.workunit.client.0.smithi003.stdout:1/687: sync 2024-09-21T12:20:49.670 INFO:tasks.workunit.client.0.smithi003.stdout:8/711: write d7/df/d20/d21/d4c/d4d/d8c/faf [4261547,72017] 0 2024-09-21T12:20:49.671 INFO:tasks.workunit.client.0.smithi003.stdout:8/712: write d7/de/f3e [2684140,12984] 0 2024-09-21T12:20:49.677 INFO:tasks.workunit.client.0.smithi003.stdout:8/713: mknod d7/df/d20/d21/d4c/d4d/d75/cfd 0 2024-09-21T12:20:49.678 INFO:tasks.workunit.client.0.smithi003.stdout:1/688: link d4/d11/d14/d25/d42/f8c d4/dc/d80/fef 0 2024-09-21T12:20:49.680 INFO:tasks.workunit.client.0.smithi003.stdout:8/714: mknod d7/df/d20/d21/d4c/d4d/cfe 0 2024-09-21T12:20:49.680 INFO:tasks.workunit.client.0.smithi003.stdout:3/753: getdents d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/daa 0 2024-09-21T12:20:49.683 INFO:tasks.workunit.client.0.smithi003.stdout:8/715: mknod d7/df/d20/d21/d4c/d4d/d80/cff 0 2024-09-21T12:20:49.684 INFO:tasks.workunit.client.0.smithi003.stdout:8/716: chown d7/df/f26 335980585 1 2024-09-21T12:20:49.685 INFO:tasks.workunit.client.0.smithi003.stdout:3/754: symlink d0/d5/da/d28/d11/lfa 0 2024-09-21T12:20:49.686 INFO:tasks.workunit.client.0.smithi003.stdout:1/689: dread d4/df/d19/f2b [0,4194304] 0 2024-09-21T12:20:49.692 INFO:tasks.workunit.client.0.smithi003.stdout:3/755: rename d0/d5/da/d28/d11/d49/d4c/d54/d5e/le5 to d0/d5/da/d28/d11/d96/lfb 0 2024-09-21T12:20:49.695 INFO:tasks.workunit.client.0.smithi003.stdout:1/690: write d4/f5e [361937,13744] 0 2024-09-21T12:20:49.695 INFO:tasks.workunit.client.0.smithi003.stdout:8/717: link d7/d57/d77/l7b d7/d57/d77/da5/dd4/l100 0 2024-09-21T12:20:49.698 INFO:tasks.workunit.client.0.smithi003.stdout:1/691: creat d4/d11/db1/ff0 x:0 0 0 2024-09-21T12:20:49.702 INFO:tasks.workunit.client.0.smithi003.stdout:3/756: getdents d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/d77 0 2024-09-21T12:20:49.703 INFO:tasks.workunit.client.0.smithi003.stdout:3/757: write d0/d5/d38/d55/f7a [328355,5019] 0 2024-09-21T12:20:49.705 INFO:tasks.workunit.client.0.smithi003.stdout:1/692: creat d4/d66/dc7/dce/ff1 x:0 0 0 2024-09-21T12:20:49.707 INFO:tasks.workunit.client.0.smithi003.stdout:1/693: fsync d4/d11/d14/d78/fd9 0 2024-09-21T12:20:49.710 INFO:tasks.workunit.client.0.smithi003.stdout:1/694: symlink d4/dc/d80/lf2 0 2024-09-21T12:20:49.711 INFO:tasks.workunit.client.0.smithi003.stdout:3/758: dwrite d0/d5/da/d28/ff7 [0,4194304] 0 2024-09-21T12:20:49.712 INFO:tasks.workunit.client.0.smithi003.stdout:8/718: dread d7/de/f3e [0,4194304] 0 2024-09-21T12:20:49.721 INFO:tasks.workunit.client.0.smithi003.stdout:8/719: dwrite d7/de/d85/fc2 [0,4194304] 0 2024-09-21T12:20:49.723 INFO:tasks.workunit.client.0.smithi003.stdout:3/759: symlink d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/daa/dc4/lfc 0 2024-09-21T12:20:49.734 INFO:tasks.workunit.client.0.smithi003.stdout:1/695: dwrite d4/df/d12/f46 [4194304,4194304] 0 2024-09-21T12:20:49.736 INFO:tasks.workunit.client.0.smithi003.stdout:8/720: link d7/d57/d77/lb8 d7/df/d20/d21/dd5/l101 0 2024-09-21T12:20:49.739 INFO:tasks.workunit.client.0.smithi003.stdout:3/760: getdents d0/d5/da/d28/d31/d6b 0 2024-09-21T12:20:49.741 INFO:tasks.workunit.client.0.smithi003.stdout:3/761: chown d0/d5/da/cc 413507 1 2024-09-21T12:20:49.743 INFO:tasks.workunit.client.0.smithi003.stdout:8/721: creat d7/de/d81/f102 x:0 0 0 2024-09-21T12:20:49.744 INFO:tasks.workunit.client.0.smithi003.stdout:3/762: stat d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/l43 0 2024-09-21T12:20:49.745 INFO:tasks.workunit.client.0.smithi003.stdout:1/696: creat d4/d11/d14/d25/d59/ff3 x:0 0 0 2024-09-21T12:20:49.751 INFO:tasks.workunit.client.0.smithi003.stdout:1/697: read d4/df/f74 [3471232,119705] 0 2024-09-21T12:20:49.751 INFO:tasks.workunit.client.0.smithi003.stdout:8/722: rename d7/d57/d77/fa8 to d7/d57/d77/da5/dd4/dfa/f103 0 2024-09-21T12:20:49.751 INFO:tasks.workunit.client.0.smithi003.stdout:3/763: mknod d0/d5/da/cfd 0 2024-09-21T12:20:49.755 INFO:tasks.workunit.client.0.smithi003.stdout:1/698: mknod d4/d66/dc7/dce/cf4 0 2024-09-21T12:20:49.758 INFO:tasks.workunit.client.0.smithi003.stdout:3/764: creat d0/d5/da/d28/d31/d6b/ffe x:0 0 0 2024-09-21T12:20:49.759 INFO:tasks.workunit.client.0.smithi003.stdout:3/765: readlink d0/d5/d38/d55/l68 0 2024-09-21T12:20:49.762 INFO:tasks.workunit.client.0.smithi003.stdout:3/766: symlink d0/d5/lff 0 2024-09-21T12:20:49.764 INFO:tasks.workunit.client.0.smithi003.stdout:1/699: dwrite d4/d66/d8b/fe6 [0,4194304] 0 2024-09-21T12:20:49.766 INFO:tasks.workunit.client.0.smithi003.stdout:8/723: write d7/de/d81/fa4 [1715124,46999] 0 2024-09-21T12:20:49.770 INFO:tasks.workunit.client.0.smithi003.stdout:8/724: stat d7/df/d36/cb0 0 2024-09-21T12:20:49.771 INFO:tasks.workunit.client.0.smithi003.stdout:1/700: link d4/d66/d8b/ce1 d4/d11/d14/d78/dae/cf5 0 2024-09-21T12:20:49.775 INFO:tasks.workunit.client.0.smithi003.stdout:3/767: dwrite d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/fca [0,4194304] 0 2024-09-21T12:20:49.779 INFO:tasks.workunit.client.0.smithi003.stdout:8/725: mknod d7/df/d20/d21/d4c/d4d/d8c/df7/c104 0 2024-09-21T12:20:49.782 INFO:tasks.workunit.client.0.smithi003.stdout:8/726: truncate d7/de/d52/fdc 768439 0 2024-09-21T12:20:49.785 INFO:tasks.workunit.client.0.smithi003.stdout:1/701: dwrite d4/d66/dc7/dce/ff1 [0,4194304] 0 2024-09-21T12:20:49.787 INFO:tasks.workunit.client.0.smithi003.stdout:8/727: write d7/de/f3e [7016923,54189] 0 2024-09-21T12:20:49.792 INFO:tasks.workunit.client.0.smithi003.stdout:8/728: unlink d7/df/d20/ff6 0 2024-09-21T12:20:49.795 INFO:tasks.workunit.client.0.smithi003.stdout:8/729: fsync d7/de/d52/f60 0 2024-09-21T12:20:49.799 INFO:tasks.workunit.client.0.smithi003.stdout:1/702: dwrite d4/d11/db1/fda [0,4194304] 0 2024-09-21T12:20:49.800 INFO:tasks.workunit.client.0.smithi003.stdout:1/703: chown d4/df/d19 1 1 2024-09-21T12:20:49.806 INFO:tasks.workunit.client.0.smithi003.stdout:3/768: dread d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/d77/f84 [0,4194304] 0 2024-09-21T12:20:49.819 INFO:tasks.workunit.client.0.smithi003.stdout:1/704: dwrite d4/d11/d14/d25/d42/f89 [0,4194304] 0 2024-09-21T12:20:49.819 INFO:tasks.workunit.client.0.smithi003.stdout:3/769: dwrite d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/d77/f9d [0,4194304] 0 2024-09-21T12:20:49.819 INFO:tasks.workunit.client.0.smithi003.stdout:8/730: dread d7/df/d16/f46 [0,4194304] 0 2024-09-21T12:20:49.821 INFO:tasks.workunit.client.0.smithi003.stdout:3/770: write d0/d5/da/d28/ff7 [3337630,17915] 0 2024-09-21T12:20:49.827 INFO:tasks.workunit.client.0.smithi003.stdout:1/705: dwrite d4/f30 [0,4194304] 0 2024-09-21T12:20:49.827 INFO:tasks.workunit.client.0.smithi003.stdout:8/731: creat d7/d57/d77/da5/f105 x:0 0 0 2024-09-21T12:20:49.830 INFO:tasks.workunit.client.0.smithi003.stdout:1/706: write d4/d11/d14/d25/d42/f89 [4162973,115046] 0 2024-09-21T12:20:49.831 INFO:tasks.workunit.client.0.smithi003.stdout:8/732: chown d7/df/d20/d54/d9d 6323 1 2024-09-21T12:20:49.833 INFO:tasks.workunit.client.0.smithi003.stdout:8/733: rmdir d7/de 39 2024-09-21T12:20:49.838 INFO:tasks.workunit.client.0.smithi003.stdout:7/558: sync 2024-09-21T12:20:49.839 INFO:tasks.workunit.client.0.smithi003.stdout:8/734: rename d7/de/d1a/l76 to d7/df/d20/d54/d9d/dd1/l106 0 2024-09-21T12:20:49.840 INFO:tasks.workunit.client.0.smithi003.stdout:7/559: mknod d8/d3c/d57/d9e/cc7 0 2024-09-21T12:20:49.843 INFO:tasks.workunit.client.0.smithi003.stdout:7/560: symlink d8/d7a/dae/lc8 0 2024-09-21T12:20:49.844 INFO:tasks.workunit.client.0.smithi003.stdout:7/561: mknod d8/db/d13/d85/dbe/cc9 0 2024-09-21T12:20:49.845 INFO:tasks.workunit.client.0.smithi003.stdout:7/562: readlink d8/db/l11 0 2024-09-21T12:20:49.846 INFO:tasks.workunit.client.0.smithi003.stdout:7/563: symlink d8/db/d13/d75/da6/lca 0 2024-09-21T12:20:49.848 INFO:tasks.workunit.client.0.smithi003.stdout:7/564: truncate d8/f17 3198996 0 2024-09-21T12:20:49.854 INFO:tasks.workunit.client.0.smithi003.stdout:7/565: dread d8/db/d32/f8c [0,4194304] 0 2024-09-21T12:20:49.858 INFO:tasks.workunit.client.0.smithi003.stdout:1/707: write d4/d11/f4a [2355039,73099] 0 2024-09-21T12:20:49.862 INFO:tasks.workunit.client.0.smithi003.stdout:8/735: write d7/df/d20/d21/d4c/d4d/d75/faa [543253,81055] 0 2024-09-21T12:20:49.864 INFO:tasks.workunit.client.0.smithi003.stdout:8/736: dread d7/df/d20/fc5 [0,4194304] 0 2024-09-21T12:20:49.868 INFO:tasks.workunit.client.0.smithi003.stdout:8/737: fdatasync d7/df/d16/f58 0 2024-09-21T12:20:49.868 INFO:tasks.workunit.client.0.smithi003.stdout:7/566: write d8/d3c/d64/f79 [957152,65093] 0 2024-09-21T12:20:49.870 INFO:tasks.workunit.client.0.smithi003.stdout:7/567: write d8/d3c/d57/f73 [2205536,129871] 0 2024-09-21T12:20:49.871 INFO:tasks.workunit.client.0.smithi003.stdout:8/738: chown d7/df/d20/d21/d4c/d4d/d75/cfd 105515676 1 2024-09-21T12:20:49.872 INFO:tasks.workunit.client.0.smithi003.stdout:7/568: fsync d8/d3c/d64/f79 0 2024-09-21T12:20:49.875 INFO:tasks.workunit.client.0.smithi003.stdout:8/739: creat d7/d57/d77/da5/dd4/dfa/f107 x:0 0 0 2024-09-21T12:20:49.877 INFO:tasks.workunit.client.0.smithi003.stdout:8/740: chown d7/df/d20/d21/d4c/c9c 4647 1 2024-09-21T12:20:49.878 INFO:tasks.workunit.client.0.smithi003.stdout:1/708: dread d4/f81 [0,4194304] 0 2024-09-21T12:20:49.878 INFO:tasks.workunit.client.0.smithi003.stdout:8/741: chown d7/de/l27 2826048 1 2024-09-21T12:20:49.880 INFO:tasks.workunit.client.0.smithi003.stdout:7/569: dread d8/db/d13/d75/fb5 [0,4194304] 0 2024-09-21T12:20:49.885 INFO:tasks.workunit.client.0.smithi003.stdout:8/742: dwrite d7/de/d85/fb2 [0,4194304] 0 2024-09-21T12:20:49.888 INFO:tasks.workunit.client.0.smithi003.stdout:8/743: fsync d7/de/fa9 0 2024-09-21T12:20:49.892 INFO:tasks.workunit.client.0.smithi003.stdout:8/744: mknod d7/df/d16/dd0/c108 0 2024-09-21T12:20:49.897 INFO:tasks.workunit.client.0.smithi003.stdout:1/709: dwrite d4/df/f38 [0,4194304] 0 2024-09-21T12:20:49.899 INFO:tasks.workunit.client.0.smithi003.stdout:1/710: readlink d4/df/l2e 0 2024-09-21T12:20:49.899 INFO:tasks.workunit.client.0.smithi003.stdout:7/570: dwrite d8/d3c/d6b/f5a [4194304,4194304] 0 2024-09-21T12:20:49.901 INFO:tasks.workunit.client.0.smithi003.stdout:8/745: creat d7/df/d20/d21/dd5/dde/f109 x:0 0 0 2024-09-21T12:20:49.904 INFO:tasks.workunit.client.0.smithi003.stdout:1/711: mkdir d4/d11/df6 0 2024-09-21T12:20:49.907 INFO:tasks.workunit.client.0.smithi003.stdout:1/712: stat d4/d11/d14/d25/d42/d63/fdf 0 2024-09-21T12:20:49.910 INFO:tasks.workunit.client.0.smithi003.stdout:7/571: symlink d8/db/d13/d96/db8/dc4/lcb 0 2024-09-21T12:20:49.911 INFO:tasks.workunit.client.0.smithi003.stdout:8/746: dwrite d7/df/d20/f35 [0,4194304] 0 2024-09-21T12:20:49.912 INFO:tasks.workunit.client.0.smithi003.stdout:8/747: dread - d7/df/d20/fe5 zero size 2024-09-21T12:20:49.912 INFO:tasks.workunit.client.0.smithi003.stdout:1/713: creat d4/d11/d14/d78/dae/ff7 x:0 0 0 2024-09-21T12:20:49.914 INFO:tasks.workunit.client.0.smithi003.stdout:8/748: write d7/de/d81/fa4 [3890632,21075] 0 2024-09-21T12:20:49.914 INFO:tasks.workunit.client.0.smithi003.stdout:7/572: mkdir d8/d3c/d6b/dcc 0 2024-09-21T12:20:49.916 INFO:tasks.workunit.client.0.smithi003.stdout:1/714: rmdir d4/df/d19 39 2024-09-21T12:20:49.917 INFO:tasks.workunit.client.0.smithi003.stdout:8/749: fdatasync d7/df/d20/d54/f5e 0 2024-09-21T12:20:49.919 INFO:tasks.workunit.client.0.smithi003.stdout:7/573: creat d8/d93/fcd x:0 0 0 2024-09-21T12:20:49.921 INFO:tasks.workunit.client.0.smithi003.stdout:8/750: mknod d7/df/d16/c10a 0 2024-09-21T12:20:49.923 INFO:tasks.workunit.client.0.smithi003.stdout:8/751: chown d7/ca 1517129 1 2024-09-21T12:20:49.923 INFO:tasks.workunit.client.0.smithi003.stdout:7/574: symlink d8/db/d13/d60/lce 0 2024-09-21T12:20:49.925 INFO:tasks.workunit.client.0.smithi003.stdout:1/715: dwrite d4/d11/db1/ff0 [0,4194304] 0 2024-09-21T12:20:49.925 INFO:tasks.workunit.client.0.smithi003.stdout:8/752: dread - d7/df/d16/dd0/fd6 zero size 2024-09-21T12:20:49.928 INFO:tasks.workunit.client.0.smithi003.stdout:1/716: write d4/d66/dc7/ded/fe9 [1029672,115561] 0 2024-09-21T12:20:49.928 INFO:tasks.workunit.client.0.smithi003.stdout:8/753: fdatasync d7/df/d20/d21/ff5 0 2024-09-21T12:20:49.940 INFO:tasks.workunit.client.0.smithi003.stdout:7/575: write d8/d31/f5f [140894,115232] 0 2024-09-21T12:20:49.945 INFO:tasks.workunit.client.0.smithi003.stdout:7/576: unlink d8/f17 0 2024-09-21T12:20:49.947 INFO:tasks.workunit.client.0.smithi003.stdout:1/717: dwrite d4/d11/d14/f62 [0,4194304] 0 2024-09-21T12:20:49.949 INFO:tasks.workunit.client.0.smithi003.stdout:8/754: dread d7/df/f83 [0,4194304] 0 2024-09-21T12:20:49.954 INFO:tasks.workunit.client.0.smithi003.stdout:7/577: rename d8/db/d13/f44 to d8/d3c/d57/d9e/fcf 0 2024-09-21T12:20:49.957 INFO:tasks.workunit.client.0.smithi003.stdout:1/718: fdatasync d4/df/d19/fba 0 2024-09-21T12:20:49.958 INFO:tasks.workunit.client.0.smithi003.stdout:1/719: chown d4/d11/d14/d25/d42/fca 151042 1 2024-09-21T12:20:49.963 INFO:tasks.workunit.client.0.smithi003.stdout:4/584: sync 2024-09-21T12:20:49.963 INFO:tasks.workunit.client.0.smithi003.stdout:5/806: sync 2024-09-21T12:20:49.963 INFO:tasks.workunit.client.0.smithi003.stdout:2/587: sync 2024-09-21T12:20:49.963 INFO:tasks.workunit.client.0.smithi003.stdout:0/815: sync 2024-09-21T12:20:49.963 INFO:tasks.workunit.client.0.smithi003.stdout:9/723: sync 2024-09-21T12:20:49.963 INFO:tasks.workunit.client.0.smithi003.stdout:6/841: sync 2024-09-21T12:20:49.965 INFO:tasks.workunit.client.0.smithi003.stdout:6/842: stat d4/d9/d79/f119 0 2024-09-21T12:20:49.967 INFO:tasks.workunit.client.0.smithi003.stdout:8/755: symlink d7/df/d20/d21/d4c/d4d/d80/df1/l10b 0 2024-09-21T12:20:49.968 INFO:tasks.workunit.client.0.smithi003.stdout:1/720: symlink d4/d11/d14/d78/lf8 0 2024-09-21T12:20:49.971 INFO:tasks.workunit.client.0.smithi003.stdout:7/578: write d8/db/d13/d60/f97 [245920,7330] 0 2024-09-21T12:20:49.974 INFO:tasks.workunit.client.0.smithi003.stdout:4/585: mkdir d9/da/d47/d4b/dca 0 2024-09-21T12:20:49.974 INFO:tasks.workunit.client.0.smithi003.stdout:6/843: dwrite d4/d13/d63/fcd [0,4194304] 0 2024-09-21T12:20:49.974 INFO:tasks.workunit.client.0.smithi003.stdout:7/579: chown d8/d3c/l4e 614563 1 2024-09-21T12:20:49.976 INFO:tasks.workunit.client.0.smithi003.stdout:4/586: fsync d9/da/d66/f95 0 2024-09-21T12:20:49.977 INFO:tasks.workunit.client.0.smithi003.stdout:4/587: chown d9/d16/d65/f9f 2 1 2024-09-21T12:20:49.978 INFO:tasks.workunit.client.0.smithi003.stdout:9/724: symlink d2/da/d2a/d3c/da2/l104 0 2024-09-21T12:20:49.984 INFO:tasks.workunit.client.0.smithi003.stdout:5/807: creat dc/dd7/d41/d5b/d74/d7f/d82/f105 x:0 0 0 2024-09-21T12:20:49.986 INFO:tasks.workunit.client.0.smithi003.stdout:0/816: dread d9/d12/d17/d38/d3a/d46/d55/d7b/f96 [0,4194304] 0 2024-09-21T12:20:49.987 INFO:tasks.workunit.client.0.smithi003.stdout:8/756: symlink d7/df/d20/d21/d4c/d4d/d8c/df7/l10c 0 2024-09-21T12:20:49.988 INFO:tasks.workunit.client.0.smithi003.stdout:1/721: mknod d4/df/d12/cf9 0 2024-09-21T12:20:49.988 INFO:tasks.workunit.client.0.smithi003.stdout:0/817: stat d9/d12/d17/d21/f31 0 2024-09-21T12:20:49.990 INFO:tasks.workunit.client.0.smithi003.stdout:8/757: dread - d7/de/d81/f102 zero size 2024-09-21T12:20:49.990 INFO:tasks.workunit.client.0.smithi003.stdout:2/588: dwrite d0/d21/f4e [4194304,4194304] 0 2024-09-21T12:20:49.991 INFO:tasks.workunit.client.0.smithi003.stdout:6/844: fdatasync d4/d13/d19/d38/ffd 0 2024-09-21T12:20:49.994 INFO:tasks.workunit.client.0.smithi003.stdout:4/588: symlink d9/da/d36/d8c/dbd/lcb 0 2024-09-21T12:20:49.995 INFO:tasks.workunit.client.0.smithi003.stdout:9/725: truncate d2/f86 5163755 0 2024-09-21T12:20:49.996 INFO:tasks.workunit.client.0.smithi003.stdout:8/758: fsync d7/de/d52/fd2 0 2024-09-21T12:20:49.998 INFO:tasks.workunit.client.0.smithi003.stdout:0/818: write d9/d12/d17/d38/d3a/d46/f121 [223342,6568] 0 2024-09-21T12:20:49.998 INFO:tasks.workunit.client.0.smithi003.stdout:2/589: write d0/d21/d2f/d9f/fb9 [211756,118496] 0 2024-09-21T12:20:49.998 INFO:tasks.workunit.client.0.smithi003.stdout:4/589: write d9/d48/f9c [2800652,52562] 0 2024-09-21T12:20:50.000 INFO:tasks.workunit.client.0.smithi003.stdout:5/808: dread dc/d15/f1f [0,4194304] 0 2024-09-21T12:20:50.003 INFO:tasks.workunit.client.0.smithi003.stdout:1/722: dread d4/df/d19/f95 [0,4194304] 0 2024-09-21T12:20:50.007 INFO:tasks.workunit.client.0.smithi003.stdout:9/726: fsync d2/da/d2a/d3c/f37 0 2024-09-21T12:20:50.008 INFO:tasks.workunit.client.0.smithi003.stdout:9/727: chown d2/da/d2a/d89/d9c 2086 1 2024-09-21T12:20:50.009 INFO:tasks.workunit.client.0.smithi003.stdout:9/728: dread - d2/d53/fe0 zero size 2024-09-21T12:20:50.011 INFO:tasks.workunit.client.0.smithi003.stdout:4/590: write d9/d16/f2e [1268879,20542] 0 2024-09-21T12:20:50.020 INFO:tasks.workunit.client.0.smithi003.stdout:7/580: dread d8/db/ff [4194304,4194304] 0 2024-09-21T12:20:50.029 INFO:tasks.workunit.client.0.smithi003.stdout:9/729: unlink d2/d53/f6e 0 2024-09-21T12:20:50.034 INFO:tasks.workunit.client.0.smithi003.stdout:0/819: mkdir d9/d6c/d26/d54/d7e/dde/d106/d107/dc6/d127 0 2024-09-21T12:20:50.039 INFO:tasks.workunit.client.0.smithi003.stdout:4/591: mkdir d9/da/d36/dcc 0 2024-09-21T12:20:50.049 INFO:tasks.workunit.client.0.smithi003.stdout:2/590: rename d0/d46/dcd/fb0 to d0/dd/fd0 0 2024-09-21T12:20:50.049 INFO:tasks.workunit.client.0.smithi003.stdout:7/581: write d8/db/ff [8752838,19872] 0 2024-09-21T12:20:50.056 INFO:tasks.workunit.client.0.smithi003.stdout:4/592: mkdir d9/da/d66/d67/dcd 0 2024-09-21T12:20:50.057 INFO:tasks.workunit.client.0.smithi003.stdout:5/809: dwrite dc/dd7/d41/f8a [0,4194304] 0 2024-09-21T12:20:50.057 INFO:tasks.workunit.client.0.smithi003.stdout:2/591: dread d0/dd/d22/d37/f74 [0,4194304] 0 2024-09-21T12:20:50.057 INFO:tasks.workunit.client.0.smithi003.stdout:8/759: link d7/df/d16/c39 d7/df/d20/d24/c10d 0 2024-09-21T12:20:50.062 INFO:tasks.workunit.client.0.smithi003.stdout:9/730: dwrite d2/da/d2a/d89/f95 [0,4194304] 0 2024-09-21T12:20:50.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:49 smithi003 ceph-mon[28057]: pgmap v11: 65 pgs: 65 active+clean; 3.0 GiB data, 9.1 GiB used, 527 GiB / 536 GiB avail; 76 MiB/s rd, 209 MiB/s wr, 477 op/s 2024-09-21T12:20:50.100 INFO:tasks.workunit.client.0.smithi003.stdout:1/723: rename d4/d11/d14/d25/d42/fca to d4/df/d19/ffa 0 2024-09-21T12:20:50.101 INFO:tasks.workunit.client.0.smithi003.stdout:0/820: mknod d9/d12/d17/d38/dfb/c128 0 2024-09-21T12:20:50.102 INFO:tasks.workunit.client.0.smithi003.stdout:7/582: unlink d8/d3c/d57/d81/fa5 0 2024-09-21T12:20:50.103 INFO:tasks.workunit.client.0.smithi003.stdout:7/583: write d8/d3c/faa [3240562,116526] 0 2024-09-21T12:20:50.104 INFO:tasks.workunit.client.0.smithi003.stdout:7/584: fsync d8/d93/fc1 0 2024-09-21T12:20:50.105 INFO:tasks.workunit.client.0.smithi003.stdout:5/810: unlink dc/dd7/d41/da0/f33 0 2024-09-21T12:20:50.107 INFO:tasks.workunit.client.0.smithi003.stdout:8/760: mkdir d7/df/d20/d21/d4c/d4d/d80/d10e 0 2024-09-21T12:20:50.109 INFO:tasks.workunit.client.0.smithi003.stdout:1/724: creat d4/d66/ffb x:0 0 0 2024-09-21T12:20:50.112 INFO:tasks.workunit.client.0.smithi003.stdout:2/592: dread d0/dd/d22/d37/d3f/f67 [0,4194304] 0 2024-09-21T12:20:50.113 INFO:tasks.workunit.client.0.smithi003.stdout:7/585: creat d8/d3c/d6b/fd0 x:0 0 0 2024-09-21T12:20:50.114 INFO:tasks.workunit.client.0.smithi003.stdout:7/586: chown d8/db/d13/c29 0 1 2024-09-21T12:20:50.116 INFO:tasks.workunit.client.0.smithi003.stdout:8/761: readlink d7/d57/d77/lb8 0 2024-09-21T12:20:50.116 INFO:tasks.workunit.client.0.smithi003.stdout:8/762: stat d7/ld 0 2024-09-21T12:20:50.117 INFO:tasks.workunit.client.0.smithi003.stdout:8/763: readlink d7/d57/l74 0 2024-09-21T12:20:50.118 INFO:tasks.workunit.client.0.smithi003.stdout:0/821: mkdir d9/d12/d17/d129 0 2024-09-21T12:20:50.120 INFO:tasks.workunit.client.0.smithi003.stdout:7/587: stat d8/d2c/c63 0 2024-09-21T12:20:50.121 INFO:tasks.workunit.client.0.smithi003.stdout:4/593: link d9/d48/l88 d9/da/d36/d8c/dbd/lce 0 2024-09-21T12:20:50.123 INFO:tasks.workunit.client.0.smithi003.stdout:1/725: symlink d4/d11/df6/lfc 0 2024-09-21T12:20:50.123 INFO:tasks.workunit.client.0.smithi003.stdout:4/594: dread - d9/d48/f89 zero size 2024-09-21T12:20:50.124 INFO:tasks.workunit.client.0.smithi003.stdout:7/588: write d8/d3c/d64/f79 [2054720,76052] 0 2024-09-21T12:20:50.124 INFO:tasks.workunit.client.0.smithi003.stdout:0/822: rmdir d9 39 2024-09-21T12:20:50.126 INFO:tasks.workunit.client.0.smithi003.stdout:8/764: dwrite d7/de/f3e [4194304,4194304] 0 2024-09-21T12:20:50.128 INFO:tasks.workunit.client.0.smithi003.stdout:1/726: fsync d4/df/d12/f75 0 2024-09-21T12:20:50.129 INFO:tasks.workunit.client.0.smithi003.stdout:8/765: read d7/df/d20/d21/d4c/d8a/fdb [2153564,118543] 0 2024-09-21T12:20:50.132 INFO:tasks.workunit.client.0.smithi003.stdout:0/823: mknod d9/d6c/d26/db3/c12a 0 2024-09-21T12:20:50.134 INFO:tasks.workunit.client.0.smithi003.stdout:4/595: read d9/da/d47/d4b/f56 [623959,78727] 0 2024-09-21T12:20:50.206 INFO:tasks.workunit.client.0.smithi003.stdout:3/771: sync 2024-09-21T12:20:50.211 INFO:tasks.workunit.client.0.smithi003.stdout:2/593: dread d0/d1c/f42 [0,4194304] 0 2024-09-21T12:20:50.213 INFO:tasks.workunit.client.0.smithi003.stdout:1/727: creat d4/d11/df6/ffd x:0 0 0 2024-09-21T12:20:50.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.212+0000 7fe469576640 1 -- 172.21.15.3:0/1665035720 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe464100ba0 msgr2=0x7fe464101000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:50.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.212+0000 7fe469576640 1 --2- 172.21.15.3:0/1665035720 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe464100ba0 0x7fe464101000 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe44c009880 tx=0x7fe44c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:20:50.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.212+0000 7fe469576640 1 -- 172.21.15.3:0/1665035720 shutdown_connections 2024-09-21T12:20:50.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.212+0000 7fe469576640 1 --2- 172.21.15.3:0/1665035720 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe464100ba0 0x7fe464101000 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:50.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.212+0000 7fe469576640 1 --2- 172.21.15.3:0/1665035720 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe464100260 0x7fe464100660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:50.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.212+0000 7fe469576640 1 -- 172.21.15.3:0/1665035720 >> 172.21.15.3:0/1665035720 conn(0x7fe4640fc010 msgr2=0x7fe4640fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:20:50.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.212+0000 7fe469576640 1 -- 172.21.15.3:0/1665035720 shutdown_connections 2024-09-21T12:20:50.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.212+0000 7fe469576640 1 -- 172.21.15.3:0/1665035720 wait complete. 2024-09-21T12:20:50.215 INFO:tasks.workunit.client.0.smithi003.stdout:8/766: truncate d7/df/d20/d21/d4c/fba 1926794 0 2024-09-21T12:20:50.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.213+0000 7fe469576640 1 Processor -- start 2024-09-21T12:20:50.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.213+0000 7fe469576640 1 -- start start 2024-09-21T12:20:50.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.213+0000 7fe469576640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe464100260 0x7fe46419dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:50.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.213+0000 7fe469576640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe464100ba0 0x7fe46419e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:50.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.213+0000 7fe469576640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fe46410ca00 con 0x7fe464100260 2024-09-21T12:20:50.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.213+0000 7fe469576640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe46410c880 con 0x7fe464100ba0 2024-09-21T12:20:50.219 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.213+0000 7fe462ffd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe464100260 0x7fe46419dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:50.219 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.213+0000 7fe462ffd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe464100260 0x7fe46419dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:53050/0 (socket says 172.21.15.3:53050) 2024-09-21T12:20:50.219 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.213+0000 7fe462ffd640 1 -- 172.21.15.3:0/4125818188 learned_addr learned my addr 172.21.15.3:0/4125818188 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:20:50.219 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.213+0000 7fe45bfff640 1 --2- 172.21.15.3:0/4125818188 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe464100ba0 0x7fe46419e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:50.219 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.214+0000 7fe462ffd640 1 -- 172.21.15.3:0/4125818188 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe464100ba0 msgr2=0x7fe46419e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:50.219 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.214+0000 7fe462ffd640 1 --2- 172.21.15.3:0/4125818188 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe464100ba0 0x7fe46419e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:50.220 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.214+0000 7fe462ffd640 1 -- 172.21.15.3:0/4125818188 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe46419e770 con 0x7fe464100260 2024-09-21T12:20:50.220 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.214+0000 7fe462ffd640 1 --2- 172.21.15.3:0/4125818188 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe464100260 0x7fe46419dbb0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fe45400b420 tx=0x7fe45400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:20:50.220 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.214+0000 7fe460ff9640 1 -- 172.21.15.3:0/4125818188 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe454011630 con 0x7fe464100260 2024-09-21T12:20:50.220 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.214+0000 7fe469576640 1 -- 172.21.15.3:0/4125818188 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4641a3140 con 0x7fe464100260 2024-09-21T12:20:50.220 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.214+0000 7fe460ff9640 1 -- 172.21.15.3:0/4125818188 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe454016070 con 0x7fe464100260 2024-09-21T12:20:50.220 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.214+0000 7fe460ff9640 1 -- 172.21.15.3:0/4125818188 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe454010d40 con 0x7fe464100260 2024-09-21T12:20:50.220 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.214+0000 7fe469576640 1 -- 172.21.15.3:0/4125818188 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4641a3720 con 0x7fe464100260 2024-09-21T12:20:50.220 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.216+0000 7fe469576640 1 -- 172.21.15.3:0/4125818188 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe464100660 con 0x7fe464100260 2024-09-21T12:20:50.221 INFO:tasks.workunit.client.0.smithi003.stdout:0/824: rename d9/d6c/d66/c7c to d9/d6c/d26/d54/d7e/dde/c12b 0 2024-09-21T12:20:50.222 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.216+0000 7fe460ff9640 1 -- 172.21.15.3:0/4125818188 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7fe45401b460 con 0x7fe464100260 2024-09-21T12:20:50.222 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.217+0000 7fe460ff9640 1 --2- 172.21.15.3:0/4125818188 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7fe450074ad0 0x7fe450076f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:50.223 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.217+0000 7fe460ff9640 1 -- 172.21.15.3:0/4125818188 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5812+0+0 (secure 0 0 0) 0x7fe4540959f0 con 0x7fe464100260 2024-09-21T12:20:50.223 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.218+0000 7fe45bfff640 1 --2- 172.21.15.3:0/4125818188 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7fe450074ad0 0x7fe450076f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:50.223 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.218+0000 7fe45bfff640 1 --2- 172.21.15.3:0/4125818188 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7fe450074ad0 0x7fe450076f90 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe44c006010 tx=0x7fe44c02a9a0 comp rx=0 tx=0).ready entity=mgr.24409 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:20:50.224 INFO:tasks.workunit.client.0.smithi003.stdout:3/772: symlink d0/d5/d38/d55/ddb/l100 0 2024-09-21T12:20:50.224 INFO:tasks.workunit.client.0.smithi003.stdout:1/728: symlink d4/d11/d49/lfe 0 2024-09-21T12:20:50.224 INFO:tasks.workunit.client.0.smithi003.stdout:1/729: truncate d4/dc/f16 6114954 0 2024-09-21T12:20:50.226 INFO:tasks.workunit.client.0.smithi003.stdout:0/825: truncate d9/d12/d17/d38/d3a/d46/d55/d9e/fc8 618800 0 2024-09-21T12:20:50.227 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.225+0000 7fe460ff9640 1 -- 172.21.15.3:0/4125818188 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fe4540610b0 con 0x7fe464100260 2024-09-21T12:20:50.228 INFO:tasks.workunit.client.0.smithi003.stdout:8/767: mknod d7/df/d20/d24/d47/df3/c10f 0 2024-09-21T12:20:50.233 INFO:tasks.workunit.client.0.smithi003.stdout:8/768: mkdir d7/df/d20/d21/d4c/d4d/d8c/df8/d110 0 2024-09-21T12:20:50.233 INFO:tasks.workunit.client.0.smithi003.stdout:0/826: dwrite d9/d6c/d26/f73 [4194304,4194304] 0 2024-09-21T12:20:50.239 INFO:tasks.workunit.client.0.smithi003.stdout:8/769: chown d7/df/d20/d21/d4c/d4d/d75/ddd/fee 103863 1 2024-09-21T12:20:50.240 INFO:tasks.workunit.client.0.smithi003.stdout:1/730: link d4/d66/dc7/c93 d4/d11/d14/d78/dae/cff 0 2024-09-21T12:20:50.241 INFO:tasks.workunit.client.0.smithi003.stdout:8/770: chown d7/df/d20/d24/d47/lae 956995980 1 2024-09-21T12:20:50.245 INFO:tasks.workunit.client.0.smithi003.stdout:0/827: dread d9/d6c/d32/f6e [0,4194304] 0 2024-09-21T12:20:50.246 INFO:tasks.workunit.client.0.smithi003.stdout:1/731: mknod d4/d66/dc7/c100 0 2024-09-21T12:20:50.246 INFO:tasks.workunit.client.0.smithi003.stdout:1/732: chown d4/dc/d80/cc4 28084 1 2024-09-21T12:20:50.250 INFO:tasks.workunit.client.0.smithi003.stdout:8/771: creat d7/df/d20/d21/de6/f111 x:0 0 0 2024-09-21T12:20:50.252 INFO:tasks.workunit.client.0.smithi003.stdout:1/733: chown d4/d11/d14/d25/d42/d7b/f7a 220003 1 2024-09-21T12:20:50.255 INFO:tasks.workunit.client.0.smithi003.stdout:0/828: dwrite d9/d12/d17/d38/d3a/d46/d55/d7b/d9a/fef [0,4194304] 0 2024-09-21T12:20:50.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:49 smithi192 ceph-mon[35641]: pgmap v11: 65 pgs: 65 active+clean; 3.0 GiB data, 9.1 GiB used, 527 GiB / 536 GiB avail; 76 MiB/s rd, 209 MiB/s wr, 477 op/s 2024-09-21T12:20:50.258 INFO:tasks.workunit.client.0.smithi003.stdout:8/772: symlink d7/df/d20/d21/d4c/d4d/d8c/df8/l112 0 2024-09-21T12:20:50.259 INFO:tasks.workunit.client.0.smithi003.stdout:1/734: truncate d4/d11/d14/d25/d42/d63/fdf 818493 0 2024-09-21T12:20:50.260 INFO:tasks.workunit.client.0.smithi003.stdout:8/773: chown d7/df/d20/d21/d4c/d4d/d75/ddd/fe2 314 1 2024-09-21T12:20:50.260 INFO:tasks.workunit.client.0.smithi003.stdout:8/774: stat d7/c40 0 2024-09-21T12:20:50.260 INFO:tasks.workunit.client.0.smithi003.stdout:1/735: chown d4/d11/fc0 0 1 2024-09-21T12:20:50.261 INFO:tasks.workunit.client.0.smithi003.stdout:8/775: fdatasync d7/f14 0 2024-09-21T12:20:50.264 INFO:tasks.workunit.client.0.smithi003.stdout:0/829: mkdir d9/d12/d17/d38/d3a/d46/d55/d7b/da0/d12c 0 2024-09-21T12:20:50.274 INFO:tasks.workunit.client.0.smithi003.stdout:0/830: unlink d9/d12/d1e/d108/d2d/f65 0 2024-09-21T12:20:50.276 INFO:tasks.workunit.client.0.smithi003.stdout:8/776: read d7/d57/d77/da5/dd4/dfa/f103 [461798,17511] 0 2024-09-21T12:20:50.287 INFO:tasks.workunit.client.0.smithi003.stdout:8/777: rename d7/d57/d77/fe8 to d7/df/d20/d21/d4c/f113 0 2024-09-21T12:20:50.288 INFO:tasks.workunit.client.0.smithi003.stdout:8/778: dread - d7/de/d52/f59 zero size 2024-09-21T12:20:50.294 INFO:tasks.workunit.client.0.smithi003.stdout:0/831: rmdir d9/d6c/d26/d54/d7e/dde/d106/d107/dc6/d127 0 2024-09-21T12:20:50.295 INFO:tasks.workunit.client.0.smithi003.stdout:5/811: dwrite dc/d15/d21/fac [0,4194304] 0 2024-09-21T12:20:50.296 INFO:tasks.workunit.client.0.smithi003.stdout:8/779: creat d7/df/d20/d21/d4c/d4d/d75/f114 x:0 0 0 2024-09-21T12:20:50.307 INFO:tasks.workunit.client.0.smithi003.stdout:0/832: mkdir d9/d12/d1e/d5f/d8a/d125/d12d 0 2024-09-21T12:20:50.311 INFO:tasks.workunit.client.0.smithi003.stdout:5/812: creat dc/dd7/d41/d9f/d104/f106 x:0 0 0 2024-09-21T12:20:50.312 INFO:tasks.workunit.client.0.smithi003.stdout:7/589: write d8/db/f5e [711604,103074] 0 2024-09-21T12:20:50.315 INFO:tasks.workunit.client.0.smithi003.stdout:0/833: creat d9/d12/d17/d38/d3a/d46/d55/db0/f12e x:0 0 0 2024-09-21T12:20:50.319 INFO:tasks.workunit.client.0.smithi003.stdout:8/780: rename d7/de/d81/f102 to d7/d57/f115 0 2024-09-21T12:20:50.320 INFO:tasks.workunit.client.0.smithi003.stdout:5/813: dwrite dc/d2b/d4e/ffa [0,4194304] 0 2024-09-21T12:20:50.322 INFO:tasks.workunit.client.0.smithi003.stdout:8/781: chown d7/df/d20/d21/dd5/dde/f109 1064290135 1 2024-09-21T12:20:50.323 INFO:tasks.workunit.client.0.smithi003.stdout:0/834: fdatasync d9/d12/d1e/d5f/d8a/fb4 0 2024-09-21T12:20:50.332 INFO:tasks.workunit.client.0.smithi003.stdout:5/814: dread dc/d15/f9a [0,4194304] 0 2024-09-21T12:20:50.332 INFO:tasks.workunit.client.0.smithi003.stdout:4/596: write d9/f3a [1041980,30082] 0 2024-09-21T12:20:50.336 INFO:tasks.workunit.client.0.smithi003.stdout:3/773: write d0/d5/da/d28/d11/d49/f76 [611695,30668] 0 2024-09-21T12:20:50.337 INFO:tasks.workunit.client.0.smithi003.stdout:2/594: dwrite d0/f3b [4194304,4194304] 0 2024-09-21T12:20:50.337 INFO:tasks.workunit.client.0.smithi003.stdout:8/782: symlink d7/df/d20/d24/l116 0 2024-09-21T12:20:50.342 INFO:tasks.workunit.client.0.smithi003.stdout:3/774: fsync d0/d5/da/d28/d11/d49/d4c/d54/d5e/d48/f8f 0 2024-09-21T12:20:50.342 INFO:tasks.workunit.client.0.smithi003.stdout:5/815: dread - dc/fcf zero size 2024-09-21T12:20:50.348 INFO:tasks.workunit.client.0.smithi003.stdout:1/736: write d4/df/d19/f95 [707354,81452] 0 2024-09-21T12:20:50.349 INFO:tasks.workunit.client.0.smithi003.stdout:8/783: truncate d7/d57/d77/fb3 1014001 0 2024-09-21T12:20:50.350 INFO:tasks.workunit.client.0.smithi003.stdout:8/784: read d7/df/d20/fa2 [51835,24314] 0 2024-09-21T12:20:50.353 INFO:tasks.workunit.client.0.smithi003.stdout:5/816: mknod dc/dd7/d3c/c107 0 2024-09-21T12:20:50.354 INFO:tasks.workunit.client.0.smithi003.stdout:2/595: creat d0/dd/d22/fd1 x:0 0 0 2024-09-21T12:20:50.355 INFO:tasks.workunit.client.0.smithi003.stdout:4/597: getdents d9/da/d47/d82 0 2024-09-21T12:20:50.356 INFO:tasks.workunit.client.0.smithi003.stdout:1/737: unlink d4/f26 0 2024-09-21T12:20:50.357 INFO:tasks.workunit.client.0.smithi003.stdout:8/785: symlink d7/df/d20/d21/d4c/d4d/d80/d10e/l117 0 2024-09-21T12:20:50.358 INFO:tasks.workunit.client.0.smithi003.stdout:2/596: unlink d0/dd/fd0 0 2024-09-21T12:20:50.359 INFO:tasks.workunit.client.0.smithi003.stdout:4/598: write d9/d16/d65/f7f [656598,67513] 0 2024-09-21T12:20:50.361 INFO:tasks.workunit.client.0.smithi003.stdout:8/786: creat d7/df/d16/f118 x:0 0 0 2024-09-21T12:20:50.363 INFO:tasks.workunit.client.0.smithi003.stdout:8/787: chown d7/df/d20/d21/d4c/f113 12655 1 2024-09-21T12:20:50.363 INFO:tasks.workunit.client.0.smithi003.stdout:2/597: creat d0/dd/d22/d8b/fd2 x:0 0 0 2024-09-21T12:20:50.364 INFO:tasks.workunit.client.0.smithi003.stdout:4/599: creat d9/da/d47/d4b/d72/fcf x:0 0 0 2024-09-21T12:20:50.365 INFO:tasks.workunit.client.0.smithi003.stdout:5/817: link dc/dd7/d41/l50 dc/dd7/d41/d9f/d104/l108 0 2024-09-21T12:20:50.365 INFO:tasks.workunit.client.0.smithi003.stdout:4/600: chown d9/l62 106 1 2024-09-21T12:20:50.367 INFO:tasks.workunit.client.0.smithi003.stdout:2/598: mknod d0/d21/d30/d78/cd3 0 2024-09-21T12:20:50.370 INFO:tasks.workunit.client.0.smithi003.stdout:5/818: mkdir dc/dd7/d41/d5b/d74/d7f/d82/dfd/d109 0 2024-09-21T12:20:50.373 INFO:tasks.workunit.client.0.smithi003.stdout:1/738: dread d4/df/fa5 [0,4194304] 0 2024-09-21T12:20:50.385 INFO:tasks.workunit.client.0.smithi003.stdout:2/599: dread d0/f36 [0,4194304] 0 2024-09-21T12:20:50.385 INFO:tasks.workunit.client.0.smithi003.stdout:4/601: dread d9/da/f27 [4194304,4194304] 0 2024-09-21T12:20:50.387 INFO:tasks.workunit.client.0.smithi003.stdout:4/602: chown d9/da/d47/d4b/d72/l52 583 1 2024-09-21T12:20:50.388 INFO:tasks.workunit.client.0.smithi003.stdout:2/600: truncate d0/d1c/f34 1991241 0 2024-09-21T12:20:50.390 INFO:tasks.workunit.client.0.smithi003.stdout:4/603: creat d9/da/d36/d55/d79/fd0 x:0 0 0 2024-09-21T12:20:50.391 INFO:tasks.workunit.client.0.smithi003.stdout:4/604: creat d9/d16/d65/d97/fd1 x:0 0 0 2024-09-21T12:20:50.393 INFO:tasks.workunit.client.0.smithi003.stdout:4/605: symlink d9/da/d36/d8c/ld2 0 2024-09-21T12:20:50.393 INFO:tasks.workunit.client.0.smithi003.stdout:4/606: chown d9/da/d66/d67/dcd 0 1 2024-09-21T12:20:50.394 INFO:tasks.workunit.client.0.smithi003.stdout:4/607: mkdir d9/da/dd3 0 2024-09-21T12:20:50.395 INFO:tasks.workunit.client.0.smithi003.stdout:4/608: dread - d9/da/d66/f95 zero size 2024-09-21T12:20:50.400 INFO:tasks.workunit.client.0.smithi003.stdout:4/609: dwrite d9/d16/f2e [4194304,4194304] 0 2024-09-21T12:20:50.401 INFO:tasks.workunit.client.0.smithi003.stdout:4/610: write d9/da/d36/da9/fc4 [730214,66838] 0 2024-09-21T12:20:50.460 INFO:tasks.workunit.client.0.smithi003.stdout:7/590: dwrite d8/db/d13/f1a [0,4194304] 0 2024-09-21T12:20:50.461 INFO:tasks.workunit.client.0.smithi003.stdout:7/591: readlink d8/d7a/dae/lc8 0 2024-09-21T12:20:50.462 INFO:tasks.workunit.client.0.smithi003.stdout:2/601: dread d0/dd/f1b [4194304,4194304] 0 2024-09-21T12:20:50.462 INFO:tasks.workunit.client.0.smithi003.stdout:0/835: write d9/d6c/f1b [8485405,50669] 0 2024-09-21T12:20:50.467 INFO:tasks.workunit.client.0.smithi003.stdout:7/592: mknod d8/db/d13/d60/cd1 0 2024-09-21T12:20:50.469 INFO:tasks.workunit.client.0.smithi003.stdout:3/775: write d0/d5/d38/db8/fce [867633,60497] 0 2024-09-21T12:20:50.472 INFO:tasks.workunit.client.0.smithi003.stdout:2/602: creat d0/d21/d2c/d6c/db2/dbb/fd4 x:0 0 0 2024-09-21T12:20:50.473 INFO:tasks.workunit.client.0.smithi003.stdout:2/603: chown d0/d21/d2f/d50/dc4/d7f 61537874 1 2024-09-21T12:20:50.474 INFO:tasks.workunit.client.0.smithi003.stdout:7/593: creat d8/d7a/dae/fd2 x:0 0 0 2024-09-21T12:20:50.475 INFO:tasks.workunit.client.0.smithi003.stdout:7/594: read - d8/d2c/fab zero size 2024-09-21T12:20:50.477 INFO:tasks.workunit.client.0.smithi003.stdout:0/836: rename d9/d6c/d26/d54/d88/la1 to d9/d12/d17/d21/d30/d4d/d11d/l12f 0 2024-09-21T12:20:50.478 INFO:tasks.workunit.client.0.smithi003.stdout:0/837: chown d9/d12/d17/d38/d47/da9/cbd 5 1 2024-09-21T12:20:50.480 INFO:tasks.workunit.client.0.smithi003.stdout:2/604: symlink d0/dd/d22/d68/d7e/d97/ld5 0 2024-09-21T12:20:50.483 INFO:tasks.workunit.client.0.smithi003.stdout:2/605: read - d0/d21/d30/f93 zero size 2024-09-21T12:20:50.484 INFO:tasks.workunit.client.0.smithi003.stdout:3/776: link d0/d5/da/d28/ccb d0/d5/da/d28/d31/d6b/c101 0 2024-09-21T12:20:50.488 INFO:tasks.workunit.client.0.smithi003.stdout:1/739: truncate d4/df/fa5 683032 0 2024-09-21T12:20:50.489 INFO:tasks.workunit.client.0.smithi003.stdout:2/606: mknod d0/d1c/d6a/dc0/cd6 0 2024-09-21T12:20:50.497 INFO:tasks.workunit.client.0.smithi003.stdout:2/607: creat d0/d21/d2f/d50/dc4/d7f/daa/fd7 x:0 0 0 2024-09-21T12:20:50.498 INFO:tasks.workunit.client.0.smithi003.stdout:1/740: dwrite d4/df/d12/f46 [4194304,4194304] 0 2024-09-21T12:20:50.499 INFO:tasks.workunit.client.0.smithi003.stdout:4/611: truncate d9/d16/f3d 144472 0 2024-09-21T12:20:50.501 INFO:tasks.workunit.client.0.smithi003.stdout:7/595: dread d8/db/d32/d43/d7e/f83 [0,4194304] 0 2024-09-21T12:20:50.501 INFO:tasks.workunit.client.0.smithi003.stdout:4/612: write d9/da/d36/da9/fc4 [1804488,58655] 0 2024-09-21T12:20:50.503 INFO:tasks.workunit.client.0.smithi003.stdout:3/777: dread d0/d5/d38/d55/f65 [0,4194304] 0 2024-09-21T12:20:50.503 INFO:tasks.workunit.client.0.smithi003.stdout:4/613: chown d9/da/l74 925050 1 2024-09-21T12:20:50.506 INFO:tasks.workunit.client.0.smithi003.stdout:7/596: fdatasync d8/f7b 0 2024-09-21T12:20:50.509 INFO:tasks.workunit.client.0.smithi003.stdout:3/778: read d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/d77/f9d [46483,65123] 0 2024-09-21T12:20:50.509 INFO:tasks.workunit.client.0.smithi003.stdout:7/597: chown d8/db/d13/c9c 3 1 2024-09-21T12:20:50.512 INFO:tasks.workunit.client.0.smithi003.stdout:0/838: getdents d9/d6c/d26/d54/d88 0 2024-09-21T12:20:50.519 INFO:tasks.workunit.client.0.smithi003.stdout:4/614: dwrite d9/f3a [0,4194304] 0 2024-09-21T12:20:50.521 INFO:tasks.workunit.client.0.smithi003.stdout:8/788: dwrite d7/d57/d77/fb3 [0,4194304] 0 2024-09-21T12:20:50.522 INFO:tasks.workunit.client.0.smithi003.stdout:7/598: mknod d8/d3c/cd3 0 2024-09-21T12:20:50.523 INFO:tasks.workunit.client.0.smithi003.stdout:0/839: dread d9/d12/d17/fe3 [0,4194304] 0 2024-09-21T12:20:50.527 INFO:tasks.workunit.client.0.smithi003.stdout:2/608: write d0/d46/f64 [146979,94438] 0 2024-09-21T12:20:50.529 INFO:tasks.workunit.client.0.smithi003.stdout:2/609: fdatasync d0/d21/d30/f43 0 2024-09-21T12:20:50.529 INFO:tasks.workunit.client.0.smithi003.stdout:3/779: rmdir d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/d42/d6d 39 2024-09-21T12:20:50.530 INFO:tasks.workunit.client.0.smithi003.stdout:2/610: chown d0/d21/d2f/d49 314256 1 2024-09-21T12:20:50.531 INFO:tasks.workunit.client.0.smithi003.stdout:3/780: read - d0/d5/da/d28/d31/fbf zero size 2024-09-21T12:20:50.532 INFO:tasks.workunit.client.0.smithi003.stdout:4/615: mkdir d9/da/dab/dd4 0 2024-09-21T12:20:50.532 INFO:tasks.workunit.client.0.smithi003.stdout:2/611: chown d0/d21/d2f/d50/dc4/f89 3772 1 2024-09-21T12:20:50.534 INFO:tasks.workunit.client.0.smithi003.stdout:1/741: getdents d4/d11/d14 0 2024-09-21T12:20:50.535 INFO:tasks.workunit.client.0.smithi003.stdout:7/599: write d8/db/d32/f8c [102130,51127] 0 2024-09-21T12:20:50.538 INFO:tasks.workunit.client.0.smithi003.stdout:8/789: dread d7/df/d20/d21/d4c/d4d/f92 [4194304,4194304] 0 2024-09-21T12:20:50.542 INFO:tasks.workunit.client.0.smithi003.stdout:4/616: creat d9/da/d66/da2/fd5 x:0 0 0 2024-09-21T12:20:50.543 INFO:tasks.workunit.client.0.smithi003.stdout:2/612: mknod d0/d21/d2f/d50/cd8 0 2024-09-21T12:20:50.543 INFO:tasks.workunit.client.0.smithi003.stdout:4/617: readlink d9/da/d66/d67/lbf 0 2024-09-21T12:20:50.544 INFO:tasks.workunit.client.0.smithi003.stdout:2/613: fdatasync d0/dd/d22/d9d/fca 0 2024-09-21T12:20:50.545 INFO:tasks.workunit.client.0.smithi003.stdout:3/781: creat d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/d77/f102 x:0 0 0 2024-09-21T12:20:50.549 INFO:tasks.workunit.client.0.smithi003.stdout:8/790: mkdir d7/d57/d77/da5/dd4/dfa/d119 0 2024-09-21T12:20:50.550 INFO:tasks.workunit.client.0.smithi003.stdout:8/791: stat d7/d57/d77/da5/dd4/dfa/f103 0 2024-09-21T12:20:50.551 INFO:tasks.workunit.client.0.smithi003.stdout:4/618: mkdir d9/da/d66/d67/dd6 0 2024-09-21T12:20:50.553 INFO:tasks.workunit.client.0.smithi003.stdout:1/742: creat d4/f101 x:0 0 0 2024-09-21T12:20:50.555 INFO:tasks.workunit.client.0.smithi003.stdout:2/614: link d0/d21/d2f/d50/fc8 d0/d1c/d6a/fd9 0 2024-09-21T12:20:50.556 INFO:tasks.workunit.client.0.smithi003.stdout:8/792: creat d7/df/d20/d24/d47/df3/f11a x:0 0 0 2024-09-21T12:20:50.557 INFO:tasks.workunit.client.0.smithi003.stdout:4/619: creat d9/d16/d65/d73/fd7 x:0 0 0 2024-09-21T12:20:50.559 INFO:tasks.workunit.client.0.smithi003.stdout:4/620: write d9/da/f9e [665799,32058] 0 2024-09-21T12:20:50.560 INFO:tasks.workunit.client.0.smithi003.stdout:1/743: symlink d4/d66/l102 0 2024-09-21T12:20:50.565 INFO:tasks.workunit.client.0.smithi003.stdout:0/840: dwrite d9/d12/d17/d38/d3a/d46/d55/d7b/f83 [0,4194304] 0 2024-09-21T12:20:50.567 INFO:tasks.workunit.client.0.smithi003.stdout:3/782: creat d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/d42/f103 x:0 0 0 2024-09-21T12:20:50.570 INFO:tasks.workunit.client.0.smithi003.stdout:4/621: rmdir d9 39 2024-09-21T12:20:50.570 INFO:tasks.workunit.client.0.smithi003.stdout:7/600: write d8/f7b [1136944,85816] 0 2024-09-21T12:20:50.572 INFO:tasks.workunit.client.0.smithi003.stdout:1/744: chown d4/d11/d14/d25/d42/f8c 688 1 2024-09-21T12:20:50.575 INFO:tasks.workunit.client.0.smithi003.stdout:0/841: dwrite d9/d6c/f1b [8388608,4194304] 0 2024-09-21T12:20:50.577 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.575+0000 7fe469576640 1 -- 172.21.15.3:0/4125818188 --> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fe464062630 con 0x7fe450074ad0 2024-09-21T12:20:50.577 INFO:tasks.workunit.client.0.smithi003.stdout:6/845: sync 2024-09-21T12:20:50.578 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.576+0000 7fe460ff9640 1 -- 172.21.15.3:0/4125818188 <== mgr.24409 v2:172.21.15.192:6828/1528605296 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+310 (secure 0 0 0) 0x7fe464062630 con 0x7fe450074ad0 2024-09-21T12:20:50.582 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.581+0000 7fe469576640 1 -- 172.21.15.3:0/4125818188 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7fe450074ad0 msgr2=0x7fe450076f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:50.583 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.581+0000 7fe469576640 1 --2- 172.21.15.3:0/4125818188 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7fe450074ad0 0x7fe450076f90 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe44c006010 tx=0x7fe44c02a9a0 comp rx=0 tx=0).stop 2024-09-21T12:20:50.583 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.581+0000 7fe469576640 1 -- 172.21.15.3:0/4125818188 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe464100260 msgr2=0x7fe46419dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:50.583 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.581+0000 7fe469576640 1 --2- 172.21.15.3:0/4125818188 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe464100260 0x7fe46419dbb0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fe45400b420 tx=0x7fe45400b8e0 comp rx=0 tx=0).stop 2024-09-21T12:20:50.583 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.581+0000 7fe469576640 1 -- 172.21.15.3:0/4125818188 shutdown_connections 2024-09-21T12:20:50.583 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.581+0000 7fe469576640 1 --2- 172.21.15.3:0/4125818188 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7fe450074ad0 0x7fe450076f90 secure :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fe44c006010 tx=0x7fe44c02a9a0 comp rx=0 tx=0).stop 2024-09-21T12:20:50.583 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.581+0000 7fe469576640 1 --2- 172.21.15.3:0/4125818188 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe464100ba0 0x7fe46419e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:50.583 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.581+0000 7fe469576640 1 --2- 172.21.15.3:0/4125818188 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe464100260 0x7fe46419dbb0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:50.583 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.581+0000 7fe469576640 1 -- 172.21.15.3:0/4125818188 >> 172.21.15.3:0/4125818188 conn(0x7fe4640fc010 msgr2=0x7fe464108b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:20:50.583 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.581+0000 7fe469576640 1 -- 172.21.15.3:0/4125818188 shutdown_connections 2024-09-21T12:20:50.583 INFO:tasks.workunit.client.0.smithi003.stdout:1/745: rmdir d4/d11/df6 39 2024-09-21T12:20:50.584 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.581+0000 7fe469576640 1 -- 172.21.15.3:0/4125818188 wait complete. 2024-09-21T12:20:50.584 INFO:tasks.workunit.client.0.smithi003.stdout:7/601: fdatasync d8/d31/fa3 0 2024-09-21T12:20:50.585 INFO:tasks.workunit.client.0.smithi003.stdout:2/615: write d0/fc [2235627,40786] 0 2024-09-21T12:20:50.586 INFO:tasks.workunit.client.0.smithi003.stdout:7/602: readlink d8/db/d32/d43/lbc 0 2024-09-21T12:20:50.588 INFO:tasks.workunit.client.0.smithi003.stdout:6/846: dread d4/d11/d1d/fbc [0,4194304] 0 2024-09-21T12:20:50.589 INFO:tasks.workunit.client.0.smithi003.stdout:6/847: chown d4/d100 79677 1 2024-09-21T12:20:50.590 INFO:tasks.workunit.client.0.smithi003.stdout:0/842: creat d9/d12/d17/d38/d3a/d46/d55/d9e/f130 x:0 0 0 2024-09-21T12:20:50.592 INFO:tasks.workunit.client.0.smithi003.stdout:4/622: rename d9/da/d47/d4b to d9/da/d66/d67/dcd/dd8 0 2024-09-21T12:20:50.593 INFO:tasks.workunit.client.0.smithi003.stdout:1/746: mkdir d4/df/d41/d103 0 2024-09-21T12:20:50.594 INFO:tasks.workunit.client.0.smithi003.stdout:3/783: write d0/d5/f4a [787023,102166] 0 2024-09-21T12:20:50.596 INFO:tasks.workunit.client.0.smithi003.stdout:8/793: getdents d7/df/d16/dd0 0 2024-09-21T12:20:50.597 INFO:teuthology.orchestra.run.smithi003.stdout:true 2024-09-21T12:20:50.601 INFO:tasks.workunit.client.0.smithi003.stdout:6/848: mkdir d4/d13/d5b/d126 0 2024-09-21T12:20:50.603 INFO:tasks.workunit.client.0.smithi003.stdout:0/843: creat d9/d12/d17/d38/f131 x:0 0 0 2024-09-21T12:20:50.606 INFO:tasks.workunit.client.0.smithi003.stdout:4/623: fdatasync d9/f15 0 2024-09-21T12:20:50.608 INFO:tasks.workunit.client.0.smithi003.stdout:2/616: dread d0/dd/f84 [0,4194304] 0 2024-09-21T12:20:50.610 INFO:tasks.workunit.client.0.smithi003.stdout:1/747: read d4/d11/d49/f7c [489003,57234] 0 2024-09-21T12:20:50.611 INFO:tasks.workunit.client.0.smithi003.stdout:3/784: write d0/d5/da/d28/d11/d49/d4c/f66 [4666259,25996] 0 2024-09-21T12:20:50.623 INFO:tasks.workunit.client.0.smithi003.stdout:6/849: creat d4/d13/d22/dc3/f127 x:0 0 0 2024-09-21T12:20:50.624 INFO:tasks.workunit.client.0.smithi003.stdout:0/844: symlink d9/d12/d17/d38/d3a/d46/d55/d7b/d9a/l132 0 2024-09-21T12:20:50.627 INFO:tasks.workunit.client.0.smithi003.stdout:1/748: dread d4/d11/d14/d25/d42/d7b/fb5 [0,4194304] 0 2024-09-21T12:20:50.627 INFO:tasks.workunit.client.0.smithi003.stdout:7/603: truncate d8/f7b 1127490 0 2024-09-21T12:20:50.628 INFO:tasks.workunit.client.0.smithi003.stdout:4/624: chown d9/d16/d65/l93 219326574 1 2024-09-21T12:20:50.632 INFO:tasks.workunit.client.0.smithi003.stdout:3/785: truncate d0/d5/d38/d55/f60 3477510 0 2024-09-21T12:20:50.635 INFO:tasks.workunit.client.0.smithi003.stdout:6/850: chown d4/d11/d32/l3d 80 1 2024-09-21T12:20:50.635 INFO:tasks.workunit.client.0.smithi003.stdout:6/851: stat d4/d13/d19/d23 0 2024-09-21T12:20:50.636 INFO:tasks.workunit.client.0.smithi003.stdout:0/845: fsync d9/d12/d1e/f1f 0 2024-09-21T12:20:50.639 INFO:tasks.workunit.client.0.smithi003.stdout:7/604: read d8/f7c [1083744,68687] 0 2024-09-21T12:20:50.640 INFO:tasks.workunit.client.0.smithi003.stdout:7/605: write d8/d3c/f9a [1079823,3270] 0 2024-09-21T12:20:50.641 INFO:tasks.workunit.client.0.smithi003.stdout:4/625: rename d9/da/cc7 to d9/d16/d65/d73/d8d/cd9 0 2024-09-21T12:20:50.644 INFO:tasks.workunit.client.0.smithi003.stdout:2/617: truncate d0/d21/d30/f43 1353719 0 2024-09-21T12:20:50.648 INFO:tasks.workunit.client.0.smithi003.stdout:3/786: mkdir d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/de3/d104 0 2024-09-21T12:20:50.651 INFO:tasks.workunit.client.0.smithi003.stdout:2/618: dwrite d0/dd/d22/fd1 [0,4194304] 0 2024-09-21T12:20:50.658 INFO:tasks.workunit.client.0.smithi003.stdout:7/606: rmdir d8/d3c/d57/d9e 39 2024-09-21T12:20:50.659 INFO:tasks.workunit.client.0.smithi003.stdout:7/607: chown d8/d31/d84/da9/dc5 180886 1 2024-09-21T12:20:50.666 INFO:tasks.workunit.client.0.smithi003.stdout:8/794: getdents d7/df/d20/d21/de6 0 2024-09-21T12:20:50.670 INFO:tasks.workunit.client.0.smithi003.stdout:1/749: write d4/d11/f72 [2276686,85915] 0 2024-09-21T12:20:50.675 INFO:tasks.workunit.client.0.smithi003.stdout:4/626: write d9/f15 [1712170,62272] 0 2024-09-21T12:20:50.680 INFO:tasks.workunit.client.0.smithi003.stdout:7/608: mknod d8/d93/cd4 0 2024-09-21T12:20:50.681 INFO:tasks.workunit.client.0.smithi003.stdout:6/852: truncate d4/d11/d32/fdb 251708 0 2024-09-21T12:20:50.686 INFO:tasks.workunit.client.0.smithi003.stdout:1/750: truncate d4/df/d19/f4e 2510639 0 2024-09-21T12:20:50.687 INFO:tasks.workunit.client.0.smithi003.stdout:0/846: rmdir d9/d12/d17/d129 0 2024-09-21T12:20:50.687 INFO:tasks.workunit.client.0.smithi003.stdout:4/627: rmdir d9/da/d66 39 2024-09-21T12:20:50.689 INFO:tasks.workunit.client.0.smithi003.stdout:7/609: dread - d8/d31/fa3 zero size 2024-09-21T12:20:50.691 INFO:tasks.workunit.client.0.smithi003.stdout:7/610: write d8/d7a/fb9 [540407,86602] 0 2024-09-21T12:20:50.692 INFO:tasks.workunit.client.0.smithi003.stdout:7/611: stat d8/db/d32/d43/c4c 0 2024-09-21T12:20:50.693 INFO:tasks.workunit.client.0.smithi003.stdout:8/795: getdents d7/df/d20/d21/de6 0 2024-09-21T12:20:50.694 INFO:tasks.workunit.client.0.smithi003.stdout:8/796: chown d7/df/d20/d54/d9d 24921140 1 2024-09-21T12:20:50.696 INFO:tasks.workunit.client.0.smithi003.stdout:1/751: truncate d4/d11/df6/ffd 815293 0 2024-09-21T12:20:50.702 INFO:tasks.workunit.client.0.smithi003.stdout:1/752: dwrite d4/d11/d14/d25/d42/f55 [0,4194304] 0 2024-09-21T12:20:50.704 INFO:tasks.workunit.client.0.smithi003.stdout:2/619: rename d0/dd/d22/d68/d7e to d0/dd/d22/d37/dda 0 2024-09-21T12:20:50.710 INFO:tasks.workunit.client.0.smithi003.stdout:2/620: dread d0/d21/d2c/f72 [0,4194304] 0 2024-09-21T12:20:50.711 INFO:tasks.workunit.client.0.smithi003.stdout:3/787: getdents d0/d5/da/d28/d11/d49/d4c/d6f/d91 0 2024-09-21T12:20:50.712 INFO:tasks.workunit.client.0.smithi003.stdout:6/853: write d4/d11/dc1/d58/f5c [8160280,115983] 0 2024-09-21T12:20:50.714 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.713+0000 7f5d71ffb640 1 -- 172.21.15.3:0/1896689196 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5d6402fda0 con 0x7f5d74101a80 2024-09-21T12:20:50.715 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.713+0000 7f5d7972f640 1 -- 172.21.15.3:0/1896689196 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5d74101a80 msgr2=0x7f5d74101f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:50.715 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.713+0000 7f5d7972f640 1 --2- 172.21.15.3:0/1896689196 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5d74101a80 0x7f5d74101f00 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f5d64009c20 tx=0x7f5d6402a970 comp rx=0 tx=0).stop 2024-09-21T12:20:50.715 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.714+0000 7f5d7972f640 1 -- 172.21.15.3:0/1896689196 shutdown_connections 2024-09-21T12:20:50.715 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.714+0000 7f5d7972f640 1 --2- 172.21.15.3:0/1896689196 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5d74101a80 0x7f5d74101f00 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:50.715 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.714+0000 7f5d7972f640 1 --2- 172.21.15.3:0/1896689196 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5d74100880 0x7f5d74100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:50.715 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.714+0000 7f5d7972f640 1 -- 172.21.15.3:0/1896689196 >> 172.21.15.3:0/1896689196 conn(0x7f5d740fc010 msgr2=0x7f5d740fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:20:50.715 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.714+0000 7f5d7972f640 1 -- 172.21.15.3:0/1896689196 shutdown_connections 2024-09-21T12:20:50.716 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.714+0000 7f5d7972f640 1 -- 172.21.15.3:0/1896689196 wait complete. 2024-09-21T12:20:50.716 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.714+0000 7f5d7972f640 1 Processor -- start 2024-09-21T12:20:50.716 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.715+0000 7f5d7972f640 1 -- start start 2024-09-21T12:20:50.717 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.715+0000 7f5d7972f640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5d74100880 0x7f5d7410c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:50.717 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.715+0000 7f5d7972f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5d74101a80 0x7f5d7410cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:50.717 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.715+0000 7f5d7972f640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f5d74104570 con 0x7f5d74101a80 2024-09-21T12:20:50.717 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.715+0000 7f5d7972f640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5d741043f0 con 0x7f5d74100880 2024-09-21T12:20:50.717 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.715+0000 7f5d727fc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5d74101a80 0x7f5d7410cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:50.717 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.715+0000 7f5d727fc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5d74101a80 0x7f5d7410cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:51918/0 (socket says 172.21.15.3:51918) 2024-09-21T12:20:50.717 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.715+0000 7f5d727fc640 1 -- 172.21.15.3:0/2838949229 learned_addr learned my addr 172.21.15.3:0/2838949229 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:20:50.718 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.715+0000 7f5d72ffd640 1 --2- 172.21.15.3:0/2838949229 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5d74100880 0x7f5d7410c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:50.718 INFO:tasks.workunit.client.0.smithi003.stdout:4/628: mknod d9/da/d66/cda 0 2024-09-21T12:20:50.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.716+0000 7f5d72ffd640 1 -- 172.21.15.3:0/2838949229 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5d74101a80 msgr2=0x7f5d7410cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:50.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.716+0000 7f5d72ffd640 1 --2- 172.21.15.3:0/2838949229 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5d74101a80 0x7f5d7410cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:50.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.716+0000 7f5d72ffd640 1 -- 172.21.15.3:0/2838949229 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d74109350 con 0x7f5d74100880 2024-09-21T12:20:50.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.716+0000 7f5d72ffd640 1 --2- 172.21.15.3:0/2838949229 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5d74100880 0x7f5d7410c7d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c00d6a0 tx=0x7f5d5c00db60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:20:50.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.716+0000 7f5d6bfff640 1 -- 172.21.15.3:0/2838949229 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5d5c017070 con 0x7f5d74100880 2024-09-21T12:20:50.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.716+0000 7f5d6bfff640 1 -- 172.21.15.3:0/2838949229 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5d5c0097a0 con 0x7f5d74100880 2024-09-21T12:20:50.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.716+0000 7f5d7972f640 1 -- 172.21.15.3:0/2838949229 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d74109640 con 0x7f5d74100880 2024-09-21T12:20:50.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.716+0000 7f5d7972f640 1 -- 172.21.15.3:0/2838949229 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d74109c50 con 0x7f5d74100880 2024-09-21T12:20:50.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.717+0000 7f5d6bfff640 1 -- 172.21.15.3:0/2838949229 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5d5c017070 con 0x7f5d74100880 2024-09-21T12:20:50.720 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.718+0000 7f5d7972f640 1 -- 172.21.15.3:0/2838949229 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d7410d2e0 con 0x7f5d74100880 2024-09-21T12:20:50.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.719+0000 7f5d6bfff640 1 -- 172.21.15.3:0/2838949229 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7f5d5c009950 con 0x7f5d74100880 2024-09-21T12:20:50.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.720+0000 7f5d6bfff640 1 --2- 172.21.15.3:0/2838949229 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7f5d60074c60 0x7f5d60077120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:50.722 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.720+0000 7f5d6bfff640 1 -- 172.21.15.3:0/2838949229 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5812+0+0 (secure 0 0 0) 0x7f5d5c0959b0 con 0x7f5d74100880 2024-09-21T12:20:50.722 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.720+0000 7f5d727fc640 1 --2- 172.21.15.3:0/2838949229 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7f5d60074c60 0x7f5d60077120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:50.722 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.721+0000 7f5d727fc640 1 --2- 172.21.15.3:0/2838949229 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7f5d60074c60 0x7f5d60077120 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5d64005e30 tx=0x7f5d6403c040 comp rx=0 tx=0).ready entity=mgr.24409 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:20:50.724 INFO:tasks.workunit.client.0.smithi003.stdout:2/621: mkdir d0/dd/d22/d37/d3f/ddb 0 2024-09-21T12:20:50.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:50.723+0000 7f5d6bfff640 1 -- 172.21.15.3:0/2838949229 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f5d5c061000 con 0x7f5d74100880 2024-09-21T12:20:50.726 INFO:tasks.workunit.client.0.smithi003.stdout:2/622: truncate d0/d21/d2f/d9f/fb9 602566 0 2024-09-21T12:20:50.730 INFO:tasks.workunit.client.0.smithi003.stdout:6/854: creat d4/d11/d17/f128 x:0 0 0 2024-09-21T12:20:50.731 INFO:tasks.workunit.client.0.smithi003.stdout:6/855: fdatasync d4/d9/d79/f9d 0 2024-09-21T12:20:50.740 INFO:tasks.workunit.client.0.smithi003.stdout:7/612: link d8/d3c/d57/l71 d8/d3c/ld5 0 2024-09-21T12:20:50.743 INFO:tasks.workunit.client.0.smithi003.stdout:3/788: mknod d0/d5/da/d28/d11/c105 0 2024-09-21T12:20:50.744 INFO:tasks.workunit.client.0.smithi003.stdout:8/797: dwrite d7/df/d20/d21/d4c/fbb [0,4194304] 0 2024-09-21T12:20:50.746 INFO:tasks.workunit.client.0.smithi003.stdout:4/629: dwrite d9/f3a [4194304,4194304] 0 2024-09-21T12:20:50.747 INFO:tasks.workunit.client.0.smithi003.stdout:0/847: link d9/d12/d17/c51 d9/d12/d17/d38/d3a/d46/c133 0 2024-09-21T12:20:50.749 INFO:tasks.workunit.client.0.smithi003.stdout:7/613: symlink d8/d3c/d64/ld6 0 2024-09-21T12:20:50.753 INFO:tasks.workunit.client.0.smithi003.stdout:3/789: unlink d0/d5/d38/d55/la3 0 2024-09-21T12:20:50.754 INFO:tasks.workunit.client.0.smithi003.stdout:6/856: mkdir d4/d11/d32/d129 0 2024-09-21T12:20:50.757 INFO:tasks.workunit.client.0.smithi003.stdout:6/857: chown d4/d13/d2e/cc6 8 1 2024-09-21T12:20:50.758 INFO:tasks.workunit.client.0.smithi003.stdout:4/630: dwrite d9/d16/d65/d73/d8d/fa0 [0,4194304] 0 2024-09-21T12:20:50.763 INFO:tasks.workunit.client.0.smithi003.stdout:4/631: write f6 [2729106,86963] 0 2024-09-21T12:20:50.765 INFO:tasks.workunit.client.0.smithi003.stdout:2/623: getdents d0/d46 0 2024-09-21T12:20:50.770 INFO:tasks.workunit.client.0.smithi003.stdout:3/790: dwrite d0/d5/da/d28/dd/f2b [0,4194304] 0 2024-09-21T12:20:50.774 INFO:tasks.workunit.client.0.smithi003.stdout:3/791: dread d0/d5/d38/f75 [0,4194304] 0 2024-09-21T12:20:50.780 INFO:tasks.workunit.client.0.smithi003.stdout:0/848: write d9/d12/d1e/d108/d2d/f77 [1178837,3249] 0 2024-09-21T12:20:50.783 INFO:tasks.workunit.client.0.smithi003.stdout:3/792: creat d0/d5/da/d28/d31/d6b/de9/f106 x:0 0 0 2024-09-21T12:20:50.786 INFO:tasks.workunit.client.0.smithi003.stdout:7/614: dread d8/db/d32/f6f [0,4194304] 0 2024-09-21T12:20:50.787 INFO:tasks.workunit.client.0.smithi003.stdout:8/798: dread d7/df/d20/d21/dd5/dde/fe3 [0,4194304] 0 2024-09-21T12:20:50.787 INFO:tasks.workunit.client.0.smithi003.stdout:3/793: read d0/d5/da/d28/dd/fda [3176839,3507] 0 2024-09-21T12:20:50.789 INFO:tasks.workunit.client.0.smithi003.stdout:0/849: unlink d9/d12/d17/d38/d3a/d46/d55/d7b/d9a/fef 0 2024-09-21T12:20:50.789 INFO:tasks.workunit.client.0.smithi003.stdout:6/858: write d4/f7c [4492586,154] 0 2024-09-21T12:20:50.794 INFO:tasks.workunit.client.0.smithi003.stdout:7/615: readlink d8/l35 0 2024-09-21T12:20:50.798 INFO:tasks.workunit.client.0.smithi003.stdout:4/632: dread d9/d25/f5e [0,4194304] 0 2024-09-21T12:20:50.799 INFO:tasks.workunit.client.0.smithi003.stdout:3/794: mkdir d0/d5/d38/d55/ddb/d107 0 2024-09-21T12:20:50.799 INFO:tasks.workunit.client.0.smithi003.stdout:8/799: dwrite d7/df/d20/d21/de6/f111 [0,4194304] 0 2024-09-21T12:20:50.802 INFO:tasks.workunit.client.0.smithi003.stdout:6/859: creat d4/d9/d79/f12a x:0 0 0 2024-09-21T12:20:50.802 INFO:tasks.workunit.client.0.smithi003.stdout:2/624: dread d0/d1c/d6a/f71 [0,4194304] 0 2024-09-21T12:20:50.803 INFO:tasks.workunit.client.0.smithi003.stdout:6/860: chown d4/d9/d59/ca0 3 1 2024-09-21T12:20:50.803 INFO:tasks.workunit.client.0.smithi003.stdout:4/633: write d9/da/d36/da9/fc4 [1704623,48816] 0 2024-09-21T12:20:50.804 INFO:tasks.workunit.client.0.smithi003.stdout:4/634: readlink d9/da/d66/d67/lbf 0 2024-09-21T12:20:50.806 INFO:tasks.workunit.client.0.smithi003.stdout:2/625: truncate d0/d1c/d6a/fd9 524544 0 2024-09-21T12:20:50.807 INFO:tasks.workunit.client.0.smithi003.stdout:7/616: fdatasync d8/db/d13/f86 0 2024-09-21T12:20:50.810 INFO:tasks.workunit.client.0.smithi003.stdout:6/861: mknod d4/d13/d22/c12b 0 2024-09-21T12:20:50.811 INFO:tasks.workunit.client.0.smithi003.stdout:7/617: dread d8/db/d13/d60/f97 [0,4194304] 0 2024-09-21T12:20:50.813 INFO:tasks.workunit.client.0.smithi003.stdout:4/635: unlink d9/da/d66/da2/fd5 0 2024-09-21T12:20:50.814 INFO:tasks.workunit.client.0.smithi003.stdout:0/850: dwrite d9/d6c/d26/d54/f6f [0,4194304] 0 2024-09-21T12:20:50.814 INFO:tasks.workunit.client.0.smithi003.stdout:7/618: write d8/d3c/d57/f65 [5766837,11433] 0 2024-09-21T12:20:50.815 INFO:tasks.workunit.client.0.smithi003.stdout:4/636: read d9/da/fb [6350571,121093] 0 2024-09-21T12:20:50.818 INFO:tasks.workunit.client.0.smithi003.stdout:4/637: dread - d9/d16/d65/d73/d8d/fad zero size 2024-09-21T12:20:50.821 INFO:tasks.workunit.client.0.smithi003.stdout:4/638: write d9/d16/d65/d73/fa3 [7432207,97366] 0 2024-09-21T12:20:50.824 INFO:tasks.workunit.client.0.smithi003.stdout:0/851: creat d9/d12/d17/d38/dfb/f134 x:0 0 0 2024-09-21T12:20:50.829 INFO:tasks.workunit.client.0.smithi003.stdout:4/639: creat d9/da/d66/da2/fdb x:0 0 0 2024-09-21T12:20:50.830 INFO:tasks.workunit.client.0.smithi003.stdout:8/800: write d7/de/f19 [3071529,100258] 0 2024-09-21T12:20:50.832 INFO:tasks.workunit.client.0.smithi003.stdout:3/795: dwrite d0/d5/fab [0,4194304] 0 2024-09-21T12:20:50.835 INFO:tasks.workunit.client.0.smithi003.stdout:4/640: chown d9/da/d66/d67/dcd/dd8/d72/cb3 0 1 2024-09-21T12:20:50.837 INFO:tasks.workunit.client.0.smithi003.stdout:3/796: dread d0/fba [0,4194304] 0 2024-09-21T12:20:50.844 INFO:tasks.workunit.client.0.smithi003.stdout:7/619: write d8/db/f16 [890724,68207] 0 2024-09-21T12:20:50.844 INFO:tasks.workunit.client.0.smithi003.stdout:2/626: dread d0/dd/d22/f85 [0,4194304] 0 2024-09-21T12:20:50.845 INFO:tasks.workunit.client.0.smithi003.stdout:0/852: write d9/d6c/d26/f35 [6154509,124863] 0 2024-09-21T12:20:50.848 INFO:tasks.workunit.client.0.smithi003.stdout:6/862: dwrite d4/d13/d63/f8d [0,4194304] 0 2024-09-21T12:20:50.848 INFO:tasks.workunit.client.0.smithi003.stdout:3/797: mknod d0/d5/da/d28/d31/c108 0 2024-09-21T12:20:50.856 INFO:tasks.workunit.client.0.smithi003.stdout:8/801: dwrite d7/df/d20/d21/dd5/dde/f109 [0,4194304] 0 2024-09-21T12:20:50.860 INFO:tasks.workunit.client.0.smithi003.stdout:6/863: mknod d4/d13/d19/d23/c12c 0 2024-09-21T12:20:50.862 INFO:tasks.workunit.client.0.smithi003.stdout:8/802: rmdir d7/df/d20 39 2024-09-21T12:20:50.862 INFO:tasks.workunit.client.0.smithi003.stdout:6/864: truncate d4/d11/dc1/d64/ff7 517165 0 2024-09-21T12:20:50.864 INFO:tasks.workunit.client.0.smithi003.stdout:6/865: truncate d4/d13/d22/fa5 4729104 0 2024-09-21T12:20:50.864 INFO:tasks.workunit.client.0.smithi003.stdout:3/798: creat d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/de3/f109 x:0 0 0 2024-09-21T12:20:50.864 INFO:tasks.workunit.client.0.smithi003.stdout:2/627: creat d0/dd/d22/d37/d3f/ddb/fdc x:0 0 0 2024-09-21T12:20:50.867 INFO:tasks.workunit.client.0.smithi003.stdout:2/628: fdatasync d0/d21/d2f/d9f/fb9 0 2024-09-21T12:20:50.867 INFO:tasks.workunit.client.0.smithi003.stdout:6/866: rmdir d4/d9/d59 39 2024-09-21T12:20:50.869 INFO:tasks.workunit.client.0.smithi003.stdout:3/799: mkdir d0/d5/da/d28/d31/d6b/d10a 0 2024-09-21T12:20:50.870 INFO:tasks.workunit.client.0.smithi003.stdout:6/867: truncate d4/d13/f7b 1623804 0 2024-09-21T12:20:50.873 INFO:tasks.workunit.client.0.smithi003.stdout:8/803: mkdir d7/df/d20/d21/d4c/d8a/d11b 0 2024-09-21T12:20:50.874 INFO:tasks.workunit.client.0.smithi003.stdout:0/853: write d9/d6c/fbe [550739,40940] 0 2024-09-21T12:20:50.874 INFO:tasks.workunit.client.0.smithi003.stdout:6/868: dread d4/d13/d19/d38/ffd [0,4194304] 0 2024-09-21T12:20:50.875 INFO:tasks.workunit.client.0.smithi003.stdout:4/641: dread d9/da/f57 [4194304,4194304] 0 2024-09-21T12:20:50.876 INFO:tasks.workunit.client.0.smithi003.stdout:8/804: readlink d7/df/d20/d21/l25 0 2024-09-21T12:20:50.876 INFO:tasks.workunit.client.0.smithi003.stdout:2/629: dread d0/dd/d22/d37/f5c [0,4194304] 0 2024-09-21T12:20:50.878 INFO:tasks.workunit.client.0.smithi003.stdout:3/800: symlink d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/d77/dd3/l10b 0 2024-09-21T12:20:50.881 INFO:tasks.workunit.client.0.smithi003.stdout:6/869: unlink d4/d11/dc1/lcb 0 2024-09-21T12:20:50.884 INFO:tasks.workunit.client.0.smithi003.stdout:7/620: dwrite d8/db/d13/d75/fb5 [0,4194304] 0 2024-09-21T12:20:50.886 INFO:tasks.workunit.client.0.smithi003.stdout:4/642: mkdir d9/da/d66/da2/ddc 0 2024-09-21T12:20:50.886 INFO:tasks.workunit.client.0.smithi003.stdout:7/621: write d8/d31/f5f [1499081,43125] 0 2024-09-21T12:20:50.886 INFO:tasks.workunit.client.0.smithi003.stdout:6/870: read d4/d11/dc1/f6b [4044395,101473] 0 2024-09-21T12:20:50.890 INFO:tasks.workunit.client.0.smithi003.stdout:2/630: unlink d0/dd/f56 0 2024-09-21T12:20:50.894 INFO:tasks.workunit.client.0.smithi003.stdout:2/631: dread d0/d21/d2f/d50/f90 [0,4194304] 0 2024-09-21T12:20:50.895 INFO:tasks.workunit.client.0.smithi003.stdout:2/632: readlink d0/dd/d22/l41 0 2024-09-21T12:20:50.895 INFO:tasks.workunit.client.0.smithi003.stdout:3/801: chown d0/d5/da/d28/dd/d9f/fd0 27 1 2024-09-21T12:20:50.904 INFO:tasks.workunit.client.0.smithi003.stdout:6/871: readlink d4/d13/d2e/l39 0 2024-09-21T12:20:50.908 INFO:tasks.workunit.client.0.smithi003.stdout:0/854: dwrite d9/d12/f81 [0,4194304] 0 2024-09-21T12:20:50.910 INFO:tasks.workunit.client.0.smithi003.stdout:3/802: fdatasync d0/d5/da/d28/dd/f72 0 2024-09-21T12:20:50.912 INFO:tasks.workunit.client.0.smithi003.stdout:9/731: sync 2024-09-21T12:20:50.913 INFO:tasks.workunit.client.0.smithi003.stdout:9/732: readlink d2/d20/d22/l4f 0 2024-09-21T12:20:50.915 INFO:tasks.workunit.client.0.smithi003.stdout:0/855: fdatasync d9/d12/d17/d38/d3a/f87 0 2024-09-21T12:20:50.918 INFO:tasks.workunit.client.0.smithi003.stdout:7/622: rename l3 to d8/d3c/d57/ld7 0 2024-09-21T12:20:50.920 INFO:tasks.workunit.client.0.smithi003.stdout:7/623: fsync d8/d3c/faa 0 2024-09-21T12:20:50.925 INFO:tasks.workunit.client.0.smithi003.stdout:0/856: mkdir d9/d12/d101/d135 0 2024-09-21T12:20:50.925 INFO:tasks.workunit.client.0.smithi003.stdout:2/633: dread d0/d1c/f2e [4194304,4194304] 0 2024-09-21T12:20:50.925 INFO:tasks.workunit.client.0.smithi003.stdout:4/643: dwrite d9/d48/f89 [0,4194304] 0 2024-09-21T12:20:50.935 INFO:tasks.workunit.client.0.smithi003.stdout:7/624: mkdir d8/db/d13/d75/dd8 0 2024-09-21T12:20:50.935 INFO:tasks.workunit.client.0.smithi003.stdout:3/803: dread d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/d77/dd3/fdd [0,4194304] 0 2024-09-21T12:20:50.935 INFO:tasks.workunit.client.0.smithi003.stdout:7/625: fdatasync d8/db/d13/d96/db8/fc2 0 2024-09-21T12:20:50.937 INFO:tasks.workunit.client.0.smithi003.stdout:4/644: unlink d9/da/d66/c81 0 2024-09-21T12:20:50.937 INFO:tasks.workunit.client.0.smithi003.stdout:3/804: dread - d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/daa/feb zero size 2024-09-21T12:20:50.937 INFO:tasks.workunit.client.0.smithi003.stdout:7/626: dread - d8/d3c/f90 zero size 2024-09-21T12:20:50.939 INFO:tasks.workunit.client.0.smithi003.stdout:6/872: getdents d4/d13/d2e/de3/df6 0 2024-09-21T12:20:50.940 INFO:tasks.workunit.client.0.smithi003.stdout:9/733: symlink d2/d53/d83/d96/df6/l105 0 2024-09-21T12:20:50.943 INFO:tasks.workunit.client.0.smithi003.stdout:0/857: creat d9/d12/d101/d135/f136 x:0 0 0 2024-09-21T12:20:50.944 INFO:tasks.workunit.client.0.smithi003.stdout:0/858: dread - d9/d6c/d32/ffc zero size 2024-09-21T12:20:50.944 INFO:tasks.workunit.client.0.smithi003.stdout:3/805: creat d0/d5/d38/db8/ddf/f10c x:0 0 0 2024-09-21T12:20:50.947 INFO:tasks.workunit.client.0.smithi003.stdout:6/873: rename d4/d13/d19/l24 to d4/d100/l12d 0 2024-09-21T12:20:50.951 INFO:tasks.workunit.client.0.smithi003.stdout:0/859: creat d9/d6c/d26/db3/f137 x:0 0 0 2024-09-21T12:20:50.953 INFO:tasks.workunit.client.0.smithi003.stdout:3/806: truncate d0/d5/da/f70 25719 0 2024-09-21T12:20:50.956 INFO:tasks.workunit.client.0.smithi003.stdout:2/634: getdents d0/d21/d2f/d9f 0 2024-09-21T12:20:50.958 INFO:tasks.workunit.client.0.smithi003.stdout:2/635: truncate d0/d21/d2f/d50/dc4/d7f/daa/fd7 984008 0 2024-09-21T12:20:50.964 INFO:tasks.workunit.client.0.smithi003.stdout:6/874: dread d4/d13/d19/d23/f70 [0,4194304] 0 2024-09-21T12:20:50.964 INFO:tasks.workunit.client.0.smithi003.stdout:3/807: creat d0/d5/da/d28/d11/d49/d4c/d54/d5e/d48/f10d x:0 0 0 2024-09-21T12:20:50.965 INFO:tasks.workunit.client.0.smithi003.stdout:6/875: write d4/d11/d32/f3b [2191242,106933] 0 2024-09-21T12:20:50.966 INFO:tasks.workunit.client.0.smithi003.stdout:7/627: truncate d8/d3c/d6b/f5a 2213568 0 2024-09-21T12:20:50.969 INFO:tasks.workunit.client.0.smithi003.stdout:2/636: creat d0/d46/dcd/fdd x:0 0 0 2024-09-21T12:20:50.970 INFO:tasks.workunit.client.0.smithi003.stdout:4/645: truncate d9/d48/f89 3656177 0 2024-09-21T12:20:50.972 INFO:tasks.workunit.client.0.smithi003.stdout:4/646: chown f8 3862 1 2024-09-21T12:20:50.973 INFO:tasks.workunit.client.0.smithi003.stdout:3/808: dwrite d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/d42/f103 [0,4194304] 0 2024-09-21T12:20:50.979 INFO:tasks.workunit.client.0.smithi003.stdout:7/628: symlink d8/d31/d84/ld9 0 2024-09-21T12:20:50.981 INFO:tasks.workunit.client.0.smithi003.stdout:4/647: mkdir d9/da/d47/ddd 0 2024-09-21T12:20:50.981 INFO:tasks.workunit.client.0.smithi003.stdout:9/734: dwrite d2/da/f14 [0,4194304] 0 2024-09-21T12:20:50.982 INFO:tasks.workunit.client.0.smithi003.stdout:0/860: rename d9/d12/d1e/d108/d2d/ff5 to d9/d12/d17/f138 0 2024-09-21T12:20:50.983 INFO:tasks.workunit.client.0.smithi003.stdout:4/648: chown d9/d16/lc2 2035 1 2024-09-21T12:20:50.984 INFO:tasks.workunit.client.0.smithi003.stdout:3/809: mknod d0/d5/c10e 0 2024-09-21T12:20:50.986 INFO:tasks.workunit.client.0.smithi003.stdout:3/810: stat d0/d5/da/d28/d11/c105 0 2024-09-21T12:20:50.987 INFO:tasks.workunit.client.0.smithi003.stdout:2/637: mknod d0/d21/d2f/d50/dc4/dc7/cde 0 2024-09-21T12:20:50.989 INFO:tasks.workunit.client.0.smithi003.stdout:7/629: rmdir d8/db/d13/d96/db8/dc4 39 2024-09-21T12:20:50.990 INFO:tasks.workunit.client.0.smithi003.stdout:7/630: read - d8/d31/fa3 zero size 2024-09-21T12:20:50.994 INFO:tasks.workunit.client.0.smithi003.stdout:4/649: mknod d9/d25/cde 0 2024-09-21T12:20:50.994 INFO:tasks.workunit.client.0.smithi003.stdout:7/631: dread - d8/db/d32/d43/d7e/fc0 zero size 2024-09-21T12:20:50.994 INFO:tasks.workunit.client.0.smithi003.stdout:0/861: rename d9/d12/d1e/d108/d2d/caf to d9/d12/d1e/d108/c139 0 2024-09-21T12:20:50.999 INFO:tasks.workunit.client.0.smithi003.stdout:2/638: creat d0/dd/d22/d37/dda/d97/fdf x:0 0 0 2024-09-21T12:20:51.003 INFO:tasks.workunit.client.0.smithi003.stdout:4/650: chown d9/da/f31 21 1 2024-09-21T12:20:51.004 INFO:tasks.workunit.client.0.smithi003.stdout:0/862: dwrite d9/d6c/d26/f35 [4194304,4194304] 0 2024-09-21T12:20:51.010 INFO:tasks.workunit.client.0.smithi003.stdout:9/735: creat d2/d20/f106 x:0 0 0 2024-09-21T12:20:51.013 INFO:tasks.workunit.client.0.smithi003.stdout:3/811: dread d0/d5/da/d28/d11/d49/d4c/fcc [0,4194304] 0 2024-09-21T12:20:51.015 INFO:tasks.workunit.client.0.smithi003.stdout:2/639: fsync d0/d21/d2f/d50/dc4/d7f/f88 0 2024-09-21T12:20:51.018 INFO:tasks.workunit.client.0.smithi003.stdout:7/632: dread d8/db/f16 [0,4194304] 0 2024-09-21T12:20:51.018 INFO:tasks.workunit.client.0.smithi003.stdout:2/640: chown d0/dd/d22/d37/f74 928970132 1 2024-09-21T12:20:51.018 INFO:tasks.workunit.client.0.smithi003.stdout:4/651: mknod d9/da/dab/cdf 0 2024-09-21T12:20:51.019 INFO:tasks.workunit.client.0.smithi003.stdout:7/633: stat d8/f7c 0 2024-09-21T12:20:51.019 INFO:tasks.workunit.client.0.smithi003.stdout:4/652: dread - d9/d25/f69 zero size 2024-09-21T12:20:51.021 INFO:tasks.workunit.client.0.smithi003.stdout:4/653: write d9/da/fa5 [1991399,5075] 0 2024-09-21T12:20:51.023 INFO:tasks.workunit.client.0.smithi003.stdout:4/654: write d9/da/d47/f5c [1003702,37540] 0 2024-09-21T12:20:51.026 INFO:tasks.workunit.client.0.smithi003.stdout:9/736: creat d2/da0/f107 x:0 0 0 2024-09-21T12:20:51.029 INFO:tasks.workunit.client.0.smithi003.stdout:3/812: mknod d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/daa/dc4/c10f 0 2024-09-21T12:20:51.030 INFO:tasks.workunit.client.0.smithi003.stdout:2/641: unlink d0/f36 0 2024-09-21T12:20:51.031 INFO:tasks.workunit.client.0.smithi003.stdout:2/642: chown d0/d21/d2f/d50/dc4/d7f/daa 551846 1 2024-09-21T12:20:51.036 INFO:tasks.workunit.client.0.smithi003.stdout:9/737: rmdir d2/da/d2a/d3c/da2/daf 39 2024-09-21T12:20:51.043 INFO:tasks.workunit.client.0.smithi003.stdout:2/643: truncate d0/d21/d30/fb8 4584303 0 2024-09-21T12:20:51.045 INFO:tasks.workunit.client.0.smithi003.stdout:9/738: mknod d2/da/d2a/d3c/da2/ddd/c108 0 2024-09-21T12:20:51.047 INFO:tasks.workunit.client.0.smithi003.stdout:9/739: mkdir d2/d20/d22/d3f/d109 0 2024-09-21T12:20:51.061 INFO:tasks.workunit.client.0.smithi003.stdout:4/655: write d9/d25/f5e [5234119,83099] 0 2024-09-21T12:20:51.064 INFO:tasks.workunit.client.0.smithi003.stdout:4/656: dread - d9/da/d66/d67/dcd/dd8/d72/fcf zero size 2024-09-21T12:20:51.064 INFO:tasks.workunit.client.0.smithi003.stdout:7/634: dwrite d8/db/d13/d60/f8a [0,4194304] 0 2024-09-21T12:20:51.082 INFO:tasks.workunit.client.0.smithi003.stdout:9/740: write d2/d20/d22/d5e/d87/fa6 [876637,6398] 0 2024-09-21T12:20:51.097 INFO:tasks.workunit.client.0.smithi003.stdout:7/635: creat d8/d2c/fda x:0 0 0 2024-09-21T12:20:51.105 INFO:tasks.workunit.client.0.smithi003.stdout:9/741: creat d2/d53/f10a x:0 0 0 2024-09-21T12:20:51.111 INFO:tasks.workunit.client.0.smithi003.stdout:7/636: getdents d8/d7a/dae 0 2024-09-21T12:20:51.117 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.115+0000 7f5d7972f640 1 -- 172.21.15.3:0/2838949229 --> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f5d74108710 con 0x7f5d60074c60 2024-09-21T12:20:51.120 INFO:tasks.workunit.client.0.smithi003.stdout:7/637: dwrite d8/d3c/f9a [0,4194304] 0 2024-09-21T12:20:51.120 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.119+0000 7f5d6bfff640 1 -- 172.21.15.3:0/2838949229 <== mgr.24409 v2:172.21.15.192:6828/1528605296 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+310 (secure 0 0 0) 0x7f5d74108710 con 0x7f5d60074c60 2024-09-21T12:20:51.122 INFO:tasks.workunit.client.0.smithi003.stdout:2/644: dwrite d0/dd/d22/f23 [0,4194304] 0 2024-09-21T12:20:51.126 INFO:tasks.workunit.client.0.smithi003.stdout:7/638: fdatasync d8/d2c/fda 0 2024-09-21T12:20:51.126 INFO:tasks.workunit.client.0.smithi003.stdout:2/645: fdatasync d0/fc 0 2024-09-21T12:20:51.127 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.125+0000 7f5d7972f640 1 -- 172.21.15.3:0/2838949229 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7f5d60074c60 msgr2=0x7f5d60077120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:51.127 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.125+0000 7f5d7972f640 1 --2- 172.21.15.3:0/2838949229 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7f5d60074c60 0x7f5d60077120 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f5d64005e30 tx=0x7f5d6403c040 comp rx=0 tx=0).stop 2024-09-21T12:20:51.127 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.125+0000 7f5d7972f640 1 -- 172.21.15.3:0/2838949229 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5d74100880 msgr2=0x7f5d7410c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:51.127 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.125+0000 7f5d7972f640 1 --2- 172.21.15.3:0/2838949229 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5d74100880 0x7f5d7410c7d0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5d5c00d6a0 tx=0x7f5d5c00db60 comp rx=0 tx=0).stop 2024-09-21T12:20:51.127 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.125+0000 7f5d7972f640 1 -- 172.21.15.3:0/2838949229 shutdown_connections 2024-09-21T12:20:51.127 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.125+0000 7f5d7972f640 1 --2- 172.21.15.3:0/2838949229 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7f5d60074c60 0x7f5d60077120 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:51.128 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.125+0000 7f5d7972f640 1 --2- 172.21.15.3:0/2838949229 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5d74101a80 0x7f5d7410cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:51.128 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.125+0000 7f5d7972f640 1 --2- 172.21.15.3:0/2838949229 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5d74100880 0x7f5d7410c7d0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:51.128 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.125+0000 7f5d7972f640 1 -- 172.21.15.3:0/2838949229 >> 172.21.15.3:0/2838949229 conn(0x7f5d740fc010 msgr2=0x7f5d74106ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:20:51.128 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.125+0000 7f5d7972f640 1 -- 172.21.15.3:0/2838949229 shutdown_connections 2024-09-21T12:20:51.128 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.125+0000 7f5d7972f640 1 -- 172.21.15.3:0/2838949229 wait complete. 2024-09-21T12:20:51.128 INFO:tasks.workunit.client.0.smithi003.stdout:7/639: chown d8/db/d13/l70 88227701 1 2024-09-21T12:20:51.132 INFO:tasks.workunit.client.0.smithi003.stdout:5/819: sync 2024-09-21T12:20:51.134 INFO:tasks.workunit.client.0.smithi003.stdout:2/646: creat d0/d21/d2c/d6c/fe0 x:0 0 0 2024-09-21T12:20:51.137 INFO:tasks.workunit.client.0.smithi003.stdout:7/640: fdatasync d8/db/d13/d60/f8f 0 2024-09-21T12:20:51.139 INFO:tasks.workunit.client.0.smithi003.stdout:5/820: creat dc/dd7/d41/d5b/dab/f10a x:0 0 0 2024-09-21T12:20:51.146 INFO:tasks.workunit.client.0.smithi003.stdout:7/641: symlink d8/db/d32/d43/d7e/dad/ldb 0 2024-09-21T12:20:51.152 INFO:tasks.workunit.client.0.smithi003.stdout:7/642: dread d8/d7a/dae/fb6 [0,4194304] 0 2024-09-21T12:20:51.155 INFO:tasks.workunit.client.0.smithi003.stdout:7/643: rmdir d8/db/d13/d96 39 2024-09-21T12:20:51.160 INFO:tasks.workunit.client.0.smithi003.stdout:7/644: dread d8/db/d32/f6f [0,4194304] 0 2024-09-21T12:20:51.163 INFO:tasks.workunit.client.0.smithi003.stdout:2/647: dread d0/d21/f81 [0,4194304] 0 2024-09-21T12:20:51.163 INFO:tasks.workunit.client.0.smithi003.stdout:7/645: unlink d8/db/d32/d43/c4c 0 2024-09-21T12:20:51.168 INFO:tasks.workunit.client.0.smithi003.stdout:9/742: write d2/d53/faa [4895039,88407] 0 2024-09-21T12:20:51.173 INFO:tasks.workunit.client.0.smithi003.stdout:5/821: dread dc/dd7/d41/da0/d35/f78 [0,4194304] 0 2024-09-21T12:20:51.174 INFO:tasks.workunit.client.0.smithi003.stdout:4/657: dwrite d9/d25/f7a [0,4194304] 0 2024-09-21T12:20:51.175 INFO:tasks.workunit.client.0.smithi003.stdout:9/743: truncate d2/da/d2a/f33 6967809 0 2024-09-21T12:20:51.176 INFO:tasks.workunit.client.0.smithi003.stdout:5/822: fsync dc/dd7/d41/da0/d4b/d5c/f77 0 2024-09-21T12:20:51.177 INFO:tasks.workunit.client.0.smithi003.stdout:5/823: chown dc/d2b/c3b 687296 1 2024-09-21T12:20:51.181 INFO:tasks.workunit.client.0.smithi003.stdout:7/646: dread d8/db/ff [0,4194304] 0 2024-09-21T12:20:51.182 INFO:tasks.workunit.client.0.smithi003.stdout:9/744: mkdir d2/da/d35/d76/d94/d10b 0 2024-09-21T12:20:51.186 INFO:tasks.workunit.client.0.smithi003.stdout:5/824: dwrite dc/d15/d21/f24 [0,4194304] 0 2024-09-21T12:20:51.190 INFO:tasks.workunit.client.0.smithi003.stdout:9/745: creat d2/d20/d22/d3f/d109/f10c x:0 0 0 2024-09-21T12:20:51.194 INFO:tasks.workunit.client.0.smithi003.stdout:7/647: dwrite d8/d7a/dae/fd2 [0,4194304] 0 2024-09-21T12:20:51.201 INFO:tasks.workunit.client.0.smithi003.stdout:9/746: mknod d2/da/d35/d76/c10d 0 2024-09-21T12:20:51.209 INFO:tasks.workunit.client.0.smithi003.stdout:7/648: dwrite d8/d2c/f7f [0,4194304] 0 2024-09-21T12:20:51.210 INFO:tasks.workunit.client.0.smithi003.stdout:9/747: rename d2/d53/d83/cbb to d2/d53/df8/c10e 0 2024-09-21T12:20:51.210 INFO:tasks.workunit.client.0.smithi003.stdout:7/649: write d8/d2c/f7f [2566915,92368] 0 2024-09-21T12:20:51.216 INFO:tasks.workunit.client.0.smithi003.stdout:9/748: creat d2/da/d35/d76/d94/d10b/f10f x:0 0 0 2024-09-21T12:20:51.219 INFO:tasks.workunit.client.0.smithi003.stdout:9/749: fsync d2/d20/d22/d5e/d87/fa6 0 2024-09-21T12:20:51.221 INFO:tasks.workunit.client.0.smithi003.stdout:9/750: stat d2/da/d17/d40/f4c 0 2024-09-21T12:20:51.222 INFO:tasks.workunit.client.0.smithi003.stdout:5/825: dread dc/dd7/d3c/f91 [0,4194304] 0 2024-09-21T12:20:51.222 INFO:tasks.workunit.client.0.smithi003.stdout:7/650: dwrite d8/db/d13/d60/f8a [0,4194304] 0 2024-09-21T12:20:51.230 INFO:tasks.workunit.client.0.smithi003.stdout:9/751: mknod d2/d20/d22/d3f/dfd/c110 0 2024-09-21T12:20:51.231 INFO:tasks.workunit.client.0.smithi003.stdout:7/651: mknod d8/db/d13/d96/db8/dc4/cdc 0 2024-09-21T12:20:51.231 INFO:tasks.workunit.client.0.smithi003.stdout:9/752: chown d2/d20/d22/d3f/d109/f10c 2 1 2024-09-21T12:20:51.232 INFO:tasks.workunit.client.0.smithi003.stdout:5/826: dread dc/d2b/fcb [0,4194304] 0 2024-09-21T12:20:51.233 INFO:tasks.workunit.client.0.smithi003.stdout:7/652: dread - d8/db/d13/f89 zero size 2024-09-21T12:20:51.235 INFO:tasks.workunit.client.0.smithi003.stdout:9/753: stat d2/da/d2a/d3c/da2/daf/f7b 0 2024-09-21T12:20:51.240 INFO:tasks.workunit.client.0.smithi003.stdout:9/754: creat d2/da/d17/f111 x:0 0 0 2024-09-21T12:20:51.243 INFO:tasks.workunit.client.0.smithi003.stdout:7/653: dwrite d8/db/d13/f1a [0,4194304] 0 2024-09-21T12:20:51.243 INFO:tasks.workunit.client.0.smithi003.stdout:5/827: dwrite dc/d15/d26/fb8 [0,4194304] 0 2024-09-21T12:20:51.245 INFO:tasks.workunit.client.0.smithi003.stdout:9/755: write d2/d53/d75/fbd [156320,41972] 0 2024-09-21T12:20:51.247 INFO:tasks.workunit.client.0.smithi003.stdout:9/756: chown d2/d20/d22/d3f/c41 104 1 2024-09-21T12:20:51.251 INFO:tasks.workunit.client.0.smithi003.stdout:7/654: write d8/d3c/fb1 [3372381,85130] 0 2024-09-21T12:20:51.255 INFO:tasks.workunit.client.0.smithi003.stdout:9/757: fdatasync d2/da/d17/d40/f57 0 2024-09-21T12:20:51.256 INFO:tasks.workunit.client.0.smithi003.stdout:5/828: dread dc/d15/d1c/f58 [0,4194304] 0 2024-09-21T12:20:51.258 INFO:tasks.workunit.client.0.smithi003.stdout:7/655: rename d8/d2c/fda to d8/db/d13/d96/db8/dc4/fdd 0 2024-09-21T12:20:51.267 INFO:tasks.workunit.client.0.smithi003.stdout:5/829: dread dc/d2b/d4e/f94 [0,4194304] 0 2024-09-21T12:20:51.268 INFO:tasks.workunit.client.0.smithi003.stdout:5/830: write dc/d15/d6f/feb [4530805,35563] 0 2024-09-21T12:20:51.269 INFO:tasks.workunit.client.0.smithi003.stdout:5/831: read - dc/d2b/ff3 zero size 2024-09-21T12:20:51.273 INFO:tasks.workunit.client.0.smithi003.stdout:5/832: getdents dc/dd7/d41/d5b/d74/d7f/d82 0 2024-09-21T12:20:51.274 INFO:tasks.workunit.client.0.smithi003.stdout:5/833: chown dc/d15/cb3 1192 1 2024-09-21T12:20:51.275 INFO:tasks.workunit.client.0.smithi003.stdout:5/834: chown dc/dd7/d41/da0/d4b/d5c/fdb 1580 1 2024-09-21T12:20:51.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.278+0000 7fb0da4da640 1 -- 172.21.15.3:0/405068505 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb0d4101960 msgr2=0x7fb0d4101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:51.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.278+0000 7fb0da4da640 1 --2- 172.21.15.3:0/405068505 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb0d4101960 0x7fb0d4101d60 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fb0c4009880 tx=0x7fb0c402a4b0 comp rx=0 tx=0).stop 2024-09-21T12:20:51.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.278+0000 7fb0da4da640 1 -- 172.21.15.3:0/405068505 shutdown_connections 2024-09-21T12:20:51.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.278+0000 7fb0da4da640 1 --2- 172.21.15.3:0/405068505 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0d4102b60 0x7fb0d4102fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:51.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.278+0000 7fb0da4da640 1 --2- 172.21.15.3:0/405068505 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb0d4101960 0x7fb0d4101d60 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:51.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.278+0000 7fb0da4da640 1 -- 172.21.15.3:0/405068505 >> 172.21.15.3:0/405068505 conn(0x7fb0d40fd0d0 msgr2=0x7fb0d40ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:20:51.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.279+0000 7fb0da4da640 1 -- 172.21.15.3:0/405068505 shutdown_connections 2024-09-21T12:20:51.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.279+0000 7fb0da4da640 1 -- 172.21.15.3:0/405068505 wait complete. 2024-09-21T12:20:51.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.280+0000 7fb0da4da640 1 Processor -- start 2024-09-21T12:20:51.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.280+0000 7fb0da4da640 1 -- start start 2024-09-21T12:20:51.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.281+0000 7fb0da4da640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb0d4101960 0x7fb0d4197490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:51.282 INFO:tasks.workunit.client.0.smithi003.stdout:9/758: dread d2/da/d2a/d89/f95 [0,4194304] 0 2024-09-21T12:20:51.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.281+0000 7fb0da4da640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0d4102b60 0x7fb0d41979d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:51.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.281+0000 7fb0da4da640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fb0d410a780 con 0x7fb0d4101960 2024-09-21T12:20:51.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.281+0000 7fb0d3fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb0d4101960 0x7fb0d4197490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:51.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.281+0000 7fb0d3fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb0d4101960 0x7fb0d4197490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:51944/0 (socket says 172.21.15.3:51944) 2024-09-21T12:20:51.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.281+0000 7fb0d3fff640 1 -- 172.21.15.3:0/1238287013 learned_addr learned my addr 172.21.15.3:0/1238287013 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:20:51.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.281+0000 7fb0da4da640 1 -- 172.21.15.3:0/1238287013 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb0d410a600 con 0x7fb0d4102b60 2024-09-21T12:20:51.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.281+0000 7fb0d37fe640 1 --2- 172.21.15.3:0/1238287013 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0d4102b60 0x7fb0d41979d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:51.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.282+0000 7fb0d3fff640 1 -- 172.21.15.3:0/1238287013 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0d4102b60 msgr2=0x7fb0d41979d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:51.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.282+0000 7fb0d3fff640 1 --2- 172.21.15.3:0/1238287013 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0d4102b60 0x7fb0d41979d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:51.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.282+0000 7fb0d3fff640 1 -- 172.21.15.3:0/1238287013 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0d4198050 con 0x7fb0d4101960 2024-09-21T12:20:51.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.282+0000 7fb0d37fe640 1 --2- 172.21.15.3:0/1238287013 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0d4102b60 0x7fb0d41979d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T12:20:51.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.282+0000 7fb0d3fff640 1 --2- 172.21.15.3:0/1238287013 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb0d4101960 0x7fb0d4197490 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fb0c4006010 tx=0x7fb0c40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:20:51.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.282+0000 7fb0d17fa640 1 -- 172.21.15.3:0/1238287013 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb0c403f070 con 0x7fb0d4101960 2024-09-21T12:20:51.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.282+0000 7fb0da4da640 1 -- 172.21.15.3:0/1238287013 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0d419ca30 con 0x7fb0d4101960 2024-09-21T12:20:51.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.282+0000 7fb0d17fa640 1 -- 172.21.15.3:0/1238287013 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb0c40049d0 con 0x7fb0d4101960 2024-09-21T12:20:51.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.283+0000 7fb0d17fa640 1 -- 172.21.15.3:0/1238287013 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb0c4049060 con 0x7fb0d4101960 2024-09-21T12:20:51.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.283+0000 7fb0da4da640 1 -- 172.21.15.3:0/1238287013 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0d419cfc0 con 0x7fb0d4101960 2024-09-21T12:20:51.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.284+0000 7fb0da4da640 1 -- 172.21.15.3:0/1238287013 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0d4101d60 con 0x7fb0d4101960 2024-09-21T12:20:51.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.284+0000 7fb0d17fa640 1 -- 172.21.15.3:0/1238287013 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7fb0c4042070 con 0x7fb0d4101960 2024-09-21T12:20:51.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.285+0000 7fb0d17fa640 1 --2- 172.21.15.3:0/1238287013 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7fb0bc074a80 0x7fb0bc076f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:51.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.285+0000 7fb0d17fa640 1 -- 172.21.15.3:0/1238287013 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5812+0+0 (secure 0 0 0) 0x7fb0c40b7070 con 0x7fb0d4101960 2024-09-21T12:20:51.287 INFO:tasks.workunit.client.0.smithi003.stdout:9/759: mknod d2/d53/de8/c112 0 2024-09-21T12:20:51.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.286+0000 7fb0d37fe640 1 --2- 172.21.15.3:0/1238287013 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7fb0bc074a80 0x7fb0bc076f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:51.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.286+0000 7fb0d37fe640 1 --2- 172.21.15.3:0/1238287013 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7fb0bc074a80 0x7fb0bc076f40 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb0d4198940 tx=0x7fb0c8005f90 comp rx=0 tx=0).ready entity=mgr.24409 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:20:51.290 INFO:tasks.workunit.client.0.smithi003.stdout:7/656: dwrite d8/d93/fb3 [0,4194304] 0 2024-09-21T12:20:51.293 INFO:tasks.workunit.client.0.smithi003.stdout:9/760: fdatasync d2/d53/f7f 0 2024-09-21T12:20:51.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.293+0000 7fb0d17fa640 1 -- 172.21.15.3:0/1238287013 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fb0c4082500 con 0x7fb0d4101960 2024-09-21T12:20:51.297 INFO:tasks.workunit.client.0.smithi003.stdout:5/835: dwrite dc/f3a [0,4194304] 0 2024-09-21T12:20:51.306 INFO:tasks.workunit.client.0.smithi003.stdout:9/761: dwrite d2/d53/f10a [0,4194304] 0 2024-09-21T12:20:51.307 INFO:tasks.workunit.client.0.smithi003.stdout:9/762: readlink d2/da/d17/l73 0 2024-09-21T12:20:51.308 INFO:tasks.workunit.client.0.smithi003.stdout:9/763: chown d2/d20/d22/d3f/l6a 149891588 1 2024-09-21T12:20:51.312 INFO:tasks.workunit.client.0.smithi003.stdout:9/764: rmdir d2/d20/d22/d5e/d87 39 2024-09-21T12:20:51.314 INFO:tasks.workunit.client.0.smithi003.stdout:7/657: getdents d8/db/d13/d96/db8 0 2024-09-21T12:20:51.316 INFO:tasks.workunit.client.0.smithi003.stdout:9/765: creat d2/d20/d42/da5/f113 x:0 0 0 2024-09-21T12:20:51.317 INFO:tasks.workunit.client.0.smithi003.stdout:7/658: fsync d8/d31/fa3 0 2024-09-21T12:20:51.318 INFO:tasks.workunit.client.0.smithi003.stdout:5/836: write dc/dd7/d41/da0/d4b/faa [461631,17683] 0 2024-09-21T12:20:51.349 INFO:tasks.workunit.client.0.smithi003.stdout:9/766: unlink d2/d53/faa 0 2024-09-21T12:20:51.354 INFO:tasks.workunit.client.0.smithi003.stdout:5/837: mkdir dc/dd7/d41/da0/d35/d10b 0 2024-09-21T12:20:51.356 INFO:tasks.workunit.client.0.smithi003.stdout:9/767: mknod d2/d53/d83/d96/c114 0 2024-09-21T12:20:51.358 INFO:tasks.workunit.client.0.smithi003.stdout:7/659: dread d8/f7b [0,4194304] 0 2024-09-21T12:20:51.359 INFO:tasks.workunit.client.0.smithi003.stdout:9/768: chown d2/d20/d22/c101 62829282 1 2024-09-21T12:20:51.364 INFO:tasks.workunit.client.0.smithi003.stdout:7/660: mknod d8/d3c/d57/d9e/cde 0 2024-09-21T12:20:51.364 INFO:tasks.workunit.client.0.smithi003.stdout:5/838: write dc/dd7/d41/da0/fe4 [815925,75201] 0 2024-09-21T12:20:51.365 INFO:tasks.workunit.client.0.smithi003.stdout:9/769: creat d2/d20/d22/d5e/d87/de2/f115 x:0 0 0 2024-09-21T12:20:51.367 INFO:tasks.workunit.client.0.smithi003.stdout:9/770: write d2/da/f102 [696085,14011] 0 2024-09-21T12:20:51.367 INFO:tasks.workunit.client.0.smithi003.stdout:7/661: unlink d8/fa 0 2024-09-21T12:20:51.375 INFO:tasks.workunit.client.0.smithi003.stdout:7/662: dwrite d8/db/d13/f3a [0,4194304] 0 2024-09-21T12:20:51.376 INFO:tasks.workunit.client.0.smithi003.stdout:5/839: getdents dc/dd7/d41/da0/d35 0 2024-09-21T12:20:51.377 INFO:tasks.workunit.client.0.smithi003.stdout:7/663: rmdir d8/d2c 39 2024-09-21T12:20:51.378 INFO:tasks.workunit.client.0.smithi003.stdout:7/664: chown d8/d3c/d64/l8e 1361 1 2024-09-21T12:20:51.381 INFO:tasks.workunit.client.0.smithi003.stdout:9/771: dread d2/d20/d22/d5e/d87/fde [0,4194304] 0 2024-09-21T12:20:51.387 INFO:tasks.workunit.client.0.smithi003.stdout:5/840: dwrite dc/dd7/d3c/d73/def/f103 [0,4194304] 0 2024-09-21T12:20:51.389 INFO:tasks.workunit.client.0.smithi003.stdout:7/665: dread d8/d93/fb3 [0,4194304] 0 2024-09-21T12:20:51.393 INFO:tasks.workunit.client.0.smithi003.stdout:7/666: dread - d8/db/d13/d96/db8/dc4/fdd zero size 2024-09-21T12:20:51.396 INFO:tasks.workunit.client.0.smithi003.stdout:9/772: dwrite d2/da/d2a/d3c/da2/ff9 [0,4194304] 0 2024-09-21T12:20:51.401 INFO:tasks.workunit.client.0.smithi003.stdout:7/667: creat d8/db/d13/d96/fdf x:0 0 0 2024-09-21T12:20:51.402 INFO:tasks.workunit.client.0.smithi003.stdout:9/773: creat d2/da/d35/d4d/f116 x:0 0 0 2024-09-21T12:20:51.403 INFO:tasks.workunit.client.0.smithi003.stdout:9/774: readlink d2/d20/d42/da5/lcb 0 2024-09-21T12:20:51.406 INFO:tasks.workunit.client.0.smithi003.stdout:5/841: write dc/dd7/d41/da0/ff9 [638333,115000] 0 2024-09-21T12:20:51.410 INFO:tasks.workunit.client.0.smithi003.stdout:5/842: unlink dc/dd7/d3c/ca6 0 2024-09-21T12:20:51.411 INFO:tasks.workunit.client.0.smithi003.stdout:9/775: dwrite d2/da/d35/d76/d94/f9b [0,4194304] 0 2024-09-21T12:20:51.412 INFO:tasks.workunit.client.0.smithi003.stdout:9/776: stat d2/d20/d22/c64 0 2024-09-21T12:20:51.412 INFO:tasks.workunit.client.0.smithi003.stdout:9/777: chown f1 125 1 2024-09-21T12:20:51.414 INFO:tasks.workunit.client.0.smithi003.stdout:9/778: write d2/d53/d83/fdb [723144,94266] 0 2024-09-21T12:20:51.420 INFO:tasks.workunit.client.0.smithi003.stdout:9/779: unlink d2/da/d2a/d89/d9c/f9d 0 2024-09-21T12:20:51.423 INFO:tasks.workunit.client.0.smithi003.stdout:7/668: write d8/f7c [4705972,115270] 0 2024-09-21T12:20:51.433 INFO:tasks.workunit.client.0.smithi003.stdout:7/669: dwrite d8/d93/fcd [0,4194304] 0 2024-09-21T12:20:51.434 INFO:tasks.workunit.client.0.smithi003.stdout:5/843: dwrite dc/d15/d1c/f23 [0,4194304] 0 2024-09-21T12:20:51.437 INFO:tasks.workunit.client.0.smithi003.stdout:7/670: rmdir d8/db/d13/d75/da6 39 2024-09-21T12:20:51.439 INFO:tasks.workunit.client.0.smithi003.stdout:5/844: mknod dc/dd7/d41/d5b/d74/d7f/d82/c10c 0 2024-09-21T12:20:51.439 INFO:tasks.workunit.client.0.smithi003.stdout:7/671: mknod d8/d3c/d6b/ce0 0 2024-09-21T12:20:51.440 INFO:tasks.workunit.client.0.smithi003.stdout:5/845: mknod dc/d15/d6f/c10d 0 2024-09-21T12:20:51.441 INFO:tasks.workunit.client.0.smithi003.stdout:7/672: truncate d8/d7a/fb9 1074301 0 2024-09-21T12:20:51.443 INFO:tasks.workunit.client.0.smithi003.stdout:5/846: rmdir dc/dd7/d41/da0/d4b/d5c/dae 39 2024-09-21T12:20:51.444 INFO:tasks.workunit.client.0.smithi003.stdout:7/673: unlink d8/d2c/c63 0 2024-09-21T12:20:51.448 INFO:tasks.workunit.client.0.smithi003.stdout:7/674: creat d8/db/d32/d43/d7e/dad/db2/fe1 x:0 0 0 2024-09-21T12:20:51.455 INFO:tasks.workunit.client.0.smithi003.stdout:9/780: dread d2/d20/f39 [0,4194304] 0 2024-09-21T12:20:51.456 INFO:tasks.workunit.client.0.smithi003.stdout:7/675: dread d8/d7a/fb9 [0,4194304] 0 2024-09-21T12:20:51.456 INFO:tasks.workunit.client.0.smithi003.stdout:9/781: stat d2/da/d2a/d89/d9c 0 2024-09-21T12:20:51.457 INFO:tasks.workunit.client.0.smithi003.stdout:7/676: chown d8/d93/fbd 1968896007 1 2024-09-21T12:20:51.458 INFO:tasks.workunit.client.0.smithi003.stdout:7/677: stat d8/db/d13/l70 0 2024-09-21T12:20:51.459 INFO:tasks.workunit.client.0.smithi003.stdout:9/782: symlink d2/d53/d75/l117 0 2024-09-21T12:20:51.459 INFO:tasks.workunit.client.0.smithi003.stdout:7/678: write d8/d31/f74 [618233,22470] 0 2024-09-21T12:20:51.461 INFO:tasks.workunit.client.0.smithi003.stdout:9/783: write d2/d20/f106 [23352,83226] 0 2024-09-21T12:20:51.463 INFO:tasks.workunit.client.0.smithi003.stdout:7/679: unlink d8/d31/l62 0 2024-09-21T12:20:51.467 INFO:tasks.workunit.client.0.smithi003.stdout:7/680: truncate d8/d3c/d57/d9e/fa2 226677 0 2024-09-21T12:20:51.468 INFO:tasks.workunit.client.0.smithi003.stdout:9/784: getdents d2/da/d17/d40 0 2024-09-21T12:20:51.469 INFO:tasks.workunit.client.0.smithi003.stdout:9/785: dread - d2/da/d35/d4d/f116 zero size 2024-09-21T12:20:51.470 INFO:tasks.workunit.client.0.smithi003.stdout:7/681: symlink d8/db/d13/d96/le2 0 2024-09-21T12:20:51.476 INFO:tasks.workunit.client.0.smithi003.stdout:5/847: dwrite dc/d15/f1f [0,4194304] 0 2024-09-21T12:20:51.477 INFO:tasks.workunit.client.0.smithi003.stdout:9/786: unlink d2/d20/d22/d5e/d87/de2/lfb 0 2024-09-21T12:20:51.478 INFO:tasks.workunit.client.0.smithi003.stdout:9/787: write d2/d20/d22/fc3 [450070,8263] 0 2024-09-21T12:20:51.479 INFO:tasks.workunit.client.0.smithi003.stdout:9/788: readlink d2/d20/d42/l69 0 2024-09-21T12:20:51.482 INFO:tasks.workunit.client.0.smithi003.stdout:7/682: rename d8/db/d13/d96/db8/dc4/cdc to d8/d3c/d64/ce3 0 2024-09-21T12:20:51.482 INFO:tasks.workunit.client.0.smithi003.stdout:5/848: symlink dc/d15/d26/l10e 0 2024-09-21T12:20:51.483 INFO:tasks.workunit.client.0.smithi003.stdout:5/849: chown dc/d15/la7 24232 1 2024-09-21T12:20:51.484 INFO:tasks.workunit.client.0.smithi003.stdout:5/850: fsync dc/f3a 0 2024-09-21T12:20:51.485 INFO:tasks.workunit.client.0.smithi003.stdout:9/789: creat d2/d20/d42/da5/f118 x:0 0 0 2024-09-21T12:20:51.488 INFO:tasks.workunit.client.0.smithi003.stdout:7/683: unlink d8/d31/f6e 0 2024-09-21T12:20:51.490 INFO:tasks.workunit.client.0.smithi003.stdout:9/790: rename d2/d20/d22/d5e/lc8 to d2/da/d2a/d3c/da2/daf/l119 0 2024-09-21T12:20:51.491 INFO:tasks.workunit.client.0.smithi003.stdout:7/684: creat d8/db/d13/d60/fe4 x:0 0 0 2024-09-21T12:20:51.493 INFO:tasks.workunit.client.0.smithi003.stdout:5/851: symlink dc/dd7/d41/da0/df8/l10f 0 2024-09-21T12:20:51.497 INFO:tasks.workunit.client.0.smithi003.stdout:5/852: symlink dc/dd7/d41/d5b/dab/l110 0 2024-09-21T12:20:51.502 INFO:tasks.workunit.client.0.smithi003.stdout:5/853: chown dc/d15/d6f/lbb 79918615 1 2024-09-21T12:20:51.502 INFO:tasks.workunit.client.0.smithi003.stdout:9/791: write d2/da0/fb9 [3802181,40993] 0 2024-09-21T12:20:51.502 INFO:tasks.workunit.client.0.smithi003.stdout:5/854: fsync dc/f3a 0 2024-09-21T12:20:51.504 INFO:tasks.workunit.client.0.smithi003.stdout:7/685: write d8/d3c/f3e [4790254,112350] 0 2024-09-21T12:20:51.506 INFO:tasks.workunit.client.0.smithi003.stdout:7/686: truncate d8/d3c/d6b/fd0 336157 0 2024-09-21T12:20:51.508 INFO:tasks.workunit.client.0.smithi003.stdout:5/855: write dc/dd7/d3c/f91 [1322851,2982] 0 2024-09-21T12:20:51.509 INFO:tasks.workunit.client.0.smithi003.stdout:5/856: chown dc/dd7/d41/d5b/d74 52783 1 2024-09-21T12:20:51.510 INFO:tasks.workunit.client.0.smithi003.stdout:5/857: chown dc 6176 1 2024-09-21T12:20:51.511 INFO:tasks.workunit.client.0.smithi003.stdout:7/687: rename d8/db/d13/d96/fdf to d8/d93/fe5 0 2024-09-21T12:20:51.513 INFO:tasks.workunit.client.0.smithi003.stdout:5/858: unlink dc/d15/l8e 0 2024-09-21T12:20:51.514 INFO:tasks.workunit.client.0.smithi003.stdout:7/688: unlink d8/f52 0 2024-09-21T12:20:51.516 INFO:tasks.workunit.client.0.smithi003.stdout:5/859: unlink dc/dd7/d3c/d73/f96 0 2024-09-21T12:20:51.518 INFO:tasks.workunit.client.0.smithi003.stdout:7/689: mknod d8/db/d32/d43/d7e/ce6 0 2024-09-21T12:20:51.520 INFO:tasks.workunit.client.0.smithi003.stdout:7/690: mknod d8/db/d32/ce7 0 2024-09-21T12:20:51.521 INFO:tasks.workunit.client.0.smithi003.stdout:7/691: chown d8/db/f2b 4 1 2024-09-21T12:20:51.521 INFO:tasks.workunit.client.0.smithi003.stdout:9/792: dread d2/da/d35/d76/f7e [0,4194304] 0 2024-09-21T12:20:51.522 INFO:tasks.workunit.client.0.smithi003.stdout:9/793: readlink d2/da/lc9 0 2024-09-21T12:20:51.528 INFO:tasks.workunit.client.0.smithi003.stdout:9/794: mknod d2/d20/d42/c11a 0 2024-09-21T12:20:51.529 INFO:tasks.workunit.client.0.smithi003.stdout:5/860: write dc/dd7/d41/d5b/fcd [772441,103198] 0 2024-09-21T12:20:51.532 INFO:tasks.workunit.client.0.smithi003.stdout:7/692: truncate d8/db/f5e 450498 0 2024-09-21T12:20:51.535 INFO:tasks.workunit.client.0.smithi003.stdout:9/795: link d2/d20/d22/d5e/d87/de2/f103 d2/da/d35/d76/d94/f11b 0 2024-09-21T12:20:51.535 INFO:tasks.workunit.client.0.smithi003.stdout:9/796: chown d2/d20/c5b 0 1 2024-09-21T12:20:51.538 INFO:tasks.workunit.client.0.smithi003.stdout:7/693: rename d8/d31/d84/c9d to d8/d3c/d6b/ce8 0 2024-09-21T12:20:51.543 INFO:tasks.workunit.client.0.smithi003.stdout:9/797: write d2/da/d35/d76/d94/f11b [1003631,102301] 0 2024-09-21T12:20:51.543 INFO:tasks.workunit.client.0.smithi003.stdout:7/694: symlink d8/db/d32/d43/d7e/le9 0 2024-09-21T12:20:51.547 INFO:tasks.workunit.client.0.smithi003.stdout:5/861: dwrite dc/d15/d26/f86 [0,4194304] 0 2024-09-21T12:20:51.552 INFO:tasks.workunit.client.0.smithi003.stdout:5/862: mknod dc/d15/d1c/c111 0 2024-09-21T12:20:51.556 INFO:tasks.workunit.client.0.smithi003.stdout:7/695: rename d8/d7a/dae to d8/dea 0 2024-09-21T12:20:51.557 INFO:tasks.workunit.client.0.smithi003.stdout:9/798: link d2/d53/d83/fdb d2/da/f11c 0 2024-09-21T12:20:51.559 INFO:tasks.workunit.client.0.smithi003.stdout:5/863: truncate dc/dd7/d41/d5b/fa5 1127484 0 2024-09-21T12:20:51.559 INFO:tasks.workunit.client.0.smithi003.stdout:9/799: dread d2/d20/f106 [0,4194304] 0 2024-09-21T12:20:51.560 INFO:tasks.workunit.client.0.smithi003.stdout:7/696: rename d8/d3c/cd3 to d8/db/ceb 0 2024-09-21T12:20:51.563 INFO:tasks.workunit.client.0.smithi003.stdout:9/800: mkdir d2/d53/d75/de4/df4/d11d 0 2024-09-21T12:20:51.565 INFO:tasks.workunit.client.0.smithi003.stdout:7/697: dread - d8/db/d13/d60/fb0 zero size 2024-09-21T12:20:51.565 INFO:tasks.workunit.client.0.smithi003.stdout:5/864: link dc/d15/d21/ce2 dc/d15/c112 0 2024-09-21T12:20:51.573 INFO:tasks.workunit.client.0.smithi003.stdout:5/865: link dc/d15/cb3 dc/dd7/d3c/c113 0 2024-09-21T12:20:51.580 INFO:tasks.workunit.client.0.smithi003.stdout:9/801: write d2/d20/d22/d3f/fa4 [209884,21116] 0 2024-09-21T12:20:51.580 INFO:tasks.workunit.client.0.smithi003.stdout:5/866: link dc/d2b/fd4 dc/dd7/d41/f114 0 2024-09-21T12:20:51.582 INFO:tasks.workunit.client.0.smithi003.stdout:5/867: write dc/dd7/d41/da0/d4b/fc9 [1215889,44776] 0 2024-09-21T12:20:51.584 INFO:tasks.workunit.client.0.smithi003.stdout:9/802: mknod d2/da/d17/d40/c11e 0 2024-09-21T12:20:51.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.599+0000 7fb0da4da640 1 -- 172.21.15.3:0/1238287013 --> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fb0d4062630 con 0x7fb0bc074a80 2024-09-21T12:20:51.604 INFO:tasks.workunit.client.0.smithi003.stdout:1/753: sync 2024-09-21T12:20:51.605 INFO:tasks.workunit.client.0.smithi003.stdout:5/868: dwrite dc/dd7/d3c/fb4 [0,4194304] 0 2024-09-21T12:20:51.605 INFO:tasks.workunit.client.0.smithi003.stdout:9/803: dwrite d2/da/d35/d76/d94/fac [0,4194304] 0 2024-09-21T12:20:51.607 INFO:tasks.workunit.client.0.smithi003.stdout:5/869: write dc/dd7/d41/da0/f42 [745992,22152] 0 2024-09-21T12:20:51.611 INFO:tasks.workunit.client.0.smithi003.stdout:1/754: creat d4/d11/d14/d78/f104 x:0 0 0 2024-09-21T12:20:51.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.610+0000 7fb0d17fa640 1 -- 172.21.15.3:0/1238287013 <== mgr.24409 v2:172.21.15.192:6828/1528605296 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fb0d4062630 con 0x7fb0bc074a80 2024-09-21T12:20:51.612 INFO:teuthology.orchestra.run.smithi003.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:20:51.612 INFO:teuthology.orchestra.run.smithi003.stdout:alertmanager.smithi003 smithi003 *:9093,9094 running (7m) 2m ago 8m 25.8M - 0.25.0 c8568f914cd2 5c03f233277e 2024-09-21T12:20:51.612 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-exporter.smithi003 smithi003 running (8m) 2m ago 8m 8321k - 19.1.1-373-g4e45e6b4 164465d2334a 38ef0e2dfcc4 2024-09-21T12:20:51.613 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-exporter.smithi192 smithi192 running (7m) 11s ago 7m 5259k - 19.1.1-373-g4e45e6b4 164465d2334a 848a2ec72db7 2024-09-21T12:20:51.613 INFO:teuthology.orchestra.run.smithi003.stdout:crash.smithi003 smithi003 running (8m) 2m ago 8m 6899k - 19.1.1-373-g4e45e6b4 164465d2334a c63f209dc1dc 2024-09-21T12:20:51.613 INFO:teuthology.orchestra.run.smithi003.stdout:crash.smithi192 smithi192 running (7m) 11s ago 7m 6895k - 19.1.1-373-g4e45e6b4 164465d2334a cc70c9a7b2f7 2024-09-21T12:20:51.613 INFO:teuthology.orchestra.run.smithi003.stdout:grafana.smithi003 smithi003 *:3000 running (6m) 2m ago 8m 79.4M - 9.4.12 2bacad6d85d8 f504f60818f0 2024-09-21T12:20:51.613 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi003.ebjgyl smithi003 running (3m) 2m ago 3m 11.8M - 19.1.1-373-g4e45e6b4 164465d2334a 16e0b2cac16a 2024-09-21T12:20:51.613 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi003.gfkngj smithi003 running (3m) 2m ago 3m 16.7M - 19.1.1-373-g4e45e6b4 164465d2334a 109c04f87fbd 2024-09-21T12:20:51.613 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi192.ktdqns smithi192 running (3m) 11s ago 3m 14.5M - 19.1.1-373-g4e45e6b4 164465d2334a 495c73fb3bb0 2024-09-21T12:20:51.613 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi192.ywqqxe smithi192 running (3m) 11s ago 3m 14.5M - 19.1.1-373-g4e45e6b4 164465d2334a 270a01030cbe 2024-09-21T12:20:51.613 INFO:teuthology.orchestra.run.smithi003.stdout:mgr.smithi003.wztftl smithi003 *:9283,8765,8443 running (9m) 2m ago 9m 501M - 19.1.1-373-g4e45e6b4 164465d2334a 060c1f18749f 2024-09-21T12:20:51.613 INFO:teuthology.orchestra.run.smithi003.stdout:mgr.smithi192.qsaprd smithi192 *:8443,9283,8765 running (52s) 11s ago 7m 496M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 bb9d2aeba009 2024-09-21T12:20:51.613 INFO:teuthology.orchestra.run.smithi003.stdout:mon.smithi003 smithi003 running (9m) 2m ago 10m 48.4M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 16bccf2c7503 2024-09-21T12:20:51.613 INFO:teuthology.orchestra.run.smithi003.stdout:mon.smithi192 smithi192 running (7m) 11s ago 7m 39.5M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 4fe4c4b3dc5d 2024-09-21T12:20:51.613 INFO:teuthology.orchestra.run.smithi003.stdout:node-exporter.smithi003 smithi003 *:9100 running (8m) 2m ago 8m 15.8M - 1.5.0 0da6a335fe13 a1eb875faefc 2024-09-21T12:20:51.614 INFO:teuthology.orchestra.run.smithi003.stdout:node-exporter.smithi192 smithi192 *:9100 running (7m) 11s ago 7m 16.7M - 1.5.0 0da6a335fe13 10c2542c2e19 2024-09-21T12:20:51.614 INFO:teuthology.orchestra.run.smithi003.stdout:osd.0 smithi003 running (6m) 2m ago 6m 54.6M 3948M 19.1.1-373-g4e45e6b4 164465d2334a d07f1489720d 2024-09-21T12:20:51.614 INFO:teuthology.orchestra.run.smithi003.stdout:osd.1 smithi003 running (6m) 2m ago 6m 48.1M 3948M 19.1.1-373-g4e45e6b4 164465d2334a 6abd75a07645 2024-09-21T12:20:51.614 INFO:teuthology.orchestra.run.smithi003.stdout:osd.2 smithi003 running (5m) 2m ago 5m 48.4M 3948M 19.1.1-373-g4e45e6b4 164465d2334a 3265369e573b 2024-09-21T12:20:51.614 INFO:teuthology.orchestra.run.smithi003.stdout:osd.3 smithi192 running (5m) 11s ago 5m 222M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 13efcfd71c05 2024-09-21T12:20:51.614 INFO:teuthology.orchestra.run.smithi003.stdout:osd.4 smithi192 running (4m) 11s ago 4m 199M 2240M 19.1.1-373-g4e45e6b4 164465d2334a f33bf453cb3e 2024-09-21T12:20:51.614 INFO:teuthology.orchestra.run.smithi003.stdout:osd.5 smithi192 running (4m) 11s ago 4m 227M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 12d7b7c8e985 2024-09-21T12:20:51.614 INFO:teuthology.orchestra.run.smithi003.stdout:prometheus.smithi003 smithi003 *:9095 running (6m) 2m ago 8m 58.9M - 2.43.0 a07b618ecd1d 4ecd73d1b37c 2024-09-21T12:20:51.614 INFO:tasks.workunit.client.0.smithi003.stdout:1/755: chown d4/d11/d14/d25/l9d 2 1 2024-09-21T12:20:51.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.615+0000 7fb0da4da640 1 -- 172.21.15.3:0/1238287013 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7fb0bc074a80 msgr2=0x7fb0bc076f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:51.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.615+0000 7fb0da4da640 1 --2- 172.21.15.3:0/1238287013 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7fb0bc074a80 0x7fb0bc076f40 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fb0d4198940 tx=0x7fb0c8005f90 comp rx=0 tx=0).stop 2024-09-21T12:20:51.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.615+0000 7fb0da4da640 1 -- 172.21.15.3:0/1238287013 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb0d4101960 msgr2=0x7fb0d4197490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:51.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.615+0000 7fb0da4da640 1 --2- 172.21.15.3:0/1238287013 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb0d4101960 0x7fb0d4197490 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fb0c4006010 tx=0x7fb0c40045e0 comp rx=0 tx=0).stop 2024-09-21T12:20:51.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.615+0000 7fb0da4da640 1 -- 172.21.15.3:0/1238287013 shutdown_connections 2024-09-21T12:20:51.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.615+0000 7fb0da4da640 1 --2- 172.21.15.3:0/1238287013 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7fb0bc074a80 0x7fb0bc076f40 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:51.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.615+0000 7fb0da4da640 1 --2- 172.21.15.3:0/1238287013 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0d4102b60 0x7fb0d41979d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:51.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.615+0000 7fb0da4da640 1 --2- 172.21.15.3:0/1238287013 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb0d4101960 0x7fb0d4197490 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:51.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.615+0000 7fb0da4da640 1 -- 172.21.15.3:0/1238287013 >> 172.21.15.3:0/1238287013 conn(0x7fb0d40fd0d0 msgr2=0x7fb0d4105fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:20:51.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.615+0000 7fb0da4da640 1 -- 172.21.15.3:0/1238287013 shutdown_connections 2024-09-21T12:20:51.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.615+0000 7fb0da4da640 1 -- 172.21.15.3:0/1238287013 wait complete. 2024-09-21T12:20:51.619 INFO:tasks.workunit.client.0.smithi003.stdout:5/870: symlink dc/dd7/d41/d9f/d104/l115 0 2024-09-21T12:20:51.621 INFO:tasks.workunit.client.0.smithi003.stdout:1/756: mknod d4/d11/d49/c105 0 2024-09-21T12:20:51.626 INFO:tasks.workunit.client.0.smithi003.stdout:5/871: read dc/dd7/d41/da0/d4b/d5c/dae/fe8 [543310,112468] 0 2024-09-21T12:20:51.627 INFO:tasks.workunit.client.0.smithi003.stdout:9/804: getdents d2/d20/d22 0 2024-09-21T12:20:51.628 INFO:tasks.workunit.client.0.smithi003.stdout:5/872: stat dc/dd7/d41/d5b/d74/d7f 0 2024-09-21T12:20:51.629 INFO:tasks.workunit.client.0.smithi003.stdout:9/805: mkdir d2/da/d2a/d89/d9c/d11f 0 2024-09-21T12:20:51.633 INFO:tasks.workunit.client.0.smithi003.stdout:5/873: dread dc/d15/d26/f86 [0,4194304] 0 2024-09-21T12:20:51.636 INFO:tasks.workunit.client.0.smithi003.stdout:9/806: rename d2/d20/d22/d5e/c74 to d2/d20/d22/d3f/dfd/c120 0 2024-09-21T12:20:51.639 INFO:tasks.workunit.client.0.smithi003.stdout:9/807: write d2/da/d35/d76/fc0 [1025410,58410] 0 2024-09-21T12:20:51.641 INFO:tasks.workunit.client.0.smithi003.stdout:9/808: read f1 [5059760,106046] 0 2024-09-21T12:20:51.643 INFO:tasks.workunit.client.0.smithi003.stdout:1/757: dread d4/df/d19/f6f [0,4194304] 0 2024-09-21T12:20:51.646 INFO:tasks.workunit.client.0.smithi003.stdout:9/809: symlink d2/da/d17/l121 0 2024-09-21T12:20:51.647 INFO:tasks.workunit.client.0.smithi003.stdout:9/810: chown d2/da/d17/d40/f57 10210230 1 2024-09-21T12:20:51.651 INFO:tasks.workunit.client.0.smithi003.stdout:5/874: dread dc/d15/d26/fbd [0,4194304] 0 2024-09-21T12:20:51.652 INFO:tasks.workunit.client.0.smithi003.stdout:1/758: symlink d4/d11/db1/l106 0 2024-09-21T12:20:51.655 INFO:tasks.workunit.client.0.smithi003.stdout:9/811: chown d2/d53/d83/l8a 2131 1 2024-09-21T12:20:51.658 INFO:tasks.workunit.client.0.smithi003.stdout:5/875: creat dc/dd7/d41/d5b/d74/d7f/f116 x:0 0 0 2024-09-21T12:20:51.659 INFO:tasks.workunit.client.0.smithi003.stdout:1/759: dwrite d4/d66/f84 [0,4194304] 0 2024-09-21T12:20:51.662 INFO:tasks.workunit.client.0.smithi003.stdout:9/812: read d2/d53/d75/de4/df4/fae [3594740,50097] 0 2024-09-21T12:20:51.668 INFO:tasks.workunit.client.0.smithi003.stdout:5/876: symlink dc/dd7/d41/d5b/d101/l117 0 2024-09-21T12:20:51.669 INFO:tasks.workunit.client.0.smithi003.stdout:5/877: chown dc/d2b/ff3 1598328736 1 2024-09-21T12:20:51.671 INFO:tasks.workunit.client.0.smithi003.stdout:1/760: rename d4/dc to d4/d11/d14/d25/d107 0 2024-09-21T12:20:51.673 INFO:tasks.workunit.client.0.smithi003.stdout:9/813: creat d2/da/f122 x:0 0 0 2024-09-21T12:20:51.675 INFO:tasks.workunit.client.0.smithi003.stdout:9/814: chown d2/d20/d22/d5e/d87/fa6 222849916 1 2024-09-21T12:20:51.675 INFO:tasks.workunit.client.0.smithi003.stdout:5/878: dwrite dc/dd7/d3c/fb4 [0,4194304] 0 2024-09-21T12:20:51.676 INFO:tasks.workunit.client.0.smithi003.stdout:9/815: chown d2/d20/lba 312372266 1 2024-09-21T12:20:51.681 INFO:tasks.workunit.client.0.smithi003.stdout:9/816: symlink d2/da/d2a/d89/l123 0 2024-09-21T12:20:51.686 INFO:tasks.workunit.client.0.smithi003.stdout:5/879: dwrite dc/d15/d26/f86 [0,4194304] 0 2024-09-21T12:20:51.686 INFO:tasks.workunit.client.0.smithi003.stdout:9/817: mknod d2/da/d35/d4d/c124 0 2024-09-21T12:20:51.691 INFO:tasks.workunit.client.0.smithi003.stdout:9/818: rmdir d2/da/d2a/d3c/da2/ddd 39 2024-09-21T12:20:51.691 INFO:tasks.workunit.client.0.smithi003.stdout:1/761: write d4/df/fcd [792370,84855] 0 2024-09-21T12:20:51.693 INFO:tasks.workunit.client.0.smithi003.stdout:5/880: symlink dc/dd7/d41/d5b/d74/d7f/d82/l118 0 2024-09-21T12:20:51.694 INFO:tasks.workunit.client.0.smithi003.stdout:5/881: fsync dc/d15/f1f 0 2024-09-21T12:20:51.697 INFO:tasks.workunit.client.0.smithi003.stdout:1/762: rename d4/d11/d14/d25/d107/f67 to d4/d11/df6/f108 0 2024-09-21T12:20:51.698 INFO:tasks.workunit.client.0.smithi003.stdout:1/763: chown d4/d11/d14/d25/d107/f10 1 1 2024-09-21T12:20:51.701 INFO:tasks.workunit.client.0.smithi003.stdout:5/882: rename dc/d15/d6f to dc/d2b/d4e/d119 0 2024-09-21T12:20:51.702 INFO:tasks.workunit.client.0.smithi003.stdout:9/819: creat d2/d20/d22/d5e/f125 x:0 0 0 2024-09-21T12:20:51.706 INFO:tasks.workunit.client.0.smithi003.stdout:1/764: dread d4/df/d19/f95 [0,4194304] 0 2024-09-21T12:20:51.710 INFO:tasks.workunit.client.0.smithi003.stdout:9/820: dwrite d2/d20/d42/da5/f118 [0,4194304] 0 2024-09-21T12:20:51.710 INFO:tasks.workunit.client.0.smithi003.stdout:5/883: rename dc/dd7/d41/d5b/d74/d7f/d82/f105 to dc/dd7/f11a 0 2024-09-21T12:20:51.712 INFO:tasks.workunit.client.0.smithi003.stdout:1/765: stat d4/fa 0 2024-09-21T12:20:51.718 INFO:tasks.workunit.client.0.smithi003.stdout:1/766: symlink d4/d66/dc7/ded/l109 0 2024-09-21T12:20:51.723 INFO:tasks.workunit.client.0.smithi003.stdout:5/884: fdatasync dc/dd7/d41/d5b/fa5 0 2024-09-21T12:20:51.725 INFO:tasks.workunit.client.0.smithi003.stdout:5/885: read dc/dd7/d41/da0/d4b/d5c/f99 [4630651,12526] 0 2024-09-21T12:20:51.733 INFO:tasks.workunit.client.0.smithi003.stdout:5/886: truncate dc/d15/d21/f64 803674 0 2024-09-21T12:20:51.737 INFO:tasks.workunit.client.0.smithi003.stdout:1/767: getdents d4/d66 0 2024-09-21T12:20:51.737 INFO:tasks.workunit.client.0.smithi003.stdout:9/821: dwrite d2/f86 [0,4194304] 0 2024-09-21T12:20:51.738 INFO:tasks.workunit.client.0.smithi003.stdout:5/887: creat dc/dd7/d41/d5b/d74/d7f/f11b x:0 0 0 2024-09-21T12:20:51.740 INFO:tasks.workunit.client.0.smithi003.stdout:9/822: rmdir d2/d53/de8 39 2024-09-21T12:20:51.742 INFO:tasks.workunit.client.0.smithi003.stdout:9/823: readlink d2/da/d17/l67 0 2024-09-21T12:20:51.743 INFO:tasks.workunit.client.0.smithi003.stdout:1/768: rename d4/df/d12/c23 to d4/d11/d14/d25/d42/d7b/c10a 0 2024-09-21T12:20:51.746 INFO:tasks.workunit.client.0.smithi003.stdout:5/888: dwrite dc/d2b/ff3 [0,4194304] 0 2024-09-21T12:20:51.749 INFO:tasks.workunit.client.0.smithi003.stdout:5/889: stat dc/dd7/d41/da0/d4b/d5c/dae/fe8 0 2024-09-21T12:20:51.750 INFO:tasks.workunit.client.0.smithi003.stdout:1/769: creat d4/d11/d14/d25/d42/d63/f10b x:0 0 0 2024-09-21T12:20:51.752 INFO:tasks.workunit.client.0.smithi003.stdout:1/770: write d4/d11/d14/d78/fd8 [225651,27124] 0 2024-09-21T12:20:51.755 INFO:tasks.workunit.client.0.smithi003.stdout:5/890: dread dc/d15/d21/f24 [0,4194304] 0 2024-09-21T12:20:51.756 INFO:tasks.workunit.client.0.smithi003.stdout:1/771: mknod d4/d11/d14/d25/d107/d80/c10c 0 2024-09-21T12:20:51.757 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.754+0000 7f8700d68640 1 -- 172.21.15.3:0/1173284289 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f86fc103b60 msgr2=0x7f86fc103f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:51.757 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.755+0000 7f8700d68640 1 --2- 172.21.15.3:0/1173284289 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f86fc103b60 0x7f86fc103f60 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f86f0009880 tx=0x7f86f002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:20:51.757 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.755+0000 7f8700d68640 1 -- 172.21.15.3:0/1173284289 shutdown_connections 2024-09-21T12:20:51.758 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.755+0000 7f8700d68640 1 --2- 172.21.15.3:0/1173284289 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86fc104d60 0x7f86fc1051e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:51.758 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.755+0000 7f8700d68640 1 --2- 172.21.15.3:0/1173284289 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f86fc103b60 0x7f86fc103f60 secure :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f86f0009880 tx=0x7f86f002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:20:51.758 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.755+0000 7f8700d68640 1 -- 172.21.15.3:0/1173284289 >> 172.21.15.3:0/1173284289 conn(0x7f86fc0ff2f0 msgr2=0x7f86fc101730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:20:51.758 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.755+0000 7f8700d68640 1 -- 172.21.15.3:0/1173284289 shutdown_connections 2024-09-21T12:20:51.759 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.755+0000 7f8700d68640 1 -- 172.21.15.3:0/1173284289 wait complete. 2024-09-21T12:20:51.759 INFO:tasks.workunit.client.0.smithi003.stdout:8/805: sync 2024-09-21T12:20:51.759 INFO:tasks.workunit.client.0.smithi003.stdout:6/876: sync 2024-09-21T12:20:51.760 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.756+0000 7f8700d68640 1 Processor -- start 2024-09-21T12:20:51.760 INFO:tasks.workunit.client.0.smithi003.stdout:8/806: chown d7/df/d20/d24/c72 13 1 2024-09-21T12:20:51.761 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.757+0000 7f8700d68640 1 -- start start 2024-09-21T12:20:51.761 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.757+0000 7f8700d68640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f86fc104d60 0x7f86fc079f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:51.761 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.757+0000 7f8700d68640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86fc07a470 0x7f86fc076a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:51.761 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.757+0000 7f8700d68640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f86fc10ca00 con 0x7f86fc104d60 2024-09-21T12:20:51.761 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.757+0000 7f8700d68640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f86fc10c880 con 0x7f86fc07a470 2024-09-21T12:20:51.761 INFO:tasks.workunit.client.0.smithi003.stdout:6/877: truncate d4/d13/d22/dc3/f127 166454 0 2024-09-21T12:20:51.762 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.758+0000 7f86fa59c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f86fc104d60 0x7f86fc079f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:51.762 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.758+0000 7f86f9d9b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86fc07a470 0x7f86fc076a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:51.762 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.758+0000 7f86fa59c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f86fc104d60 0x7f86fc079f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:51952/0 (socket says 172.21.15.3:51952) 2024-09-21T12:20:51.762 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.758+0000 7f86fa59c640 1 -- 172.21.15.3:0/1369538308 learned_addr learned my addr 172.21.15.3:0/1369538308 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:20:51.762 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.758+0000 7f86f9d9b640 1 -- 172.21.15.3:0/1369538308 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f86fc104d60 msgr2=0x7f86fc079f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:51.763 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.758+0000 7f86f9d9b640 1 --2- 172.21.15.3:0/1369538308 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f86fc104d60 0x7f86fc079f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:51.763 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.758+0000 7f86f9d9b640 1 -- 172.21.15.3:0/1369538308 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86fc076f40 con 0x7f86fc07a470 2024-09-21T12:20:51.763 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.759+0000 7f86f9d9b640 1 --2- 172.21.15.3:0/1369538308 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86fc07a470 0x7f86fc076a00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f86ec00b370 tx=0x7f86ec00b830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:20:51.763 INFO:tasks.workunit.client.0.smithi003.stdout:1/772: creat d4/d11/d14/d78/f10d x:0 0 0 2024-09-21T12:20:51.764 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.759+0000 7f86eb7fe640 1 -- 172.21.15.3:0/1369538308 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f86ec015020 con 0x7f86fc07a470 2024-09-21T12:20:51.764 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.759+0000 7f86eb7fe640 1 -- 172.21.15.3:0/1369538308 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f86ec011af0 con 0x7f86fc07a470 2024-09-21T12:20:51.764 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.759+0000 7f8700d68640 1 -- 172.21.15.3:0/1369538308 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86fc077230 con 0x7f86fc07a470 2024-09-21T12:20:51.764 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.759+0000 7f86eb7fe640 1 -- 172.21.15.3:0/1369538308 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f86ec010d60 con 0x7f86fc07a470 2024-09-21T12:20:51.764 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.759+0000 7f8700d68640 1 -- 172.21.15.3:0/1369538308 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86fc1a3da0 con 0x7f86fc07a470 2024-09-21T12:20:51.765 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.760+0000 7f8700d68640 1 -- 172.21.15.3:0/1369538308 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86fc103f60 con 0x7f86fc07a470 2024-09-21T12:20:51.765 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.761+0000 7f86eb7fe640 1 -- 172.21.15.3:0/1369538308 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7f86ec018020 con 0x7f86fc07a470 2024-09-21T12:20:51.765 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.761+0000 7f86eb7fe640 1 --2- 172.21.15.3:0/1369538308 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7f86e4074a80 0x7f86e4076f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:51.765 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.761+0000 7f86eb7fe640 1 -- 172.21.15.3:0/1369538308 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5812+0+0 (secure 0 0 0) 0x7f86ec095cd0 con 0x7f86fc07a470 2024-09-21T12:20:51.765 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.762+0000 7f86fa59c640 1 --2- 172.21.15.3:0/1369538308 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7f86e4074a80 0x7f86e4076f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:51.765 INFO:tasks.workunit.client.0.smithi003.stdout:6/878: creat d4/d13/d63/f12e x:0 0 0 2024-09-21T12:20:51.765 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.762+0000 7f86fa59c640 1 --2- 172.21.15.3:0/1369538308 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7f86e4074a80 0x7f86e4076f40 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f86f00096c0 tx=0x7f86f0005a20 comp rx=0 tx=0).ready entity=mgr.24409 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:20:51.768 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:51.767+0000 7f86eb7fe640 1 -- 172.21.15.3:0/1369538308 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f86ec01f020 con 0x7f86fc07a470 2024-09-21T12:20:51.798 INFO:tasks.workunit.client.0.smithi003.stdout:1/773: unlink d4/d11/d14/d25/d107/d80/c10c 0 2024-09-21T12:20:51.799 INFO:tasks.workunit.client.0.smithi003.stdout:6/879: mkdir d4/d13/d56/d12f 0 2024-09-21T12:20:51.800 INFO:tasks.workunit.client.0.smithi003.stdout:8/807: creat d7/f11c x:0 0 0 2024-09-21T12:20:51.801 INFO:tasks.workunit.client.0.smithi003.stdout:9/824: write d2/d20/d22/d5e/d87/fa1 [609780,73088] 0 2024-09-21T12:20:51.818 INFO:tasks.workunit.client.0.smithi003.stdout:6/880: truncate d4/d11/dc1/d64/f74 940396 0 2024-09-21T12:20:51.820 INFO:tasks.workunit.client.0.smithi003.stdout:9/825: mkdir d2/da/d2a/d3c/da8/d126 0 2024-09-21T12:20:51.821 INFO:tasks.workunit.client.0.smithi003.stdout:8/808: truncate d7/d57/f71 1047634 0 2024-09-21T12:20:51.821 INFO:tasks.workunit.client.0.smithi003.stdout:9/826: write d2/d20/d22/d5e/d87/fa6 [488299,105055] 0 2024-09-21T12:20:51.823 INFO:tasks.workunit.client.0.smithi003.stdout:8/809: fsync d7/df/d20/f35 0 2024-09-21T12:20:51.823 INFO:tasks.workunit.client.0.smithi003.stdout:1/774: fdatasync d4/df/fa5 0 2024-09-21T12:20:51.829 INFO:tasks.workunit.client.0.smithi003.stdout:5/891: dwrite dc/d2b/fcb [0,4194304] 0 2024-09-21T12:20:51.830 INFO:tasks.workunit.client.0.smithi003.stdout:9/827: fsync d2/d53/f93 0 2024-09-21T12:20:51.835 INFO:tasks.workunit.client.0.smithi003.stdout:8/810: mkdir d7/df/d20/d24/d47/df3/d11d 0 2024-09-21T12:20:51.843 INFO:tasks.workunit.client.0.smithi003.stdout:5/892: creat dc/dd7/d41/da0/d35/f11c x:0 0 0 2024-09-21T12:20:51.845 INFO:tasks.workunit.client.0.smithi003.stdout:9/828: fdatasync d2/d20/f77 0 2024-09-21T12:20:51.847 INFO:tasks.workunit.client.0.smithi003.stdout:1/775: creat d4/f10e x:0 0 0 2024-09-21T12:20:51.847 INFO:tasks.workunit.client.0.smithi003.stdout:6/881: dwrite d4/d13/d19/fa1 [0,4194304] 0 2024-09-21T12:20:51.850 INFO:tasks.workunit.client.0.smithi003.stdout:1/776: chown d4/df/d41/f54 33 1 2024-09-21T12:20:51.855 INFO:tasks.workunit.client.0.smithi003.stdout:5/893: dwrite dc/d15/d26/fb8 [0,4194304] 0 2024-09-21T12:20:51.858 INFO:tasks.workunit.client.0.smithi003.stdout:8/811: creat d7/df/d20/d21/d4c/d4d/d8c/f11e x:0 0 0 2024-09-21T12:20:51.859 INFO:tasks.workunit.client.0.smithi003.stdout:6/882: symlink d4/d11/d53/l130 0 2024-09-21T12:20:51.860 INFO:tasks.workunit.client.0.smithi003.stdout:8/812: chown d7/de/d1a/f68 763003 1 2024-09-21T12:20:51.860 INFO:tasks.workunit.client.0.smithi003.stdout:6/883: stat d4/d13/d22/c12b 0 2024-09-21T12:20:51.864 INFO:tasks.workunit.client.0.smithi003.stdout:8/813: write d7/de/d85/fea [383816,97613] 0 2024-09-21T12:20:51.865 INFO:tasks.workunit.client.0.smithi003.stdout:1/777: mknod d4/d11/d14/d78/dae/c10f 0 2024-09-21T12:20:51.867 INFO:tasks.workunit.client.0.smithi003.stdout:8/814: write d7/f78 [3725536,44036] 0 2024-09-21T12:20:51.868 INFO:tasks.workunit.client.0.smithi003.stdout:1/778: write d4/d11/d14/d25/d42/f55 [627235,86200] 0 2024-09-21T12:20:51.870 INFO:tasks.workunit.client.0.smithi003.stdout:6/884: dread d4/f21 [0,4194304] 0 2024-09-21T12:20:51.873 INFO:tasks.workunit.client.0.smithi003.stdout:1/779: chown d4/f90 8028355 1 2024-09-21T12:20:51.874 INFO:tasks.workunit.client.0.smithi003.stdout:8/815: chown d7/df/d20/d21/d4c/d4d/d8c/lef 35 1 2024-09-21T12:20:51.876 INFO:tasks.workunit.client.0.smithi003.stdout:8/816: chown d7/de/d52/fd2 0 1 2024-09-21T12:20:51.876 INFO:tasks.workunit.client.0.smithi003.stdout:6/885: mknod d4/c131 0 2024-09-21T12:20:51.878 INFO:tasks.workunit.client.0.smithi003.stdout:6/886: write d4/d9/f45 [2415180,28426] 0 2024-09-21T12:20:51.878 INFO:tasks.workunit.client.0.smithi003.stdout:1/780: rename d4/d11/df6/ffd to d4/df/d41/d103/f110 0 2024-09-21T12:20:51.883 INFO:tasks.workunit.client.0.smithi003.stdout:8/817: truncate d7/de/d52/fac 37587 0 2024-09-21T12:20:51.883 INFO:tasks.workunit.client.0.smithi003.stdout:9/829: write d2/da/d2a/d3c/f37 [4360900,22674] 0 2024-09-21T12:20:51.886 INFO:tasks.workunit.client.0.smithi003.stdout:6/887: mknod d4/d11/d17/c132 0 2024-09-21T12:20:51.887 INFO:tasks.workunit.client.0.smithi003.stdout:6/888: fdatasync d4/d13/d63/f12e 0 2024-09-21T12:20:51.887 INFO:tasks.workunit.client.0.smithi003.stdout:1/781: mkdir d4/d11/d14/d25/d107/d111 0 2024-09-21T12:20:51.889 INFO:tasks.workunit.client.0.smithi003.stdout:9/830: creat d2/d20/d42/dcc/f127 x:0 0 0 2024-09-21T12:20:51.891 INFO:tasks.workunit.client.0.smithi003.stdout:9/831: truncate d2/d53/fe0 843451 0 2024-09-21T12:20:51.894 INFO:tasks.workunit.client.0.smithi003.stdout:1/782: creat d4/d11/d14/f112 x:0 0 0 2024-09-21T12:20:51.895 INFO:tasks.workunit.client.0.smithi003.stdout:1/783: chown d4/df/d41/f54 45067610 1 2024-09-21T12:20:51.896 INFO:tasks.workunit.client.0.smithi003.stdout:5/894: dwrite dc/d15/d21/f64 [0,4194304] 0 2024-09-21T12:20:51.898 INFO:tasks.workunit.client.0.smithi003.stdout:6/889: dread d4/d13/d2e/f61 [0,4194304] 0 2024-09-21T12:20:51.899 INFO:tasks.workunit.client.0.smithi003.stdout:9/832: fsync d2/d53/d75/ff3 0 2024-09-21T12:20:51.900 INFO:tasks.workunit.client.0.smithi003.stdout:6/890: chown d4/d11/l33 35794086 1 2024-09-21T12:20:51.900 INFO:tasks.workunit.client.0.smithi003.stdout:9/833: readlink d2/d53/d75/l117 0 2024-09-21T12:20:51.902 INFO:tasks.workunit.client.0.smithi003.stdout:0/863: sync 2024-09-21T12:20:51.902 INFO:tasks.workunit.client.0.smithi003.stdout:5/895: mknod dc/d15/c11d 0 2024-09-21T12:20:51.903 INFO:tasks.workunit.client.0.smithi003.stdout:1/784: write d4/df/d41/d103/f110 [677258,93206] 0 2024-09-21T12:20:51.904 INFO:tasks.workunit.client.0.smithi003.stdout:1/785: stat d4/d66/l102 0 2024-09-21T12:20:51.904 INFO:tasks.workunit.client.0.smithi003.stdout:8/818: link d7/de/ceb d7/de/d85/c11f 0 2024-09-21T12:20:51.906 INFO:tasks.workunit.client.0.smithi003.stdout:6/891: mknod d4/d11/d1d/deb/c133 0 2024-09-21T12:20:51.906 INFO:tasks.workunit.client.0.smithi003.stdout:8/819: read - d7/df/d20/d24/d47/fed zero size 2024-09-21T12:20:51.909 INFO:tasks.workunit.client.0.smithi003.stdout:0/864: rmdir d9/d12/d17/d38/dfb 39 2024-09-21T12:20:51.984 INFO:tasks.workunit.client.0.smithi003.stdout:5/896: creat dc/dd7/d41/da0/d4b/d5c/dae/f11e x:0 0 0 2024-09-21T12:20:51.985 INFO:tasks.workunit.client.0.smithi003.stdout:1/786: symlink d4/d66/dc7/l113 0 2024-09-21T12:20:51.985 INFO:tasks.workunit.client.0.smithi003.stdout:6/892: unlink d4/d13/d56/f91 0 2024-09-21T12:20:51.986 INFO:tasks.workunit.client.0.smithi003.stdout:8/820: chown d7/df/d20/d54/lcf 1 1 2024-09-21T12:20:51.986 INFO:tasks.workunit.client.0.smithi003.stdout:0/865: mknod d9/d6c/d66/c13a 0 2024-09-21T12:20:51.987 INFO:tasks.workunit.client.0.smithi003.stdout:5/897: mkdir dc/dd7/ddc/d11f 0 2024-09-21T12:20:51.990 INFO:tasks.workunit.client.0.smithi003.stdout:8/821: unlink d7/d57/f98 0 2024-09-21T12:20:51.991 INFO:tasks.workunit.client.0.smithi003.stdout:5/898: fsync dc/dd7/d41/d5b/fbe 0 2024-09-21T12:20:51.992 INFO:tasks.workunit.client.0.smithi003.stdout:0/866: readlink d9/d12/d17/d38/d3a/d46/d55/d7b/d9a/lc0 0 2024-09-21T12:20:51.995 INFO:tasks.workunit.client.0.smithi003.stdout:1/787: chown d4/d11/d14/d25/d107/le4 8807194 1 2024-09-21T12:20:51.998 INFO:tasks.workunit.client.0.smithi003.stdout:6/893: unlink d4/d13/d19/d23/l10f 0 2024-09-21T12:20:51.999 INFO:tasks.workunit.client.0.smithi003.stdout:5/899: dread dc/dd7/d41/da0/d35/f78 [0,4194304] 0 2024-09-21T12:20:51.999 INFO:tasks.workunit.client.0.smithi003.stdout:8/822: dwrite d7/df/d16/dd0/fd6 [0,4194304] 0 2024-09-21T12:20:52.000 INFO:tasks.workunit.client.0.smithi003.stdout:6/894: readlink d4/d11/d1d/deb/dfa/l115 0 2024-09-21T12:20:52.001 INFO:tasks.workunit.client.0.smithi003.stdout:6/895: readlink d4/d13/ld7 0 2024-09-21T12:20:52.003 INFO:tasks.workunit.client.0.smithi003.stdout:0/867: dread - d9/d12/d17/d38/fc1 zero size 2024-09-21T12:20:52.010 INFO:tasks.workunit.client.0.smithi003.stdout:6/896: creat d4/d11/d1d/db9/d108/f134 x:0 0 0 2024-09-21T12:20:52.012 INFO:tasks.workunit.client.0.smithi003.stdout:8/823: dread d7/df/f83 [0,4194304] 0 2024-09-21T12:20:52.012 INFO:tasks.workunit.client.0.smithi003.stdout:0/868: truncate d9/d12/d1e/d5f/d8a/fb4 3333595 0 2024-09-21T12:20:52.014 INFO:tasks.workunit.client.0.smithi003.stdout:0/869: chown d9/d6c/d66/c13a 5569228 1 2024-09-21T12:20:52.014 INFO:tasks.workunit.client.0.smithi003.stdout:8/824: stat d7/df/d20/d21/d4c/d4d/d80/d10e 0 2024-09-21T12:20:52.014 INFO:tasks.workunit.client.0.smithi003.stdout:5/900: dread dc/d2b/f54 [0,4194304] 0 2024-09-21T12:20:52.015 INFO:tasks.workunit.client.0.smithi003.stdout:1/788: rename d4/d66/ldd to d4/d11/d14/d78/l114 0 2024-09-21T12:20:52.018 INFO:tasks.workunit.client.0.smithi003.stdout:3/813: sync 2024-09-21T12:20:52.023 INFO:tasks.workunit.client.0.smithi003.stdout:8/825: fsync d7/df/d16/f93 0 2024-09-21T12:20:52.024 INFO:tasks.workunit.client.0.smithi003.stdout:8/826: chown d7/de/d52 502 1 2024-09-21T12:20:52.033 INFO:tasks.workunit.client.0.smithi003.stdout:8/827: dwrite d7/d57/d77/da5/f105 [0,4194304] 0 2024-09-21T12:20:52.034 INFO:tasks.workunit.client.0.smithi003.stdout:0/870: dread d9/d12/d17/d21/f42 [4194304,4194304] 0 2024-09-21T12:20:52.035 INFO:tasks.workunit.client.0.smithi003.stdout:5/901: dread dc/d15/d1c/f23 [0,4194304] 0 2024-09-21T12:20:52.037 INFO:tasks.workunit.client.0.smithi003.stdout:1/789: creat d4/d11/df6/f115 x:0 0 0 2024-09-21T12:20:52.045 INFO:tasks.workunit.client.0.smithi003.stdout:3/814: symlink d0/d5/d38/d55/ddb/l110 0 2024-09-21T12:20:52.047 INFO:tasks.workunit.client.0.smithi003.stdout:3/815: stat d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/d77/dbb 0 2024-09-21T12:20:52.051 INFO:tasks.workunit.client.0.smithi003.stdout:5/902: creat dc/dd7/d41/d5b/dab/ddd/f120 x:0 0 0 2024-09-21T12:20:52.054 INFO:tasks.workunit.client.0.smithi003.stdout:6/897: link d4/d11/dc1/l8e d4/d9/d79/l135 0 2024-09-21T12:20:52.062 INFO:tasks.workunit.client.0.smithi003.stdout:1/790: dread d4/d11/f4a [0,4194304] 0 2024-09-21T12:20:52.063 INFO:tasks.workunit.client.0.smithi003.stdout:8/828: symlink d7/df/d20/d21/d4c/d4d/d8c/df8/d110/l120 0 2024-09-21T12:20:52.064 INFO:tasks.workunit.client.0.smithi003.stdout:8/829: stat d7/df 0 2024-09-21T12:20:52.066 INFO:tasks.workunit.client.0.smithi003.stdout:3/816: dread d0/d5/f46 [0,4194304] 0 2024-09-21T12:20:52.071 INFO:tasks.workunit.client.0.smithi003.stdout:1/791: dwrite d4/d11/d14/d25/d42/d63/fcf [0,4194304] 0 2024-09-21T12:20:52.099 INFO:tasks.workunit.client.0.smithi003.stdout:0/871: truncate d9/d12/d17/d38/d3a/d46/d55/d7b/f83 1455004 0 2024-09-21T12:20:52.101 INFO:tasks.workunit.client.0.smithi003.stdout:0/872: stat d9/d12/d17/d38/d3a/d46/d55/d7b/da0/d12c 0 2024-09-21T12:20:52.102 INFO:tasks.workunit.client.0.smithi003.stdout:0/873: chown d9/d6c/d26/d54/d7e/dde/lf1 1441952553 1 2024-09-21T12:20:52.111 INFO:tasks.workunit.client.0.smithi003.stdout:2/648: sync 2024-09-21T12:20:52.111 INFO:tasks.workunit.client.0.smithi003.stdout:4/658: sync 2024-09-21T12:20:52.113 INFO:tasks.workunit.client.0.smithi003.stdout:4/659: chown d9/d16/d65/d73/d8d/fa0 1 1 2024-09-21T12:20:52.125 INFO:tasks.workunit.client.0.smithi003.stdout:8/830: creat d7/df/d20/d21/d4c/d4d/d8c/df7/f121 x:0 0 0 2024-09-21T12:20:52.128 INFO:tasks.workunit.client.0.smithi003.stdout:1/792: rmdir d4/df/d41/d103 39 2024-09-21T12:20:52.129 INFO:tasks.workunit.client.0.smithi003.stdout:1/793: stat d4/d66/dc7/dce 0 2024-09-21T12:20:52.131 INFO:tasks.workunit.client.0.smithi003.stdout:5/903: rename dc/dd7/d41/d5b/fbe to dc/dd7/d3c/f121 0 2024-09-21T12:20:52.134 INFO:tasks.workunit.client.0.smithi003.stdout:6/898: rmdir d4/d13/d56/d12f 0 2024-09-21T12:20:52.135 INFO:tasks.workunit.client.0.smithi003.stdout:5/904: truncate dc/dd7/d41/da0/d4b/d5c/dae/f11e 674065 0 2024-09-21T12:20:52.135 INFO:tasks.workunit.client.0.smithi003.stdout:4/660: mknod d9/d48/ce0 0 2024-09-21T12:20:52.137 INFO:tasks.workunit.client.0.smithi003.stdout:1/794: creat d4/df/d12/f116 x:0 0 0 2024-09-21T12:20:52.138 INFO:tasks.workunit.client.0.smithi003.stdout:8/831: mkdir d7/df/d20/d24/d47/df3/d11d/d122 0 2024-09-21T12:20:52.140 INFO:tasks.workunit.client.0.smithi003.stdout:2/649: rename d0/dd/d22/d37/d3f/f67 to d0/d21/d2f/d49/fe1 0 2024-09-21T12:20:52.142 INFO:tasks.workunit.client.0.smithi003.stdout:5/905: fdatasync dc/d2b/d4e/f94 0 2024-09-21T12:20:52.144 INFO:tasks.workunit.client.0.smithi003.stdout:1/795: symlink d4/d11/d14/d25/d42/d7b/l117 0 2024-09-21T12:20:52.146 INFO:tasks.workunit.client.0.smithi003.stdout:1/796: dread - d4/d11/df6/f115 zero size 2024-09-21T12:20:52.147 INFO:tasks.workunit.client.0.smithi003.stdout:3/817: dread d0/d5/da/d28/f51 [0,4194304] 0 2024-09-21T12:20:52.150 INFO:tasks.workunit.client.0.smithi003.stdout:0/874: dread d9/d12/d17/f93 [0,4194304] 0 2024-09-21T12:20:52.154 INFO:tasks.workunit.client.0.smithi003.stdout:5/906: creat dc/d2b/f122 x:0 0 0 2024-09-21T12:20:52.154 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:52.152+0000 7f8700d68640 1 -- 172.21.15.3:0/1369538308 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f86fc02d7c0 con 0x7f86fc07a470 2024-09-21T12:20:52.155 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:51 smithi003 ceph-mon[28057]: pgmap v12: 65 pgs: 65 active+clean; 3.0 GiB data, 9.1 GiB used, 527 GiB / 536 GiB avail; 44 MiB/s rd, 108 MiB/s wr, 273 op/s 2024-09-21T12:20:52.155 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:51 smithi003 ceph-mon[28057]: from='client.14714 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:20:52.155 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:52.153+0000 7f86eb7fe640 1 -- 172.21.15.3:0/1369538308 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+841 (secure 0 0 0) 0x7f86ec0612a0 con 0x7f86fc07a470 2024-09-21T12:20:52.155 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-21T12:20:52.155 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": { 2024-09-21T12:20:52.155 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2 2024-09-21T12:20:52.155 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:20:52.156 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": { 2024-09-21T12:20:52.156 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T12:20:52.156 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 1 2024-09-21T12:20:52.156 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:20:52.156 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": { 2024-09-21T12:20:52.156 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 6 2024-09-21T12:20:52.156 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:20:52.156 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": { 2024-09-21T12:20:52.156 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 4 2024-09-21T12:20:52.156 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:20:52.156 INFO:teuthology.orchestra.run.smithi003.stdout: "overall": { 2024-09-21T12:20:52.156 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 13, 2024-09-21T12:20:52.156 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 1 2024-09-21T12:20:52.157 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-21T12:20:52.157 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-21T12:20:52.157 INFO:tasks.workunit.client.0.smithi003.stdout:4/661: rename d9/d16/l44 to d9/da/d47/d82/le1 0 2024-09-21T12:20:52.157 INFO:tasks.workunit.client.0.smithi003.stdout:1/797: dwrite d4/d11/db1/ff0 [0,4194304] 0 2024-09-21T12:20:52.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:52.157+0000 7f8700d68640 1 -- 172.21.15.3:0/1369538308 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7f86e4074a80 msgr2=0x7f86e4076f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:52.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:52.157+0000 7f8700d68640 1 --2- 172.21.15.3:0/1369538308 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7f86e4074a80 0x7f86e4076f40 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f86f00096c0 tx=0x7f86f0005a20 comp rx=0 tx=0).stop 2024-09-21T12:20:52.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:52.157+0000 7f8700d68640 1 -- 172.21.15.3:0/1369538308 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86fc07a470 msgr2=0x7f86fc076a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:52.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:52.157+0000 7f8700d68640 1 --2- 172.21.15.3:0/1369538308 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86fc07a470 0x7f86fc076a00 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f86ec00b370 tx=0x7f86ec00b830 comp rx=0 tx=0).stop 2024-09-21T12:20:52.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:52.157+0000 7f8700d68640 1 -- 172.21.15.3:0/1369538308 shutdown_connections 2024-09-21T12:20:52.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:52.157+0000 7f8700d68640 1 --2- 172.21.15.3:0/1369538308 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7f86e4074a80 0x7f86e4076f40 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:52.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:52.157+0000 7f8700d68640 1 --2- 172.21.15.3:0/1369538308 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86fc07a470 0x7f86fc076a00 secure :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f86ec00b370 tx=0x7f86ec00b830 comp rx=0 tx=0).stop 2024-09-21T12:20:52.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:52.157+0000 7f8700d68640 1 --2- 172.21.15.3:0/1369538308 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f86fc104d60 0x7f86fc079f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:52.159 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:52.157+0000 7f8700d68640 1 -- 172.21.15.3:0/1369538308 >> 172.21.15.3:0/1369538308 conn(0x7f86fc0ff2f0 msgr2=0x7f86fc108330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:20:52.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:52.158+0000 7f8700d68640 1 -- 172.21.15.3:0/1369538308 shutdown_connections 2024-09-21T12:20:52.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:52.158+0000 7f8700d68640 1 -- 172.21.15.3:0/1369538308 wait complete. 2024-09-21T12:20:52.161 INFO:tasks.workunit.client.0.smithi003.stdout:3/818: creat d0/d5/da/d28/dd/d9f/f111 x:0 0 0 2024-09-21T12:20:52.166 INFO:tasks.workunit.client.0.smithi003.stdout:8/832: dread d7/df/d20/d21/d4c/fd8 [0,4194304] 0 2024-09-21T12:20:52.167 INFO:tasks.workunit.client.0.smithi003.stdout:0/875: dwrite d9/d12/d1e/d108/d2d/f77 [0,4194304] 0 2024-09-21T12:20:52.168 INFO:tasks.workunit.client.0.smithi003.stdout:1/798: rename d4/d66/lad to d4/d11/d14/d78/l118 0 2024-09-21T12:20:52.170 INFO:tasks.workunit.client.0.smithi003.stdout:4/662: symlink d9/da/d66/d67/dd6/le2 0 2024-09-21T12:20:52.171 INFO:tasks.workunit.client.0.smithi003.stdout:8/833: fdatasync d7/df/d20/d24/d47/d79/f97 0 2024-09-21T12:20:52.173 INFO:tasks.workunit.client.0.smithi003.stdout:0/876: read - d9/d12/d17/d38/d3a/f87 zero size 2024-09-21T12:20:52.176 INFO:tasks.workunit.client.0.smithi003.stdout:1/799: symlink d4/d11/db1/l119 0 2024-09-21T12:20:52.181 INFO:tasks.workunit.client.0.smithi003.stdout:1/800: dread - d4/df/fd7 zero size 2024-09-21T12:20:52.181 INFO:tasks.workunit.client.0.smithi003.stdout:4/663: symlink d9/da/le3 0 2024-09-21T12:20:52.182 INFO:tasks.workunit.client.0.smithi003.stdout:4/664: dread - d9/d25/f69 zero size 2024-09-21T12:20:52.189 INFO:tasks.workunit.client.0.smithi003.stdout:1/801: dwrite d4/d11/f72 [0,4194304] 0 2024-09-21T12:20:52.192 INFO:tasks.workunit.client.0.smithi003.stdout:4/665: dwrite d9/d25/f7a [0,4194304] 0 2024-09-21T12:20:52.192 INFO:tasks.workunit.client.0.smithi003.stdout:1/802: chown d4/df/d19/c58 401 1 2024-09-21T12:20:52.195 INFO:tasks.workunit.client.0.smithi003.stdout:4/666: fsync d9/da/d36/d55/d79/f87 0 2024-09-21T12:20:52.199 INFO:tasks.workunit.client.0.smithi003.stdout:1/803: rename d4/d11/d14/d78/dae/c10f to d4/d11/d14/d25/d59/c11a 0 2024-09-21T12:20:52.202 INFO:tasks.workunit.client.0.smithi003.stdout:4/667: creat d9/da/d47/ddd/fe4 x:0 0 0 2024-09-21T12:20:52.203 INFO:tasks.workunit.client.0.smithi003.stdout:1/804: unlink d4/df/d19/f6d 0 2024-09-21T12:20:52.204 INFO:tasks.workunit.client.0.smithi003.stdout:1/805: chown d4/d66/l102 77193 1 2024-09-21T12:20:52.206 INFO:tasks.workunit.client.0.smithi003.stdout:4/668: rename d9/l30 to d9/da/d66/da2/le5 0 2024-09-21T12:20:52.216 INFO:tasks.workunit.client.0.smithi003.stdout:2/650: write d0/dd/d22/d68/f7a [390713,118383] 0 2024-09-21T12:20:52.224 INFO:tasks.workunit.client.0.smithi003.stdout:5/907: truncate dc/dd7/d41/d5b/fcd 858376 0 2024-09-21T12:20:52.225 INFO:tasks.workunit.client.0.smithi003.stdout:4/669: dread d9/d16/f28 [0,4194304] 0 2024-09-21T12:20:52.228 INFO:tasks.workunit.client.0.smithi003.stdout:5/908: unlink dc/dd7/d41/d5b/c9b 0 2024-09-21T12:20:52.229 INFO:tasks.workunit.client.0.smithi003.stdout:3/819: write d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/daa/faf [882542,75603] 0 2024-09-21T12:20:52.231 INFO:tasks.workunit.client.0.smithi003.stdout:5/909: readlink dc/dd7/d41/d5b/lee 0 2024-09-21T12:20:52.234 INFO:tasks.workunit.client.0.smithi003.stdout:8/834: write d7/df/d20/d21/d4c/d8a/fdb [5059256,17617] 0 2024-09-21T12:20:52.236 INFO:tasks.workunit.client.0.smithi003.stdout:0/877: truncate d9/d6c/d26/d54/f6f 2250901 0 2024-09-21T12:20:52.238 INFO:tasks.workunit.client.0.smithi003.stdout:5/910: truncate dc/d15/d26/f84 454466 0 2024-09-21T12:20:52.243 INFO:tasks.workunit.client.0.smithi003.stdout:8/835: dwrite d7/df/d20/d21/d4c/d4d/d75/faa [0,4194304] 0 2024-09-21T12:20:52.244 INFO:tasks.workunit.client.0.smithi003.stdout:0/878: read d9/d12/d17/d38/d3a/d46/d55/db0/fb2 [1328359,60411] 0 2024-09-21T12:20:52.248 INFO:tasks.workunit.client.0.smithi003.stdout:5/911: creat dc/d15/d26/f123 x:0 0 0 2024-09-21T12:20:52.249 INFO:tasks.workunit.client.0.smithi003.stdout:5/912: fsync dc/d15/d21/fac 0 2024-09-21T12:20:52.253 INFO:tasks.workunit.client.0.smithi003.stdout:5/913: chown dc/dd7/d41/da0/d4b/d5c/dae/f11e 0 1 2024-09-21T12:20:52.253 INFO:tasks.workunit.client.0.smithi003.stdout:8/836: rename d7/df/d20/d21/d4c/d4d/d8c/df7/f121 to d7/d57/d77/da5/f123 0 2024-09-21T12:20:52.254 INFO:tasks.workunit.client.0.smithi003.stdout:1/806: dwrite d4/f90 [0,4194304] 0 2024-09-21T12:20:52.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:51 smithi192 ceph-mon[35641]: pgmap v12: 65 pgs: 65 active+clean; 3.0 GiB data, 9.1 GiB used, 527 GiB / 536 GiB avail; 44 MiB/s rd, 108 MiB/s wr, 273 op/s 2024-09-21T12:20:52.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:51 smithi192 ceph-mon[35641]: from='client.14714 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:20:52.259 INFO:tasks.workunit.client.0.smithi003.stdout:4/670: write d9/da/d47/f4c [1578874,87850] 0 2024-09-21T12:20:52.262 INFO:tasks.workunit.client.0.smithi003.stdout:3/820: write d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/d77/dd3/fed [248767,107929] 0 2024-09-21T12:20:52.263 INFO:tasks.workunit.client.0.smithi003.stdout:2/651: dwrite d0/dd/d22/f85 [0,4194304] 0 2024-09-21T12:20:52.265 INFO:tasks.workunit.client.0.smithi003.stdout:1/807: creat d4/d11/df6/f11b x:0 0 0 2024-09-21T12:20:52.266 INFO:tasks.workunit.client.0.smithi003.stdout:2/652: stat d0/d21/d30 0 2024-09-21T12:20:52.269 INFO:tasks.workunit.client.0.smithi003.stdout:3/821: chown d0/d5/da/d28/dd/d9f/cb9 111806207 1 2024-09-21T12:20:52.276 INFO:tasks.workunit.client.0.smithi003.stdout:5/914: dwrite dc/d15/f9a [0,4194304] 0 2024-09-21T12:20:52.283 INFO:tasks.workunit.client.0.smithi003.stdout:2/653: dwrite d0/d21/d2f/d50/f90 [0,4194304] 0 2024-09-21T12:20:52.286 INFO:tasks.workunit.client.0.smithi003.stdout:8/837: rename d7/df/d20/d21/f33 to d7/d57/f124 0 2024-09-21T12:20:52.286 INFO:tasks.workunit.client.0.smithi003.stdout:0/879: dwrite d9/d12/d17/f93 [0,4194304] 0 2024-09-21T12:20:52.291 INFO:tasks.workunit.client.0.smithi003.stdout:5/915: dread dc/dd7/d41/da0/d35/f78 [0,4194304] 0 2024-09-21T12:20:52.292 INFO:tasks.workunit.client.0.smithi003.stdout:5/916: readlink dc/dd7/d41/l62 0 2024-09-21T12:20:52.293 INFO:tasks.workunit.client.0.smithi003.stdout:5/917: chown dc/d15/l47 12222 1 2024-09-21T12:20:52.298 INFO:tasks.workunit.client.0.smithi003.stdout:4/671: rename d9/d16/f28 to d9/da/d47/fe6 0 2024-09-21T12:20:52.299 INFO:tasks.workunit.client.0.smithi003.stdout:8/838: dwrite d7/df/d20/d21/d4c/d8a/fdb [0,4194304] 0 2024-09-21T12:20:52.301 INFO:tasks.workunit.client.0.smithi003.stdout:1/808: link d4/df/d19/l51 d4/d11/d49/l11c 0 2024-09-21T12:20:52.302 INFO:tasks.workunit.client.0.smithi003.stdout:4/672: write d9/da/d36/da9/fc4 [2332838,86055] 0 2024-09-21T12:20:52.302 INFO:tasks.workunit.client.0.smithi003.stdout:5/918: symlink dc/dd7/d41/da0/d35/l124 0 2024-09-21T12:20:52.302 INFO:tasks.workunit.client.0.smithi003.stdout:8/839: fdatasync d7/df/d20/f35 0 2024-09-21T12:20:52.303 INFO:tasks.workunit.client.0.smithi003.stdout:8/840: dread - d7/fe4 zero size 2024-09-21T12:20:52.305 INFO:tasks.workunit.client.0.smithi003.stdout:5/919: readlink dc/dd7/d3c/l6c 0 2024-09-21T12:20:52.308 INFO:tasks.workunit.client.0.smithi003.stdout:4/673: mkdir d9/da/d47/de7 0 2024-09-21T12:20:52.309 INFO:tasks.workunit.client.0.smithi003.stdout:4/674: fdatasync d9/d16/d65/d73/fa3 0 2024-09-21T12:20:52.311 INFO:tasks.workunit.client.0.smithi003.stdout:1/809: creat d4/d11/d14/d78/f11d x:0 0 0 2024-09-21T12:20:52.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:52.309+0000 7ff47a946640 1 -- 172.21.15.3:0/85390553 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff474100880 msgr2=0x7ff474100c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:52.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:52.310+0000 7ff47a946640 1 --2- 172.21.15.3:0/85390553 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff474100880 0x7ff474100c80 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7ff464009880 tx=0x7ff46402a4b0 comp rx=0 tx=0).stop 2024-09-21T12:20:52.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:52.310+0000 7ff47a946640 1 -- 172.21.15.3:0/85390553 shutdown_connections 2024-09-21T12:20:52.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:52.310+0000 7ff47a946640 1 --2- 172.21.15.3:0/85390553 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff474101a80 0x7ff474101f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:52.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:52.310+0000 7ff47a946640 1 --2- 172.21.15.3:0/85390553 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff474100880 0x7ff474100c80 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:52.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:52.310+0000 7ff47a946640 1 -- 172.21.15.3:0/85390553 >> 172.21.15.3:0/85390553 conn(0x7ff4740fc010 msgr2=0x7ff4740fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:20:52.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:52.311+0000 7ff47a946640 1 -- 172.21.15.3:0/85390553 shutdown_connections 2024-09-21T12:20:52.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:52.311+0000 7ff47a946640 1 -- 172.21.15.3:0/85390553 wait complete. 2024-09-21T12:20:52.313 INFO:tasks.workunit.client.0.smithi003.stdout:2/654: rename d0/dd/d22/d37/d3f to d0/de2 0 2024-09-21T12:20:52.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:52.312+0000 7ff47a946640 1 Processor -- start 2024-09-21T12:20:52.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:52.312+0000 7ff47a946640 1 -- start start 2024-09-21T12:20:52.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:52.313+0000 7ff47a946640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff474100880 0x7ff4741962a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:52.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:52.313+0000 7ff47a946640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff474101a80 0x7ff4741967e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:52.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:52.313+0000 7ff47a946640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7ff474109720 con 0x7ff474101a80 2024-09-21T12:20:52.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:52.313+0000 7ff47a946640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff4741095a0 con 0x7ff474100880 2024-09-21T12:20:52.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:52.314+0000 7ff473fff640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff474100880 0x7ff4741962a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:52.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:52.315+0000 7ff473fff640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff474100880 0x7ff4741962a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.3:44250/0 (socket says 172.21.15.3:44250) 2024-09-21T12:20:52.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:52.315+0000 7ff473fff640 1 -- 172.21.15.3:0/3867116435 learned_addr learned my addr 172.21.15.3:0/3867116435 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:20:52.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:52.316+0000 7ff473fff640 1 -- 172.21.15.3:0/3867116435 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff474101a80 msgr2=0x7ff4741967e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:52.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:52.316+0000 7ff473fff640 1 --2- 172.21.15.3:0/3867116435 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff474101a80 0x7ff4741967e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:52.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:52.316+0000 7ff473fff640 1 -- 172.21.15.3:0/3867116435 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff474196e60 con 0x7ff474100880 2024-09-21T12:20:52.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:52.316+0000 7ff473fff640 1 --2- 172.21.15.3:0/3867116435 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff474100880 0x7ff4741962a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff464009850 tx=0x7ff464005e60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:20:52.318 INFO:tasks.workunit.client.0.smithi003.stdout:3/822: dread d0/d5/da/d28/d11/d49/d4c/d54/d5e/d48/f8f [0,4194304] 0 2024-09-21T12:20:52.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:52.317+0000 7ff4717fa640 1 -- 172.21.15.3:0/3867116435 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff464035070 con 0x7ff474100880 2024-09-21T12:20:52.319 INFO:tasks.workunit.client.0.smithi003.stdout:0/880: rename d9/d12/d17/c4e to d9/d12/d17/d21/d30/c13b 0 2024-09-21T12:20:52.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:52.317+0000 7ff4717fa640 1 -- 172.21.15.3:0/3867116435 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff464031d10 con 0x7ff474100880 2024-09-21T12:20:52.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:52.317+0000 7ff47a946640 1 -- 172.21.15.3:0/3867116435 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff47406a520 con 0x7ff474100880 2024-09-21T12:20:52.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:52.318+0000 7ff4717fa640 1 -- 172.21.15.3:0/3867116435 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff464003820 con 0x7ff474100880 2024-09-21T12:20:52.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:52.319+0000 7ff47a946640 1 -- 172.21.15.3:0/3867116435 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff47406ab30 con 0x7ff474100880 2024-09-21T12:20:52.321 INFO:tasks.workunit.client.0.smithi003.stdout:4/675: unlink d9/da/l1d 0 2024-09-21T12:20:52.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:52.320+0000 7ff47a946640 1 -- 172.21.15.3:0/3867116435 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff47418ffa0 con 0x7ff474100880 2024-09-21T12:20:52.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:52.321+0000 7ff4717fa640 1 -- 172.21.15.3:0/3867116435 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7ff4640039c0 con 0x7ff474100880 2024-09-21T12:20:52.323 INFO:tasks.workunit.client.0.smithi003.stdout:3/823: truncate d0/d5/da/d28/dd/f2b 4326281 0 2024-09-21T12:20:52.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:52.322+0000 7ff4717fa640 1 --2- 172.21.15.3:0/3867116435 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7ff45c074ab0 0x7ff45c076f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:20:52.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:52.322+0000 7ff4717fa640 1 -- 172.21.15.3:0/3867116435 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5812+0+0 (secure 0 0 0) 0x7ff464044070 con 0x7ff474100880 2024-09-21T12:20:52.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:52.322+0000 7ff4737fe640 1 --2- 172.21.15.3:0/3867116435 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7ff45c074ab0 0x7ff45c076f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:20:52.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:52.323+0000 7ff4737fe640 1 --2- 172.21.15.3:0/3867116435 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7ff45c074ab0 0x7ff45c076f70 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff474197750 tx=0x7ff468006c90 comp rx=0 tx=0).ready entity=mgr.24409 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:20:52.326 INFO:tasks.workunit.client.0.smithi003.stdout:5/920: rename dc/d2b to dc/dd7/d41/d5b/d101/d125 0 2024-09-21T12:20:52.327 INFO:tasks.workunit.client.0.smithi003.stdout:4/676: creat d9/da/d66/fe8 x:0 0 0 2024-09-21T12:20:52.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:52.327+0000 7ff4717fa640 1 -- 172.21.15.3:0/3867116435 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7ff46408a410 con 0x7ff474100880 2024-09-21T12:20:52.329 INFO:tasks.workunit.client.0.smithi003.stdout:0/881: symlink d9/d12/d1e/d5f/d8a/d125/d12d/l13c 0 2024-09-21T12:20:52.331 INFO:tasks.workunit.client.0.smithi003.stdout:5/921: creat dc/dd7/d41/d9f/d104/f126 x:0 0 0 2024-09-21T12:20:52.332 INFO:tasks.workunit.client.0.smithi003.stdout:8/841: write d7/df/d16/f5c [1659358,28944] 0 2024-09-21T12:20:52.333 INFO:tasks.workunit.client.0.smithi003.stdout:2/655: dread d0/f1d [0,4194304] 0 2024-09-21T12:20:52.333 INFO:tasks.workunit.client.0.smithi003.stdout:4/677: creat d9/da/d66/fe9 x:0 0 0 2024-09-21T12:20:52.336 INFO:tasks.workunit.client.0.smithi003.stdout:1/810: write d4/d11/d14/d25/f9a [531640,82946] 0 2024-09-21T12:20:52.336 INFO:tasks.workunit.client.0.smithi003.stdout:0/882: creat d9/d12/de7/f13d x:0 0 0 2024-09-21T12:20:52.338 INFO:tasks.workunit.client.0.smithi003.stdout:1/811: write d4/d66/dc7/dce/ff1 [2915386,91981] 0 2024-09-21T12:20:52.339 INFO:tasks.workunit.client.0.smithi003.stdout:0/883: fdatasync d9/d12/d17/d38/d3a/d46/d55/d9e/f130 0 2024-09-21T12:20:52.340 INFO:tasks.workunit.client.0.smithi003.stdout:8/842: symlink d7/df/d20/d54/d9d/dd1/l125 0 2024-09-21T12:20:52.342 INFO:tasks.workunit.client.0.smithi003.stdout:3/824: rmdir d0/d5/da/d28/d31/d6b/d10a 0 2024-09-21T12:20:52.344 INFO:tasks.workunit.client.0.smithi003.stdout:3/825: chown d0/d5/da/d28/d31/d6b/fef 94081 1 2024-09-21T12:20:52.344 INFO:tasks.workunit.client.0.smithi003.stdout:4/678: rename d9/d16/f3b to d9/da/d66/d67/dcd/fea 0 2024-09-21T12:20:52.346 INFO:tasks.workunit.client.0.smithi003.stdout:4/679: read d9/da/d47/f5c [918020,69848] 0 2024-09-21T12:20:52.347 INFO:tasks.workunit.client.0.smithi003.stdout:5/922: mknod dc/dd7/d41/d5b/d74/c127 0 2024-09-21T12:20:52.349 INFO:tasks.workunit.client.0.smithi003.stdout:0/884: chown d9/fb 243764946 1 2024-09-21T12:20:52.351 INFO:tasks.workunit.client.0.smithi003.stdout:8/843: dread d7/df/d20/d21/dd5/dde/fe3 [0,4194304] 0 2024-09-21T12:20:52.352 INFO:tasks.workunit.client.0.smithi003.stdout:8/844: readlink d7/df/d20/d21/d4c/d4d/d8c/lef 0 2024-09-21T12:20:52.353 INFO:tasks.workunit.client.0.smithi003.stdout:3/826: mkdir d0/d5/da/d28/d11/d96/de2/d112 0 2024-09-21T12:20:52.354 INFO:tasks.workunit.client.0.smithi003.stdout:2/656: creat d0/dd/d22/fe3 x:0 0 0 2024-09-21T12:20:52.355 INFO:tasks.workunit.client.0.smithi003.stdout:3/827: write d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/f30 [1021682,123831] 0 2024-09-21T12:20:52.358 INFO:tasks.workunit.client.0.smithi003.stdout:5/923: symlink dc/dd7/d41/d5b/dab/l128 0 2024-09-21T12:20:52.359 INFO:tasks.workunit.client.0.smithi003.stdout:3/828: write d0/d5/da/d28/d11/d49/d4c/d54/d5e/d48/f10d [406859,109526] 0 2024-09-21T12:20:52.361 INFO:tasks.workunit.client.0.smithi003.stdout:9/834: sync 2024-09-21T12:20:52.361 INFO:tasks.workunit.client.0.smithi003.stdout:7/698: sync 2024-09-21T12:20:52.361 INFO:tasks.workunit.client.0.smithi003.stdout:0/885: creat d9/d6c/d26/d54/d88/f13e x:0 0 0 2024-09-21T12:20:52.364 INFO:tasks.workunit.client.0.smithi003.stdout:0/886: stat d9/d6c/d26/d54/d7e/cd1 0 2024-09-21T12:20:52.366 INFO:tasks.workunit.client.0.smithi003.stdout:1/812: write d4/d11/d14/d25/d107/fcc [3346015,98442] 0 2024-09-21T12:20:52.370 INFO:tasks.workunit.client.0.smithi003.stdout:7/699: dwrite d8/db/f2b [0,4194304] 0 2024-09-21T12:20:52.371 INFO:tasks.workunit.client.0.smithi003.stdout:5/924: creat dc/dd7/d41/d5b/d74/d7f/d82/f129 x:0 0 0 2024-09-21T12:20:52.371 INFO:tasks.workunit.client.0.smithi003.stdout:7/700: dread - d8/db/d13/f89 zero size 2024-09-21T12:20:52.371 INFO:tasks.workunit.client.0.smithi003.stdout:4/680: write d9/d16/d65/d97/f9d [138637,96365] 0 2024-09-21T12:20:52.374 INFO:tasks.workunit.client.0.smithi003.stdout:9/835: creat d2/da/d2a/d3c/da8/f128 x:0 0 0 2024-09-21T12:20:52.382 INFO:tasks.workunit.client.0.smithi003.stdout:0/887: truncate d9/d12/d17/d38/d3a/d46/d55/d57/f76 803206 0 2024-09-21T12:20:52.384 INFO:tasks.workunit.client.0.smithi003.stdout:7/701: creat d8/d31/d84/fec x:0 0 0 2024-09-21T12:20:52.386 INFO:tasks.workunit.client.0.smithi003.stdout:5/925: mkdir dc/dd7/d41/d5b/d74/d7f/d12a 0 2024-09-21T12:20:52.386 INFO:tasks.workunit.client.0.smithi003.stdout:8/845: write d7/d57/f124 [1462278,13629] 0 2024-09-21T12:20:52.388 INFO:tasks.workunit.client.0.smithi003.stdout:4/681: unlink d9/da/d66/d67/l6d 0 2024-09-21T12:20:52.390 INFO:tasks.workunit.client.0.smithi003.stdout:8/846: read d7/df/d20/d21/d4c/d4d/d8c/faf [3197809,3499] 0 2024-09-21T12:20:52.391 INFO:tasks.workunit.client.0.smithi003.stdout:8/847: chown d7/df/d20/d21/d4c/d4d/d8c/faf 472954 1 2024-09-21T12:20:52.391 INFO:tasks.workunit.client.0.smithi003.stdout:1/813: mknod d4/d11/c11e 0 2024-09-21T12:20:52.392 INFO:tasks.workunit.client.0.smithi003.stdout:2/657: rename d0/d1c/d6a/dc0/cd6 to d0/ce4 0 2024-09-21T12:20:52.394 INFO:tasks.workunit.client.0.smithi003.stdout:0/888: truncate d9/d12/d17/d21/d30/d4d/d11d/f10c 897253 0 2024-09-21T12:20:52.394 INFO:tasks.workunit.client.0.smithi003.stdout:6/899: sync 2024-09-21T12:20:52.395 INFO:tasks.workunit.client.0.smithi003.stdout:5/926: fsync dc/dd7/d41/fd1 0 2024-09-21T12:20:52.396 INFO:tasks.workunit.client.0.smithi003.stdout:5/927: read dc/d15/f9a [2098297,103218] 0 2024-09-21T12:20:52.397 INFO:tasks.workunit.client.0.smithi003.stdout:5/928: readlink dc/l12 0 2024-09-21T12:20:52.399 INFO:tasks.workunit.client.0.smithi003.stdout:5/929: write dc/dd7/d41/da0/d4b/d5c/dae/f11e [593209,49946] 0 2024-09-21T12:20:52.399 INFO:tasks.workunit.client.0.smithi003.stdout:9/836: mknod d2/da/d2a/d3c/c129 0 2024-09-21T12:20:52.400 INFO:tasks.workunit.client.0.smithi003.stdout:9/837: read d2/da/d35/d76/d94/f9b [2227406,72880] 0 2024-09-21T12:20:52.401 INFO:tasks.workunit.client.0.smithi003.stdout:9/838: chown d2/da/fd1 802930396 1 2024-09-21T12:20:52.403 INFO:tasks.workunit.client.0.smithi003.stdout:1/814: rename d4/d66/ffb to d4/d66/d8b/f11f 0 2024-09-21T12:20:52.405 INFO:tasks.workunit.client.0.smithi003.stdout:2/658: creat d0/d21/d2c/d6c/db2/fe5 x:0 0 0 2024-09-21T12:20:52.408 INFO:tasks.workunit.client.0.smithi003.stdout:7/702: truncate d8/d3c/faa 857970 0 2024-09-21T12:20:52.410 INFO:tasks.workunit.client.0.smithi003.stdout:6/900: chown d4/c68 224583 1 2024-09-21T12:20:52.419 INFO:tasks.workunit.client.0.smithi003.stdout:3/829: getdents d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e 0 2024-09-21T12:20:52.423 INFO:tasks.workunit.client.0.smithi003.stdout:4/682: creat d9/da/d36/dcc/feb x:0 0 0 2024-09-21T12:20:52.425 INFO:tasks.workunit.client.0.smithi003.stdout:7/703: dread d8/db/d13/f1a [0,4194304] 0 2024-09-21T12:20:52.427 INFO:tasks.workunit.client.0.smithi003.stdout:7/704: truncate d8/db/d32/f8c 1608891 0 2024-09-21T12:20:52.430 INFO:tasks.workunit.client.0.smithi003.stdout:0/889: dread d9/d12/d17/d38/d3a/d46/f94 [0,4194304] 0 2024-09-21T12:20:52.442 INFO:tasks.workunit.client.0.smithi003.stdout:4/683: rename d9/da/d66/d67/dcd/dd8/dca to d9/da/d36/d55/dec 0 2024-09-21T12:20:52.443 INFO:tasks.workunit.client.0.smithi003.stdout:2/659: write d0/d21/f81 [4473508,108946] 0 2024-09-21T12:20:52.447 INFO:tasks.workunit.client.0.smithi003.stdout:1/815: dwrite d4/df/f31 [0,4194304] 0 2024-09-21T12:20:52.447 INFO:tasks.workunit.client.0.smithi003.stdout:5/930: truncate dc/d15/d26/f84 1010070 0 2024-09-21T12:20:52.447 INFO:tasks.workunit.client.0.smithi003.stdout:9/839: dread d2/da/d2a/f8c [0,4194304] 0 2024-09-21T12:20:52.449 INFO:tasks.workunit.client.0.smithi003.stdout:9/840: chown d2/d20/f21 615409533 1 2024-09-21T12:20:52.459 INFO:tasks.workunit.client.0.smithi003.stdout:2/660: fsync d0/d1c/f42 0 2024-09-21T12:20:52.465 INFO:tasks.workunit.client.0.smithi003.stdout:8/848: getdents d7/d57/d77 0 2024-09-21T12:20:52.468 INFO:tasks.workunit.client.0.smithi003.stdout:8/849: dread d7/df/d20/ff0 [0,4194304] 0 2024-09-21T12:20:52.470 INFO:tasks.workunit.client.0.smithi003.stdout:0/890: write d9/d12/d1e/d108/f29 [638378,81942] 0 2024-09-21T12:20:52.470 INFO:tasks.workunit.client.0.smithi003.stdout:8/850: stat d7/d57/d77/da5/f123 0 2024-09-21T12:20:52.472 INFO:tasks.workunit.client.0.smithi003.stdout:7/705: rename d8/db/d13/d75/da6/lca to d8/d3c/led 0 2024-09-21T12:20:52.475 INFO:tasks.workunit.client.0.smithi003.stdout:9/841: creat d2/da/d2a/d89/d9c/f12a x:0 0 0 2024-09-21T12:20:52.475 INFO:tasks.workunit.client.0.smithi003.stdout:4/684: dread d9/d25/f39 [0,4194304] 0 2024-09-21T12:20:52.477 INFO:tasks.workunit.client.0.smithi003.stdout:2/661: truncate d0/d1c/d6a/f2a 191290 0 2024-09-21T12:20:52.479 INFO:tasks.workunit.client.0.smithi003.stdout:5/931: symlink dc/l12b 0 2024-09-21T12:20:52.481 INFO:tasks.workunit.client.0.smithi003.stdout:8/851: unlink d7/df/d20/d21/dd5/dde/ce9 0 2024-09-21T12:20:52.482 INFO:tasks.workunit.client.0.smithi003.stdout:7/706: fsync d8/db/f16 0 2024-09-21T12:20:52.483 INFO:tasks.workunit.client.0.smithi003.stdout:8/852: write d7/df/d16/f46 [3973439,45057] 0 2024-09-21T12:20:52.484 INFO:tasks.workunit.client.0.smithi003.stdout:7/707: truncate d8/d2c/fab 606526 0 2024-09-21T12:20:52.484 INFO:tasks.workunit.client.0.smithi003.stdout:9/842: truncate d2/d20/f21 5416179 0 2024-09-21T12:20:52.486 INFO:tasks.workunit.client.0.smithi003.stdout:6/901: getdents d4/d9 0 2024-09-21T12:20:52.486 INFO:tasks.workunit.client.0.smithi003.stdout:3/830: getdents d0/d5/da/d28 0 2024-09-21T12:20:52.487 INFO:tasks.workunit.client.0.smithi003.stdout:7/708: chown d8/db/d13/d60/fe4 1 1 2024-09-21T12:20:52.489 INFO:tasks.workunit.client.0.smithi003.stdout:2/662: symlink d0/d1c/d6a/dc0/le6 0 2024-09-21T12:20:52.489 INFO:tasks.workunit.client.0.smithi003.stdout:3/831: stat d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/d77 0 2024-09-21T12:20:52.492 INFO:tasks.workunit.client.0.smithi003.stdout:1/816: rmdir d4/d11/d14/d25/d107/d111 0 2024-09-21T12:20:52.493 INFO:tasks.workunit.client.0.smithi003.stdout:5/932: read dc/dd7/d41/da0/d4b/d5c/fdb [351337,52257] 0 2024-09-21T12:20:52.494 INFO:tasks.workunit.client.0.smithi003.stdout:0/891: mknod d9/d6c/d26/d54/c13f 0 2024-09-21T12:20:52.496 INFO:tasks.workunit.client.0.smithi003.stdout:8/853: mkdir d7/de/d81/d126 0 2024-09-21T12:20:52.497 INFO:tasks.workunit.client.0.smithi003.stdout:9/843: dread d2/da/d2a/d89/f95 [0,4194304] 0 2024-09-21T12:20:52.497 INFO:tasks.workunit.client.0.smithi003.stdout:6/902: dread - d4/d11/d32/f104 zero size 2024-09-21T12:20:52.498 INFO:tasks.workunit.client.0.smithi003.stdout:9/844: write d2/da/f102 [43564,13018] 0 2024-09-21T12:20:52.501 INFO:tasks.workunit.client.0.smithi003.stdout:9/845: truncate d2/da/d35/d4d/f116 720549 0 2024-09-21T12:20:52.504 INFO:tasks.workunit.client.0.smithi003.stdout:2/663: unlink d0/d1c/d6a/f33 0 2024-09-21T12:20:52.511 INFO:tasks.workunit.client.0.smithi003.stdout:3/832: dread d0/d5/da/d28/d31/d6b/fc0 [0,4194304] 0 2024-09-21T12:20:52.518 INFO:tasks.workunit.client.0.smithi003.stdout:5/933: dwrite dc/d15/d21/f24 [0,4194304] 0 2024-09-21T12:20:52.523 INFO:tasks.workunit.client.0.smithi003.stdout:6/903: mkdir d4/d13/d19/d38/d136 0 2024-09-21T12:20:52.523 INFO:tasks.workunit.client.0.smithi003.stdout:4/685: write d9/d48/f89 [1582107,45942] 0 2024-09-21T12:20:52.525 INFO:tasks.workunit.client.0.smithi003.stdout:9/846: creat d2/d20/d22/d3f/dfd/f12b x:0 0 0 2024-09-21T12:20:52.526 INFO:tasks.workunit.client.0.smithi003.stdout:9/847: chown d2/da/f11c 37340341 1 2024-09-21T12:20:52.527 INFO:tasks.workunit.client.0.smithi003.stdout:7/709: write d8/d31/f67 [4771656,45344] 0 2024-09-21T12:20:52.532 INFO:tasks.workunit.client.0.smithi003.stdout:1/817: write d4/d11/d14/d25/d59/fac [175127,93496] 0 2024-09-21T12:20:52.532 INFO:tasks.workunit.client.0.smithi003.stdout:3/833: mkdir d0/d5/da/d28/d31/d6b/d113 0 2024-09-21T12:20:52.536 INFO:tasks.workunit.client.0.smithi003.stdout:8/854: mkdir d7/df/d20/d54/d127 0 2024-09-21T12:20:52.538 INFO:tasks.workunit.client.0.smithi003.stdout:6/904: creat d4/d11/d1d/f137 x:0 0 0 2024-09-21T12:20:52.538 INFO:tasks.workunit.client.0.smithi003.stdout:9/848: rmdir d2/da/d35/d76 39 2024-09-21T12:20:52.540 INFO:tasks.workunit.client.0.smithi003.stdout:7/710: creat d8/d31/fee x:0 0 0 2024-09-21T12:20:52.544 INFO:tasks.workunit.client.0.smithi003.stdout:0/892: link d9/d6c/d26/c11c d9/d12/d101/d135/c140 0 2024-09-21T12:20:52.546 INFO:tasks.workunit.client.0.smithi003.stdout:8/855: creat d7/de/d81/f128 x:0 0 0 2024-09-21T12:20:52.550 INFO:tasks.workunit.client.0.smithi003.stdout:7/711: dwrite d8/d31/fee [0,4194304] 0 2024-09-21T12:20:52.552 INFO:tasks.workunit.client.0.smithi003.stdout:1/818: truncate d4/d11/d14/f3f 1699971 0 2024-09-21T12:20:52.554 INFO:tasks.workunit.client.0.smithi003.stdout:1/819: fsync d4/d66/f84 0 2024-09-21T12:20:52.556 INFO:tasks.workunit.client.0.smithi003.stdout:2/664: truncate d0/dd/f5a 464450 0 2024-09-21T12:20:52.559 INFO:tasks.workunit.client.0.smithi003.stdout:3/834: dwrite d0/d5/da/d28/dd/fb2 [0,4194304] 0 2024-09-21T12:20:52.562 INFO:tasks.workunit.client.0.smithi003.stdout:3/835: chown d0/d5/fab 2244 1 2024-09-21T12:20:52.564 INFO:tasks.workunit.client.0.smithi003.stdout:9/849: fdatasync d2/da/d35/d76/fe7 0 2024-09-21T12:20:52.564 INFO:tasks.workunit.client.0.smithi003.stdout:7/712: dwrite d8/d93/fcd [0,4194304] 0 2024-09-21T12:20:52.566 INFO:tasks.workunit.client.0.smithi003.stdout:6/905: write d4/d13/f2c [1869590,88043] 0 2024-09-21T12:20:52.569 INFO:tasks.workunit.client.0.smithi003.stdout:7/713: readlink d8/db/d32/d43/d7e/le9 0 2024-09-21T12:20:52.569 INFO:tasks.workunit.client.0.smithi003.stdout:6/906: chown d4/d13/l42 6 1 2024-09-21T12:20:52.575 INFO:tasks.workunit.client.0.smithi003.stdout:1/820: rename d4/d11/d14/d25/d107/d80/ca8 to d4/d66/c120 0 2024-09-21T12:20:52.577 INFO:tasks.workunit.client.0.smithi003.stdout:9/850: symlink d2/d53/de8/l12c 0 2024-09-21T12:20:52.579 INFO:tasks.workunit.client.0.smithi003.stdout:0/893: dread d9/d12/d17/d38/ff4 [0,4194304] 0 2024-09-21T12:20:52.582 INFO:tasks.workunit.client.0.smithi003.stdout:2/665: rename d0/d21/d62 to d0/d21/d2c/d6c/db2/de7 0 2024-09-21T12:20:52.583 INFO:tasks.workunit.client.0.smithi003.stdout:7/714: fsync d8/d31/fee 0 2024-09-21T12:20:52.586 INFO:tasks.workunit.client.0.smithi003.stdout:0/894: mknod d9/d6c/d26/d54/d7e/dde/c141 0 2024-09-21T12:20:52.587 INFO:tasks.workunit.client.0.smithi003.stdout:3/836: dread d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/f53 [0,4194304] 0 2024-09-21T12:20:52.588 INFO:tasks.workunit.client.0.smithi003.stdout:8/856: dread d7/de/d1a/f68 [0,4194304] 0 2024-09-21T12:20:52.599 INFO:tasks.workunit.client.0.smithi003.stdout:7/715: dwrite d8/db/d32/d43/d7e/f83 [0,4194304] 0 2024-09-21T12:20:52.602 INFO:tasks.workunit.client.0.smithi003.stdout:8/857: mknod d7/df/d20/d21/d4c/d4d/d8c/df8/d110/c129 0 2024-09-21T12:20:52.603 INFO:tasks.workunit.client.0.smithi003.stdout:6/907: truncate d4/d13/d19/fa1 2114874 0 2024-09-21T12:20:52.606 INFO:tasks.workunit.client.0.smithi003.stdout:3/837: symlink d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/d42/l114 0 2024-09-21T12:20:52.610 INFO:tasks.workunit.client.0.smithi003.stdout:7/716: rename d8/d93/fb3 to d8/db/d32/d43/fef 0 2024-09-21T12:20:52.612 INFO:tasks.workunit.client.0.smithi003.stdout:1/821: dwrite d4/f7 [0,4194304] 0 2024-09-21T12:20:52.615 INFO:tasks.workunit.client.0.smithi003.stdout:8/858: creat d7/df/d20/d21/d4c/d8a/f12a x:0 0 0 2024-09-21T12:20:52.619 INFO:tasks.workunit.client.0.smithi003.stdout:2/666: truncate d0/d46/f64 85812 0 2024-09-21T12:20:52.620 INFO:tasks.workunit.client.0.smithi003.stdout:6/908: chown d4/d11/d1d/d36/lca 55071404 1 2024-09-21T12:20:52.625 INFO:tasks.workunit.client.0.smithi003.stdout:1/822: rmdir d4/d11/d14/d25 39 2024-09-21T12:20:52.627 INFO:tasks.workunit.client.0.smithi003.stdout:8/859: creat d7/df/d20/d21/de6/f12b x:0 0 0 2024-09-21T12:20:52.631 INFO:tasks.workunit.client.0.smithi003.stdout:8/860: stat d7/de/d81/f128 0 2024-09-21T12:20:52.633 INFO:tasks.workunit.client.0.smithi003.stdout:9/851: dwrite d2/da/d2a/f5a [0,4194304] 0 2024-09-21T12:20:52.633 INFO:tasks.workunit.client.0.smithi003.stdout:7/717: dwrite d8/db/f2b [4194304,4194304] 0 2024-09-21T12:20:52.634 INFO:tasks.workunit.client.0.smithi003.stdout:6/909: dread - d4/d11/d17/f95 zero size 2024-09-21T12:20:52.638 INFO:tasks.workunit.client.0.smithi003.stdout:0/895: dwrite d9/fb [4194304,4194304] 0 2024-09-21T12:20:52.640 INFO:tasks.workunit.client.0.smithi003.stdout:7/718: fdatasync d8/f7c 0 2024-09-21T12:20:52.643 INFO:tasks.workunit.client.0.smithi003.stdout:6/910: fsync d4/d9/f15 0 2024-09-21T12:20:52.648 INFO:tasks.workunit.client.0.smithi003.stdout:8/861: dwrite d7/df/d20/d21/ff5 [0,4194304] 0 2024-09-21T12:20:52.649 INFO:tasks.workunit.client.0.smithi003.stdout:6/911: fdatasync d4/d9/f50 0 2024-09-21T12:20:52.655 INFO:tasks.workunit.client.0.smithi003.stdout:9/852: creat d2/da/d2a/d89/f12d x:0 0 0 2024-09-21T12:20:52.656 INFO:tasks.workunit.client.0.smithi003.stdout:7/719: write d8/d3c/d57/f65 [2189282,124096] 0 2024-09-21T12:20:52.657 INFO:tasks.workunit.client.0.smithi003.stdout:2/667: dwrite d0/d1c/d6a/fd9 [0,4194304] 0 2024-09-21T12:20:52.663 INFO:tasks.workunit.client.0.smithi003.stdout:3/838: dread d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/d77/f84 [0,4194304] 0 2024-09-21T12:20:52.666 INFO:tasks.workunit.client.0.smithi003.stdout:6/912: mknod d4/d13/d19/d38/da3/c138 0 2024-09-21T12:20:52.675 INFO:tasks.workunit.client.0.smithi003.stdout:0/896: dread d9/d12/d17/d38/d3a/d46/d55/d7b/f83 [0,4194304] 0 2024-09-21T12:20:52.675 INFO:tasks.workunit.client.0.smithi003.stdout:1/823: dwrite d4/d11/d14/d25/d42/f5f [0,4194304] 0 2024-09-21T12:20:52.676 INFO:tasks.workunit.client.0.smithi003.stdout:9/853: rename d2/d20/d42/lda to d2/d20/d42/da5/l12e 0 2024-09-21T12:20:52.683 INFO:tasks.workunit.client.0.smithi003.stdout:6/913: write d4/d13/d19/d23/f70 [1302941,118525] 0 2024-09-21T12:20:52.684 INFO:tasks.workunit.client.0.smithi003.stdout:8/862: creat d7/df/d20/d24/f12c x:0 0 0 2024-09-21T12:20:52.685 INFO:tasks.workunit.client.0.smithi003.stdout:6/914: readlink d4/d13/d19/d23/l75 0 2024-09-21T12:20:52.686 INFO:tasks.workunit.client.0.smithi003.stdout:6/915: chown d4/d13/d5b/d8c 13 1 2024-09-21T12:20:52.687 INFO:tasks.workunit.client.0.smithi003.stdout:8/863: write d7/df/d20/d21/de6/f12b [136830,99825] 0 2024-09-21T12:20:52.689 INFO:tasks.workunit.client.0.smithi003.stdout:1/824: creat d4/d66/dc7/dce/f121 x:0 0 0 2024-09-21T12:20:52.689 INFO:tasks.workunit.client.0.smithi003.stdout:3/839: dread d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/d77/dd3/fdd [0,4194304] 0 2024-09-21T12:20:52.690 INFO:tasks.workunit.client.0.smithi003.stdout:2/668: rename d0/de2/l70 to d0/d21/d2f/d50/dc4/d7f/le8 0 2024-09-21T12:20:52.693 INFO:tasks.workunit.client.0.smithi003.stdout:7/720: getdents d8/d3c 0 2024-09-21T12:20:52.703 INFO:tasks.workunit.client.0.smithi003.stdout:0/897: write d9/d12/d17/d38/d3a/f87 [646427,90758] 0 2024-09-21T12:20:52.704 INFO:tasks.workunit.client.0.smithi003.stdout:2/669: write d0/dd/d22/f57 [640594,48951] 0 2024-09-21T12:20:52.706 INFO:tasks.workunit.client.0.smithi003.stdout:3/840: creat d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/f115 x:0 0 0 2024-09-21T12:20:52.707 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:52.706+0000 7ff47a946640 1 -- 172.21.15.3:0/3867116435 --> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7ff47406ad50 con 0x7ff45c074ab0 2024-09-21T12:20:52.708 INFO:tasks.workunit.client.0.smithi003.stdout:9/854: dwrite d2/da/f11c [0,4194304] 0 2024-09-21T12:20:52.709 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:52.707+0000 7ff4717fa640 1 -- 172.21.15.3:0/3867116435 <== mgr.24409 v2:172.21.15.192:6828/1528605296 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+310 (secure 0 0 0) 0x7ff47406ad50 con 0x7ff45c074ab0 2024-09-21T12:20:52.709 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-21T12:20:52.709 INFO:teuthology.orchestra.run.smithi003.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T12:20:52.709 INFO:teuthology.orchestra.run.smithi003.stdout: "in_progress": true, 2024-09-21T12:20:52.709 INFO:teuthology.orchestra.run.smithi003.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-21T12:20:52.709 INFO:teuthology.orchestra.run.smithi003.stdout: "services_complete": [], 2024-09-21T12:20:52.709 INFO:teuthology.orchestra.run.smithi003.stdout: "progress": "1/2 daemons upgraded", 2024-09-21T12:20:52.709 INFO:teuthology.orchestra.run.smithi003.stdout: "message": "", 2024-09-21T12:20:52.709 INFO:teuthology.orchestra.run.smithi003.stdout: "is_paused": false 2024-09-21T12:20:52.710 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-21T12:20:52.710 INFO:tasks.workunit.client.0.smithi003.stdout:9/855: stat d2/d53/fe0 0 2024-09-21T12:20:52.711 INFO:tasks.workunit.client.0.smithi003.stdout:6/916: mkdir d4/d11/d139 0 2024-09-21T12:20:52.712 INFO:tasks.workunit.client.0.smithi003.stdout:6/917: fsync d4/d9/d79/f119 0 2024-09-21T12:20:52.712 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:52.710+0000 7ff47a946640 1 -- 172.21.15.3:0/3867116435 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7ff45c074ab0 msgr2=0x7ff45c076f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:52.713 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:52.710+0000 7ff47a946640 1 --2- 172.21.15.3:0/3867116435 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7ff45c074ab0 0x7ff45c076f70 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ff474197750 tx=0x7ff468006c90 comp rx=0 tx=0).stop 2024-09-21T12:20:52.713 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:52.711+0000 7ff47a946640 1 -- 172.21.15.3:0/3867116435 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff474100880 msgr2=0x7ff4741962a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:20:52.713 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:52.711+0000 7ff47a946640 1 --2- 172.21.15.3:0/3867116435 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff474100880 0x7ff4741962a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff464009850 tx=0x7ff464005e60 comp rx=0 tx=0).stop 2024-09-21T12:20:52.713 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:52.711+0000 7ff47a946640 1 -- 172.21.15.3:0/3867116435 shutdown_connections 2024-09-21T12:20:52.713 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:52.711+0000 7ff47a946640 1 --2- 172.21.15.3:0/3867116435 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7ff45c074ab0 0x7ff45c076f70 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:52.713 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:52.711+0000 7ff47a946640 1 --2- 172.21.15.3:0/3867116435 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff474101a80 0x7ff4741967e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:52.713 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:52.711+0000 7ff47a946640 1 --2- 172.21.15.3:0/3867116435 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff474100880 0x7ff4741962a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:20:52.713 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:52.711+0000 7ff47a946640 1 -- 172.21.15.3:0/3867116435 >> 172.21.15.3:0/3867116435 conn(0x7ff4740fc010 msgr2=0x7ff474104e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:20:52.713 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:52.711+0000 7ff47a946640 1 -- 172.21.15.3:0/3867116435 shutdown_connections 2024-09-21T12:20:52.713 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:20:52.711+0000 7ff47a946640 1 -- 172.21.15.3:0/3867116435 wait complete. 2024-09-21T12:20:52.714 INFO:tasks.workunit.client.0.smithi003.stdout:6/918: write d4/d9/d79/f9d [8715947,126866] 0 2024-09-21T12:20:52.714 INFO:tasks.workunit.client.0.smithi003.stdout:1/825: mknod d4/d11/d14/d25/d107/c122 0 2024-09-21T12:20:52.716 INFO:tasks.workunit.client.0.smithi003.stdout:1/826: write d4/d66/f84 [5073212,45289] 0 2024-09-21T12:20:52.717 INFO:tasks.workunit.client.0.smithi003.stdout:1/827: chown d4/df/ldb 0 1 2024-09-21T12:20:52.719 INFO:tasks.workunit.client.0.smithi003.stdout:0/898: mkdir d9/d12/d17/d38/d3a/d46/d55/d7b/da0/d142 0 2024-09-21T12:20:52.722 INFO:tasks.workunit.client.0.smithi003.stdout:7/721: truncate d8/d93/fc1 1039724 0 2024-09-21T12:20:52.724 INFO:tasks.workunit.client.0.smithi003.stdout:1/828: dwrite d4/d66/dc7/ded/fe9 [0,4194304] 0 2024-09-21T12:20:52.727 INFO:tasks.workunit.client.0.smithi003.stdout:2/670: unlink d0/d46/f64 0 2024-09-21T12:20:52.727 INFO:tasks.workunit.client.0.smithi003.stdout:0/899: dread d9/d12/d17/d38/d3a/d46/f94 [0,4194304] 0 2024-09-21T12:20:52.728 INFO:tasks.workunit.client.0.smithi003.stdout:3/841: creat d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/d77/dbb/f116 x:0 0 0 2024-09-21T12:20:52.730 INFO:tasks.workunit.client.0.smithi003.stdout:3/842: chown d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/d77/dd3 373 1 2024-09-21T12:20:52.732 INFO:tasks.workunit.client.0.smithi003.stdout:3/843: fdatasync d0/d5/da/d28/d31/fbf 0 2024-09-21T12:20:52.735 INFO:tasks.workunit.client.0.smithi003.stdout:8/864: getdents d7/df/d20 0 2024-09-21T12:20:52.736 INFO:tasks.workunit.client.0.smithi003.stdout:6/919: mknod d4/d13/d5b/d122/c13a 0 2024-09-21T12:20:52.741 INFO:tasks.workunit.client.0.smithi003.stdout:2/671: truncate d0/dd/d22/d37/f5c 1815897 0 2024-09-21T12:20:52.742 INFO:tasks.workunit.client.0.smithi003.stdout:9/856: link d2/d53/d75/ff3 d2/d53/d83/f12f 0 2024-09-21T12:20:52.743 INFO:tasks.workunit.client.0.smithi003.stdout:6/920: creat d4/d100/f13b x:0 0 0 2024-09-21T12:20:52.745 INFO:tasks.workunit.client.0.smithi003.stdout:6/921: fdatasync d4/d13/d5b/d8c/f117 0 2024-09-21T12:20:52.747 INFO:tasks.workunit.client.0.smithi003.stdout:9/857: dread d2/d53/d83/fdb [0,4194304] 0 2024-09-21T12:20:52.752 INFO:tasks.workunit.client.0.smithi003.stdout:6/922: mknod d4/d11/d17/c13c 0 2024-09-21T12:20:52.753 INFO:tasks.workunit.client.0.smithi003.stdout:6/923: write d4/d13/d63/f8d [4283082,79800] 0 2024-09-21T12:20:52.753 INFO:tasks.workunit.client.0.smithi003.stdout:6/924: stat d4/d100/f13b 0 2024-09-21T12:20:52.755 INFO:tasks.workunit.client.0.smithi003.stdout:0/900: write d9/f4c [466212,115649] 0 2024-09-21T12:20:52.760 INFO:tasks.workunit.client.0.smithi003.stdout:1/829: write d4/df/d19/f2b [1206482,84816] 0 2024-09-21T12:20:52.762 INFO:tasks.workunit.client.0.smithi003.stdout:6/925: dread - d4/d100/f101 zero size 2024-09-21T12:20:52.766 INFO:tasks.workunit.client.0.smithi003.stdout:1/830: truncate d4/d11/d14/d78/fd8 889022 0 2024-09-21T12:20:52.767 INFO:tasks.workunit.client.0.smithi003.stdout:7/722: dwrite d8/d3c/d57/d9e/fa2 [0,4194304] 0 2024-09-21T12:20:52.841 INFO:tasks.workunit.client.0.smithi003.stdout:6/926: creat d4/d13/d19/d38/da3/f13d x:0 0 0 2024-09-21T12:20:52.842 INFO:tasks.workunit.client.0.smithi003.stdout:1/831: dread - d4/df/d12/fd0 zero size 2024-09-21T12:20:52.842 INFO:tasks.workunit.client.0.smithi003.stdout:7/723: dread d8/d2c/f2a [0,4194304] 0 2024-09-21T12:20:52.844 INFO:tasks.workunit.client.0.smithi003.stdout:2/672: dwrite d0/d21/d2c/f72 [0,4194304] 0 2024-09-21T12:20:52.845 INFO:tasks.workunit.client.0.smithi003.stdout:9/858: dwrite d2/da/d17/f7a [0,4194304] 0 2024-09-21T12:20:52.848 INFO:tasks.workunit.client.0.smithi003.stdout:9/859: chown f1 5 1 2024-09-21T12:20:52.852 INFO:tasks.workunit.client.0.smithi003.stdout:0/901: dwrite d9/d12/d17/d38/d3a/d46/d55/d9e/fc8 [0,4194304] 0 2024-09-21T12:20:52.881 INFO:tasks.workunit.client.0.smithi003.stdout:6/927: mknod d4/d11/d32/da8/c13e 0 2024-09-21T12:20:52.886 INFO:tasks.workunit.client.0.smithi003.stdout:1/832: mknod d4/d11/d14/d78/dae/c123 0 2024-09-21T12:20:52.891 INFO:tasks.workunit.client.0.smithi003.stdout:9/860: mknod d2/d20/d22/c130 0 2024-09-21T12:20:52.892 INFO:tasks.workunit.client.0.smithi003.stdout:9/861: readlink d2/d20/d42/l69 0 2024-09-21T12:20:52.893 INFO:tasks.workunit.client.0.smithi003.stdout:9/862: read - d2/d20/d22/d3f/d109/f10c zero size 2024-09-21T12:20:52.895 INFO:tasks.workunit.client.0.smithi003.stdout:6/928: mknod d4/d11/d32/da8/c13f 0 2024-09-21T12:20:52.900 INFO:tasks.workunit.client.0.smithi003.stdout:0/902: truncate d9/d6c/d26/d54/f6f 1657663 0 2024-09-21T12:20:52.902 INFO:tasks.workunit.client.0.smithi003.stdout:9/863: mknod d2/da0/db3/c131 0 2024-09-21T12:20:52.902 INFO:tasks.workunit.client.0.smithi003.stdout:9/864: chown d2/d20/d22/d3f/dfd 1656 1 2024-09-21T12:20:52.905 INFO:tasks.workunit.client.0.smithi003.stdout:1/833: truncate d4/df/d41/f60 704369 0 2024-09-21T12:20:52.910 INFO:tasks.workunit.client.0.smithi003.stdout:0/903: mkdir d9/d6c/d26/d54/d7e/dde/d106/d107/dff/d143 0 2024-09-21T12:20:52.913 INFO:tasks.workunit.client.0.smithi003.stdout:9/865: dread d2/da/f11c [0,4194304] 0 2024-09-21T12:20:52.913 INFO:tasks.workunit.client.0.smithi003.stdout:6/929: rmdir d4/d11/dc1/d64 39 2024-09-21T12:20:52.943 INFO:tasks.workunit.client.0.smithi003.stdout:2/673: rename d0/dd/d22/d68/f7a to d0/d21/d2f/d50/fe9 0 2024-09-21T12:20:52.947 INFO:tasks.workunit.client.0.smithi003.stdout:1/834: rename d4/d11/d14/d78/f10d to d4/d66/f124 0 2024-09-21T12:20:52.948 INFO:tasks.workunit.client.0.smithi003.stdout:1/835: write d4/d11/df6/f115 [432245,73852] 0 2024-09-21T12:20:52.950 INFO:tasks.workunit.client.0.smithi003.stdout:2/674: mkdir d0/d1c/dea 0 2024-09-21T12:20:52.952 INFO:tasks.workunit.client.0.smithi003.stdout:0/904: rename d9/d12/c50 to d9/d12/d17/d38/d3a/d46/d55/db0/c144 0 2024-09-21T12:20:52.953 INFO:tasks.workunit.client.0.smithi003.stdout:0/905: readlink d9/d6c/l6b 0 2024-09-21T12:20:52.954 INFO:tasks.workunit.client.0.smithi003.stdout:2/675: fdatasync d0/d21/f81 0 2024-09-21T12:20:52.954 INFO:tasks.workunit.client.0.smithi003.stdout:1/836: truncate d4/d11/d14/d25/d42/d63/fa9 587751 0 2024-09-21T12:20:52.956 INFO:tasks.workunit.client.0.smithi003.stdout:0/906: stat d9/d12/d17/d38/d47/c110 0 2024-09-21T12:20:52.957 INFO:tasks.workunit.client.0.smithi003.stdout:1/837: truncate d4/d11/d14/d25/d59/f82 945048 0 2024-09-21T12:20:52.958 INFO:tasks.workunit.client.0.smithi003.stdout:2/676: dread d0/f1d [0,4194304] 0 2024-09-21T12:20:52.959 INFO:tasks.workunit.client.0.smithi003.stdout:0/907: creat d9/d6c/d26/d54/d88/f145 x:0 0 0 2024-09-21T12:20:52.963 INFO:tasks.workunit.client.0.smithi003.stdout:1/838: creat d4/df/d41/f125 x:0 0 0 2024-09-21T12:20:52.964 INFO:tasks.workunit.client.0.smithi003.stdout:7/724: truncate d8/db/d13/f3a 3480566 0 2024-09-21T12:20:52.965 INFO:tasks.workunit.client.0.smithi003.stdout:2/677: creat d0/d1c/feb x:0 0 0 2024-09-21T12:20:52.965 INFO:tasks.workunit.client.0.smithi003.stdout:0/908: fdatasync d9/d12/d17/d21/d30/d4d/d11d/f10c 0 2024-09-21T12:20:52.973 INFO:tasks.workunit.client.0.smithi003.stdout:7/725: dwrite d8/db/d13/d75/fb5 [0,4194304] 0 2024-09-21T12:20:52.977 INFO:tasks.workunit.client.0.smithi003.stdout:2/678: rename d0/dd/d22/d37/f73 to d0/dd/d22/fec 0 2024-09-21T12:20:52.986 INFO:tasks.workunit.client.0.smithi003.stdout:6/930: write d4/d11/d1d/d36/dae/fbd [34610,23851] 0 2024-09-21T12:20:52.988 INFO:tasks.workunit.client.0.smithi003.stdout:6/931: dread - d4/d13/d22/dc3/f11c zero size 2024-09-21T12:20:52.989 INFO:tasks.workunit.client.0.smithi003.stdout:1/839: dread d4/d11/db1/fda [0,4194304] 0 2024-09-21T12:20:52.991 INFO:tasks.workunit.client.0.smithi003.stdout:6/932: fsync d4/d11/d32/f104 0 2024-09-21T12:20:52.995 INFO:tasks.workunit.client.0.smithi003.stdout:6/933: mkdir d4/d9/d79/d140 0 2024-09-21T12:20:52.997 INFO:tasks.workunit.client.0.smithi003.stdout:1/840: dwrite d4/d11/d14/d78/f11d [0,4194304] 0 2024-09-21T12:20:53.001 INFO:tasks.workunit.client.0.smithi003.stdout:1/841: creat d4/d11/d14/d25/d107/d80/f126 x:0 0 0 2024-09-21T12:20:53.008 INFO:tasks.workunit.client.0.smithi003.stdout:1/842: dwrite d4/d11/d14/f62 [0,4194304] 0 2024-09-21T12:20:53.011 INFO:tasks.workunit.client.0.smithi003.stdout:1/843: creat d4/df/d19/d8a/f127 x:0 0 0 2024-09-21T12:20:53.020 INFO:tasks.workunit.client.0.smithi003.stdout:1/844: dwrite d4/d11/d14/d78/f9c [0,4194304] 0 2024-09-21T12:20:53.029 INFO:tasks.workunit.client.0.smithi003.stdout:1/845: dwrite d4/f30 [4194304,4194304] 0 2024-09-21T12:20:53.032 INFO:tasks.workunit.client.0.smithi003.stdout:1/846: creat d4/df/d12/f128 x:0 0 0 2024-09-21T12:20:53.045 INFO:tasks.workunit.client.0.smithi003.stdout:1/847: link d4/df/d12/fc3 d4/d11/d14/d78/dae/f129 0 2024-09-21T12:20:53.046 INFO:tasks.workunit.client.0.smithi003.stdout:0/909: write d9/d12/f13 [4687234,45795] 0 2024-09-21T12:20:53.053 INFO:tasks.workunit.client.0.smithi003.stdout:0/910: getdents d9/d12/d17/d38/d3a/d46/d55/d7b/da0/d12c 0 2024-09-21T12:20:53.054 INFO:tasks.workunit.client.0.smithi003.stdout:0/911: stat d9/d12/d17/d38/d3a/d46/d55/d57 0 2024-09-21T12:20:53.055 INFO:tasks.workunit.client.0.smithi003.stdout:2/679: write d0/d21/d2f/fac [3980,20998] 0 2024-09-21T12:20:53.056 INFO:tasks.workunit.client.0.smithi003.stdout:0/912: mkdir d9/d12/d17/d21/d30/d4d/d146 0 2024-09-21T12:20:53.060 INFO:tasks.workunit.client.0.smithi003.stdout:0/913: unlink d9/d12/d17/d21/cd6 0 2024-09-21T12:20:53.060 INFO:tasks.workunit.client.0.smithi003.stdout:0/914: stat d9/d12/d17/d38/fc1 0 2024-09-21T12:20:53.072 INFO:tasks.workunit.client.0.smithi003.stdout:6/934: dwrite d4/d13/d19/d23/f4d [4194304,4194304] 0 2024-09-21T12:20:53.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:52 smithi003 ceph-mon[28057]: from='client.24455 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:20:53.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:52 smithi003 ceph-mon[28057]: from='client.14722 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:20:53.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:52 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/1369538308' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:20:53.089 INFO:tasks.workunit.client.0.smithi003.stdout:1/848: write d4/fa [3306913,128773] 0 2024-09-21T12:20:53.094 INFO:tasks.workunit.client.0.smithi003.stdout:6/935: rename d4/d11/d1d/f43 to d4/d13/d22/f141 0 2024-09-21T12:20:53.097 INFO:tasks.workunit.client.0.smithi003.stdout:0/915: link d9/d12/d1e/d108/l5d d9/d12/d101/d135/l147 0 2024-09-21T12:20:53.100 INFO:tasks.workunit.client.0.smithi003.stdout:6/936: creat d4/d13/d2e/f142 x:0 0 0 2024-09-21T12:20:53.101 INFO:tasks.workunit.client.0.smithi003.stdout:0/916: rmdir d9/d12 39 2024-09-21T12:20:53.104 INFO:tasks.workunit.client.0.smithi003.stdout:6/937: mknod d4/d13/d5b/d126/c143 0 2024-09-21T12:20:53.107 INFO:tasks.workunit.client.0.smithi003.stdout:6/938: truncate d4/d13/d19/d38/f10d 1012456 0 2024-09-21T12:20:53.109 INFO:tasks.workunit.client.0.smithi003.stdout:2/680: dwrite d0/d21/d30/f93 [0,4194304] 0 2024-09-21T12:20:53.112 INFO:tasks.workunit.client.0.smithi003.stdout:6/939: creat d4/d11/dc1/d98/f144 x:0 0 0 2024-09-21T12:20:53.113 INFO:tasks.workunit.client.0.smithi003.stdout:2/681: fsync d0/d21/d2f/d50/dc4/f9b 0 2024-09-21T12:20:53.123 INFO:tasks.workunit.client.0.smithi003.stdout:2/682: getdents d0/d46/dcd 0 2024-09-21T12:20:53.124 INFO:tasks.workunit.client.0.smithi003.stdout:2/683: fdatasync d0/d1c/d6a/fad 0 2024-09-21T12:20:53.134 INFO:tasks.workunit.client.0.smithi003.stdout:2/684: getdents d0/d1c/d6a 0 2024-09-21T12:20:53.140 INFO:tasks.workunit.client.0.smithi003.stdout:2/685: creat d0/d21/d2f/d50/fed x:0 0 0 2024-09-21T12:20:53.151 INFO:tasks.workunit.client.0.smithi003.stdout:2/686: rename d0/dd/d22/d37/f74 to d0/d21/d2f/d50/dc4/fee 0 2024-09-21T12:20:53.164 INFO:tasks.workunit.client.0.smithi003.stdout:1/849: write d4/df/d12/fd0 [601253,101026] 0 2024-09-21T12:20:53.166 INFO:tasks.workunit.client.0.smithi003.stdout:1/850: truncate d4/df/f74 5567286 0 2024-09-21T12:20:53.169 INFO:tasks.workunit.client.0.smithi003.stdout:1/851: creat d4/d11/d49/f12a x:0 0 0 2024-09-21T12:20:53.169 INFO:tasks.workunit.client.0.smithi003.stdout:1/852: chown d4/df/d19/ffa 919302 1 2024-09-21T12:20:53.170 INFO:tasks.workunit.client.0.smithi003.stdout:1/853: chown d4/d11/fbe 179909674 1 2024-09-21T12:20:53.173 INFO:tasks.workunit.client.0.smithi003.stdout:1/854: rename d4/d11/df6/lfc to d4/df/d12/l12b 0 2024-09-21T12:20:53.173 INFO:tasks.workunit.client.0.smithi003.stdout:0/917: write d9/d12/d17/d38/d47/fe8 [964423,64490] 0 2024-09-21T12:20:53.174 INFO:tasks.workunit.client.0.smithi003.stdout:1/855: truncate d4/df/fcd 877611 0 2024-09-21T12:20:53.176 INFO:tasks.workunit.client.0.smithi003.stdout:1/856: write d4/d11/d14/d25/d42/f89 [2619631,51026] 0 2024-09-21T12:20:53.178 INFO:tasks.workunit.client.0.smithi003.stdout:1/857: write d4/d11/d14/d25/d42/d63/fe0 [1028989,98388] 0 2024-09-21T12:20:53.179 INFO:tasks.workunit.client.0.smithi003.stdout:0/918: rename d9/d12/d17/d38/c49 to d9/d12/d1e/d5f/d8a/d125/c148 0 2024-09-21T12:20:53.179 INFO:tasks.workunit.client.0.smithi003.stdout:1/858: dread - d4/d11/d49/f12a zero size 2024-09-21T12:20:53.184 INFO:tasks.workunit.client.0.smithi003.stdout:0/919: read d9/d6c/d26/d54/f6f [864901,45345] 0 2024-09-21T12:20:53.187 INFO:tasks.workunit.client.0.smithi003.stdout:0/920: mknod d9/d12/d17/c149 0 2024-09-21T12:20:53.190 INFO:tasks.workunit.client.0.smithi003.stdout:1/859: getdents d4/df/d19 0 2024-09-21T12:20:53.190 INFO:tasks.workunit.client.0.smithi003.stdout:0/921: stat d9/f59 0 2024-09-21T12:20:53.191 INFO:tasks.workunit.client.0.smithi003.stdout:1/860: stat d4/df/d19/d8a/cb7 0 2024-09-21T12:20:53.192 INFO:tasks.workunit.client.0.smithi003.stdout:1/861: write d4/d66/dc7/dce/f121 [67076,26494] 0 2024-09-21T12:20:53.194 INFO:tasks.workunit.client.0.smithi003.stdout:0/922: creat d9/d12/d17/d38/d123/f14a x:0 0 0 2024-09-21T12:20:53.197 INFO:tasks.workunit.client.0.smithi003.stdout:0/923: unlink d9/d12/d17/c149 0 2024-09-21T12:20:53.198 INFO:tasks.workunit.client.0.smithi003.stdout:0/924: dread - d9/d6c/d66/fae zero size 2024-09-21T12:20:53.200 INFO:tasks.workunit.client.0.smithi003.stdout:0/925: mkdir d9/d6c/d26/d54/d7e/dde/d106/d14b 0 2024-09-21T12:20:53.201 INFO:tasks.workunit.client.0.smithi003.stdout:0/926: write d9/d12/d17/d38/d3a/d46/d55/d7b/f96 [1706064,46243] 0 2024-09-21T12:20:53.213 INFO:tasks.workunit.client.0.smithi003.stdout:1/862: write d4/d11/d14/d25/d107/fd2 [1101108,64389] 0 2024-09-21T12:20:53.217 INFO:tasks.workunit.client.0.smithi003.stdout:1/863: dread d4/d11/d14/f62 [0,4194304] 0 2024-09-21T12:20:53.218 INFO:tasks.workunit.client.0.smithi003.stdout:0/927: write d9/d12/d17/d21/f9f [2188553,17773] 0 2024-09-21T12:20:53.220 INFO:tasks.workunit.client.0.smithi003.stdout:0/928: dread - d9/d12/d17/d38/d47/f10f zero size 2024-09-21T12:20:53.220 INFO:tasks.workunit.client.0.smithi003.stdout:0/929: chown d9/d12 124624 1 2024-09-21T12:20:53.223 INFO:tasks.workunit.client.0.smithi003.stdout:1/864: creat d4/d11/d14/d25/f12c x:0 0 0 2024-09-21T12:20:53.225 INFO:tasks.workunit.client.0.smithi003.stdout:1/865: truncate d4/d66/f124 1000034 0 2024-09-21T12:20:53.227 INFO:tasks.workunit.client.0.smithi003.stdout:0/930: dwrite d9/d12/d1e/d108/d2d/f10e [4194304,4194304] 0 2024-09-21T12:20:53.228 INFO:tasks.workunit.client.0.smithi003.stdout:1/866: mknod d4/d11/db1/c12d 0 2024-09-21T12:20:53.236 INFO:tasks.workunit.client.0.smithi003.stdout:1/867: write d4/fbf [420874,129979] 0 2024-09-21T12:20:53.253 INFO:tasks.workunit.client.0.smithi003.stdout:0/931: dread d9/d12/d17/d21/f42 [0,4194304] 0 2024-09-21T12:20:53.255 INFO:tasks.workunit.client.0.smithi003.stdout:0/932: write d9/d12/d1e/d108/f29 [520422,861] 0 2024-09-21T12:20:53.255 INFO:tasks.workunit.client.0.smithi003.stdout:1/868: dread d4/df/d41/f7f [0,4194304] 0 2024-09-21T12:20:53.256 INFO:tasks.workunit.client.0.smithi003.stdout:1/869: chown d4/d11/db1/cb4 1 1 2024-09-21T12:20:53.257 INFO:tasks.workunit.client.0.smithi003.stdout:1/870: chown d4/d11/d49/fcb 584502 1 2024-09-21T12:20:53.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:52 smithi192 ceph-mon[35641]: from='client.24455 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:20:53.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:52 smithi192 ceph-mon[35641]: from='client.14722 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:20:53.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:52 smithi192 ceph-mon[35641]: from='client.? 172.21.15.3:0/1369538308' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:20:53.264 INFO:tasks.workunit.client.0.smithi003.stdout:1/871: dwrite d4/fbf [0,4194304] 0 2024-09-21T12:20:53.268 INFO:tasks.workunit.client.0.smithi003.stdout:1/872: write d4/d11/d14/fb9 [886572,43201] 0 2024-09-21T12:20:53.270 INFO:tasks.workunit.client.0.smithi003.stdout:1/873: write d4/df/d41/f54 [3730272,37387] 0 2024-09-21T12:20:53.274 INFO:tasks.workunit.client.0.smithi003.stdout:0/933: dwrite d9/d12/d17/fe3 [0,4194304] 0 2024-09-21T12:20:53.277 INFO:tasks.workunit.client.0.smithi003.stdout:0/934: creat d9/d12/de7/f14c x:0 0 0 2024-09-21T12:20:53.281 INFO:tasks.workunit.client.0.smithi003.stdout:0/935: dread d9/fb [4194304,4194304] 0 2024-09-21T12:20:53.284 INFO:tasks.workunit.client.0.smithi003.stdout:0/936: symlink d9/d12/d17/d38/d47/l14d 0 2024-09-21T12:20:53.287 INFO:tasks.workunit.client.0.smithi003.stdout:1/874: dwrite d4/df/f5d [0,4194304] 0 2024-09-21T12:20:53.290 INFO:tasks.workunit.client.0.smithi003.stdout:1/875: mknod d4/d66/dc7/c12e 0 2024-09-21T12:20:53.292 INFO:tasks.workunit.client.0.smithi003.stdout:1/876: unlink d4/df/fd7 0 2024-09-21T12:20:53.293 INFO:tasks.workunit.client.0.smithi003.stdout:1/877: creat d4/d66/dc7/f12f x:0 0 0 2024-09-21T12:20:53.295 INFO:tasks.workunit.client.0.smithi003.stdout:1/878: write d4/df/d19/d8a/f127 [137649,124703] 0 2024-09-21T12:20:53.306 INFO:tasks.workunit.client.0.smithi003.stdout:1/879: link d4/d11/d14/d25/d42/d63/fa9 d4/d11/df6/f130 0 2024-09-21T12:20:53.308 INFO:tasks.workunit.client.0.smithi003.stdout:1/880: read d4/d11/d14/d25/d42/d63/fcf [3473274,120596] 0 2024-09-21T12:20:53.308 INFO:tasks.workunit.client.0.smithi003.stdout:1/881: readlink d4/df/d41/l96 0 2024-09-21T12:20:53.309 INFO:tasks.workunit.client.0.smithi003.stdout:1/882: chown d4/d11/d14/d78/f9c 1426448 1 2024-09-21T12:20:53.315 INFO:tasks.workunit.client.0.smithi003.stdout:1/883: creat d4/d11/f131 x:0 0 0 2024-09-21T12:20:53.326 INFO:tasks.workunit.client.0.smithi003.stdout:1/884: dread d4/d11/d14/d25/d42/d7b/fb5 [0,4194304] 0 2024-09-21T12:20:53.327 INFO:tasks.workunit.client.0.smithi003.stdout:1/885: readlink d4/d11/d49/l11c 0 2024-09-21T12:20:53.343 INFO:tasks.workunit.client.0.smithi003.stdout:1/886: dwrite d4/d11/d14/d25/d42/d63/fa9 [0,4194304] 0 2024-09-21T12:20:53.349 INFO:tasks.workunit.client.0.smithi003.stdout:1/887: creat d4/f132 x:0 0 0 2024-09-21T12:20:53.352 INFO:tasks.workunit.client.0.smithi003.stdout:1/888: mknod d4/d11/db1/c133 0 2024-09-21T12:20:53.353 INFO:tasks.workunit.client.0.smithi003.stdout:1/889: chown d4/d11/d14/d25/d107/d80/f83 7160 1 2024-09-21T12:20:53.362 INFO:tasks.workunit.client.0.smithi003.stdout:1/890: truncate d4/d11/d14/d25/d42/d63/fe0 724091 0 2024-09-21T12:20:53.375 INFO:tasks.workunit.client.0.smithi003.stdout:1/891: truncate d4/d11/d14/d25/d107/fcc 2295740 0 2024-09-21T12:20:53.376 INFO:tasks.workunit.client.0.smithi003.stdout:1/892: rmdir d4 39 2024-09-21T12:20:53.385 INFO:tasks.workunit.client.0.smithi003.stdout:1/893: dwrite d4/d11/f50 [0,4194304] 0 2024-09-21T12:20:53.387 INFO:tasks.workunit.client.0.smithi003.stdout:1/894: write d4/d11/d14/d25/d59/f82 [71360,4622] 0 2024-09-21T12:20:53.393 INFO:tasks.workunit.client.0.smithi003.stdout:1/895: mknod d4/df/d12/c134 0 2024-09-21T12:20:53.394 INFO:tasks.workunit.client.0.smithi003.stdout:1/896: read - d4/df/fe7 zero size 2024-09-21T12:20:53.395 INFO:tasks.workunit.client.0.smithi003.stdout:1/897: chown d4/df/f5d 3 1 2024-09-21T12:20:53.397 INFO:tasks.workunit.client.0.smithi003.stdout:1/898: write d4/d11/d14/d25/d59/fac [779336,100526] 0 2024-09-21T12:20:53.399 INFO:tasks.workunit.client.0.smithi003.stdout:1/899: creat d4/d66/f135 x:0 0 0 2024-09-21T12:20:53.399 INFO:tasks.workunit.client.0.smithi003.stdout:1/900: fdatasync d4/d66/f84 0 2024-09-21T12:20:53.403 INFO:tasks.workunit.client.0.smithi003.stdout:1/901: link d4/df/d41/c76 d4/df/d12/c136 0 2024-09-21T12:20:53.404 INFO:tasks.workunit.client.0.smithi003.stdout:1/902: mknod d4/d11/d14/d78/dae/c137 0 2024-09-21T12:20:53.412 INFO:tasks.workunit.client.0.smithi003.stdout:1/903: dwrite d4/df/d41/d103/f110 [0,4194304] 0 2024-09-21T12:20:53.783 INFO:tasks.workunit.client.0.smithi003.stdout:5/934: sync 2024-09-21T12:20:53.788 INFO:tasks.workunit.client.0.smithi003.stdout:5/935: fsync dc/fc3 0 2024-09-21T12:20:53.793 INFO:tasks.workunit.client.0.smithi003.stdout:5/936: mkdir dc/dd7/d41/d5b/d74/d7f/d12c 0 2024-09-21T12:20:53.794 INFO:tasks.workunit.client.0.smithi003.stdout:5/937: write dc/dd7/d3c/f91 [4101685,128864] 0 2024-09-21T12:20:53.799 INFO:tasks.workunit.client.0.smithi003.stdout:5/938: rmdir dc/dd7/ddc 39 2024-09-21T12:20:53.804 INFO:tasks.workunit.client.0.smithi003.stdout:5/939: mkdir dc/dd7/d41/d12d 0 2024-09-21T12:20:53.809 INFO:tasks.workunit.client.0.smithi003.stdout:5/940: rename dc/l12 to dc/dd7/d41/d9f/dde/l12e 0 2024-09-21T12:20:53.809 INFO:tasks.workunit.client.0.smithi003.stdout:5/941: fsync dc/d15/d26/f123 0 2024-09-21T12:20:53.810 INFO:tasks.workunit.client.0.smithi003.stdout:5/942: readlink dc/dd7/d3c/l6c 0 2024-09-21T12:20:53.822 INFO:tasks.workunit.client.0.smithi003.stdout:3/844: sync 2024-09-21T12:20:53.822 INFO:tasks.workunit.client.0.smithi003.stdout:4/686: sync 2024-09-21T12:20:53.823 INFO:tasks.workunit.client.0.smithi003.stdout:8/865: sync 2024-09-21T12:20:53.824 INFO:tasks.workunit.client.0.smithi003.stdout:4/687: fsync d9/d16/d65/d97/faf 0 2024-09-21T12:20:53.829 INFO:tasks.workunit.client.0.smithi003.stdout:3/845: dwrite d0/d5/da/d28/d31/d6b/fef [0,4194304] 0 2024-09-21T12:20:53.830 INFO:tasks.workunit.client.0.smithi003.stdout:3/846: chown d0/d5/da/d28/d11/d49/d4c/d54 73106811 1 2024-09-21T12:20:53.839 INFO:tasks.workunit.client.0.smithi003.stdout:4/688: dread d9/fc [0,4194304] 0 2024-09-21T12:20:53.897 INFO:tasks.workunit.client.0.smithi003.stdout:8/866: link d7/df/f26 d7/df/d20/d21/f12d 0 2024-09-21T12:20:53.898 INFO:tasks.workunit.client.0.smithi003.stdout:8/867: stat d7/df/d20/d24/d47/fcd 0 2024-09-21T12:20:53.902 INFO:tasks.workunit.client.0.smithi003.stdout:3/847: creat d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/de3/d104/f117 x:0 0 0 2024-09-21T12:20:53.907 INFO:tasks.workunit.client.0.smithi003.stdout:3/848: mknod d0/d5/da/d28/d11/d49/d4c/d54/d5e/dd2/c118 0 2024-09-21T12:20:53.912 INFO:tasks.workunit.client.0.smithi003.stdout:3/849: mkdir d0/d5/da/d28/d11/d49/d4c/d6f/d91/d119 0 2024-09-21T12:20:53.912 INFO:tasks.workunit.client.0.smithi003.stdout:4/689: dwrite d9/d16/d65/d97/faf [0,4194304] 0 2024-09-21T12:20:53.916 INFO:tasks.workunit.client.0.smithi003.stdout:4/690: chown d9/da/d66/d67/dcd/dd8/d72/l52 799 1 2024-09-21T12:20:53.917 INFO:tasks.workunit.client.0.smithi003.stdout:8/868: dwrite d7/f65 [0,4194304] 0 2024-09-21T12:20:53.919 INFO:tasks.workunit.client.0.smithi003.stdout:3/850: symlink d0/d5/da/d28/d11/d96/de2/l11a 0 2024-09-21T12:20:53.926 INFO:tasks.workunit.client.0.smithi003.stdout:8/869: dwrite d7/df/d20/d21/f8b [0,4194304] 0 2024-09-21T12:20:53.928 INFO:tasks.workunit.client.0.smithi003.stdout:3/851: getdents d0/d5/da/d28/d11/d49/d4c 0 2024-09-21T12:20:53.932 INFO:tasks.workunit.client.0.smithi003.stdout:8/870: creat d7/df/d20/d21/d4c/d4d/f12e x:0 0 0 2024-09-21T12:20:53.933 INFO:tasks.workunit.client.0.smithi003.stdout:7/726: sync 2024-09-21T12:20:53.933 INFO:tasks.workunit.client.0.smithi003.stdout:6/940: sync 2024-09-21T12:20:53.933 INFO:tasks.workunit.client.0.smithi003.stdout:9/866: sync 2024-09-21T12:20:53.936 INFO:tasks.workunit.client.0.smithi003.stdout:9/867: mkdir d2/d53/d75/d132 0 2024-09-21T12:20:53.937 INFO:tasks.workunit.client.0.smithi003.stdout:3/852: symlink d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/d42/d6d/d86/l11b 0 2024-09-21T12:20:53.939 INFO:tasks.workunit.client.0.smithi003.stdout:9/868: chown d2/d20/d22/d3f/dfd/c120 299 1 2024-09-21T12:20:53.943 INFO:tasks.workunit.client.0.smithi003.stdout:9/869: mknod d2/da/d2a/c133 0 2024-09-21T12:20:53.944 INFO:tasks.workunit.client.0.smithi003.stdout:3/853: mkdir d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/d11c 0 2024-09-21T12:20:53.946 INFO:tasks.workunit.client.0.smithi003.stdout:7/727: getdents d8/d3c 0 2024-09-21T12:20:53.947 INFO:tasks.workunit.client.0.smithi003.stdout:6/941: dwrite d4/fa [0,4194304] 0 2024-09-21T12:20:53.954 INFO:tasks.workunit.client.0.smithi003.stdout:3/854: dread d0/d5/f36 [0,4194304] 0 2024-09-21T12:20:53.954 INFO:tasks.workunit.client.0.smithi003.stdout:9/870: dwrite d2/da/d17/f8e [0,4194304] 0 2024-09-21T12:20:53.956 INFO:tasks.workunit.client.0.smithi003.stdout:3/855: stat d0/d5/da/d28/dd/f2e 0 2024-09-21T12:20:53.959 INFO:tasks.workunit.client.0.smithi003.stdout:6/942: link d4/d100/f101 d4/d11/d1d/f145 0 2024-09-21T12:20:53.962 INFO:tasks.workunit.client.0.smithi003.stdout:7/728: write d8/d93/fc1 [1248891,75994] 0 2024-09-21T12:20:53.967 INFO:tasks.workunit.client.0.smithi003.stdout:6/943: mkdir d4/d11/d32/d129/d146 0 2024-09-21T12:20:53.969 INFO:tasks.workunit.client.0.smithi003.stdout:6/944: truncate d4/d13/d22/dc3/f127 483380 0 2024-09-21T12:20:53.970 INFO:tasks.workunit.client.0.smithi003.stdout:7/729: rmdir d8/db/d13/d75/da6 0 2024-09-21T12:20:53.973 INFO:tasks.workunit.client.0.smithi003.stdout:8/871: dread d7/df/d20/f35 [0,4194304] 0 2024-09-21T12:20:53.974 INFO:tasks.workunit.client.0.smithi003.stdout:8/872: chown d7/df/d20/d21/d4c/d4d/d8c 0 1 2024-09-21T12:20:53.974 INFO:tasks.workunit.client.0.smithi003.stdout:9/871: truncate d2/da/f3b 3422098 0 2024-09-21T12:20:53.977 INFO:tasks.workunit.client.0.smithi003.stdout:7/730: rename d8/db/d32/d43/d7e/dad/db2 to d8/d3c/d64/df0 0 2024-09-21T12:20:53.982 INFO:tasks.workunit.client.0.smithi003.stdout:9/872: dwrite d2/da/d35/d76/d94/d10b/f10f [0,4194304] 0 2024-09-21T12:20:53.982 INFO:tasks.workunit.client.0.smithi003.stdout:6/945: getdents d4/d13/d19 0 2024-09-21T12:20:53.982 INFO:tasks.workunit.client.0.smithi003.stdout:7/731: mknod d8/db/d32/cf1 0 2024-09-21T12:20:53.984 INFO:tasks.workunit.client.0.smithi003.stdout:7/732: chown d8/d3c/d57/d9e/cc6 0 1 2024-09-21T12:20:53.987 INFO:tasks.workunit.client.0.smithi003.stdout:8/873: rename d7/de/d1a/ca3 to d7/df/d20/d24/d47/df3/d11d/d122/c12f 0 2024-09-21T12:20:53.988 INFO:tasks.workunit.client.0.smithi003.stdout:6/946: dread d4/d13/d19/d38/fab [4194304,4194304] 0 2024-09-21T12:20:54.003 INFO:tasks.workunit.client.0.smithi003.stdout:6/947: write d4/d13/d63/f72 [780313,107315] 0 2024-09-21T12:20:54.004 INFO:tasks.workunit.client.0.smithi003.stdout:6/948: chown d4/d9/l103 9139 1 2024-09-21T12:20:54.005 INFO:tasks.workunit.client.0.smithi003.stdout:9/873: dread d2/d53/d75/fbd [0,4194304] 0 2024-09-21T12:20:54.005 INFO:tasks.workunit.client.0.smithi003.stdout:8/874: link d7/df/d20/d24/c72 d7/df/d20/d24/d47/df3/d11d/d122/c130 0 2024-09-21T12:20:54.007 INFO:tasks.workunit.client.0.smithi003.stdout:7/733: getdents d8/db/d13/d60 0 2024-09-21T12:20:54.008 INFO:tasks.workunit.client.0.smithi003.stdout:6/949: mknod d4/d13/d2e/de3/c147 0 2024-09-21T12:20:54.009 INFO:tasks.workunit.client.0.smithi003.stdout:7/734: chown d8/db/f58 91 1 2024-09-21T12:20:54.009 INFO:tasks.workunit.client.0.smithi003.stdout:9/874: chown d2/da/d2a/d3c/da2/daf/f7b 307281 1 2024-09-21T12:20:54.010 INFO:tasks.workunit.client.0.smithi003.stdout:9/875: chown d2/da/d17/c1d 5 1 2024-09-21T12:20:54.010 INFO:tasks.workunit.client.0.smithi003.stdout:8/875: creat d7/d57/d77/da5/dd4/f131 x:0 0 0 2024-09-21T12:20:54.011 INFO:tasks.workunit.client.0.smithi003.stdout:9/876: dread - d2/da/d35/d76/fe7 zero size 2024-09-21T12:20:54.011 INFO:tasks.workunit.client.0.smithi003.stdout:6/950: rmdir d4/d11 39 2024-09-21T12:20:54.012 INFO:tasks.workunit.client.0.smithi003.stdout:7/735: creat d8/db/d13/d96/db8/dc4/ff2 x:0 0 0 2024-09-21T12:20:54.014 INFO:tasks.workunit.client.0.smithi003.stdout:8/876: mknod d7/c132 0 2024-09-21T12:20:54.015 INFO:tasks.workunit.client.0.smithi003.stdout:8/877: chown d7/d57/d77/da5/dd4/dfa/d119 6 1 2024-09-21T12:20:54.016 INFO:tasks.workunit.client.0.smithi003.stdout:7/736: unlink d8/db/d32/d43/d7e/c99 0 2024-09-21T12:20:54.016 INFO:tasks.workunit.client.0.smithi003.stdout:6/951: mknod d4/d11/d1d/db9/d108/c148 0 2024-09-21T12:20:54.029 INFO:tasks.workunit.client.0.smithi003.stdout:8/878: write d7/df/d20/d54/f8e [163400,77549] 0 2024-09-21T12:20:54.033 INFO:tasks.workunit.client.0.smithi003.stdout:6/952: dwrite d4/d9/d59/dba/ffc [0,4194304] 0 2024-09-21T12:20:54.035 INFO:tasks.workunit.client.0.smithi003.stdout:6/953: dread - d4/d13/d2e/de3/df6/f110 zero size 2024-09-21T12:20:54.040 INFO:tasks.workunit.client.0.smithi003.stdout:6/954: fsync d4/d9/f15 0 2024-09-21T12:20:54.052 INFO:tasks.workunit.client.0.smithi003.stdout:8/879: truncate d7/df/d16/f93 2664822 0 2024-09-21T12:20:54.060 INFO:tasks.workunit.client.0.smithi003.stdout:2/687: sync 2024-09-21T12:20:54.060 INFO:tasks.workunit.client.0.smithi003.stdout:0/937: sync 2024-09-21T12:20:54.062 INFO:tasks.workunit.client.0.smithi003.stdout:2/688: symlink d0/d1c/d6a/lef 0 2024-09-21T12:20:54.065 INFO:tasks.workunit.client.0.smithi003.stdout:6/955: dread d4/d9/fd [4194304,4194304] 0 2024-09-21T12:20:54.066 INFO:tasks.workunit.client.0.smithi003.stdout:2/689: creat d0/d21/d2c/d6c/db2/de7/ff0 x:0 0 0 2024-09-21T12:20:54.066 INFO:tasks.workunit.client.0.smithi003.stdout:2/690: chown d0/d21 79 1 2024-09-21T12:20:54.067 INFO:tasks.workunit.client.0.smithi003.stdout:6/956: creat d4/d13/d22/dc3/f149 x:0 0 0 2024-09-21T12:20:54.073 INFO:tasks.workunit.client.0.smithi003.stdout:0/938: getdents d9/d12 0 2024-09-21T12:20:54.080 INFO:tasks.workunit.client.0.smithi003.stdout:0/939: dwrite d9/d6c/fbe [0,4194304] 0 2024-09-21T12:20:54.085 INFO:tasks.workunit.client.0.smithi003.stdout:8/880: dwrite d7/df/d20/ff0 [0,4194304] 0 2024-09-21T12:20:54.116 INFO:tasks.workunit.client.0.smithi003.stdout:2/691: rmdir d0/d21/d2f/d49/db1 0 2024-09-21T12:20:54.118 INFO:tasks.workunit.client.0.smithi003.stdout:6/957: write d4/d13/fd4 [2781781,23978] 0 2024-09-21T12:20:54.120 INFO:tasks.workunit.client.0.smithi003.stdout:2/692: creat d0/d21/d2f/d50/dc4/dc7/ff1 x:0 0 0 2024-09-21T12:20:54.125 INFO:tasks.workunit.client.0.smithi003.stdout:6/958: mkdir d4/d11/d1d/db9/d14a 0 2024-09-21T12:20:54.127 INFO:tasks.workunit.client.0.smithi003.stdout:2/693: creat d0/d21/d2c/d6c/db2/dbb/ff2 x:0 0 0 2024-09-21T12:20:54.137 INFO:tasks.workunit.client.0.smithi003.stdout:0/940: dread d9/d12/d17/d21/fa7 [0,4194304] 0 2024-09-21T12:20:54.138 INFO:tasks.workunit.client.0.smithi003.stdout:0/941: write d9/d12/d17/d38/d47/f10f [1036965,107293] 0 2024-09-21T12:20:54.143 INFO:tasks.workunit.client.0.smithi003.stdout:6/959: dread d4/d13/d63/fb5 [0,4194304] 0 2024-09-21T12:20:54.144 INFO:tasks.workunit.client.0.smithi003.stdout:6/960: write d4/d100/f13b [875959,90209] 0 2024-09-21T12:20:54.150 INFO:tasks.workunit.client.0.smithi003.stdout:6/961: dwrite d4/d13/d63/f72 [0,4194304] 0 2024-09-21T12:20:54.151 INFO:tasks.workunit.client.0.smithi003.stdout:6/962: stat d4/d13/ld7 0 2024-09-21T12:20:54.153 INFO:tasks.workunit.client.0.smithi003.stdout:6/963: truncate d4/d11/d1d/db9/fc0 2884537 0 2024-09-21T12:20:54.157 INFO:tasks.workunit.client.0.smithi003.stdout:6/964: creat d4/d11/d139/f14b x:0 0 0 2024-09-21T12:20:54.158 INFO:tasks.workunit.client.0.smithi003.stdout:6/965: chown d4/d13/d19/d23/c82 46 1 2024-09-21T12:20:54.159 INFO:tasks.workunit.client.0.smithi003.stdout:6/966: readlink d4/d9/l9e 0 2024-09-21T12:20:54.159 INFO:tasks.workunit.client.0.smithi003.stdout:2/694: dread d0/dd/d22/d37/f48 [0,4194304] 0 2024-09-21T12:20:54.160 INFO:tasks.workunit.client.0.smithi003.stdout:6/967: stat d4/d11/d139 0 2024-09-21T12:20:54.162 INFO:tasks.workunit.client.0.smithi003.stdout:6/968: fsync d4/d13/d19/d38/fb3 0 2024-09-21T12:20:54.168 INFO:tasks.workunit.client.0.smithi003.stdout:2/695: link d0/d1c/d6a/dc0/le6 d0/d21/d2c/d6c/db2/de7/lf3 0 2024-09-21T12:20:54.171 INFO:tasks.workunit.client.0.smithi003.stdout:6/969: dread d4/d13/d63/fa2 [0,4194304] 0 2024-09-21T12:20:54.171 INFO:tasks.workunit.client.0.smithi003.stdout:2/696: creat d0/d1c/d6a/dc0/ff4 x:0 0 0 2024-09-21T12:20:54.175 INFO:tasks.workunit.client.0.smithi003.stdout:6/970: rename d4/d100/f13b to d4/d13/d2e/de3/f14c 0 2024-09-21T12:20:54.175 INFO:tasks.workunit.client.0.smithi003.stdout:2/697: dread d0/d21/d2c/f72 [0,4194304] 0 2024-09-21T12:20:54.176 INFO:tasks.workunit.client.0.smithi003.stdout:6/971: chown d4/d11/d32/f5f 1889276 1 2024-09-21T12:20:54.183 INFO:tasks.workunit.client.0.smithi003.stdout:6/972: dwrite d4/d11/d32/f3b [0,4194304] 0 2024-09-21T12:20:54.184 INFO:tasks.workunit.client.0.smithi003.stdout:2/698: link d0/d21/d2c/d6c/db2/de7/f8d d0/d21/d2f/d49/d83/ff5 0 2024-09-21T12:20:54.185 INFO:tasks.workunit.client.0.smithi003.stdout:6/973: write d4/d13/fd4 [5075178,74378] 0 2024-09-21T12:20:54.188 INFO:tasks.workunit.client.0.smithi003.stdout:2/699: mkdir d0/d21/d2c/d6c/db2/de7/df6 0 2024-09-21T12:20:54.188 INFO:tasks.workunit.client.0.smithi003.stdout:2/700: readlink d0/dd/d22/d68/laf 0 2024-09-21T12:20:54.190 INFO:tasks.workunit.client.0.smithi003.stdout:2/701: mkdir d0/df7 0 2024-09-21T12:20:54.193 INFO:tasks.workunit.client.0.smithi003.stdout:2/702: symlink d0/d21/d2c/d6c/db2/lf8 0 2024-09-21T12:20:54.196 INFO:tasks.workunit.client.0.smithi003.stdout:2/703: readlink d0/d21/d2f/d50/dc4/d7f/le8 0 2024-09-21T12:20:54.197 INFO:tasks.workunit.client.0.smithi003.stdout:2/704: write d0/dd/f84 [1992385,59244] 0 2024-09-21T12:20:54.201 INFO:tasks.workunit.client.0.smithi003.stdout:2/705: dread - d0/d21/f91 zero size 2024-09-21T12:20:54.203 INFO:tasks.workunit.client.0.smithi003.stdout:2/706: mkdir d0/d21/d2c/d6c/df9 0 2024-09-21T12:20:54.206 INFO:tasks.workunit.client.0.smithi003.stdout:2/707: creat d0/d21/d2f/d49/ffa x:0 0 0 2024-09-21T12:20:54.210 INFO:tasks.workunit.client.0.smithi003.stdout:2/708: mkdir d0/d21/d2f/d50/dfb 0 2024-09-21T12:20:54.211 INFO:tasks.workunit.client.0.smithi003.stdout:6/974: dwrite d4/d13/d19/d38/ffd [0,4194304] 0 2024-09-21T12:20:54.216 INFO:tasks.workunit.client.0.smithi003.stdout:2/709: link d0/d46/dcd/fdd d0/d21/d2c/d6c/db2/de7/ffc 0 2024-09-21T12:20:54.227 INFO:tasks.workunit.client.0.smithi003.stdout:2/710: getdents d0/d21/d30 0 2024-09-21T12:20:54.228 INFO:tasks.workunit.client.0.smithi003.stdout:6/975: write d4/d11/dc1/f90 [648729,56398] 0 2024-09-21T12:20:54.228 INFO:tasks.workunit.client.0.smithi003.stdout:2/711: chown d0/d21/d2f/d49/d83/ff5 1 1 2024-09-21T12:20:54.232 INFO:tasks.workunit.client.0.smithi003.stdout:6/976: mknod d4/d13/d56/d105/c14d 0 2024-09-21T12:20:54.236 INFO:tasks.workunit.client.0.smithi003.stdout:2/712: dwrite d0/dd/d22/f57 [0,4194304] 0 2024-09-21T12:20:54.238 INFO:tasks.workunit.client.0.smithi003.stdout:2/713: mkdir d0/d21/d2f/d9f/dfd 0 2024-09-21T12:20:54.240 INFO:tasks.workunit.client.0.smithi003.stdout:2/714: creat d0/d21/d2f/d9f/ffe x:0 0 0 2024-09-21T12:20:54.248 INFO:tasks.workunit.client.0.smithi003.stdout:2/715: dwrite d0/de2/ddb/fdc [0,4194304] 0 2024-09-21T12:20:54.248 INFO:tasks.workunit.client.0.smithi003.stdout:2/716: stat d0/d46 0 2024-09-21T12:20:54.249 INFO:tasks.workunit.client.0.smithi003.stdout:2/717: readlink d0/d1c/d6a/l6e 0 2024-09-21T12:20:54.251 INFO:tasks.workunit.client.0.smithi003.stdout:2/718: chown d0/dd/d22/d37/dda/d97/fdf 10838 1 2024-09-21T12:20:54.252 INFO:tasks.workunit.client.0.smithi003.stdout:6/977: write d4/d11/dc1/d64/f69 [1903340,113010] 0 2024-09-21T12:20:54.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:53 smithi192 ceph-mon[35641]: pgmap v13: 65 pgs: 65 active+clean; 3.0 GiB data, 9.1 GiB used, 527 GiB / 536 GiB avail; 44 MiB/s rd, 108 MiB/s wr, 273 op/s 2024-09-21T12:20:54.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:53 smithi192 ceph-mon[35641]: from='client.24463 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:20:54.258 INFO:tasks.workunit.client.0.smithi003.stdout:2/719: creat d0/d21/d2f/d50/dfb/fff x:0 0 0 2024-09-21T12:20:54.259 INFO:tasks.workunit.client.0.smithi003.stdout:6/978: fdatasync d4/d13/d56/d105/f125 0 2024-09-21T12:20:54.260 INFO:tasks.workunit.client.0.smithi003.stdout:2/720: mknod d0/d21/d2c/d6c/db2/c100 0 2024-09-21T12:20:54.264 INFO:tasks.workunit.client.0.smithi003.stdout:2/721: rename d0/d21/d30/fb8 to d0/d21/d2f/d50/dc4/dc7/f101 0 2024-09-21T12:20:54.266 INFO:tasks.workunit.client.0.smithi003.stdout:6/979: getdents d4/d9/d59/dba 0 2024-09-21T12:20:54.266 INFO:tasks.workunit.client.0.smithi003.stdout:2/722: fdatasync d0/d1c/d6a/f31 0 2024-09-21T12:20:54.270 INFO:tasks.workunit.client.0.smithi003.stdout:6/980: symlink d4/d11/d1d/db9/dfb/l14e 0 2024-09-21T12:20:54.274 INFO:tasks.workunit.client.0.smithi003.stdout:2/723: rename d0/d21/d2f/f8f to d0/d21/d2f/d50/dc4/d7f/daa/f102 0 2024-09-21T12:20:54.275 INFO:tasks.workunit.client.0.smithi003.stdout:2/724: truncate d0/d1c/d6a/dc0/ff4 403611 0 2024-09-21T12:20:54.276 INFO:tasks.workunit.client.0.smithi003.stdout:6/981: rename d4/d13/d2e/f142 to d4/d11/df5/f14f 0 2024-09-21T12:20:54.283 INFO:tasks.workunit.client.0.smithi003.stdout:6/982: write d4/d13/d2e/fc8 [369290,120790] 0 2024-09-21T12:20:54.284 INFO:tasks.workunit.client.0.smithi003.stdout:6/983: chown d4/d11/d32/fac 7260949 1 2024-09-21T12:20:54.287 INFO:tasks.workunit.client.0.smithi003.stdout:2/725: dwrite d0/d1c/d6a/f2a [0,4194304] 0 2024-09-21T12:20:54.289 INFO:tasks.workunit.client.0.smithi003.stdout:6/984: truncate d4/d11/d1d/db9/dfb/dfe/f11a 304198 0 2024-09-21T12:20:54.290 INFO:tasks.workunit.client.0.smithi003.stdout:6/985: chown d4/l5e 11 1 2024-09-21T12:20:54.290 INFO:tasks.workunit.client.0.smithi003.stdout:2/726: fsync d0/d1c/f2e 0 2024-09-21T12:20:54.292 INFO:tasks.workunit.client.0.smithi003.stdout:2/727: fsync d0/d1c/f2e 0 2024-09-21T12:20:54.293 INFO:tasks.workunit.client.0.smithi003.stdout:2/728: truncate d0/d1c/feb 505584 0 2024-09-21T12:20:54.298 INFO:tasks.workunit.client.0.smithi003.stdout:6/986: mkdir d4/d11/d1d/db9/d108/d11f/d121/d150 0 2024-09-21T12:20:54.301 INFO:tasks.workunit.client.0.smithi003.stdout:2/729: write d0/dd/f84 [3318722,30879] 0 2024-09-21T12:20:54.303 INFO:tasks.workunit.client.0.smithi003.stdout:6/987: creat d4/d13/d22/dc3/f151 x:0 0 0 2024-09-21T12:20:54.305 INFO:tasks.workunit.client.0.smithi003.stdout:2/730: unlink d0/d21/d2f/d50/dc4/dc7/ff1 0 2024-09-21T12:20:54.307 INFO:tasks.workunit.client.0.smithi003.stdout:6/988: mkdir d4/d11/d1d/db9/d108/d11f/d152 0 2024-09-21T12:20:54.308 INFO:tasks.workunit.client.0.smithi003.stdout:6/989: dread - d4/d11/d32/f104 zero size 2024-09-21T12:20:54.309 INFO:tasks.workunit.client.0.smithi003.stdout:2/731: mknod d0/d21/d30/c103 0 2024-09-21T12:20:54.314 INFO:tasks.workunit.client.0.smithi003.stdout:2/732: symlink d0/l104 0 2024-09-21T12:20:54.315 INFO:tasks.workunit.client.0.smithi003.stdout:2/733: read - d0/d46/dcd/fdd zero size 2024-09-21T12:20:54.321 INFO:tasks.workunit.client.0.smithi003.stdout:2/734: creat d0/d21/f105 x:0 0 0 2024-09-21T12:20:54.322 INFO:tasks.workunit.client.0.smithi003.stdout:6/990: dwrite d4/d11/dc1/d58/ff1 [0,4194304] 0 2024-09-21T12:20:54.325 INFO:tasks.workunit.client.0.smithi003.stdout:2/735: creat d0/d46/dcd/f106 x:0 0 0 2024-09-21T12:20:54.327 INFO:tasks.workunit.client.0.smithi003.stdout:2/736: dread - d0/d21/d2c/d6c/db2/de7/ffc zero size 2024-09-21T12:20:54.329 INFO:tasks.workunit.client.0.smithi003.stdout:2/737: truncate d0/dd/d22/f85 4899062 0 2024-09-21T12:20:54.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:53 smithi003 ceph-mon[28057]: pgmap v13: 65 pgs: 65 active+clean; 3.0 GiB data, 9.1 GiB used, 527 GiB / 536 GiB avail; 44 MiB/s rd, 108 MiB/s wr, 273 op/s 2024-09-21T12:20:54.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:53 smithi003 ceph-mon[28057]: from='client.24463 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:20:54.330 INFO:tasks.workunit.client.0.smithi003.stdout:2/738: mknod d0/d21/d2f/d50/dc4/d7f/daa/c107 0 2024-09-21T12:20:54.332 INFO:tasks.workunit.client.0.smithi003.stdout:2/739: creat d0/d21/d2c/d6c/db2/f108 x:0 0 0 2024-09-21T12:20:54.333 INFO:tasks.workunit.client.0.smithi003.stdout:2/740: readlink d0/d21/d30/d78/la6 0 2024-09-21T12:20:54.342 INFO:tasks.workunit.client.0.smithi003.stdout:6/991: dwrite d4/d11/d1d/db9/f124 [0,4194304] 0 2024-09-21T12:20:54.346 INFO:tasks.workunit.client.0.smithi003.stdout:2/741: dwrite d0/d1c/d6a/f19 [0,4194304] 0 2024-09-21T12:20:54.350 INFO:tasks.workunit.client.0.smithi003.stdout:2/742: mkdir d0/dd/d22/d37/dda/d109 0 2024-09-21T12:20:54.353 INFO:tasks.workunit.client.0.smithi003.stdout:6/992: write d4/d9/d59/f77 [3427606,82322] 0 2024-09-21T12:20:54.354 INFO:tasks.workunit.client.0.smithi003.stdout:2/743: fsync d0/dd/d22/d37/f48 0 2024-09-21T12:20:54.357 INFO:tasks.workunit.client.0.smithi003.stdout:6/993: rename d4/d13/d2e/l39 to d4/d11/d1d/db9/dfb/l153 0 2024-09-21T12:20:54.358 INFO:tasks.workunit.client.0.smithi003.stdout:2/744: creat d0/d21/d30/f10a x:0 0 0 2024-09-21T12:20:54.360 INFO:tasks.workunit.client.0.smithi003.stdout:2/745: rmdir d0/dd/d22 39 2024-09-21T12:20:54.367 INFO:tasks.workunit.client.0.smithi003.stdout:2/746: dread d0/dd/d22/f57 [0,4194304] 0 2024-09-21T12:20:54.368 INFO:tasks.workunit.client.0.smithi003.stdout:2/747: fdatasync d0/d21/d30/f93 0 2024-09-21T12:20:54.370 INFO:tasks.workunit.client.0.smithi003.stdout:2/748: creat d0/de2/ddb/f10b x:0 0 0 2024-09-21T12:20:54.371 INFO:tasks.workunit.client.0.smithi003.stdout:2/749: stat d0/d46/dcd/fa8 0 2024-09-21T12:20:54.373 INFO:tasks.workunit.client.0.smithi003.stdout:2/750: write d0/dd/d22/f57 [3899211,13875] 0 2024-09-21T12:20:54.377 INFO:tasks.workunit.client.0.smithi003.stdout:6/994: dwrite d4/d11/d1d/f145 [0,4194304] 0 2024-09-21T12:20:54.378 INFO:tasks.workunit.client.0.smithi003.stdout:5/943: sync 2024-09-21T12:20:54.378 INFO:tasks.workunit.client.0.smithi003.stdout:1/904: sync 2024-09-21T12:20:54.379 INFO:tasks.workunit.client.0.smithi003.stdout:1/905: dread - d4/d11/d49/f12a zero size 2024-09-21T12:20:54.384 INFO:tasks.workunit.client.0.smithi003.stdout:5/944: creat dc/dd7/d41/d5b/dab/ddd/f12f x:0 0 0 2024-09-21T12:20:54.387 INFO:tasks.workunit.client.0.smithi003.stdout:6/995: dread f3 [0,4194304] 0 2024-09-21T12:20:54.387 INFO:tasks.workunit.client.0.smithi003.stdout:1/906: rename d4/d11/d14/l20 to d4/d11/d49/daf/l138 0 2024-09-21T12:20:54.388 INFO:tasks.workunit.client.0.smithi003.stdout:6/996: fsync d4/d13/d19/d38/da3/f13d 0 2024-09-21T12:20:54.390 INFO:tasks.workunit.client.0.smithi003.stdout:6/997: chown d4/d13/d19/c55 144889 1 2024-09-21T12:20:54.391 INFO:tasks.workunit.client.0.smithi003.stdout:1/907: symlink d4/l139 0 2024-09-21T12:20:54.392 INFO:tasks.workunit.client.0.smithi003.stdout:6/998: mkdir d4/d13/d56/d154 0 2024-09-21T12:20:54.396 INFO:tasks.workunit.client.0.smithi003.stdout:5/945: write dc/d15/d21/fd5 [1093648,14879] 0 2024-09-21T12:20:54.397 INFO:tasks.workunit.client.0.smithi003.stdout:2/751: dread d0/d21/d2f/d50/fc8 [0,4194304] 0 2024-09-21T12:20:54.399 INFO:tasks.workunit.client.0.smithi003.stdout:2/752: chown d0/d21/d2c/d6c/db2/dbb/fd4 45602985 1 2024-09-21T12:20:54.400 INFO:tasks.workunit.client.0.smithi003.stdout:6/999: creat d4/d11/d1d/db9/d14a/f155 x:0 0 0 2024-09-21T12:20:54.400 INFO:tasks.workunit.client.0.smithi003.stdout:2/753: chown d0/dd/d22/d68/cc3 4 1 2024-09-21T12:20:54.403 INFO:tasks.workunit.client.0.smithi003.stdout:1/908: getdents d4/d66/dc7 0 2024-09-21T12:20:54.408 INFO:tasks.workunit.client.0.smithi003.stdout:1/909: mkdir d4/d66/d8b/d13a 0 2024-09-21T12:20:54.408 INFO:tasks.workunit.client.0.smithi003.stdout:1/910: dread - d4/f101 zero size 2024-09-21T12:20:54.409 INFO:tasks.workunit.client.0.smithi003.stdout:2/754: getdents d0/d21/d2f/d9f/dfd 0 2024-09-21T12:20:54.411 INFO:tasks.workunit.client.0.smithi003.stdout:2/755: write d0/d21/d2f/d50/dc4/d7f/f88 [4939682,24733] 0 2024-09-21T12:20:54.411 INFO:tasks.workunit.client.0.smithi003.stdout:5/946: dread dc/dd7/d41/f8a [0,4194304] 0 2024-09-21T12:20:54.413 INFO:tasks.workunit.client.0.smithi003.stdout:2/756: chown d0/d1c/d6a/l6e 32 1 2024-09-21T12:20:54.416 INFO:tasks.workunit.client.0.smithi003.stdout:1/911: dwrite d4/d11/df6/f130 [0,4194304] 0 2024-09-21T12:20:54.417 INFO:tasks.workunit.client.0.smithi003.stdout:1/912: chown d4/d11/d14/d25/d42/d63/fcf 25597 1 2024-09-21T12:20:54.421 INFO:tasks.workunit.client.0.smithi003.stdout:1/913: chown d4/d11/d14/d25/d107/fcc 2953 1 2024-09-21T12:20:54.423 INFO:tasks.workunit.client.0.smithi003.stdout:2/757: truncate d0/d21/d2f/d50/dc4/f89 1054522 0 2024-09-21T12:20:54.430 INFO:tasks.workunit.client.0.smithi003.stdout:2/758: mknod d0/d21/d2c/d6c/db2/c10c 0 2024-09-21T12:20:54.433 INFO:tasks.workunit.client.0.smithi003.stdout:5/947: getdents dc/d15 0 2024-09-21T12:20:54.434 INFO:tasks.workunit.client.0.smithi003.stdout:5/948: chown dc/dd7/d41/l62 15382 1 2024-09-21T12:20:54.438 INFO:tasks.workunit.client.0.smithi003.stdout:5/949: creat dc/dd7/d41/d5b/d101/f130 x:0 0 0 2024-09-21T12:20:54.440 INFO:tasks.workunit.client.0.smithi003.stdout:5/950: stat dc/dd7/d41/d5b/ce3 0 2024-09-21T12:20:54.442 INFO:tasks.workunit.client.0.smithi003.stdout:5/951: chown dc/dd7/d41/d9f/dde 217 1 2024-09-21T12:20:54.443 INFO:tasks.workunit.client.0.smithi003.stdout:1/914: dwrite d4/d11/d14/d25/d107/d80/f83 [0,4194304] 0 2024-09-21T12:20:54.446 INFO:tasks.workunit.client.0.smithi003.stdout:5/952: mkdir dc/dd7/d41/d5b/d74/d7f/d131 0 2024-09-21T12:20:54.447 INFO:tasks.workunit.client.0.smithi003.stdout:1/915: chown d4/d11/d14/fde 56946 1 2024-09-21T12:20:54.447 INFO:tasks.workunit.client.0.smithi003.stdout:5/953: dread - dc/d15/d26/f123 zero size 2024-09-21T12:20:54.448 INFO:tasks.workunit.client.0.smithi003.stdout:2/759: dread d0/ff [0,4194304] 0 2024-09-21T12:20:54.448 INFO:tasks.workunit.client.0.smithi003.stdout:1/916: rename d4/df/d12 to d4/df/d12/d13b 22 2024-09-21T12:20:54.449 INFO:tasks.workunit.client.0.smithi003.stdout:5/954: write dc/dd7/d41/d5b/dab/f10a [225485,17781] 0 2024-09-21T12:20:54.449 INFO:tasks.workunit.client.0.smithi003.stdout:1/917: truncate d4/f101 701375 0 2024-09-21T12:20:54.454 INFO:tasks.workunit.client.0.smithi003.stdout:1/918: write d4/d66/d8b/f11f [443999,91881] 0 2024-09-21T12:20:54.455 INFO:tasks.workunit.client.0.smithi003.stdout:2/760: truncate d0/dd/d22/d37/f48 570731 0 2024-09-21T12:20:54.456 INFO:tasks.workunit.client.0.smithi003.stdout:1/919: write d4/d11/f131 [547609,73309] 0 2024-09-21T12:20:54.457 INFO:tasks.workunit.client.0.smithi003.stdout:5/955: creat dc/dd7/d41/d9f/d104/f132 x:0 0 0 2024-09-21T12:20:54.458 INFO:tasks.workunit.client.0.smithi003.stdout:1/920: chown d4/d11/d14/d25/f12c 2564 1 2024-09-21T12:20:54.461 INFO:tasks.workunit.client.0.smithi003.stdout:2/761: mknod d0/d21/d2c/d6c/df9/c10d 0 2024-09-21T12:20:54.464 INFO:tasks.workunit.client.0.smithi003.stdout:5/956: creat dc/d15/d21/f133 x:0 0 0 2024-09-21T12:20:54.468 INFO:tasks.workunit.client.0.smithi003.stdout:1/921: write d4/d11/d14/d25/d42/f6e [281109,76366] 0 2024-09-21T12:20:54.475 INFO:tasks.workunit.client.0.smithi003.stdout:1/922: dwrite d4/df/d12/f128 [0,4194304] 0 2024-09-21T12:20:54.478 INFO:tasks.workunit.client.0.smithi003.stdout:5/957: truncate dc/dd7/d41/da0/d4b/d5c/f77 595629 0 2024-09-21T12:20:54.478 INFO:tasks.workunit.client.0.smithi003.stdout:2/762: write d0/d21/fb5 [126684,114813] 0 2024-09-21T12:20:54.483 INFO:tasks.workunit.client.0.smithi003.stdout:5/958: mkdir dc/dd7/d41/d9f/dde/d134 0 2024-09-21T12:20:54.485 INFO:tasks.workunit.client.0.smithi003.stdout:1/923: mkdir d4/d11/d14/d25/d107/d13c 0 2024-09-21T12:20:54.487 INFO:tasks.workunit.client.0.smithi003.stdout:2/763: dwrite d0/d21/fb5 [0,4194304] 0 2024-09-21T12:20:54.488 INFO:tasks.workunit.client.0.smithi003.stdout:5/959: mknod dc/dd7/d41/d5b/d101/d125/d4e/c135 0 2024-09-21T12:20:54.488 INFO:tasks.workunit.client.0.smithi003.stdout:1/924: chown d4/d11/d14/d78/lf8 67380 1 2024-09-21T12:20:54.491 INFO:tasks.workunit.client.0.smithi003.stdout:1/925: unlink d4/df/f5d 0 2024-09-21T12:20:54.496 INFO:tasks.workunit.client.0.smithi003.stdout:2/764: write d0/d21/d2c/fa0 [3962564,60245] 0 2024-09-21T12:20:54.502 INFO:tasks.workunit.client.0.smithi003.stdout:2/765: symlink d0/d21/d2f/d50/dc4/dc7/l10e 0 2024-09-21T12:20:54.503 INFO:tasks.workunit.client.0.smithi003.stdout:1/926: dwrite d4/df/d19/f4e [4194304,4194304] 0 2024-09-21T12:20:54.505 INFO:tasks.workunit.client.0.smithi003.stdout:5/960: dwrite dc/dd7/d41/d5b/d74/fec [0,4194304] 0 2024-09-21T12:20:54.507 INFO:tasks.workunit.client.0.smithi003.stdout:5/961: stat dc/dd7/d41/da0/d35/d10b 0 2024-09-21T12:20:54.513 INFO:tasks.workunit.client.0.smithi003.stdout:1/927: creat d4/df/d12/f13d x:0 0 0 2024-09-21T12:20:54.516 INFO:tasks.workunit.client.0.smithi003.stdout:1/928: read d4/d11/db1/ff0 [2323246,47876] 0 2024-09-21T12:20:54.521 INFO:tasks.workunit.client.0.smithi003.stdout:1/929: mkdir d4/d66/d8b/d13e 0 2024-09-21T12:20:54.523 INFO:tasks.workunit.client.0.smithi003.stdout:1/930: mknod d4/d66/c13f 0 2024-09-21T12:20:54.530 INFO:tasks.workunit.client.0.smithi003.stdout:1/931: fsync d4/d11/d14/d25/d42/d7b/fb5 0 2024-09-21T12:20:54.534 INFO:tasks.workunit.client.0.smithi003.stdout:5/962: write dc/fc3 [611411,34986] 0 2024-09-21T12:20:54.534 INFO:tasks.workunit.client.0.smithi003.stdout:1/932: mknod d4/df/d19/d8a/c140 0 2024-09-21T12:20:54.536 INFO:tasks.workunit.client.0.smithi003.stdout:2/766: dwrite d0/f25 [0,4194304] 0 2024-09-21T12:20:54.536 INFO:tasks.workunit.client.0.smithi003.stdout:5/963: mknod dc/dd7/d41/da0/d90/c136 0 2024-09-21T12:20:54.540 INFO:tasks.workunit.client.0.smithi003.stdout:5/964: chown dc/dd7/d41/d9f/dde/l12e 61722 1 2024-09-21T12:20:54.543 INFO:tasks.workunit.client.0.smithi003.stdout:2/767: dwrite d0/d21/d2f/d50/dc4/dc7/f101 [0,4194304] 0 2024-09-21T12:20:54.553 INFO:tasks.workunit.client.0.smithi003.stdout:1/933: dwrite d4/df/fa5 [0,4194304] 0 2024-09-21T12:20:54.556 INFO:tasks.workunit.client.0.smithi003.stdout:5/965: write dc/dd7/d41/d5b/fc0 [753066,61842] 0 2024-09-21T12:20:54.559 INFO:tasks.workunit.client.0.smithi003.stdout:5/966: fdatasync dc/dd7/d41/ff0 0 2024-09-21T12:20:54.560 INFO:tasks.workunit.client.0.smithi003.stdout:5/967: chown dc/d15/cd8 80673 1 2024-09-21T12:20:54.567 INFO:tasks.workunit.client.0.smithi003.stdout:5/968: getdents dc/dd7/d41/da0/df8 0 2024-09-21T12:20:54.568 INFO:tasks.workunit.client.0.smithi003.stdout:5/969: stat c8 0 2024-09-21T12:20:54.569 INFO:tasks.workunit.client.0.smithi003.stdout:1/934: dwrite d4/d11/d14/d25/d42/d63/fe0 [0,4194304] 0 2024-09-21T12:20:54.570 INFO:tasks.workunit.client.0.smithi003.stdout:1/935: dread - d4/d11/d14/d25/d107/d80/fef zero size 2024-09-21T12:20:54.577 INFO:tasks.workunit.client.0.smithi003.stdout:5/970: dwrite dc/d15/d26/f86 [0,4194304] 0 2024-09-21T12:20:54.579 INFO:tasks.workunit.client.0.smithi003.stdout:1/936: rename d4/d66/dc7/cc5 to d4/c141 0 2024-09-21T12:20:54.579 INFO:tasks.workunit.client.0.smithi003.stdout:5/971: fdatasync dc/f3a 0 2024-09-21T12:20:54.580 INFO:tasks.workunit.client.0.smithi003.stdout:5/972: chown dc/dd7/d41 28 1 2024-09-21T12:20:54.585 INFO:tasks.workunit.client.0.smithi003.stdout:1/937: fsync d4/d11/d14/fab 0 2024-09-21T12:20:54.589 INFO:tasks.workunit.client.0.smithi003.stdout:5/973: dwrite dc/dd7/d41/d5b/d101/d125/d4e/d119/feb [0,4194304] 0 2024-09-21T12:20:54.589 INFO:tasks.workunit.client.0.smithi003.stdout:1/938: mkdir d4/d11/d49/d142 0 2024-09-21T12:20:54.593 INFO:tasks.workunit.client.0.smithi003.stdout:1/939: mknod d4/d66/c143 0 2024-09-21T12:20:54.595 INFO:tasks.workunit.client.0.smithi003.stdout:5/974: truncate dc/f4d 217963 0 2024-09-21T12:20:54.597 INFO:tasks.workunit.client.0.smithi003.stdout:5/975: write dc/dd7/d41/d9f/d104/f106 [506367,88292] 0 2024-09-21T12:20:54.598 INFO:tasks.workunit.client.0.smithi003.stdout:1/940: read d4/d11/d14/d25/d107/f16 [2498923,34132] 0 2024-09-21T12:20:54.603 INFO:tasks.workunit.client.0.smithi003.stdout:1/941: link d4/d11/d14/d25/d59/c88 d4/d66/c144 0 2024-09-21T12:20:54.603 INFO:tasks.workunit.client.0.smithi003.stdout:1/942: chown d4/d11/f50 9327 1 2024-09-21T12:20:54.618 INFO:tasks.workunit.client.0.smithi003.stdout:1/943: dwrite d4/d11/d14/f62 [0,4194304] 0 2024-09-21T12:20:54.619 INFO:tasks.workunit.client.0.smithi003.stdout:1/944: chown d4/d11/df6/f11b 6752 1 2024-09-21T12:20:54.619 INFO:tasks.workunit.client.0.smithi003.stdout:5/976: dread dc/dd7/d41/d5b/d101/d125/f44 [0,4194304] 0 2024-09-21T12:20:54.621 INFO:tasks.workunit.client.0.smithi003.stdout:1/945: creat d4/d11/d14/d78/f145 x:0 0 0 2024-09-21T12:20:54.625 INFO:tasks.workunit.client.0.smithi003.stdout:1/946: creat d4/d11/d14/d25/d42/d7b/f146 x:0 0 0 2024-09-21T12:20:54.625 INFO:tasks.workunit.client.0.smithi003.stdout:5/977: dread dc/dd7/d41/da0/fe4 [0,4194304] 0 2024-09-21T12:20:54.630 INFO:tasks.workunit.client.0.smithi003.stdout:5/978: dread dc/dd7/d41/d5b/fa5 [0,4194304] 0 2024-09-21T12:20:54.632 INFO:tasks.workunit.client.0.smithi003.stdout:5/979: chown dc/dd7/d41/d5b/d101 7185 1 2024-09-21T12:20:54.634 INFO:tasks.workunit.client.0.smithi003.stdout:1/947: dwrite d4/d11/d14/f112 [0,4194304] 0 2024-09-21T12:20:54.636 INFO:tasks.workunit.client.0.smithi003.stdout:4/691: sync 2024-09-21T12:20:54.640 INFO:tasks.workunit.client.0.smithi003.stdout:1/948: creat d4/d11/d14/d25/d42/d7b/f147 x:0 0 0 2024-09-21T12:20:54.645 INFO:tasks.workunit.client.0.smithi003.stdout:4/692: creat d9/da/d66/d67/dcd/fed x:0 0 0 2024-09-21T12:20:54.647 INFO:tasks.workunit.client.0.smithi003.stdout:4/693: read d9/d16/d65/d97/f9d [173427,81123] 0 2024-09-21T12:20:54.647 INFO:tasks.workunit.client.0.smithi003.stdout:1/949: unlink d4/d11/l40 0 2024-09-21T12:20:54.652 INFO:tasks.workunit.client.0.smithi003.stdout:1/950: mkdir d4/d11/d14/d25/d59/d148 0 2024-09-21T12:20:54.654 INFO:tasks.workunit.client.0.smithi003.stdout:4/694: rename d9/d16/f78 to d9/da/d66/da2/fee 0 2024-09-21T12:20:54.654 INFO:tasks.workunit.client.0.smithi003.stdout:5/980: dread dc/dd7/d3c/fb4 [0,4194304] 0 2024-09-21T12:20:54.655 INFO:tasks.workunit.client.0.smithi003.stdout:4/695: chown d9/da/d66/d67/dcd/dd8 6772834 1 2024-09-21T12:20:54.655 INFO:tasks.workunit.client.0.smithi003.stdout:1/951: mknod d4/d11/df6/c149 0 2024-09-21T12:20:54.658 INFO:tasks.workunit.client.0.smithi003.stdout:1/952: mkdir d4/d11/df6/d14a 0 2024-09-21T12:20:54.659 INFO:tasks.workunit.client.0.smithi003.stdout:4/696: creat d9/da/dab/dd4/fef x:0 0 0 2024-09-21T12:20:54.663 INFO:tasks.workunit.client.0.smithi003.stdout:1/953: creat d4/d66/d8b/d13a/f14b x:0 0 0 2024-09-21T12:20:54.664 INFO:tasks.workunit.client.0.smithi003.stdout:4/697: mkdir d9/da/d66/d67/db2/df0 0 2024-09-21T12:20:54.669 INFO:tasks.workunit.client.0.smithi003.stdout:1/954: rename d4/df/d19 to d4/d14c 0 2024-09-21T12:20:54.671 INFO:tasks.workunit.client.0.smithi003.stdout:5/981: truncate dc/dd7/d41/da0/d4b/fc9 1916820 0 2024-09-21T12:20:54.680 INFO:tasks.workunit.client.0.smithi003.stdout:1/955: dwrite d4/d14c/f95 [0,4194304] 0 2024-09-21T12:20:54.684 INFO:tasks.workunit.client.0.smithi003.stdout:5/982: dwrite dc/dd7/d3c/fc8 [0,4194304] 0 2024-09-21T12:20:54.687 INFO:tasks.workunit.client.0.smithi003.stdout:1/956: write d4/d11/d14/d25/d42/f5f [4407426,86935] 0 2024-09-21T12:20:54.687 INFO:tasks.workunit.client.0.smithi003.stdout:4/698: dwrite d9/d16/d65/d97/fc0 [0,4194304] 0 2024-09-21T12:20:54.689 INFO:tasks.workunit.client.0.smithi003.stdout:1/957: chown d4/d11/df6/f108 108183997 1 2024-09-21T12:20:54.690 INFO:tasks.workunit.client.0.smithi003.stdout:4/699: chown d9/d16/d65/d73/d8d/fa0 1882819 1 2024-09-21T12:20:54.693 INFO:tasks.workunit.client.0.smithi003.stdout:4/700: mknod d9/da/d36/d55/d79/cf1 0 2024-09-21T12:20:54.701 INFO:tasks.workunit.client.0.smithi003.stdout:5/983: dwrite dc/dd7/d41/d5b/d101/d125/d4e/f53 [4194304,4194304] 0 2024-09-21T12:20:54.705 INFO:tasks.workunit.client.0.smithi003.stdout:5/984: write dc/d15/ff4 [455314,44301] 0 2024-09-21T12:20:54.706 INFO:tasks.workunit.client.0.smithi003.stdout:1/958: dread d4/df/d41/f54 [0,4194304] 0 2024-09-21T12:20:54.708 INFO:tasks.workunit.client.0.smithi003.stdout:5/985: mknod dc/dd7/d41/d5b/c137 0 2024-09-21T12:20:54.712 INFO:tasks.workunit.client.0.smithi003.stdout:5/986: truncate dc/dd7/d41/da0/d4b/d5c/dae/f11e 1305268 0 2024-09-21T12:20:54.713 INFO:tasks.workunit.client.0.smithi003.stdout:1/959: rename d4/d66/dc7/c93 to d4/df/d41/c14d 0 2024-09-21T12:20:54.713 INFO:tasks.workunit.client.0.smithi003.stdout:5/987: dread - dc/dd7/d41/d5b/d74/d7f/d82/fd6 zero size 2024-09-21T12:20:54.716 INFO:tasks.workunit.client.0.smithi003.stdout:4/701: write d9/d16/d65/d97/f9d [447564,55960] 0 2024-09-21T12:20:54.729 INFO:tasks.workunit.client.0.smithi003.stdout:1/960: write d4/df/d41/f85 [218073,91793] 0 2024-09-21T12:20:54.732 INFO:tasks.workunit.client.0.smithi003.stdout:3/856: sync 2024-09-21T12:20:54.732 INFO:tasks.workunit.client.0.smithi003.stdout:5/988: write dc/d15/d21/fa9 [77158,40828] 0 2024-09-21T12:20:54.733 INFO:tasks.workunit.client.0.smithi003.stdout:4/702: truncate d9/d25/f7a 2607498 0 2024-09-21T12:20:54.736 INFO:tasks.workunit.client.0.smithi003.stdout:5/989: mkdir dc/dd7/d41/da0/d35/d138 0 2024-09-21T12:20:54.738 INFO:tasks.workunit.client.0.smithi003.stdout:3/857: truncate d0/d5/da/d28/d31/f63 4453765 0 2024-09-21T12:20:54.740 INFO:tasks.workunit.client.0.smithi003.stdout:4/703: dread d9/da/d66/d67/dcd/dd8/f56 [0,4194304] 0 2024-09-21T12:20:54.741 INFO:tasks.workunit.client.0.smithi003.stdout:1/961: dread d4/d11/f2a [0,4194304] 0 2024-09-21T12:20:54.742 INFO:tasks.workunit.client.0.smithi003.stdout:1/962: write d4/f132 [25288,26310] 0 2024-09-21T12:20:54.743 INFO:tasks.workunit.client.0.smithi003.stdout:3/858: getdents d0/d5/da/d28/d11/d49/d4c/d6f/d91/d119 0 2024-09-21T12:20:54.744 INFO:tasks.workunit.client.0.smithi003.stdout:3/859: chown d0/d5/fe8 457849 1 2024-09-21T12:20:54.749 INFO:tasks.workunit.client.0.smithi003.stdout:1/963: dread d4/d14c/f8f [0,4194304] 0 2024-09-21T12:20:54.753 INFO:tasks.workunit.client.0.smithi003.stdout:3/860: getdents d0/d5/da/d28/dd/d9f 0 2024-09-21T12:20:54.754 INFO:tasks.workunit.client.0.smithi003.stdout:5/990: dwrite dc/d15/d1c/f5f [0,4194304] 0 2024-09-21T12:20:54.755 INFO:tasks.workunit.client.0.smithi003.stdout:3/861: chown d0/d5/da/d28/dd/fb2 104810 1 2024-09-21T12:20:54.761 INFO:tasks.workunit.client.0.smithi003.stdout:5/991: chown dc/d15/d21/f24 2 1 2024-09-21T12:20:54.761 INFO:tasks.workunit.client.0.smithi003.stdout:4/704: dread d9/da/fd [0,4194304] 0 2024-09-21T12:20:54.761 INFO:tasks.workunit.client.0.smithi003.stdout:4/705: chown d9/cb8 605 1 2024-09-21T12:20:54.761 INFO:tasks.workunit.client.0.smithi003.stdout:1/964: truncate d4/df/d41/f85 1599566 0 2024-09-21T12:20:54.761 INFO:tasks.workunit.client.0.smithi003.stdout:5/992: rmdir dc/dd7/d41/d9f 39 2024-09-21T12:20:54.762 INFO:tasks.workunit.client.0.smithi003.stdout:5/993: chown dc/d15/c11d 176973900 1 2024-09-21T12:20:54.763 INFO:tasks.workunit.client.0.smithi003.stdout:4/706: creat d9/da/d36/dcc/ff2 x:0 0 0 2024-09-21T12:20:54.765 INFO:tasks.workunit.client.0.smithi003.stdout:1/965: rename d4/d11/d14/fab to d4/d66/dc7/ded/f14e 0 2024-09-21T12:20:54.767 INFO:tasks.workunit.client.0.smithi003.stdout:8/881: sync 2024-09-21T12:20:54.767 INFO:tasks.workunit.client.0.smithi003.stdout:9/877: sync 2024-09-21T12:20:54.767 INFO:tasks.workunit.client.0.smithi003.stdout:7/737: sync 2024-09-21T12:20:54.767 INFO:tasks.workunit.client.0.smithi003.stdout:5/994: creat dc/d15/f139 x:0 0 0 2024-09-21T12:20:54.768 INFO:tasks.workunit.client.0.smithi003.stdout:3/862: truncate d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/d42/d6d/d86/f8e 4007921 0 2024-09-21T12:20:54.769 INFO:tasks.workunit.client.0.smithi003.stdout:4/707: dread d9/d25/f39 [4194304,4194304] 0 2024-09-21T12:20:54.776 INFO:tasks.workunit.client.0.smithi003.stdout:9/878: dwrite d2/d20/d22/d5e/d87/fa1 [0,4194304] 0 2024-09-21T12:20:54.776 INFO:tasks.workunit.client.0.smithi003.stdout:9/879: stat d2/da/d17/f7a 0 2024-09-21T12:20:54.777 INFO:tasks.workunit.client.0.smithi003.stdout:7/738: symlink d8/db/d13/d96/lf3 0 2024-09-21T12:20:54.779 INFO:tasks.workunit.client.0.smithi003.stdout:7/739: fsync d8/db/d32/d43/d7e/f83 0 2024-09-21T12:20:54.783 INFO:tasks.workunit.client.0.smithi003.stdout:5/995: creat dc/dd7/d41/d12d/f13a x:0 0 0 2024-09-21T12:20:54.784 INFO:tasks.workunit.client.0.smithi003.stdout:1/966: truncate d4/d11/df6/f130 3077710 0 2024-09-21T12:20:54.784 INFO:tasks.workunit.client.0.smithi003.stdout:1/967: readlink d4/df/ldb 0 2024-09-21T12:20:54.786 INFO:tasks.workunit.client.0.smithi003.stdout:1/968: write d4/df/f38 [3797195,88812] 0 2024-09-21T12:20:54.786 INFO:tasks.workunit.client.0.smithi003.stdout:9/880: rmdir d2/d53/d75/de4 39 2024-09-21T12:20:54.789 INFO:tasks.workunit.client.0.smithi003.stdout:3/863: mknod d0/d5/d38/d55/ddb/d107/c11d 0 2024-09-21T12:20:54.792 INFO:tasks.workunit.client.0.smithi003.stdout:5/996: fsync dc/dd7/d41/d9f/d104/f132 0 2024-09-21T12:20:54.793 INFO:tasks.workunit.client.0.smithi003.stdout:8/882: dwrite d7/df/d20/fe0 [0,4194304] 0 2024-09-21T12:20:54.793 INFO:tasks.workunit.client.0.smithi003.stdout:9/881: unlink d2/da/d2a/d3c/da2/lad 0 2024-09-21T12:20:54.794 INFO:tasks.workunit.client.0.smithi003.stdout:9/882: readlink d2/d53/l6b 0 2024-09-21T12:20:54.801 INFO:tasks.workunit.client.0.smithi003.stdout:3/864: rmdir d0/d5/d38/d55/ddb/d107 39 2024-09-21T12:20:54.802 INFO:tasks.workunit.client.0.smithi003.stdout:4/708: dread f8 [0,4194304] 0 2024-09-21T12:20:54.803 INFO:tasks.workunit.client.0.smithi003.stdout:1/969: mkdir d4/d66/d8b/d13e/d14f 0 2024-09-21T12:20:54.808 INFO:tasks.workunit.client.0.smithi003.stdout:3/865: mknod d0/d5/c11e 0 2024-09-21T12:20:54.809 INFO:tasks.workunit.client.0.smithi003.stdout:4/709: fdatasync d9/da/f27 0 2024-09-21T12:20:54.811 INFO:tasks.workunit.client.0.smithi003.stdout:5/997: mknod dc/dd7/d3c/c13b 0 2024-09-21T12:20:54.812 INFO:tasks.workunit.client.0.smithi003.stdout:9/883: creat d2/d53/d75/de4/df4/f134 x:0 0 0 2024-09-21T12:20:54.813 INFO:tasks.workunit.client.0.smithi003.stdout:5/998: write dc/d15/d21/f133 [1040673,128739] 0 2024-09-21T12:20:54.814 INFO:tasks.workunit.client.0.smithi003.stdout:5/999: readlink dc/dd7/d41/da0/l7e 0 2024-09-21T12:20:54.814 INFO:tasks.workunit.client.0.smithi003.stdout:3/866: creat d0/d5/d38/db8/ddf/f11f x:0 0 0 2024-09-21T12:20:54.820 INFO:tasks.workunit.client.0.smithi003.stdout:1/970: rename d4/df/d41/f54 to d4/d11/d14/d25/d42/f150 0 2024-09-21T12:20:54.823 INFO:tasks.workunit.client.0.smithi003.stdout:9/884: rename d2/d53/de8/c112 to d2/da/d2a/d89/d9c/c135 0 2024-09-21T12:20:54.824 INFO:tasks.workunit.client.0.smithi003.stdout:4/710: dwrite d9/da/d66/d67/dcd/fea [4194304,4194304] 0 2024-09-21T12:20:54.830 INFO:tasks.workunit.client.0.smithi003.stdout:3/867: rename d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/d77/dd3/l10b to d0/d5/d38/db8/ddf/l120 0 2024-09-21T12:20:54.830 INFO:tasks.workunit.client.0.smithi003.stdout:9/885: dread d2/da/d2a/d3c/da2/daf/f70 [0,4194304] 0 2024-09-21T12:20:54.831 INFO:tasks.workunit.client.0.smithi003.stdout:1/971: dwrite d4/df/d12/f128 [4194304,4194304] 0 2024-09-21T12:20:54.832 INFO:tasks.workunit.client.0.smithi003.stdout:4/711: unlink d9/d25/l2b 0 2024-09-21T12:20:54.834 INFO:tasks.workunit.client.0.smithi003.stdout:4/712: chown d9/da/d36/d55/d79/cf1 427 1 2024-09-21T12:20:54.836 INFO:tasks.workunit.client.0.smithi003.stdout:4/713: readlink d9/d25/lb9 0 2024-09-21T12:20:54.838 INFO:tasks.workunit.client.0.smithi003.stdout:3/868: mkdir d0/d5/da/d28/d11/d49/d4c/d6f/d91/d121 0 2024-09-21T12:20:54.838 INFO:tasks.workunit.client.0.smithi003.stdout:4/714: fsync d9/da/d36/d55/d79/fd0 0 2024-09-21T12:20:54.840 INFO:tasks.workunit.client.0.smithi003.stdout:4/715: write d9/da/d36/dcc/feb [265739,5714] 0 2024-09-21T12:20:54.841 INFO:tasks.workunit.client.0.smithi003.stdout:3/869: stat d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/de3/d104/f117 0 2024-09-21T12:20:54.852 INFO:tasks.workunit.client.0.smithi003.stdout:9/886: creat d2/d53/d75/d132/f136 x:0 0 0 2024-09-21T12:20:54.854 INFO:tasks.workunit.client.0.smithi003.stdout:9/887: truncate d2/d53/d75/de4/df4/f134 662319 0 2024-09-21T12:20:54.856 INFO:tasks.workunit.client.0.smithi003.stdout:9/888: creat d2/d53/d75/de4/df4/f137 x:0 0 0 2024-09-21T12:20:54.858 INFO:tasks.workunit.client.0.smithi003.stdout:9/889: creat d2/da/d17/f138 x:0 0 0 2024-09-21T12:20:54.865 INFO:tasks.workunit.client.0.smithi003.stdout:1/972: write d4/d66/dc7/ded/f14e [810721,129098] 0 2024-09-21T12:20:54.868 INFO:tasks.workunit.client.0.smithi003.stdout:3/870: dwrite d0/d5/da/d28/d11/d49/f73 [0,4194304] 0 2024-09-21T12:20:54.869 INFO:tasks.workunit.client.0.smithi003.stdout:1/973: truncate d4/df/d12/f75 945483 0 2024-09-21T12:20:54.873 INFO:tasks.workunit.client.0.smithi003.stdout:4/716: dwrite d9/d25/f7a [0,4194304] 0 2024-09-21T12:20:54.875 INFO:tasks.workunit.client.0.smithi003.stdout:3/871: fsync d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/fd4 0 2024-09-21T12:20:54.876 INFO:tasks.workunit.client.0.smithi003.stdout:4/717: chown d9/da/d36/d55/d79/cf1 45 1 2024-09-21T12:20:54.880 INFO:tasks.workunit.client.0.smithi003.stdout:4/718: write d9/da/d36/da9/fc4 [2489978,104014] 0 2024-09-21T12:20:54.882 INFO:tasks.workunit.client.0.smithi003.stdout:3/872: symlink d0/d5/d38/db8/l122 0 2024-09-21T12:20:54.882 INFO:tasks.workunit.client.0.smithi003.stdout:9/890: dwrite d2/d53/d75/ff3 [0,4194304] 0 2024-09-21T12:20:54.883 INFO:tasks.workunit.client.0.smithi003.stdout:4/719: chown d9/da/d36/d55/fa8 68886 1 2024-09-21T12:20:54.887 INFO:tasks.workunit.client.0.smithi003.stdout:3/873: chown d0/d5/d38/d55/ddb/d107/c11d 519786 1 2024-09-21T12:20:54.888 INFO:tasks.workunit.client.0.smithi003.stdout:9/891: mknod d2/d53/de8/c139 0 2024-09-21T12:20:54.894 INFO:tasks.workunit.client.0.smithi003.stdout:3/874: fsync d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/f90 0 2024-09-21T12:20:54.900 INFO:tasks.workunit.client.0.smithi003.stdout:4/720: write d9/da/d36/f50 [4467568,2911] 0 2024-09-21T12:20:54.901 INFO:tasks.workunit.client.0.smithi003.stdout:9/892: getdents d2/d53/df8 0 2024-09-21T12:20:54.903 INFO:tasks.workunit.client.0.smithi003.stdout:4/721: chown d9/d16/f70 3368 1 2024-09-21T12:20:54.904 INFO:tasks.workunit.client.0.smithi003.stdout:3/875: dwrite d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/d77/dd3/fed [0,4194304] 0 2024-09-21T12:20:54.907 INFO:tasks.workunit.client.0.smithi003.stdout:1/974: dread d4/d66/dc7/dce/ff1 [0,4194304] 0 2024-09-21T12:20:54.907 INFO:tasks.workunit.client.0.smithi003.stdout:9/893: mknod d2/d20/d42/c13a 0 2024-09-21T12:20:54.910 INFO:tasks.workunit.client.0.smithi003.stdout:3/876: symlink d0/d5/da/d28/dd/l123 0 2024-09-21T12:20:54.910 INFO:tasks.workunit.client.0.smithi003.stdout:1/975: fsync d4/d11/d14/d25/d42/f150 0 2024-09-21T12:20:54.912 INFO:tasks.workunit.client.0.smithi003.stdout:9/894: symlink d2/da/d2a/d89/d9c/l13b 0 2024-09-21T12:20:54.912 INFO:tasks.workunit.client.0.smithi003.stdout:1/976: rmdir d4/df/d41/d103 39 2024-09-21T12:20:54.915 INFO:tasks.workunit.client.0.smithi003.stdout:1/977: read d4/d14c/f4e [3244621,124427] 0 2024-09-21T12:20:54.918 INFO:tasks.workunit.client.0.smithi003.stdout:3/877: getdents d0/d5/da/d28/d11/d96/de2 0 2024-09-21T12:20:54.922 INFO:tasks.workunit.client.0.smithi003.stdout:3/878: truncate d0/d5/da/d28/d31/d6b/fc0 354426 0 2024-09-21T12:20:54.924 INFO:tasks.workunit.client.0.smithi003.stdout:9/895: write d2/da/d17/f2c [4023809,3090] 0 2024-09-21T12:20:54.925 INFO:tasks.workunit.client.0.smithi003.stdout:1/978: truncate d4/d11/d14/d25/d59/f82 613011 0 2024-09-21T12:20:54.926 INFO:tasks.workunit.client.0.smithi003.stdout:4/722: dwrite d9/d16/f3d [0,4194304] 0 2024-09-21T12:20:54.926 INFO:tasks.workunit.client.0.smithi003.stdout:9/896: fdatasync d2/da/d35/d76/d94/f11b 0 2024-09-21T12:20:54.928 INFO:tasks.workunit.client.0.smithi003.stdout:1/979: read d4/d11/d14/d25/d107/fd2 [3316953,117361] 0 2024-09-21T12:20:54.932 INFO:tasks.workunit.client.0.smithi003.stdout:4/723: unlink d9/da/d66/fe9 0 2024-09-21T12:20:54.937 INFO:tasks.workunit.client.0.smithi003.stdout:9/897: mkdir d2/da/d35/d13c 0 2024-09-21T12:20:54.939 INFO:tasks.workunit.client.0.smithi003.stdout:1/980: rmdir d4/df/d41/d103 39 2024-09-21T12:20:54.941 INFO:tasks.workunit.client.0.smithi003.stdout:4/724: mknod d9/da/d47/de7/cf3 0 2024-09-21T12:20:54.942 INFO:tasks.workunit.client.0.smithi003.stdout:4/725: truncate d9/da/d47/ddd/fe4 79496 0 2024-09-21T12:20:54.943 INFO:tasks.workunit.client.0.smithi003.stdout:9/898: unlink d2/d20/d22/d3f/dfd/c110 0 2024-09-21T12:20:54.948 INFO:tasks.workunit.client.0.smithi003.stdout:9/899: creat d2/f13d x:0 0 0 2024-09-21T12:20:54.955 INFO:tasks.workunit.client.0.smithi003.stdout:1/981: write d4/d11/db1/ff0 [4451129,115077] 0 2024-09-21T12:20:54.958 INFO:tasks.workunit.client.0.smithi003.stdout:9/900: write d2/d20/d42/da5/fbf [916937,38687] 0 2024-09-21T12:20:54.960 INFO:tasks.workunit.client.0.smithi003.stdout:1/982: mkdir d4/d11/d14/d25/d151 0 2024-09-21T12:20:54.961 INFO:tasks.workunit.client.0.smithi003.stdout:1/983: chown d4/d11/d14/d25/d107/d80/f83 172750 1 2024-09-21T12:20:54.964 INFO:tasks.workunit.client.0.smithi003.stdout:9/901: dwrite d2/d20/d22/d5e/d87/fa6 [0,4194304] 0 2024-09-21T12:20:54.967 INFO:tasks.workunit.client.0.smithi003.stdout:1/984: getdents d4 0 2024-09-21T12:20:54.968 INFO:tasks.workunit.client.0.smithi003.stdout:9/902: mkdir d2/da/d35/d76/d13e 0 2024-09-21T12:20:54.969 INFO:tasks.workunit.client.0.smithi003.stdout:9/903: dread - d2/d53/d75/de4/fec zero size 2024-09-21T12:20:54.970 INFO:tasks.workunit.client.0.smithi003.stdout:9/904: dread - d2/da/d17/f138 zero size 2024-09-21T12:20:54.974 INFO:tasks.workunit.client.0.smithi003.stdout:9/905: creat d2/d53/d75/f13f x:0 0 0 2024-09-21T12:20:54.977 INFO:tasks.workunit.client.0.smithi003.stdout:9/906: rename d2/d53/f8d to d2/da/d2a/d3c/da8/d126/f140 0 2024-09-21T12:20:54.977 INFO:tasks.workunit.client.0.smithi003.stdout:1/985: dread d4/d14c/f2b [0,4194304] 0 2024-09-21T12:20:54.977 INFO:tasks.workunit.client.0.smithi003.stdout:2/768: sync 2024-09-21T12:20:54.977 INFO:tasks.workunit.client.0.smithi003.stdout:0/942: sync 2024-09-21T12:20:54.979 INFO:tasks.workunit.client.0.smithi003.stdout:9/907: mknod d2/d53/d75/de4/df4/c141 0 2024-09-21T12:20:54.980 INFO:tasks.workunit.client.0.smithi003.stdout:9/908: write d2/d20/d22/d3f/dfd/f12b [243848,46047] 0 2024-09-21T12:20:54.982 INFO:tasks.workunit.client.0.smithi003.stdout:2/769: creat d0/dd/d22/d37/dda/f10f x:0 0 0 2024-09-21T12:20:54.984 INFO:tasks.workunit.client.0.smithi003.stdout:1/986: link d4/fbf d4/d11/d14/d25/d42/d63/f152 0 2024-09-21T12:20:54.986 INFO:tasks.workunit.client.0.smithi003.stdout:2/770: rename d0/d1c/f34 to d0/d21/d30/f110 0 2024-09-21T12:20:54.987 INFO:tasks.workunit.client.0.smithi003.stdout:2/771: stat d0/d21/d2f/d49/c98 0 2024-09-21T12:20:54.987 INFO:tasks.workunit.client.0.smithi003.stdout:1/987: rmdir d4/d66 39 2024-09-21T12:20:54.988 INFO:tasks.workunit.client.0.smithi003.stdout:0/943: dread d9/d12/d17/d38/d47/f10f [0,4194304] 0 2024-09-21T12:20:54.990 INFO:tasks.workunit.client.0.smithi003.stdout:2/772: fsync d0/dd/f1b 0 2024-09-21T12:20:54.991 INFO:tasks.workunit.client.0.smithi003.stdout:9/909: getdents d2/d53/d83 0 2024-09-21T12:20:54.991 INFO:tasks.workunit.client.0.smithi003.stdout:0/944: mknod d9/d12/d1e/d108/d2d/c14e 0 2024-09-21T12:20:54.993 INFO:tasks.workunit.client.0.smithi003.stdout:9/910: write d2/d20/d22/d5e/f125 [122845,26054] 0 2024-09-21T12:20:54.994 INFO:tasks.workunit.client.0.smithi003.stdout:9/911: chown d2/da/d35/d76/f7e 4746 1 2024-09-21T12:20:54.995 INFO:tasks.workunit.client.0.smithi003.stdout:9/912: chown d2/d53/d75/fb4 505327659 1 2024-09-21T12:20:54.996 INFO:tasks.workunit.client.0.smithi003.stdout:2/773: mknod d0/d21/d2f/d49/c111 0 2024-09-21T12:20:54.996 INFO:tasks.workunit.client.0.smithi003.stdout:9/913: chown d2/da/d2a/d3c/c129 1 1 2024-09-21T12:20:54.997 INFO:tasks.workunit.client.0.smithi003.stdout:9/914: write d2/d20/d42/dcc/f127 [952684,31069] 0 2024-09-21T12:20:55.000 INFO:tasks.workunit.client.0.smithi003.stdout:0/945: chown d9/d6c/d32/c3f 15211 1 2024-09-21T12:20:55.002 INFO:tasks.workunit.client.0.smithi003.stdout:2/774: dwrite d0/f25 [0,4194304] 0 2024-09-21T12:20:55.003 INFO:tasks.workunit.client.0.smithi003.stdout:9/915: symlink d2/d53/d75/de4/l142 0 2024-09-21T12:20:55.006 INFO:tasks.workunit.client.0.smithi003.stdout:0/946: truncate d9/d12/d17/f6d 886869 0 2024-09-21T12:20:55.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:54 smithi192 ceph-mon[35641]: pgmap v14: 65 pgs: 65 active+clean; 2.9 GiB data, 8.6 GiB used, 528 GiB / 536 GiB avail; 70 MiB/s rd, 163 MiB/s wr, 431 op/s 2024-09-21T12:20:55.011 INFO:tasks.workunit.client.0.smithi003.stdout:0/947: symlink d9/d12/d1e/d5f/d8a/d125/d12d/l14f 0 2024-09-21T12:20:55.016 INFO:tasks.workunit.client.0.smithi003.stdout:9/916: creat d2/da/d35/f143 x:0 0 0 2024-09-21T12:20:55.055 INFO:tasks.workunit.client.0.smithi003.stdout:2/775: write d0/d1c/f42 [3334246,79261] 0 2024-09-21T12:20:55.056 INFO:tasks.workunit.client.0.smithi003.stdout:9/917: symlink d2/d53/d83/l144 0 2024-09-21T12:20:55.057 INFO:tasks.workunit.client.0.smithi003.stdout:1/988: dwrite d4/d11/d14/d25/d107/fdc [0,4194304] 0 2024-09-21T12:20:55.058 INFO:tasks.workunit.client.0.smithi003.stdout:2/776: truncate d0/d1c/feb 928289 0 2024-09-21T12:20:55.059 INFO:tasks.workunit.client.0.smithi003.stdout:9/918: chown d2/da/d35/d76/d94/d10b/f10f 0 1 2024-09-21T12:20:55.060 INFO:tasks.workunit.client.0.smithi003.stdout:1/989: write d4/d11/d14/f112 [675397,57424] 0 2024-09-21T12:20:55.061 INFO:tasks.workunit.client.0.smithi003.stdout:2/777: write d0/d21/d2f/d9f/ffe [210544,68838] 0 2024-09-21T12:20:55.063 INFO:tasks.workunit.client.0.smithi003.stdout:2/778: write d0/dd/f84 [217135,15321] 0 2024-09-21T12:20:55.072 INFO:tasks.workunit.client.0.smithi003.stdout:0/948: dread d9/d12/d17/d21/d30/ff2 [0,4194304] 0 2024-09-21T12:20:55.085 INFO:tasks.workunit.client.0.smithi003.stdout:9/919: dread d2/da/d35/d76/f7e [0,4194304] 0 2024-09-21T12:20:55.085 INFO:tasks.workunit.client.0.smithi003.stdout:9/920: write d2/da/d35/d4d/f116 [616056,738] 0 2024-09-21T12:20:55.171 INFO:tasks.workunit.client.0.smithi003.stdout:2/779: creat d0/d1c/d6a/dc0/f112 x:0 0 0 2024-09-21T12:20:55.201 INFO:tasks.workunit.client.0.smithi003.stdout:0/949: truncate d9/d12/d17/d38/d3a/d46/d55/f90 1326368 0 2024-09-21T12:20:55.206 INFO:tasks.workunit.client.0.smithi003.stdout:0/950: fdatasync d9/d6c/d26/d54/ffd 0 2024-09-21T12:20:55.207 INFO:tasks.workunit.client.0.smithi003.stdout:0/951: stat d9/d12/d17/d38 0 2024-09-21T12:20:55.207 INFO:tasks.workunit.client.0.smithi003.stdout:9/921: mknod d2/da/d2a/d3c/da2/daf/dd0/c145 0 2024-09-21T12:20:55.208 INFO:tasks.workunit.client.0.smithi003.stdout:0/952: fsync d9/d12/d17/d38/d3a/f87 0 2024-09-21T12:20:55.212 INFO:tasks.workunit.client.0.smithi003.stdout:1/990: rename d4/df/d41/c14d to d4/d66/dc7/ded/c153 0 2024-09-21T12:20:55.215 INFO:tasks.workunit.client.0.smithi003.stdout:0/953: creat d9/d12/d17/d38/d3a/f150 x:0 0 0 2024-09-21T12:20:55.217 INFO:tasks.workunit.client.0.smithi003.stdout:1/991: creat d4/d11/df6/d14a/f154 x:0 0 0 2024-09-21T12:20:55.218 INFO:tasks.workunit.client.0.smithi003.stdout:0/954: mkdir d9/d6c/d26/db3/d151 0 2024-09-21T12:20:55.221 INFO:tasks.workunit.client.0.smithi003.stdout:1/992: unlink d4/d11/d14/d25/d42/d63/c71 0 2024-09-21T12:20:55.224 INFO:tasks.workunit.client.0.smithi003.stdout:1/993: creat d4/d66/dc7/f155 x:0 0 0 2024-09-21T12:20:55.224 INFO:tasks.workunit.client.0.smithi003.stdout:9/922: dread d2/d53/d83/fdb [0,4194304] 0 2024-09-21T12:20:55.227 INFO:tasks.workunit.client.0.smithi003.stdout:1/994: read - d4/d11/d14/d78/dae/f129 zero size 2024-09-21T12:20:55.228 INFO:tasks.workunit.client.0.smithi003.stdout:0/955: dwrite d9/d12/d17/d21/fa7 [0,4194304] 0 2024-09-21T12:20:55.228 INFO:tasks.workunit.client.0.smithi003.stdout:1/995: readlink d4/df/l2e 0 2024-09-21T12:20:55.229 INFO:tasks.workunit.client.0.smithi003.stdout:1/996: read - d4/d66/dc7/f155 zero size 2024-09-21T12:20:55.230 INFO:tasks.workunit.client.0.smithi003.stdout:9/923: mkdir d2/d20/d22/d5e/d87/d146 0 2024-09-21T12:20:55.235 INFO:tasks.workunit.client.0.smithi003.stdout:1/997: creat d4/df/d41/f156 x:0 0 0 2024-09-21T12:20:55.265 INFO:tasks.workunit.client.0.smithi003.stdout:2/780: dwrite d0/d21/d2f/d9f/fa5 [0,4194304] 0 2024-09-21T12:20:55.268 INFO:tasks.workunit.client.0.smithi003.stdout:2/781: truncate d0/d21/d2c/d6c/db2/de7/ff0 967075 0 2024-09-21T12:20:55.273 INFO:tasks.workunit.client.0.smithi003.stdout:2/782: mkdir d0/d21/d30/d78/d113 0 2024-09-21T12:20:55.274 INFO:tasks.workunit.client.0.smithi003.stdout:2/783: fdatasync d0/d21/d30/f10a 0 2024-09-21T12:20:55.283 INFO:tasks.workunit.client.0.smithi003.stdout:2/784: dwrite d0/d21/d2f/d50/dc4/d7f/f88 [0,4194304] 0 2024-09-21T12:20:55.283 INFO:tasks.workunit.client.0.smithi003.stdout:0/956: write d9/d12/d1e/d108/f85 [519833,116973] 0 2024-09-21T12:20:55.285 INFO:tasks.workunit.client.0.smithi003.stdout:9/924: write d2/da/d2a/f8c [3306241,28659] 0 2024-09-21T12:20:55.295 INFO:tasks.workunit.client.0.smithi003.stdout:1/998: dwrite d4/d11/d14/d25/d59/f82 [0,4194304] 0 2024-09-21T12:20:55.297 INFO:tasks.workunit.client.0.smithi003.stdout:9/925: dwrite d2/da/d35/d76/d94/f11b [0,4194304] 0 2024-09-21T12:20:55.307 INFO:tasks.workunit.client.0.smithi003.stdout:1/999: link d4/d66/dc7/f12f d4/d11/d14/d25/d107/d80/f157 0 2024-09-21T12:20:55.310 INFO:tasks.workunit.client.0.smithi003.stdout:9/926: dwrite d2/d20/d22/d5e/f125 [0,4194304] 0 2024-09-21T12:20:55.321 INFO:tasks.workunit.client.0.smithi003.stdout:2/785: dwrite d0/d21/d2c/d6c/db2/de7/f8d [0,4194304] 0 2024-09-21T12:20:55.323 INFO:tasks.workunit.client.0.smithi003.stdout:0/957: dwrite d9/d12/d1e/d108/f28 [0,4194304] 0 2024-09-21T12:20:55.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:54 smithi003 ceph-mon[28057]: pgmap v14: 65 pgs: 65 active+clean; 2.9 GiB data, 8.6 GiB used, 528 GiB / 536 GiB avail; 70 MiB/s rd, 163 MiB/s wr, 431 op/s 2024-09-21T12:20:55.330 INFO:tasks.workunit.client.0.smithi003.stdout:2/786: creat d0/d21/d2c/d6c/db2/dbb/f114 x:0 0 0 2024-09-21T12:20:55.336 INFO:tasks.workunit.client.0.smithi003.stdout:0/958: creat d9/d12/d17/d38/f152 x:0 0 0 2024-09-21T12:20:55.339 INFO:tasks.workunit.client.0.smithi003.stdout:2/787: dwrite d0/d21/d2c/d6c/db2/de7/f8d [0,4194304] 0 2024-09-21T12:20:55.341 INFO:tasks.workunit.client.0.smithi003.stdout:0/959: mknod d9/d12/c153 0 2024-09-21T12:20:55.341 INFO:tasks.workunit.client.0.smithi003.stdout:2/788: chown d0/d21/d30/d78/la6 1302 1 2024-09-21T12:20:55.357 INFO:tasks.workunit.client.0.smithi003.stdout:9/927: dread d2/d53/f10a [0,4194304] 0 2024-09-21T12:20:55.360 INFO:tasks.workunit.client.0.smithi003.stdout:2/789: write d0/f7c [3095959,49048] 0 2024-09-21T12:20:55.363 INFO:tasks.workunit.client.0.smithi003.stdout:2/790: truncate d0/dd/f8c 1314127 0 2024-09-21T12:20:55.365 INFO:tasks.workunit.client.0.smithi003.stdout:2/791: fdatasync d0/d21/d30/fcb 0 2024-09-21T12:20:55.366 INFO:tasks.workunit.client.0.smithi003.stdout:9/928: getdents d2/da/d2a/d3c/da8/d126 0 2024-09-21T12:20:55.368 INFO:tasks.workunit.client.0.smithi003.stdout:7/740: sync 2024-09-21T12:20:55.373 INFO:tasks.workunit.client.0.smithi003.stdout:7/741: mknod d8/dea/cf4 0 2024-09-21T12:20:55.375 INFO:tasks.workunit.client.0.smithi003.stdout:0/960: write d9/d12/d17/f18 [523274,109186] 0 2024-09-21T12:20:55.376 INFO:tasks.workunit.client.0.smithi003.stdout:9/929: dwrite d2/d53/d75/fbd [0,4194304] 0 2024-09-21T12:20:55.380 INFO:tasks.workunit.client.0.smithi003.stdout:0/961: creat d9/d12/d17/d21/d30/d4d/f154 x:0 0 0 2024-09-21T12:20:55.384 INFO:tasks.workunit.client.0.smithi003.stdout:9/930: symlink d2/da/d2a/d3c/l147 0 2024-09-21T12:20:55.385 INFO:tasks.workunit.client.0.smithi003.stdout:9/931: chown d2/da/d35/d76/fc0 3008 1 2024-09-21T12:20:55.387 INFO:tasks.workunit.client.0.smithi003.stdout:0/962: fsync d9/d12/d17/d38/d3a/d46/d55/d7b/d9a/f10b 0 2024-09-21T12:20:55.387 INFO:tasks.workunit.client.0.smithi003.stdout:7/742: dwrite d8/f7b [0,4194304] 0 2024-09-21T12:20:55.389 INFO:tasks.workunit.client.0.smithi003.stdout:0/963: dread - d9/d12/d17/d38/d3a/d46/d55/db0/fed zero size 2024-09-21T12:20:55.393 INFO:tasks.workunit.client.0.smithi003.stdout:7/743: rename d8/db/d13 to d8/d3c/d64/df5 0 2024-09-21T12:20:55.395 INFO:tasks.workunit.client.0.smithi003.stdout:7/744: truncate d8/db/d32/d43/fef 4383700 0 2024-09-21T12:20:55.397 INFO:tasks.workunit.client.0.smithi003.stdout:2/792: dread d0/dd/d22/f57 [0,4194304] 0 2024-09-21T12:20:55.398 INFO:tasks.workunit.client.0.smithi003.stdout:7/745: rmdir d8/db/d32/d43 39 2024-09-21T12:20:55.399 INFO:tasks.workunit.client.0.smithi003.stdout:7/746: dread - d8/d93/fbd zero size 2024-09-21T12:20:55.400 INFO:tasks.workunit.client.0.smithi003.stdout:9/932: write d2/da/d17/fa9 [142767,119152] 0 2024-09-21T12:20:55.404 INFO:tasks.workunit.client.0.smithi003.stdout:7/747: unlink d8/db/d32/d43/c66 0 2024-09-21T12:20:55.406 INFO:tasks.workunit.client.0.smithi003.stdout:7/748: creat d8/d3c/d64/ff6 x:0 0 0 2024-09-21T12:20:55.410 INFO:tasks.workunit.client.0.smithi003.stdout:9/933: dread d2/da/d35/f79 [0,4194304] 0 2024-09-21T12:20:55.410 INFO:tasks.workunit.client.0.smithi003.stdout:2/793: truncate d0/d1c/d6a/fd9 266689 0 2024-09-21T12:20:55.412 INFO:tasks.workunit.client.0.smithi003.stdout:2/794: mkdir d0/d21/d2f/d50/dc4/d7f/d115 0 2024-09-21T12:20:55.414 INFO:tasks.workunit.client.0.smithi003.stdout:2/795: rmdir d0/d21/d2f/d9f 39 2024-09-21T12:20:55.420 INFO:tasks.workunit.client.0.smithi003.stdout:0/964: dread d9/d12/d1e/d108/f64 [0,4194304] 0 2024-09-21T12:20:55.422 INFO:tasks.workunit.client.0.smithi003.stdout:7/749: dread d8/d3c/d57/f65 [4194304,4194304] 0 2024-09-21T12:20:55.424 INFO:tasks.workunit.client.0.smithi003.stdout:7/750: chown d8/d31/d84/fec 1722090 1 2024-09-21T12:20:55.426 INFO:tasks.workunit.client.0.smithi003.stdout:0/965: rename d9/d12/d101/d135/f136 to d9/d122/f155 0 2024-09-21T12:20:55.426 INFO:tasks.workunit.client.0.smithi003.stdout:3/879: sync 2024-09-21T12:20:55.426 INFO:tasks.workunit.client.0.smithi003.stdout:8/883: sync 2024-09-21T12:20:55.426 INFO:tasks.workunit.client.0.smithi003.stdout:4/726: sync 2024-09-21T12:20:55.427 INFO:tasks.workunit.client.0.smithi003.stdout:7/751: rmdir d8/d3c/d64/df0 39 2024-09-21T12:20:55.428 INFO:tasks.workunit.client.0.smithi003.stdout:0/966: chown d9/d6c/d26/f3c 2038353577 1 2024-09-21T12:20:55.430 INFO:tasks.workunit.client.0.smithi003.stdout:9/934: dread d2/f2b [0,4194304] 0 2024-09-21T12:20:55.431 INFO:tasks.workunit.client.0.smithi003.stdout:8/884: mkdir d7/df/d20/d24/d47/d133 0 2024-09-21T12:20:55.433 INFO:tasks.workunit.client.0.smithi003.stdout:7/752: truncate d8/fa0 123003 0 2024-09-21T12:20:55.436 INFO:tasks.workunit.client.0.smithi003.stdout:2/796: dread d0/dd/d22/d37/dda/f86 [0,4194304] 0 2024-09-21T12:20:55.437 INFO:tasks.workunit.client.0.smithi003.stdout:9/935: symlink d2/da/d2a/d3c/da8/d126/l148 0 2024-09-21T12:20:55.440 INFO:tasks.workunit.client.0.smithi003.stdout:3/880: dwrite d0/d5/d38/db8/ddf/f10c [0,4194304] 0 2024-09-21T12:20:55.442 INFO:tasks.workunit.client.0.smithi003.stdout:8/885: creat d7/df/d20/d24/d47/d79/d8f/f134 x:0 0 0 2024-09-21T12:20:55.443 INFO:tasks.workunit.client.0.smithi003.stdout:0/967: truncate d9/d12/d17/d21/f31 3065579 0 2024-09-21T12:20:55.446 INFO:tasks.workunit.client.0.smithi003.stdout:4/727: dread d9/da/f92 [0,4194304] 0 2024-09-21T12:20:55.447 INFO:tasks.workunit.client.0.smithi003.stdout:4/728: write d9/da/f9e [127726,90588] 0 2024-09-21T12:20:55.448 INFO:tasks.workunit.client.0.smithi003.stdout:2/797: symlink d0/dd/d22/d37/dda/l116 0 2024-09-21T12:20:55.450 INFO:tasks.workunit.client.0.smithi003.stdout:4/729: truncate d9/d16/d65/d73/d8d/fad 337812 0 2024-09-21T12:20:55.451 INFO:tasks.workunit.client.0.smithi003.stdout:3/881: unlink d0/d5/da/d28/d31/d6b/de9/ff3 0 2024-09-21T12:20:55.452 INFO:tasks.workunit.client.0.smithi003.stdout:8/886: mkdir d7/d57/d77/da5/d135 0 2024-09-21T12:20:55.453 INFO:tasks.workunit.client.0.smithi003.stdout:8/887: dread - d7/d57/f115 zero size 2024-09-21T12:20:55.454 INFO:tasks.workunit.client.0.smithi003.stdout:0/968: rmdir d9/d122 39 2024-09-21T12:20:55.459 INFO:tasks.workunit.client.0.smithi003.stdout:4/730: dwrite d9/da/d66/fe8 [0,4194304] 0 2024-09-21T12:20:55.459 INFO:tasks.workunit.client.0.smithi003.stdout:2/798: rename d0/d1c/d6a/c3c to d0/d21/d30/d78/d113/c117 0 2024-09-21T12:20:55.465 INFO:tasks.workunit.client.0.smithi003.stdout:0/969: creat d9/d6c/d32/db8/f156 x:0 0 0 2024-09-21T12:20:55.467 INFO:tasks.workunit.client.0.smithi003.stdout:0/970: read d9/d12/d17/f93 [69778,120190] 0 2024-09-21T12:20:55.470 INFO:tasks.workunit.client.0.smithi003.stdout:8/888: truncate d7/d57/d77/da5/dd4/dfa/f107 727543 0 2024-09-21T12:20:55.471 INFO:tasks.workunit.client.0.smithi003.stdout:2/799: rmdir d0/d1c/d6a/dc0 39 2024-09-21T12:20:55.472 INFO:tasks.workunit.client.0.smithi003.stdout:2/800: chown d0/d46 38 1 2024-09-21T12:20:55.475 INFO:tasks.workunit.client.0.smithi003.stdout:9/936: dwrite d2/d20/d22/d5e/d87/fde [0,4194304] 0 2024-09-21T12:20:55.477 INFO:tasks.workunit.client.0.smithi003.stdout:9/937: stat d2/da/f11c 0 2024-09-21T12:20:55.479 INFO:tasks.workunit.client.0.smithi003.stdout:2/801: symlink d0/d46/dcd/l118 0 2024-09-21T12:20:55.480 INFO:tasks.workunit.client.0.smithi003.stdout:2/802: dread - d0/d1c/d6a/fc6 zero size 2024-09-21T12:20:55.481 INFO:tasks.workunit.client.0.smithi003.stdout:2/803: write d0/d21/f81 [3778417,91389] 0 2024-09-21T12:20:55.487 INFO:tasks.workunit.client.0.smithi003.stdout:3/882: dread d0/d5/da/d28/ff7 [0,4194304] 0 2024-09-21T12:20:55.492 INFO:tasks.workunit.client.0.smithi003.stdout:0/971: dwrite d9/d12/d17/f36 [0,4194304] 0 2024-09-21T12:20:55.493 INFO:tasks.workunit.client.0.smithi003.stdout:4/731: dread d9/d16/d65/d73/fa3 [4194304,4194304] 0 2024-09-21T12:20:55.494 INFO:tasks.workunit.client.0.smithi003.stdout:9/938: write d2/da/d2a/d3c/da8/ff2 [884526,94851] 0 2024-09-21T12:20:55.495 INFO:tasks.workunit.client.0.smithi003.stdout:8/889: dread d7/de/d1a/f68 [0,4194304] 0 2024-09-21T12:20:55.496 INFO:tasks.workunit.client.0.smithi003.stdout:4/732: chown d9/da/d47/de7/cf3 104 1 2024-09-21T12:20:55.498 INFO:tasks.workunit.client.0.smithi003.stdout:2/804: getdents d0/d21/d2f/d50 0 2024-09-21T12:20:55.498 INFO:tasks.workunit.client.0.smithi003.stdout:4/733: write d9/da/d66/f95 [776038,9314] 0 2024-09-21T12:20:55.500 INFO:tasks.workunit.client.0.smithi003.stdout:0/972: symlink d9/d12/d1e/l157 0 2024-09-21T12:20:55.503 INFO:tasks.workunit.client.0.smithi003.stdout:9/939: dread d2/d20/d22/d5e/d87/de2/f103 [0,4194304] 0 2024-09-21T12:20:55.504 INFO:tasks.workunit.client.0.smithi003.stdout:3/883: write d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/fb1 [2754485,103082] 0 2024-09-21T12:20:55.505 INFO:tasks.workunit.client.0.smithi003.stdout:2/805: truncate d0/d21/d2f/fa2 8062582 0 2024-09-21T12:20:55.507 INFO:tasks.workunit.client.0.smithi003.stdout:8/890: creat d7/d57/d77/da5/d135/f136 x:0 0 0 2024-09-21T12:20:55.508 INFO:tasks.workunit.client.0.smithi003.stdout:4/734: mkdir d9/da/d36/d55/d79/df4 0 2024-09-21T12:20:55.512 INFO:tasks.workunit.client.0.smithi003.stdout:3/884: mknod d0/d5/da/d28/d11/d49/d4c/d6f/d91/c124 0 2024-09-21T12:20:55.515 INFO:tasks.workunit.client.0.smithi003.stdout:2/806: creat d0/d21/d2f/d9f/f119 x:0 0 0 2024-09-21T12:20:55.516 INFO:tasks.workunit.client.0.smithi003.stdout:4/735: dwrite d9/da/d66/da2/fdb [0,4194304] 0 2024-09-21T12:20:55.516 INFO:tasks.workunit.client.0.smithi003.stdout:2/807: chown d0/d1c/d6a/f71 2749009 1 2024-09-21T12:20:55.518 INFO:tasks.workunit.client.0.smithi003.stdout:4/736: write d9/d25/f7a [3892621,58414] 0 2024-09-21T12:20:55.525 INFO:tasks.workunit.client.0.smithi003.stdout:3/885: creat d0/d5/d38/db8/ddf/f125 x:0 0 0 2024-09-21T12:20:55.526 INFO:tasks.workunit.client.0.smithi003.stdout:2/808: dwrite d0/d21/d2f/d9f/fb9 [0,4194304] 0 2024-09-21T12:20:55.529 INFO:tasks.workunit.client.0.smithi003.stdout:2/809: write d0/d21/d2f/d50/f69 [697005,26717] 0 2024-09-21T12:20:55.529 INFO:tasks.workunit.client.0.smithi003.stdout:0/973: rename d9/d12/d1e/d5f/d8a/f124 to d9/d12/d17/d21/f158 0 2024-09-21T12:20:55.530 INFO:tasks.workunit.client.0.smithi003.stdout:2/810: readlink d0/d1c/d6a/lef 0 2024-09-21T12:20:55.531 INFO:tasks.workunit.client.0.smithi003.stdout:0/974: chown d9/d6c/d26/d54/ffd 9031 1 2024-09-21T12:20:55.532 INFO:tasks.workunit.client.0.smithi003.stdout:9/940: link d2/c13 d2/d20/d22/d3f/c149 0 2024-09-21T12:20:55.534 INFO:tasks.workunit.client.0.smithi003.stdout:8/891: getdents d7/df/d20/d54/d9d 0 2024-09-21T12:20:55.535 INFO:tasks.workunit.client.0.smithi003.stdout:8/892: chown d7/de/fa9 16794 1 2024-09-21T12:20:55.542 INFO:tasks.workunit.client.0.smithi003.stdout:4/737: dread d9/da/d66/d67/dcd/dd8/fb1 [4194304,4194304] 0 2024-09-21T12:20:55.543 INFO:tasks.workunit.client.0.smithi003.stdout:4/738: write d9/f3a [9307558,56812] 0 2024-09-21T12:20:55.545 INFO:tasks.workunit.client.0.smithi003.stdout:9/941: creat d2/d53/d75/de4/df4/f14a x:0 0 0 2024-09-21T12:20:55.547 INFO:tasks.workunit.client.0.smithi003.stdout:3/886: getdents d0/d5/da/d28/d31/d6b/d79 0 2024-09-21T12:20:55.549 INFO:tasks.workunit.client.0.smithi003.stdout:3/887: dread - d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/de3/f109 zero size 2024-09-21T12:20:55.550 INFO:tasks.workunit.client.0.smithi003.stdout:3/888: readlink d0/d5/da/d28/d11/d49/l69 0 2024-09-21T12:20:55.552 INFO:tasks.workunit.client.0.smithi003.stdout:3/889: chown d0/d5/da/d28/la5 3475 1 2024-09-21T12:20:55.553 INFO:tasks.workunit.client.0.smithi003.stdout:4/739: unlink d9/da/d47/c6e 0 2024-09-21T12:20:55.555 INFO:tasks.workunit.client.0.smithi003.stdout:0/975: dwrite d9/d12/d17/d38/d3a/f72 [0,4194304] 0 2024-09-21T12:20:55.559 INFO:tasks.workunit.client.0.smithi003.stdout:9/942: rename d2/d53/d75/de4/df4/f14a to d2/d20/d22/d5e/d87/de2/f14b 0 2024-09-21T12:20:55.561 INFO:tasks.workunit.client.0.smithi003.stdout:8/893: creat d7/df/d20/d21/d4c/d4d/d8c/f137 x:0 0 0 2024-09-21T12:20:55.562 INFO:tasks.workunit.client.0.smithi003.stdout:2/811: getdents d0/d21/d2f/d50 0 2024-09-21T12:20:55.566 INFO:tasks.workunit.client.0.smithi003.stdout:2/812: creat d0/d21/d2f/d50/dc4/d7f/daa/f11a x:0 0 0 2024-09-21T12:20:55.567 INFO:tasks.workunit.client.0.smithi003.stdout:4/740: rename d9/da/c46 to d9/da/d36/d55/d79/df4/cf5 0 2024-09-21T12:20:55.567 INFO:tasks.workunit.client.0.smithi003.stdout:3/890: dread d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/d77/fbe [0,4194304] 0 2024-09-21T12:20:55.570 INFO:tasks.workunit.client.0.smithi003.stdout:8/894: mknod d7/df/d20/d54/c138 0 2024-09-21T12:20:55.574 INFO:tasks.workunit.client.0.smithi003.stdout:9/943: rename d2/da/lca to d2/d53/df8/l14c 0 2024-09-21T12:20:55.574 INFO:tasks.workunit.client.0.smithi003.stdout:4/741: rmdir d9/da/d47/ddd 39 2024-09-21T12:20:55.577 INFO:tasks.workunit.client.0.smithi003.stdout:2/813: unlink d0/ce4 0 2024-09-21T12:20:55.578 INFO:tasks.workunit.client.0.smithi003.stdout:2/814: chown d0/dd/d22/d37/dda/d109 204048182 1 2024-09-21T12:20:55.583 INFO:tasks.workunit.client.0.smithi003.stdout:3/891: creat d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/f126 x:0 0 0 2024-09-21T12:20:55.585 INFO:tasks.workunit.client.0.smithi003.stdout:9/944: creat d2/d20/f14d x:0 0 0 2024-09-21T12:20:55.587 INFO:tasks.workunit.client.0.smithi003.stdout:4/742: creat d9/ff6 x:0 0 0 2024-09-21T12:20:55.587 INFO:tasks.workunit.client.0.smithi003.stdout:4/743: stat d9/d25 0 2024-09-21T12:20:55.589 INFO:tasks.workunit.client.0.smithi003.stdout:2/815: creat d0/df7/f11b x:0 0 0 2024-09-21T12:20:55.591 INFO:tasks.workunit.client.0.smithi003.stdout:3/892: creat d0/d5/da/d28/d11/d49/d4c/d54/f127 x:0 0 0 2024-09-21T12:20:55.594 INFO:tasks.workunit.client.0.smithi003.stdout:9/945: dwrite d2/d20/d22/d5e/f125 [0,4194304] 0 2024-09-21T12:20:55.597 INFO:tasks.workunit.client.0.smithi003.stdout:2/816: write d0/d21/d2c/f72 [4237663,25173] 0 2024-09-21T12:20:55.600 INFO:tasks.workunit.client.0.smithi003.stdout:4/744: dwrite d9/da/d36/dcc/feb [0,4194304] 0 2024-09-21T12:20:55.602 INFO:tasks.workunit.client.0.smithi003.stdout:4/745: write d9/da/f27 [1010305,109953] 0 2024-09-21T12:20:55.603 INFO:tasks.workunit.client.0.smithi003.stdout:8/895: dread d7/de/f3e [4194304,4194304] 0 2024-09-21T12:20:55.614 INFO:tasks.workunit.client.0.smithi003.stdout:8/896: creat d7/de/d81/d126/f139 x:0 0 0 2024-09-21T12:20:55.615 INFO:tasks.workunit.client.0.smithi003.stdout:9/946: getdents d2/da/d2a/d3c/da2 0 2024-09-21T12:20:55.616 INFO:tasks.workunit.client.0.smithi003.stdout:3/893: dwrite d0/d5/da/d28/d11/d49/d4c/d6f/d91/fe0 [0,4194304] 0 2024-09-21T12:20:55.619 INFO:tasks.workunit.client.0.smithi003.stdout:9/947: readlink d2/d20/d22/d5e/l72 0 2024-09-21T12:20:55.619 INFO:tasks.workunit.client.0.smithi003.stdout:8/897: truncate d7/df/f12 472272 0 2024-09-21T12:20:55.620 INFO:tasks.workunit.client.0.smithi003.stdout:8/898: readlink d7/de/ldf 0 2024-09-21T12:20:55.620 INFO:tasks.workunit.client.0.smithi003.stdout:9/948: fsync d2/da/d17/f2c 0 2024-09-21T12:20:55.622 INFO:tasks.workunit.client.0.smithi003.stdout:9/949: write d2/d20/d42/da5/f118 [3388423,47698] 0 2024-09-21T12:20:55.627 INFO:tasks.workunit.client.0.smithi003.stdout:9/950: rename d2/d20/d22/c130 to d2/c14e 0 2024-09-21T12:20:55.630 INFO:tasks.workunit.client.0.smithi003.stdout:9/951: symlink d2/d53/df8/l14f 0 2024-09-21T12:20:55.630 INFO:tasks.workunit.client.0.smithi003.stdout:9/952: fdatasync d2/d20/d42/dcc/f127 0 2024-09-21T12:20:55.634 INFO:tasks.workunit.client.0.smithi003.stdout:2/817: dread d0/dd/d22/d37/dda/d97/fcf [0,4194304] 0 2024-09-21T12:20:55.634 INFO:tasks.workunit.client.0.smithi003.stdout:3/894: dread d0/d5/da/d28/d11/d49/d4c/fcc [0,4194304] 0 2024-09-21T12:20:55.636 INFO:tasks.workunit.client.0.smithi003.stdout:8/899: write d7/df/d36/f41 [3980669,10285] 0 2024-09-21T12:20:55.637 INFO:tasks.workunit.client.0.smithi003.stdout:2/818: write d0/d1c/d6a/f71 [2580992,121216] 0 2024-09-21T12:20:55.639 INFO:tasks.workunit.client.0.smithi003.stdout:9/953: creat d2/da/f150 x:0 0 0 2024-09-21T12:20:55.643 INFO:tasks.workunit.client.0.smithi003.stdout:3/895: fdatasync d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/f2c 0 2024-09-21T12:20:55.647 INFO:tasks.workunit.client.0.smithi003.stdout:2/819: creat d0/d21/d2f/d49/f11c x:0 0 0 2024-09-21T12:20:55.651 INFO:tasks.workunit.client.0.smithi003.stdout:9/954: dwrite d2/d20/d22/d3f/dfd/f12b [0,4194304] 0 2024-09-21T12:20:55.652 INFO:tasks.workunit.client.0.smithi003.stdout:3/896: unlink d0/d5/d38/d55/ddb/d107/c11d 0 2024-09-21T12:20:55.653 INFO:tasks.workunit.client.0.smithi003.stdout:8/900: dwrite d7/df/d20/d21/d4c/d4d/d75/f114 [0,4194304] 0 2024-09-21T12:20:55.655 INFO:tasks.workunit.client.0.smithi003.stdout:3/897: fdatasync d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/d77/f102 0 2024-09-21T12:20:55.658 INFO:tasks.workunit.client.0.smithi003.stdout:2/820: mkdir d0/d21/d2f/d9f/d11d 0 2024-09-21T12:20:55.659 INFO:tasks.workunit.client.0.smithi003.stdout:9/955: truncate d2/d20/d22/d3f/d109/f10c 675396 0 2024-09-21T12:20:55.664 INFO:tasks.workunit.client.0.smithi003.stdout:3/898: truncate d0/d5/da/d28/d31/fee 228664 0 2024-09-21T12:20:55.667 INFO:tasks.workunit.client.0.smithi003.stdout:9/956: symlink d2/da/d17/l151 0 2024-09-21T12:20:55.671 INFO:tasks.workunit.client.0.smithi003.stdout:3/899: dwrite d0/d5/da/d28/dd/f2b [0,4194304] 0 2024-09-21T12:20:55.671 INFO:tasks.workunit.client.0.smithi003.stdout:2/821: creat d0/d21/d2f/d50/dc4/d7f/d115/f11e x:0 0 0 2024-09-21T12:20:55.678 INFO:tasks.workunit.client.0.smithi003.stdout:2/822: creat d0/d21/d2f/d50/f11f x:0 0 0 2024-09-21T12:20:55.681 INFO:tasks.workunit.client.0.smithi003.stdout:9/957: dwrite d2/da/d2a/d89/f12d [0,4194304] 0 2024-09-21T12:20:55.683 INFO:tasks.workunit.client.0.smithi003.stdout:8/901: dwrite d7/df/f26 [0,4194304] 0 2024-09-21T12:20:55.686 INFO:tasks.workunit.client.0.smithi003.stdout:9/958: unlink d2/da/d2a/d3c/da2/ddd/c108 0 2024-09-21T12:20:55.691 INFO:tasks.workunit.client.0.smithi003.stdout:8/902: rename d7/df/d20/d21/l25 to d7/df/d20/l13a 0 2024-09-21T12:20:55.828 INFO:tasks.workunit.client.0.smithi003.stdout:9/959: mknod d2/d53/d75/c152 0 2024-09-21T12:20:55.832 INFO:tasks.workunit.client.0.smithi003.stdout:3/900: dwrite d0/d5/da/f70 [0,4194304] 0 2024-09-21T12:20:55.832 INFO:tasks.workunit.client.0.smithi003.stdout:2/823: dwrite d0/dd/d22/d37/dda/f10f [0,4194304] 0 2024-09-21T12:20:55.832 INFO:tasks.workunit.client.0.smithi003.stdout:2/824: readlink d0/d1c/la9 0 2024-09-21T12:20:55.835 INFO:tasks.workunit.client.0.smithi003.stdout:3/901: chown d0/d5/da/d28/d11/cb0 6984 1 2024-09-21T12:20:55.840 INFO:tasks.workunit.client.0.smithi003.stdout:8/903: write d7/df/d20/d21/d4c/d4d/d75/faa [807802,121883] 0 2024-09-21T12:20:55.840 INFO:tasks.workunit.client.0.smithi003.stdout:2/825: rename d0/f7c to d0/d21/d30/d78/f120 0 2024-09-21T12:20:55.844 INFO:tasks.workunit.client.0.smithi003.stdout:9/960: dwrite d2/da/d35/d76/d94/fac [0,4194304] 0 2024-09-21T12:20:55.846 INFO:tasks.workunit.client.0.smithi003.stdout:9/961: stat d2/d53/d83/cb7 0 2024-09-21T12:20:55.848 INFO:tasks.workunit.client.0.smithi003.stdout:2/826: truncate d0/d1c/f61 7227682 0 2024-09-21T12:20:55.851 INFO:tasks.workunit.client.0.smithi003.stdout:2/827: chown d0/d1c/feb 2185777 1 2024-09-21T12:20:55.851 INFO:tasks.workunit.client.0.smithi003.stdout:3/902: mknod d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/d11c/c128 0 2024-09-21T12:20:55.853 INFO:tasks.workunit.client.0.smithi003.stdout:2/828: rename d0/d21 to d0/d21/d2c/d6c/df9/d121 22 2024-09-21T12:20:55.855 INFO:tasks.workunit.client.0.smithi003.stdout:9/962: dwrite d2/d20/d42/da5/f113 [0,4194304] 0 2024-09-21T12:20:55.856 INFO:tasks.workunit.client.0.smithi003.stdout:9/963: stat d2/da/d2a/d3c 0 2024-09-21T12:20:55.857 INFO:tasks.workunit.client.0.smithi003.stdout:8/904: link d7/d57/d77/da5/dd4/l100 d7/df/d20/d54/d9d/dd1/l13b 0 2024-09-21T12:20:55.857 INFO:tasks.workunit.client.0.smithi003.stdout:9/964: dread - d2/da/d35/f143 zero size 2024-09-21T12:20:55.859 INFO:tasks.workunit.client.0.smithi003.stdout:2/829: creat d0/d21/d2f/d9f/d11d/f122 x:0 0 0 2024-09-21T12:20:55.862 INFO:tasks.workunit.client.0.smithi003.stdout:8/905: truncate d7/de/d81/fa4 2473136 0 2024-09-21T12:20:55.862 INFO:tasks.workunit.client.0.smithi003.stdout:3/903: getdents d0/d5/da/d28/dd 0 2024-09-21T12:20:55.864 INFO:tasks.workunit.client.0.smithi003.stdout:2/830: write d0/d21/d2f/d50/f11f [536611,43532] 0 2024-09-21T12:20:55.866 INFO:tasks.workunit.client.0.smithi003.stdout:2/831: read d0/dd/f84 [1558813,101332] 0 2024-09-21T12:20:55.868 INFO:tasks.workunit.client.0.smithi003.stdout:9/965: dwrite d2/d53/d75/f13f [0,4194304] 0 2024-09-21T12:20:55.870 INFO:tasks.workunit.client.0.smithi003.stdout:2/832: fsync d0/d21/d2f/d50/fed 0 2024-09-21T12:20:55.874 INFO:tasks.workunit.client.0.smithi003.stdout:8/906: truncate d7/df/d20/d21/d4c/d4d/d8c/f95 939926 0 2024-09-21T12:20:55.876 INFO:tasks.workunit.client.0.smithi003.stdout:2/833: creat d0/d1c/d6a/dc0/f123 x:0 0 0 2024-09-21T12:20:55.877 INFO:tasks.workunit.client.0.smithi003.stdout:2/834: readlink d0/la7 0 2024-09-21T12:20:55.878 INFO:tasks.workunit.client.0.smithi003.stdout:8/907: creat d7/df/d20/d21/dd5/f13c x:0 0 0 2024-09-21T12:20:55.878 INFO:tasks.workunit.client.0.smithi003.stdout:2/835: read d0/dd/d22/f57 [1408997,117038] 0 2024-09-21T12:20:55.881 INFO:tasks.workunit.client.0.smithi003.stdout:2/836: creat d0/de2/ddb/f124 x:0 0 0 2024-09-21T12:20:55.882 INFO:tasks.workunit.client.0.smithi003.stdout:2/837: chown d0/d21/d2c/f58 1068542214 1 2024-09-21T12:20:55.883 INFO:tasks.workunit.client.0.smithi003.stdout:8/908: mkdir d7/de/d13d 0 2024-09-21T12:20:55.883 INFO:tasks.workunit.client.0.smithi003.stdout:2/838: write d0/de2/ddb/fdc [623840,95801] 0 2024-09-21T12:20:55.884 INFO:tasks.workunit.client.0.smithi003.stdout:8/909: write d7/df/d20/d54/f8e [1219278,27159] 0 2024-09-21T12:20:55.889 INFO:tasks.workunit.client.0.smithi003.stdout:8/910: write d7/de/d1a/f68 [3276746,62452] 0 2024-09-21T12:20:55.891 INFO:tasks.workunit.client.0.smithi003.stdout:3/904: write d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/f2c [2276219,85120] 0 2024-09-21T12:20:55.893 INFO:tasks.workunit.client.0.smithi003.stdout:3/905: read d0/d5/da/d28/d11/f44 [1834,103686] 0 2024-09-21T12:20:55.899 INFO:tasks.workunit.client.0.smithi003.stdout:9/966: dwrite d2/da/d17/d40/fe1 [0,4194304] 0 2024-09-21T12:20:55.900 INFO:tasks.workunit.client.0.smithi003.stdout:9/967: chown d2/da/d17/f138 8457 1 2024-09-21T12:20:55.908 INFO:tasks.workunit.client.0.smithi003.stdout:9/968: dwrite d2/da/d35/d76/d94/d10b/f10f [0,4194304] 0 2024-09-21T12:20:55.909 INFO:tasks.workunit.client.0.smithi003.stdout:3/906: creat d0/d5/da/f129 x:0 0 0 2024-09-21T12:20:55.911 INFO:tasks.workunit.client.0.smithi003.stdout:9/969: mkdir d2/da0/d153 0 2024-09-21T12:20:55.913 INFO:tasks.workunit.client.0.smithi003.stdout:9/970: rmdir d2/da/d2a/d3c/da8 39 2024-09-21T12:20:55.916 INFO:tasks.workunit.client.0.smithi003.stdout:8/911: dwrite d7/df/d16/f93 [0,4194304] 0 2024-09-21T12:20:55.919 INFO:tasks.workunit.client.0.smithi003.stdout:3/907: mkdir d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/daa/dc4/d12a 0 2024-09-21T12:20:55.920 INFO:tasks.workunit.client.0.smithi003.stdout:3/908: chown d0/d5/da/d28/d11/d96 1918201 1 2024-09-21T12:20:55.921 INFO:tasks.workunit.client.0.smithi003.stdout:9/971: mknod d2/da/d2a/d3c/da2/daf/c154 0 2024-09-21T12:20:55.924 INFO:tasks.workunit.client.0.smithi003.stdout:8/912: dread d7/df/d20/d21/d4c/d4d/d8c/f95 [0,4194304] 0 2024-09-21T12:20:55.926 INFO:tasks.workunit.client.0.smithi003.stdout:8/913: dread - d7/d57/d77/da5/f123 zero size 2024-09-21T12:20:55.927 INFO:tasks.workunit.client.0.smithi003.stdout:9/972: dread d2/d53/d75/fbd [0,4194304] 0 2024-09-21T12:20:55.929 INFO:tasks.workunit.client.0.smithi003.stdout:9/973: dread - d2/d20/d22/d5e/d87/de2/f115 zero size 2024-09-21T12:20:55.930 INFO:tasks.workunit.client.0.smithi003.stdout:8/914: creat d7/d57/d77/da5/dd4/f13e x:0 0 0 2024-09-21T12:20:55.933 INFO:tasks.workunit.client.0.smithi003.stdout:8/915: fdatasync d7/df/d20/d21/d4c/d4d/f92 0 2024-09-21T12:20:55.935 INFO:tasks.workunit.client.0.smithi003.stdout:8/916: dread - d7/df/d20/d21/d4c/d4d/f12e zero size 2024-09-21T12:20:55.936 INFO:tasks.workunit.client.0.smithi003.stdout:9/974: read d2/da/d2a/d3c/da8/d126/f140 [1337121,81274] 0 2024-09-21T12:20:55.945 INFO:tasks.workunit.client.0.smithi003.stdout:3/909: dread d0/d5/da/f3f [0,4194304] 0 2024-09-21T12:20:55.949 INFO:tasks.workunit.client.0.smithi003.stdout:3/910: chown d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/daa/faf 2 1 2024-09-21T12:20:55.951 INFO:tasks.workunit.client.0.smithi003.stdout:8/917: dwrite d7/df/d16/fca [0,4194304] 0 2024-09-21T12:20:55.953 INFO:tasks.workunit.client.0.smithi003.stdout:9/975: dwrite d2/d20/d22/d5e/d87/fee [0,4194304] 0 2024-09-21T12:20:55.956 INFO:tasks.workunit.client.0.smithi003.stdout:3/911: unlink d0/d5/da/d28/d31/cc8 0 2024-09-21T12:20:55.973 INFO:tasks.workunit.client.0.smithi003.stdout:3/912: getdents d0/d5/da/d28/d31 0 2024-09-21T12:20:55.976 INFO:tasks.workunit.client.0.smithi003.stdout:3/913: getdents d0/d5/da/d28/de1 0 2024-09-21T12:20:55.978 INFO:tasks.workunit.client.0.smithi003.stdout:9/976: dwrite d2/d53/f7f [0,4194304] 0 2024-09-21T12:20:55.981 INFO:tasks.workunit.client.0.smithi003.stdout:9/977: chown d2/d53/d83/d96/df6/l105 15 1 2024-09-21T12:20:55.984 INFO:tasks.workunit.client.0.smithi003.stdout:8/918: dwrite d7/df/d20/fc5 [0,4194304] 0 2024-09-21T12:20:55.984 INFO:tasks.workunit.client.0.smithi003.stdout:3/914: creat d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/d42/d6d/f12b x:0 0 0 2024-09-21T12:20:55.990 INFO:tasks.workunit.client.0.smithi003.stdout:3/915: truncate d0/d5/da/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/de3/d104/f117 250924 0 2024-09-21T12:20:55.994 INFO:tasks.workunit.client.0.smithi003.stdout:3/916: creat d0/d5/d38/f12c x:0 0 0 2024-09-21T12:20:55.997 INFO:tasks.workunit.client.0.smithi003.stdout:9/978: link d2/d20/d22/d3f/c41 d2/da/d2a/d89/d9c/d11f/c155 0 2024-09-21T12:20:55.997 INFO:tasks.workunit.client.0.smithi003.stdout:8/919: write d7/de/d52/f59 [949063,111597] 0 2024-09-21T12:20:55.998 INFO:tasks.workunit.client.0.smithi003.stdout:9/979: chown d2/da/d17 12674603 1 2024-09-21T12:20:56.000 INFO:tasks.workunit.client.0.smithi003.stdout:9/980: write d2/d53/d75/ff3 [3999192,70997] 0 2024-09-21T12:20:56.001 INFO:tasks.workunit.client.0.smithi003.stdout:9/981: stat d2/da/d35/d4d 0 2024-09-21T12:20:56.003 INFO:tasks.workunit.client.0.smithi003.stdout:3/917: rename d0/d5/da to d0/d5/d38/d55/ddb/d12d 0 2024-09-21T12:20:56.005 INFO:tasks.workunit.client.0.smithi003.stdout:8/920: dwrite d7/f78 [4194304,4194304] 0 2024-09-21T12:20:56.007 INFO:tasks.workunit.client.0.smithi003.stdout:3/918: read d0/d5/d38/d55/ddb/d12d/d28/d31/f67 [1423604,45483] 0 2024-09-21T12:20:56.014 INFO:tasks.workunit.client.0.smithi003.stdout:3/919: mkdir d0/d5/d38/d55/ddb/d12d/d28/d11/d49/d4c/d6f/d91/d119/d12e 0 2024-09-21T12:20:56.014 INFO:tasks.workunit.client.0.smithi003.stdout:8/921: dwrite d7/df/d20/d21/d4c/d8a/fdb [0,4194304] 0 2024-09-21T12:20:56.018 INFO:tasks.workunit.client.0.smithi003.stdout:8/922: truncate d7/df/d20/d21/d4c/d8a/f12a 216713 0 2024-09-21T12:20:56.022 INFO:tasks.workunit.client.0.smithi003.stdout:3/920: mknod d0/d5/d38/d55/ddb/d12d/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/d42/d6d/d86/c12f 0 2024-09-21T12:20:56.023 INFO:tasks.workunit.client.0.smithi003.stdout:3/921: fdatasync d0/d5/d38/db8/fce 0 2024-09-21T12:20:56.025 INFO:tasks.workunit.client.0.smithi003.stdout:8/923: creat d7/df/d20/d24/d47/df3/d11d/d122/f13f x:0 0 0 2024-09-21T12:20:56.027 INFO:tasks.workunit.client.0.smithi003.stdout:8/924: dread - d7/df/d20/d24/d47/d79/d8f/f134 zero size 2024-09-21T12:20:56.030 INFO:tasks.workunit.client.0.smithi003.stdout:9/982: dread d2/d53/d75/fb4 [0,4194304] 0 2024-09-21T12:20:56.032 INFO:tasks.workunit.client.0.smithi003.stdout:9/983: chown d2 135804 1 2024-09-21T12:20:56.032 INFO:tasks.workunit.client.0.smithi003.stdout:8/925: dread d7/df/d16/f93 [0,4194304] 0 2024-09-21T12:20:56.033 INFO:tasks.workunit.client.0.smithi003.stdout:9/984: write d2/da/d17/f7a [3757453,74902] 0 2024-09-21T12:20:56.042 INFO:tasks.workunit.client.0.smithi003.stdout:3/922: dwrite d0/d5/d38/d55/ddb/d12d/d28/d31/f67 [0,4194304] 0 2024-09-21T12:20:56.046 INFO:tasks.workunit.client.0.smithi003.stdout:9/985: dwrite d2/d53/f93 [0,4194304] 0 2024-09-21T12:20:56.050 INFO:tasks.workunit.client.0.smithi003.stdout:3/923: getdents d0/d5/d38/d55/ddb/d12d/d28/de1 0 2024-09-21T12:20:56.052 INFO:tasks.workunit.client.0.smithi003.stdout:3/924: truncate d0/d5/d38/db8/ddf/f125 149417 0 2024-09-21T12:20:56.059 INFO:tasks.workunit.client.0.smithi003.stdout:9/986: write d2/da/d17/f27 [949965,4681] 0 2024-09-21T12:20:56.060 INFO:tasks.workunit.client.0.smithi003.stdout:3/925: chown d0/d5/d38/d55/ddb/d12d/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/d42/d6d/d86/f8e 254015269 1 2024-09-21T12:20:56.064 INFO:tasks.workunit.client.0.smithi003.stdout:3/926: mknod d0/d5/d38/d55/ddb/d12d/d28/c130 0 2024-09-21T12:20:56.065 INFO:tasks.workunit.client.0.smithi003.stdout:9/987: dwrite d2/da/d2a/d3c/da2/ff9 [0,4194304] 0 2024-09-21T12:20:56.094 INFO:tasks.workunit.client.0.smithi003.stdout:7/753: sync 2024-09-21T12:20:56.118 INFO:tasks.workunit.client.0.smithi003.stdout:3/927: dread d0/d5/d38/d55/ddb/d12d/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/d77/f9d [0,4194304] 0 2024-09-21T12:20:56.144 INFO:tasks.workunit.client.0.smithi003.stdout:7/754: dread d8/db/d32/d43/f88 [0,4194304] 0 2024-09-21T12:20:56.145 INFO:tasks.workunit.client.0.smithi003.stdout:3/928: chown d0/c9a 3205676 1 2024-09-21T12:20:56.146 INFO:tasks.workunit.client.0.smithi003.stdout:9/988: creat d2/da/d2a/d3c/f156 x:0 0 0 2024-09-21T12:20:56.149 INFO:tasks.workunit.client.0.smithi003.stdout:7/755: truncate d8/db/f16 1459990 0 2024-09-21T12:20:56.150 INFO:tasks.workunit.client.0.smithi003.stdout:3/929: mknod d0/d5/d38/d55/ddb/d12d/d28/d11/d49/d4c/d6f/d91/c131 0 2024-09-21T12:20:56.154 INFO:tasks.workunit.client.0.smithi003.stdout:7/756: read d8/d3c/d64/df5/f3a [2425610,20356] 0 2024-09-21T12:20:56.164 INFO:tasks.workunit.client.0.smithi003.stdout:7/757: link d8/d31/d84/lc3 d8/d7a/lf7 0 2024-09-21T12:20:56.171 INFO:tasks.workunit.client.0.smithi003.stdout:7/758: rename l6 to d8/db/d32/d43/lf8 0 2024-09-21T12:20:56.176 INFO:tasks.workunit.client.0.smithi003.stdout:3/930: dread d0/d5/d38/d55/ddb/d12d/d28/d11/f34 [0,4194304] 0 2024-09-21T12:20:56.177 INFO:tasks.workunit.client.0.smithi003.stdout:7/759: truncate d8/d3c/d6b/f5a 973772 0 2024-09-21T12:20:56.179 INFO:tasks.workunit.client.0.smithi003.stdout:7/760: truncate d8/d93/fe5 22761 0 2024-09-21T12:20:56.181 INFO:tasks.workunit.client.0.smithi003.stdout:3/931: chown d0/d5/d38/d55/ddb/d12d/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/d42/d6d/d86/f8e 176697535 1 2024-09-21T12:20:56.184 INFO:tasks.workunit.client.0.smithi003.stdout:3/932: dread - d0/d5/d38/d55/ddb/d12d/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/de3/f109 zero size 2024-09-21T12:20:56.193 INFO:tasks.workunit.client.0.smithi003.stdout:7/761: dwrite d8/d3c/d57/f65 [8388608,4194304] 0 2024-09-21T12:20:56.196 INFO:tasks.workunit.client.0.smithi003.stdout:7/762: write d8/d93/fcd [4956414,27238] 0 2024-09-21T12:20:56.197 INFO:tasks.workunit.client.0.smithi003.stdout:3/933: rename d0/d5/d38/d55/ddb/d12d/d28/d11/d49/d4c/f66 to d0/d5/d38/d55/ddb/d12d/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/d11c/f132 0 2024-09-21T12:20:56.199 INFO:tasks.workunit.client.0.smithi003.stdout:7/763: chown d8/d3c/l4e 8608 1 2024-09-21T12:20:56.209 INFO:tasks.workunit.client.0.smithi003.stdout:3/934: getdents d0/d5 0 2024-09-21T12:20:56.213 INFO:tasks.workunit.client.0.smithi003.stdout:9/989: dwrite d2/da/d2a/d3c/da2/daf/f7d [0,4194304] 0 2024-09-21T12:20:56.213 INFO:tasks.workunit.client.0.smithi003.stdout:9/990: stat d2/d53/f10a 0 2024-09-21T12:20:56.225 INFO:tasks.workunit.client.0.smithi003.stdout:7/764: dwrite d8/d3c/d64/f79 [0,4194304] 0 2024-09-21T12:20:56.226 INFO:tasks.workunit.client.0.smithi003.stdout:3/935: dwrite d0/d5/d38/d55/ddb/d12d/d28/d11/d49/d4c/d54/d5e/d48/f10d [0,4194304] 0 2024-09-21T12:20:56.232 INFO:tasks.workunit.client.0.smithi003.stdout:7/765: creat d8/d3c/d64/df5/d75/dd8/ff9 x:0 0 0 2024-09-21T12:20:56.236 INFO:tasks.workunit.client.0.smithi003.stdout:7/766: creat d8/d3c/d64/df5/d96/ffa x:0 0 0 2024-09-21T12:20:56.238 INFO:tasks.workunit.client.0.smithi003.stdout:7/767: rmdir d8/d3c/d57/d81 39 2024-09-21T12:20:56.239 INFO:tasks.workunit.client.0.smithi003.stdout:7/768: chown d8/d31/c46 4332134 1 2024-09-21T12:20:56.254 INFO:tasks.workunit.client.0.smithi003.stdout:3/936: dwrite d0/d5/d38/d55/ddb/d12d/d28/d11/d49/d4c/d54/d5e/d26/d7e/daa/feb [0,4194304] 0 2024-09-21T12:20:56.259 INFO:tasks.workunit.client.0.smithi003.stdout:3/937: mkdir d0/d5/d38/d55/ddb/d12d/d28/d11/d49/d4c/d6f/d91/d133 0 2024-09-21T12:20:56.262 INFO:tasks.workunit.client.0.smithi003.stdout:3/938: dread - d0/d5/d38/d55/ddb/d12d/d28/d31/d6b/de9/f106 zero size 2024-09-21T12:20:56.279 INFO:tasks.workunit.client.0.smithi003.stdout:3/939: dread d0/d5/d38/d55/ddb/d12d/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/d42/f103 [0,4194304] 0 2024-09-21T12:20:56.281 INFO:tasks.workunit.client.0.smithi003.stdout:3/940: rmdir d0/d5/d38/d55/ddb/d12d/d28/dd 39 2024-09-21T12:20:56.284 INFO:tasks.workunit.client.0.smithi003.stdout:3/941: mknod d0/d5/d38/d55/ddb/d12d/d28/d11/d49/d4c/d6f/d91/d121/c134 0 2024-09-21T12:20:56.286 INFO:tasks.workunit.client.0.smithi003.stdout:3/942: truncate d0/d5/f5c 580650 0 2024-09-21T12:20:56.290 INFO:tasks.workunit.client.0.smithi003.stdout:3/943: rename d0/d5/d38/d55/ddb/d12d/d28/d11/d49/d4c/d54/d5e/d26/f30 to d0/d5/d38/d55/ddb/d12d/d28/d31/d6b/f135 0 2024-09-21T12:20:56.309 INFO:tasks.workunit.client.0.smithi003.stdout:3/944: write d0/d5/d38/d55/ddb/d12d/fa9 [133904,71900] 0 2024-09-21T12:20:56.312 INFO:tasks.workunit.client.0.smithi003.stdout:3/945: write d0/d5/d38/d55/ddb/d12d/d28/f51 [6776095,77746] 0 2024-09-21T12:20:56.316 INFO:tasks.workunit.client.0.smithi003.stdout:3/946: symlink d0/d5/d38/d55/ddb/d12d/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/d11c/l136 0 2024-09-21T12:20:56.319 INFO:tasks.workunit.client.0.smithi003.stdout:3/947: rename d0/d5/d38/d55/ddb/d12d/d28/d11/d49/d4c/d54/d5e/d26 to d0/d5/d38/d55/ddb/d12d/d28/d11/d49/d4c/d54/d5e/d26/d7e/daa/dc4/d137 22 2024-09-21T12:20:56.361 INFO:tasks.workunit.client.0.smithi003.stdout:4/746: sync 2024-09-21T12:20:56.361 INFO:tasks.workunit.client.0.smithi003.stdout:0/976: sync 2024-09-21T12:20:56.371 INFO:tasks.workunit.client.0.smithi003.stdout:0/977: write d9/d12/d17/d21/f31 [3753946,86930] 0 2024-09-21T12:20:56.371 INFO:tasks.workunit.client.0.smithi003.stdout:4/747: truncate d9/da/d47/f4c 254093 0 2024-09-21T12:20:56.374 INFO:tasks.workunit.client.0.smithi003.stdout:0/978: creat d9/d12/d101/f159 x:0 0 0 2024-09-21T12:20:56.375 INFO:tasks.workunit.client.0.smithi003.stdout:4/748: mkdir d9/da/d47/d82/df7 0 2024-09-21T12:20:56.376 INFO:tasks.workunit.client.0.smithi003.stdout:0/979: symlink d9/d6c/d32/l15a 0 2024-09-21T12:20:56.379 INFO:tasks.workunit.client.0.smithi003.stdout:0/980: unlink d9/d12/d114/l11a 0 2024-09-21T12:20:56.380 INFO:tasks.workunit.client.0.smithi003.stdout:0/981: chown d9/d12/d1e/d5f/d8a/d125 1394512 1 2024-09-21T12:20:56.382 INFO:tasks.workunit.client.0.smithi003.stdout:0/982: mkdir d9/d12/d17/d38/d3a/d46/d55/d7b/d15b 0 2024-09-21T12:20:56.384 INFO:tasks.workunit.client.0.smithi003.stdout:0/983: write d9/d6c/d26/f73 [10097033,42740] 0 2024-09-21T12:20:56.388 INFO:tasks.workunit.client.0.smithi003.stdout:0/984: fsync d9/d12/d17/d38/d3a/d46/d55/d7b/f83 0 2024-09-21T12:20:56.390 INFO:tasks.workunit.client.0.smithi003.stdout:4/749: dread d9/da/fa5 [0,4194304] 0 2024-09-21T12:20:56.395 INFO:tasks.workunit.client.0.smithi003.stdout:4/750: symlink d9/da/d36/d55/d79/df4/lf8 0 2024-09-21T12:20:56.395 INFO:tasks.workunit.client.0.smithi003.stdout:4/751: chown d9/da/fb 780103 1 2024-09-21T12:20:56.399 INFO:tasks.workunit.client.0.smithi003.stdout:4/752: rename d9/da/d66/dbe/cc9 to d9/da/dd3/cf9 0 2024-09-21T12:20:56.451 INFO:tasks.workunit.client.0.smithi003.stdout:4/753: dwrite d9/f24 [4194304,4194304] 0 2024-09-21T12:20:56.454 INFO:tasks.workunit.client.0.smithi003.stdout:0/985: dwrite d9/d12/d17/d21/f42 [0,4194304] 0 2024-09-21T12:20:56.454 INFO:tasks.workunit.client.0.smithi003.stdout:4/754: rmdir d9/d16 39 2024-09-21T12:20:56.458 INFO:tasks.workunit.client.0.smithi003.stdout:0/986: fdatasync d9/d6c/d32/f6e 0 2024-09-21T12:20:56.459 INFO:tasks.workunit.client.0.smithi003.stdout:0/987: fdatasync d9/d12/d17/f18 0 2024-09-21T12:20:56.461 INFO:tasks.workunit.client.0.smithi003.stdout:4/755: mknod d9/da/d36/cfa 0 2024-09-21T12:20:56.462 INFO:tasks.workunit.client.0.smithi003.stdout:4/756: chown d9/da/d36/c3c 51 1 2024-09-21T12:20:56.464 INFO:tasks.workunit.client.0.smithi003.stdout:0/988: creat d9/d6c/d66/f15c x:0 0 0 2024-09-21T12:20:56.468 INFO:tasks.workunit.client.0.smithi003.stdout:4/757: rename d9/da/l74 to d9/da/d47/ddd/lfb 0 2024-09-21T12:20:56.469 INFO:tasks.workunit.client.0.smithi003.stdout:0/989: symlink d9/d12/d17/l15d 0 2024-09-21T12:20:56.472 INFO:tasks.workunit.client.0.smithi003.stdout:0/990: mknod d9/d6c/d26/d54/d7e/dde/d106/d107/d102/c15e 0 2024-09-21T12:20:56.474 INFO:tasks.workunit.client.0.smithi003.stdout:4/758: rename d9/d16/lc2 to d9/da/d66/d67/dd6/lfc 0 2024-09-21T12:20:56.475 INFO:tasks.workunit.client.0.smithi003.stdout:0/991: chown d9/d12/d17/d21/dee/c116 24039 1 2024-09-21T12:20:56.477 INFO:tasks.workunit.client.0.smithi003.stdout:0/992: truncate d9/d12/d1e/d108/f29 1680981 0 2024-09-21T12:20:56.477 INFO:tasks.workunit.client.0.smithi003.stdout:0/993: chown d9/d6c/d26/c78 101549 1 2024-09-21T12:20:56.480 INFO:tasks.workunit.client.0.smithi003.stdout:0/994: creat d9/d12/d17/d38/d3a/d46/d55/d57/f15f x:0 0 0 2024-09-21T12:20:56.486 INFO:tasks.workunit.client.0.smithi003.stdout:0/995: dwrite d9/d12/d17/d21/f31 [0,4194304] 0 2024-09-21T12:20:56.494 INFO:tasks.workunit.client.0.smithi003.stdout:0/996: dwrite d9/d6c/d26/d54/d88/f13e [0,4194304] 0 2024-09-21T12:20:56.503 INFO:tasks.workunit.client.0.smithi003.stdout:4/759: dread d9/d48/f9c [0,4194304] 0 2024-09-21T12:20:56.503 INFO:tasks.workunit.client.0.smithi003.stdout:0/997: mkdir d9/d6c/d26/d54/d7e/dde/d106/d107/d11f/d160 0 2024-09-21T12:20:56.506 INFO:tasks.workunit.client.0.smithi003.stdout:4/760: rmdir d9/da/d66/d67/dcd 39 2024-09-21T12:20:56.508 INFO:tasks.workunit.client.0.smithi003.stdout:4/761: creat d9/d16/d65/d73/ffd x:0 0 0 2024-09-21T12:20:56.511 INFO:tasks.workunit.client.0.smithi003.stdout:4/762: unlink d9/d25/c94 0 2024-09-21T12:20:56.513 INFO:tasks.workunit.client.0.smithi003.stdout:4/763: symlink d9/da/d66/lfe 0 2024-09-21T12:20:56.516 INFO:tasks.workunit.client.0.smithi003.stdout:4/764: unlink d9/da/d36/c38 0 2024-09-21T12:20:56.517 INFO:tasks.workunit.client.0.smithi003.stdout:8/926: sync 2024-09-21T12:20:56.517 INFO:tasks.workunit.client.0.smithi003.stdout:2/839: sync 2024-09-21T12:20:56.517 INFO:tasks.workunit.client.0.smithi003.stdout:8/927: readlink d7/df/d16/l7e 0 2024-09-21T12:20:56.521 INFO:tasks.workunit.client.0.smithi003.stdout:2/840: truncate d0/dd/f65 304583 0 2024-09-21T12:20:56.523 INFO:tasks.workunit.client.0.smithi003.stdout:8/928: write d7/df/d16/f93 [876030,41891] 0 2024-09-21T12:20:56.526 INFO:tasks.workunit.client.0.smithi003.stdout:2/841: creat d0/d21/d2f/d49/f125 x:0 0 0 2024-09-21T12:20:56.529 INFO:tasks.workunit.client.0.smithi003.stdout:8/929: creat d7/df/d20/d24/d47/df3/f140 x:0 0 0 2024-09-21T12:20:56.530 INFO:tasks.workunit.client.0.smithi003.stdout:2/842: creat d0/d46/f126 x:0 0 0 2024-09-21T12:20:56.533 INFO:tasks.workunit.client.0.smithi003.stdout:2/843: mkdir d0/d1c/d6a/dc0/d127 0 2024-09-21T12:20:56.537 INFO:tasks.workunit.client.0.smithi003.stdout:4/765: dwrite d9/da/fb [4194304,4194304] 0 2024-09-21T12:20:56.541 INFO:tasks.workunit.client.0.smithi003.stdout:4/766: creat d9/da/d36/d55/dec/fff x:0 0 0 2024-09-21T12:20:56.543 INFO:tasks.workunit.client.0.smithi003.stdout:2/844: dread d0/d21/d30/f43 [0,4194304] 0 2024-09-21T12:20:56.544 INFO:tasks.workunit.client.0.smithi003.stdout:4/767: read d9/d25/f7a [2439048,28108] 0 2024-09-21T12:20:56.547 INFO:tasks.workunit.client.0.smithi003.stdout:8/930: dread d7/de/d1a/fc9 [0,4194304] 0 2024-09-21T12:20:56.553 INFO:tasks.workunit.client.0.smithi003.stdout:4/768: stat d9/da/d66/d67/dcd/dd8/d72/cc6 0 2024-09-21T12:20:56.556 INFO:tasks.workunit.client.0.smithi003.stdout:2/845: rename d0/d21/d30/f110 to d0/dd/d22/d37/f128 0 2024-09-21T12:20:56.557 INFO:tasks.workunit.client.0.smithi003.stdout:4/769: creat d9/da/d66/da2/f100 x:0 0 0 2024-09-21T12:20:56.558 INFO:tasks.workunit.client.0.smithi003.stdout:4/770: write d9/d16/d65/d73/d8d/fad [1325040,81816] 0 2024-09-21T12:20:56.563 INFO:tasks.workunit.client.0.smithi003.stdout:4/771: fdatasync d9/da/d66/da2/fee 0 2024-09-21T12:20:56.566 INFO:tasks.workunit.client.0.smithi003.stdout:8/931: dwrite d7/de/fa9 [4194304,4194304] 0 2024-09-21T12:20:56.572 INFO:tasks.workunit.client.0.smithi003.stdout:8/932: dread d7/de/d85/fea [0,4194304] 0 2024-09-21T12:20:56.573 INFO:tasks.workunit.client.0.smithi003.stdout:4/772: creat d9/d48/f101 x:0 0 0 2024-09-21T12:20:56.576 INFO:tasks.workunit.client.0.smithi003.stdout:8/933: write d7/de/d81/fe1 [811100,100184] 0 2024-09-21T12:20:56.578 INFO:tasks.workunit.client.0.smithi003.stdout:8/934: fsync d7/df/d20/d21/d4c/d4d/d8c/f137 0 2024-09-21T12:20:56.578 INFO:tasks.workunit.client.0.smithi003.stdout:4/773: mknod d9/da/c102 0 2024-09-21T12:20:56.579 INFO:tasks.workunit.client.0.smithi003.stdout:8/935: dread - d7/d57/d77/da5/dd4/f13e zero size 2024-09-21T12:20:56.581 INFO:tasks.workunit.client.0.smithi003.stdout:4/774: read d9/da/d47/f4c [3669,11611] 0 2024-09-21T12:20:56.582 INFO:tasks.workunit.client.0.smithi003.stdout:8/936: creat d7/de/d52/f141 x:0 0 0 2024-09-21T12:20:56.582 INFO:tasks.workunit.client.0.smithi003.stdout:4/775: chown d9/da/d36/f50 16 1 2024-09-21T12:20:56.584 INFO:tasks.workunit.client.0.smithi003.stdout:8/937: creat d7/d57/d77/f142 x:0 0 0 2024-09-21T12:20:56.586 INFO:tasks.workunit.client.0.smithi003.stdout:4/776: rename d9/da/c4d to d9/da/dab/dd4/c103 0 2024-09-21T12:20:56.599 INFO:tasks.workunit.client.0.smithi003.stdout:8/938: dwrite d7/de/d85/fb2 [0,4194304] 0 2024-09-21T12:20:56.605 INFO:tasks.workunit.client.0.smithi003.stdout:8/939: creat d7/df/d20/d21/dd5/f143 x:0 0 0 2024-09-21T12:20:56.606 INFO:tasks.workunit.client.0.smithi003.stdout:4/777: dwrite d9/da/d66/da2/fee [0,4194304] 0 2024-09-21T12:20:56.608 INFO:tasks.workunit.client.0.smithi003.stdout:4/778: mkdir d9/d16/d65/d73/d104 0 2024-09-21T12:20:56.609 INFO:tasks.workunit.client.0.smithi003.stdout:8/940: mkdir d7/d57/d77/d144 0 2024-09-21T12:20:56.612 INFO:tasks.workunit.client.0.smithi003.stdout:8/941: mkdir d7/d57/d77/da5/dd4/d145 0 2024-09-21T12:20:56.614 INFO:tasks.workunit.client.0.smithi003.stdout:8/942: fsync d7/df/d20/d21/d4c/d8a/f12a 0 2024-09-21T12:20:56.618 INFO:tasks.workunit.client.0.smithi003.stdout:8/943: mkdir d7/df/d20/d21/d4c/d4d/d75/ddd/d146 0 2024-09-21T12:20:56.623 INFO:tasks.workunit.client.0.smithi003.stdout:8/944: dread d7/df/d16/f93 [0,4194304] 0 2024-09-21T12:20:56.625 INFO:tasks.workunit.client.0.smithi003.stdout:8/945: mkdir d7/df/d147 0 2024-09-21T12:20:56.627 INFO:tasks.workunit.client.0.smithi003.stdout:8/946: mkdir d7/de/d13d/d148 0 2024-09-21T12:20:56.628 INFO:tasks.workunit.client.0.smithi003.stdout:8/947: read - d7/df/d20/d21/d4c/d4d/f12e zero size 2024-09-21T12:20:56.630 INFO:tasks.workunit.client.0.smithi003.stdout:8/948: mknod d7/df/d20/d24/d47/d79/c149 0 2024-09-21T12:20:56.634 INFO:tasks.workunit.client.0.smithi003.stdout:8/949: rename d7/df/d20/d21/f12d to d7/df/d20/d24/d47/f14a 0 2024-09-21T12:20:56.637 INFO:tasks.workunit.client.0.smithi003.stdout:8/950: symlink d7/df/l14b 0 2024-09-21T12:20:56.638 INFO:tasks.workunit.client.0.smithi003.stdout:8/951: chown d7/f18 2031 1 2024-09-21T12:20:56.638 INFO:tasks.workunit.client.0.smithi003.stdout:4/779: dread d9/d16/d65/d73/fa3 [0,4194304] 0 2024-09-21T12:20:56.641 INFO:tasks.workunit.client.0.smithi003.stdout:8/952: creat d7/df/d20/d24/d47/df3/f14c x:0 0 0 2024-09-21T12:20:56.642 INFO:tasks.workunit.client.0.smithi003.stdout:4/780: symlink d9/l105 0 2024-09-21T12:20:56.644 INFO:tasks.workunit.client.0.smithi003.stdout:8/953: dread d7/de/d52/fac [0,4194304] 0 2024-09-21T12:20:56.654 INFO:tasks.workunit.client.0.smithi003.stdout:4/781: write d9/d16/d65/d73/fd7 [771348,65961] 0 2024-09-21T12:20:56.658 INFO:tasks.workunit.client.0.smithi003.stdout:4/782: fsync d9/fc 0 2024-09-21T12:20:56.659 INFO:tasks.workunit.client.0.smithi003.stdout:8/954: dwrite f0 [0,4194304] 0 2024-09-21T12:20:56.660 INFO:tasks.workunit.client.0.smithi003.stdout:4/783: chown d9/da/d47/d82/fbc 567941 1 2024-09-21T12:20:56.664 INFO:tasks.workunit.client.0.smithi003.stdout:4/784: mkdir d9/da/d66/d67/dd6/d106 0 2024-09-21T12:20:56.664 INFO:tasks.workunit.client.0.smithi003.stdout:4/785: dread - d9/da/d36/d55/dec/fff zero size 2024-09-21T12:20:56.665 INFO:tasks.workunit.client.0.smithi003.stdout:8/955: link d7/df/d16/fca d7/df/d20/d24/d47/df3/f14d 0 2024-09-21T12:20:56.668 INFO:tasks.workunit.client.0.smithi003.stdout:4/786: symlink d9/da/d66/dbe/l107 0 2024-09-21T12:20:56.669 INFO:tasks.workunit.client.0.smithi003.stdout:8/956: rmdir d7/de 39 2024-09-21T12:20:56.671 INFO:tasks.workunit.client.0.smithi003.stdout:4/787: truncate d9/d25/f5e 305831 0 2024-09-21T12:20:56.671 INFO:tasks.workunit.client.0.smithi003.stdout:8/957: chown d7/df/d20/c94 52387996 1 2024-09-21T12:20:56.674 INFO:tasks.workunit.client.0.smithi003.stdout:4/788: mkdir d9/da/d66/d67/dcd/dd8/d72/d108 0 2024-09-21T12:20:56.674 INFO:tasks.workunit.client.0.smithi003.stdout:8/958: read d7/df/d20/d21/d4c/d4d/f92 [904591,37995] 0 2024-09-21T12:20:56.677 INFO:tasks.workunit.client.0.smithi003.stdout:8/959: creat d7/df/d20/d21/d4c/d4d/d75/ddd/f14e x:0 0 0 2024-09-21T12:20:56.680 INFO:tasks.workunit.client.0.smithi003.stdout:8/960: symlink d7/df/d20/d24/d47/d79/d8f/l14f 0 2024-09-21T12:20:56.693 INFO:tasks.workunit.client.0.smithi003.stdout:8/961: rename d7/de/d52/c96 to d7/df/d20/d54/c150 0 2024-09-21T12:20:56.695 INFO:tasks.workunit.client.0.smithi003.stdout:4/789: dwrite d9/da/d66/d67/fb6 [0,4194304] 0 2024-09-21T12:20:56.699 INFO:tasks.workunit.client.0.smithi003.stdout:9/991: sync 2024-09-21T12:20:56.702 INFO:tasks.workunit.client.0.smithi003.stdout:4/790: getdents d9/da/d66/d67/dd6/d106 0 2024-09-21T12:20:56.703 INFO:tasks.workunit.client.0.smithi003.stdout:4/791: chown d9/f15 11 1 2024-09-21T12:20:56.706 INFO:tasks.workunit.client.0.smithi003.stdout:8/962: dwrite d7/df/d20/d21/de6/f111 [0,4194304] 0 2024-09-21T12:20:56.709 INFO:tasks.workunit.client.0.smithi003.stdout:9/992: rename d2/f97 to d2/da/d35/f157 0 2024-09-21T12:20:56.712 INFO:tasks.workunit.client.0.smithi003.stdout:9/993: mknod d2/da/d35/d76/d94/c158 0 2024-09-21T12:20:56.716 INFO:tasks.workunit.client.0.smithi003.stdout:4/792: rename d9/da/dab/dd4/c103 to d9/da/dab/c109 0 2024-09-21T12:20:56.717 INFO:tasks.workunit.client.0.smithi003.stdout:9/994: mknod d2/d53/d75/de4/df4/c159 0 2024-09-21T12:20:56.718 INFO:tasks.workunit.client.0.smithi003.stdout:4/793: fsync d9/d16/d65/d73/f9a 0 2024-09-21T12:20:56.722 INFO:tasks.workunit.client.0.smithi003.stdout:4/794: mknod d9/da/d66/d67/dd6/d106/c10a 0 2024-09-21T12:20:56.723 INFO:tasks.workunit.client.0.smithi003.stdout:4/795: stat d9/da/d66/d67/dcd/dd8/d72/cc6 0 2024-09-21T12:20:56.736 INFO:tasks.workunit.client.0.smithi003.stdout:4/796: dread d9/da/d66/fe8 [0,4194304] 0 2024-09-21T12:20:56.739 INFO:tasks.workunit.client.0.smithi003.stdout:4/797: mkdir d9/da/d10b 0 2024-09-21T12:20:56.740 INFO:tasks.workunit.client.0.smithi003.stdout:9/995: write d2/d53/d75/fb4 [3619344,112372] 0 2024-09-21T12:20:56.743 INFO:tasks.workunit.client.0.smithi003.stdout:4/798: creat d9/d16/d65/d73/d104/f10c x:0 0 0 2024-09-21T12:20:56.745 INFO:tasks.workunit.client.0.smithi003.stdout:9/996: mknod d2/d20/d22/d5e/d87/d146/c15a 0 2024-09-21T12:20:56.748 INFO:tasks.workunit.client.0.smithi003.stdout:9/997: rename d2/da/d17/f7a to d2/da/d2a/d3c/da8/f15b 0 2024-09-21T12:20:56.754 INFO:tasks.workunit.client.0.smithi003.stdout:9/998: creat d2/d53/df8/f15c x:0 0 0 2024-09-21T12:20:56.755 INFO:tasks.workunit.client.0.smithi003.stdout:9/999: chown d2/d53/d83/fdb 4 1 2024-09-21T12:20:56.756 INFO:tasks.workunit.client.0.smithi003.stdout:4/799: dwrite d9/d16/f70 [0,4194304] 0 2024-09-21T12:20:56.767 INFO:tasks.workunit.client.0.smithi003.stdout:4/800: getdents d9/da/d36/da9 0 2024-09-21T12:20:56.768 INFO:tasks.workunit.client.0.smithi003.stdout:4/801: chown d9/d16/d65/d73/fa3 0 1 2024-09-21T12:20:56.770 INFO:tasks.workunit.client.0.smithi003.stdout:4/802: mknod d9/da/d36/d55/c10d 0 2024-09-21T12:20:56.772 INFO:tasks.workunit.client.0.smithi003.stdout:4/803: mknod d9/da/d36/d55/c10e 0 2024-09-21T12:20:56.773 INFO:tasks.workunit.client.0.smithi003.stdout:4/804: write d9/d16/f70 [908432,68585] 0 2024-09-21T12:20:56.775 INFO:tasks.workunit.client.0.smithi003.stdout:7/769: sync 2024-09-21T12:20:56.778 INFO:tasks.workunit.client.0.smithi003.stdout:7/770: creat d8/db/d32/d43/ffb x:0 0 0 2024-09-21T12:20:56.782 INFO:tasks.workunit.client.0.smithi003.stdout:7/771: truncate d8/d3c/d64/df5/f1a 1560732 0 2024-09-21T12:20:56.788 INFO:tasks.workunit.client.0.smithi003.stdout:4/805: dread d9/da/d66/d67/dcd/dd8/fb1 [0,4194304] 0 2024-09-21T12:20:56.789 INFO:tasks.workunit.client.0.smithi003.stdout:4/806: chown d9/d48/f9c 345 1 2024-09-21T12:20:56.797 INFO:tasks.workunit.client.0.smithi003.stdout:7/772: dread d8/d3c/f3e [0,4194304] 0 2024-09-21T12:20:56.804 INFO:tasks.workunit.client.0.smithi003.stdout:7/773: getdents d8/d3c/d64/df0/dbf 0 2024-09-21T12:20:56.804 INFO:tasks.workunit.client.0.smithi003.stdout:4/807: dwrite d9/d16/d65/d97/fd1 [0,4194304] 0 2024-09-21T12:20:56.807 INFO:tasks.workunit.client.0.smithi003.stdout:4/808: fsync d9/da/fa5 0 2024-09-21T12:20:56.813 INFO:tasks.workunit.client.0.smithi003.stdout:7/774: symlink d8/d3c/d6b/dcc/lfc 0 2024-09-21T12:20:56.814 INFO:tasks.workunit.client.0.smithi003.stdout:7/775: stat d8/dea/lc8 0 2024-09-21T12:20:56.819 INFO:tasks.workunit.client.0.smithi003.stdout:7/776: getdents d8/d3c/d64/df0 0 2024-09-21T12:20:56.829 INFO:tasks.workunit.client.0.smithi003.stdout:4/809: dread f6 [0,4194304] 0 2024-09-21T12:20:56.830 INFO:tasks.workunit.client.0.smithi003.stdout:4/810: chown d9/da/c21 1896487 1 2024-09-21T12:20:56.833 INFO:tasks.workunit.client.0.smithi003.stdout:4/811: mkdir d9/d48/d10f 0 2024-09-21T12:20:56.834 INFO:tasks.workunit.client.0.smithi003.stdout:4/812: dread - d9/da/d66/d67/dcd/dd8/d72/f6f zero size 2024-09-21T12:20:56.840 INFO:tasks.workunit.client.0.smithi003.stdout:4/813: dwrite d9/f24 [4194304,4194304] 0 2024-09-21T12:20:56.845 INFO:tasks.workunit.client.0.smithi003.stdout:4/814: link d9/da/dab/fb7 d9/da/d47/ddd/f110 0 2024-09-21T12:20:56.846 INFO:tasks.workunit.client.0.smithi003.stdout:4/815: stat d9/da/dab/fb7 0 2024-09-21T12:20:56.849 INFO:tasks.workunit.client.0.smithi003.stdout:4/816: mknod d9/d16/c111 0 2024-09-21T12:20:56.851 INFO:tasks.workunit.client.0.smithi003.stdout:4/817: mkdir d9/da/d36/d112 0 2024-09-21T12:20:56.871 INFO:tasks.workunit.client.0.smithi003.stdout:4/818: dwrite d9/d16/d65/f7f [0,4194304] 0 2024-09-21T12:20:56.876 INFO:tasks.workunit.client.0.smithi003.stdout:4/819: symlink d9/da/d66/da2/ddc/l113 0 2024-09-21T12:20:56.879 INFO:tasks.workunit.client.0.smithi003.stdout:4/820: fdatasync d9/d25/fa6 0 2024-09-21T12:20:56.882 INFO:tasks.workunit.client.0.smithi003.stdout:4/821: mkdir d9/da/d66/d67/dd6/d106/d114 0 2024-09-21T12:20:56.888 INFO:tasks.workunit.client.0.smithi003.stdout:4/822: dwrite d9/da/d36/dcc/feb [0,4194304] 0 2024-09-21T12:20:56.892 INFO:tasks.workunit.client.0.smithi003.stdout:4/823: mkdir d9/da/d47/ddd/d115 0 2024-09-21T12:20:56.894 INFO:tasks.workunit.client.0.smithi003.stdout:4/824: rmdir d9/da/d66/dbe 39 2024-09-21T12:20:56.897 INFO:tasks.workunit.client.0.smithi003.stdout:4/825: creat d9/d16/d65/d97/f116 x:0 0 0 2024-09-21T12:20:56.898 INFO:tasks.workunit.client.0.smithi003.stdout:4/826: chown d9/da/d47/ddd/fe4 200 1 2024-09-21T12:20:56.913 INFO:tasks.workunit.client.0.smithi003.stdout:4/827: dread d9/da/d66/d67/dcd/fea [4194304,4194304] 0 2024-09-21T12:20:56.914 INFO:tasks.workunit.client.0.smithi003.stdout:4/828: readlink d9/da/d66/lfe 0 2024-09-21T12:20:56.916 INFO:tasks.workunit.client.0.smithi003.stdout:4/829: rename d9/da/l11 to d9/da/dab/dd4/l117 0 2024-09-21T12:20:56.917 INFO:tasks.workunit.client.0.smithi003.stdout:4/830: write d9/d16/d65/f7f [4966228,66246] 0 2024-09-21T12:20:56.918 INFO:tasks.workunit.client.0.smithi003.stdout:4/831: fsync d9/d16/d65/d97/fd1 0 2024-09-21T12:20:56.922 INFO:tasks.workunit.client.0.smithi003.stdout:4/832: readlink d9/da/d47/ddd/lfb 0 2024-09-21T12:20:56.928 INFO:tasks.workunit.client.0.smithi003.stdout:4/833: getdents d9/da/dab 0 2024-09-21T12:20:56.929 INFO:tasks.workunit.client.0.smithi003.stdout:4/834: mknod d9/da/d36/d112/c118 0 2024-09-21T12:20:56.956 INFO:tasks.workunit.client.0.smithi003.stdout:3/948: sync 2024-09-21T12:20:56.961 INFO:tasks.workunit.client.0.smithi003.stdout:3/949: creat d0/d5/d38/d55/ddb/d12d/d28/d11/d49/d4c/d54/d5e/d26/d7e/daa/dc4/d12a/f138 x:0 0 0 2024-09-21T12:20:56.965 INFO:tasks.workunit.client.0.smithi003.stdout:3/950: mkdir d0/d5/d38/d55/ddb/d12d/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/d42/d6d/d139 0 2024-09-21T12:20:56.968 INFO:tasks.workunit.client.0.smithi003.stdout:3/951: mkdir d0/d5/d38/d55/ddb/d12d/d28/d11/d49/d4c/d54/d5e/d48/d13a 0 2024-09-21T12:20:56.982 INFO:tasks.workunit.client.0.smithi003.stdout:3/952: dwrite d0/d5/d38/d55/ddb/d12d/d28/dd/fae [0,4194304] 0 2024-09-21T12:20:56.986 INFO:tasks.workunit.client.0.smithi003.stdout:3/953: mknod d0/d5/d38/d55/ddb/d12d/d28/d11/d96/c13b 0 2024-09-21T12:20:56.992 INFO:tasks.workunit.client.0.smithi003.stdout:3/954: dwrite d0/d5/d38/d55/ddb/d12d/d28/d11/d49/d4c/d6f/d91/fe0 [0,4194304] 0 2024-09-21T12:20:57.019 INFO:tasks.workunit.client.0.smithi003.stdout:3/955: dwrite d0/d5/d38/d55/ddb/d12d/d28/d31/d6b/fc0 [0,4194304] 0 2024-09-21T12:20:57.033 INFO:tasks.workunit.client.0.smithi003.stdout:3/956: dwrite d0/d5/d38/d55/ddb/d12d/d28/d11/d49/d4c/d54/d5e/d26/fa7 [0,4194304] 0 2024-09-21T12:20:57.040 INFO:tasks.workunit.client.0.smithi003.stdout:3/957: creat d0/d5/d38/d55/ddb/d12d/d28/d11/d49/d4c/f13c x:0 0 0 2024-09-21T12:20:57.043 INFO:tasks.workunit.client.0.smithi003.stdout:3/958: mknod d0/d5/d38/d55/ddb/d12d/d28/d31/d6b/d79/c13d 0 2024-09-21T12:20:57.046 INFO:tasks.workunit.client.0.smithi003.stdout:3/959: creat d0/d5/d38/d55/ddb/d12d/d28/d31/d6b/f13e x:0 0 0 2024-09-21T12:20:57.047 INFO:tasks.workunit.client.0.smithi003.stdout:3/960: stat d0/d5/d38/d55/ddb/d12d/d28/d11/d49/f76 0 2024-09-21T12:20:57.055 INFO:tasks.workunit.client.0.smithi003.stdout:3/961: dwrite d0/d5/d38/d55/ddb/d12d/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/d77/f102 [0,4194304] 0 2024-09-21T12:20:57.070 INFO:tasks.workunit.client.0.smithi003.stdout:3/962: getdents d0/d5/d38/d55/ddb/d12d/d28/d11/d49/d4c/d54/d5e/d48 0 2024-09-21T12:20:57.073 INFO:tasks.workunit.client.0.smithi003.stdout:3/963: mknod d0/d5/d38/d55/ddb/d12d/d28/dd/c13f 0 2024-09-21T12:20:57.075 INFO:tasks.workunit.client.0.smithi003.stdout:3/964: mknod d0/d5/d38/db8/ddf/c140 0 2024-09-21T12:20:57.088 INFO:tasks.workunit.client.0.smithi003.stdout:3/965: rename d0/d5/d38/d55/ddb/d12d/d28/d11/d49/d4c/d54/d5e/d48/lf9 to d0/d5/d38/d55/ddb/d12d/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/d42/d6d/d86/l141 0 2024-09-21T12:20:57.121 INFO:tasks.workunit.client.0.smithi003.stdout:3/966: readlink d0/d5/d38/d55/ddb/d12d/d28/d11/d49/d4c/l9e 0 2024-09-21T12:20:57.134 INFO:tasks.workunit.client.0.smithi003.stdout:3/967: dread d0/d5/d38/d55/ddb/d12d/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/d77/dd3/fdd [0,4194304] 0 2024-09-21T12:20:57.151 INFO:tasks.workunit.client.0.smithi003.stdout:3/968: truncate d0/d5/d38/d55/ddb/d12d/d28/d31/d6b/f135 122461 0 2024-09-21T12:20:57.153 INFO:tasks.workunit.client.0.smithi003.stdout:3/969: symlink d0/d5/d38/d55/ddb/d12d/d28/l142 0 2024-09-21T12:20:57.155 INFO:tasks.workunit.client.0.smithi003.stdout:3/970: mkdir d0/d5/d38/db8/ddf/d143 0 2024-09-21T12:20:57.157 INFO:tasks.workunit.client.0.smithi003.stdout:3/971: dread - d0/d5/d38/d55/ddb/d12d/d28/d31/d6b/ffe zero size 2024-09-21T12:20:57.161 INFO:tasks.workunit.client.0.smithi003.stdout:3/972: creat d0/d5/d38/d55/ddb/d12d/d28/d11/d49/d4c/d6f/d91/d133/f144 x:0 0 0 2024-09-21T12:20:57.166 INFO:tasks.workunit.client.0.smithi003.stdout:3/973: rename d0/d5/d38/d55/ddb/cf1 to d0/d5/d38/d55/ddb/d12d/d28/d11/d49/d4c/c145 0 2024-09-21T12:20:57.168 INFO:tasks.workunit.client.0.smithi003.stdout:3/974: rename d0/d5/d38/d55/ddb/d12d/d28 to d0/d5/d38/d55/ddb/d12d/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/d77/d146 22 2024-09-21T12:20:57.188 INFO:tasks.workunit.client.0.smithi003.stdout:3/975: write d0/d5/d38/d55/ddb/d12d/d28/d31/d6b/ffe [76395,108675] 0 2024-09-21T12:20:57.191 INFO:tasks.workunit.client.0.smithi003.stdout:3/976: mknod d0/d5/d38/d55/ddb/d12d/d28/d11/d49/d4c/d6f/d91/d121/c147 0 2024-09-21T12:20:57.195 INFO:tasks.workunit.client.0.smithi003.stdout:3/977: creat d0/d5/d38/d55/ddb/d12d/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/d42/d6d/d139/f148 x:0 0 0 2024-09-21T12:20:57.209 INFO:tasks.workunit.client.0.smithi003.stdout:3/978: dwrite d0/d5/d38/d55/ddb/d12d/d28/d11/f34 [0,4194304] 0 2024-09-21T12:20:57.210 INFO:tasks.workunit.client.0.smithi003.stdout:3/979: chown d0/d5/c11e 504141941 1 2024-09-21T12:20:57.214 INFO:tasks.workunit.client.0.smithi003.stdout:3/980: read d0/d5/d38/d55/ddb/d12d/d28/d11/d49/d4c/d54/d5e/d26/d7e/daa/faf [165012,24525] 0 2024-09-21T12:20:57.215 INFO:tasks.workunit.client.0.smithi003.stdout:3/981: dread - d0/d5/d38/f12c zero size 2024-09-21T12:20:57.221 INFO:tasks.workunit.client.0.smithi003.stdout:3/982: rename d0/d5/d38/d55/ddb/d12d/d28/d11/d49/d4c/d54/d5e/d48/f8f to d0/d5/d38/d55/ddb/d12d/d28/d11/d49/d4c/d6f/d91/d119/d12e/f149 0 2024-09-21T12:20:57.229 INFO:tasks.workunit.client.0.smithi003.stdout:3/983: dwrite d0/d5/d38/d55/ddb/d12d/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/f126 [0,4194304] 0 2024-09-21T12:20:57.238 INFO:tasks.workunit.client.0.smithi003.stdout:3/984: dwrite d0/d5/d38/d55/ddb/d12d/d28/d31/d6b/fc0 [4194304,4194304] 0 2024-09-21T12:20:57.239 INFO:tasks.workunit.client.0.smithi003.stdout:3/985: chown d0/d5/d38/d55/ddb/d12d/d28/d11/d96/de2 4538 1 2024-09-21T12:20:57.248 INFO:tasks.workunit.client.0.smithi003.stdout:2/846: sync 2024-09-21T12:20:57.248 INFO:tasks.workunit.client.0.smithi003.stdout:0/998: sync 2024-09-21T12:20:57.248 INFO:tasks.workunit.client.0.smithi003.stdout:8/963: sync 2024-09-21T12:20:57.249 INFO:tasks.workunit.client.0.smithi003.stdout:0/999: chown d9/d12/d1e/d5f/c9b 36 1 2024-09-21T12:20:57.250 INFO:tasks.workunit.client.0.smithi003.stdout:8/964: write d7/df/d20/ff0 [1777234,120152] 0 2024-09-21T12:20:57.253 INFO:tasks.workunit.client.0.smithi003.stdout:2/847: symlink d0/dd/d22/d37/dda/d97/l129 0 2024-09-21T12:20:57.262 INFO:tasks.workunit.client.0.smithi003.stdout:2/848: write d0/d21/d2f/d49/fe1 [1032306,76373] 0 2024-09-21T12:20:57.263 INFO:tasks.workunit.client.0.smithi003.stdout:2/849: chown d0/d21/d2c/d6c/df9/c10d 1027243148 1 2024-09-21T12:20:57.264 INFO:tasks.workunit.client.0.smithi003.stdout:3/986: dread d0/d5/d38/d55/ddb/d12d/f3f [0,4194304] 0 2024-09-21T12:20:57.271 INFO:tasks.workunit.client.0.smithi003.stdout:3/987: write d0/d5/d38/d55/ddb/d12d/d28/d31/f63 [1334792,17976] 0 2024-09-21T12:20:57.327 INFO:tasks.workunit.client.0.smithi003.stdout:3/988: write d0/d5/d38/d55/ddb/d12d/d28/d11/d49/d4c/d54/d5e/d26/f115 [364298,55119] 0 2024-09-21T12:20:57.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:57 smithi003 ceph-mon[28057]: pgmap v15: 65 pgs: 65 active+clean; 2.9 GiB data, 8.6 GiB used, 528 GiB / 536 GiB avail; 47 MiB/s rd, 104 MiB/s wr, 284 op/s 2024-09-21T12:20:57.330 INFO:tasks.workunit.client.0.smithi003.stdout:2/850: dread d0/de2/ddb/fdc [0,4194304] 0 2024-09-21T12:20:57.331 INFO:tasks.workunit.client.0.smithi003.stdout:3/989: mkdir d0/d5/d38/d55/ddb/d12d/d28/d31/d6b/de9/d14a 0 2024-09-21T12:20:57.331 INFO:tasks.workunit.client.0.smithi003.stdout:2/851: stat d0/d21/d2c/d6c 0 2024-09-21T12:20:57.336 INFO:tasks.workunit.client.0.smithi003.stdout:3/990: rename d0/d5/d38/d55/ddb/d12d/d28/d31/d6b/d113 to d0/d5/d38/d55/ddb/d12d/d28/d11/d49/d4c/d6f/d91/d133/d14b 0 2024-09-21T12:20:57.338 INFO:tasks.workunit.client.0.smithi003.stdout:2/852: fsync d0/dd/d22/d37/f48 0 2024-09-21T12:20:57.342 INFO:tasks.workunit.client.0.smithi003.stdout:3/991: rename d0/d5/f36 to d0/d5/d38/d55/ddb/d12d/d28/d11/d96/f14c 0 2024-09-21T12:20:57.346 INFO:tasks.workunit.client.0.smithi003.stdout:2/853: mkdir d0/dd/d22/d37/dda/d109/d12a 0 2024-09-21T12:20:57.347 INFO:tasks.workunit.client.0.smithi003.stdout:2/854: chown d0/dd/f8c 85 1 2024-09-21T12:20:57.358 INFO:tasks.workunit.client.0.smithi003.stdout:3/992: dread d0/d5/d38/d55/ddb/d12d/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/d42/d6d/d86/f8e [0,4194304] 0 2024-09-21T12:20:57.363 INFO:tasks.workunit.client.0.smithi003.stdout:3/993: mkdir d0/d5/d38/d55/ddb/d12d/d28/d31/d6b/de9/d14d 0 2024-09-21T12:20:57.364 INFO:tasks.workunit.client.0.smithi003.stdout:2/855: dread d0/d1c/f2e [0,4194304] 0 2024-09-21T12:20:57.368 INFO:tasks.workunit.client.0.smithi003.stdout:3/994: unlink d0/d5/d38/d55/ddb/d12d/d28/d11/d49/d4c/d54/d5e/d26/d7e/daa/dc4/d12a/f138 0 2024-09-21T12:20:57.373 INFO:tasks.workunit.client.0.smithi003.stdout:3/995: stat d0/d5/d38/d55/ddb/d12d/d28/c3c 0 2024-09-21T12:20:57.373 INFO:tasks.workunit.client.0.smithi003.stdout:2/856: write d0/d21/d2c/d6c/f8a [3254294,92020] 0 2024-09-21T12:20:57.374 INFO:tasks.workunit.client.0.smithi003.stdout:2/857: readlink d0/d46/dcd/l118 0 2024-09-21T12:20:57.376 INFO:tasks.workunit.client.0.smithi003.stdout:3/996: creat d0/d5/d38/d55/ddb/d12d/d28/d31/d6b/de9/f14e x:0 0 0 2024-09-21T12:20:57.378 INFO:tasks.workunit.client.0.smithi003.stdout:2/858: rename d0/dd/f8c to d0/d21/d2f/d50/dc4/f12b 0 2024-09-21T12:20:57.382 INFO:tasks.workunit.client.0.smithi003.stdout:3/997: dwrite d0/d5/d38/f12c [0,4194304] 0 2024-09-21T12:20:57.397 INFO:tasks.workunit.client.0.smithi003.stdout:3/998: truncate d0/d5/d38/d55/ddb/d12d/d28/dd/fae 863077 0 2024-09-21T12:20:57.398 INFO:tasks.workunit.client.0.smithi003.stdout:2/859: dread d0/f25 [0,4194304] 0 2024-09-21T12:20:57.403 INFO:tasks.workunit.client.0.smithi003.stdout:2/860: write d0/d21/d2f/d9f/fbd [970722,3876] 0 2024-09-21T12:20:57.407 INFO:tasks.workunit.client.0.smithi003.stdout:2/861: rename d0/d21/d30/fcb to d0/d21/d2f/d50/dc4/dc7/f12c 0 2024-09-21T12:20:57.409 INFO:tasks.workunit.client.0.smithi003.stdout:3/999: dwrite d0/d5/d38/d55/ddb/d12d/d28/d11/d49/d4c/d54/d5e/d26/d7e/d83/d42/f103 [0,4194304] 0 2024-09-21T12:20:57.410 INFO:tasks.workunit.client.0.smithi003.stdout:2/862: getdents d0/d46/dcd 0 2024-09-21T12:20:57.418 INFO:tasks.workunit.client.0.smithi003.stdout:2/863: dread d0/dd/d22/d37/f5c [0,4194304] 0 2024-09-21T12:20:57.433 INFO:tasks.workunit.client.0.smithi003.stdout:2/864: dwrite d0/d21/d2f/d50/dc4/f9b [0,4194304] 0 2024-09-21T12:20:57.433 INFO:tasks.workunit.client.0.smithi003.stdout:7/777: sync 2024-09-21T12:20:57.433 INFO:tasks.workunit.client.0.smithi003.stdout:4/835: sync 2024-09-21T12:20:57.435 INFO:tasks.workunit.client.0.smithi003.stdout:2/865: rmdir d0/de2 39 2024-09-21T12:20:57.439 INFO:tasks.workunit.client.0.smithi003.stdout:7/778: creat d8/d3c/d64/df0/dbf/ffd x:0 0 0 2024-09-21T12:20:57.445 INFO:tasks.workunit.client.0.smithi003.stdout:2/866: rmdir d0/d46/dcc 0 2024-09-21T12:20:57.459 INFO:tasks.workunit.client.0.smithi003.stdout:7/779: write d8/db/d32/d43/f76 [3972682,113046] 0 2024-09-21T12:20:57.459 INFO:tasks.workunit.client.0.smithi003.stdout:2/867: write d0/dd/f65 [216519,49499] 0 2024-09-21T12:20:57.465 INFO:tasks.workunit.client.0.smithi003.stdout:7/780: write d8/d3c/d6b/f5a [1296402,99344] 0 2024-09-21T12:20:57.468 INFO:tasks.workunit.client.0.smithi003.stdout:7/781: symlink d8/d31/d84/da9/lfe 0 2024-09-21T12:20:57.468 INFO:tasks.workunit.client.0.smithi003.stdout:7/782: stat d8/db/d32/d43/d7e/fc0 0 2024-09-21T12:20:57.470 INFO:tasks.workunit.client.0.smithi003.stdout:7/783: read d8/d3c/d6b/fd0 [72107,101165] 0 2024-09-21T12:20:57.478 INFO:tasks.workunit.client.0.smithi003.stdout:7/784: dread d8/db/f16 [0,4194304] 0 2024-09-21T12:20:57.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:57 smithi192 ceph-mon[35641]: pgmap v15: 65 pgs: 65 active+clean; 2.9 GiB data, 8.6 GiB used, 528 GiB / 536 GiB avail; 47 MiB/s rd, 104 MiB/s wr, 284 op/s 2024-09-21T12:20:57.691 INFO:tasks.workunit.client.0.smithi003.stdout:8/965: sync 2024-09-21T12:20:57.691 INFO:tasks.workunit.client.0.smithi003.stdout:8/966: chown d7/de/f3e 28835 1 2024-09-21T12:20:57.697 INFO:tasks.workunit.client.0.smithi003.stdout:8/967: dwrite d7/df/d20/d21/de6/f12b [0,4194304] 0 2024-09-21T12:20:57.698 INFO:tasks.workunit.client.0.smithi003.stdout:8/968: chown d7/fe4 1409 1 2024-09-21T12:20:57.707 INFO:tasks.workunit.client.0.smithi003.stdout:8/969: dwrite d7/df/d20/fe0 [0,4194304] 0 2024-09-21T12:20:57.707 INFO:tasks.workunit.client.0.smithi003.stdout:8/970: chown d7/d57/l74 7 1 2024-09-21T12:20:57.713 INFO:tasks.workunit.client.0.smithi003.stdout:8/971: getdents d7/de/d13d/d148 0 2024-09-21T12:20:57.717 INFO:tasks.workunit.client.0.smithi003.stdout:8/972: mknod d7/df/d20/d21/d4c/d4d/d75/c151 0 2024-09-21T12:20:57.719 INFO:tasks.workunit.client.0.smithi003.stdout:8/973: mknod d7/de/d81/c152 0 2024-09-21T12:20:57.738 INFO:tasks.workunit.client.0.smithi003.stdout:8/974: dread d7/df/d20/d24/d47/d79/f6c [0,4194304] 0 2024-09-21T12:20:57.741 INFO:tasks.workunit.client.0.smithi003.stdout:8/975: unlink d7/df/d20/d21/d4c/d4d/d80/d10e/l117 0 2024-09-21T12:20:57.743 INFO:tasks.workunit.client.0.smithi003.stdout:8/976: fdatasync d7/de/d81/fa4 0 2024-09-21T12:20:57.743 INFO:tasks.workunit.client.0.smithi003.stdout:8/977: chown d7/df/cd7 1 1 2024-09-21T12:20:57.746 INFO:tasks.workunit.client.0.smithi003.stdout:8/978: chown d7/lb9 20622 1 2024-09-21T12:20:57.751 INFO:tasks.workunit.client.0.smithi003.stdout:8/979: creat d7/de/f153 x:0 0 0 2024-09-21T12:20:57.756 INFO:tasks.workunit.client.0.smithi003.stdout:8/980: dwrite d7/df/d20/fc5 [0,4194304] 0 2024-09-21T12:20:57.764 INFO:tasks.workunit.client.0.smithi003.stdout:8/981: dwrite d7/df/d20/d21/d4c/d4d/d75/f114 [0,4194304] 0 2024-09-21T12:20:57.769 INFO:tasks.workunit.client.0.smithi003.stdout:8/982: mknod d7/df/d20/d21/d4c/d8a/c154 0 2024-09-21T12:20:57.771 INFO:tasks.workunit.client.0.smithi003.stdout:8/983: mknod d7/de/d1a/c155 0 2024-09-21T12:20:57.774 INFO:tasks.workunit.client.0.smithi003.stdout:8/984: fdatasync d7/df/d20/d24/d47/d79/f6c 0 2024-09-21T12:20:57.776 INFO:tasks.workunit.client.0.smithi003.stdout:8/985: rmdir d7/df/d20/d24/d47/d79 39 2024-09-21T12:20:57.779 INFO:tasks.workunit.client.0.smithi003.stdout:8/986: rename d7/d57/d77/da5/cec to d7/df/d147/c156 0 2024-09-21T12:20:57.783 INFO:tasks.workunit.client.0.smithi003.stdout:8/987: rename d7/df/d20/d21/d4c/d4d/l9b to d7/df/d20/d24/d47/df3/d11d/d122/l157 0 2024-09-21T12:20:57.785 INFO:tasks.workunit.client.0.smithi003.stdout:8/988: fdatasync d7/d57/d77/fb3 0 2024-09-21T12:20:57.791 INFO:tasks.workunit.client.0.smithi003.stdout:8/989: mknod d7/df/d20/d24/d47/df3/c158 0 2024-09-21T12:20:57.795 INFO:tasks.workunit.client.0.smithi003.stdout:8/990: creat d7/df/d20/d24/f159 x:0 0 0 2024-09-21T12:20:57.824 INFO:tasks.workunit.client.0.smithi003.stdout:4/836: sync 2024-09-21T12:20:57.825 INFO:tasks.workunit.client.0.smithi003.stdout:8/991: creat d7/df/d20/d21/dd5/f15a x:0 0 0 2024-09-21T12:20:57.826 INFO:tasks.workunit.client.0.smithi003.stdout:8/992: chown d7/de/l27 14 1 2024-09-21T12:20:57.828 INFO:tasks.workunit.client.0.smithi003.stdout:8/993: mknod d7/df/d20/d21/d4c/d4d/d80/d10e/c15b 0 2024-09-21T12:20:57.832 INFO:tasks.workunit.client.0.smithi003.stdout:8/994: dread d7/df/d20/fe0 [0,4194304] 0 2024-09-21T12:20:57.835 INFO:tasks.workunit.client.0.smithi003.stdout:4/837: dread d9/da/f31 [0,4194304] 0 2024-09-21T12:20:57.836 INFO:tasks.workunit.client.0.smithi003.stdout:8/995: truncate d7/d57/d77/da5/dd4/dfa/f107 645538 0 2024-09-21T12:20:57.838 INFO:tasks.workunit.client.0.smithi003.stdout:4/838: creat d9/da/d47/d82/df7/f119 x:0 0 0 2024-09-21T12:20:57.840 INFO:tasks.workunit.client.0.smithi003.stdout:4/839: rmdir d9/da/d36/da9 39 2024-09-21T12:20:57.842 INFO:tasks.workunit.client.0.smithi003.stdout:4/840: dread - d9/da/dab/fb7 zero size 2024-09-21T12:20:57.842 INFO:tasks.workunit.client.0.smithi003.stdout:4/841: chown d9/d25/c71 214 1 2024-09-21T12:20:57.858 INFO:tasks.workunit.client.0.smithi003.stdout:4/842: dread f8 [0,4194304] 0 2024-09-21T12:20:57.859 INFO:tasks.workunit.client.0.smithi003.stdout:4/843: read f6 [2397822,51023] 0 2024-09-21T12:20:57.886 INFO:tasks.workunit.client.0.smithi003.stdout:4/844: creat d9/da/d36/d8c/dbd/f11a x:0 0 0 2024-09-21T12:20:57.894 INFO:tasks.workunit.client.0.smithi003.stdout:4/845: dwrite d9/d16/d65/d73/d104/f10c [0,4194304] 0 2024-09-21T12:20:57.900 INFO:tasks.workunit.client.0.smithi003.stdout:4/846: symlink d9/da/d66/d67/dcd/dd8/d72/l11b 0 2024-09-21T12:20:57.916 INFO:tasks.workunit.client.0.smithi003.stdout:4/847: dread d9/da/d36/f50 [0,4194304] 0 2024-09-21T12:20:57.917 INFO:tasks.workunit.client.0.smithi003.stdout:4/848: read - d9/da/dab/fb7 zero size 2024-09-21T12:20:57.919 INFO:tasks.workunit.client.0.smithi003.stdout:4/849: write d9/d16/d65/d73/fa3 [4147864,91349] 0 2024-09-21T12:20:57.929 INFO:tasks.workunit.client.0.smithi003.stdout:4/850: link l2 d9/da/d47/l11c 0 2024-09-21T12:20:57.933 INFO:tasks.workunit.client.0.smithi003.stdout:4/851: symlink d9/da/d66/d67/dd6/d106/d114/l11d 0 2024-09-21T12:20:57.941 INFO:tasks.workunit.client.0.smithi003.stdout:4/852: dwrite d9/da/d66/da2/fee [0,4194304] 0 2024-09-21T12:20:57.944 INFO:tasks.workunit.client.0.smithi003.stdout:4/853: write d9/f24 [2246771,16289] 0 2024-09-21T12:20:57.952 INFO:tasks.workunit.client.0.smithi003.stdout:4/854: getdents d9/da/d36/dcc 0 2024-09-21T12:20:57.954 INFO:tasks.workunit.client.0.smithi003.stdout:4/855: read - d9/da/d47/f9b zero size 2024-09-21T12:20:58.005 INFO:tasks.workunit.client.0.smithi003.stdout:7/785: sync 2024-09-21T12:20:58.006 INFO:tasks.workunit.client.0.smithi003.stdout:8/996: sync 2024-09-21T12:20:58.006 INFO:tasks.workunit.client.0.smithi003.stdout:2/868: sync 2024-09-21T12:20:58.007 INFO:tasks.workunit.client.0.smithi003.stdout:7/786: write d8/d2c/f2e [2111706,28325] 0 2024-09-21T12:20:58.010 INFO:tasks.workunit.client.0.smithi003.stdout:2/869: creat d0/dd/d22/d8b/f12d x:0 0 0 2024-09-21T12:20:58.010 INFO:tasks.workunit.client.0.smithi003.stdout:2/870: readlink d0/dd/d22/l41 0 2024-09-21T12:20:58.011 INFO:tasks.workunit.client.0.smithi003.stdout:7/787: dread d8/d3c/d64/df5/d60/f97 [0,4194304] 0 2024-09-21T12:20:58.012 INFO:tasks.workunit.client.0.smithi003.stdout:2/871: dread - d0/d21/d2c/d6c/db2/dbb/ff2 zero size 2024-09-21T12:20:58.012 INFO:tasks.workunit.client.0.smithi003.stdout:7/788: write d8/db/d32/d43/d7e/f83 [4825751,51539] 0 2024-09-21T12:20:58.014 INFO:tasks.workunit.client.0.smithi003.stdout:2/872: mkdir d0/d46/dcd/d12e 0 2024-09-21T12:20:58.015 INFO:tasks.workunit.client.0.smithi003.stdout:7/789: creat d8/d3c/d64/df5/d85/fff x:0 0 0 2024-09-21T12:20:58.018 INFO:tasks.workunit.client.0.smithi003.stdout:4/856: rename d9/da/f57 to d9/da/d47/f11e 0 2024-09-21T12:20:58.019 INFO:tasks.workunit.client.0.smithi003.stdout:7/790: mkdir d8/db/d32/d43/d7e/dad/d100 0 2024-09-21T12:20:58.019 INFO:tasks.workunit.client.0.smithi003.stdout:4/857: read d9/da/d66/f95 [523928,80433] 0 2024-09-21T12:20:58.020 INFO:tasks.workunit.client.0.smithi003.stdout:2/873: getdents d0/d21/d2f/d9f 0 2024-09-21T12:20:58.023 INFO:tasks.workunit.client.0.smithi003.stdout:2/874: write d0/de2/ddb/f124 [166278,19576] 0 2024-09-21T12:20:58.026 INFO:tasks.workunit.client.0.smithi003.stdout:2/875: dread d0/de2/ddb/f124 [0,4194304] 0 2024-09-21T12:20:58.031 INFO:tasks.workunit.client.0.smithi003.stdout:2/876: fdatasync d0/d46/dcd/fa8 0 2024-09-21T12:20:58.034 INFO:tasks.workunit.client.0.smithi003.stdout:8/997: write d7/df/d20/d21/d4c/fbb [5066036,98959] 0 2024-09-21T12:20:58.034 INFO:tasks.workunit.client.0.smithi003.stdout:7/791: link d8/d3c/d64/df5/l26 d8/l101 0 2024-09-21T12:20:58.036 INFO:tasks.workunit.client.0.smithi003.stdout:7/792: dread d8/d2c/f2a [0,4194304] 0 2024-09-21T12:20:58.039 INFO:tasks.workunit.client.0.smithi003.stdout:2/877: mkdir d0/d21/d30/d12f 0 2024-09-21T12:20:58.041 INFO:tasks.workunit.client.0.smithi003.stdout:4/858: write d9/da/d36/f3f [1624608,124702] 0 2024-09-21T12:20:58.043 INFO:tasks.workunit.client.0.smithi003.stdout:7/793: creat d8/d3c/d64/df5/d85/f102 x:0 0 0 2024-09-21T12:20:58.043 INFO:tasks.workunit.client.0.smithi003.stdout:4/859: read d9/d16/f2e [7581201,45577] 0 2024-09-21T12:20:58.049 INFO:tasks.workunit.client.0.smithi003.stdout:7/794: dwrite d8/d2c/fab [0,4194304] 0 2024-09-21T12:20:58.050 INFO:tasks.workunit.client.0.smithi003.stdout:7/795: readlink d8/db/d32/l3f 0 2024-09-21T12:20:58.052 INFO:tasks.workunit.client.0.smithi003.stdout:8/998: write d7/df/d20/d24/d47/fed [646530,2088] 0 2024-09-21T12:20:58.056 INFO:tasks.workunit.client.0.smithi003.stdout:7/796: unlink d8/d3c/d64/df5/d96/db8/dc4/lcb 0 2024-09-21T12:20:58.057 INFO:tasks.workunit.client.0.smithi003.stdout:2/878: dread d0/d21/d30/d78/f120 [0,4194304] 0 2024-09-21T12:20:58.059 INFO:tasks.workunit.client.0.smithi003.stdout:2/879: dread - d0/d1c/d6a/dc0/f112 zero size 2024-09-21T12:20:58.059 INFO:tasks.workunit.client.0.smithi003.stdout:7/797: read d8/d31/fee [3604824,112176] 0 2024-09-21T12:20:58.060 INFO:tasks.workunit.client.0.smithi003.stdout:8/999: creat d7/df/d20/d24/d47/f15c x:0 0 0 2024-09-21T12:20:58.062 INFO:tasks.workunit.client.0.smithi003.stdout:2/880: unlink d0/d46/dcd/l118 0 2024-09-21T12:20:58.067 INFO:tasks.workunit.client.0.smithi003.stdout:7/798: dwrite d8/d3c/d64/df5/d96/db8/dc4/ff2 [0,4194304] 0 2024-09-21T12:20:58.068 INFO:tasks.workunit.client.0.smithi003.stdout:7/799: chown d8/d31/c42 28661948 1 2024-09-21T12:20:58.072 INFO:tasks.workunit.client.0.smithi003.stdout:2/881: mknod d0/d21/d30/c130 0 2024-09-21T12:20:58.074 INFO:tasks.workunit.client.0.smithi003.stdout:2/882: write d0/dd/d22/d37/dda/f10f [2270324,118704] 0 2024-09-21T12:20:58.078 INFO:tasks.workunit.client.0.smithi003.stdout:7/800: rename d8/d3c/d64/df5/l26 to d8/d3c/d64/df5/d96/l103 0 2024-09-21T12:20:58.079 INFO:tasks.workunit.client.0.smithi003.stdout:2/883: symlink d0/dd/d22/d9d/l131 0 2024-09-21T12:20:58.080 INFO:tasks.workunit.client.0.smithi003.stdout:7/801: dread - d8/d3c/d64/df5/d60/fb0 zero size 2024-09-21T12:20:58.082 INFO:tasks.workunit.client.0.smithi003.stdout:7/802: rmdir d8/d93 39 2024-09-21T12:20:58.086 INFO:tasks.workunit.client.0.smithi003.stdout:7/803: fdatasync d8/d3c/d64/df5/f89 0 2024-09-21T12:20:58.088 INFO:tasks.workunit.client.0.smithi003.stdout:2/884: symlink d0/dd/d22/d37/dda/d109/d12a/l132 0 2024-09-21T12:20:58.092 INFO:tasks.workunit.client.0.smithi003.stdout:2/885: stat d0/d21/d2f/d49 0 2024-09-21T12:20:58.093 INFO:tasks.workunit.client.0.smithi003.stdout:7/804: fsync d8/d93/fcd 0 2024-09-21T12:20:58.093 INFO:tasks.workunit.client.0.smithi003.stdout:2/886: read d0/f25 [131707,111596] 0 2024-09-21T12:20:58.143 INFO:tasks.workunit.client.0.smithi003.stdout:7/805: write d8/d31/d84/fec [650253,125141] 0 2024-09-21T12:20:58.145 INFO:tasks.workunit.client.0.smithi003.stdout:2/887: rename d0/d21/d2f to d0/d21/d133 0 2024-09-21T12:20:58.146 INFO:tasks.workunit.client.0.smithi003.stdout:7/806: creat d8/db/d32/d43/f104 x:0 0 0 2024-09-21T12:20:58.150 INFO:tasks.workunit.client.0.smithi003.stdout:7/807: creat d8/db/d32/f105 x:0 0 0 2024-09-21T12:20:58.152 INFO:tasks.workunit.client.0.smithi003.stdout:2/888: dwrite d0/d21/f105 [0,4194304] 0 2024-09-21T12:20:58.154 INFO:tasks.workunit.client.0.smithi003.stdout:7/808: truncate d8/db/d32/f5d 3568678 0 2024-09-21T12:20:58.156 INFO:tasks.workunit.client.0.smithi003.stdout:2/889: creat d0/d46/dcd/d12e/f134 x:0 0 0 2024-09-21T12:20:58.157 INFO:tasks.workunit.client.0.smithi003.stdout:2/890: readlink d0/d21/d133/d50/dc4/dc7/l10e 0 2024-09-21T12:20:58.158 INFO:tasks.workunit.client.0.smithi003.stdout:2/891: stat d0/d21/d133/d50/dc4/dc7 0 2024-09-21T12:20:58.159 INFO:tasks.workunit.client.0.smithi003.stdout:2/892: chown d0/d21/d133/d50/cd8 25094724 1 2024-09-21T12:20:58.159 INFO:tasks.workunit.client.0.smithi003.stdout:7/809: creat d8/d31/d84/da8/f106 x:0 0 0 2024-09-21T12:20:58.167 INFO:tasks.workunit.client.0.smithi003.stdout:2/893: symlink d0/d21/d2c/d6c/db2/l135 0 2024-09-21T12:20:58.168 INFO:tasks.workunit.client.0.smithi003.stdout:7/810: mknod d8/d3c/d57/d81/c107 0 2024-09-21T12:20:58.171 INFO:tasks.workunit.client.0.smithi003.stdout:2/894: mkdir d0/d1c/d6a/dc0/d127/d136 0 2024-09-21T12:20:58.173 INFO:tasks.workunit.client.0.smithi003.stdout:7/811: symlink d8/d3c/d64/df0/dbf/l108 0 2024-09-21T12:20:58.175 INFO:tasks.workunit.client.0.smithi003.stdout:2/895: fsync d0/fa 0 2024-09-21T12:20:58.179 INFO:tasks.workunit.client.0.smithi003.stdout:2/896: dread d0/dd/d22/d37/f5c [0,4194304] 0 2024-09-21T12:20:58.180 INFO:tasks.workunit.client.0.smithi003.stdout:7/812: getdents d8/d31/d84/da9 0 2024-09-21T12:20:58.189 INFO:tasks.workunit.client.0.smithi003.stdout:2/897: dwrite d0/d21/d30/d78/f120 [0,4194304] 0 2024-09-21T12:20:58.191 INFO:tasks.workunit.client.0.smithi003.stdout:2/898: write d0/dd/f65 [356577,58776] 0 2024-09-21T12:20:58.192 INFO:tasks.workunit.client.0.smithi003.stdout:2/899: chown d0/dd/d22/d8b/fd2 498 1 2024-09-21T12:20:58.197 INFO:tasks.workunit.client.0.smithi003.stdout:2/900: mkdir d0/d21/d133/d50/dc4/d7f/daa/d137 0 2024-09-21T12:20:58.202 INFO:tasks.workunit.client.0.smithi003.stdout:2/901: mkdir d0/d21/d133/d50/dc4/d7f/daa/d137/d138 0 2024-09-21T12:20:58.208 INFO:tasks.workunit.client.0.smithi003.stdout:2/902: truncate d0/d21/d133/d50/dc4/d7f/f88 1947598 0 2024-09-21T12:20:58.209 INFO:tasks.workunit.client.0.smithi003.stdout:2/903: mknod d0/d1c/d6a/dc0/c139 0 2024-09-21T12:20:58.211 INFO:tasks.workunit.client.0.smithi003.stdout:2/904: symlink d0/dd/d22/d68/l13a 0 2024-09-21T12:20:58.212 INFO:tasks.workunit.client.0.smithi003.stdout:2/905: mkdir d0/d21/d133/d9f/d13b 0 2024-09-21T12:20:58.214 INFO:tasks.workunit.client.0.smithi003.stdout:2/906: chown d0/d21/d133/d49/f125 1 1 2024-09-21T12:20:58.251 INFO:tasks.workunit.client.0.smithi003.stdout:7/813: dwrite d8/d7a/fb9 [0,4194304] 0 2024-09-21T12:20:58.254 INFO:tasks.workunit.client.0.smithi003.stdout:7/814: dread - d8/db/d32/d43/f104 zero size 2024-09-21T12:20:58.259 INFO:tasks.workunit.client.0.smithi003.stdout:2/907: dwrite d0/d46/dcd/fdd [0,4194304] 0 2024-09-21T12:20:58.260 INFO:tasks.workunit.client.0.smithi003.stdout:7/815: mknod d8/c109 0 2024-09-21T12:20:58.268 INFO:tasks.workunit.client.0.smithi003.stdout:7/816: fdatasync d8/d3c/d64/df5/d60/f8a 0 2024-09-21T12:20:58.269 INFO:tasks.workunit.client.0.smithi003.stdout:7/817: dread - d8/d3c/d64/df5/f89 zero size 2024-09-21T12:20:58.272 INFO:tasks.workunit.client.0.smithi003.stdout:7/818: symlink d8/db/d32/d43/d7e/dad/l10a 0 2024-09-21T12:20:58.276 INFO:tasks.workunit.client.0.smithi003.stdout:7/819: rename d8/d3c/d57/d9e/fa2 to d8/db/d32/f10b 0 2024-09-21T12:20:58.285 INFO:tasks.workunit.client.0.smithi003.stdout:2/908: write d0/d21/d2c/f58 [440946,123234] 0 2024-09-21T12:20:58.287 INFO:tasks.workunit.client.0.smithi003.stdout:7/820: dread d8/d3c/d6b/f5a [0,4194304] 0 2024-09-21T12:20:58.289 INFO:tasks.workunit.client.0.smithi003.stdout:7/821: unlink d8/d3c/d57/l71 0 2024-09-21T12:20:58.291 INFO:tasks.workunit.client.0.smithi003.stdout:2/909: truncate d0/dd/d22/d37/dda/d97/fdf 260893 0 2024-09-21T12:20:58.293 INFO:tasks.workunit.client.0.smithi003.stdout:2/910: symlink d0/d21/d133/d9f/d11d/l13c 0 2024-09-21T12:20:58.296 INFO:tasks.workunit.client.0.smithi003.stdout:2/911: symlink d0/d21/d133/d50/dc4/d7f/daa/d137/l13d 0 2024-09-21T12:20:58.299 INFO:tasks.workunit.client.0.smithi003.stdout:7/822: dread d8/d31/f74 [0,4194304] 0 2024-09-21T12:20:58.304 INFO:tasks.workunit.client.0.smithi003.stdout:7/823: mkdir d8/d3c/d64/df5/d96/db8/d10c 0 2024-09-21T12:20:58.305 INFO:tasks.workunit.client.0.smithi003.stdout:7/824: write d8/d3c/d64/df0/dbf/ffd [528432,16611] 0 2024-09-21T12:20:58.309 INFO:tasks.workunit.client.0.smithi003.stdout:7/825: creat d8/db/d32/d43/d7e/dad/f10d x:0 0 0 2024-09-21T12:20:58.311 INFO:tasks.workunit.client.0.smithi003.stdout:7/826: truncate d8/d3c/d64/df5/f3a 1641002 0 2024-09-21T12:20:58.312 INFO:tasks.workunit.client.0.smithi003.stdout:7/827: chown d8/d3c/d64/df5/d85/fff 12053 1 2024-09-21T12:20:58.314 INFO:tasks.workunit.client.0.smithi003.stdout:4/860: sync 2024-09-21T12:20:58.319 INFO:tasks.workunit.client.0.smithi003.stdout:4/861: dread d9/d16/d65/f7f [0,4194304] 0 2024-09-21T12:20:58.322 INFO:tasks.workunit.client.0.smithi003.stdout:2/912: dwrite d0/dd/d22/d37/f48 [0,4194304] 0 2024-09-21T12:20:58.324 INFO:tasks.workunit.client.0.smithi003.stdout:4/862: creat d9/da/d36/d8c/f11f x:0 0 0 2024-09-21T12:20:58.331 INFO:tasks.workunit.client.0.smithi003.stdout:2/913: unlink d0/dd/d22/la3 0 2024-09-21T12:20:58.332 INFO:tasks.workunit.client.0.smithi003.stdout:4/863: dwrite d9/d16/d65/d97/fd1 [0,4194304] 0 2024-09-21T12:20:58.333 INFO:tasks.workunit.client.0.smithi003.stdout:7/828: stat d8/d3c/d6b/c6a 0 2024-09-21T12:20:58.337 INFO:tasks.workunit.client.0.smithi003.stdout:2/914: creat d0/d21/d133/d50/dc4/d7f/f13e x:0 0 0 2024-09-21T12:20:58.341 INFO:tasks.workunit.client.0.smithi003.stdout:7/829: rename d8/d3c/d6b/fd0 to d8/d31/d84/da9/dc5/f10e 0 2024-09-21T12:20:58.344 INFO:tasks.workunit.client.0.smithi003.stdout:4/864: mkdir d9/da/d66/d67/dcd/dd8/d72/d108/d120 0 2024-09-21T12:20:58.346 INFO:tasks.workunit.client.0.smithi003.stdout:4/865: truncate d9/d25/fa6 1035838 0 2024-09-21T12:20:58.360 INFO:tasks.workunit.client.0.smithi003.stdout:4/866: write d9/da/d36/d55/fa8 [169518,41773] 0 2024-09-21T12:20:58.363 INFO:tasks.workunit.client.0.smithi003.stdout:4/867: write d9/da/d66/da2/fee [211878,66733] 0 2024-09-21T12:20:58.366 INFO:tasks.workunit.client.0.smithi003.stdout:2/915: dwrite d0/dd/d22/d37/dda/d97/fdf [0,4194304] 0 2024-09-21T12:20:58.374 INFO:tasks.workunit.client.0.smithi003.stdout:4/868: dwrite d9/d16/d65/d73/d104/f10c [4194304,4194304] 0 2024-09-21T12:20:58.375 INFO:tasks.workunit.client.0.smithi003.stdout:2/916: creat d0/d21/f13f x:0 0 0 2024-09-21T12:20:58.375 INFO:tasks.workunit.client.0.smithi003.stdout:4/869: fsync d9/f3a 0 2024-09-21T12:20:58.378 INFO:tasks.workunit.client.0.smithi003.stdout:2/917: mkdir d0/d21/d133/d9f/d140 0 2024-09-21T12:20:58.379 INFO:tasks.workunit.client.0.smithi003.stdout:4/870: truncate d9/f64 1332945 0 2024-09-21T12:20:58.382 INFO:tasks.workunit.client.0.smithi003.stdout:4/871: fdatasync d9/da/d47/d82/fbc 0 2024-09-21T12:20:58.383 INFO:tasks.workunit.client.0.smithi003.stdout:4/872: read - d9/da/d36/d8c/dbd/f11a zero size 2024-09-21T12:20:58.385 INFO:tasks.workunit.client.0.smithi003.stdout:2/918: rename d0/df7/f11b to d0/dd/f141 0 2024-09-21T12:20:58.387 INFO:tasks.workunit.client.0.smithi003.stdout:4/873: rmdir d9 39 2024-09-21T12:20:58.389 INFO:tasks.workunit.client.0.smithi003.stdout:2/919: dread - d0/dd/d22/fe3 zero size 2024-09-21T12:20:58.393 INFO:tasks.workunit.client.0.smithi003.stdout:2/920: read d0/d21/d133/d9f/fa5 [1660473,54607] 0 2024-09-21T12:20:58.397 INFO:tasks.workunit.client.0.smithi003.stdout:2/921: creat d0/d21/d30/f142 x:0 0 0 2024-09-21T12:20:58.405 INFO:tasks.workunit.client.0.smithi003.stdout:4/874: getdents d9/d48 0 2024-09-21T12:20:58.406 INFO:tasks.workunit.client.0.smithi003.stdout:2/922: dwrite d0/de2/ddb/fdc [0,4194304] 0 2024-09-21T12:20:58.407 INFO:tasks.workunit.client.0.smithi003.stdout:2/923: dread - d0/d1c/d6a/fc6 zero size 2024-09-21T12:20:58.408 INFO:tasks.workunit.client.0.smithi003.stdout:4/875: fdatasync d9/d25/fa6 0 2024-09-21T12:20:58.412 INFO:tasks.workunit.client.0.smithi003.stdout:2/924: unlink d0/d21/d133/d50/dc4/f9b 0 2024-09-21T12:20:58.414 INFO:tasks.workunit.client.0.smithi003.stdout:2/925: truncate d0/d21/d2c/d6c/db2/dbb/f114 428563 0 2024-09-21T12:20:58.416 INFO:tasks.workunit.client.0.smithi003.stdout:2/926: creat d0/d1c/d6a/dc0/f143 x:0 0 0 2024-09-21T12:20:58.420 INFO:tasks.workunit.client.0.smithi003.stdout:2/927: mkdir d0/dd/dc1/d144 0 2024-09-21T12:20:58.422 INFO:tasks.workunit.client.0.smithi003.stdout:4/876: fsync d9/f64 0 2024-09-21T12:20:58.434 INFO:tasks.workunit.client.0.smithi003.stdout:4/877: write d9/d16/d65/d73/d8d/fa0 [1288251,3760] 0 2024-09-21T12:20:58.437 INFO:tasks.workunit.client.0.smithi003.stdout:2/928: dwrite d0/d21/d133/d50/dc4/d7f/daa/f102 [0,4194304] 0 2024-09-21T12:20:58.438 INFO:tasks.workunit.client.0.smithi003.stdout:4/878: mkdir d9/da/d66/da2/d121 0 2024-09-21T12:20:58.441 INFO:tasks.workunit.client.0.smithi003.stdout:4/879: fdatasync d9/da/d47/f4c 0 2024-09-21T12:20:58.445 INFO:tasks.workunit.client.0.smithi003.stdout:4/880: symlink d9/d25/l122 0 2024-09-21T12:20:58.447 INFO:tasks.workunit.client.0.smithi003.stdout:4/881: fsync d9/da/f31 0 2024-09-21T12:20:58.450 INFO:tasks.workunit.client.0.smithi003.stdout:4/882: creat d9/da/d47/de7/f123 x:0 0 0 2024-09-21T12:20:58.451 INFO:tasks.workunit.client.0.smithi003.stdout:2/929: write d0/dd/f5a [554200,102794] 0 2024-09-21T12:20:58.452 INFO:tasks.workunit.client.0.smithi003.stdout:4/883: write d9/da/d36/d55/fa8 [250261,41648] 0 2024-09-21T12:20:58.455 INFO:tasks.workunit.client.0.smithi003.stdout:2/930: truncate d0/d21/d2c/d6c/db2/dbb/f114 628623 0 2024-09-21T12:20:58.456 INFO:tasks.workunit.client.0.smithi003.stdout:4/884: creat d9/d16/d65/d73/d8d/f124 x:0 0 0 2024-09-21T12:20:58.461 INFO:tasks.workunit.client.0.smithi003.stdout:4/885: link d9/da/d47/f11e d9/da/d66/da2/ddc/f125 0 2024-09-21T12:20:58.462 INFO:tasks.workunit.client.0.smithi003.stdout:4/886: chown d9/da/dab/fb7 1057433 1 2024-09-21T12:20:58.465 INFO:tasks.workunit.client.0.smithi003.stdout:4/887: mkdir d9/da/d36/da9/d126 0 2024-09-21T12:20:58.469 INFO:tasks.workunit.client.0.smithi003.stdout:2/931: dwrite d0/d21/d133/d50/fe9 [0,4194304] 0 2024-09-21T12:20:58.472 INFO:tasks.workunit.client.0.smithi003.stdout:2/932: unlink d0/l104 0 2024-09-21T12:20:58.473 INFO:tasks.workunit.client.0.smithi003.stdout:4/888: dwrite d9/da/f9e [0,4194304] 0 2024-09-21T12:20:58.479 INFO:tasks.workunit.client.0.smithi003.stdout:4/889: rename d9/da/d36/d55/d79/df4/cf5 to d9/da/d66/d67/db2/c127 0 2024-09-21T12:20:58.483 INFO:tasks.workunit.client.0.smithi003.stdout:4/890: creat d9/da/d36/d55/d79/f128 x:0 0 0 2024-09-21T12:20:58.484 INFO:tasks.workunit.client.0.smithi003.stdout:2/933: dread d0/ff [0,4194304] 0 2024-09-21T12:20:58.489 INFO:tasks.workunit.client.0.smithi003.stdout:4/891: link d9/da/d36/f50 d9/da/d36/da9/d126/f129 0 2024-09-21T12:20:58.490 INFO:tasks.workunit.client.0.smithi003.stdout:2/934: mknod d0/dd/d22/c145 0 2024-09-21T12:20:58.494 INFO:tasks.workunit.client.0.smithi003.stdout:2/935: unlink d0/d46/dcd/d12e/f134 0 2024-09-21T12:20:58.497 INFO:tasks.workunit.client.0.smithi003.stdout:2/936: mkdir d0/d21/d30/d12f/d146 0 2024-09-21T12:20:58.497 INFO:tasks.workunit.client.0.smithi003.stdout:2/937: dread - d0/d21/d133/d49/ffa zero size 2024-09-21T12:20:58.509 INFO:tasks.workunit.client.0.smithi003.stdout:4/892: dwrite d9/da/d47/ddd/f110 [0,4194304] 0 2024-09-21T12:20:58.510 INFO:tasks.workunit.client.0.smithi003.stdout:4/893: chown d9/d16/d65/d97/f9d 7059617 1 2024-09-21T12:20:58.514 INFO:tasks.workunit.client.0.smithi003.stdout:2/938: write d0/dd/d22/f23 [1015108,47777] 0 2024-09-21T12:20:58.515 INFO:tasks.workunit.client.0.smithi003.stdout:2/939: read - d0/d1c/d6a/dc0/f112 zero size 2024-09-21T12:20:58.515 INFO:tasks.workunit.client.0.smithi003.stdout:4/894: symlink d9/da/d66/d67/dd6/l12a 0 2024-09-21T12:20:58.519 INFO:tasks.workunit.client.0.smithi003.stdout:2/940: rename d0/d21/d2c/d6c/db2/de7/f8d to d0/d46/f147 0 2024-09-21T12:20:58.520 INFO:tasks.workunit.client.0.smithi003.stdout:4/895: mkdir d9/da/d47/de7/d12b 0 2024-09-21T12:20:58.521 INFO:tasks.workunit.client.0.smithi003.stdout:4/896: stat d9/da/d47/de7/cf3 0 2024-09-21T12:20:58.522 INFO:tasks.workunit.client.0.smithi003.stdout:2/941: mknod d0/dd/c148 0 2024-09-21T12:20:58.525 INFO:tasks.workunit.client.0.smithi003.stdout:2/942: creat d0/dd/d22/d37/f149 x:0 0 0 2024-09-21T12:20:58.527 INFO:tasks.workunit.client.0.smithi003.stdout:2/943: write d0/d21/d133/d9f/f119 [56636,72558] 0 2024-09-21T12:20:58.529 INFO:tasks.workunit.client.0.smithi003.stdout:4/897: dwrite d9/da/d66/d67/dcd/fea [0,4194304] 0 2024-09-21T12:20:58.531 INFO:tasks.workunit.client.0.smithi003.stdout:2/944: mknod d0/d1c/d6a/dc0/c14a 0 2024-09-21T12:20:58.533 INFO:tasks.workunit.client.0.smithi003.stdout:2/945: readlink d0/de2/l60 0 2024-09-21T12:20:58.538 INFO:tasks.workunit.client.0.smithi003.stdout:2/946: fdatasync d0/d21/d133/d50/dc4/fee 0 2024-09-21T12:20:58.544 INFO:tasks.workunit.client.0.smithi003.stdout:2/947: creat d0/d46/f14b x:0 0 0 2024-09-21T12:20:58.548 INFO:tasks.workunit.client.0.smithi003.stdout:2/948: creat d0/d46/dcd/f14c x:0 0 0 2024-09-21T12:20:58.548 INFO:tasks.workunit.client.0.smithi003.stdout:2/949: fdatasync d0/d21/f105 0 2024-09-21T12:20:58.550 INFO:tasks.workunit.client.0.smithi003.stdout:4/898: dwrite d9/da/d66/d67/dcd/dd8/d72/f6c [0,4194304] 0 2024-09-21T12:20:58.551 INFO:tasks.workunit.client.0.smithi003.stdout:4/899: readlink d9/da/d66/d67/dd6/d106/d114/l11d 0 2024-09-21T12:20:58.553 INFO:tasks.workunit.client.0.smithi003.stdout:4/900: dread - d9/d16/d65/d73/d8d/f124 zero size 2024-09-21T12:20:58.561 INFO:tasks.workunit.client.0.smithi003.stdout:4/901: dwrite d9/da/d36/d8c/f11f [0,4194304] 0 2024-09-21T12:20:58.579 INFO:tasks.workunit.client.0.smithi003.stdout:4/902: dwrite d9/d25/fa6 [0,4194304] 0 2024-09-21T12:20:58.581 INFO:tasks.workunit.client.0.smithi003.stdout:4/903: dread d9/da/d47/ddd/fe4 [0,4194304] 0 2024-09-21T12:20:58.587 INFO:tasks.workunit.client.0.smithi003.stdout:4/904: getdents d9/da/d36 0 2024-09-21T12:20:58.589 INFO:tasks.workunit.client.0.smithi003.stdout:4/905: rename d9/da/d36/d55/dec/fff to d9/da/d10b/f12c 0 2024-09-21T12:20:58.596 INFO:tasks.workunit.client.0.smithi003.stdout:4/906: dwrite d9/d16/d65/d73/ffd [0,4194304] 0 2024-09-21T12:20:58.599 INFO:tasks.workunit.client.0.smithi003.stdout:4/907: creat d9/da/d36/d55/dec/f12d x:0 0 0 2024-09-21T12:20:58.600 INFO:tasks.workunit.client.0.smithi003.stdout:4/908: dread - d9/da/d47/d82/fbc zero size 2024-09-21T12:20:58.901 INFO:tasks.workunit.client.0.smithi003.stdout:7/830: sync 2024-09-21T12:20:58.903 INFO:tasks.workunit.client.0.smithi003.stdout:7/831: creat d8/db/d32/d43/d7e/dad/f10f x:0 0 0 2024-09-21T12:20:58.910 INFO:tasks.workunit.client.0.smithi003.stdout:7/832: dread d8/d3c/faa [0,4194304] 0 2024-09-21T12:20:58.912 INFO:tasks.workunit.client.0.smithi003.stdout:7/833: creat d8/d3c/d6b/f110 x:0 0 0 2024-09-21T12:20:58.917 INFO:tasks.workunit.client.0.smithi003.stdout:7/834: write d8/db/f16 [2028627,115465] 0 2024-09-21T12:20:58.919 INFO:tasks.workunit.client.0.smithi003.stdout:7/835: fsync d8/db/f38 0 2024-09-21T12:20:58.927 INFO:tasks.workunit.client.0.smithi003.stdout:7/836: rename d8/db/d32/d43/lf8 to d8/db/d32/l111 0 2024-09-21T12:20:58.931 INFO:tasks.workunit.client.0.smithi003.stdout:7/837: mknod d8/d3c/d64/df5/d96/db8/d10c/c112 0 2024-09-21T12:20:58.935 INFO:tasks.workunit.client.0.smithi003.stdout:7/838: getdents d8/db/d32/d43/d7e/dad 0 2024-09-21T12:20:58.935 INFO:tasks.workunit.client.0.smithi003.stdout:4/909: sync 2024-09-21T12:20:58.935 INFO:tasks.workunit.client.0.smithi003.stdout:2/950: sync 2024-09-21T12:20:58.937 INFO:tasks.workunit.client.0.smithi003.stdout:4/910: dread - d9/d48/f101 zero size 2024-09-21T12:20:58.937 INFO:tasks.workunit.client.0.smithi003.stdout:7/839: creat d8/d7a/f113 x:0 0 0 2024-09-21T12:20:58.939 INFO:tasks.workunit.client.0.smithi003.stdout:2/951: creat d0/dd/d22/d37/dda/d97/f14d x:0 0 0 2024-09-21T12:20:58.942 INFO:tasks.workunit.client.0.smithi003.stdout:7/840: symlink d8/d3c/d64/df5/d85/dbe/l114 0 2024-09-21T12:20:58.943 INFO:tasks.workunit.client.0.smithi003.stdout:2/952: rmdir d0/d21/d2c/d6c/db2 39 2024-09-21T12:20:58.944 INFO:tasks.workunit.client.0.smithi003.stdout:4/911: dwrite d9/da/d47/ddd/f110 [0,4194304] 0 2024-09-21T12:20:58.945 INFO:tasks.workunit.client.0.smithi003.stdout:4/912: chown d9/d16/d65/d73/fa3 4522992 1 2024-09-21T12:20:58.950 INFO:tasks.workunit.client.0.smithi003.stdout:2/953: link d0/dd/d22/d37/dda/l116 d0/d46/dcd/d12e/l14e 0 2024-09-21T12:20:58.955 INFO:tasks.workunit.client.0.smithi003.stdout:7/841: write d8/d3c/f9a [2978158,102708] 0 2024-09-21T12:20:58.962 INFO:tasks.workunit.client.0.smithi003.stdout:4/913: dwrite d9/da/d47/f9b [0,4194304] 0 2024-09-21T12:20:58.963 INFO:tasks.workunit.client.0.smithi003.stdout:7/842: rename d8/d31 to d8/d3c/d57/d115 0 2024-09-21T12:20:58.966 INFO:tasks.workunit.client.0.smithi003.stdout:2/954: truncate d0/d21/d133/d50/fe9 1239128 0 2024-09-21T12:20:58.969 INFO:tasks.workunit.client.0.smithi003.stdout:7/843: symlink d8/db/d32/d43/d92/l116 0 2024-09-21T12:20:58.970 INFO:tasks.workunit.client.0.smithi003.stdout:4/914: unlink d9/da/d66/d67/dd6/lfc 0 2024-09-21T12:20:58.971 INFO:tasks.workunit.client.0.smithi003.stdout:7/844: fdatasync d8/d93/fbd 0 2024-09-21T12:20:58.971 INFO:tasks.workunit.client.0.smithi003.stdout:4/915: chown d9/da/d36/d55 7 1 2024-09-21T12:20:58.974 INFO:tasks.workunit.client.0.smithi003.stdout:2/955: dwrite d0/d46/f126 [0,4194304] 0 2024-09-21T12:20:58.977 INFO:tasks.workunit.client.0.smithi003.stdout:7/845: truncate d8/d3c/d57/d115/fa3 378040 0 2024-09-21T12:20:58.978 INFO:tasks.workunit.client.0.smithi003.stdout:7/846: chown d8/d3c/d64/l8e 8009142 1 2024-09-21T12:20:58.984 INFO:tasks.workunit.client.0.smithi003.stdout:7/847: mknod d8/d3c/d57/d81/c117 0 2024-09-21T12:20:58.985 INFO:tasks.workunit.client.0.smithi003.stdout:7/848: fdatasync d8/db/d32/d43/d7e/f83 0 2024-09-21T12:20:58.986 INFO:tasks.workunit.client.0.smithi003.stdout:4/916: link d9/da/d36/c3c d9/da/d36/d8c/dbd/c12e 0 2024-09-21T12:20:58.989 INFO:tasks.workunit.client.0.smithi003.stdout:7/849: creat d8/d2c/f118 x:0 0 0 2024-09-21T12:20:58.989 INFO:tasks.workunit.client.0.smithi003.stdout:4/917: mknod d9/d16/d65/d73/c12f 0 2024-09-21T12:20:58.992 INFO:tasks.workunit.client.0.smithi003.stdout:7/850: unlink d8/d3c/d6b/f110 0 2024-09-21T12:20:58.995 INFO:tasks.workunit.client.0.smithi003.stdout:4/918: unlink d9/da/d36/d55/d79/f128 0 2024-09-21T12:20:58.997 INFO:tasks.workunit.client.0.smithi003.stdout:7/851: dread - d8/d3c/d64/df5/d96/db8/fc2 zero size 2024-09-21T12:20:59.001 INFO:tasks.workunit.client.0.smithi003.stdout:7/852: mknod d8/d3c/d57/d9e/c119 0 2024-09-21T12:20:59.002 INFO:tasks.workunit.client.0.smithi003.stdout:4/919: creat d9/da/d66/da2/d121/f130 x:0 0 0 2024-09-21T12:20:59.002 INFO:tasks.workunit.client.0.smithi003.stdout:4/920: stat d9/da/dab/cdf 0 2024-09-21T12:20:59.013 INFO:tasks.workunit.client.0.smithi003.stdout:4/921: link d9/l105 d9/da/d66/dbe/l131 0 2024-09-21T12:20:59.016 INFO:tasks.workunit.client.0.smithi003.stdout:4/922: truncate d9/da/d47/ddd/fe4 1096581 0 2024-09-21T12:20:59.019 INFO:tasks.workunit.client.0.smithi003.stdout:4/923: rename d9/da/d36/d8c/l98 to d9/da/d36/d112/l132 0 2024-09-21T12:20:59.020 INFO:tasks.workunit.client.0.smithi003.stdout:7/853: write d8/d3c/d64/df5/f1a [2456403,88956] 0 2024-09-21T12:20:59.022 INFO:tasks.workunit.client.0.smithi003.stdout:7/854: chown d8/d3c/f90 7488177 1 2024-09-21T12:20:59.030 INFO:tasks.workunit.client.0.smithi003.stdout:4/924: dwrite d9/d25/f7a [4194304,4194304] 0 2024-09-21T12:20:59.031 INFO:tasks.workunit.client.0.smithi003.stdout:4/925: read d9/da/d47/f9b [2911916,67493] 0 2024-09-21T12:20:59.032 INFO:tasks.workunit.client.0.smithi003.stdout:4/926: rmdir d9/da/d36/d8c/dbd 39 2024-09-21T12:20:59.038 INFO:tasks.workunit.client.0.smithi003.stdout:7/855: dread d8/d3c/fb1 [0,4194304] 0 2024-09-21T12:20:59.046 INFO:tasks.workunit.client.0.smithi003.stdout:4/927: write d9/d16/d65/f9f [406670,79103] 0 2024-09-21T12:20:59.046 INFO:tasks.workunit.client.0.smithi003.stdout:7/856: write d8/d3c/d57/d115/fa3 [1384798,105470] 0 2024-09-21T12:20:59.048 INFO:tasks.workunit.client.0.smithi003.stdout:4/928: chown d9/da/d36/d55/c10e 792748418 1 2024-09-21T12:20:59.050 INFO:tasks.workunit.client.0.smithi003.stdout:7/857: truncate d8/d3c/d64/df5/d60/fb0 639164 0 2024-09-21T12:20:59.052 INFO:tasks.workunit.client.0.smithi003.stdout:7/858: read d8/d2c/f7f [3015901,32261] 0 2024-09-21T12:20:59.053 INFO:tasks.workunit.client.0.smithi003.stdout:4/929: creat d9/da/d36/d8c/f133 x:0 0 0 2024-09-21T12:20:59.056 INFO:tasks.workunit.client.0.smithi003.stdout:4/930: mknod d9/da/d66/d67/dcd/c134 0 2024-09-21T12:20:59.058 INFO:tasks.workunit.client.0.smithi003.stdout:4/931: mknod d9/da/d47/d82/c135 0 2024-09-21T12:20:59.059 INFO:tasks.workunit.client.0.smithi003.stdout:7/859: write d8/dea/fd2 [854455,33098] 0 2024-09-21T12:20:59.061 INFO:tasks.workunit.client.0.smithi003.stdout:7/860: write d8/d3c/d64/df5/d75/dd8/ff9 [411456,44228] 0 2024-09-21T12:20:59.062 INFO:tasks.workunit.client.0.smithi003.stdout:7/861: truncate d8/d93/fe5 57082 0 2024-09-21T12:20:59.068 INFO:tasks.workunit.client.0.smithi003.stdout:7/862: rename d8/db/d32/d43/lbc to d8/db/d32/l11a 0 2024-09-21T12:20:59.069 INFO:tasks.workunit.client.0.smithi003.stdout:4/932: dwrite d9/da/d47/f9b [4194304,4194304] 0 2024-09-21T12:20:59.071 INFO:tasks.workunit.client.0.smithi003.stdout:4/933: fdatasync d9/da/dab/fb7 0 2024-09-21T12:20:59.084 INFO:tasks.workunit.client.0.smithi003.stdout:4/934: rmdir d9/da/d36/d55/dec 39 2024-09-21T12:20:59.086 INFO:tasks.workunit.client.0.smithi003.stdout:7/863: rename d8/db/ceb to d8/db/d32/d43/d7e/dad/d100/c11b 0 2024-09-21T12:20:59.089 INFO:tasks.workunit.client.0.smithi003.stdout:7/864: mknod d8/d3c/d64/df0/c11c 0 2024-09-21T12:20:59.091 INFO:tasks.workunit.client.0.smithi003.stdout:7/865: fdatasync d8/d3c/f3e 0 2024-09-21T12:20:59.096 INFO:tasks.workunit.client.0.smithi003.stdout:7/866: mkdir d8/d2c/d11d 0 2024-09-21T12:20:59.097 INFO:tasks.workunit.client.0.smithi003.stdout:4/935: write d9/d16/f2e [8735982,97774] 0 2024-09-21T12:20:59.104 INFO:tasks.workunit.client.0.smithi003.stdout:7/867: dwrite d8/db/d32/d43/ffb [0,4194304] 0 2024-09-21T12:20:59.111 INFO:tasks.workunit.client.0.smithi003.stdout:7/868: dwrite d8/db/d32/d43/f104 [0,4194304] 0 2024-09-21T12:20:59.143 INFO:tasks.workunit.client.0.smithi003.stdout:4/936: creat d9/da/d36/f136 x:0 0 0 2024-09-21T12:20:59.146 INFO:tasks.workunit.client.0.smithi003.stdout:7/869: symlink d8/d3c/d64/df5/d96/l11e 0 2024-09-21T12:20:59.148 INFO:tasks.workunit.client.0.smithi003.stdout:4/937: chown d9/d16/l8b 6814605 1 2024-09-21T12:20:59.150 INFO:tasks.workunit.client.0.smithi003.stdout:4/938: unlink d9/da/d47/c53 0 2024-09-21T12:20:59.151 INFO:tasks.workunit.client.0.smithi003.stdout:2/956: sync 2024-09-21T12:20:59.152 INFO:tasks.workunit.client.0.smithi003.stdout:2/957: write d0/d21/d133/d49/f125 [696027,75098] 0 2024-09-21T12:20:59.153 INFO:tasks.workunit.client.0.smithi003.stdout:4/939: dread d9/da/d47/ddd/fe4 [0,4194304] 0 2024-09-21T12:20:59.154 INFO:tasks.workunit.client.0.smithi003.stdout:4/940: write d9/d25/f7a [8355462,126364] 0 2024-09-21T12:20:59.156 INFO:tasks.workunit.client.0.smithi003.stdout:2/958: unlink d0/d46/dcd/d12e/l14e 0 2024-09-21T12:20:59.157 INFO:tasks.workunit.client.0.smithi003.stdout:4/941: mknod d9/da/d47/d82/c137 0 2024-09-21T12:20:59.159 INFO:tasks.workunit.client.0.smithi003.stdout:2/959: read d0/d21/d133/d9f/fa5 [3170340,111744] 0 2024-09-21T12:20:59.166 INFO:tasks.workunit.client.0.smithi003.stdout:2/960: creat d0/dd/d22/d37/f14f x:0 0 0 2024-09-21T12:20:59.168 INFO:tasks.workunit.client.0.smithi003.stdout:2/961: creat d0/d21/d30/f150 x:0 0 0 2024-09-21T12:20:59.168 INFO:tasks.workunit.client.0.smithi003.stdout:2/962: fsync d0/d46/dcd/f106 0 2024-09-21T12:20:59.184 INFO:tasks.workunit.client.0.smithi003.stdout:4/942: creat d9/da/d36/d112/f138 x:0 0 0 2024-09-21T12:20:59.189 INFO:tasks.workunit.client.0.smithi003.stdout:4/943: dread d9/d16/d65/d73/d8d/fad [0,4194304] 0 2024-09-21T12:20:59.193 INFO:tasks.workunit.client.0.smithi003.stdout:4/944: creat d9/da/d36/d55/d79/f139 x:0 0 0 2024-09-21T12:20:59.199 INFO:tasks.workunit.client.0.smithi003.stdout:2/963: write d0/dd/d22/d37/dda/f86 [4045945,3024] 0 2024-09-21T12:20:59.225 INFO:tasks.workunit.client.0.smithi003.stdout:4/945: dwrite d9/da/d66/f95 [0,4194304] 0 2024-09-21T12:20:59.260 INFO:tasks.workunit.client.0.smithi003.stdout:4/946: dread d9/d16/d65/d97/fc0 [0,4194304] 0 2024-09-21T12:20:59.263 INFO:tasks.workunit.client.0.smithi003.stdout:4/947: readlink d9/da/d47/l11c 0 2024-09-21T12:20:59.302 INFO:tasks.workunit.client.0.smithi003.stdout:4/948: getdents d9/da/d47/de7 0 2024-09-21T12:20:59.303 INFO:tasks.workunit.client.0.smithi003.stdout:4/949: readlink d9/d16/d65/d73/d8d/la4 0 2024-09-21T12:20:59.309 INFO:tasks.workunit.client.0.smithi003.stdout:4/950: dwrite d9/da/d36/da9/fc4 [0,4194304] 0 2024-09-21T12:20:59.310 INFO:tasks.workunit.client.0.smithi003.stdout:4/951: readlink d9/da/d47/l11c 0 2024-09-21T12:20:59.310 INFO:tasks.workunit.client.0.smithi003.stdout:4/952: fdatasync d9/da/fb 0 2024-09-21T12:20:59.317 INFO:tasks.workunit.client.0.smithi003.stdout:4/953: dwrite d9/d16/d65/d73/fd7 [0,4194304] 0 2024-09-21T12:20:59.319 INFO:tasks.workunit.client.0.smithi003.stdout:4/954: fdatasync d9/fc 0 2024-09-21T12:20:59.322 INFO:tasks.workunit.client.0.smithi003.stdout:4/955: rmdir d9/da/d47/d82/df7 39 2024-09-21T12:20:59.331 INFO:tasks.workunit.client.0.smithi003.stdout:4/956: creat d9/da/d66/f13a x:0 0 0 2024-09-21T12:20:59.338 INFO:tasks.workunit.client.0.smithi003.stdout:4/957: dread d9/da/d36/f50 [0,4194304] 0 2024-09-21T12:20:59.343 INFO:tasks.workunit.client.0.smithi003.stdout:4/958: dwrite d9/da/d66/da2/f100 [0,4194304] 0 2024-09-21T12:20:59.347 INFO:tasks.workunit.client.0.smithi003.stdout:4/959: creat d9/da/d66/d67/db2/df0/f13b x:0 0 0 2024-09-21T12:20:59.348 INFO:tasks.workunit.client.0.smithi003.stdout:4/960: read d9/d16/d65/d97/fc0 [3405090,124099] 0 2024-09-21T12:20:59.353 INFO:tasks.workunit.client.0.smithi003.stdout:4/961: unlink d9/da/d36/d55/dec/f12d 0 2024-09-21T12:20:59.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:20:59 smithi192 ceph-mon[35641]: pgmap v16: 65 pgs: 65 active+clean; 2.8 GiB data, 8.3 GiB used, 528 GiB / 536 GiB avail; 70 MiB/s rd, 152 MiB/s wr, 417 op/s 2024-09-21T12:20:59.520 INFO:tasks.workunit.client.0.smithi003.stdout:7/870: sync 2024-09-21T12:20:59.526 INFO:tasks.workunit.client.0.smithi003.stdout:7/871: dwrite d8/d2c/f118 [0,4194304] 0 2024-09-21T12:20:59.540 INFO:tasks.workunit.client.0.smithi003.stdout:7/872: dwrite d8/db/d32/d43/f88 [0,4194304] 0 2024-09-21T12:20:59.541 INFO:tasks.workunit.client.0.smithi003.stdout:7/873: fsync d8/d3c/d57/d115/d84/fec 0 2024-09-21T12:20:59.543 INFO:tasks.workunit.client.0.smithi003.stdout:7/874: truncate d8/db/f58 1645525 0 2024-09-21T12:20:59.547 INFO:tasks.workunit.client.0.smithi003.stdout:7/875: dread d8/db/d32/f6f [0,4194304] 0 2024-09-21T12:20:59.549 INFO:tasks.workunit.client.0.smithi003.stdout:7/876: creat d8/db/d32/d43/d7e/dad/d100/f11f x:0 0 0 2024-09-21T12:20:59.555 INFO:tasks.workunit.client.0.smithi003.stdout:7/877: creat d8/d3c/d64/df5/d96/db8/f120 x:0 0 0 2024-09-21T12:20:59.558 INFO:tasks.workunit.client.0.smithi003.stdout:7/878: creat d8/d3c/d57/d115/d84/da8/f121 x:0 0 0 2024-09-21T12:20:59.570 INFO:tasks.workunit.client.0.smithi003.stdout:2/964: sync 2024-09-21T12:20:59.570 INFO:tasks.workunit.client.0.smithi003.stdout:4/962: sync 2024-09-21T12:20:59.573 INFO:tasks.workunit.client.0.smithi003.stdout:7/879: dread d8/d3c/d64/df5/f1e [0,4194304] 0 2024-09-21T12:20:59.573 INFO:tasks.workunit.client.0.smithi003.stdout:7/880: dread - d8/db/d32/f105 zero size 2024-09-21T12:20:59.573 INFO:tasks.workunit.client.0.smithi003.stdout:4/963: creat d9/d16/d65/d73/f13c x:0 0 0 2024-09-21T12:20:59.576 INFO:tasks.workunit.client.0.smithi003.stdout:2/965: getdents d0/d46/dcd/d12e 0 2024-09-21T12:20:59.578 INFO:tasks.workunit.client.0.smithi003.stdout:4/964: symlink d9/da/d36/dcc/l13d 0 2024-09-21T12:20:59.578 INFO:tasks.workunit.client.0.smithi003.stdout:2/966: dread - d0/d21/d2c/d6c/fe0 zero size 2024-09-21T12:20:59.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:20:59 smithi003 ceph-mon[28057]: pgmap v16: 65 pgs: 65 active+clean; 2.8 GiB data, 8.3 GiB used, 528 GiB / 536 GiB avail; 70 MiB/s rd, 152 MiB/s wr, 417 op/s 2024-09-21T12:20:59.579 INFO:tasks.workunit.client.0.smithi003.stdout:4/965: readlink d9/da/d66/d67/dd6/d106/d114/l11d 0 2024-09-21T12:20:59.580 INFO:tasks.workunit.client.0.smithi003.stdout:4/966: read - d9/da/d47/f7e zero size 2024-09-21T12:20:59.582 INFO:tasks.workunit.client.0.smithi003.stdout:2/967: fsync d0/dd/d22/d9d/fca 0 2024-09-21T12:20:59.588 INFO:tasks.workunit.client.0.smithi003.stdout:7/881: truncate d8/db/f58 2141093 0 2024-09-21T12:20:59.593 INFO:tasks.workunit.client.0.smithi003.stdout:4/967: fdatasync d9/d25/f5e 0 2024-09-21T12:20:59.593 INFO:tasks.workunit.client.0.smithi003.stdout:7/882: mknod d8/dea/c122 0 2024-09-21T12:20:59.599 INFO:tasks.workunit.client.0.smithi003.stdout:7/883: fsync d8/d3c/f90 0 2024-09-21T12:20:59.605 INFO:tasks.workunit.client.0.smithi003.stdout:2/968: dread d0/dd/d22/fd1 [0,4194304] 0 2024-09-21T12:20:59.606 INFO:tasks.workunit.client.0.smithi003.stdout:2/969: chown d0/d1c/d6a 78263 1 2024-09-21T12:20:59.606 INFO:tasks.workunit.client.0.smithi003.stdout:4/968: dread d9/da/f31 [0,4194304] 0 2024-09-21T12:20:59.608 INFO:tasks.workunit.client.0.smithi003.stdout:4/969: write d9/d48/f101 [518280,17680] 0 2024-09-21T12:20:59.612 INFO:tasks.workunit.client.0.smithi003.stdout:4/970: chown d9/da/d66/da2/d121/f130 634 1 2024-09-21T12:20:59.613 INFO:tasks.workunit.client.0.smithi003.stdout:2/970: mkdir d0/d46/dcd/d12e/d151 0 2024-09-21T12:20:59.613 INFO:tasks.workunit.client.0.smithi003.stdout:7/884: dread d8/d3c/d64/df5/f1a [0,4194304] 0 2024-09-21T12:20:59.613 INFO:tasks.workunit.client.0.smithi003.stdout:4/971: chown d9/f64 60 1 2024-09-21T12:20:59.616 INFO:tasks.workunit.client.0.smithi003.stdout:2/971: rename d0/d1c/f61 to d0/d21/d30/d12f/f152 0 2024-09-21T12:20:59.617 INFO:tasks.workunit.client.0.smithi003.stdout:4/972: mknod d9/da/d66/d67/dd6/d106/c13e 0 2024-09-21T12:20:59.618 INFO:tasks.workunit.client.0.smithi003.stdout:4/973: fdatasync d9/da/d66/f95 0 2024-09-21T12:20:59.621 INFO:tasks.workunit.client.0.smithi003.stdout:7/885: write d8/db/d32/f8c [754838,114559] 0 2024-09-21T12:20:59.621 INFO:tasks.workunit.client.0.smithi003.stdout:2/972: symlink d0/d46/dcd/d12e/d151/l153 0 2024-09-21T12:20:59.626 INFO:tasks.workunit.client.0.smithi003.stdout:4/974: write d9/da/d66/da2/fac [3750,51946] 0 2024-09-21T12:20:59.628 INFO:tasks.workunit.client.0.smithi003.stdout:4/975: chown d9/da/dd3 58316296 1 2024-09-21T12:20:59.630 INFO:tasks.workunit.client.0.smithi003.stdout:7/886: creat d8/d3c/d64/df5/d96/db8/dc4/f123 x:0 0 0 2024-09-21T12:20:59.630 INFO:tasks.workunit.client.0.smithi003.stdout:2/973: dwrite d0/d1c/d6a/f2a [0,4194304] 0 2024-09-21T12:20:59.636 INFO:tasks.workunit.client.0.smithi003.stdout:2/974: fdatasync d0/dd/d22/d37/dda/d97/fcf 0 2024-09-21T12:20:59.637 INFO:tasks.workunit.client.0.smithi003.stdout:4/976: mkdir d9/da/d36/d13f 0 2024-09-21T12:20:59.637 INFO:tasks.workunit.client.0.smithi003.stdout:2/975: dread - d0/d46/f14b zero size 2024-09-21T12:20:59.638 INFO:tasks.workunit.client.0.smithi003.stdout:7/887: unlink d8/l34 0 2024-09-21T12:20:59.640 INFO:tasks.workunit.client.0.smithi003.stdout:4/977: symlink d9/da/d66/da2/l140 0 2024-09-21T12:20:59.643 INFO:tasks.workunit.client.0.smithi003.stdout:2/976: rename d0/dd/d22/fe3 to d0/d21/d133/d50/dfb/f154 0 2024-09-21T12:20:59.644 INFO:tasks.workunit.client.0.smithi003.stdout:7/888: truncate d8/d2c/f2a 693861 0 2024-09-21T12:20:59.645 INFO:tasks.workunit.client.0.smithi003.stdout:7/889: readlink d8/d3c/d64/ld6 0 2024-09-21T12:20:59.646 INFO:tasks.workunit.client.0.smithi003.stdout:4/978: stat c4 0 2024-09-21T12:20:59.647 INFO:tasks.workunit.client.0.smithi003.stdout:7/890: mkdir d8/db/d124 0 2024-09-21T12:20:59.655 INFO:tasks.workunit.client.0.smithi003.stdout:7/891: dwrite d8/db/d32/d43/d7e/dad/f10d [0,4194304] 0 2024-09-21T12:20:59.656 INFO:tasks.workunit.client.0.smithi003.stdout:7/892: dread - d8/d3c/d57/d115/d84/da8/f121 zero size 2024-09-21T12:20:59.661 INFO:tasks.workunit.client.0.smithi003.stdout:4/979: write d9/fc [2572630,53399] 0 2024-09-21T12:20:59.666 INFO:tasks.workunit.client.0.smithi003.stdout:7/893: link d8/db/l11 d8/db/d32/d43/d7e/dad/l125 0 2024-09-21T12:20:59.669 INFO:tasks.workunit.client.0.smithi003.stdout:4/980: rename d9/da/d47/d82/le1 to d9/da/d36/d8c/dbd/l141 0 2024-09-21T12:20:59.671 INFO:tasks.workunit.client.0.smithi003.stdout:4/981: fsync d9/d48/f101 0 2024-09-21T12:20:59.673 INFO:tasks.workunit.client.0.smithi003.stdout:7/894: getdents d8/d3c/d64/df5/d96/db8 0 2024-09-21T12:20:59.676 INFO:tasks.workunit.client.0.smithi003.stdout:7/895: rename d8/d3c/f9a to d8/dea/f126 0 2024-09-21T12:20:59.676 INFO:tasks.workunit.client.0.smithi003.stdout:4/982: getdents d9/d48 0 2024-09-21T12:20:59.679 INFO:tasks.workunit.client.0.smithi003.stdout:7/896: creat d8/d2c/f127 x:0 0 0 2024-09-21T12:20:59.680 INFO:tasks.workunit.client.0.smithi003.stdout:4/983: mkdir d9/da/d66/d67/db2/df0/d142 0 2024-09-21T12:20:59.683 INFO:tasks.workunit.client.0.smithi003.stdout:7/897: dread d8/f1d [0,4194304] 0 2024-09-21T12:20:59.683 INFO:tasks.workunit.client.0.smithi003.stdout:4/984: symlink d9/d16/l143 0 2024-09-21T12:20:59.685 INFO:tasks.workunit.client.0.smithi003.stdout:4/985: dread d9/da/d66/da2/fac [0,4194304] 0 2024-09-21T12:20:59.693 INFO:tasks.workunit.client.0.smithi003.stdout:4/986: dread d9/f15 [0,4194304] 0 2024-09-21T12:20:59.697 INFO:tasks.workunit.client.0.smithi003.stdout:7/898: write d8/d3c/d64/df5/d96/db8/dc4/f123 [165937,22889] 0 2024-09-21T12:20:59.705 INFO:tasks.workunit.client.0.smithi003.stdout:7/899: dwrite d8/d3c/d57/d115/fee [0,4194304] 0 2024-09-21T12:20:59.711 INFO:tasks.workunit.client.0.smithi003.stdout:7/900: rename d8/db/d32/d43/faf to d8/d2c/d11d/f128 0 2024-09-21T12:20:59.712 INFO:tasks.workunit.client.0.smithi003.stdout:7/901: stat d8/db/d32/d43/d92/l116 0 2024-09-21T12:20:59.715 INFO:tasks.workunit.client.0.smithi003.stdout:7/902: readlink d8/db/d32/d43/l5b 0 2024-09-21T12:20:59.716 INFO:tasks.workunit.client.0.smithi003.stdout:7/903: chown d8/d3c/d64/df5/f30 2 1 2024-09-21T12:20:59.716 INFO:tasks.workunit.client.0.smithi003.stdout:7/904: fdatasync d8/db/d32/f105 0 2024-09-21T12:20:59.717 INFO:tasks.workunit.client.0.smithi003.stdout:7/905: fdatasync d8/d3c/d64/df5/d96/db8/dc4/ff2 0 2024-09-21T12:20:59.719 INFO:tasks.workunit.client.0.smithi003.stdout:7/906: mknod d8/d3c/d64/df5/d75/c129 0 2024-09-21T12:20:59.727 INFO:tasks.workunit.client.0.smithi003.stdout:7/907: truncate d8/db/d32/d43/fef 2240406 0 2024-09-21T12:20:59.728 INFO:tasks.workunit.client.0.smithi003.stdout:7/908: dread - d8/d3c/d64/df5/d60/f8f zero size 2024-09-21T12:20:59.730 INFO:tasks.workunit.client.0.smithi003.stdout:7/909: fsync d8/d3c/d64/df5/f1e 0 2024-09-21T12:20:59.737 INFO:tasks.workunit.client.0.smithi003.stdout:7/910: rename d8/d3c/d57/d115/c46 to d8/d3c/d64/c12a 0 2024-09-21T12:20:59.748 INFO:tasks.workunit.client.0.smithi003.stdout:7/911: dwrite d8/d93/fbd [0,4194304] 0 2024-09-21T12:20:59.755 INFO:tasks.workunit.client.0.smithi003.stdout:7/912: getdents d8/d3c/d57 0 2024-09-21T12:20:59.759 INFO:tasks.workunit.client.0.smithi003.stdout:7/913: rename d8/d3c/d57/d115/d84/fec to d8/d3c/d57/f12b 0 2024-09-21T12:20:59.760 INFO:tasks.workunit.client.0.smithi003.stdout:7/914: rmdir d8/d3c 39 2024-09-21T12:20:59.764 INFO:tasks.workunit.client.0.smithi003.stdout:7/915: rename d8/d3c/d64/df5/d96/db8/dc4/ff2 to d8/d3c/d64/df5/d85/dbe/f12c 0 2024-09-21T12:20:59.767 INFO:tasks.workunit.client.0.smithi003.stdout:7/916: readlink l5 0 2024-09-21T12:20:59.770 INFO:tasks.workunit.client.0.smithi003.stdout:7/917: creat d8/d3c/d64/df5/d96/f12d x:0 0 0 2024-09-21T12:20:59.775 INFO:tasks.workunit.client.0.smithi003.stdout:7/918: getdents d8/db/d32 0 2024-09-21T12:20:59.779 INFO:tasks.workunit.client.0.smithi003.stdout:7/919: getdents d8/d3c/d64/df0/dbf 0 2024-09-21T12:20:59.783 INFO:tasks.workunit.client.0.smithi003.stdout:7/920: fsync d8/d3c/d57/d115/fee 0 2024-09-21T12:20:59.786 INFO:tasks.workunit.client.0.smithi003.stdout:7/921: creat d8/d3c/d64/df5/f12e x:0 0 0 2024-09-21T12:20:59.787 INFO:tasks.workunit.client.0.smithi003.stdout:7/922: creat d8/d2c/f12f x:0 0 0 2024-09-21T12:20:59.788 INFO:tasks.workunit.client.0.smithi003.stdout:7/923: chown d8/db/l7d 22 1 2024-09-21T12:20:59.789 INFO:tasks.workunit.client.0.smithi003.stdout:7/924: mkdir d8/db/d32/d43/d92/d130 0 2024-09-21T12:20:59.790 INFO:tasks.workunit.client.0.smithi003.stdout:7/925: readlink d8/db/l7d 0 2024-09-21T12:20:59.792 INFO:tasks.workunit.client.0.smithi003.stdout:7/926: unlink d8/d3c/d64/df5/l70 0 2024-09-21T12:20:59.796 INFO:tasks.workunit.client.0.smithi003.stdout:7/927: getdents d8/d3c/d64 0 2024-09-21T12:20:59.797 INFO:tasks.workunit.client.0.smithi003.stdout:7/928: stat d8/d3c/d64/df5/d60/fb0 0 2024-09-21T12:20:59.798 INFO:tasks.workunit.client.0.smithi003.stdout:7/929: truncate d8/d2c/f127 184009 0 2024-09-21T12:20:59.834 INFO:tasks.workunit.client.0.smithi003.stdout:7/930: getdents d8/d3c/d57/d81 0 2024-09-21T12:20:59.856 INFO:tasks.workunit.client.0.smithi003.stdout:7/931: dwrite d8/db/d32/d43/fef [0,4194304] 0 2024-09-21T12:20:59.862 INFO:tasks.workunit.client.0.smithi003.stdout:7/932: link d8/d93/fcd d8/d7a/f131 0 2024-09-21T12:20:59.869 INFO:tasks.workunit.client.0.smithi003.stdout:7/933: dwrite d8/db/d32/d43/fef [0,4194304] 0 2024-09-21T12:20:59.870 INFO:tasks.workunit.client.0.smithi003.stdout:7/934: stat d8/db/f2b 0 2024-09-21T12:20:59.881 INFO:tasks.workunit.client.0.smithi003.stdout:7/935: getdents d8/d3c/d57 0 2024-09-21T12:20:59.884 INFO:tasks.workunit.client.0.smithi003.stdout:7/936: rmdir d8/d3c/d57/d115/d84/da9/dc5 39 2024-09-21T12:20:59.886 INFO:tasks.workunit.client.0.smithi003.stdout:7/937: creat d8/d3c/d64/df5/d96/db8/f132 x:0 0 0 2024-09-21T12:20:59.888 INFO:tasks.workunit.client.0.smithi003.stdout:7/938: write d8/d3c/d57/f73 [5098930,20834] 0 2024-09-21T12:20:59.890 INFO:tasks.workunit.client.0.smithi003.stdout:7/939: mknod d8/db/d32/d43/c133 0 2024-09-21T12:20:59.890 INFO:tasks.workunit.client.0.smithi003.stdout:7/940: chown d8/db/ff 1277923 1 2024-09-21T12:20:59.896 INFO:tasks.workunit.client.0.smithi003.stdout:7/941: dwrite d8/d2c/f127 [0,4194304] 0 2024-09-21T12:20:59.908 INFO:tasks.workunit.client.0.smithi003.stdout:7/942: write d8/d93/fc1 [319488,69005] 0 2024-09-21T12:20:59.911 INFO:tasks.workunit.client.0.smithi003.stdout:7/943: truncate d8/db/f2b 9416506 0 2024-09-21T12:20:59.914 INFO:tasks.workunit.client.0.smithi003.stdout:7/944: mknod d8/d3c/d64/df5/d85/c134 0 2024-09-21T12:20:59.915 INFO:tasks.workunit.client.0.smithi003.stdout:7/945: readlink d8/d3c/d6b/dcc/lfc 0 2024-09-21T12:20:59.929 INFO:tasks.workunit.client.0.smithi003.stdout:7/946: dwrite d8/db/d32/f5d [0,4194304] 0 2024-09-21T12:20:59.938 INFO:tasks.workunit.client.0.smithi003.stdout:7/947: getdents d8/d3c/d57/d115/d84 0 2024-09-21T12:20:59.940 INFO:tasks.workunit.client.0.smithi003.stdout:7/948: creat d8/db/d32/d43/d7e/f135 x:0 0 0 2024-09-21T12:20:59.943 INFO:tasks.workunit.client.0.smithi003.stdout:7/949: creat d8/d3c/d64/df5/d96/db8/dc4/f136 x:0 0 0 2024-09-21T12:20:59.947 INFO:tasks.workunit.client.0.smithi003.stdout:7/950: rename d8/d3c/d57/d81/c8d to d8/d3c/d64/df5/c137 0 2024-09-21T12:20:59.948 INFO:tasks.workunit.client.0.smithi003.stdout:7/951: chown d8/d2c/d11d/f128 2349200 1 2024-09-21T12:20:59.950 INFO:tasks.workunit.client.0.smithi003.stdout:7/952: rename d8/dea/c122 to d8/d3c/d57/d115/d84/c138 0 2024-09-21T12:20:59.951 INFO:tasks.workunit.client.0.smithi003.stdout:7/953: symlink d8/l139 0 2024-09-21T12:20:59.953 INFO:tasks.workunit.client.0.smithi003.stdout:7/954: unlink d8/db/d32/l11a 0 2024-09-21T12:20:59.965 INFO:tasks.workunit.client.0.smithi003.stdout:2/977: sync 2024-09-21T12:20:59.966 INFO:tasks.workunit.client.0.smithi003.stdout:2/978: chown d0/d1c/f96 77661 1 2024-09-21T12:20:59.968 INFO:tasks.workunit.client.0.smithi003.stdout:2/979: creat d0/dd/d22/d9d/f155 x:0 0 0 2024-09-21T12:20:59.971 INFO:tasks.workunit.client.0.smithi003.stdout:7/955: write d8/db/d32/d43/f76 [4759341,82568] 0 2024-09-21T12:20:59.977 INFO:tasks.workunit.client.0.smithi003.stdout:7/956: rename d8/d2c/f12f to d8/d3c/d64/df5/d75/f13a 0 2024-09-21T12:20:59.982 INFO:tasks.workunit.client.0.smithi003.stdout:2/980: write d0/d21/d133/d50/fc8 [1107926,70823] 0 2024-09-21T12:20:59.985 INFO:tasks.workunit.client.0.smithi003.stdout:2/981: creat d0/dd/d22/d37/dda/d97/f156 x:0 0 0 2024-09-21T12:20:59.986 INFO:tasks.workunit.client.0.smithi003.stdout:2/982: write d0/d46/dcd/f106 [956155,89246] 0 2024-09-21T12:20:59.986 INFO:tasks.workunit.client.0.smithi003.stdout:7/957: write d8/d3c/d64/df5/d60/fb0 [1517285,54511] 0 2024-09-21T12:20:59.990 INFO:tasks.workunit.client.0.smithi003.stdout:7/958: truncate d8/d3c/d57/d115/d84/da8/f121 560416 0 2024-09-21T12:20:59.992 INFO:tasks.workunit.client.0.smithi003.stdout:7/959: mknod d8/d3c/d6b/c13b 0 2024-09-21T12:20:59.993 INFO:tasks.workunit.client.0.smithi003.stdout:2/983: dwrite d0/d1c/f42 [4194304,4194304] 0 2024-09-21T12:20:59.999 INFO:tasks.workunit.client.0.smithi003.stdout:2/984: rename d0/d21/d133/fa2 to d0/d21/d30/d12f/f157 0 2024-09-21T12:21:00.000 INFO:tasks.workunit.client.0.smithi003.stdout:2/985: chown d0/d21/d133/d50/f69 100406 1 2024-09-21T12:21:00.000 INFO:tasks.workunit.client.0.smithi003.stdout:2/986: readlink d0/de2/l60 0 2024-09-21T12:21:00.009 INFO:tasks.workunit.client.0.smithi003.stdout:7/960: dwrite d8/d3c/d64/df5/d60/f8f [0,4194304] 0 2024-09-21T12:21:00.010 INFO:tasks.workunit.client.0.smithi003.stdout:7/961: readlink d8/db/d32/d43/d7e/le9 0 2024-09-21T12:21:00.013 INFO:tasks.workunit.client.0.smithi003.stdout:7/962: creat d8/d7a/f13c x:0 0 0 2024-09-21T12:21:00.016 INFO:tasks.workunit.client.0.smithi003.stdout:2/987: write d0/d1c/d6a/fc6 [315137,116583] 0 2024-09-21T12:21:00.021 INFO:tasks.workunit.client.0.smithi003.stdout:2/988: rename d0/d21/d133/d50/fe9 to d0/dd/d22/d9d/f158 0 2024-09-21T12:21:00.032 INFO:tasks.workunit.client.0.smithi003.stdout:7/963: dread d8/d3c/d64/df5/f30 [0,4194304] 0 2024-09-21T12:21:00.034 INFO:tasks.workunit.client.0.smithi003.stdout:7/964: rmdir d8/d3c/d57/d81 39 2024-09-21T12:21:00.035 INFO:tasks.workunit.client.0.smithi003.stdout:7/965: creat d8/db/d32/d43/d7e/f13d x:0 0 0 2024-09-21T12:21:00.036 INFO:tasks.workunit.client.0.smithi003.stdout:7/966: stat d8/db/d32/d43/d7e/fc0 0 2024-09-21T12:21:00.037 INFO:tasks.workunit.client.0.smithi003.stdout:7/967: chown d8/ca4 676 1 2024-09-21T12:21:00.040 INFO:tasks.workunit.client.0.smithi003.stdout:7/968: write d8/d3c/d57/f73 [4155448,123013] 0 2024-09-21T12:21:00.042 INFO:tasks.workunit.client.0.smithi003.stdout:7/969: symlink d8/db/d32/d43/d7e/l13e 0 2024-09-21T12:21:00.048 INFO:tasks.workunit.client.0.smithi003.stdout:7/970: rename d8/l12 to d8/d3c/d64/df5/d75/l13f 0 2024-09-21T12:21:00.057 INFO:tasks.workunit.client.0.smithi003.stdout:7/971: write d8/d3c/fb1 [9228452,126485] 0 2024-09-21T12:21:00.057 INFO:tasks.workunit.client.0.smithi003.stdout:7/972: mknod d8/d3c/d64/df5/d85/c140 0 2024-09-21T12:21:00.058 INFO:tasks.workunit.client.0.smithi003.stdout:7/973: rmdir d8/d3c/d64/df5/d85 39 2024-09-21T12:21:00.060 INFO:tasks.workunit.client.0.smithi003.stdout:7/974: chown d8/d3c/d57/d115/c36 81509522 1 2024-09-21T12:21:00.063 INFO:tasks.workunit.client.0.smithi003.stdout:7/975: mkdir d8/d3c/d6b/d141 0 2024-09-21T12:21:00.075 INFO:tasks.workunit.client.0.smithi003.stdout:7/976: dread d8/db/f1c [4194304,4194304] 0 2024-09-21T12:21:00.078 INFO:tasks.workunit.client.0.smithi003.stdout:7/977: mkdir d8/d142 0 2024-09-21T12:21:00.079 INFO:tasks.workunit.client.0.smithi003.stdout:7/978: write d8/db/d32/d43/ffb [1666621,106639] 0 2024-09-21T12:21:00.086 INFO:tasks.workunit.client.0.smithi003.stdout:7/979: mknod d8/d3c/d57/d115/c143 0 2024-09-21T12:21:00.092 INFO:tasks.workunit.client.0.smithi003.stdout:7/980: dwrite d8/d3c/fb1 [0,4194304] 0 2024-09-21T12:21:00.103 INFO:tasks.workunit.client.0.smithi003.stdout:7/981: dread d8/d3c/d64/df5/f30 [0,4194304] 0 2024-09-21T12:21:00.173 INFO:tasks.workunit.client.0.smithi003.stdout:4/987: sync 2024-09-21T12:21:00.180 INFO:tasks.workunit.client.0.smithi003.stdout:7/982: write d8/db/d32/f105 [554470,81757] 0 2024-09-21T12:21:00.180 INFO:tasks.workunit.client.0.smithi003.stdout:4/988: symlink d9/d48/l144 0 2024-09-21T12:21:00.185 INFO:tasks.workunit.client.0.smithi003.stdout:7/983: creat d8/d3c/d57/d81/f144 x:0 0 0 2024-09-21T12:21:00.186 INFO:tasks.workunit.client.0.smithi003.stdout:4/989: mknod d9/da/d36/da9/d126/c145 0 2024-09-21T12:21:00.187 INFO:tasks.workunit.client.0.smithi003.stdout:7/984: fdatasync d8/db/f1c 0 2024-09-21T12:21:00.190 INFO:tasks.workunit.client.0.smithi003.stdout:4/990: dread d9/da/d66/da2/f100 [0,4194304] 0 2024-09-21T12:21:00.192 INFO:tasks.workunit.client.0.smithi003.stdout:4/991: mknod d9/da/c146 0 2024-09-21T12:21:00.195 INFO:tasks.workunit.client.0.smithi003.stdout:2/989: sync 2024-09-21T12:21:00.205 INFO:tasks.workunit.client.0.smithi003.stdout:2/990: creat d0/d46/f159 x:0 0 0 2024-09-21T12:21:00.221 INFO:tasks.workunit.client.0.smithi003.stdout:4/992: dwrite d9/da/dab/dd4/fef [0,4194304] 0 2024-09-21T12:21:00.223 INFO:tasks.workunit.client.0.smithi003.stdout:2/991: write d0/d21/d133/d50/f90 [2230158,69308] 0 2024-09-21T12:21:00.227 INFO:tasks.workunit.client.0.smithi003.stdout:4/993: creat d9/da/d66/d67/db2/df0/f147 x:0 0 0 2024-09-21T12:21:00.230 INFO:tasks.workunit.client.0.smithi003.stdout:4/994: dread d9/da/d66/da2/fac [0,4194304] 0 2024-09-21T12:21:00.232 INFO:tasks.workunit.client.0.smithi003.stdout:2/992: dwrite d0/d21/d133/d50/dc4/d7f/d115/f11e [0,4194304] 0 2024-09-21T12:21:00.233 INFO:tasks.workunit.client.0.smithi003.stdout:4/995: creat d9/d16/d65/d73/d104/f148 x:0 0 0 2024-09-21T12:21:00.237 INFO:tasks.workunit.client.0.smithi003.stdout:2/993: creat d0/d21/d133/d50/dc4/d7f/f15a x:0 0 0 2024-09-21T12:21:00.240 INFO:tasks.workunit.client.0.smithi003.stdout:4/996: creat d9/da/d36/da9/f149 x:0 0 0 2024-09-21T12:21:00.251 INFO:tasks.workunit.client.0.smithi003.stdout:2/994: dwrite d0/dd/f29 [0,4194304] 0 2024-09-21T12:21:00.251 INFO:tasks.workunit.client.0.smithi003.stdout:4/997: dwrite d9/da/d66/d67/dcd/dd8/f75 [4194304,4194304] 0 2024-09-21T12:21:00.258 INFO:tasks.workunit.client.0.smithi003.stdout:2/995: dread d0/ff [0,4194304] 0 2024-09-21T12:21:00.266 INFO:tasks.workunit.client.0.smithi003.stdout:2/996: dwrite d0/dd/d22/d37/f48 [0,4194304] 0 2024-09-21T12:21:00.267 INFO:tasks.workunit.client.0.smithi003.stdout:2/997: chown d0/ff 283 1 2024-09-21T12:21:00.268 INFO:tasks.workunit.client.0.smithi003.stdout:2/998: mkdir d0/d21/d133/d50/dc4/dc7/d15b 0 2024-09-21T12:21:00.269 INFO:tasks.workunit.client.0.smithi003.stdout:2/999: chown d0/d21/d30/d78/c9c 4597 1 2024-09-21T12:21:00.279 INFO:tasks.workunit.client.0.smithi003.stdout:4/998: dread d9/da/fa5 [0,4194304] 0 2024-09-21T12:21:00.287 INFO:tasks.workunit.client.0.smithi003.stdout:4/999: dwrite d9/da/d66/da2/f100 [4194304,4194304] 0 2024-09-21T12:21:00.374 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-21T12:21:00.374 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-09-21T12:21:00.391 INFO:tasks.workunit.client.0.smithi003.stdout:7/985: sync 2024-09-21T12:21:00.393 INFO:tasks.workunit.client.0.smithi003.stdout:7/986: creat d8/db/d32/d43/d7e/dad/f145 x:0 0 0 2024-09-21T12:21:00.402 INFO:tasks.workunit.client.0.smithi003.stdout:7/987: dwrite d8/d3c/faa [0,4194304] 0 2024-09-21T12:21:00.411 INFO:tasks.workunit.client.0.smithi003.stdout:7/988: write d8/d3c/d57/d115/d84/da9/dc5/f10e [1155001,107067] 0 2024-09-21T12:21:00.416 INFO:tasks.workunit.client.0.smithi003.stdout:7/989: rename d8/d3c/d57/d115/d84/c94 to d8/d3c/d57/c146 0 2024-09-21T12:21:00.417 INFO:tasks.workunit.client.0.smithi003.stdout:7/990: write d8/db/f16 [1475171,30699] 0 2024-09-21T12:21:00.421 INFO:tasks.workunit.client.0.smithi003.stdout:7/991: link d8/d3c/d57/d115/d84/da9/lfe d8/d3c/d6b/l147 0 2024-09-21T12:21:00.427 INFO:tasks.workunit.client.0.smithi003.stdout:7/992: getdents d8/db/d32/d43 0 2024-09-21T12:21:00.433 INFO:tasks.workunit.client.0.smithi003.stdout:7/993: truncate d8/d3c/d57/d115/fa3 1043317 0 2024-09-21T12:21:00.448 INFO:tasks.workunit.client.0.smithi003.stdout:7/994: dread d8/dea/fb6 [0,4194304] 0 2024-09-21T12:21:00.466 INFO:tasks.workunit.client.0.smithi003.stdout:7/995: dread d8/db/d32/d43/d7e/f83 [0,4194304] 0 2024-09-21T12:21:00.469 INFO:tasks.workunit.client.0.smithi003.stdout:7/996: rename d8/c109 to d8/d3c/c148 0 2024-09-21T12:21:00.470 INFO:tasks.workunit.client.0.smithi003.stdout:7/997: stat d8/d3c/d64/f79 0 2024-09-21T12:21:00.477 INFO:tasks.workunit.client.0.smithi003.stdout:7/998: creat d8/d3c/d57/d115/d84/da9/f149 x:0 0 0 2024-09-21T12:21:00.479 INFO:tasks.workunit.client.0.smithi003.stdout:7/999: truncate d8/d3c/d64/df5/f86 160765 0 2024-09-21T12:21:00.482 INFO:tasks.workunit.client.0.smithi003.stderr:+ rm -rf -- ./tmp.YQwefhmTKg 2024-09-21T12:21:02.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:01 smithi192 ceph-mon[35641]: pgmap v17: 65 pgs: 65 active+clean; 2.8 GiB data, 8.3 GiB used, 528 GiB / 536 GiB avail; 50 MiB/s rd, 103 MiB/s wr, 290 op/s 2024-09-21T12:21:02.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:01 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' 2024-09-21T12:21:02.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:01 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' 2024-09-21T12:21:02.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:01 smithi003 ceph-mon[28057]: pgmap v17: 65 pgs: 65 active+clean; 2.8 GiB data, 8.3 GiB used, 528 GiB / 536 GiB avail; 50 MiB/s rd, 103 MiB/s wr, 290 op/s 2024-09-21T12:21:02.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:01 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' 2024-09-21T12:21:02.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:01 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' 2024-09-21T12:21:03.302 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:03 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' 2024-09-21T12:21:03.302 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:03 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' 2024-09-21T12:21:03.302 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:03 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:21:03.302 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:03 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:21:03.303 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:03 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:21:03.303 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:03 smithi003 ceph-mon[28057]: Adjusting osd_memory_target on smithi003 to 1217M 2024-09-21T12:21:03.303 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:03 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' 2024-09-21T12:21:03.303 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:03 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:21:03.303 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:03 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:21:03.303 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:03 smithi003 ceph-mon[28057]: Updating smithi003:/etc/ceph/ceph.conf 2024-09-21T12:21:03.303 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:03 smithi003 ceph-mon[28057]: Updating smithi192:/etc/ceph/ceph.conf 2024-09-21T12:21:03.303 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:03 smithi003 ceph-mon[28057]: pgmap v18: 65 pgs: 65 active+clean; 2.8 GiB data, 8.3 GiB used, 528 GiB / 536 GiB avail; 50 MiB/s rd, 103 MiB/s wr, 290 op/s 2024-09-21T12:21:03.303 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:03 smithi003 ceph-mon[28057]: Updating smithi192:/var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T12:21:03.303 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:03 smithi003 ceph-mon[28057]: Updating smithi003:/var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T12:21:03.303 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:03 smithi003 ceph-mon[28057]: Updating smithi192:/etc/ceph/ceph.client.admin.keyring 2024-09-21T12:21:03.303 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:03 smithi003 ceph-mon[28057]: Updating smithi003:/etc/ceph/ceph.client.admin.keyring 2024-09-21T12:21:03.303 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:03 smithi003 ceph-mon[28057]: Updating smithi192:/var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T12:21:03.303 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:03 smithi003 ceph-mon[28057]: Updating smithi003:/var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T12:21:03.303 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:03 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' 2024-09-21T12:21:03.304 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:03 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' 2024-09-21T12:21:03.304 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:03 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' 2024-09-21T12:21:03.304 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:03 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' 2024-09-21T12:21:03.304 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:03 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' 2024-09-21T12:21:03.304 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:03 smithi003 ceph-mon[28057]: Reconfiguring ceph-exporter.smithi003 (dependencies changed)... 2024-09-21T12:21:03.304 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:03 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi003", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-21T12:21:03.304 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:03 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:21:03.304 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:03 smithi003 ceph-mon[28057]: Deploying daemon ceph-exporter.smithi003 on smithi003 2024-09-21T12:21:03.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:03 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' 2024-09-21T12:21:03.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:03 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' 2024-09-21T12:21:03.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:03 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:21:03.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:03 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:21:03.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:03 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-21T12:21:03.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:03 smithi192 ceph-mon[35641]: Adjusting osd_memory_target on smithi003 to 1217M 2024-09-21T12:21:03.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:03 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' 2024-09-21T12:21:03.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:03 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:21:03.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:03 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:21:03.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:03 smithi192 ceph-mon[35641]: Updating smithi003:/etc/ceph/ceph.conf 2024-09-21T12:21:03.509 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:03 smithi192 ceph-mon[35641]: Updating smithi192:/etc/ceph/ceph.conf 2024-09-21T12:21:03.509 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:03 smithi192 ceph-mon[35641]: pgmap v18: 65 pgs: 65 active+clean; 2.8 GiB data, 8.3 GiB used, 528 GiB / 536 GiB avail; 50 MiB/s rd, 103 MiB/s wr, 290 op/s 2024-09-21T12:21:03.509 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:03 smithi192 ceph-mon[35641]: Updating smithi192:/var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T12:21:03.509 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:03 smithi192 ceph-mon[35641]: Updating smithi003:/var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T12:21:03.509 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:03 smithi192 ceph-mon[35641]: Updating smithi192:/etc/ceph/ceph.client.admin.keyring 2024-09-21T12:21:03.509 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:03 smithi192 ceph-mon[35641]: Updating smithi003:/etc/ceph/ceph.client.admin.keyring 2024-09-21T12:21:03.509 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:03 smithi192 ceph-mon[35641]: Updating smithi192:/var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T12:21:03.509 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:03 smithi192 ceph-mon[35641]: Updating smithi003:/var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T12:21:03.509 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:03 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' 2024-09-21T12:21:03.509 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:03 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' 2024-09-21T12:21:03.509 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:03 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' 2024-09-21T12:21:03.509 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:03 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' 2024-09-21T12:21:03.509 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:03 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' 2024-09-21T12:21:03.510 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:03 smithi192 ceph-mon[35641]: Reconfiguring ceph-exporter.smithi003 (dependencies changed)... 2024-09-21T12:21:03.510 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:03 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi003", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-21T12:21:03.510 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:03 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:21:03.510 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:03 smithi192 ceph-mon[35641]: Deploying daemon ceph-exporter.smithi003 on smithi003 2024-09-21T12:21:04.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:04 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:21:04.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:04 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:21:05.308 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:05 smithi003 ceph-mon[28057]: pgmap v19: 65 pgs: 65 active+clean; 2.2 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail; 55 MiB/s rd, 121 MiB/s wr, 372 op/s 2024-09-21T12:21:05.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:05 smithi192 ceph-mon[35641]: pgmap v19: 65 pgs: 65 active+clean; 2.2 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail; 55 MiB/s rd, 121 MiB/s wr, 372 op/s 2024-09-21T12:21:08.165 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:07 smithi003 ceph-mon[28057]: pgmap v20: 65 pgs: 65 active+clean; 2.2 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail; 29 MiB/s rd, 66 MiB/s wr, 214 op/s 2024-09-21T12:21:08.165 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:07 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' 2024-09-21T12:21:08.165 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:07 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' 2024-09-21T12:21:08.259 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:07 smithi192 ceph-mon[35641]: pgmap v20: 65 pgs: 65 active+clean; 2.2 GiB data, 6.9 GiB used, 530 GiB / 536 GiB avail; 29 MiB/s rd, 66 MiB/s wr, 214 op/s 2024-09-21T12:21:08.259 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:07 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' 2024-09-21T12:21:08.259 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:07 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' 2024-09-21T12:21:09.072 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:08 smithi003 ceph-mon[28057]: Reconfiguring prometheus.smithi003 (dependencies changed)... 2024-09-21T12:21:09.072 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:08 smithi003 ceph-mon[28057]: Reconfiguring daemon prometheus.smithi003 on smithi003 2024-09-21T12:21:09.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:08 smithi192 ceph-mon[35641]: Reconfiguring prometheus.smithi003 (dependencies changed)... 2024-09-21T12:21:09.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:08 smithi192 ceph-mon[35641]: Reconfiguring daemon prometheus.smithi003 on smithi003 2024-09-21T12:21:10.031 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:09 smithi003 ceph-mon[28057]: pgmap v21: 65 pgs: 65 active+clean; 1.7 GiB data, 5.3 GiB used, 531 GiB / 536 GiB avail; 29 MiB/s rd, 67 MiB/s wr, 276 op/s 2024-09-21T12:21:10.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:09 smithi192 ceph-mon[35641]: pgmap v21: 65 pgs: 65 active+clean; 1.7 GiB data, 5.3 GiB used, 531 GiB / 536 GiB avail; 29 MiB/s rd, 67 MiB/s wr, 276 op/s 2024-09-21T12:21:12.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:11 smithi003 ceph-mon[28057]: pgmap v22: 65 pgs: 65 active+clean; 1.7 GiB data, 5.3 GiB used, 531 GiB / 536 GiB avail; 5.3 MiB/s rd, 19 MiB/s wr, 143 op/s 2024-09-21T12:21:12.188 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:11 smithi192 ceph-mon[35641]: pgmap v22: 65 pgs: 65 active+clean; 1.7 GiB data, 5.3 GiB used, 531 GiB / 536 GiB avail; 5.3 MiB/s rd, 19 MiB/s wr, 143 op/s 2024-09-21T12:21:13.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:13 smithi192 ceph-mon[35641]: pgmap v23: 65 pgs: 65 active+clean; 1.7 GiB data, 5.3 GiB used, 531 GiB / 536 GiB avail; 5.3 MiB/s rd, 19 MiB/s wr, 143 op/s 2024-09-21T12:21:13.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:13 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' 2024-09-21T12:21:13.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:13 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' 2024-09-21T12:21:13.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:13 smithi192 ceph-mon[35641]: Reconfiguring ceph-exporter.smithi192 (dependencies changed)... 2024-09-21T12:21:13.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:13 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi192", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-21T12:21:13.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:13 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:21:13.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:13 smithi192 ceph-mon[35641]: Deploying daemon ceph-exporter.smithi192 on smithi192 2024-09-21T12:21:13.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:13 smithi003 ceph-mon[28057]: pgmap v23: 65 pgs: 65 active+clean; 1.7 GiB data, 5.3 GiB used, 531 GiB / 536 GiB avail; 5.3 MiB/s rd, 19 MiB/s wr, 143 op/s 2024-09-21T12:21:13.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:13 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' 2024-09-21T12:21:13.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:13 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' 2024-09-21T12:21:13.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:13 smithi003 ceph-mon[28057]: Reconfiguring ceph-exporter.smithi192 (dependencies changed)... 2024-09-21T12:21:13.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:13 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi192", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]}]: dispatch 2024-09-21T12:21:13.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:13 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:21:13.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:13 smithi003 ceph-mon[28057]: Deploying daemon ceph-exporter.smithi192 on smithi192 2024-09-21T12:21:15.671 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:15 smithi192 ceph-mon[35641]: pgmap v24: 65 pgs: 65 active+clean; 1.1 GiB data, 3.7 GiB used, 533 GiB / 536 GiB avail; 5.3 MiB/s rd, 19 MiB/s wr, 194 op/s 2024-09-21T12:21:15.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:15 smithi003 ceph-mon[28057]: pgmap v24: 65 pgs: 65 active+clean; 1.1 GiB data, 3.7 GiB used, 533 GiB / 536 GiB avail; 5.3 MiB/s rd, 19 MiB/s wr, 194 op/s 2024-09-21T12:21:17.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:17 smithi003 ceph-mon[28057]: pgmap v25: 65 pgs: 65 active+clean; 1.1 GiB data, 3.7 GiB used, 533 GiB / 536 GiB avail; 28 KiB/s rd, 1.4 MiB/s wr, 112 op/s 2024-09-21T12:21:17.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:17 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' 2024-09-21T12:21:17.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:17 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' 2024-09-21T12:21:17.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:17 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T12:21:17.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:17 smithi003 ceph-mon[28057]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T12:21:17.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:17 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:21:17.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:17 smithi003 ceph-mon[28057]: Upgrade: Need to upgrade myself (mgr.smithi192.qsaprd) 2024-09-21T12:21:17.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:17 smithi003 ceph-mon[28057]: Upgrade: Need to upgrade myself (mgr.smithi192.qsaprd) 2024-09-21T12:21:17.871 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:17 smithi192 ceph-mon[35641]: pgmap v25: 65 pgs: 65 active+clean; 1.1 GiB data, 3.7 GiB used, 533 GiB / 536 GiB avail; 28 KiB/s rd, 1.4 MiB/s wr, 112 op/s 2024-09-21T12:21:17.871 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:17 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' 2024-09-21T12:21:17.871 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:17 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' 2024-09-21T12:21:17.871 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:17 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T12:21:17.871 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:17 smithi192 ceph-mon[35641]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T12:21:17.871 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:17 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:21:17.871 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:17 smithi192 ceph-mon[35641]: Upgrade: Need to upgrade myself (mgr.smithi192.qsaprd) 2024-09-21T12:21:17.871 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:17 smithi192 ceph-mon[35641]: Upgrade: Need to upgrade myself (mgr.smithi192.qsaprd) 2024-09-21T12:21:18.661 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-21T12:21:18.661 DEBUG:teuthology.orchestra.run.smithi003:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-21T12:21:19.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:19 smithi003 ceph-mon[28057]: pgmap v26: 65 pgs: 65 active+clean; 593 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 45 KiB/s rd, 2.2 MiB/s wr, 168 op/s 2024-09-21T12:21:19.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:19 smithi003 ceph-mon[28057]: Upgrade: Updating mgr.smithi003.wztftl 2024-09-21T12:21:19.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:19 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' 2024-09-21T12:21:19.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:19 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi003.wztftl", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T12:21:19.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:19 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T12:21:19.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:19 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:21:19.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:19 smithi003 ceph-mon[28057]: Deploying daemon mgr.smithi003.wztftl on smithi003 2024-09-21T12:21:19.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:19 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:21:19.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:19 smithi192 ceph-mon[35641]: pgmap v26: 65 pgs: 65 active+clean; 593 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 45 KiB/s rd, 2.2 MiB/s wr, 168 op/s 2024-09-21T12:21:19.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:19 smithi192 ceph-mon[35641]: Upgrade: Updating mgr.smithi003.wztftl 2024-09-21T12:21:19.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:19 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' 2024-09-21T12:21:19.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:19 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi003.wztftl", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T12:21:19.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:19 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T12:21:19.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:19 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:21:19.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:19 smithi192 ceph-mon[35641]: Deploying daemon mgr.smithi003.wztftl on smithi003 2024-09-21T12:21:19.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:19 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:21:21.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:21 smithi192 ceph-mon[35641]: pgmap v27: 65 pgs: 65 active+clean; 593 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 1.4 MiB/s wr, 107 op/s 2024-09-21T12:21:21.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:21 smithi003 ceph-mon[28057]: pgmap v27: 65 pgs: 65 active+clean; 593 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 1.4 MiB/s wr, 107 op/s 2024-09-21T12:21:22.822 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:22.817+0000 7f1b25668640 1 -- 172.21.15.3:0/166459399 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1b20100ae0 msgr2=0x7f1b20100f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:21:22.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:22.817+0000 7f1b25668640 1 --2- 172.21.15.3:0/166459399 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1b20100ae0 0x7f1b20100f60 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f1b08009880 tx=0x7f1b0802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:21:22.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:22.817+0000 7f1b25668640 1 -- 172.21.15.3:0/166459399 shutdown_connections 2024-09-21T12:21:22.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:22.817+0000 7f1b25668640 1 --2- 172.21.15.3:0/166459399 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1b20100ae0 0x7f1b20100f60 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:21:22.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:22.817+0000 7f1b25668640 1 --2- 172.21.15.3:0/166459399 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b20101e30 0x7f1b20102230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:21:22.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:22.817+0000 7f1b25668640 1 -- 172.21.15.3:0/166459399 >> 172.21.15.3:0/166459399 conn(0x7f1b200fb760 msgr2=0x7f1b200fdba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:21:22.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:22.818+0000 7f1b25668640 1 -- 172.21.15.3:0/166459399 shutdown_connections 2024-09-21T12:21:22.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:22.818+0000 7f1b25668640 1 -- 172.21.15.3:0/166459399 wait complete. 2024-09-21T12:21:22.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:22.818+0000 7f1b25668640 1 Processor -- start 2024-09-21T12:21:22.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:22.818+0000 7f1b25668640 1 -- start start 2024-09-21T12:21:22.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:22.818+0000 7f1b25668640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1b20100ae0 0x7f1b201974e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:21:22.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:22.819+0000 7f1b25668640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b20101e30 0x7f1b20197a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:21:22.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:22.819+0000 7f1b25668640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f1b20109670 con 0x7f1b20100ae0 2024-09-21T12:21:22.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:22.819+0000 7f1b25668640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f1b201094f0 con 0x7f1b20101e30 2024-09-21T12:21:22.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:22.819+0000 7f1b1effd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1b20100ae0 0x7f1b201974e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:21:22.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:22.819+0000 7f1b1effd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1b20100ae0 0x7f1b201974e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:43678/0 (socket says 172.21.15.3:43678) 2024-09-21T12:21:22.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:22.819+0000 7f1b1effd640 1 -- 172.21.15.3:0/2039930331 learned_addr learned my addr 172.21.15.3:0/2039930331 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:21:22.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:22.819+0000 7f1b17fff640 1 --2- 172.21.15.3:0/2039930331 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b20101e30 0x7f1b20197a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:21:22.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:22.819+0000 7f1b1effd640 1 -- 172.21.15.3:0/2039930331 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b20101e30 msgr2=0x7f1b20197a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:21:22.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:22.819+0000 7f1b1effd640 1 --2- 172.21.15.3:0/2039930331 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b20101e30 0x7f1b20197a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:21:22.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:22.819+0000 7f1b1effd640 1 -- 172.21.15.3:0/2039930331 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b201980a0 con 0x7f1b20100ae0 2024-09-21T12:21:22.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:22.819+0000 7f1b1effd640 1 --2- 172.21.15.3:0/2039930331 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1b20100ae0 0x7f1b201974e0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f1b1000e940 tx=0x7f1b1000ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:21:22.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:22.819+0000 7f1b1cff9640 1 -- 172.21.15.3:0/2039930331 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1b1000cac0 con 0x7f1b20100ae0 2024-09-21T12:21:22.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:22.819+0000 7f1b25668640 1 -- 172.21.15.3:0/2039930331 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b2019cae0 con 0x7f1b20100ae0 2024-09-21T12:21:22.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:22.819+0000 7f1b1cff9640 1 -- 172.21.15.3:0/2039930331 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1b1000cc60 con 0x7f1b20100ae0 2024-09-21T12:21:22.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:22.819+0000 7f1b1cff9640 1 -- 172.21.15.3:0/2039930331 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1b10003de0 con 0x7f1b20100ae0 2024-09-21T12:21:22.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:22.819+0000 7f1b25668640 1 -- 172.21.15.3:0/2039930331 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b2019d040 con 0x7f1b20100ae0 2024-09-21T12:21:22.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:22.821+0000 7f1b25668640 1 -- 172.21.15.3:0/2039930331 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b20109e50 con 0x7f1b20100ae0 2024-09-21T12:21:22.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:22.821+0000 7f1b1cff9640 1 -- 172.21.15.3:0/2039930331 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7f1b10003f80 con 0x7f1b20100ae0 2024-09-21T12:21:22.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:22.822+0000 7f1b1cff9640 1 --2- 172.21.15.3:0/2039930331 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7f1b0c074a20 0x7f1b0c076ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:21:22.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:22.822+0000 7f1b1cff9640 1 -- 172.21.15.3:0/2039930331 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5812+0+0 (secure 0 0 0) 0x7f1b10096a60 con 0x7f1b20100ae0 2024-09-21T12:21:22.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:22.822+0000 7f1b17fff640 1 --2- 172.21.15.3:0/2039930331 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7f1b0c074a20 0x7f1b0c076ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:21:22.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:22.822+0000 7f1b17fff640 1 --2- 172.21.15.3:0/2039930331 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7f1b0c074a20 0x7f1b0c076ee0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1b08000c00 tx=0x7f1b08005a20 comp rx=0 tx=0).ready entity=mgr.24409 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:21:22.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:22.826+0000 7f1b1cff9640 1 -- 172.21.15.3:0/2039930331 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f1b10061f90 con 0x7f1b20100ae0 2024-09-21T12:21:23.108 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.105+0000 7f1b25668640 1 -- 172.21.15.3:0/2039930331 --> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f1b20100150 con 0x7f1b0c074a20 2024-09-21T12:21:23.109 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.106+0000 7f1b1cff9640 1 -- 172.21.15.3:0/2039930331 <== mgr.24409 v2:172.21.15.192:6828/1528605296 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+341 (secure 0 0 0) 0x7f1b20100150 con 0x7f1b0c074a20 2024-09-21T12:21:23.111 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.109+0000 7f1b25668640 1 -- 172.21.15.3:0/2039930331 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7f1b0c074a20 msgr2=0x7f1b0c076ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:21:23.111 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.109+0000 7f1b25668640 1 --2- 172.21.15.3:0/2039930331 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7f1b0c074a20 0x7f1b0c076ee0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1b08000c00 tx=0x7f1b08005a20 comp rx=0 tx=0).stop 2024-09-21T12:21:23.112 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.109+0000 7f1b25668640 1 -- 172.21.15.3:0/2039930331 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1b20100ae0 msgr2=0x7f1b201974e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:21:23.112 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.109+0000 7f1b25668640 1 --2- 172.21.15.3:0/2039930331 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1b20100ae0 0x7f1b201974e0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f1b1000e940 tx=0x7f1b1000ee00 comp rx=0 tx=0).stop 2024-09-21T12:21:23.112 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.109+0000 7f1b25668640 1 -- 172.21.15.3:0/2039930331 shutdown_connections 2024-09-21T12:21:23.112 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.109+0000 7f1b25668640 1 --2- 172.21.15.3:0/2039930331 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7f1b0c074a20 0x7f1b0c076ee0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:21:23.112 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.109+0000 7f1b25668640 1 --2- 172.21.15.3:0/2039930331 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1b20101e30 0x7f1b20197a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:21:23.112 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.109+0000 7f1b25668640 1 --2- 172.21.15.3:0/2039930331 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1b20100ae0 0x7f1b201974e0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:21:23.112 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.109+0000 7f1b25668640 1 -- 172.21.15.3:0/2039930331 >> 172.21.15.3:0/2039930331 conn(0x7f1b200fb760 msgr2=0x7f1b200ffa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:21:23.112 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.109+0000 7f1b25668640 1 -- 172.21.15.3:0/2039930331 shutdown_connections 2024-09-21T12:21:23.112 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.109+0000 7f1b25668640 1 -- 172.21.15.3:0/2039930331 wait complete. 2024-09-21T12:21:23.120 INFO:teuthology.orchestra.run.smithi003.stdout:true 2024-09-21T12:21:23.205 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.202+0000 7f8b06a7d640 1 -- 172.21.15.3:0/3380726587 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8b00100860 msgr2=0x7f8b00100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:21:23.205 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.202+0000 7f8b06a7d640 1 --2- 172.21.15.3:0/3380726587 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8b00100860 0x7f8b00100c60 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f8af4009880 tx=0x7f8af402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:21:23.205 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.202+0000 7f8b06a7d640 1 -- 172.21.15.3:0/3380726587 shutdown_connections 2024-09-21T12:21:23.205 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.202+0000 7f8b06a7d640 1 --2- 172.21.15.3:0/3380726587 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8b00101a60 0x7f8b00101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:21:23.205 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.202+0000 7f8b06a7d640 1 --2- 172.21.15.3:0/3380726587 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8b00100860 0x7f8b00100c60 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:21:23.205 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.202+0000 7f8b06a7d640 1 -- 172.21.15.3:0/3380726587 >> 172.21.15.3:0/3380726587 conn(0x7f8b000fc010 msgr2=0x7f8b000fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:21:23.205 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.202+0000 7f8b06a7d640 1 -- 172.21.15.3:0/3380726587 shutdown_connections 2024-09-21T12:21:23.205 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.202+0000 7f8b06a7d640 1 -- 172.21.15.3:0/3380726587 wait complete. 2024-09-21T12:21:23.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.203+0000 7f8b06a7d640 1 Processor -- start 2024-09-21T12:21:23.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.203+0000 7f8b06a7d640 1 -- start start 2024-09-21T12:21:23.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.203+0000 7f8b06a7d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8b00100860 0x7f8b00197520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:21:23.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.203+0000 7f8b06a7d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8b00101a60 0x7f8b00197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:21:23.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.203+0000 7f8b06a7d640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f8b001096a0 con 0x7f8b00100860 2024-09-21T12:21:23.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.203+0000 7f8b06a7d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8b00109520 con 0x7f8b00101a60 2024-09-21T12:21:23.207 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.203+0000 7f8b04819640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8b00100860 0x7f8b00197520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:21:23.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.203+0000 7f8b04819640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8b00100860 0x7f8b00197520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:43692/0 (socket says 172.21.15.3:43692) 2024-09-21T12:21:23.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.203+0000 7f8b04819640 1 -- 172.21.15.3:0/2440243838 learned_addr learned my addr 172.21.15.3:0/2440243838 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:21:23.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.203+0000 7f8afffff640 1 --2- 172.21.15.3:0/2440243838 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8b00101a60 0x7f8b00197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:21:23.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.204+0000 7f8afffff640 1 -- 172.21.15.3:0/2440243838 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8b00100860 msgr2=0x7f8b00197520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:21:23.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.204+0000 7f8afffff640 1 --2- 172.21.15.3:0/2440243838 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8b00100860 0x7f8b00197520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:21:23.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.204+0000 7f8afffff640 1 -- 172.21.15.3:0/2440243838 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b001980e0 con 0x7f8b00101a60 2024-09-21T12:21:23.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.204+0000 7f8b04819640 1 --2- 172.21.15.3:0/2440243838 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8b00100860 0x7f8b00197520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T12:21:23.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.204+0000 7f8afffff640 1 --2- 172.21.15.3:0/2440243838 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8b00101a60 0x7f8b00197a60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8aec00e970 tx=0x7f8aec00ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:21:23.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.204+0000 7f8afdffb640 1 -- 172.21.15.3:0/2440243838 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8aec00cac0 con 0x7f8b00101a60 2024-09-21T12:21:23.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.204+0000 7f8afdffb640 1 -- 172.21.15.3:0/2440243838 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8aec00cc60 con 0x7f8b00101a60 2024-09-21T12:21:23.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.204+0000 7f8afdffb640 1 -- 172.21.15.3:0/2440243838 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8aec0047a0 con 0x7f8b00101a60 2024-09-21T12:21:23.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.204+0000 7f8b06a7d640 1 -- 172.21.15.3:0/2440243838 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b0019cb20 con 0x7f8b00101a60 2024-09-21T12:21:23.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.205+0000 7f8b06a7d640 1 -- 172.21.15.3:0/2440243838 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b0019d0b0 con 0x7f8b00101a60 2024-09-21T12:21:23.209 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.206+0000 7f8b06a7d640 1 -- 172.21.15.3:0/2440243838 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b00100c60 con 0x7f8b00101a60 2024-09-21T12:21:23.209 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.206+0000 7f8afdffb640 1 -- 172.21.15.3:0/2440243838 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7f8aec0049a0 con 0x7f8b00101a60 2024-09-21T12:21:23.209 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.206+0000 7f8afdffb640 1 --2- 172.21.15.3:0/2440243838 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7f8af0074a80 0x7f8af0076f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:21:23.209 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.206+0000 7f8afdffb640 1 -- 172.21.15.3:0/2440243838 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5812+0+0 (secure 0 0 0) 0x7f8aec096730 con 0x7f8b00101a60 2024-09-21T12:21:23.209 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.207+0000 7f8b04819640 1 --2- 172.21.15.3:0/2440243838 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7f8af0074a80 0x7f8af0076f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:21:23.210 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.207+0000 7f8b04819640 1 --2- 172.21.15.3:0/2440243838 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7f8af0074a80 0x7f8af0076f40 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8af40096c0 tx=0x7f8af40058d0 comp rx=0 tx=0).ready entity=mgr.24409 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:21:23.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.211+0000 7f8afdffb640 1 -- 172.21.15.3:0/2440243838 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f8aec00ce10 con 0x7f8b00101a60 2024-09-21T12:21:23.465 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.462+0000 7f8b06a7d640 1 -- 172.21.15.3:0/2440243838 --> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f8b0006a400 con 0x7f8af0074a80 2024-09-21T12:21:23.466 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:23 smithi003 ceph-mon[28057]: pgmap v28: 65 pgs: 65 active+clean; 593 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 1.4 MiB/s wr, 107 op/s 2024-09-21T12:21:23.466 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.464+0000 7f8afdffb640 1 -- 172.21.15.3:0/2440243838 <== mgr.24409 v2:172.21.15.192:6828/1528605296 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+341 (secure 0 0 0) 0x7f8b0006a400 con 0x7f8af0074a80 2024-09-21T12:21:23.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.466+0000 7f8b06a7d640 1 -- 172.21.15.3:0/2440243838 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7f8af0074a80 msgr2=0x7f8af0076f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:21:23.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.466+0000 7f8b06a7d640 1 --2- 172.21.15.3:0/2440243838 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7f8af0074a80 0x7f8af0076f40 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f8af40096c0 tx=0x7f8af40058d0 comp rx=0 tx=0).stop 2024-09-21T12:21:23.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.466+0000 7f8b06a7d640 1 -- 172.21.15.3:0/2440243838 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8b00101a60 msgr2=0x7f8b00197a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:21:23.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.466+0000 7f8b06a7d640 1 --2- 172.21.15.3:0/2440243838 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8b00101a60 0x7f8b00197a60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8aec00e970 tx=0x7f8aec00ee30 comp rx=0 tx=0).stop 2024-09-21T12:21:23.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.466+0000 7f8b06a7d640 1 -- 172.21.15.3:0/2440243838 shutdown_connections 2024-09-21T12:21:23.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.466+0000 7f8b06a7d640 1 --2- 172.21.15.3:0/2440243838 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7f8af0074a80 0x7f8af0076f40 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:21:23.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.466+0000 7f8b06a7d640 1 --2- 172.21.15.3:0/2440243838 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8b00101a60 0x7f8b00197a60 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:21:23.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.466+0000 7f8b06a7d640 1 --2- 172.21.15.3:0/2440243838 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8b00100860 0x7f8b00197520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:21:23.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.466+0000 7f8b06a7d640 1 -- 172.21.15.3:0/2440243838 >> 172.21.15.3:0/2440243838 conn(0x7f8b000fc010 msgr2=0x7f8b00069cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:21:23.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.466+0000 7f8b06a7d640 1 -- 172.21.15.3:0/2440243838 shutdown_connections 2024-09-21T12:21:23.469 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.466+0000 7f8b06a7d640 1 -- 172.21.15.3:0/2440243838 wait complete. 2024-09-21T12:21:23.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:23 smithi192 ceph-mon[35641]: pgmap v28: 65 pgs: 65 active+clean; 593 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 1.4 MiB/s wr, 107 op/s 2024-09-21T12:21:23.600 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.598+0000 7f19d67fc640 1 -- 172.21.15.3:0/173137674 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f19cc031700 con 0x7f19d80739b0 2024-09-21T12:21:23.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.598+0000 7f19dc9e8640 1 -- 172.21.15.3:0/173137674 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19d80739b0 msgr2=0x7f19d810d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:21:23.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.598+0000 7f19dc9e8640 1 --2- 172.21.15.3:0/173137674 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19d80739b0 0x7f19d810d330 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f19cc009880 tx=0x7f19cc02a4d0 comp rx=0 tx=0).stop 2024-09-21T12:21:23.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.599+0000 7f19dc9e8640 1 -- 172.21.15.3:0/173137674 shutdown_connections 2024-09-21T12:21:23.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.599+0000 7f19dc9e8640 1 --2- 172.21.15.3:0/173137674 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19d80739b0 0x7f19d810d330 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:21:23.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.599+0000 7f19dc9e8640 1 --2- 172.21.15.3:0/173137674 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19d8072fe0 0x7f19d80733e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:21:23.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.599+0000 7f19dc9e8640 1 -- 172.21.15.3:0/173137674 >> 172.21.15.3:0/173137674 conn(0x7f19d806e8b0 msgr2=0x7f19d8070cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:21:23.603 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.600+0000 7f19dc9e8640 1 -- 172.21.15.3:0/173137674 shutdown_connections 2024-09-21T12:21:23.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.604+0000 7f19dc9e8640 1 -- 172.21.15.3:0/173137674 wait complete. 2024-09-21T12:21:23.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.604+0000 7f19dc9e8640 1 Processor -- start 2024-09-21T12:21:23.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.605+0000 7f19dc9e8640 1 -- start start 2024-09-21T12:21:23.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.606+0000 7f19dc9e8640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19d8072fe0 0x7f19d81b1030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:21:23.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.606+0000 7f19dc9e8640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19d80739b0 0x7f19d81b3580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:21:23.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.606+0000 7f19dc9e8640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f19d8110b90 con 0x7f19d80739b0 2024-09-21T12:21:23.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.606+0000 7f19dc9e8640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f19d8110a10 con 0x7f19d8072fe0 2024-09-21T12:21:23.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.606+0000 7f19d6ffd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19d80739b0 0x7f19d81b3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:21:23.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.606+0000 7f19d6ffd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19d80739b0 0x7f19d81b3580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:43714/0 (socket says 172.21.15.3:43714) 2024-09-21T12:21:23.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.606+0000 7f19d6ffd640 1 -- 172.21.15.3:0/3034902702 learned_addr learned my addr 172.21.15.3:0/3034902702 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:21:23.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.606+0000 7f19d77fe640 1 --2- 172.21.15.3:0/3034902702 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19d8072fe0 0x7f19d81b1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:21:23.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.607+0000 7f19d6ffd640 1 -- 172.21.15.3:0/3034902702 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19d8072fe0 msgr2=0x7f19d81b1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:21:23.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.607+0000 7f19d6ffd640 1 --2- 172.21.15.3:0/3034902702 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19d8072fe0 0x7f19d81b1030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:21:23.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.608+0000 7f19d6ffd640 1 -- 172.21.15.3:0/3034902702 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19d81b3c00 con 0x7f19d80739b0 2024-09-21T12:21:23.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.608+0000 7f19d6ffd640 1 --2- 172.21.15.3:0/3034902702 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19d80739b0 0x7f19d81b3580 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f19cc0099a0 tx=0x7f19cc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:21:23.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.609+0000 7f19d4ff9640 1 -- 172.21.15.3:0/3034902702 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f19cc03f070 con 0x7f19d80739b0 2024-09-21T12:21:23.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.609+0000 7f19d4ff9640 1 -- 172.21.15.3:0/3034902702 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f19cc003ab0 con 0x7f19d80739b0 2024-09-21T12:21:23.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.609+0000 7f19d4ff9640 1 -- 172.21.15.3:0/3034902702 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f19cc035030 con 0x7f19d80739b0 2024-09-21T12:21:23.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.610+0000 7f19dc9e8640 1 -- 172.21.15.3:0/3034902702 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19d81b3e90 con 0x7f19d80739b0 2024-09-21T12:21:23.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.610+0000 7f19dc9e8640 1 -- 172.21.15.3:0/3034902702 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19d81b4390 con 0x7f19d80739b0 2024-09-21T12:21:23.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.611+0000 7f19dc9e8640 1 -- 172.21.15.3:0/3034902702 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19d8112a80 con 0x7f19d80739b0 2024-09-21T12:21:23.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.614+0000 7f19d4ff9640 1 -- 172.21.15.3:0/3034902702 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7f19cc042070 con 0x7f19d80739b0 2024-09-21T12:21:23.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.614+0000 7f19d4ff9640 1 --2- 172.21.15.3:0/3034902702 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7f19c0074b80 0x7f19c0077040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:21:23.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.615+0000 7f19d4ff9640 1 -- 172.21.15.3:0/3034902702 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5812+0+0 (secure 0 0 0) 0x7f19cc0b7290 con 0x7f19d80739b0 2024-09-21T12:21:23.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.615+0000 7f19d77fe640 1 --2- 172.21.15.3:0/3034902702 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7f19c0074b80 0x7f19c0077040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:21:23.621 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.619+0000 7f19d77fe640 1 --2- 172.21.15.3:0/3034902702 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7f19c0074b80 0x7f19c0077040 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f19d8119060 tx=0x7f19c800a2d0 comp rx=0 tx=0).ready entity=mgr.24409 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:21:23.629 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.626+0000 7f19d4ff9640 1 -- 172.21.15.3:0/3034902702 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f19cc003c60 con 0x7f19d80739b0 2024-09-21T12:21:23.939 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.936+0000 7f19dc9e8640 1 -- 172.21.15.3:0/3034902702 --> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f19d8062630 con 0x7f19c0074b80 2024-09-21T12:21:23.949 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.946+0000 7f19d4ff9640 1 -- 172.21.15.3:0/3034902702 <== mgr.24409 v2:172.21.15.192:6828/1528605296 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f19d8062630 con 0x7f19c0074b80 2024-09-21T12:21:23.949 INFO:teuthology.orchestra.run.smithi003.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:21:23.949 INFO:teuthology.orchestra.run.smithi003.stdout:alertmanager.smithi003 smithi003 *:9093,9094 running (7m) 22s ago 9m 25.8M - 0.25.0 c8568f914cd2 5c03f233277e 2024-09-21T12:21:23.949 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-exporter.smithi003 smithi003 starting - - - - 2024-09-21T12:21:23.949 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-exporter.smithi192 smithi192 starting - - - - 2024-09-21T12:21:23.949 INFO:teuthology.orchestra.run.smithi003.stdout:crash.smithi003 smithi003 running (9m) 22s ago 9m 6899k - 19.1.1-373-g4e45e6b4 164465d2334a c63f209dc1dc 2024-09-21T12:21:23.949 INFO:teuthology.orchestra.run.smithi003.stdout:crash.smithi192 smithi192 running (8m) 43s ago 8m 6895k - 19.1.1-373-g4e45e6b4 164465d2334a cc70c9a7b2f7 2024-09-21T12:21:23.949 INFO:teuthology.orchestra.run.smithi003.stdout:grafana.smithi003 smithi003 *:3000 running (7m) 22s ago 8m 78.4M - 9.4.12 2bacad6d85d8 f504f60818f0 2024-09-21T12:21:23.950 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi003.ebjgyl smithi003 running (3m) 22s ago 3m 13.6M - 19.1.1-373-g4e45e6b4 164465d2334a 16e0b2cac16a 2024-09-21T12:21:23.950 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi003.gfkngj smithi003 running (3m) 22s ago 3m 227M - 19.1.1-373-g4e45e6b4 164465d2334a 109c04f87fbd 2024-09-21T12:21:23.950 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi192.ktdqns smithi192 running (3m) 43s ago 3m 14.5M - 19.1.1-373-g4e45e6b4 164465d2334a 495c73fb3bb0 2024-09-21T12:21:23.950 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi192.ywqqxe smithi192 running (3m) 43s ago 3m 14.5M - 19.1.1-373-g4e45e6b4 164465d2334a 270a01030cbe 2024-09-21T12:21:23.950 INFO:teuthology.orchestra.run.smithi003.stdout:mgr.smithi003.wztftl smithi003 *:9283,8765,8443 running (10m) 22s ago 10m 247M - 19.1.1-373-g4e45e6b4 164465d2334a 060c1f18749f 2024-09-21T12:21:23.950 INFO:teuthology.orchestra.run.smithi003.stdout:mgr.smithi192.qsaprd smithi192 *:8443,9283,8765 running (84s) 43s ago 8m 496M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 bb9d2aeba009 2024-09-21T12:21:23.950 INFO:teuthology.orchestra.run.smithi003.stdout:mon.smithi003 smithi003 running (10m) 22s ago 10m 54.7M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 16bccf2c7503 2024-09-21T12:21:23.950 INFO:teuthology.orchestra.run.smithi003.stdout:mon.smithi192 smithi192 running (8m) 43s ago 8m 39.5M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 4fe4c4b3dc5d 2024-09-21T12:21:23.950 INFO:teuthology.orchestra.run.smithi003.stdout:node-exporter.smithi003 smithi003 *:9100 running (9m) 22s ago 9m 16.2M - 1.5.0 0da6a335fe13 a1eb875faefc 2024-09-21T12:21:23.950 INFO:teuthology.orchestra.run.smithi003.stdout:node-exporter.smithi192 smithi192 *:9100 running (8m) 43s ago 8m 16.7M - 1.5.0 0da6a335fe13 10c2542c2e19 2024-09-21T12:21:23.950 INFO:teuthology.orchestra.run.smithi003.stdout:osd.0 smithi003 running (7m) 22s ago 7m 202M 1217M 19.1.1-373-g4e45e6b4 164465d2334a d07f1489720d 2024-09-21T12:21:23.950 INFO:teuthology.orchestra.run.smithi003.stdout:osd.1 smithi003 running (6m) 22s ago 6m 194M 1217M 19.1.1-373-g4e45e6b4 164465d2334a 6abd75a07645 2024-09-21T12:21:23.950 INFO:teuthology.orchestra.run.smithi003.stdout:osd.2 smithi003 running (6m) 22s ago 6m 151M 1217M 19.1.1-373-g4e45e6b4 164465d2334a 3265369e573b 2024-09-21T12:21:23.950 INFO:teuthology.orchestra.run.smithi003.stdout:osd.3 smithi192 running (5m) 43s ago 5m 222M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 13efcfd71c05 2024-09-21T12:21:23.951 INFO:teuthology.orchestra.run.smithi003.stdout:osd.4 smithi192 running (5m) 43s ago 5m 199M 2240M 19.1.1-373-g4e45e6b4 164465d2334a f33bf453cb3e 2024-09-21T12:21:23.951 INFO:teuthology.orchestra.run.smithi003.stdout:osd.5 smithi192 running (4m) 43s ago 4m 227M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 12d7b7c8e985 2024-09-21T12:21:23.951 INFO:teuthology.orchestra.run.smithi003.stdout:prometheus.smithi003 smithi003 *:9095 starting - - - - 2024-09-21T12:21:23.953 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.950+0000 7f19dc9e8640 1 -- 172.21.15.3:0/3034902702 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7f19c0074b80 msgr2=0x7f19c0077040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:21:23.953 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.950+0000 7f19dc9e8640 1 --2- 172.21.15.3:0/3034902702 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7f19c0074b80 0x7f19c0077040 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f19d8119060 tx=0x7f19c800a2d0 comp rx=0 tx=0).stop 2024-09-21T12:21:23.953 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.950+0000 7f19dc9e8640 1 -- 172.21.15.3:0/3034902702 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19d80739b0 msgr2=0x7f19d81b3580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:21:23.953 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.950+0000 7f19dc9e8640 1 --2- 172.21.15.3:0/3034902702 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19d80739b0 0x7f19d81b3580 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f19cc0099a0 tx=0x7f19cc0048f0 comp rx=0 tx=0).stop 2024-09-21T12:21:23.953 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.950+0000 7f19dc9e8640 1 -- 172.21.15.3:0/3034902702 shutdown_connections 2024-09-21T12:21:23.953 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.950+0000 7f19dc9e8640 1 --2- 172.21.15.3:0/3034902702 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7f19c0074b80 0x7f19c0077040 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:21:23.953 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.950+0000 7f19dc9e8640 1 --2- 172.21.15.3:0/3034902702 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f19d80739b0 0x7f19d81b3580 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:21:23.953 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.950+0000 7f19dc9e8640 1 --2- 172.21.15.3:0/3034902702 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f19d8072fe0 0x7f19d81b1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:21:23.953 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.950+0000 7f19dc9e8640 1 -- 172.21.15.3:0/3034902702 >> 172.21.15.3:0/3034902702 conn(0x7f19d806e8b0 msgr2=0x7f19d810c120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:21:23.953 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.950+0000 7f19dc9e8640 1 -- 172.21.15.3:0/3034902702 shutdown_connections 2024-09-21T12:21:23.953 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:23.950+0000 7f19dc9e8640 1 -- 172.21.15.3:0/3034902702 wait complete. 2024-09-21T12:21:24.064 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.062+0000 7f508d648640 1 -- 172.21.15.3:0/2586585144 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5088074b40 msgr2=0x7f5088074fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:21:24.065 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.062+0000 7f508d648640 1 --2- 172.21.15.3:0/2586585144 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5088074b40 0x7f5088074fa0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f507c009880 tx=0x7f507c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:21:24.065 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.062+0000 7f508d648640 1 -- 172.21.15.3:0/2586585144 shutdown_connections 2024-09-21T12:21:24.065 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.062+0000 7f508d648640 1 --2- 172.21.15.3:0/2586585144 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5088074b40 0x7f5088074fa0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:21:24.065 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.062+0000 7f508d648640 1 --2- 172.21.15.3:0/2586585144 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f50880761a0 0x7f5088074600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:21:24.065 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.062+0000 7f508d648640 1 -- 172.21.15.3:0/2586585144 >> 172.21.15.3:0/2586585144 conn(0x7f50880fd140 msgr2=0x7f50880ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:21:24.065 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.062+0000 7f508d648640 1 -- 172.21.15.3:0/2586585144 shutdown_connections 2024-09-21T12:21:24.065 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.062+0000 7f508d648640 1 -- 172.21.15.3:0/2586585144 wait complete. 2024-09-21T12:21:24.066 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.063+0000 7f508d648640 1 Processor -- start 2024-09-21T12:21:24.067 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.063+0000 7f508d648640 1 -- start start 2024-09-21T12:21:24.067 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.063+0000 7f508d648640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5088074b40 0x7f50881996b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:21:24.067 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.063+0000 7f508d648640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f50880761a0 0x7f5088199bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:21:24.067 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.063+0000 7f508d648640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f508810c980 con 0x7f50880761a0 2024-09-21T12:21:24.067 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.063+0000 7f508d648640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f508810c800 con 0x7f5088074b40 2024-09-21T12:21:24.067 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.063+0000 7f50867fc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f50880761a0 0x7f5088199bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:21:24.067 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.063+0000 7f50867fc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f50880761a0 0x7f5088199bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:43720/0 (socket says 172.21.15.3:43720) 2024-09-21T12:21:24.067 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.063+0000 7f50867fc640 1 -- 172.21.15.3:0/1373956400 learned_addr learned my addr 172.21.15.3:0/1373956400 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:21:24.067 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.063+0000 7f5086ffd640 1 --2- 172.21.15.3:0/1373956400 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5088074b40 0x7f50881996b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:21:24.067 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.064+0000 7f50867fc640 1 -- 172.21.15.3:0/1373956400 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5088074b40 msgr2=0x7f50881996b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:21:24.067 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.064+0000 7f50867fc640 1 --2- 172.21.15.3:0/1373956400 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5088074b40 0x7f50881996b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:21:24.067 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.064+0000 7f50867fc640 1 -- 172.21.15.3:0/1373956400 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f508819a270 con 0x7f50880761a0 2024-09-21T12:21:24.068 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.064+0000 7f50867fc640 1 --2- 172.21.15.3:0/1373956400 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f50880761a0 0x7f5088199bf0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f507c006010 tx=0x7f507c004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:21:24.068 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.064+0000 7f506ffff640 1 -- 172.21.15.3:0/1373956400 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f507c03f070 con 0x7f50880761a0 2024-09-21T12:21:24.068 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.064+0000 7f508d648640 1 -- 172.21.15.3:0/1373956400 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f508819ec50 con 0x7f50880761a0 2024-09-21T12:21:24.068 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.064+0000 7f506ffff640 1 -- 172.21.15.3:0/1373956400 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f507c0049d0 con 0x7f50880761a0 2024-09-21T12:21:24.068 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.065+0000 7f506ffff640 1 -- 172.21.15.3:0/1373956400 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f507c035030 con 0x7f50880761a0 2024-09-21T12:21:24.068 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.065+0000 7f508d648640 1 -- 172.21.15.3:0/1373956400 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f508819f190 con 0x7f50880761a0 2024-09-21T12:21:24.069 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.066+0000 7f508d648640 1 -- 172.21.15.3:0/1373956400 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5088074fa0 con 0x7f50880761a0 2024-09-21T12:21:24.069 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.066+0000 7f506ffff640 1 -- 172.21.15.3:0/1373956400 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7f507c042070 con 0x7f50880761a0 2024-09-21T12:21:24.069 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.067+0000 7f506ffff640 1 --2- 172.21.15.3:0/1373956400 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7f5070074a30 0x7f5070076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:21:24.069 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.067+0000 7f506ffff640 1 -- 172.21.15.3:0/1373956400 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5812+0+0 (secure 0 0 0) 0x7f507c0b6f10 con 0x7f50880761a0 2024-09-21T12:21:24.069 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.067+0000 7f5086ffd640 1 --2- 172.21.15.3:0/1373956400 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7f5070074a30 0x7f5070076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:21:24.070 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.067+0000 7f5086ffd640 1 --2- 172.21.15.3:0/1373956400 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7f5070074a30 0x7f5070076ef0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5078009bd0 tx=0x7f5078005f90 comp rx=0 tx=0).ready entity=mgr.24409 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:21:24.079 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.076+0000 7f506ffff640 1 -- 172.21.15.3:0/1373956400 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f507c082440 con 0x7f50880761a0 2024-09-21T12:21:24.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.425+0000 7f508d648640 1 -- 172.21.15.3:0/1373956400 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f5088062df0 con 0x7f50880761a0 2024-09-21T12:21:24.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.426+0000 7f506ffff640 1 -- 172.21.15.3:0/1373956400 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+841 (secure 0 0 0) 0x7f507c0872f0 con 0x7f50880761a0 2024-09-21T12:21:24.429 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-21T12:21:24.429 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": { 2024-09-21T12:21:24.429 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2 2024-09-21T12:21:24.429 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:21:24.429 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": { 2024-09-21T12:21:24.429 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T12:21:24.429 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 1 2024-09-21T12:21:24.429 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:21:24.429 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": { 2024-09-21T12:21:24.429 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 6 2024-09-21T12:21:24.429 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:21:24.429 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": { 2024-09-21T12:21:24.430 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 4 2024-09-21T12:21:24.430 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:21:24.430 INFO:teuthology.orchestra.run.smithi003.stdout: "overall": { 2024-09-21T12:21:24.430 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 13, 2024-09-21T12:21:24.430 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 1 2024-09-21T12:21:24.430 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-21T12:21:24.430 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-21T12:21:24.431 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.428+0000 7f508d648640 1 -- 172.21.15.3:0/1373956400 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7f5070074a30 msgr2=0x7f5070076ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:21:24.431 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.428+0000 7f508d648640 1 --2- 172.21.15.3:0/1373956400 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7f5070074a30 0x7f5070076ef0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f5078009bd0 tx=0x7f5078005f90 comp rx=0 tx=0).stop 2024-09-21T12:21:24.431 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.428+0000 7f508d648640 1 -- 172.21.15.3:0/1373956400 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f50880761a0 msgr2=0x7f5088199bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:21:24.431 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.428+0000 7f508d648640 1 --2- 172.21.15.3:0/1373956400 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f50880761a0 0x7f5088199bf0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f507c006010 tx=0x7f507c004570 comp rx=0 tx=0).stop 2024-09-21T12:21:24.431 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.428+0000 7f508d648640 1 -- 172.21.15.3:0/1373956400 shutdown_connections 2024-09-21T12:21:24.431 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.428+0000 7f508d648640 1 --2- 172.21.15.3:0/1373956400 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7f5070074a30 0x7f5070076ef0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:21:24.431 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.428+0000 7f508d648640 1 --2- 172.21.15.3:0/1373956400 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f50880761a0 0x7f5088199bf0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:21:24.431 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.428+0000 7f508d648640 1 --2- 172.21.15.3:0/1373956400 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5088074b40 0x7f50881996b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:21:24.431 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.428+0000 7f508d648640 1 -- 172.21.15.3:0/1373956400 >> 172.21.15.3:0/1373956400 conn(0x7f50880fd140 msgr2=0x7f5088107ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:21:24.431 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.428+0000 7f508d648640 1 -- 172.21.15.3:0/1373956400 shutdown_connections 2024-09-21T12:21:24.431 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.428+0000 7f508d648640 1 -- 172.21.15.3:0/1373956400 wait complete. 2024-09-21T12:21:24.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:24 smithi192 ceph-mon[35641]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:21:24.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:24 smithi192 ceph-mon[35641]: from='client.24475 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:21:24.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.524+0000 7f7178792640 1 -- 172.21.15.3:0/2280547651 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7170104dc0 msgr2=0x7f71701071b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:21:24.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.524+0000 7f7178792640 1 --2- 172.21.15.3:0/2280547651 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7170104dc0 0x7f71701071b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f7160009880 tx=0x7f716002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:21:24.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.524+0000 7f7178792640 1 -- 172.21.15.3:0/2280547651 shutdown_connections 2024-09-21T12:21:24.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.524+0000 7f7178792640 1 --2- 172.21.15.3:0/2280547651 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7170104dc0 0x7f71701071b0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:21:24.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.524+0000 7f7178792640 1 --2- 172.21.15.3:0/2280547651 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7170102490 0x7f7170104880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:21:24.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.524+0000 7f7178792640 1 -- 172.21.15.3:0/2280547651 >> 172.21.15.3:0/2280547651 conn(0x7f71700fc010 msgr2=0x7f71700fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:21:24.527 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:24 smithi003 ceph-mon[28057]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:21:24.527 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:24 smithi003 ceph-mon[28057]: from='client.24475 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:21:24.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.524+0000 7f7178792640 1 -- 172.21.15.3:0/2280547651 shutdown_connections 2024-09-21T12:21:24.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.524+0000 7f7178792640 1 -- 172.21.15.3:0/2280547651 wait complete. 2024-09-21T12:21:24.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.525+0000 7f7178792640 1 Processor -- start 2024-09-21T12:21:24.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.525+0000 7f7178792640 1 -- start start 2024-09-21T12:21:24.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.525+0000 7f7178792640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7170102490 0x7f7170101d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:21:24.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.525+0000 7f7178792640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7170104dc0 0x7f7170100440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:21:24.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.525+0000 7f7178792640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f717010a7a0 con 0x7f7170104dc0 2024-09-21T12:21:24.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.525+0000 7f7178792640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f717010a620 con 0x7f7170102490 2024-09-21T12:21:24.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.525+0000 7f7175d2d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7170104dc0 0x7f7170100440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:21:24.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.525+0000 7f7175d2d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7170104dc0 0x7f7170100440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:43746/0 (socket says 172.21.15.3:43746) 2024-09-21T12:21:24.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.525+0000 7f7175d2d640 1 -- 172.21.15.3:0/3183971077 learned_addr learned my addr 172.21.15.3:0/3183971077 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:21:24.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.526+0000 7f717652e640 1 --2- 172.21.15.3:0/3183971077 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7170102490 0x7f7170101d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:21:24.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.526+0000 7f7175d2d640 1 -- 172.21.15.3:0/3183971077 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7170102490 msgr2=0x7f7170101d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:21:24.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.526+0000 7f7175d2d640 1 --2- 172.21.15.3:0/3183971077 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7170102490 0x7f7170101d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:21:24.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.526+0000 7f7175d2d640 1 -- 172.21.15.3:0/3183971077 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7170100980 con 0x7f7170104dc0 2024-09-21T12:21:24.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.526+0000 7f717652e640 1 --2- 172.21.15.3:0/3183971077 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7170102490 0x7f7170101d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:21:24.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.526+0000 7f7175d2d640 1 --2- 172.21.15.3:0/3183971077 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7170104dc0 0x7f7170100440 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f7160006010 tx=0x7f71600045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:21:24.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.526+0000 7f71677fe640 1 -- 172.21.15.3:0/3183971077 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f716003f070 con 0x7f7170104dc0 2024-09-21T12:21:24.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.526+0000 7f7178792640 1 -- 172.21.15.3:0/3183971077 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7170100c10 con 0x7f7170104dc0 2024-09-21T12:21:24.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.526+0000 7f71677fe640 1 -- 172.21.15.3:0/3183971077 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f71600049d0 con 0x7f7170104dc0 2024-09-21T12:21:24.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.526+0000 7f71677fe640 1 -- 172.21.15.3:0/3183971077 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7160035030 con 0x7f7170104dc0 2024-09-21T12:21:24.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.526+0000 7f7178792640 1 -- 172.21.15.3:0/3183971077 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7170101140 con 0x7f7170104dc0 2024-09-21T12:21:24.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.527+0000 7f7178792640 1 -- 172.21.15.3:0/3183971077 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7170102870 con 0x7f7170104dc0 2024-09-21T12:21:24.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.528+0000 7f71677fe640 1 -- 172.21.15.3:0/3183971077 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 25) ==== 98036+0+0 (secure 0 0 0) 0x7f7160042070 con 0x7f7170104dc0 2024-09-21T12:21:24.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.529+0000 7f71677fe640 1 --2- 172.21.15.3:0/3183971077 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7f715c074a30 0x7f715c076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:21:24.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.529+0000 7f71677fe640 1 -- 172.21.15.3:0/3183971077 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5812+0+0 (secure 0 0 0) 0x7f71600b6eb0 con 0x7f7170104dc0 2024-09-21T12:21:24.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.529+0000 7f717652e640 1 --2- 172.21.15.3:0/3183971077 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7f715c074a30 0x7f715c076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:21:24.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.529+0000 7f717652e640 1 --2- 172.21.15.3:0/3183971077 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7f715c074a30 0x7f715c076ef0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f716c009c20 tx=0x7f716c005f90 comp rx=0 tx=0).ready entity=mgr.24409 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:21:24.536 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.534+0000 7f71677fe640 1 -- 172.21.15.3:0/3183971077 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f71600823e0 con 0x7f7170104dc0 2024-09-21T12:21:24.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.832+0000 7f7178792640 1 -- 172.21.15.3:0/3183971077 --> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f7170105800 con 0x7f715c074a30 2024-09-21T12:21:24.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.834+0000 7f71677fe640 1 -- 172.21.15.3:0/3183971077 <== mgr.24409 v2:172.21.15.192:6828/1528605296 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+341 (secure 0 0 0) 0x7f7170105800 con 0x7f715c074a30 2024-09-21T12:21:24.837 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-21T12:21:24.837 INFO:teuthology.orchestra.run.smithi003.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T12:21:24.837 INFO:teuthology.orchestra.run.smithi003.stdout: "in_progress": true, 2024-09-21T12:21:24.837 INFO:teuthology.orchestra.run.smithi003.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-21T12:21:24.837 INFO:teuthology.orchestra.run.smithi003.stdout: "services_complete": [], 2024-09-21T12:21:24.837 INFO:teuthology.orchestra.run.smithi003.stdout: "progress": "1/2 daemons upgraded", 2024-09-21T12:21:24.837 INFO:teuthology.orchestra.run.smithi003.stdout: "message": "Currently upgrading mgr daemons", 2024-09-21T12:21:24.837 INFO:teuthology.orchestra.run.smithi003.stdout: "is_paused": false 2024-09-21T12:21:24.837 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-21T12:21:24.839 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.836+0000 7f7178792640 1 -- 172.21.15.3:0/3183971077 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7f715c074a30 msgr2=0x7f715c076ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:21:24.839 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.836+0000 7f7178792640 1 --2- 172.21.15.3:0/3183971077 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7f715c074a30 0x7f715c076ef0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f716c009c20 tx=0x7f716c005f90 comp rx=0 tx=0).stop 2024-09-21T12:21:24.839 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.836+0000 7f7178792640 1 -- 172.21.15.3:0/3183971077 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7170104dc0 msgr2=0x7f7170100440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:21:24.839 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.836+0000 7f7178792640 1 --2- 172.21.15.3:0/3183971077 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7170104dc0 0x7f7170100440 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f7160006010 tx=0x7f71600045e0 comp rx=0 tx=0).stop 2024-09-21T12:21:24.839 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.836+0000 7f7178792640 1 -- 172.21.15.3:0/3183971077 shutdown_connections 2024-09-21T12:21:24.839 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.836+0000 7f7178792640 1 --2- 172.21.15.3:0/3183971077 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7f715c074a30 0x7f715c076ef0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:21:24.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.836+0000 7f7178792640 1 --2- 172.21.15.3:0/3183971077 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7170104dc0 0x7f7170100440 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:21:24.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.836+0000 7f7178792640 1 --2- 172.21.15.3:0/3183971077 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7170102490 0x7f7170101d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:21:24.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.836+0000 7f7178792640 1 -- 172.21.15.3:0/3183971077 >> 172.21.15.3:0/3183971077 conn(0x7f71700fc010 msgr2=0x7f71700fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:21:24.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.837+0000 7f7178792640 1 -- 172.21.15.3:0/3183971077 shutdown_connections 2024-09-21T12:21:24.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:24.837+0000 7f7178792640 1 -- 172.21.15.3:0/3183971077 wait complete. 2024-09-21T12:21:25.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:25 smithi192 ceph-mon[35641]: from='client.14744 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:21:25.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:25 smithi192 ceph-mon[35641]: pgmap v29: 65 pgs: 65 active+clean; 289 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 46 KiB/s rd, 2.2 MiB/s wr, 154 op/s 2024-09-21T12:21:25.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:25 smithi192 ceph-mon[35641]: from='client.? 172.21.15.3:0/1373956400' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:21:25.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:25 smithi192 ceph-mon[35641]: from='client.14752 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:21:25.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:25 smithi003 ceph-mon[28057]: from='client.14744 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:21:25.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:25 smithi003 ceph-mon[28057]: pgmap v29: 65 pgs: 65 active+clean; 289 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 46 KiB/s rd, 2.2 MiB/s wr, 154 op/s 2024-09-21T12:21:25.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:25 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/1373956400' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:21:25.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:25 smithi003 ceph-mon[28057]: from='client.14752 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:21:27.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:27 smithi192 ceph-mon[35641]: pgmap v30: 65 pgs: 65 active+clean; 289 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 32 KiB/s rd, 1.5 MiB/s wr, 103 op/s 2024-09-21T12:21:27.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:27 smithi003 ceph-mon[28057]: pgmap v30: 65 pgs: 65 active+clean; 289 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 32 KiB/s rd, 1.5 MiB/s wr, 103 op/s 2024-09-21T12:21:29.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:29 smithi192 ceph-mon[35641]: pgmap v31: 65 pgs: 65 active+clean; 289 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 48 KiB/s rd, 2.3 MiB/s wr, 147 op/s 2024-09-21T12:21:29.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:29 smithi003 ceph-mon[28057]: pgmap v31: 65 pgs: 65 active+clean; 289 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 48 KiB/s rd, 2.3 MiB/s wr, 147 op/s 2024-09-21T12:21:31.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:31 smithi192 ceph-mon[35641]: pgmap v32: 65 pgs: 65 active+clean; 289 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 32 KiB/s rd, 1.6 MiB/s wr, 91 op/s 2024-09-21T12:21:31.529 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:31 smithi003 ceph-mon[28057]: pgmap v32: 65 pgs: 65 active+clean; 289 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 32 KiB/s rd, 1.6 MiB/s wr, 91 op/s 2024-09-21T12:21:33.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:33 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' 2024-09-21T12:21:33.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:33 smithi192 ceph-mon[35641]: pgmap v33: 65 pgs: 65 active+clean; 289 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 32 KiB/s rd, 1.6 MiB/s wr, 91 op/s 2024-09-21T12:21:33.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:33 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' 2024-09-21T12:21:33.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:33 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:21:33.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:33 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' 2024-09-21T12:21:33.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:33 smithi003 ceph-mon[28057]: pgmap v33: 65 pgs: 65 active+clean; 289 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 32 KiB/s rd, 1.6 MiB/s wr, 91 op/s 2024-09-21T12:21:33.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:33 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' 2024-09-21T12:21:33.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:33 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:21:34.458 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:34 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:21:34.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:34 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:21:35.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:35 smithi192 ceph-mon[35641]: pgmap v34: 65 pgs: 65 active+clean; 294 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 47 KiB/s rd, 2.3 MiB/s wr, 123 op/s 2024-09-21T12:21:35.549 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:35 smithi003 ceph-mon[28057]: pgmap v34: 65 pgs: 65 active+clean; 294 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 47 KiB/s rd, 2.3 MiB/s wr, 123 op/s 2024-09-21T12:21:36.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:36 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' 2024-09-21T12:21:36.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:36 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' 2024-09-21T12:21:36.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:36 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' 2024-09-21T12:21:36.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:36 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' 2024-09-21T12:21:37.470 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:37 smithi003 ceph-mon[28057]: pgmap v35: 65 pgs: 65 active+clean; 294 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 32 KiB/s rd, 1.6 MiB/s wr, 76 op/s 2024-09-21T12:21:37.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:37 smithi192 ceph-mon[35641]: pgmap v35: 65 pgs: 65 active+clean; 294 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 32 KiB/s rd, 1.6 MiB/s wr, 76 op/s 2024-09-21T12:21:38.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:38 smithi192 ceph-mon[35641]: Standby manager daemon smithi003.wztftl restarted 2024-09-21T12:21:38.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:38 smithi192 ceph-mon[35641]: Standby manager daemon smithi003.wztftl started 2024-09-21T12:21:38.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:38 smithi192 ceph-mon[35641]: from='mgr.? 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi003.wztftl/crt"}]: dispatch 2024-09-21T12:21:38.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:38 smithi192 ceph-mon[35641]: from='mgr.? 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T12:21:38.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:38 smithi192 ceph-mon[35641]: from='mgr.? 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi003.wztftl/key"}]: dispatch 2024-09-21T12:21:38.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:38 smithi192 ceph-mon[35641]: from='mgr.? 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T12:21:38.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:38 smithi003 ceph-mon[28057]: Standby manager daemon smithi003.wztftl restarted 2024-09-21T12:21:38.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:38 smithi003 ceph-mon[28057]: Standby manager daemon smithi003.wztftl started 2024-09-21T12:21:38.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:38 smithi003 ceph-mon[28057]: from='mgr.? 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi003.wztftl/crt"}]: dispatch 2024-09-21T12:21:38.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:38 smithi003 ceph-mon[28057]: from='mgr.? 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T12:21:38.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:38 smithi003 ceph-mon[28057]: from='mgr.? 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi003.wztftl/key"}]: dispatch 2024-09-21T12:21:38.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:38 smithi003 ceph-mon[28057]: from='mgr.? 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T12:21:39.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:39 smithi192 ceph-mon[35641]: pgmap v36: 65 pgs: 65 active+clean; 301 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 45 KiB/s rd, 2.2 MiB/s wr, 110 op/s 2024-09-21T12:21:39.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:39 smithi192 ceph-mon[35641]: mgrmap e26: smithi192.qsaprd(active, since 66s), standbys: smithi003.wztftl 2024-09-21T12:21:39.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:39 smithi003 ceph-mon[28057]: pgmap v36: 65 pgs: 65 active+clean; 301 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 45 KiB/s rd, 2.2 MiB/s wr, 110 op/s 2024-09-21T12:21:39.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:39 smithi003 ceph-mon[28057]: mgrmap e26: smithi192.qsaprd(active, since 66s), standbys: smithi003.wztftl 2024-09-21T12:21:41.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:41 smithi003 ceph-mon[28057]: pgmap v37: 65 pgs: 65 active+clean; 301 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 28 KiB/s rd, 1.4 MiB/s wr, 65 op/s 2024-09-21T12:21:41.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:41 smithi192 ceph-mon[35641]: pgmap v37: 65 pgs: 65 active+clean; 301 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 28 KiB/s rd, 1.4 MiB/s wr, 65 op/s 2024-09-21T12:21:43.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:43 smithi003 ceph-mon[28057]: pgmap v38: 65 pgs: 65 active+clean; 301 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 28 KiB/s rd, 1.4 MiB/s wr, 65 op/s 2024-09-21T12:21:43.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:43 smithi192 ceph-mon[35641]: pgmap v38: 65 pgs: 65 active+clean; 301 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 28 KiB/s rd, 1.4 MiB/s wr, 65 op/s 2024-09-21T12:21:45.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:45 smithi192 ceph-mon[35641]: pgmap v39: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 42 KiB/s rd, 2.1 MiB/s wr, 110 op/s 2024-09-21T12:21:45.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:45 smithi003 ceph-mon[28057]: pgmap v39: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 42 KiB/s rd, 2.1 MiB/s wr, 110 op/s 2024-09-21T12:21:47.794 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:47 smithi003 ceph-mon[28057]: pgmap v40: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 27 KiB/s rd, 1.4 MiB/s wr, 79 op/s 2024-09-21T12:21:47.794 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:47 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' 2024-09-21T12:21:47.794 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:47 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' 2024-09-21T12:21:47.794 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:47 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' 2024-09-21T12:21:47.794 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:47 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' 2024-09-21T12:21:48.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:47 smithi192 ceph-mon[35641]: pgmap v40: 65 pgs: 65 active+clean; 307 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 27 KiB/s rd, 1.4 MiB/s wr, 79 op/s 2024-09-21T12:21:48.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:47 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' 2024-09-21T12:21:48.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:47 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' 2024-09-21T12:21:48.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:47 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' 2024-09-21T12:21:48.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:47 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' 2024-09-21T12:21:48.828 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:48 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:21:49.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:48 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:21:49.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:49 smithi003 ceph-mon[28057]: pgmap v41: 65 pgs: 65 active+clean; 305 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 44 KiB/s rd, 2.1 MiB/s wr, 139 op/s 2024-09-21T12:21:50.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:49 smithi192 ceph-mon[35641]: pgmap v41: 65 pgs: 65 active+clean; 305 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 44 KiB/s rd, 2.1 MiB/s wr, 139 op/s 2024-09-21T12:21:51.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:51 smithi192 ceph-mon[35641]: pgmap v42: 65 pgs: 65 active+clean; 305 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 31 KiB/s rd, 1.5 MiB/s wr, 105 op/s 2024-09-21T12:21:51.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:51 smithi003 ceph-mon[28057]: pgmap v42: 65 pgs: 65 active+clean; 305 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 31 KiB/s rd, 1.5 MiB/s wr, 105 op/s 2024-09-21T12:21:53.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:53 smithi003 ceph-mon[28057]: pgmap v43: 65 pgs: 65 active+clean; 305 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 31 KiB/s rd, 1.5 MiB/s wr, 105 op/s 2024-09-21T12:21:54.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:53 smithi192 ceph-mon[35641]: pgmap v43: 65 pgs: 65 active+clean; 305 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 31 KiB/s rd, 1.5 MiB/s wr, 105 op/s 2024-09-21T12:21:54.977 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:54.975+0000 7faa27419640 1 -- 172.21.15.3:0/177362681 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faa20100200 msgr2=0x7faa20102610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:21:54.977 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:54.975+0000 7faa27419640 1 --2- 172.21.15.3:0/177362681 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faa20100200 0x7faa20102610 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7faa1c009880 tx=0x7faa1c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:21:54.977 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:54.975+0000 7faa27419640 1 -- 172.21.15.3:0/177362681 shutdown_connections 2024-09-21T12:21:54.977 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:54.975+0000 7faa27419640 1 --2- 172.21.15.3:0/177362681 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa20102b50 0x7faa20104fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:21:54.977 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:54.975+0000 7faa27419640 1 --2- 172.21.15.3:0/177362681 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faa20100200 0x7faa20102610 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:21:54.978 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:54.975+0000 7faa27419640 1 -- 172.21.15.3:0/177362681 >> 172.21.15.3:0/177362681 conn(0x7faa200fc030 msgr2=0x7faa200fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:21:54.978 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:54.976+0000 7faa27419640 1 -- 172.21.15.3:0/177362681 shutdown_connections 2024-09-21T12:21:54.978 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:54.976+0000 7faa27419640 1 -- 172.21.15.3:0/177362681 wait complete. 2024-09-21T12:21:54.978 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:54.977+0000 7faa27419640 1 Processor -- start 2024-09-21T12:21:54.979 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:54.977+0000 7faa27419640 1 -- start start 2024-09-21T12:21:54.979 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:54.978+0000 7faa27419640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa20100200 0x7faa2019d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:21:54.979 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:54.978+0000 7faa27419640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faa20102b50 0x7faa2019de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:21:54.980 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:54.978+0000 7faa27419640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7faa20110d90 con 0x7faa20102b50 2024-09-21T12:21:54.980 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:54.978+0000 7faa27419640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7faa20110c10 con 0x7faa20100200 2024-09-21T12:21:54.981 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:54.978+0000 7faa249b4640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faa20102b50 0x7faa2019de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:21:54.981 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:54.978+0000 7faa249b4640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faa20102b50 0x7faa2019de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35996/0 (socket says 172.21.15.3:35996) 2024-09-21T12:21:54.981 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:54.978+0000 7faa249b4640 1 -- 172.21.15.3:0/2400123325 learned_addr learned my addr 172.21.15.3:0/2400123325 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:21:54.981 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:54.978+0000 7faa251b5640 1 --2- 172.21.15.3:0/2400123325 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa20100200 0x7faa2019d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:21:54.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:54.980+0000 7faa249b4640 1 -- 172.21.15.3:0/2400123325 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa20100200 msgr2=0x7faa2019d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:21:54.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:54.980+0000 7faa249b4640 1 --2- 172.21.15.3:0/2400123325 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa20100200 0x7faa2019d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:21:54.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:54.980+0000 7faa249b4640 1 -- 172.21.15.3:0/2400123325 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa2019e4a0 con 0x7faa20102b50 2024-09-21T12:21:54.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:54.980+0000 7faa249b4640 1 --2- 172.21.15.3:0/2400123325 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faa20102b50 0x7faa2019de20 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7faa1000e970 tx=0x7faa1000ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:21:54.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:54.981+0000 7faa167fc640 1 -- 172.21.15.3:0/2400123325 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faa1000cac0 con 0x7faa20102b50 2024-09-21T12:21:54.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:54.981+0000 7faa167fc640 1 -- 172.21.15.3:0/2400123325 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7faa1000cc60 con 0x7faa20102b50 2024-09-21T12:21:54.984 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:54.981+0000 7faa167fc640 1 -- 172.21.15.3:0/2400123325 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faa10018720 con 0x7faa20102b50 2024-09-21T12:21:54.984 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:54.981+0000 7faa27419640 1 -- 172.21.15.3:0/2400123325 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa201a2ee0 con 0x7faa20102b50 2024-09-21T12:21:54.984 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:54.981+0000 7faa27419640 1 -- 172.21.15.3:0/2400123325 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa201a33e0 con 0x7faa20102b50 2024-09-21T12:21:54.985 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:54.983+0000 7faa27419640 1 -- 172.21.15.3:0/2400123325 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa040052c0 con 0x7faa20102b50 2024-09-21T12:21:54.988 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:54.986+0000 7faa167fc640 1 -- 172.21.15.3:0/2400123325 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 26) ==== 103424+0+0 (secure 0 0 0) 0x7faa100188c0 con 0x7faa20102b50 2024-09-21T12:21:54.988 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:54.987+0000 7faa167fc640 1 --2- 172.21.15.3:0/2400123325 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7faa0c07b1d0 0x7faa0c07d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:21:54.988 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:54.987+0000 7faa167fc640 1 -- 172.21.15.3:0/2400123325 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5812+0+0 (secure 0 0 0) 0x7faa1009ea40 con 0x7faa20102b50 2024-09-21T12:21:54.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:54.988+0000 7faa251b5640 1 --2- 172.21.15.3:0/2400123325 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7faa0c07b1d0 0x7faa0c07d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:21:54.993 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:54.992+0000 7faa251b5640 1 --2- 172.21.15.3:0/2400123325 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7faa0c07b1d0 0x7faa0c07d690 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7faa1c0096c0 tx=0x7faa1c000bc0 comp rx=0 tx=0).ready entity=mgr.24409 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:21:54.996 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:54.994+0000 7faa167fc640 1 -- 172.21.15.3:0/2400123325 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7faa10069fd0 con 0x7faa20102b50 2024-09-21T12:21:55.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.331+0000 7faa27419640 1 -- 172.21.15.3:0/2400123325 --> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7faa04000bf0 con 0x7faa0c07b1d0 2024-09-21T12:21:55.334 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.333+0000 7faa167fc640 1 -- 172.21.15.3:0/2400123325 <== mgr.24409 v2:172.21.15.192:6828/1528605296 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+360 (secure 0 0 0) 0x7faa04000bf0 con 0x7faa0c07b1d0 2024-09-21T12:21:55.337 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.335+0000 7faa27419640 1 -- 172.21.15.3:0/2400123325 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7faa0c07b1d0 msgr2=0x7faa0c07d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:21:55.337 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.335+0000 7faa27419640 1 --2- 172.21.15.3:0/2400123325 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7faa0c07b1d0 0x7faa0c07d690 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7faa1c0096c0 tx=0x7faa1c000bc0 comp rx=0 tx=0).stop 2024-09-21T12:21:55.337 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.335+0000 7faa27419640 1 -- 172.21.15.3:0/2400123325 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faa20102b50 msgr2=0x7faa2019de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:21:55.337 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.335+0000 7faa27419640 1 --2- 172.21.15.3:0/2400123325 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faa20102b50 0x7faa2019de20 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7faa1000e970 tx=0x7faa1000ee30 comp rx=0 tx=0).stop 2024-09-21T12:21:55.337 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.335+0000 7faa27419640 1 -- 172.21.15.3:0/2400123325 shutdown_connections 2024-09-21T12:21:55.337 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.335+0000 7faa27419640 1 --2- 172.21.15.3:0/2400123325 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7faa0c07b1d0 0x7faa0c07d690 secure :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7faa1c0096c0 tx=0x7faa1c000bc0 comp rx=0 tx=0).stop 2024-09-21T12:21:55.337 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.335+0000 7faa27419640 1 --2- 172.21.15.3:0/2400123325 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faa20102b50 0x7faa2019de20 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:21:55.337 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.335+0000 7faa27419640 1 --2- 172.21.15.3:0/2400123325 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faa20100200 0x7faa2019d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:21:55.337 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.335+0000 7faa27419640 1 -- 172.21.15.3:0/2400123325 >> 172.21.15.3:0/2400123325 conn(0x7faa200fc030 msgr2=0x7faa200fe420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:21:55.337 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.335+0000 7faa27419640 1 -- 172.21.15.3:0/2400123325 shutdown_connections 2024-09-21T12:21:55.338 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.335+0000 7faa27419640 1 -- 172.21.15.3:0/2400123325 wait complete. 2024-09-21T12:21:55.345 INFO:teuthology.orchestra.run.smithi003.stdout:true 2024-09-21T12:21:55.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.447+0000 7f9371c46640 1 -- 172.21.15.3:0/2959578018 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f936c104d20 msgr2=0x7f936c107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:21:55.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.447+0000 7f9371c46640 1 --2- 172.21.15.3:0/2959578018 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f936c104d20 0x7f936c107110 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f93600098b0 tx=0x7f936002a4d0 comp rx=0 tx=0).stop 2024-09-21T12:21:55.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.447+0000 7f9371c46640 1 -- 172.21.15.3:0/2959578018 shutdown_connections 2024-09-21T12:21:55.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.447+0000 7f9371c46640 1 --2- 172.21.15.3:0/2959578018 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f936c104d20 0x7f936c107110 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:21:55.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.447+0000 7f9371c46640 1 --2- 172.21.15.3:0/2959578018 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f936c1023f0 0x7f936c1047e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:21:55.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.447+0000 7f9371c46640 1 -- 172.21.15.3:0/2959578018 >> 172.21.15.3:0/2959578018 conn(0x7f936c0fc010 msgr2=0x7f936c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:21:55.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.447+0000 7f9371c46640 1 -- 172.21.15.3:0/2959578018 shutdown_connections 2024-09-21T12:21:55.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.447+0000 7f9371c46640 1 -- 172.21.15.3:0/2959578018 wait complete. 2024-09-21T12:21:55.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.448+0000 7f9371c46640 1 Processor -- start 2024-09-21T12:21:55.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.448+0000 7f9371c46640 1 -- start start 2024-09-21T12:21:55.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.448+0000 7f9371c46640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f936c1023f0 0x7f936c197510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:21:55.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.448+0000 7f9371c46640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f936c104d20 0x7f936c197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:21:55.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.448+0000 7f9371c46640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f936c10a790 con 0x7f936c1023f0 2024-09-21T12:21:55.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.448+0000 7f9371c46640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f936c10a610 con 0x7f936c104d20 2024-09-21T12:21:55.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.449+0000 7f936b7fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f936c1023f0 0x7f936c197510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:21:55.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.449+0000 7f936b7fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f936c1023f0 0x7f936c197510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36020/0 (socket says 172.21.15.3:36020) 2024-09-21T12:21:55.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.449+0000 7f936b7fe640 1 -- 172.21.15.3:0/636030167 learned_addr learned my addr 172.21.15.3:0/636030167 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:21:55.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.449+0000 7f936affd640 1 --2- 172.21.15.3:0/636030167 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f936c104d20 0x7f936c197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:21:55.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.449+0000 7f936b7fe640 1 -- 172.21.15.3:0/636030167 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f936c104d20 msgr2=0x7f936c197a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:21:55.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.449+0000 7f936b7fe640 1 --2- 172.21.15.3:0/636030167 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f936c104d20 0x7f936c197a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:21:55.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.449+0000 7f936b7fe640 1 -- 172.21.15.3:0/636030167 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f936c1980d0 con 0x7f936c1023f0 2024-09-21T12:21:55.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.449+0000 7f936b7fe640 1 --2- 172.21.15.3:0/636030167 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f936c1023f0 0x7f936c197510 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f935c00d8d0 tx=0x7f935c00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:21:55.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.449+0000 7f9368ff9640 1 -- 172.21.15.3:0/636030167 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f935c017070 con 0x7f936c1023f0 2024-09-21T12:21:55.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.449+0000 7f9368ff9640 1 -- 172.21.15.3:0/636030167 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f935c010460 con 0x7f936c1023f0 2024-09-21T12:21:55.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.449+0000 7f9371c46640 1 -- 172.21.15.3:0/636030167 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f936c19cb10 con 0x7f936c1023f0 2024-09-21T12:21:55.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.449+0000 7f9368ff9640 1 -- 172.21.15.3:0/636030167 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f935c00f5f0 con 0x7f936c1023f0 2024-09-21T12:21:55.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.450+0000 7f9371c46640 1 -- 172.21.15.3:0/636030167 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f936c19d070 con 0x7f936c1023f0 2024-09-21T12:21:55.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.451+0000 7f9371c46640 1 -- 172.21.15.3:0/636030167 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f936c10af70 con 0x7f936c1023f0 2024-09-21T12:21:55.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.451+0000 7f9368ff9640 1 -- 172.21.15.3:0/636030167 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 26) ==== 103424+0+0 (secure 0 0 0) 0x7f935c009a30 con 0x7f936c1023f0 2024-09-21T12:21:55.453 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.452+0000 7f9368ff9640 1 --2- 172.21.15.3:0/636030167 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7f935407b050 0x7f935407d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:21:55.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.452+0000 7f9368ff9640 1 -- 172.21.15.3:0/636030167 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5812+0+0 (secure 0 0 0) 0x7f935c09df00 con 0x7f936c1023f0 2024-09-21T12:21:55.454 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.452+0000 7f936affd640 1 --2- 172.21.15.3:0/636030167 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7f935407b050 0x7f935407d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:21:55.455 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.454+0000 7f936affd640 1 --2- 172.21.15.3:0/636030167 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7f935407b050 0x7f935407d510 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9360009880 tx=0x7f93600058d0 comp rx=0 tx=0).ready entity=mgr.24409 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:21:55.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.458+0000 7f9368ff9640 1 -- 172.21.15.3:0/636030167 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f935c069430 con 0x7f936c1023f0 2024-09-21T12:21:55.734 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.732+0000 7f9371c46640 1 -- 172.21.15.3:0/636030167 --> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f936c105780 con 0x7f935407b050 2024-09-21T12:21:55.734 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:55 smithi003 ceph-mon[28057]: pgmap v44: 65 pgs: 65 active+clean; 306 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 46 KiB/s rd, 2.3 MiB/s wr, 143 op/s 2024-09-21T12:21:55.735 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.733+0000 7f9368ff9640 1 -- 172.21.15.3:0/636030167 <== mgr.24409 v2:172.21.15.192:6828/1528605296 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+360 (secure 0 0 0) 0x7f936c105780 con 0x7f935407b050 2024-09-21T12:21:55.738 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.737+0000 7f9371c46640 1 -- 172.21.15.3:0/636030167 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7f935407b050 msgr2=0x7f935407d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:21:55.738 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.737+0000 7f9371c46640 1 --2- 172.21.15.3:0/636030167 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7f935407b050 0x7f935407d510 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9360009880 tx=0x7f93600058d0 comp rx=0 tx=0).stop 2024-09-21T12:21:55.739 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.737+0000 7f9371c46640 1 -- 172.21.15.3:0/636030167 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f936c1023f0 msgr2=0x7f936c197510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:21:55.739 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.737+0000 7f9371c46640 1 --2- 172.21.15.3:0/636030167 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f936c1023f0 0x7f936c197510 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f935c00d8d0 tx=0x7f935c00dd90 comp rx=0 tx=0).stop 2024-09-21T12:21:55.739 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.737+0000 7f9371c46640 1 -- 172.21.15.3:0/636030167 shutdown_connections 2024-09-21T12:21:55.739 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.737+0000 7f9371c46640 1 --2- 172.21.15.3:0/636030167 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7f935407b050 0x7f935407d510 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:21:55.739 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.737+0000 7f9371c46640 1 --2- 172.21.15.3:0/636030167 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f936c104d20 0x7f936c197a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:21:55.739 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.737+0000 7f9371c46640 1 --2- 172.21.15.3:0/636030167 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f936c1023f0 0x7f936c197510 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:21:55.739 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.737+0000 7f9371c46640 1 -- 172.21.15.3:0/636030167 >> 172.21.15.3:0/636030167 conn(0x7f936c0fc010 msgr2=0x7f936c0fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:21:55.739 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.737+0000 7f9371c46640 1 -- 172.21.15.3:0/636030167 shutdown_connections 2024-09-21T12:21:55.739 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.737+0000 7f9371c46640 1 -- 172.21.15.3:0/636030167 wait complete. 2024-09-21T12:21:55.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.835+0000 7fdf290b9640 1 -- 172.21.15.3:0/964269434 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf24104d40 msgr2=0x7fdf24107130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:21:55.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.835+0000 7fdf290b9640 1 --2- 172.21.15.3:0/964269434 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf24104d40 0x7fdf24107130 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fdf180098b0 tx=0x7fdf1802a4d0 comp rx=0 tx=0).stop 2024-09-21T12:21:55.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.836+0000 7fdf290b9640 1 -- 172.21.15.3:0/964269434 shutdown_connections 2024-09-21T12:21:55.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.836+0000 7fdf290b9640 1 --2- 172.21.15.3:0/964269434 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf24104d40 0x7fdf24107130 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:21:55.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.836+0000 7fdf290b9640 1 --2- 172.21.15.3:0/964269434 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf24102410 0x7fdf24104800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:21:55.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.836+0000 7fdf290b9640 1 -- 172.21.15.3:0/964269434 >> 172.21.15.3:0/964269434 conn(0x7fdf240fc010 msgr2=0x7fdf240fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:21:55.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.836+0000 7fdf290b9640 1 -- 172.21.15.3:0/964269434 shutdown_connections 2024-09-21T12:21:55.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.836+0000 7fdf290b9640 1 -- 172.21.15.3:0/964269434 wait complete. 2024-09-21T12:21:55.839 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.836+0000 7fdf290b9640 1 Processor -- start 2024-09-21T12:21:55.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.837+0000 7fdf290b9640 1 -- start start 2024-09-21T12:21:55.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.837+0000 7fdf290b9640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf24102410 0x7fdf24197550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:21:55.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.837+0000 7fdf290b9640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf24104d40 0x7fdf24197a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:21:55.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.837+0000 7fdf290b9640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fdf2410a7d0 con 0x7fdf24104d40 2024-09-21T12:21:55.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.837+0000 7fdf290b9640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fdf2410a650 con 0x7fdf24102410 2024-09-21T12:21:55.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.837+0000 7fdf22d9d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf24102410 0x7fdf24197550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:21:55.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.837+0000 7fdf2259c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf24104d40 0x7fdf24197a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:21:55.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.837+0000 7fdf22d9d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf24102410 0x7fdf24197550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.3:59000/0 (socket says 172.21.15.3:59000) 2024-09-21T12:21:55.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.837+0000 7fdf22d9d640 1 -- 172.21.15.3:0/3971087440 learned_addr learned my addr 172.21.15.3:0/3971087440 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:21:55.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.838+0000 7fdf2259c640 1 -- 172.21.15.3:0/3971087440 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf24102410 msgr2=0x7fdf24197550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:21:55.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.838+0000 7fdf2259c640 1 --2- 172.21.15.3:0/3971087440 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf24102410 0x7fdf24197550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:21:55.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.838+0000 7fdf2259c640 1 -- 172.21.15.3:0/3971087440 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf24198110 con 0x7fdf24104d40 2024-09-21T12:21:55.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.838+0000 7fdf22d9d640 1 --2- 172.21.15.3:0/3971087440 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf24102410 0x7fdf24197550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T12:21:55.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.838+0000 7fdf2259c640 1 --2- 172.21.15.3:0/3971087440 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf24104d40 0x7fdf24197a90 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fdf18009230 tx=0x7fdf180045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:21:55.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.838+0000 7fdf0bfff640 1 -- 172.21.15.3:0/3971087440 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdf1803f070 con 0x7fdf24104d40 2024-09-21T12:21:55.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.838+0000 7fdf0bfff640 1 -- 172.21.15.3:0/3971087440 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdf18004a50 con 0x7fdf24104d40 2024-09-21T12:21:55.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.838+0000 7fdf290b9640 1 -- 172.21.15.3:0/3971087440 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf2419caf0 con 0x7fdf24104d40 2024-09-21T12:21:55.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.838+0000 7fdf0bfff640 1 -- 172.21.15.3:0/3971087440 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdf18035030 con 0x7fdf24104d40 2024-09-21T12:21:55.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.838+0000 7fdf290b9640 1 -- 172.21.15.3:0/3971087440 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf2419d080 con 0x7fdf24104d40 2024-09-21T12:21:55.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.839+0000 7fdf290b9640 1 -- 172.21.15.3:0/3971087440 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf241027f0 con 0x7fdf24104d40 2024-09-21T12:21:55.842 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.840+0000 7fdf0bfff640 1 -- 172.21.15.3:0/3971087440 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 26) ==== 103424+0+0 (secure 0 0 0) 0x7fdf18042070 con 0x7fdf24104d40 2024-09-21T12:21:55.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.841+0000 7fdf0bfff640 1 --2- 172.21.15.3:0/3971087440 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7fdf0c07b050 0x7fdf0c07d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:21:55.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.841+0000 7fdf0bfff640 1 -- 172.21.15.3:0/3971087440 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5812+0+0 (secure 0 0 0) 0x7fdf180bef00 con 0x7fdf24104d40 2024-09-21T12:21:55.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.842+0000 7fdf22d9d640 1 --2- 172.21.15.3:0/3971087440 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7fdf0c07b050 0x7fdf0c07d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:21:55.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.842+0000 7fdf22d9d640 1 --2- 172.21.15.3:0/3971087440 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7fdf0c07b050 0x7fdf0c07d510 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fdf140104e0 tx=0x7fdf1400b410 comp rx=0 tx=0).ready entity=mgr.24409 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:21:55.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:55.846+0000 7fdf0bfff640 1 -- 172.21.15.3:0/3971087440 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fdf1808a4b0 con 0x7fdf24104d40 2024-09-21T12:21:56.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:55 smithi192 ceph-mon[35641]: pgmap v44: 65 pgs: 65 active+clean; 306 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 46 KiB/s rd, 2.3 MiB/s wr, 143 op/s 2024-09-21T12:21:56.167 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.165+0000 7fdf290b9640 1 -- 172.21.15.3:0/3971087440 --> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fdf2419d2b0 con 0x7fdf0c07b050 2024-09-21T12:21:56.178 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.176+0000 7fdf0bfff640 1 -- 172.21.15.3:0/3971087440 <== mgr.24409 v2:172.21.15.192:6828/1528605296 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7fdf2419d2b0 con 0x7fdf0c07b050 2024-09-21T12:21:56.178 INFO:teuthology.orchestra.run.smithi003.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:21:56.178 INFO:teuthology.orchestra.run.smithi003.stdout:alertmanager.smithi003 smithi003 *:9093,9094 running (8m) 9s ago 9m 25.8M - 0.25.0 c8568f914cd2 5c03f233277e 2024-09-21T12:21:56.178 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-exporter.smithi003 smithi003 running (49s) 9s ago 9m 8250k - 19.1.1-373-g4e45e6b4 164465d2334a 0c9ad60a4f5a 2024-09-21T12:21:56.178 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-exporter.smithi192 smithi192 running (40s) 20s ago 9m 7968k - 19.1.1-373-g4e45e6b4 164465d2334a d5be8a6e120f 2024-09-21T12:21:56.178 INFO:teuthology.orchestra.run.smithi003.stdout:crash.smithi003 smithi003 running (9m) 9s ago 9m 6899k - 19.1.1-373-g4e45e6b4 164465d2334a c63f209dc1dc 2024-09-21T12:21:56.178 INFO:teuthology.orchestra.run.smithi003.stdout:crash.smithi192 smithi192 running (8m) 20s ago 8m 6895k - 19.1.1-373-g4e45e6b4 164465d2334a cc70c9a7b2f7 2024-09-21T12:21:56.178 INFO:teuthology.orchestra.run.smithi003.stdout:grafana.smithi003 smithi003 *:3000 running (8m) 9s ago 9m 83.2M - 9.4.12 2bacad6d85d8 f504f60818f0 2024-09-21T12:21:56.179 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi003.ebjgyl smithi003 running (4m) 9s ago 4m 14.1M - 19.1.1-373-g4e45e6b4 164465d2334a 16e0b2cac16a 2024-09-21T12:21:56.179 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi003.gfkngj smithi003 running (4m) 9s ago 4m 228M - 19.1.1-373-g4e45e6b4 164465d2334a 109c04f87fbd 2024-09-21T12:21:56.179 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi192.ktdqns smithi192 running (4m) 20s ago 4m 15.8M - 19.1.1-373-g4e45e6b4 164465d2334a 495c73fb3bb0 2024-09-21T12:21:56.179 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi192.ywqqxe smithi192 running (4m) 20s ago 4m 15.9M - 19.1.1-373-g4e45e6b4 164465d2334a 270a01030cbe 2024-09-21T12:21:56.179 INFO:teuthology.orchestra.run.smithi003.stdout:mgr.smithi003.wztftl smithi003 *:8443,9283,8765 running (29s) 9s ago 10m 119M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 8ce0e66fd369 2024-09-21T12:21:56.179 INFO:teuthology.orchestra.run.smithi003.stdout:mgr.smithi192.qsaprd smithi192 *:8443,9283,8765 running (116s) 20s ago 8m 508M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 bb9d2aeba009 2024-09-21T12:21:56.179 INFO:teuthology.orchestra.run.smithi003.stdout:mon.smithi003 smithi003 running (10m) 9s ago 11m 53.6M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 16bccf2c7503 2024-09-21T12:21:56.179 INFO:teuthology.orchestra.run.smithi003.stdout:mon.smithi192 smithi192 running (8m) 20s ago 8m 41.5M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 4fe4c4b3dc5d 2024-09-21T12:21:56.179 INFO:teuthology.orchestra.run.smithi003.stdout:node-exporter.smithi003 smithi003 *:9100 running (9m) 9s ago 9m 16.2M - 1.5.0 0da6a335fe13 a1eb875faefc 2024-09-21T12:21:56.179 INFO:teuthology.orchestra.run.smithi003.stdout:node-exporter.smithi192 smithi192 *:9100 running (8m) 20s ago 8m 16.7M - 1.5.0 0da6a335fe13 10c2542c2e19 2024-09-21T12:21:56.179 INFO:teuthology.orchestra.run.smithi003.stdout:osd.0 smithi003 running (7m) 9s ago 7m 180M 1217M 19.1.1-373-g4e45e6b4 164465d2334a d07f1489720d 2024-09-21T12:21:56.179 INFO:teuthology.orchestra.run.smithi003.stdout:osd.1 smithi003 running (7m) 9s ago 7m 189M 1217M 19.1.1-373-g4e45e6b4 164465d2334a 6abd75a07645 2024-09-21T12:21:56.179 INFO:teuthology.orchestra.run.smithi003.stdout:osd.2 smithi003 running (6m) 9s ago 6m 152M 1217M 19.1.1-373-g4e45e6b4 164465d2334a 3265369e573b 2024-09-21T12:21:56.180 INFO:teuthology.orchestra.run.smithi003.stdout:osd.3 smithi192 running (6m) 20s ago 6m 216M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 13efcfd71c05 2024-09-21T12:21:56.180 INFO:teuthology.orchestra.run.smithi003.stdout:osd.4 smithi192 running (5m) 20s ago 5m 184M 2240M 19.1.1-373-g4e45e6b4 164465d2334a f33bf453cb3e 2024-09-21T12:21:56.180 INFO:teuthology.orchestra.run.smithi003.stdout:osd.5 smithi192 running (5m) 20s ago 5m 159M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 12d7b7c8e985 2024-09-21T12:21:56.180 INFO:teuthology.orchestra.run.smithi003.stdout:prometheus.smithi003 smithi003 *:9095 running (44s) 9s ago 9m 45.1M - 2.43.0 a07b618ecd1d 221e783f96c5 2024-09-21T12:21:56.181 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.179+0000 7fdf290b9640 1 -- 172.21.15.3:0/3971087440 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7fdf0c07b050 msgr2=0x7fdf0c07d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:21:56.181 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.179+0000 7fdf290b9640 1 --2- 172.21.15.3:0/3971087440 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7fdf0c07b050 0x7fdf0c07d510 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fdf140104e0 tx=0x7fdf1400b410 comp rx=0 tx=0).stop 2024-09-21T12:21:56.181 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.179+0000 7fdf290b9640 1 -- 172.21.15.3:0/3971087440 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf24104d40 msgr2=0x7fdf24197a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:21:56.181 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.179+0000 7fdf290b9640 1 --2- 172.21.15.3:0/3971087440 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf24104d40 0x7fdf24197a90 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fdf18009230 tx=0x7fdf180045e0 comp rx=0 tx=0).stop 2024-09-21T12:21:56.181 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.179+0000 7fdf290b9640 1 -- 172.21.15.3:0/3971087440 shutdown_connections 2024-09-21T12:21:56.181 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.179+0000 7fdf290b9640 1 --2- 172.21.15.3:0/3971087440 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7fdf0c07b050 0x7fdf0c07d510 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:21:56.181 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.179+0000 7fdf290b9640 1 --2- 172.21.15.3:0/3971087440 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf24104d40 0x7fdf24197a90 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:21:56.181 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.179+0000 7fdf290b9640 1 --2- 172.21.15.3:0/3971087440 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf24102410 0x7fdf24197550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:21:56.181 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.179+0000 7fdf290b9640 1 -- 172.21.15.3:0/3971087440 >> 172.21.15.3:0/3971087440 conn(0x7fdf240fc010 msgr2=0x7fdf240fe450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:21:56.181 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.179+0000 7fdf290b9640 1 -- 172.21.15.3:0/3971087440 shutdown_connections 2024-09-21T12:21:56.181 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.179+0000 7fdf290b9640 1 -- 172.21.15.3:0/3971087440 wait complete. 2024-09-21T12:21:56.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.287+0000 7f27ee0fb640 1 -- 172.21.15.3:0/3483519808 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f27e8100b80 msgr2=0x7f27e8100fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:21:56.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.287+0000 7f27ee0fb640 1 --2- 172.21.15.3:0/3483519808 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f27e8100b80 0x7f27e8100fe0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f27dc009880 tx=0x7f27dc02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:21:56.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.287+0000 7f27ee0fb640 1 -- 172.21.15.3:0/3483519808 shutdown_connections 2024-09-21T12:21:56.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.287+0000 7f27ee0fb640 1 --2- 172.21.15.3:0/3483519808 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f27e8100b80 0x7f27e8100fe0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:21:56.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.287+0000 7f27ee0fb640 1 --2- 172.21.15.3:0/3483519808 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27e8100240 0x7f27e8100640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:21:56.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.287+0000 7f27ee0fb640 1 -- 172.21.15.3:0/3483519808 >> 172.21.15.3:0/3483519808 conn(0x7f27e80fc010 msgr2=0x7f27e80fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:21:56.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.288+0000 7f27ee0fb640 1 -- 172.21.15.3:0/3483519808 shutdown_connections 2024-09-21T12:21:56.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.288+0000 7f27ee0fb640 1 -- 172.21.15.3:0/3483519808 wait complete. 2024-09-21T12:21:56.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.288+0000 7f27ee0fb640 1 Processor -- start 2024-09-21T12:21:56.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.289+0000 7f27ee0fb640 1 -- start start 2024-09-21T12:21:56.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.289+0000 7f27ee0fb640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f27e8100240 0x7f27e8199670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:21:56.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.289+0000 7f27ee0fb640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27e8100b80 0x7f27e8199bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:21:56.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.289+0000 7f27ee0fb640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f27e810c970 con 0x7f27e8100240 2024-09-21T12:21:56.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.289+0000 7f27ee0fb640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f27e810c7f0 con 0x7f27e8100b80 2024-09-21T12:21:56.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.289+0000 7f27e77fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f27e8100240 0x7f27e8199670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:21:56.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.289+0000 7f27e77fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f27e8100240 0x7f27e8199670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36068/0 (socket says 172.21.15.3:36068) 2024-09-21T12:21:56.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.289+0000 7f27e77fe640 1 -- 172.21.15.3:0/1781029356 learned_addr learned my addr 172.21.15.3:0/1781029356 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:21:56.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.289+0000 7f27e6ffd640 1 --2- 172.21.15.3:0/1781029356 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27e8100b80 0x7f27e8199bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:21:56.296 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.290+0000 7f27e6ffd640 1 -- 172.21.15.3:0/1781029356 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f27e8100240 msgr2=0x7f27e8199670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:21:56.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.290+0000 7f27e6ffd640 1 --2- 172.21.15.3:0/1781029356 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f27e8100240 0x7f27e8199670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:21:56.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.290+0000 7f27e6ffd640 1 -- 172.21.15.3:0/1781029356 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27e819a230 con 0x7f27e8100b80 2024-09-21T12:21:56.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.290+0000 7f27e6ffd640 1 --2- 172.21.15.3:0/1781029356 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27e8100b80 0x7f27e8199bb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f27dc006010 tx=0x7f27dc0045e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:21:56.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.290+0000 7f27e4ff9640 1 -- 172.21.15.3:0/1781029356 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f27dc03f070 con 0x7f27e8100b80 2024-09-21T12:21:56.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.290+0000 7f27e4ff9640 1 -- 172.21.15.3:0/1781029356 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f27dc004a50 con 0x7f27e8100b80 2024-09-21T12:21:56.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.290+0000 7f27ee0fb640 1 -- 172.21.15.3:0/1781029356 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27e819ec10 con 0x7f27e8100b80 2024-09-21T12:21:56.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.290+0000 7f27e4ff9640 1 -- 172.21.15.3:0/1781029356 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f27dc035030 con 0x7f27e8100b80 2024-09-21T12:21:56.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.290+0000 7f27ee0fb640 1 -- 172.21.15.3:0/1781029356 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27e819f1a0 con 0x7f27e8100b80 2024-09-21T12:21:56.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.291+0000 7f27ee0fb640 1 -- 172.21.15.3:0/1781029356 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27e8100640 con 0x7f27e8100b80 2024-09-21T12:21:56.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.292+0000 7f27e4ff9640 1 -- 172.21.15.3:0/1781029356 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 26) ==== 103424+0+0 (secure 0 0 0) 0x7f27dc042070 con 0x7f27e8100b80 2024-09-21T12:21:56.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.293+0000 7f27e4ff9640 1 --2- 172.21.15.3:0/1781029356 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7f27d007b050 0x7f27d007d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:21:56.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.293+0000 7f27e4ff9640 1 -- 172.21.15.3:0/1781029356 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5812+0+0 (secure 0 0 0) 0x7f27dc0beb80 con 0x7f27e8100b80 2024-09-21T12:21:56.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.293+0000 7f27e77fe640 1 --2- 172.21.15.3:0/1781029356 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7f27d007b050 0x7f27d007d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:21:56.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.293+0000 7f27e77fe640 1 --2- 172.21.15.3:0/1781029356 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7f27d007b050 0x7f27d007d510 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f27d8005fd0 tx=0x7f27d800b4a0 comp rx=0 tx=0).ready entity=mgr.24409 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:21:56.299 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.298+0000 7f27e4ff9640 1 -- 172.21.15.3:0/1781029356 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f27dc004c00 con 0x7f27e8100b80 2024-09-21T12:21:56.677 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.675+0000 7f27ee0fb640 1 -- 172.21.15.3:0/1781029356 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f27e8062df0 con 0x7f27e8100b80 2024-09-21T12:21:56.678 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-21T12:21:56.678 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": { 2024-09-21T12:21:56.678 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2 2024-09-21T12:21:56.678 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:21:56.678 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": { 2024-09-21T12:21:56.678 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:21:56.678 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:21:56.678 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": { 2024-09-21T12:21:56.678 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 6 2024-09-21T12:21:56.679 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:21:56.679 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": { 2024-09-21T12:21:56.679 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 4 2024-09-21T12:21:56.679 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:21:56.679 INFO:teuthology.orchestra.run.smithi003.stdout: "overall": { 2024-09-21T12:21:56.679 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 12, 2024-09-21T12:21:56.679 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:21:56.679 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-21T12:21:56.679 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-21T12:21:56.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.676+0000 7f27e4ff9640 1 -- 172.21.15.3:0/1781029356 <== mon.1 v2:172.21.15.192:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7f27dc08a0b0 con 0x7f27e8100b80 2024-09-21T12:21:56.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.678+0000 7f27ee0fb640 1 -- 172.21.15.3:0/1781029356 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7f27d007b050 msgr2=0x7f27d007d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:21:56.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.678+0000 7f27ee0fb640 1 --2- 172.21.15.3:0/1781029356 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7f27d007b050 0x7f27d007d510 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f27d8005fd0 tx=0x7f27d800b4a0 comp rx=0 tx=0).stop 2024-09-21T12:21:56.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.678+0000 7f27ee0fb640 1 -- 172.21.15.3:0/1781029356 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27e8100b80 msgr2=0x7f27e8199bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:21:56.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.678+0000 7f27ee0fb640 1 --2- 172.21.15.3:0/1781029356 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27e8100b80 0x7f27e8199bb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f27dc006010 tx=0x7f27dc0045e0 comp rx=0 tx=0).stop 2024-09-21T12:21:56.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.678+0000 7f27ee0fb640 1 -- 172.21.15.3:0/1781029356 shutdown_connections 2024-09-21T12:21:56.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.678+0000 7f27ee0fb640 1 --2- 172.21.15.3:0/1781029356 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7f27d007b050 0x7f27d007d510 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:21:56.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.678+0000 7f27ee0fb640 1 --2- 172.21.15.3:0/1781029356 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f27e8100b80 0x7f27e8199bb0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:21:56.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.678+0000 7f27ee0fb640 1 --2- 172.21.15.3:0/1781029356 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f27e8100240 0x7f27e8199670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:21:56.681 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.678+0000 7f27ee0fb640 1 -- 172.21.15.3:0/1781029356 >> 172.21.15.3:0/1781029356 conn(0x7f27e80fc010 msgr2=0x7f27e8108b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:21:56.681 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.678+0000 7f27ee0fb640 1 -- 172.21.15.3:0/1781029356 shutdown_connections 2024-09-21T12:21:56.681 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.678+0000 7f27ee0fb640 1 -- 172.21.15.3:0/1781029356 wait complete. 2024-09-21T12:21:56.779 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.777+0000 7f5d5a8cc640 1 -- 172.21.15.3:0/1142007714 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5d54101a60 msgr2=0x7f5d54101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:21:56.779 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.777+0000 7f5d5a8cc640 1 --2- 172.21.15.3:0/1142007714 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5d54101a60 0x7f5d54101ee0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f5d48009880 tx=0x7f5d4802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:21:56.779 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:56 smithi003 ceph-mon[28057]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:21:56.779 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:56 smithi003 ceph-mon[28057]: from='client.14764 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:21:56.780 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.777+0000 7f5d5a8cc640 1 -- 172.21.15.3:0/1142007714 shutdown_connections 2024-09-21T12:21:56.780 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.777+0000 7f5d5a8cc640 1 --2- 172.21.15.3:0/1142007714 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5d54101a60 0x7f5d54101ee0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:21:56.780 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.777+0000 7f5d5a8cc640 1 --2- 172.21.15.3:0/1142007714 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5d54100860 0x7f5d54100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:21:56.781 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.777+0000 7f5d5a8cc640 1 -- 172.21.15.3:0/1142007714 >> 172.21.15.3:0/1142007714 conn(0x7f5d540fc010 msgr2=0x7f5d540fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:21:56.781 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.777+0000 7f5d5a8cc640 1 -- 172.21.15.3:0/1142007714 shutdown_connections 2024-09-21T12:21:56.781 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.777+0000 7f5d5a8cc640 1 -- 172.21.15.3:0/1142007714 wait complete. 2024-09-21T12:21:56.781 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.778+0000 7f5d5a8cc640 1 Processor -- start 2024-09-21T12:21:56.781 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.778+0000 7f5d5a8cc640 1 -- start start 2024-09-21T12:21:56.781 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.779+0000 7f5d5a8cc640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5d54100860 0x7f5d5406a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:21:56.781 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.779+0000 7f5d5a8cc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5d5419a3f0 0x7f5d5419c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:21:56.781 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.779+0000 7f5d5a8cc640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f5d54109680 con 0x7f5d5419a3f0 2024-09-21T12:21:56.781 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.779+0000 7f5d5a8cc640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5d54109500 con 0x7f5d54100860 2024-09-21T12:21:56.781 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.779+0000 7f5d537fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5d5419a3f0 0x7f5d5419c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:21:56.781 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.779+0000 7f5d537fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5d5419a3f0 0x7f5d5419c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:36080/0 (socket says 172.21.15.3:36080) 2024-09-21T12:21:56.781 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.779+0000 7f5d537fe640 1 -- 172.21.15.3:0/2213469460 learned_addr learned my addr 172.21.15.3:0/2213469460 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:21:56.781 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.779+0000 7f5d53fff640 1 --2- 172.21.15.3:0/2213469460 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5d54100860 0x7f5d5406a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:21:56.782 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.779+0000 7f5d53fff640 1 -- 172.21.15.3:0/2213469460 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5d5419a3f0 msgr2=0x7f5d5419c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:21:56.782 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.779+0000 7f5d53fff640 1 --2- 172.21.15.3:0/2213469460 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5d5419a3f0 0x7f5d5419c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:21:56.782 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.779+0000 7f5d53fff640 1 -- 172.21.15.3:0/2213469460 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d5419cda0 con 0x7f5d54100860 2024-09-21T12:21:56.782 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.780+0000 7f5d53fff640 1 --2- 172.21.15.3:0/2213469460 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5d54100860 0x7f5d5406a790 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5d4400e970 tx=0x7f5d4400ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:21:56.783 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.780+0000 7f5d517fa640 1 -- 172.21.15.3:0/2213469460 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5d4400cac0 con 0x7f5d54100860 2024-09-21T12:21:56.783 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.780+0000 7f5d517fa640 1 -- 172.21.15.3:0/2213469460 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5d4400cc60 con 0x7f5d54100860 2024-09-21T12:21:56.783 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.780+0000 7f5d517fa640 1 -- 172.21.15.3:0/2213469460 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5d44018630 con 0x7f5d54100860 2024-09-21T12:21:56.783 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.780+0000 7f5d5a8cc640 1 -- 172.21.15.3:0/2213469460 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d5419d090 con 0x7f5d54100860 2024-09-21T12:21:56.783 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.780+0000 7f5d5a8cc640 1 -- 172.21.15.3:0/2213469460 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d5419d620 con 0x7f5d54100860 2024-09-21T12:21:56.783 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.781+0000 7f5d5a8cc640 1 -- 172.21.15.3:0/2213469460 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d54101ee0 con 0x7f5d54100860 2024-09-21T12:21:56.783 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.782+0000 7f5d517fa640 1 -- 172.21.15.3:0/2213469460 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 26) ==== 103424+0+0 (secure 0 0 0) 0x7f5d4401f020 con 0x7f5d54100860 2024-09-21T12:21:56.784 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.782+0000 7f5d517fa640 1 --2- 172.21.15.3:0/2213469460 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7f5d3c07b050 0x7f5d3c07d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:21:56.784 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.783+0000 7f5d517fa640 1 -- 172.21.15.3:0/2213469460 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5812+0+0 (secure 0 0 0) 0x7f5d4409e3e0 con 0x7f5d54100860 2024-09-21T12:21:56.784 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.783+0000 7f5d537fe640 1 --2- 172.21.15.3:0/2213469460 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7f5d3c07b050 0x7f5d3c07d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:21:56.785 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.783+0000 7f5d537fe640 1 --2- 172.21.15.3:0/2213469460 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7f5d3c07b050 0x7f5d3c07d510 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5d5406a510 tx=0x7f5d48005a20 comp rx=0 tx=0).ready entity=mgr.24409 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:21:56.789 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:56.787+0000 7f5d517fa640 1 -- 172.21.15.3:0/2213469460 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f5d44069820 con 0x7f5d54100860 2024-09-21T12:21:57.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:56 smithi192 ceph-mon[35641]: from='client.14760 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:21:57.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:56 smithi192 ceph-mon[35641]: from='client.14764 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:21:57.158 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:57.157+0000 7f5d5a8cc640 1 -- 172.21.15.3:0/2213469460 --> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f5d54062630 con 0x7f5d3c07b050 2024-09-21T12:21:57.160 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:57.158+0000 7f5d517fa640 1 -- 172.21.15.3:0/2213469460 <== mgr.24409 v2:172.21.15.192:6828/1528605296 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+360 (secure 0 0 0) 0x7f5d54062630 con 0x7f5d3c07b050 2024-09-21T12:21:57.160 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-21T12:21:57.160 INFO:teuthology.orchestra.run.smithi003.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T12:21:57.160 INFO:teuthology.orchestra.run.smithi003.stdout: "in_progress": true, 2024-09-21T12:21:57.160 INFO:teuthology.orchestra.run.smithi003.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-21T12:21:57.160 INFO:teuthology.orchestra.run.smithi003.stdout: "services_complete": [ 2024-09-21T12:21:57.160 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr" 2024-09-21T12:21:57.160 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-21T12:21:57.160 INFO:teuthology.orchestra.run.smithi003.stdout: "progress": "2/2 daemons upgraded", 2024-09-21T12:21:57.160 INFO:teuthology.orchestra.run.smithi003.stdout: "message": "Currently upgrading mgr daemons", 2024-09-21T12:21:57.160 INFO:teuthology.orchestra.run.smithi003.stdout: "is_paused": false 2024-09-21T12:21:57.161 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-21T12:21:57.162 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:57.160+0000 7f5d5a8cc640 1 -- 172.21.15.3:0/2213469460 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7f5d3c07b050 msgr2=0x7f5d3c07d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:21:57.162 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:57.160+0000 7f5d5a8cc640 1 --2- 172.21.15.3:0/2213469460 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7f5d3c07b050 0x7f5d3c07d510 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f5d5406a510 tx=0x7f5d48005a20 comp rx=0 tx=0).stop 2024-09-21T12:21:57.162 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:57.160+0000 7f5d5a8cc640 1 -- 172.21.15.3:0/2213469460 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5d54100860 msgr2=0x7f5d5406a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:21:57.163 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:57.160+0000 7f5d5a8cc640 1 --2- 172.21.15.3:0/2213469460 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5d54100860 0x7f5d5406a790 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5d4400e970 tx=0x7f5d4400ee30 comp rx=0 tx=0).stop 2024-09-21T12:21:57.163 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:57.161+0000 7f5d5a8cc640 1 -- 172.21.15.3:0/2213469460 shutdown_connections 2024-09-21T12:21:57.163 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:57.161+0000 7f5d5a8cc640 1 --2- 172.21.15.3:0/2213469460 >> [v2:172.21.15.192:6828/1528605296,v1:172.21.15.192:6829/1528605296] conn(0x7f5d3c07b050 0x7f5d3c07d510 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:21:57.163 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:57.161+0000 7f5d5a8cc640 1 --2- 172.21.15.3:0/2213469460 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5d5419a3f0 0x7f5d5419c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:21:57.163 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:57.161+0000 7f5d5a8cc640 1 --2- 172.21.15.3:0/2213469460 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5d54100860 0x7f5d5406a790 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:21:57.163 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:57.161+0000 7f5d5a8cc640 1 -- 172.21.15.3:0/2213469460 >> 172.21.15.3:0/2213469460 conn(0x7f5d540fc010 msgr2=0x7f5d54105010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:21:57.163 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:57.161+0000 7f5d5a8cc640 1 -- 172.21.15.3:0/2213469460 shutdown_connections 2024-09-21T12:21:57.163 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:21:57.161+0000 7f5d5a8cc640 1 -- 172.21.15.3:0/2213469460 wait complete. 2024-09-21T12:21:57.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:57 smithi003 ceph-mon[28057]: pgmap v45: 65 pgs: 65 active+clean; 306 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 32 KiB/s rd, 1.6 MiB/s wr, 97 op/s 2024-09-21T12:21:57.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:57 smithi003 ceph-mon[28057]: from='client.14768 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:21:57.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:57 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/1781029356' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:21:58.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:57 smithi192 ceph-mon[35641]: pgmap v45: 65 pgs: 65 active+clean; 306 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 32 KiB/s rd, 1.6 MiB/s wr, 97 op/s 2024-09-21T12:21:58.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:57 smithi192 ceph-mon[35641]: from='client.14768 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:21:58.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:57 smithi192 ceph-mon[35641]: from='client.? 172.21.15.3:0/1781029356' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:21:58.811 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:58 smithi003 ceph-mon[28057]: from='client.24509 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:21:58.832 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:58 smithi192 ceph-mon[35641]: from='client.24509 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:21:59.999 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:59 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' 2024-09-21T12:21:59.999 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:59 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' 2024-09-21T12:21:59.999 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:59 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:21:59.999 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:59 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:21:59.999 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:59 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' 2024-09-21T12:21:59.999 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:59 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:21:59.999 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:59 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "mgr fail", "who": "smithi192.qsaprd"}]: dispatch 2024-09-21T12:21:59.999 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:59 smithi003 ceph-mon[28057]: Activating manager daemon smithi003.wztftl 2024-09-21T12:21:59.999 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:59 smithi003 ceph-mon[28057]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd='[{"prefix": "mgr fail", "who": "smithi192.qsaprd"}]': finished 2024-09-21T12:21:59.999 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:59 smithi003 ceph-mon[28057]: osdmap e48: 6 total, 6 up, 6 in 2024-09-21T12:21:59.999 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:59 smithi003 ceph-mon[28057]: mgrmap e27: smithi003.wztftl(active, starting, since 0.00914554s) 2024-09-21T12:22:00.000 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:59 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mon metadata", "id": "smithi003"}]: dispatch 2024-09-21T12:22:00.000 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:59 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mon metadata", "id": "smithi192"}]: dispatch 2024-09-21T12:22:00.000 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:59 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi003.gfkngj"}]: dispatch 2024-09-21T12:22:00.000 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:59 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi192.ywqqxe"}]: dispatch 2024-09-21T12:22:00.000 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:59 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi192.ktdqns"}]: dispatch 2024-09-21T12:22:00.000 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:59 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi003.ebjgyl"}]: dispatch 2024-09-21T12:22:00.000 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:59 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mgr metadata", "who": "smithi003.wztftl", "id": "smithi003.wztftl"}]: dispatch 2024-09-21T12:22:00.000 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:59 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T12:22:00.000 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:59 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T12:22:00.000 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:59 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T12:22:00.000 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:59 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T12:22:00.000 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:59 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T12:22:00.000 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:59 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T12:22:00.000 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:59 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-21T12:22:00.001 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:59 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-21T12:22:00.001 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:59 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-21T12:22:00.001 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:59 smithi003 ceph-mon[28057]: Manager daemon smithi003.wztftl is now available 2024-09-21T12:22:00.001 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:21:59 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:22:00.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:59 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' 2024-09-21T12:22:00.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:59 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' 2024-09-21T12:22:00.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:59 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:22:00.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:59 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:22:00.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:59 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' 2024-09-21T12:22:00.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:59 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:22:00.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:59 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "mgr fail", "who": "smithi192.qsaprd"}]: dispatch 2024-09-21T12:22:00.009 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:59 smithi192 ceph-mon[35641]: Activating manager daemon smithi003.wztftl 2024-09-21T12:22:00.009 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:59 smithi192 ceph-mon[35641]: from='mgr.24409 172.21.15.192:0/3108240136' entity='mgr.smithi192.qsaprd' cmd='[{"prefix": "mgr fail", "who": "smithi192.qsaprd"}]': finished 2024-09-21T12:22:00.009 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:59 smithi192 ceph-mon[35641]: osdmap e48: 6 total, 6 up, 6 in 2024-09-21T12:22:00.009 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:59 smithi192 ceph-mon[35641]: mgrmap e27: smithi003.wztftl(active, starting, since 0.00914554s) 2024-09-21T12:22:00.009 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:59 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mon metadata", "id": "smithi003"}]: dispatch 2024-09-21T12:22:00.009 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:59 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mon metadata", "id": "smithi192"}]: dispatch 2024-09-21T12:22:00.009 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:59 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi003.gfkngj"}]: dispatch 2024-09-21T12:22:00.009 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:59 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi192.ywqqxe"}]: dispatch 2024-09-21T12:22:00.009 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:59 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi192.ktdqns"}]: dispatch 2024-09-21T12:22:00.009 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:59 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi003.ebjgyl"}]: dispatch 2024-09-21T12:22:00.009 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:59 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mgr metadata", "who": "smithi003.wztftl", "id": "smithi003.wztftl"}]: dispatch 2024-09-21T12:22:00.009 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:59 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-21T12:22:00.009 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:59 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-21T12:22:00.009 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:59 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-21T12:22:00.010 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:59 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-21T12:22:00.010 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:59 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-21T12:22:00.010 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:59 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-21T12:22:00.010 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:59 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-21T12:22:00.010 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:59 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-21T12:22:00.010 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:59 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-21T12:22:00.010 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:59 smithi192 ceph-mon[35641]: Manager daemon smithi003.wztftl is now available 2024-09-21T12:22:00.010 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:21:59 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:22:01.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:00 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T12:22:01.009 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:00 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:22:01.009 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:00 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi003.wztftl/mirror_snapshot_schedule"}]: dispatch 2024-09-21T12:22:01.009 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:00 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi003.wztftl/mirror_snapshot_schedule"}]: dispatch 2024-09-21T12:22:01.009 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:00 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi003.wztftl/trash_purge_schedule"}]: dispatch 2024-09-21T12:22:01.009 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:00 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi003.wztftl/trash_purge_schedule"}]: dispatch 2024-09-21T12:22:01.009 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:00 smithi192 ceph-mon[35641]: mgrmap e28: smithi003.wztftl(active, since 1.0158s) 2024-09-21T12:22:01.009 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:00 smithi192 ceph-mon[35641]: from='mon.? -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T12:22:01.009 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:00 smithi192 ceph-mon[35641]: pgmap v3: 65 pgs: 65 active+clean; 280 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:01.009 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:00 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:01.009 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:00 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:01.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:00 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T12:22:01.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:00 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:22:01.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:00 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi003.wztftl/mirror_snapshot_schedule"}]: dispatch 2024-09-21T12:22:01.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:00 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi003.wztftl/mirror_snapshot_schedule"}]: dispatch 2024-09-21T12:22:01.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:00 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi003.wztftl/trash_purge_schedule"}]: dispatch 2024-09-21T12:22:01.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:00 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi003.wztftl/trash_purge_schedule"}]: dispatch 2024-09-21T12:22:01.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:00 smithi003 ceph-mon[28057]: mgrmap e28: smithi003.wztftl(active, since 1.0158s) 2024-09-21T12:22:01.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:00 smithi003 ceph-mon[28057]: from='mon.? -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T12:22:01.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:00 smithi003 ceph-mon[28057]: pgmap v3: 65 pgs: 65 active+clean; 280 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:01.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:00 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:01.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:00 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:02.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:01 smithi192 ceph-mon[35641]: mgrmap e29: smithi003.wztftl(active, since 2s) 2024-09-21T12:22:02.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:01 smithi192 ceph-mon[35641]: pgmap v4: 65 pgs: 65 active+clean; 280 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:02.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:01 smithi003 ceph-mon[28057]: mgrmap e29: smithi003.wztftl(active, since 2s) 2024-09-21T12:22:02.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:01 smithi003 ceph-mon[28057]: pgmap v4: 65 pgs: 65 active+clean; 280 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:03.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:02 smithi192 ceph-mon[35641]: [21/Sep/2024:12:22:01] ENGINE Bus STARTING 2024-09-21T12:22:03.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:02 smithi192 ceph-mon[35641]: [21/Sep/2024:12:22:01] ENGINE Serving on http://172.21.15.3:8765 2024-09-21T12:22:03.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:02 smithi003 ceph-mon[28057]: [21/Sep/2024:12:22:01] ENGINE Bus STARTING 2024-09-21T12:22:03.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:02 smithi003 ceph-mon[28057]: [21/Sep/2024:12:22:01] ENGINE Serving on http://172.21.15.3:8765 2024-09-21T12:22:04.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:03 smithi003 ceph-mon[28057]: [21/Sep/2024:12:22:01] ENGINE Serving on https://172.21.15.3:7150 2024-09-21T12:22:04.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:03 smithi003 ceph-mon[28057]: [21/Sep/2024:12:22:01] ENGINE Bus STARTED 2024-09-21T12:22:04.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:03 smithi003 ceph-mon[28057]: [21/Sep/2024:12:22:01] ENGINE Error in HTTPServer.serve 2024-09-21T12:22:04.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: Traceback (most recent call last): 2024-09-21T12:22:04.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T12:22:04.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: self._connections.run(self.expiration_interval) 2024-09-21T12:22:04.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T12:22:04.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: self._run(expiration_interval) 2024-09-21T12:22:04.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T12:22:04.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T12:22:04.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T12:22:04.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T12:22:04.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T12:22:04.081 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: s = self.context.wrap_socket( 2024-09-21T12:22:04.081 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T12:22:04.081 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: return self.sslsocket_class._create( 2024-09-21T12:22:04.081 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T12:22:04.081 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: self.do_handshake() 2024-09-21T12:22:04.081 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T12:22:04.081 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: self._sslobj.do_handshake() 2024-09-21T12:22:04.081 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T12:22:04.081 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:03 smithi003 ceph-mon[28057]: pgmap v5: 65 pgs: 65 active+clean; 280 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:04.081 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:03 smithi003 ceph-mon[28057]: mgrmap e30: smithi003.wztftl(active, since 4s) 2024-09-21T12:22:04.081 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:03 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:04.081 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:03 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:04.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:03 smithi192 ceph-mon[35641]: [21/Sep/2024:12:22:01] ENGINE Serving on https://172.21.15.3:7150 2024-09-21T12:22:04.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:03 smithi192 ceph-mon[35641]: [21/Sep/2024:12:22:01] ENGINE Bus STARTED 2024-09-21T12:22:04.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:03 smithi192 ceph-mon[35641]: [21/Sep/2024:12:22:01] ENGINE Error in HTTPServer.serve 2024-09-21T12:22:04.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: Traceback (most recent call last): 2024-09-21T12:22:04.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-21T12:22:04.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: self._connections.run(self.expiration_interval) 2024-09-21T12:22:04.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-21T12:22:04.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: self._run(expiration_interval) 2024-09-21T12:22:04.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-21T12:22:04.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-21T12:22:04.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-21T12:22:04.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-21T12:22:04.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-21T12:22:04.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: s = self.context.wrap_socket( 2024-09-21T12:22:04.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-21T12:22:04.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: return self.sslsocket_class._create( 2024-09-21T12:22:04.259 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-21T12:22:04.259 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: self.do_handshake() 2024-09-21T12:22:04.259 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-21T12:22:04.259 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: self._sslobj.do_handshake() 2024-09-21T12:22:04.259 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-21T12:22:04.259 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:03 smithi192 ceph-mon[35641]: pgmap v5: 65 pgs: 65 active+clean; 280 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:04.259 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:03 smithi192 ceph-mon[35641]: mgrmap e30: smithi003.wztftl(active, since 4s) 2024-09-21T12:22:04.259 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:03 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:04.259 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:03 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:05.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:05 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:05.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:05 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:05.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:05 smithi192 ceph-mon[35641]: Standby manager daemon smithi192.qsaprd started 2024-09-21T12:22:05.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:05 smithi192 ceph-mon[35641]: from='mgr.? 172.21.15.192:0/1814633642' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi192.qsaprd/crt"}]: dispatch 2024-09-21T12:22:05.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:05 smithi192 ceph-mon[35641]: from='mgr.? 172.21.15.192:0/1814633642' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T12:22:05.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:05 smithi192 ceph-mon[35641]: from='mgr.? 172.21.15.192:0/1814633642' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi192.qsaprd/key"}]: dispatch 2024-09-21T12:22:05.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:05 smithi192 ceph-mon[35641]: from='mgr.? 172.21.15.192:0/1814633642' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T12:22:05.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:05 smithi192 ceph-mon[35641]: pgmap v6: 65 pgs: 65 active+clean; 283 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 31 KiB/s rd, 867 KiB/s wr, 84 op/s 2024-09-21T12:22:05.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:05 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:05.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:05 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:05.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:05 smithi003 ceph-mon[28057]: Standby manager daemon smithi192.qsaprd started 2024-09-21T12:22:05.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:05 smithi003 ceph-mon[28057]: from='mgr.? 172.21.15.192:0/1814633642' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi192.qsaprd/crt"}]: dispatch 2024-09-21T12:22:05.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:05 smithi003 ceph-mon[28057]: from='mgr.? 172.21.15.192:0/1814633642' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T12:22:05.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:05 smithi003 ceph-mon[28057]: from='mgr.? 172.21.15.192:0/1814633642' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi192.qsaprd/key"}]: dispatch 2024-09-21T12:22:05.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:05 smithi003 ceph-mon[28057]: from='mgr.? 172.21.15.192:0/1814633642' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T12:22:05.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:05 smithi003 ceph-mon[28057]: pgmap v6: 65 pgs: 65 active+clean; 283 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 31 KiB/s rd, 867 KiB/s wr, 84 op/s 2024-09-21T12:22:06.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:06 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mgr metadata", "who": "smithi192.qsaprd", "id": "smithi192.qsaprd"}]: dispatch 2024-09-21T12:22:06.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:06 smithi192 ceph-mon[35641]: mgrmap e31: smithi003.wztftl(active, since 6s), standbys: smithi192.qsaprd 2024-09-21T12:22:06.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:06 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mgr metadata", "who": "smithi192.qsaprd", "id": "smithi192.qsaprd"}]: dispatch 2024-09-21T12:22:06.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:06 smithi003 ceph-mon[28057]: mgrmap e31: smithi003.wztftl(active, since 6s), standbys: smithi192.qsaprd 2024-09-21T12:22:07.399 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:07 smithi192 ceph-mon[35641]: pgmap v7: 65 pgs: 65 active+clean; 283 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 47 KiB/s rd, 988 KiB/s wr, 166 op/s 2024-09-21T12:22:07.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:07 smithi003 ceph-mon[28057]: pgmap v7: 65 pgs: 65 active+clean; 283 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 47 KiB/s rd, 988 KiB/s wr, 166 op/s 2024-09-21T12:22:10.051 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:09 smithi003 ceph-mon[28057]: pgmap v8: 65 pgs: 65 active+clean; 283 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 37 KiB/s rd, 768 KiB/s wr, 129 op/s 2024-09-21T12:22:10.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:09 smithi192 ceph-mon[35641]: pgmap v8: 65 pgs: 65 active+clean; 283 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 37 KiB/s rd, 768 KiB/s wr, 129 op/s 2024-09-21T12:22:10.534 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-09-21T12:22:10.534 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-09-21T12:22:10.817 DEBUG:teuthology.parallel:result is None 2024-09-21T12:22:12.156 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:11 smithi003 ceph-mon[28057]: pgmap v9: 65 pgs: 65 active+clean; 285 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 45 KiB/s rd, 1.3 MiB/s wr, 185 op/s 2024-09-21T12:22:12.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:11 smithi192 ceph-mon[35641]: pgmap v9: 65 pgs: 65 active+clean; 285 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 45 KiB/s rd, 1.3 MiB/s wr, 185 op/s 2024-09-21T12:22:13.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:13 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:13.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:13 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:13.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:13 smithi003 ceph-mon[28057]: pgmap v10: 65 pgs: 65 active+clean; 285 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 41 KiB/s rd, 1.2 MiB/s wr, 169 op/s 2024-09-21T12:22:13.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:13 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:13.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:13 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:14.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:13 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:14.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:13 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:14.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:13 smithi192 ceph-mon[35641]: pgmap v10: 65 pgs: 65 active+clean; 285 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 41 KiB/s rd, 1.2 MiB/s wr, 169 op/s 2024-09-21T12:22:14.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:13 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:14.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:13 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:15.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:14 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:22:15.032 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:14 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:22:16.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:15 smithi192 ceph-mon[35641]: pgmap v11: 65 pgs: 65 active+clean; 282 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 55 KiB/s rd, 1.3 MiB/s wr, 185 op/s 2024-09-21T12:22:16.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:15 smithi003 ceph-mon[28057]: pgmap v11: 65 pgs: 65 active+clean; 282 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 55 KiB/s rd, 1.3 MiB/s wr, 185 op/s 2024-09-21T12:22:18.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:17 smithi192 ceph-mon[35641]: pgmap v12: 65 pgs: 65 active+clean; 280 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 42 KiB/s rd, 1.4 MiB/s wr, 201 op/s 2024-09-21T12:22:18.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:17 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:18.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:17 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:18.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:17 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:22:18.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:17 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:22:18.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:17 smithi003 ceph-mon[28057]: pgmap v12: 65 pgs: 65 active+clean; 280 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 42 KiB/s rd, 1.4 MiB/s wr, 201 op/s 2024-09-21T12:22:18.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:17 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:18.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:17 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:18.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:17 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:22:18.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:17 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:22:18.906 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:18 smithi003 ceph-mon[28057]: Updating smithi003:/etc/ceph/ceph.conf 2024-09-21T12:22:18.906 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:18 smithi003 ceph-mon[28057]: Updating smithi192:/etc/ceph/ceph.conf 2024-09-21T12:22:18.906 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:18 smithi003 ceph-mon[28057]: Updating smithi192:/var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T12:22:18.907 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:18 smithi003 ceph-mon[28057]: Updating smithi003:/var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T12:22:18.907 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:18 smithi003 ceph-mon[28057]: Updating smithi192:/etc/ceph/ceph.client.admin.keyring 2024-09-21T12:22:18.907 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:18 smithi003 ceph-mon[28057]: Updating smithi003:/etc/ceph/ceph.client.admin.keyring 2024-09-21T12:22:18.907 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:18 smithi003 ceph-mon[28057]: Updating smithi192:/var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T12:22:18.907 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:18 smithi003 ceph-mon[28057]: Updating smithi003:/var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T12:22:18.907 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:18 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:18.907 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:18 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:18.907 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:18 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:18.907 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:18 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:18.907 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:18 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:19.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:18 smithi192 ceph-mon[35641]: Updating smithi003:/etc/ceph/ceph.conf 2024-09-21T12:22:19.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:18 smithi192 ceph-mon[35641]: Updating smithi192:/etc/ceph/ceph.conf 2024-09-21T12:22:19.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:18 smithi192 ceph-mon[35641]: Updating smithi192:/var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T12:22:19.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:18 smithi192 ceph-mon[35641]: Updating smithi003:/var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/config/ceph.conf 2024-09-21T12:22:19.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:18 smithi192 ceph-mon[35641]: Updating smithi192:/etc/ceph/ceph.client.admin.keyring 2024-09-21T12:22:19.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:18 smithi192 ceph-mon[35641]: Updating smithi003:/etc/ceph/ceph.client.admin.keyring 2024-09-21T12:22:19.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:18 smithi192 ceph-mon[35641]: Updating smithi192:/var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T12:22:19.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:18 smithi192 ceph-mon[35641]: Updating smithi003:/var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/config/ceph.client.admin.keyring 2024-09-21T12:22:19.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:18 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:19.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:18 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:19.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:18 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:19.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:18 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:19.259 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:18 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:20.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:19 smithi192 ceph-mon[35641]: Reconfiguring prometheus.smithi003 (dependencies changed)... 2024-09-21T12:22:20.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:19 smithi192 ceph-mon[35641]: Reconfiguring daemon prometheus.smithi003 on smithi003 2024-09-21T12:22:20.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:19 smithi192 ceph-mon[35641]: pgmap v13: 65 pgs: 65 active+clean; 280 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 28 KiB/s rd, 1.2 MiB/s wr, 139 op/s 2024-09-21T12:22:20.287 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:19 smithi003 ceph-mon[28057]: Reconfiguring prometheus.smithi003 (dependencies changed)... 2024-09-21T12:22:20.287 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:19 smithi003 ceph-mon[28057]: Reconfiguring daemon prometheus.smithi003 on smithi003 2024-09-21T12:22:20.288 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:19 smithi003 ceph-mon[28057]: pgmap v13: 65 pgs: 65 active+clean; 280 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 28 KiB/s rd, 1.2 MiB/s wr, 139 op/s 2024-09-21T12:22:20.289 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-09-21T12:22:20.289 DEBUG:teuthology.orchestra.run.smithi003:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-21T12:22:20.607 DEBUG:teuthology.parallel:result is None 2024-09-21T12:22:20.608 DEBUG:teuthology.orchestra.run.smithi003:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-21T12:22:20.645 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-21T12:22:20.645 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-09-21T12:22:20.678 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-09-21T12:22:20.678 DEBUG:teuthology.parallel:result is None 2024-09-21T12:22:22.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:21 smithi192 ceph-mon[35641]: pgmap v14: 65 pgs: 65 active+clean; 280 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 39 KiB/s rd, 1.7 MiB/s wr, 216 op/s 2024-09-21T12:22:22.325 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:21 smithi003 ceph-mon[28057]: pgmap v14: 65 pgs: 65 active+clean; 280 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 39 KiB/s rd, 1.7 MiB/s wr, 216 op/s 2024-09-21T12:22:24.021 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:23 smithi003 ceph-mon[28057]: pgmap v15: 65 pgs: 65 active+clean; 280 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 25 KiB/s rd, 1.0 MiB/s wr, 143 op/s 2024-09-21T12:22:24.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:23 smithi192 ceph-mon[35641]: pgmap v15: 65 pgs: 65 active+clean; 280 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 25 KiB/s rd, 1.0 MiB/s wr, 143 op/s 2024-09-21T12:22:25.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:25 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:25.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:25 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:25.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:25 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T12:22:25.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:25 smithi003 ceph-mon[28057]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T12:22:25.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:25 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:22:25.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:25 smithi003 ceph-mon[28057]: pgmap v16: 65 pgs: 65 active+clean; 279 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 32 KiB/s rd, 1.1 MiB/s wr, 156 op/s 2024-09-21T12:22:25.426 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:25 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:25.427 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:25 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:25.427 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:25 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T12:22:25.427 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:25 smithi192 ceph-mon[35641]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T12:22:25.427 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:25 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:22:25.427 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:25 smithi192 ceph-mon[35641]: pgmap v16: 65 pgs: 65 active+clean; 279 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 32 KiB/s rd, 1.1 MiB/s wr, 156 op/s 2024-09-21T12:22:26.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:26 smithi003 ceph-mon[28057]: Upgrade: Updating mgr.smithi192.qsaprd 2024-09-21T12:22:26.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:26 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi192.qsaprd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T12:22:26.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:26 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi192.qsaprd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T12:22:26.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:26 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T12:22:26.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:26 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:22:26.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:26 smithi003 ceph-mon[28057]: Deploying daemon mgr.smithi192.qsaprd on smithi192 2024-09-21T12:22:26.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:26 smithi192 ceph-mon[35641]: Upgrade: Updating mgr.smithi192.qsaprd 2024-09-21T12:22:26.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:26 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi192.qsaprd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T12:22:26.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:26 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi192.qsaprd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-21T12:22:26.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:26 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-21T12:22:26.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:26 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:22:26.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:26 smithi192 ceph-mon[35641]: Deploying daemon mgr.smithi192.qsaprd on smithi192 2024-09-21T12:22:27.264 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.261+0000 7f392bb39640 1 -- 172.21.15.3:0/1964204574 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f39241001e0 msgr2=0x7f39241005e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:22:27.264 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.261+0000 7f392bb39640 1 --2- 172.21.15.3:0/1964204574 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f39241001e0 0x7f39241005e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f3920009880 tx=0x7f392002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:22:27.265 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.261+0000 7f392bb39640 1 -- 172.21.15.3:0/1964204574 shutdown_connections 2024-09-21T12:22:27.265 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.261+0000 7f392bb39640 1 --2- 172.21.15.3:0/1964204574 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3924100b20 0x7f3924100f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:22:27.265 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.261+0000 7f392bb39640 1 --2- 172.21.15.3:0/1964204574 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f39241001e0 0x7f39241005e0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:22:27.265 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.261+0000 7f392bb39640 1 -- 172.21.15.3:0/1964204574 >> 172.21.15.3:0/1964204574 conn(0x7f39240fc010 msgr2=0x7f39240fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:22:27.265 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.261+0000 7f392bb39640 1 -- 172.21.15.3:0/1964204574 shutdown_connections 2024-09-21T12:22:27.265 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.261+0000 7f392bb39640 1 -- 172.21.15.3:0/1964204574 wait complete. 2024-09-21T12:22:27.265 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.262+0000 7f392bb39640 1 Processor -- start 2024-09-21T12:22:27.265 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.262+0000 7f392bb39640 1 -- start start 2024-09-21T12:22:27.265 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.262+0000 7f392bb39640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39241001e0 0x7f39241996f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:22:27.265 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.262+0000 7f392bb39640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3924100b20 0x7f3924199c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:22:27.265 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.262+0000 7f392bb39640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f392410c990 con 0x7f3924100b20 2024-09-21T12:22:27.265 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.262+0000 7f392bb39640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f392410c810 con 0x7f39241001e0 2024-09-21T12:22:27.265 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.262+0000 7f39290d4640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3924100b20 0x7f3924199c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:22:27.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.262+0000 7f39298d5640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39241001e0 0x7f39241996f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:22:27.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.262+0000 7f39290d4640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3924100b20 0x7f3924199c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41286/0 (socket says 172.21.15.3:41286) 2024-09-21T12:22:27.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.262+0000 7f39290d4640 1 -- 172.21.15.3:0/367990222 learned_addr learned my addr 172.21.15.3:0/367990222 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:22:27.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.262+0000 7f39290d4640 1 -- 172.21.15.3:0/367990222 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39241001e0 msgr2=0x7f39241996f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:22:27.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.262+0000 7f39290d4640 1 --2- 172.21.15.3:0/367990222 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39241001e0 0x7f39241996f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:22:27.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.262+0000 7f39290d4640 1 -- 172.21.15.3:0/367990222 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f392419a2b0 con 0x7f3924100b20 2024-09-21T12:22:27.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.263+0000 7f39290d4640 1 --2- 172.21.15.3:0/367990222 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3924100b20 0x7f3924199c30 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f391400e970 tx=0x7f391400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:22:27.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.263+0000 7f391affd640 1 -- 172.21.15.3:0/367990222 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f391400cac0 con 0x7f3924100b20 2024-09-21T12:22:27.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.263+0000 7f391affd640 1 -- 172.21.15.3:0/367990222 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f39140054e0 con 0x7f3924100b20 2024-09-21T12:22:27.266 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.263+0000 7f392bb39640 1 -- 172.21.15.3:0/367990222 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f392419ecf0 con 0x7f3924100b20 2024-09-21T12:22:27.267 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.263+0000 7f391affd640 1 -- 172.21.15.3:0/367990222 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3914010430 con 0x7f3924100b20 2024-09-21T12:22:27.267 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.263+0000 7f392bb39640 1 -- 172.21.15.3:0/367990222 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f392419f220 con 0x7f3924100b20 2024-09-21T12:22:27.267 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.264+0000 7f392bb39640 1 -- 172.21.15.3:0/367990222 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39241005e0 con 0x7f3924100b20 2024-09-21T12:22:27.267 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.265+0000 7f391affd640 1 -- 172.21.15.3:0/367990222 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 31) ==== 103420+0+0 (secure 0 0 0) 0x7f3914004f00 con 0x7f3924100b20 2024-09-21T12:22:27.267 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.266+0000 7f391affd640 1 --2- 172.21.15.3:0/367990222 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f391007b0b0 0x7f391007d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:22:27.267 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.266+0000 7f39298d5640 1 --2- 172.21.15.3:0/367990222 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f391007b0b0 0x7f391007d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:22:27.267 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.266+0000 7f391affd640 1 -- 172.21.15.3:0/367990222 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6156+0+0 (secure 0 0 0) 0x7f391409e870 con 0x7f3924100b20 2024-09-21T12:22:27.268 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.266+0000 7f39298d5640 1 --2- 172.21.15.3:0/367990222 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f391007b0b0 0x7f391007d570 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3920000c00 tx=0x7f39200058d0 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:22:27.272 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.271+0000 7f391affd640 1 -- 172.21.15.3:0/367990222 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f3914069cd0 con 0x7f3924100b20 2024-09-21T12:22:27.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:27 smithi003 ceph-mon[28057]: pgmap v17: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 19 KiB/s rd, 1.1 MiB/s wr, 161 op/s 2024-09-21T12:22:27.405 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:27 smithi192 ceph-mon[35641]: pgmap v17: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 19 KiB/s rd, 1.1 MiB/s wr, 161 op/s 2024-09-21T12:22:27.478 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.477+0000 7f392bb39640 1 -- 172.21.15.3:0/367990222 --> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f39240626f0 con 0x7f391007b0b0 2024-09-21T12:22:27.480 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.478+0000 7f391affd640 1 -- 172.21.15.3:0/367990222 <== mgr.14756 v2:172.21.15.3:6800/1284098095 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+360 (secure 0 0 0) 0x7f39240626f0 con 0x7f391007b0b0 2024-09-21T12:22:27.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.480+0000 7f392bb39640 1 -- 172.21.15.3:0/367990222 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f391007b0b0 msgr2=0x7f391007d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:22:27.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.480+0000 7f392bb39640 1 --2- 172.21.15.3:0/367990222 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f391007b0b0 0x7f391007d570 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f3920000c00 tx=0x7f39200058d0 comp rx=0 tx=0).stop 2024-09-21T12:22:27.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.480+0000 7f392bb39640 1 -- 172.21.15.3:0/367990222 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3924100b20 msgr2=0x7f3924199c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:22:27.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.480+0000 7f392bb39640 1 --2- 172.21.15.3:0/367990222 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3924100b20 0x7f3924199c30 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f391400e970 tx=0x7f391400ed70 comp rx=0 tx=0).stop 2024-09-21T12:22:27.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.480+0000 7f392bb39640 1 -- 172.21.15.3:0/367990222 shutdown_connections 2024-09-21T12:22:27.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.480+0000 7f392bb39640 1 --2- 172.21.15.3:0/367990222 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f391007b0b0 0x7f391007d570 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:22:27.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.480+0000 7f392bb39640 1 --2- 172.21.15.3:0/367990222 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3924100b20 0x7f3924199c30 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:22:27.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.480+0000 7f392bb39640 1 --2- 172.21.15.3:0/367990222 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39241001e0 0x7f39241996f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:22:27.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.480+0000 7f392bb39640 1 -- 172.21.15.3:0/367990222 >> 172.21.15.3:0/367990222 conn(0x7f39240fc010 msgr2=0x7f3924108a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:22:27.482 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.480+0000 7f392bb39640 1 -- 172.21.15.3:0/367990222 shutdown_connections 2024-09-21T12:22:27.483 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.480+0000 7f392bb39640 1 -- 172.21.15.3:0/367990222 wait complete. 2024-09-21T12:22:27.491 INFO:teuthology.orchestra.run.smithi003.stdout:true 2024-09-21T12:22:27.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.565+0000 7fa000d51640 1 -- 172.21.15.3:0/18847880 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ffc101a60 msgr2=0x7f9ffc101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:22:27.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.565+0000 7fa000d51640 1 --2- 172.21.15.3:0/18847880 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ffc101a60 0x7f9ffc101ee0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f9fe4009880 tx=0x7f9fe402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:22:27.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.565+0000 7fa000d51640 1 -- 172.21.15.3:0/18847880 shutdown_connections 2024-09-21T12:22:27.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.565+0000 7fa000d51640 1 --2- 172.21.15.3:0/18847880 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ffc101a60 0x7f9ffc101ee0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:22:27.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.565+0000 7fa000d51640 1 --2- 172.21.15.3:0/18847880 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ffc100860 0x7f9ffc100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:22:27.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.565+0000 7fa000d51640 1 -- 172.21.15.3:0/18847880 >> 172.21.15.3:0/18847880 conn(0x7f9ffc0fc010 msgr2=0x7f9ffc0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:22:27.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.565+0000 7fa000d51640 1 -- 172.21.15.3:0/18847880 shutdown_connections 2024-09-21T12:22:27.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.565+0000 7fa000d51640 1 -- 172.21.15.3:0/18847880 wait complete. 2024-09-21T12:22:27.569 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.566+0000 7fa000d51640 1 Processor -- start 2024-09-21T12:22:27.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.566+0000 7fa000d51640 1 -- start start 2024-09-21T12:22:27.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.566+0000 7fa000d51640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ffc100860 0x7f9ffc06aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:22:27.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.566+0000 7fa000d51640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ffc101a60 0x7f9ffc19e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:22:27.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.566+0000 7fa000d51640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f9ffc109680 con 0x7f9ffc101a60 2024-09-21T12:22:27.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.566+0000 7fa000d51640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9ffc109500 con 0x7f9ffc100860 2024-09-21T12:22:27.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.566+0000 7f9ff3fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ffc101a60 0x7f9ffc19e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:22:27.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.567+0000 7f9ff3fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ffc101a60 0x7f9ffc19e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41308/0 (socket says 172.21.15.3:41308) 2024-09-21T12:22:27.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.567+0000 7f9ff3fff640 1 -- 172.21.15.3:0/1898461674 learned_addr learned my addr 172.21.15.3:0/1898461674 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:22:27.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.567+0000 7f9ffa59c640 1 --2- 172.21.15.3:0/1898461674 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ffc100860 0x7f9ffc06aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:22:27.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.567+0000 7f9ff3fff640 1 -- 172.21.15.3:0/1898461674 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ffc100860 msgr2=0x7f9ffc06aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:22:27.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.567+0000 7f9ff3fff640 1 --2- 172.21.15.3:0/1898461674 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ffc100860 0x7f9ffc06aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:22:27.571 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.567+0000 7f9ff3fff640 1 -- 172.21.15.3:0/1898461674 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ffc19eb50 con 0x7f9ffc101a60 2024-09-21T12:22:27.571 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.567+0000 7f9ffa59c640 1 --2- 172.21.15.3:0/1898461674 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ffc100860 0x7f9ffc06aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:22:27.571 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.567+0000 7f9ff3fff640 1 --2- 172.21.15.3:0/1898461674 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ffc101a60 0x7f9ffc19e610 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f9fe4006010 tx=0x7f9fe40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:22:27.571 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.567+0000 7f9ff37fe640 1 -- 172.21.15.3:0/1898461674 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9fe403f070 con 0x7f9ffc101a60 2024-09-21T12:22:27.571 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.567+0000 7f9ff37fe640 1 -- 172.21.15.3:0/1898461674 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9fe4004ac0 con 0x7f9ffc101a60 2024-09-21T12:22:27.571 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.567+0000 7fa000d51640 1 -- 172.21.15.3:0/1898461674 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ffc19ed20 con 0x7f9ffc101a60 2024-09-21T12:22:27.571 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.567+0000 7f9ff37fe640 1 -- 172.21.15.3:0/1898461674 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9fe4035030 con 0x7f9ffc101a60 2024-09-21T12:22:27.571 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.567+0000 7fa000d51640 1 -- 172.21.15.3:0/1898461674 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ffc19f1d0 con 0x7f9ffc101a60 2024-09-21T12:22:27.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.568+0000 7fa000d51640 1 -- 172.21.15.3:0/1898461674 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ffc100c60 con 0x7f9ffc101a60 2024-09-21T12:22:27.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.569+0000 7f9ff37fe640 1 -- 172.21.15.3:0/1898461674 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 31) ==== 103420+0+0 (secure 0 0 0) 0x7f9fe4042070 con 0x7f9ffc101a60 2024-09-21T12:22:27.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.570+0000 7f9ff37fe640 1 --2- 172.21.15.3:0/1898461674 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f9fe807b0b0 0x7f9fe807d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:22:27.572 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.570+0000 7f9ff37fe640 1 -- 172.21.15.3:0/1898461674 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6156+0+0 (secure 0 0 0) 0x7f9fe40bede0 con 0x7f9ffc101a60 2024-09-21T12:22:27.573 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.570+0000 7f9ffa59c640 1 --2- 172.21.15.3:0/1898461674 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f9fe807b0b0 0x7f9fe807d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:22:27.573 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.570+0000 7f9ffa59c640 1 --2- 172.21.15.3:0/1898461674 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f9fe807b0b0 0x7f9fe807d570 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9fec005d00 tx=0x7f9fec005c90 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:22:27.576 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.574+0000 7f9ff37fe640 1 -- 172.21.15.3:0/1898461674 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f9fe408a1b0 con 0x7f9ffc101a60 2024-09-21T12:22:27.780 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.778+0000 7fa000d51640 1 -- 172.21.15.3:0/1898461674 --> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f9ffc062740 con 0x7f9fe807b0b0 2024-09-21T12:22:27.781 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.780+0000 7f9ff37fe640 1 -- 172.21.15.3:0/1898461674 <== mgr.14756 v2:172.21.15.3:6800/1284098095 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+360 (secure 0 0 0) 0x7f9ffc062740 con 0x7f9fe807b0b0 2024-09-21T12:22:27.783 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.781+0000 7fa000d51640 1 -- 172.21.15.3:0/1898461674 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f9fe807b0b0 msgr2=0x7f9fe807d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:22:27.783 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.781+0000 7fa000d51640 1 --2- 172.21.15.3:0/1898461674 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f9fe807b0b0 0x7f9fe807d570 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f9fec005d00 tx=0x7f9fec005c90 comp rx=0 tx=0).stop 2024-09-21T12:22:27.784 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.781+0000 7fa000d51640 1 -- 172.21.15.3:0/1898461674 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ffc101a60 msgr2=0x7f9ffc19e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:22:27.784 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.781+0000 7fa000d51640 1 --2- 172.21.15.3:0/1898461674 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ffc101a60 0x7f9ffc19e610 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f9fe4006010 tx=0x7f9fe40046c0 comp rx=0 tx=0).stop 2024-09-21T12:22:27.784 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.782+0000 7fa000d51640 1 -- 172.21.15.3:0/1898461674 shutdown_connections 2024-09-21T12:22:27.784 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.782+0000 7fa000d51640 1 --2- 172.21.15.3:0/1898461674 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f9fe807b0b0 0x7f9fe807d570 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:22:27.784 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.782+0000 7fa000d51640 1 --2- 172.21.15.3:0/1898461674 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ffc101a60 0x7f9ffc19e610 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:22:27.784 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.782+0000 7fa000d51640 1 --2- 172.21.15.3:0/1898461674 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ffc100860 0x7f9ffc06aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:22:27.784 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.782+0000 7fa000d51640 1 -- 172.21.15.3:0/1898461674 >> 172.21.15.3:0/1898461674 conn(0x7f9ffc0fc010 msgr2=0x7f9ffc104f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:22:27.784 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.782+0000 7fa000d51640 1 -- 172.21.15.3:0/1898461674 shutdown_connections 2024-09-21T12:22:27.784 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.782+0000 7fa000d51640 1 -- 172.21.15.3:0/1898461674 wait complete. 2024-09-21T12:22:27.869 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.866+0000 7f179efbf640 1 -- 172.21.15.3:0/2155958219 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1798100860 msgr2=0x7f1798100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:22:27.869 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.866+0000 7f179efbf640 1 --2- 172.21.15.3:0/2155958219 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1798100860 0x7f1798100c60 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f178c009880 tx=0x7f178c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:22:27.869 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.866+0000 7f179efbf640 1 -- 172.21.15.3:0/2155958219 shutdown_connections 2024-09-21T12:22:27.869 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.866+0000 7f179efbf640 1 --2- 172.21.15.3:0/2155958219 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1798101a60 0x7f1798101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:22:27.870 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.866+0000 7f179efbf640 1 --2- 172.21.15.3:0/2155958219 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1798100860 0x7f1798100c60 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:22:27.870 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.866+0000 7f179efbf640 1 -- 172.21.15.3:0/2155958219 >> 172.21.15.3:0/2155958219 conn(0x7f17980fc010 msgr2=0x7f17980fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:22:27.870 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.866+0000 7f179efbf640 1 -- 172.21.15.3:0/2155958219 shutdown_connections 2024-09-21T12:22:27.870 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.866+0000 7f179efbf640 1 -- 172.21.15.3:0/2155958219 wait complete. 2024-09-21T12:22:27.870 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.867+0000 7f179efbf640 1 Processor -- start 2024-09-21T12:22:27.870 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.867+0000 7f179efbf640 1 -- start start 2024-09-21T12:22:27.870 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.867+0000 7f179efbf640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1798100860 0x7f1798104780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:22:27.870 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.867+0000 7f179efbf640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1798101a60 0x7f1798102e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:22:27.870 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.867+0000 7f179efbf640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f17981096a0 con 0x7f1798100860 2024-09-21T12:22:27.870 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.867+0000 7f179efbf640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f1798109520 con 0x7f1798101a60 2024-09-21T12:22:27.870 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.867+0000 7f179cd5b640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1798100860 0x7f1798104780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:22:27.870 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.867+0000 7f179cd5b640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1798100860 0x7f1798104780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41314/0 (socket says 172.21.15.3:41314) 2024-09-21T12:22:27.871 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.867+0000 7f179cd5b640 1 -- 172.21.15.3:0/2518768699 learned_addr learned my addr 172.21.15.3:0/2518768699 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:22:27.871 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.867+0000 7f1797fff640 1 --2- 172.21.15.3:0/2518768699 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1798101a60 0x7f1798102e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:22:27.871 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.867+0000 7f179cd5b640 1 -- 172.21.15.3:0/2518768699 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1798101a60 msgr2=0x7f1798102e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:22:27.871 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.867+0000 7f179cd5b640 1 --2- 172.21.15.3:0/2518768699 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1798101a60 0x7f1798102e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:22:27.871 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.867+0000 7f179cd5b640 1 -- 172.21.15.3:0/2518768699 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1798103380 con 0x7f1798100860 2024-09-21T12:22:27.871 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.867+0000 7f179cd5b640 1 --2- 172.21.15.3:0/2518768699 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1798100860 0x7f1798104780 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f178c006010 tx=0x7f178c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:22:27.871 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.868+0000 7f1795ffb640 1 -- 172.21.15.3:0/2518768699 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f178c03f070 con 0x7f1798100860 2024-09-21T12:22:27.871 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.868+0000 7f1795ffb640 1 -- 172.21.15.3:0/2518768699 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f178c004a50 con 0x7f1798100860 2024-09-21T12:22:27.871 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.868+0000 7f179efbf640 1 -- 172.21.15.3:0/2518768699 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1798103610 con 0x7f1798100860 2024-09-21T12:22:27.871 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.868+0000 7f1795ffb640 1 -- 172.21.15.3:0/2518768699 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f178c035030 con 0x7f1798100860 2024-09-21T12:22:27.872 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.868+0000 7f179efbf640 1 -- 172.21.15.3:0/2518768699 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1798103b40 con 0x7f1798100860 2024-09-21T12:22:27.872 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.869+0000 7f179efbf640 1 -- 172.21.15.3:0/2518768699 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1798100c60 con 0x7f1798100860 2024-09-21T12:22:27.872 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.870+0000 7f1795ffb640 1 -- 172.21.15.3:0/2518768699 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 31) ==== 103420+0+0 (secure 0 0 0) 0x7f178c042070 con 0x7f1798100860 2024-09-21T12:22:27.872 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.870+0000 7f1795ffb640 1 --2- 172.21.15.3:0/2518768699 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f178807b0b0 0x7f178807d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:22:27.872 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.870+0000 7f1795ffb640 1 -- 172.21.15.3:0/2518768699 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6156+0+0 (secure 0 0 0) 0x7f178c0bed20 con 0x7f1798100860 2024-09-21T12:22:27.873 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.870+0000 7f1797fff640 1 --2- 172.21.15.3:0/2518768699 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f178807b0b0 0x7f178807d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:22:27.873 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.871+0000 7f1797fff640 1 --2- 172.21.15.3:0/2518768699 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f178807b0b0 0x7f178807d570 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f1784005fd0 tx=0x7f1784005850 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:22:27.876 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:27.875+0000 7f1795ffb640 1 -- 172.21.15.3:0/2518768699 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f178c08a180 con 0x7f1798100860 2024-09-21T12:22:28.071 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.070+0000 7f179efbf640 1 -- 172.21.15.3:0/2518768699 --> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f179806a910 con 0x7f178807b0b0 2024-09-21T12:22:28.081 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.079+0000 7f1795ffb640 1 -- 172.21.15.3:0/2518768699 <== mgr.14756 v2:172.21.15.3:6800/1284098095 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f179806a910 con 0x7f178807b0b0 2024-09-21T12:22:28.081 INFO:teuthology.orchestra.run.smithi003.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:22:28.081 INFO:teuthology.orchestra.run.smithi003.stdout:alertmanager.smithi003 smithi003 *:9093,9094 running (8m) 15s ago 10m 25.8M - 0.25.0 c8568f914cd2 5c03f233277e 2024-09-21T12:22:28.081 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-exporter.smithi003 smithi003 running (81s) 15s ago 10m 8414k - 19.1.1-373-g4e45e6b4 164465d2334a 0c9ad60a4f5a 2024-09-21T12:22:28.081 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-exporter.smithi192 smithi192 running (72s) 24s ago 9m 8040k - 19.1.1-373-g4e45e6b4 164465d2334a d5be8a6e120f 2024-09-21T12:22:28.081 INFO:teuthology.orchestra.run.smithi003.stdout:crash.smithi003 smithi003 running (10m) 15s ago 10m 6899k - 19.1.1-373-g4e45e6b4 164465d2334a c63f209dc1dc 2024-09-21T12:22:28.082 INFO:teuthology.orchestra.run.smithi003.stdout:crash.smithi192 smithi192 running (9m) 24s ago 9m 6895k - 19.1.1-373-g4e45e6b4 164465d2334a cc70c9a7b2f7 2024-09-21T12:22:28.082 INFO:teuthology.orchestra.run.smithi003.stdout:grafana.smithi003 smithi003 *:3000 running (8m) 15s ago 9m 80.9M - 9.4.12 2bacad6d85d8 f504f60818f0 2024-09-21T12:22:28.082 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi003.ebjgyl smithi003 running (4m) 15s ago 4m 14.5M - 19.1.1-373-g4e45e6b4 164465d2334a 16e0b2cac16a 2024-09-21T12:22:28.082 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi003.gfkngj smithi003 running (4m) 15s ago 4m 197M - 19.1.1-373-g4e45e6b4 164465d2334a 109c04f87fbd 2024-09-21T12:22:28.082 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi192.ktdqns smithi192 running (4m) 24s ago 4m 16.2M - 19.1.1-373-g4e45e6b4 164465d2334a 495c73fb3bb0 2024-09-21T12:22:28.082 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi192.ywqqxe smithi192 running (4m) 24s ago 4m 16.2M - 19.1.1-373-g4e45e6b4 164465d2334a 270a01030cbe 2024-09-21T12:22:28.082 INFO:teuthology.orchestra.run.smithi003.stdout:mgr.smithi003.wztftl smithi003 *:8443,9283,8765 running (61s) 15s ago 11m 492M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 8ce0e66fd369 2024-09-21T12:22:28.082 INFO:teuthology.orchestra.run.smithi003.stdout:mgr.smithi192.qsaprd smithi192 *:8443,9283,8765 running (2m) 24s ago 9m 146M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 bb9d2aeba009 2024-09-21T12:22:28.082 INFO:teuthology.orchestra.run.smithi003.stdout:mon.smithi003 smithi003 running (11m) 15s ago 11m 56.3M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 16bccf2c7503 2024-09-21T12:22:28.082 INFO:teuthology.orchestra.run.smithi003.stdout:mon.smithi192 smithi192 running (9m) 24s ago 9m 45.7M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 4fe4c4b3dc5d 2024-09-21T12:22:28.082 INFO:teuthology.orchestra.run.smithi003.stdout:node-exporter.smithi003 smithi003 *:9100 running (10m) 15s ago 10m 16.1M - 1.5.0 0da6a335fe13 a1eb875faefc 2024-09-21T12:22:28.082 INFO:teuthology.orchestra.run.smithi003.stdout:node-exporter.smithi192 smithi192 *:9100 running (9m) 24s ago 9m 16.7M - 1.5.0 0da6a335fe13 10c2542c2e19 2024-09-21T12:22:28.082 INFO:teuthology.orchestra.run.smithi003.stdout:osd.0 smithi003 running (8m) 15s ago 8m 191M 1217M 19.1.1-373-g4e45e6b4 164465d2334a d07f1489720d 2024-09-21T12:22:28.083 INFO:teuthology.orchestra.run.smithi003.stdout:osd.1 smithi003 running (7m) 15s ago 7m 197M 1217M 19.1.1-373-g4e45e6b4 164465d2334a 6abd75a07645 2024-09-21T12:22:28.083 INFO:teuthology.orchestra.run.smithi003.stdout:osd.2 smithi003 running (7m) 15s ago 7m 164M 1217M 19.1.1-373-g4e45e6b4 164465d2334a 3265369e573b 2024-09-21T12:22:28.083 INFO:teuthology.orchestra.run.smithi003.stdout:osd.3 smithi192 running (6m) 24s ago 6m 231M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 13efcfd71c05 2024-09-21T12:22:28.083 INFO:teuthology.orchestra.run.smithi003.stdout:osd.4 smithi192 running (6m) 24s ago 6m 197M 2240M 19.1.1-373-g4e45e6b4 164465d2334a f33bf453cb3e 2024-09-21T12:22:28.083 INFO:teuthology.orchestra.run.smithi003.stdout:osd.5 smithi192 running (5m) 24s ago 5m 171M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 12d7b7c8e985 2024-09-21T12:22:28.083 INFO:teuthology.orchestra.run.smithi003.stdout:prometheus.smithi003 smithi003 *:9095 starting - - - - 2024-09-21T12:22:28.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.081+0000 7f179efbf640 1 -- 172.21.15.3:0/2518768699 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f178807b0b0 msgr2=0x7f178807d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:22:28.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.081+0000 7f179efbf640 1 --2- 172.21.15.3:0/2518768699 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f178807b0b0 0x7f178807d570 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f1784005fd0 tx=0x7f1784005850 comp rx=0 tx=0).stop 2024-09-21T12:22:28.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.081+0000 7f179efbf640 1 -- 172.21.15.3:0/2518768699 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1798100860 msgr2=0x7f1798104780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:22:28.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.081+0000 7f179efbf640 1 --2- 172.21.15.3:0/2518768699 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1798100860 0x7f1798104780 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f178c006010 tx=0x7f178c0045e0 comp rx=0 tx=0).stop 2024-09-21T12:22:28.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.081+0000 7f179efbf640 1 -- 172.21.15.3:0/2518768699 shutdown_connections 2024-09-21T12:22:28.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.081+0000 7f179efbf640 1 --2- 172.21.15.3:0/2518768699 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f178807b0b0 0x7f178807d570 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:22:28.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.081+0000 7f179efbf640 1 --2- 172.21.15.3:0/2518768699 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1798101a60 0x7f1798102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:22:28.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.081+0000 7f179efbf640 1 --2- 172.21.15.3:0/2518768699 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1798100860 0x7f1798104780 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:22:28.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.081+0000 7f179efbf640 1 -- 172.21.15.3:0/2518768699 >> 172.21.15.3:0/2518768699 conn(0x7f17980fc010 msgr2=0x7f179806a200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:22:28.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.082+0000 7f179efbf640 1 -- 172.21.15.3:0/2518768699 shutdown_connections 2024-09-21T12:22:28.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.082+0000 7f179efbf640 1 -- 172.21.15.3:0/2518768699 wait complete. 2024-09-21T12:22:28.167 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.164+0000 7f1db595b640 1 -- 172.21.15.3:0/628973055 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1db0102b60 msgr2=0x7f1db0102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:22:28.167 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.164+0000 7f1db595b640 1 --2- 172.21.15.3:0/628973055 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1db0102b60 0x7f1db0102fe0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f1da4009880 tx=0x7f1da402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:22:28.167 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.165+0000 7f1db595b640 1 -- 172.21.15.3:0/628973055 shutdown_connections 2024-09-21T12:22:28.167 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.165+0000 7f1db595b640 1 --2- 172.21.15.3:0/628973055 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1db0102b60 0x7f1db0102fe0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:22:28.167 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.165+0000 7f1db595b640 1 --2- 172.21.15.3:0/628973055 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1db0101960 0x7f1db0101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:22:28.167 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.165+0000 7f1db595b640 1 -- 172.21.15.3:0/628973055 >> 172.21.15.3:0/628973055 conn(0x7f1db00fd0f0 msgr2=0x7f1db00ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:22:28.167 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.165+0000 7f1db595b640 1 -- 172.21.15.3:0/628973055 shutdown_connections 2024-09-21T12:22:28.167 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.165+0000 7f1db595b640 1 -- 172.21.15.3:0/628973055 wait complete. 2024-09-21T12:22:28.167 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.165+0000 7f1db595b640 1 Processor -- start 2024-09-21T12:22:28.168 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.165+0000 7f1db595b640 1 -- start start 2024-09-21T12:22:28.169 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.166+0000 7f1db595b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1db0101960 0x7f1db01996a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:22:28.169 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.166+0000 7f1db595b640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1db0102b60 0x7f1db0199be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:22:28.169 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.166+0000 7f1db595b640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f1db010a780 con 0x7f1db0102b60 2024-09-21T12:22:28.169 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.166+0000 7f1db595b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f1db010a600 con 0x7f1db0101960 2024-09-21T12:22:28.169 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.166+0000 7f1dae7fc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1db0102b60 0x7f1db0199be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:22:28.169 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.166+0000 7f1dae7fc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1db0102b60 0x7f1db0199be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41324/0 (socket says 172.21.15.3:41324) 2024-09-21T12:22:28.169 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.166+0000 7f1dae7fc640 1 -- 172.21.15.3:0/733660778 learned_addr learned my addr 172.21.15.3:0/733660778 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:22:28.169 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.166+0000 7f1daeffd640 1 --2- 172.21.15.3:0/733660778 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1db0101960 0x7f1db01996a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:22:28.169 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.166+0000 7f1dae7fc640 1 -- 172.21.15.3:0/733660778 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1db0101960 msgr2=0x7f1db01996a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:22:28.169 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.166+0000 7f1dae7fc640 1 --2- 172.21.15.3:0/733660778 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1db0101960 0x7f1db01996a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:22:28.170 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.166+0000 7f1dae7fc640 1 -- 172.21.15.3:0/733660778 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1db019a260 con 0x7f1db0102b60 2024-09-21T12:22:28.170 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.166+0000 7f1dae7fc640 1 --2- 172.21.15.3:0/733660778 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1db0102b60 0x7f1db0199be0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f1da4006010 tx=0x7f1da40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:22:28.170 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.166+0000 7f1db4959640 1 -- 172.21.15.3:0/733660778 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1da403f070 con 0x7f1db0102b60 2024-09-21T12:22:28.170 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.167+0000 7f1db595b640 1 -- 172.21.15.3:0/733660778 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1db019ec40 con 0x7f1db0102b60 2024-09-21T12:22:28.170 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.167+0000 7f1db4959640 1 -- 172.21.15.3:0/733660778 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1da4004ac0 con 0x7f1db0102b60 2024-09-21T12:22:28.170 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.167+0000 7f1db4959640 1 -- 172.21.15.3:0/733660778 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1da4035030 con 0x7f1db0102b60 2024-09-21T12:22:28.170 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.167+0000 7f1db595b640 1 -- 172.21.15.3:0/733660778 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1db019f180 con 0x7f1db0102b60 2024-09-21T12:22:28.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.168+0000 7f1db595b640 1 -- 172.21.15.3:0/733660778 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1db0101d60 con 0x7f1db0102b60 2024-09-21T12:22:28.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.168+0000 7f1db4959640 1 -- 172.21.15.3:0/733660778 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 31) ==== 103420+0+0 (secure 0 0 0) 0x7f1da4042070 con 0x7f1db0102b60 2024-09-21T12:22:28.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.169+0000 7f1db4959640 1 --2- 172.21.15.3:0/733660778 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f1d9807b0b0 0x7f1d9807d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:22:28.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.169+0000 7f1db4959640 1 -- 172.21.15.3:0/733660778 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6156+0+0 (secure 0 0 0) 0x7f1da40bed40 con 0x7f1db0102b60 2024-09-21T12:22:28.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.169+0000 7f1daeffd640 1 --2- 172.21.15.3:0/733660778 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f1d9807b0b0 0x7f1d9807d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:22:28.171 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.170+0000 7f1daeffd640 1 --2- 172.21.15.3:0/733660778 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f1d9807b0b0 0x7f1d9807d570 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1db01029c0 tx=0x7f1da000b390 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:22:28.175 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.174+0000 7f1db4959640 1 -- 172.21.15.3:0/733660778 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f1da408a1a0 con 0x7f1db0102b60 2024-09-21T12:22:28.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:28 smithi003 ceph-mon[28057]: from='client.14808 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:22:28.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:28 smithi003 ceph-mon[28057]: from='client.14812 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:22:28.441 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.440+0000 7f1db595b640 1 -- 172.21.15.3:0/733660778 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f1db019f630 con 0x7f1db0102b60 2024-09-21T12:22:28.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.440+0000 7f1db4959640 1 -- 172.21.15.3:0/733660778 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7f1da408f050 con 0x7f1db0102b60 2024-09-21T12:22:28.442 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-21T12:22:28.442 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": { 2024-09-21T12:22:28.442 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2 2024-09-21T12:22:28.443 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:22:28.443 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": { 2024-09-21T12:22:28.443 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:22:28.443 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:22:28.443 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": { 2024-09-21T12:22:28.443 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 6 2024-09-21T12:22:28.443 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:22:28.443 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": { 2024-09-21T12:22:28.443 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 4 2024-09-21T12:22:28.443 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:22:28.443 INFO:teuthology.orchestra.run.smithi003.stdout: "overall": { 2024-09-21T12:22:28.443 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 12, 2024-09-21T12:22:28.443 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:22:28.443 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-21T12:22:28.443 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-21T12:22:28.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.442+0000 7f1db595b640 1 -- 172.21.15.3:0/733660778 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f1d9807b0b0 msgr2=0x7f1d9807d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:22:28.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.442+0000 7f1db595b640 1 --2- 172.21.15.3:0/733660778 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f1d9807b0b0 0x7f1d9807d570 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1db01029c0 tx=0x7f1da000b390 comp rx=0 tx=0).stop 2024-09-21T12:22:28.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.442+0000 7f1db595b640 1 -- 172.21.15.3:0/733660778 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1db0102b60 msgr2=0x7f1db0199be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:22:28.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.442+0000 7f1db595b640 1 --2- 172.21.15.3:0/733660778 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1db0102b60 0x7f1db0199be0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f1da4006010 tx=0x7f1da40046c0 comp rx=0 tx=0).stop 2024-09-21T12:22:28.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.442+0000 7f1db595b640 1 -- 172.21.15.3:0/733660778 shutdown_connections 2024-09-21T12:22:28.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.442+0000 7f1db595b640 1 --2- 172.21.15.3:0/733660778 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f1d9807b0b0 0x7f1d9807d570 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:22:28.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.443+0000 7f1db595b640 1 --2- 172.21.15.3:0/733660778 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1db0102b60 0x7f1db0199be0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:22:28.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.443+0000 7f1db595b640 1 --2- 172.21.15.3:0/733660778 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1db0101960 0x7f1db01996a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:22:28.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.443+0000 7f1db595b640 1 -- 172.21.15.3:0/733660778 >> 172.21.15.3:0/733660778 conn(0x7f1db00fd0f0 msgr2=0x7f1db0074660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:22:28.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.443+0000 7f1db595b640 1 -- 172.21.15.3:0/733660778 shutdown_connections 2024-09-21T12:22:28.445 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.443+0000 7f1db595b640 1 -- 172.21.15.3:0/733660778 wait complete. 2024-09-21T12:22:28.474 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:28 smithi192 ceph-mon[35641]: from='client.14808 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:22:28.474 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:28 smithi192 ceph-mon[35641]: from='client.14812 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:22:28.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.528+0000 7f3723a68640 1 -- 172.21.15.3:0/2542823783 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f371c104d20 msgr2=0x7f371c107110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:22:28.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.528+0000 7f3723a68640 1 --2- 172.21.15.3:0/2542823783 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f371c104d20 0x7f371c107110 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f37100098b0 tx=0x7f371002a4d0 comp rx=0 tx=0).stop 2024-09-21T12:22:28.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.528+0000 7f3723a68640 1 -- 172.21.15.3:0/2542823783 shutdown_connections 2024-09-21T12:22:28.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.528+0000 7f3723a68640 1 --2- 172.21.15.3:0/2542823783 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f371c104d20 0x7f371c107110 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:22:28.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.528+0000 7f3723a68640 1 --2- 172.21.15.3:0/2542823783 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f371c1023f0 0x7f371c1047e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:22:28.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.528+0000 7f3723a68640 1 -- 172.21.15.3:0/2542823783 >> 172.21.15.3:0/2542823783 conn(0x7f371c0fc010 msgr2=0x7f371c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:22:28.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.528+0000 7f3723a68640 1 -- 172.21.15.3:0/2542823783 shutdown_connections 2024-09-21T12:22:28.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.528+0000 7f3723a68640 1 -- 172.21.15.3:0/2542823783 wait complete. 2024-09-21T12:22:28.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.528+0000 7f3723a68640 1 Processor -- start 2024-09-21T12:22:28.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.528+0000 7f3723a68640 1 -- start start 2024-09-21T12:22:28.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.529+0000 7f3723a68640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f371c1023f0 0x7f371c197530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:22:28.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.529+0000 7f3723a68640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f371c104d20 0x7f371c197a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:22:28.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.529+0000 7f3723a68640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f371c10a7b0 con 0x7f371c104d20 2024-09-21T12:22:28.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.529+0000 7f3723a68640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f371c10a630 con 0x7f371c1023f0 2024-09-21T12:22:28.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.529+0000 7f3721003640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f371c104d20 0x7f371c197a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:22:28.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.529+0000 7f3721003640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f371c104d20 0x7f371c197a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41328/0 (socket says 172.21.15.3:41328) 2024-09-21T12:22:28.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.529+0000 7f3721003640 1 -- 172.21.15.3:0/3279743782 learned_addr learned my addr 172.21.15.3:0/3279743782 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:22:28.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.529+0000 7f3721804640 1 --2- 172.21.15.3:0/3279743782 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f371c1023f0 0x7f371c197530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:22:28.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.529+0000 7f3721003640 1 -- 172.21.15.3:0/3279743782 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f371c1023f0 msgr2=0x7f371c197530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:22:28.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.529+0000 7f3721003640 1 --2- 172.21.15.3:0/3279743782 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f371c1023f0 0x7f371c197530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:22:28.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.529+0000 7f3721003640 1 -- 172.21.15.3:0/3279743782 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f371c1980f0 con 0x7f371c104d20 2024-09-21T12:22:28.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.529+0000 7f3721003640 1 --2- 172.21.15.3:0/3279743782 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f371c104d20 0x7f371c197a70 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f3710009230 tx=0x7f37100045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:22:28.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.529+0000 7f371affd640 1 -- 172.21.15.3:0/3279743782 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f371003f070 con 0x7f371c104d20 2024-09-21T12:22:28.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.529+0000 7f3723a68640 1 -- 172.21.15.3:0/3279743782 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f371c19cad0 con 0x7f371c104d20 2024-09-21T12:22:28.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.530+0000 7f371affd640 1 -- 172.21.15.3:0/3279743782 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f37100049d0 con 0x7f371c104d20 2024-09-21T12:22:28.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.530+0000 7f371affd640 1 -- 172.21.15.3:0/3279743782 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3710035030 con 0x7f371c104d20 2024-09-21T12:22:28.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.530+0000 7f3723a68640 1 -- 172.21.15.3:0/3279743782 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f371c19d060 con 0x7f371c104d20 2024-09-21T12:22:28.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.531+0000 7f3723a68640 1 -- 172.21.15.3:0/3279743782 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f371c1027d0 con 0x7f371c104d20 2024-09-21T12:22:28.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.531+0000 7f371affd640 1 -- 172.21.15.3:0/3279743782 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 31) ==== 103420+0+0 (secure 0 0 0) 0x7f3710042070 con 0x7f371c104d20 2024-09-21T12:22:28.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.532+0000 7f371affd640 1 --2- 172.21.15.3:0/3279743782 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f370407b050 0x7f370407d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:22:28.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.532+0000 7f371affd640 1 -- 172.21.15.3:0/3279743782 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6156+0+0 (secure 0 0 0) 0x7f37100beca0 con 0x7f371c104d20 2024-09-21T12:22:28.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.532+0000 7f3721804640 1 --2- 172.21.15.3:0/3279743782 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f370407b050 0x7f370407d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:22:28.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.532+0000 7f3721804640 1 --2- 172.21.15.3:0/3279743782 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f370407b050 0x7f370407d510 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3714009bd0 tx=0x7f3714005f90 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:22:28.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.536+0000 7f371affd640 1 -- 172.21.15.3:0/3279743782 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f37100c3070 con 0x7f371c104d20 2024-09-21T12:22:28.744 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.742+0000 7f3723a68640 1 -- 172.21.15.3:0/3279743782 --> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f371c105780 con 0x7f370407b050 2024-09-21T12:22:28.745 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.743+0000 7f371affd640 1 -- 172.21.15.3:0/3279743782 <== mgr.14756 v2:172.21.15.3:6800/1284098095 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+360 (secure 0 0 0) 0x7f371c105780 con 0x7f370407b050 2024-09-21T12:22:28.745 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-21T12:22:28.745 INFO:teuthology.orchestra.run.smithi003.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T12:22:28.745 INFO:teuthology.orchestra.run.smithi003.stdout: "in_progress": true, 2024-09-21T12:22:28.745 INFO:teuthology.orchestra.run.smithi003.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-21T12:22:28.745 INFO:teuthology.orchestra.run.smithi003.stdout: "services_complete": [ 2024-09-21T12:22:28.745 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr" 2024-09-21T12:22:28.745 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-21T12:22:28.745 INFO:teuthology.orchestra.run.smithi003.stdout: "progress": "2/2 daemons upgraded", 2024-09-21T12:22:28.745 INFO:teuthology.orchestra.run.smithi003.stdout: "message": "Currently upgrading mgr daemons", 2024-09-21T12:22:28.745 INFO:teuthology.orchestra.run.smithi003.stdout: "is_paused": false 2024-09-21T12:22:28.745 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-21T12:22:28.747 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.745+0000 7f3723a68640 1 -- 172.21.15.3:0/3279743782 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f370407b050 msgr2=0x7f370407d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:22:28.747 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.745+0000 7f3723a68640 1 --2- 172.21.15.3:0/3279743782 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f370407b050 0x7f370407d510 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3714009bd0 tx=0x7f3714005f90 comp rx=0 tx=0).stop 2024-09-21T12:22:28.747 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.745+0000 7f3723a68640 1 -- 172.21.15.3:0/3279743782 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f371c104d20 msgr2=0x7f371c197a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:22:28.747 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.745+0000 7f3723a68640 1 --2- 172.21.15.3:0/3279743782 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f371c104d20 0x7f371c197a70 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f3710009230 tx=0x7f37100045e0 comp rx=0 tx=0).stop 2024-09-21T12:22:28.747 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.745+0000 7f3723a68640 1 -- 172.21.15.3:0/3279743782 shutdown_connections 2024-09-21T12:22:28.747 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.745+0000 7f3723a68640 1 --2- 172.21.15.3:0/3279743782 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f370407b050 0x7f370407d510 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:22:28.748 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.745+0000 7f3723a68640 1 --2- 172.21.15.3:0/3279743782 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f371c104d20 0x7f371c197a70 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:22:28.748 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.745+0000 7f3723a68640 1 --2- 172.21.15.3:0/3279743782 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f371c1023f0 0x7f371c197530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:22:28.748 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.745+0000 7f3723a68640 1 -- 172.21.15.3:0/3279743782 >> 172.21.15.3:0/3279743782 conn(0x7f371c0fc010 msgr2=0x7f371c0fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:22:28.748 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.745+0000 7f3723a68640 1 -- 172.21.15.3:0/3279743782 shutdown_connections 2024-09-21T12:22:28.748 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:28.746+0000 7f3723a68640 1 -- 172.21.15.3:0/3279743782 wait complete. 2024-09-21T12:22:29.183 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:29 smithi192 ceph-mon[35641]: from='client.14816 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:22:29.183 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:29 smithi192 ceph-mon[35641]: from='client.? 172.21.15.3:0/733660778' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:22:29.183 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:29 smithi192 ceph-mon[35641]: from='client.14824 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:22:29.183 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:29 smithi192 ceph-mon[35641]: pgmap v18: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 19 KiB/s rd, 605 KiB/s wr, 110 op/s 2024-09-21T12:22:29.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:29 smithi003 ceph-mon[28057]: from='client.14816 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:22:29.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:29 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/733660778' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:22:29.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:29 smithi003 ceph-mon[28057]: from='client.14824 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:22:29.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:29 smithi003 ceph-mon[28057]: pgmap v18: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 19 KiB/s rd, 605 KiB/s wr, 110 op/s 2024-09-21T12:22:30.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:30 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:30.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:30 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:30.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:30 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:22:30.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:30 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:22:30.652 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:30 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:30.652 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:30 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:30.652 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:30 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:22:30.652 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:30 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:22:31.654 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:31 smithi192 ceph-mon[35641]: pgmap v19: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 19 KiB/s rd, 605 KiB/s wr, 110 op/s 2024-09-21T12:22:31.813 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:31 smithi003 ceph-mon[28057]: pgmap v19: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 19 KiB/s rd, 605 KiB/s wr, 110 op/s 2024-09-21T12:22:33.747 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:33 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:33.747 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:33 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:33.747 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:33 smithi192 ceph-mon[35641]: pgmap v20: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 7.2 KiB/s rd, 104 KiB/s wr, 33 op/s 2024-09-21T12:22:33.747 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:33 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:33.747 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:33 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:33.778 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:33 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:33.778 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:33 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:33.778 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:33 smithi003 ceph-mon[28057]: pgmap v20: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 7.2 KiB/s rd, 104 KiB/s wr, 33 op/s 2024-09-21T12:22:33.778 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:33 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:33.779 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:33 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:34.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:34 smithi192 ceph-mon[35641]: Standby manager daemon smithi192.qsaprd restarted 2024-09-21T12:22:34.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:34 smithi192 ceph-mon[35641]: Standby manager daemon smithi192.qsaprd started 2024-09-21T12:22:34.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:34 smithi192 ceph-mon[35641]: from='mgr.? 172.21.15.192:0/3792888873' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi192.qsaprd/crt"}]: dispatch 2024-09-21T12:22:34.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:34 smithi192 ceph-mon[35641]: from='mgr.? 172.21.15.192:0/3792888873' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T12:22:34.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:34 smithi192 ceph-mon[35641]: from='mgr.? 172.21.15.192:0/3792888873' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi192.qsaprd/key"}]: dispatch 2024-09-21T12:22:34.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:34 smithi192 ceph-mon[35641]: from='mgr.? 172.21.15.192:0/3792888873' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T12:22:34.764 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:34 smithi003 ceph-mon[28057]: Standby manager daemon smithi192.qsaprd restarted 2024-09-21T12:22:34.764 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:34 smithi003 ceph-mon[28057]: Standby manager daemon smithi192.qsaprd started 2024-09-21T12:22:34.764 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:34 smithi003 ceph-mon[28057]: from='mgr.? 172.21.15.192:0/3792888873' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi192.qsaprd/crt"}]: dispatch 2024-09-21T12:22:34.764 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:34 smithi003 ceph-mon[28057]: from='mgr.? 172.21.15.192:0/3792888873' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-21T12:22:34.764 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:34 smithi003 ceph-mon[28057]: from='mgr.? 172.21.15.192:0/3792888873' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi192.qsaprd/key"}]: dispatch 2024-09-21T12:22:34.764 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:34 smithi003 ceph-mon[28057]: from='mgr.? 172.21.15.192:0/3792888873' entity='mgr.smithi192.qsaprd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-21T12:22:35.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:35 smithi003 ceph-mon[28057]: mgrmap e32: smithi003.wztftl(active, since 35s), standbys: smithi192.qsaprd 2024-09-21T12:22:35.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:35 smithi003 ceph-mon[28057]: pgmap v21: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 7.2 KiB/s rd, 104 KiB/s wr, 33 op/s 2024-09-21T12:22:35.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:35 smithi192 ceph-mon[35641]: mgrmap e32: smithi003.wztftl(active, since 35s), standbys: smithi192.qsaprd 2024-09-21T12:22:35.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:35 smithi192 ceph-mon[35641]: pgmap v21: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 7.2 KiB/s rd, 104 KiB/s wr, 33 op/s 2024-09-21T12:22:37.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:37 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:37.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:37 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:37.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:37 smithi003 ceph-mon[28057]: pgmap v22: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 28 KiB/s wr, 20 op/s 2024-09-21T12:22:37.872 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:37 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:37.872 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:37 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:37.872 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:37 smithi192 ceph-mon[35641]: pgmap v22: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 28 KiB/s wr, 20 op/s 2024-09-21T12:22:39.254 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:39 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:39.254 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:39 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:39.255 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:39 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:22:39.255 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:39 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:22:39.255 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:39 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:39.255 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:39 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:22:39.255 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:39 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:22:39.255 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:39 smithi003 ceph-mon[28057]: Upgrade: Setting container_image for all mgr 2024-09-21T12:22:39.255 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:39 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:39.255 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:39 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi003.wztftl"}]: dispatch 2024-09-21T12:22:39.255 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:39 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi003.wztftl"}]: dispatch 2024-09-21T12:22:39.255 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:39 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi003.wztftl"}]': finished 2024-09-21T12:22:39.255 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:39 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi192.qsaprd"}]: dispatch 2024-09-21T12:22:39.255 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:39 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi192.qsaprd"}]: dispatch 2024-09-21T12:22:39.255 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:39 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi192.qsaprd"}]': finished 2024-09-21T12:22:39.256 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:39 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:22:39.256 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:39 smithi003 ceph-mon[28057]: Upgrade: Setting container_image for all rgw 2024-09-21T12:22:39.256 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:39 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:39.256 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:39 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:22:39.256 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:39 smithi003 ceph-mon[28057]: Upgrade: Setting container_image for all rbd-mirror 2024-09-21T12:22:39.256 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:39 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:39.256 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:39 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:22:39.256 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:39 smithi003 ceph-mon[28057]: Upgrade: Setting container_image for all cephfs-mirror 2024-09-21T12:22:39.256 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:39 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:39.256 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:39 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:22:39.256 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:39 smithi003 ceph-mon[28057]: Upgrade: Setting container_image for all iscsi 2024-09-21T12:22:39.256 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:39 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:39.256 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:39 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:22:39.256 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:39 smithi003 ceph-mon[28057]: Upgrade: Setting container_image for all nfs 2024-09-21T12:22:39.256 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:39 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:39.256 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:39 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:22:39.257 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:39 smithi003 ceph-mon[28057]: Upgrade: Setting container_image for all nvmeof 2024-09-21T12:22:39.257 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:39 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:39.257 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:39 smithi003 ceph-mon[28057]: pgmap v23: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-21T12:22:39.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:39 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:39.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:39 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:39.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:39 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:22:39.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:39 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:22:39.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:39 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:39.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:39 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:22:39.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:39 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:22:39.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:39 smithi192 ceph-mon[35641]: Upgrade: Setting container_image for all mgr 2024-09-21T12:22:39.509 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:39 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:39.509 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:39 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi003.wztftl"}]: dispatch 2024-09-21T12:22:39.509 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:39 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi003.wztftl"}]: dispatch 2024-09-21T12:22:39.509 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:39 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi003.wztftl"}]': finished 2024-09-21T12:22:39.509 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:39 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi192.qsaprd"}]: dispatch 2024-09-21T12:22:39.509 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:39 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi192.qsaprd"}]: dispatch 2024-09-21T12:22:39.509 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:39 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi192.qsaprd"}]': finished 2024-09-21T12:22:39.509 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:39 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:22:39.509 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:39 smithi192 ceph-mon[35641]: Upgrade: Setting container_image for all rgw 2024-09-21T12:22:39.509 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:39 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:39.509 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:39 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:22:39.509 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:39 smithi192 ceph-mon[35641]: Upgrade: Setting container_image for all rbd-mirror 2024-09-21T12:22:39.509 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:39 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:39.509 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:39 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:22:39.510 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:39 smithi192 ceph-mon[35641]: Upgrade: Setting container_image for all cephfs-mirror 2024-09-21T12:22:39.510 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:39 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:39.510 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:39 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:22:39.510 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:39 smithi192 ceph-mon[35641]: Upgrade: Setting container_image for all iscsi 2024-09-21T12:22:39.510 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:39 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:39.510 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:39 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:22:39.510 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:39 smithi192 ceph-mon[35641]: Upgrade: Setting container_image for all nfs 2024-09-21T12:22:39.510 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:39 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:39.510 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:39 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:22:39.510 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:39 smithi192 ceph-mon[35641]: Upgrade: Setting container_image for all nvmeof 2024-09-21T12:22:39.510 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:39 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:39.511 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:39 smithi192 ceph-mon[35641]: pgmap v23: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-21T12:22:40.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:40 smithi003 ceph-mon[28057]: Upgrade: Updating node-exporter.smithi003 (1/2) 2024-09-21T12:22:40.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:40 smithi003 ceph-mon[28057]: Deploying daemon node-exporter.smithi003 on smithi003 2024-09-21T12:22:40.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:40 smithi192 ceph-mon[35641]: Upgrade: Updating node-exporter.smithi003 (1/2) 2024-09-21T12:22:40.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:40 smithi192 ceph-mon[35641]: Deploying daemon node-exporter.smithi003 on smithi003 2024-09-21T12:22:41.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:41 smithi003 ceph-mon[28057]: pgmap v24: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-21T12:22:41.732 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:41 smithi192 ceph-mon[35641]: pgmap v24: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-21T12:22:44.068 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:43 smithi003 ceph-mon[28057]: pgmap v25: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:44.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:43 smithi192 ceph-mon[35641]: pgmap v25: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:46.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:45 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:46.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:45 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:46.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:45 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:22:46.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:45 smithi192 ceph-mon[35641]: pgmap v26: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:46.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:45 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:46.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:45 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:46.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:45 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:22:46.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:45 smithi003 ceph-mon[28057]: pgmap v26: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:48.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:47 smithi192 ceph-mon[35641]: Upgrade: Updating node-exporter.smithi192 (2/2) 2024-09-21T12:22:48.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:47 smithi192 ceph-mon[35641]: Deploying daemon node-exporter.smithi192 on smithi192 2024-09-21T12:22:48.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:47 smithi192 ceph-mon[35641]: pgmap v27: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:48.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:47 smithi003 ceph-mon[28057]: Upgrade: Updating node-exporter.smithi192 (2/2) 2024-09-21T12:22:48.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:47 smithi003 ceph-mon[28057]: Deploying daemon node-exporter.smithi192 on smithi192 2024-09-21T12:22:48.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:47 smithi003 ceph-mon[28057]: pgmap v27: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:50.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:49 smithi192 ceph-mon[35641]: pgmap v28: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:50.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:49 smithi003 ceph-mon[28057]: pgmap v28: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:51.999 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:51 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:51.999 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:51 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:51.999 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:51 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:22:51.999 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:51 smithi003 ceph-mon[28057]: pgmap v29: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:52.000 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:51 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:52.000 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:51 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:52.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:51 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:52.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:51 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:52.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:51 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:22:52.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:51 smithi192 ceph-mon[35641]: pgmap v29: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:52.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:51 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:52.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:51 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:54.244 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:53 smithi003 ceph-mon[28057]: pgmap v30: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:54.245 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:53 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:54.245 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:53 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:54.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:53 smithi192 ceph-mon[35641]: pgmap v30: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:54.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:53 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:54.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:53 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:55.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:55 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:55.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:55 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:55.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:55 smithi003 ceph-mon[28057]: pgmap v31: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:55.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:55 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:55.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:55 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:55.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:55 smithi192 ceph-mon[35641]: pgmap v31: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:56.943 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:56 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:56.943 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:56 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:56.943 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:56 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:56.943 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:56 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:57.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:56 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:57.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:56 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:57.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:56 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:57.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:56 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:57.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:57 smithi192 ceph-mon[35641]: pgmap v32: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:57.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:57 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:57.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:57 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:57.982 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:57 smithi003 ceph-mon[28057]: pgmap v32: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:57.983 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:57 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:57.983 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:57 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:58.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:58.841+0000 7f44996b2640 1 -- 172.21.15.3:0/2093965927 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4494102b60 msgr2=0x7f4494102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:22:58.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:58.841+0000 7f44996b2640 1 --2- 172.21.15.3:0/2093965927 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4494102b60 0x7f4494102fe0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f447c009880 tx=0x7f447c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:22:58.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:58.841+0000 7f44996b2640 1 -- 172.21.15.3:0/2093965927 shutdown_connections 2024-09-21T12:22:58.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:58.841+0000 7f44996b2640 1 --2- 172.21.15.3:0/2093965927 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4494102b60 0x7f4494102fe0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:22:58.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:58.841+0000 7f44996b2640 1 --2- 172.21.15.3:0/2093965927 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4494101960 0x7f4494101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:22:58.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:58.841+0000 7f44996b2640 1 -- 172.21.15.3:0/2093965927 >> 172.21.15.3:0/2093965927 conn(0x7f44940fd0f0 msgr2=0x7f44940ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:22:58.843 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:58.841+0000 7f44996b2640 1 -- 172.21.15.3:0/2093965927 shutdown_connections 2024-09-21T12:22:58.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:58.841+0000 7f44996b2640 1 -- 172.21.15.3:0/2093965927 wait complete. 2024-09-21T12:22:58.844 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:58.841+0000 7f44996b2640 1 Processor -- start 2024-09-21T12:22:58.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:58.842+0000 7f44996b2640 1 -- start start 2024-09-21T12:22:58.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:58.842+0000 7f44996b2640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4494101960 0x7f4494075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:22:58.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:58.842+0000 7f44996b2640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4494102b60 0x7f44940745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:22:58.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:58.842+0000 7f44996b2640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f449410a780 con 0x7f4494102b60 2024-09-21T12:22:58.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:58.842+0000 7f44996b2640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f449410a600 con 0x7f4494101960 2024-09-21T12:22:58.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:58.842+0000 7f44927fc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4494102b60 0x7f44940745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:22:58.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:58.842+0000 7f44927fc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4494102b60 0x7f44940745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44144/0 (socket says 172.21.15.3:44144) 2024-09-21T12:22:58.845 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:58.842+0000 7f44927fc640 1 -- 172.21.15.3:0/2963963826 learned_addr learned my addr 172.21.15.3:0/2963963826 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:22:58.846 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:58.842+0000 7f4492ffd640 1 --2- 172.21.15.3:0/2963963826 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4494101960 0x7f4494075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:22:58.846 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:58.842+0000 7f44927fc640 1 -- 172.21.15.3:0/2963963826 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4494101960 msgr2=0x7f4494075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:22:58.846 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:58.842+0000 7f44927fc640 1 --2- 172.21.15.3:0/2963963826 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4494101960 0x7f4494075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:22:58.846 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:58.842+0000 7f44927fc640 1 -- 172.21.15.3:0/2963963826 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4494074b20 con 0x7f4494102b60 2024-09-21T12:22:58.846 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:58.843+0000 7f44927fc640 1 --2- 172.21.15.3:0/2963963826 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4494102b60 0x7f44940745e0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f447c006010 tx=0x7f447c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:22:58.846 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:58.843+0000 7f448bfff640 1 -- 172.21.15.3:0/2963963826 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f447c03f070 con 0x7f4494102b60 2024-09-21T12:22:58.846 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:58.843+0000 7f44996b2640 1 -- 172.21.15.3:0/2963963826 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4494074db0 con 0x7f4494102b60 2024-09-21T12:22:58.846 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:58.843+0000 7f448bfff640 1 -- 172.21.15.3:0/2963963826 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f447c004ac0 con 0x7f4494102b60 2024-09-21T12:22:58.846 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:58.843+0000 7f448bfff640 1 -- 172.21.15.3:0/2963963826 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f447c035030 con 0x7f4494102b60 2024-09-21T12:22:58.846 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:58.843+0000 7f44996b2640 1 -- 172.21.15.3:0/2963963826 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44940752e0 con 0x7f4494102b60 2024-09-21T12:22:58.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:58.844+0000 7f44996b2640 1 -- 172.21.15.3:0/2963963826 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4494101d60 con 0x7f4494102b60 2024-09-21T12:22:58.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:58.845+0000 7f448bfff640 1 -- 172.21.15.3:0/2963963826 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 32) ==== 103420+0+0 (secure 0 0 0) 0x7f447c042070 con 0x7f4494102b60 2024-09-21T12:22:58.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:58.845+0000 7f448bfff640 1 --2- 172.21.15.3:0/2963963826 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f448007b0b0 0x7f448007d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:22:58.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:58.845+0000 7f448bfff640 1 -- 172.21.15.3:0/2963963826 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6156+0+0 (secure 0 0 0) 0x7f447c0bedb0 con 0x7f4494102b60 2024-09-21T12:22:58.848 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:58.845+0000 7f4492ffd640 1 --2- 172.21.15.3:0/2963963826 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f448007b0b0 0x7f448007d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:22:58.848 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:58.846+0000 7f4492ffd640 1 --2- 172.21.15.3:0/2963963826 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f448007b0b0 0x7f448007d570 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f44941029c0 tx=0x7f448c00b390 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:22:58.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:58.850+0000 7f448bfff640 1 -- 172.21.15.3:0/2963963826 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f447c08a210 con 0x7f4494102b60 2024-09-21T12:22:59.059 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.057+0000 7f44996b2640 1 -- 172.21.15.3:0/2963963826 --> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f4494062630 con 0x7f448007b0b0 2024-09-21T12:22:59.059 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.058+0000 7f448bfff640 1 -- 172.21.15.3:0/2963963826 <== mgr.14756 v2:172.21.15.3:6800/1284098095 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+370 (secure 0 0 0) 0x7f4494062630 con 0x7f448007b0b0 2024-09-21T12:22:59.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.060+0000 7f44996b2640 1 -- 172.21.15.3:0/2963963826 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f448007b0b0 msgr2=0x7f448007d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:22:59.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.060+0000 7f44996b2640 1 --2- 172.21.15.3:0/2963963826 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f448007b0b0 0x7f448007d570 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f44941029c0 tx=0x7f448c00b390 comp rx=0 tx=0).stop 2024-09-21T12:22:59.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.060+0000 7f44996b2640 1 -- 172.21.15.3:0/2963963826 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4494102b60 msgr2=0x7f44940745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:22:59.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.060+0000 7f44996b2640 1 --2- 172.21.15.3:0/2963963826 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4494102b60 0x7f44940745e0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f447c006010 tx=0x7f447c0046c0 comp rx=0 tx=0).stop 2024-09-21T12:22:59.062 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.060+0000 7f44996b2640 1 -- 172.21.15.3:0/2963963826 shutdown_connections 2024-09-21T12:22:59.063 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.060+0000 7f44996b2640 1 --2- 172.21.15.3:0/2963963826 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f448007b0b0 0x7f448007d570 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:22:59.063 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.060+0000 7f44996b2640 1 --2- 172.21.15.3:0/2963963826 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4494102b60 0x7f44940745e0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:22:59.063 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.060+0000 7f44996b2640 1 --2- 172.21.15.3:0/2963963826 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4494101960 0x7f4494075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:22:59.063 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.060+0000 7f44996b2640 1 -- 172.21.15.3:0/2963963826 >> 172.21.15.3:0/2963963826 conn(0x7f44940fd0f0 msgr2=0x7f4494105fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:22:59.063 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.061+0000 7f44996b2640 1 -- 172.21.15.3:0/2963963826 shutdown_connections 2024-09-21T12:22:59.063 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.061+0000 7f44996b2640 1 -- 172.21.15.3:0/2963963826 wait complete. 2024-09-21T12:22:59.071 INFO:teuthology.orchestra.run.smithi003.stdout:true 2024-09-21T12:22:59.149 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.146+0000 7f98ea4a9640 1 -- 172.21.15.3:0/2248703992 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f98e4100860 msgr2=0x7f98e4100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:22:59.149 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.146+0000 7f98ea4a9640 1 --2- 172.21.15.3:0/2248703992 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f98e4100860 0x7f98e4100c60 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f98dc009c20 tx=0x7f98dc02a970 comp rx=0 tx=0).stop 2024-09-21T12:22:59.149 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.147+0000 7f98ea4a9640 1 -- 172.21.15.3:0/2248703992 shutdown_connections 2024-09-21T12:22:59.149 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.147+0000 7f98ea4a9640 1 --2- 172.21.15.3:0/2248703992 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f98e4101a60 0x7f98e4101ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:22:59.149 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.147+0000 7f98ea4a9640 1 --2- 172.21.15.3:0/2248703992 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f98e4100860 0x7f98e4100c60 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:22:59.149 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.147+0000 7f98ea4a9640 1 -- 172.21.15.3:0/2248703992 >> 172.21.15.3:0/2248703992 conn(0x7f98e40fc010 msgr2=0x7f98e40fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:22:59.149 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.147+0000 7f98ea4a9640 1 -- 172.21.15.3:0/2248703992 shutdown_connections 2024-09-21T12:22:59.149 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.147+0000 7f98ea4a9640 1 -- 172.21.15.3:0/2248703992 wait complete. 2024-09-21T12:22:59.149 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.147+0000 7f98ea4a9640 1 Processor -- start 2024-09-21T12:22:59.150 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.147+0000 7f98ea4a9640 1 -- start start 2024-09-21T12:22:59.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.148+0000 7f98ea4a9640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f98e4100860 0x7f98e406a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:22:59.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.148+0000 7f98ea4a9640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f98e4101a60 0x7f98e419c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:22:59.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.148+0000 7f98ea4a9640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f98e4109680 con 0x7f98e4101a60 2024-09-21T12:22:59.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.148+0000 7f98ea4a9640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f98e4109500 con 0x7f98e4100860 2024-09-21T12:22:59.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.148+0000 7f98e37fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f98e4101a60 0x7f98e419c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:22:59.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.148+0000 7f98e37fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f98e4101a60 0x7f98e419c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44162/0 (socket says 172.21.15.3:44162) 2024-09-21T12:22:59.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.148+0000 7f98e37fe640 1 -- 172.21.15.3:0/4048450739 learned_addr learned my addr 172.21.15.3:0/4048450739 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:22:59.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.148+0000 7f98e3fff640 1 --2- 172.21.15.3:0/4048450739 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f98e4100860 0x7f98e406a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:22:59.151 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.148+0000 7f98e37fe640 1 -- 172.21.15.3:0/4048450739 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f98e4100860 msgr2=0x7f98e406a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:22:59.152 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.148+0000 7f98e37fe640 1 --2- 172.21.15.3:0/4048450739 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f98e4100860 0x7f98e406a790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:22:59.152 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.148+0000 7f98e37fe640 1 -- 172.21.15.3:0/4048450739 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98e419c7c0 con 0x7f98e4101a60 2024-09-21T12:22:59.152 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.148+0000 7f98e37fe640 1 --2- 172.21.15.3:0/4048450739 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f98e4101a60 0x7f98e419c200 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f98d800d8d0 tx=0x7f98d800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:22:59.152 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.149+0000 7f98e17fa640 1 -- 172.21.15.3:0/4048450739 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f98d8017070 con 0x7f98e4101a60 2024-09-21T12:22:59.152 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.149+0000 7f98e17fa640 1 -- 172.21.15.3:0/4048450739 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f98d8010460 con 0x7f98e4101a60 2024-09-21T12:22:59.152 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.149+0000 7f98ea4a9640 1 -- 172.21.15.3:0/4048450739 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98e419cab0 con 0x7f98e4101a60 2024-09-21T12:22:59.152 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.149+0000 7f98e17fa640 1 -- 172.21.15.3:0/4048450739 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f98d800f5d0 con 0x7f98e4101a60 2024-09-21T12:22:59.152 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.149+0000 7f98ea4a9640 1 -- 172.21.15.3:0/4048450739 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98e419d0c0 con 0x7f98e4101a60 2024-09-21T12:22:59.153 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.150+0000 7f98ea4a9640 1 -- 172.21.15.3:0/4048450739 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98e4100c60 con 0x7f98e4101a60 2024-09-21T12:22:59.153 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.151+0000 7f98e17fa640 1 -- 172.21.15.3:0/4048450739 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 32) ==== 103420+0+0 (secure 0 0 0) 0x7f98d8009a30 con 0x7f98e4101a60 2024-09-21T12:22:59.153 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.151+0000 7f98e17fa640 1 --2- 172.21.15.3:0/4048450739 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f98cc07b050 0x7f98cc07d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:22:59.153 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.151+0000 7f98e17fa640 1 -- 172.21.15.3:0/4048450739 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6156+0+0 (secure 0 0 0) 0x7f98d809e100 con 0x7f98e4101a60 2024-09-21T12:22:59.153 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.151+0000 7f98e3fff640 1 --2- 172.21.15.3:0/4048450739 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f98cc07b050 0x7f98cc07d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:22:59.153 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.152+0000 7f98e3fff640 1 --2- 172.21.15.3:0/4048450739 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f98cc07b050 0x7f98cc07d510 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f98dc000f80 tx=0x7f98dc03c040 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:22:59.157 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.156+0000 7f98e17fa640 1 -- 172.21.15.3:0/4048450739 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f98d8069450 con 0x7f98e4101a60 2024-09-21T12:22:59.364 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.363+0000 7f98ea4a9640 1 -- 172.21.15.3:0/4048450739 --> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f98e4106010 con 0x7f98cc07b050 2024-09-21T12:22:59.365 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.364+0000 7f98e17fa640 1 -- 172.21.15.3:0/4048450739 <== mgr.14756 v2:172.21.15.3:6800/1284098095 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+370 (secure 0 0 0) 0x7f98e4106010 con 0x7f98cc07b050 2024-09-21T12:22:59.368 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.366+0000 7f98ea4a9640 1 -- 172.21.15.3:0/4048450739 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f98cc07b050 msgr2=0x7f98cc07d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:22:59.368 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.366+0000 7f98ea4a9640 1 --2- 172.21.15.3:0/4048450739 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f98cc07b050 0x7f98cc07d510 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f98dc000f80 tx=0x7f98dc03c040 comp rx=0 tx=0).stop 2024-09-21T12:22:59.368 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.366+0000 7f98ea4a9640 1 -- 172.21.15.3:0/4048450739 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f98e4101a60 msgr2=0x7f98e419c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:22:59.368 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.366+0000 7f98ea4a9640 1 --2- 172.21.15.3:0/4048450739 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f98e4101a60 0x7f98e419c200 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f98d800d8d0 tx=0x7f98d800dd90 comp rx=0 tx=0).stop 2024-09-21T12:22:59.368 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.366+0000 7f98ea4a9640 1 -- 172.21.15.3:0/4048450739 shutdown_connections 2024-09-21T12:22:59.368 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.366+0000 7f98ea4a9640 1 --2- 172.21.15.3:0/4048450739 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f98cc07b050 0x7f98cc07d510 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:22:59.368 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.366+0000 7f98ea4a9640 1 --2- 172.21.15.3:0/4048450739 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f98e4101a60 0x7f98e419c200 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:22:59.368 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.366+0000 7f98ea4a9640 1 --2- 172.21.15.3:0/4048450739 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f98e4100860 0x7f98e406a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:22:59.368 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.366+0000 7f98ea4a9640 1 -- 172.21.15.3:0/4048450739 >> 172.21.15.3:0/4048450739 conn(0x7f98e40fc010 msgr2=0x7f98e40fe230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:22:59.368 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.366+0000 7f98ea4a9640 1 -- 172.21.15.3:0/4048450739 shutdown_connections 2024-09-21T12:22:59.368 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.366+0000 7f98ea4a9640 1 -- 172.21.15.3:0/4048450739 wait complete. 2024-09-21T12:22:59.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.454+0000 7f0a90e99640 1 -- 172.21.15.3:0/1229223931 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0a8c101a60 msgr2=0x7f0a8c101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:22:59.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.454+0000 7f0a90e99640 1 --2- 172.21.15.3:0/1229223931 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0a8c101a60 0x7f0a8c101ee0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f0a80009880 tx=0x7f0a8002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:22:59.456 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.454+0000 7f0a90e99640 1 -- 172.21.15.3:0/1229223931 shutdown_connections 2024-09-21T12:22:59.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.454+0000 7f0a90e99640 1 --2- 172.21.15.3:0/1229223931 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0a8c101a60 0x7f0a8c101ee0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:22:59.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.454+0000 7f0a90e99640 1 --2- 172.21.15.3:0/1229223931 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a8c100860 0x7f0a8c100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:22:59.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.454+0000 7f0a90e99640 1 -- 172.21.15.3:0/1229223931 >> 172.21.15.3:0/1229223931 conn(0x7f0a8c0fc010 msgr2=0x7f0a8c0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:22:59.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.454+0000 7f0a90e99640 1 -- 172.21.15.3:0/1229223931 shutdown_connections 2024-09-21T12:22:59.457 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.454+0000 7f0a90e99640 1 -- 172.21.15.3:0/1229223931 wait complete. 2024-09-21T12:22:59.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.455+0000 7f0a90e99640 1 Processor -- start 2024-09-21T12:22:59.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.455+0000 7f0a90e99640 1 -- start start 2024-09-21T12:22:59.458 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.455+0000 7f0a90e99640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a8c100860 0x7f0a8c104780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:22:59.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.456+0000 7f0a90e99640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0a8c101a60 0x7f0a8c102e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:22:59.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.456+0000 7f0a90e99640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f0a8c1096a0 con 0x7f0a8c101a60 2024-09-21T12:22:59.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.456+0000 7f0a90e99640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0a8c109520 con 0x7f0a8c100860 2024-09-21T12:22:59.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.456+0000 7f0a89d9b640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0a8c101a60 0x7f0a8c102e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:22:59.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.456+0000 7f0a89d9b640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0a8c101a60 0x7f0a8c102e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44176/0 (socket says 172.21.15.3:44176) 2024-09-21T12:22:59.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.456+0000 7f0a89d9b640 1 -- 172.21.15.3:0/323037936 learned_addr learned my addr 172.21.15.3:0/323037936 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:22:59.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.456+0000 7f0a8a59c640 1 --2- 172.21.15.3:0/323037936 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a8c100860 0x7f0a8c104780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:22:59.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.456+0000 7f0a89d9b640 1 -- 172.21.15.3:0/323037936 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a8c100860 msgr2=0x7f0a8c104780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:22:59.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.456+0000 7f0a89d9b640 1 --2- 172.21.15.3:0/323037936 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a8c100860 0x7f0a8c104780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:22:59.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.456+0000 7f0a89d9b640 1 -- 172.21.15.3:0/323037936 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a8c103380 con 0x7f0a8c101a60 2024-09-21T12:22:59.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.456+0000 7f0a89d9b640 1 --2- 172.21.15.3:0/323037936 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0a8c101a60 0x7f0a8c102e40 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f0a80006010 tx=0x7f0a800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:22:59.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.456+0000 7f0a7b7fe640 1 -- 172.21.15.3:0/323037936 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0a8003f070 con 0x7f0a8c101a60 2024-09-21T12:22:59.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.456+0000 7f0a90e99640 1 -- 172.21.15.3:0/323037936 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a8c103610 con 0x7f0a8c101a60 2024-09-21T12:22:59.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.457+0000 7f0a7b7fe640 1 -- 172.21.15.3:0/323037936 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0a80004ac0 con 0x7f0a8c101a60 2024-09-21T12:22:59.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.457+0000 7f0a7b7fe640 1 -- 172.21.15.3:0/323037936 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0a80035030 con 0x7f0a8c101a60 2024-09-21T12:22:59.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.457+0000 7f0a90e99640 1 -- 172.21.15.3:0/323037936 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a8c103b40 con 0x7f0a8c101a60 2024-09-21T12:22:59.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.458+0000 7f0a90e99640 1 -- 172.21.15.3:0/323037936 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a8c100c60 con 0x7f0a8c101a60 2024-09-21T12:22:59.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.459+0000 7f0a7b7fe640 1 -- 172.21.15.3:0/323037936 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 32) ==== 103420+0+0 (secure 0 0 0) 0x7f0a80042070 con 0x7f0a8c101a60 2024-09-21T12:22:59.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.459+0000 7f0a7b7fe640 1 --2- 172.21.15.3:0/323037936 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f0a7407b0b0 0x7f0a7407d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:22:59.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.459+0000 7f0a7b7fe640 1 -- 172.21.15.3:0/323037936 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6156+0+0 (secure 0 0 0) 0x7f0a800bed90 con 0x7f0a8c101a60 2024-09-21T12:22:59.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.459+0000 7f0a8a59c640 1 --2- 172.21.15.3:0/323037936 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f0a7407b0b0 0x7f0a7407d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:22:59.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.460+0000 7f0a8a59c640 1 --2- 172.21.15.3:0/323037936 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f0a7407b0b0 0x7f0a7407d570 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c005fd0 tx=0x7f0a7c00b390 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:22:59.465 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.464+0000 7f0a7b7fe640 1 -- 172.21.15.3:0/323037936 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f0a8008a1f0 con 0x7f0a8c101a60 2024-09-21T12:22:59.668 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.667+0000 7f0a90e99640 1 -- 172.21.15.3:0/323037936 --> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f0a8c06a400 con 0x7f0a7407b0b0 2024-09-21T12:22:59.698 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.696+0000 7f0a7b7fe640 1 -- 172.21.15.3:0/323037936 <== mgr.14756 v2:172.21.15.3:6800/1284098095 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f0a8c06a400 con 0x7f0a7407b0b0 2024-09-21T12:22:59.698 INFO:teuthology.orchestra.run.smithi003.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:22:59.698 INFO:teuthology.orchestra.run.smithi003.stdout:alertmanager.smithi003 smithi003 *:9093,9094 running (9m) 4s ago 10m 25.8M - 0.25.0 c8568f914cd2 5c03f233277e 2024-09-21T12:22:59.698 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-exporter.smithi003 smithi003 running (113s) 4s ago 10m 8480k - 19.1.1-373-g4e45e6b4 164465d2334a 0c9ad60a4f5a 2024-09-21T12:22:59.698 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-exporter.smithi192 smithi192 running (103s) 5s ago 10m 8124k - 19.1.1-373-g4e45e6b4 164465d2334a d5be8a6e120f 2024-09-21T12:22:59.698 INFO:teuthology.orchestra.run.smithi003.stdout:crash.smithi003 smithi003 running (10m) 4s ago 10m 6899k - 19.1.1-373-g4e45e6b4 164465d2334a c63f209dc1dc 2024-09-21T12:22:59.698 INFO:teuthology.orchestra.run.smithi003.stdout:crash.smithi192 smithi192 running (10m) 5s ago 10m 6895k - 19.1.1-373-g4e45e6b4 164465d2334a cc70c9a7b2f7 2024-09-21T12:22:59.698 INFO:teuthology.orchestra.run.smithi003.stdout:grafana.smithi003 smithi003 *:3000 running (9m) 4s ago 10m 77.0M - 9.4.12 2bacad6d85d8 f504f60818f0 2024-09-21T12:22:59.698 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi003.ebjgyl smithi003 running (5m) 4s ago 5m 14.9M - 19.1.1-373-g4e45e6b4 164465d2334a 16e0b2cac16a 2024-09-21T12:22:59.699 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi003.gfkngj smithi003 running (5m) 4s ago 5m 144M - 19.1.1-373-g4e45e6b4 164465d2334a 109c04f87fbd 2024-09-21T12:22:59.699 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi192.ktdqns smithi192 running (5m) 5s ago 5m 16.7M - 19.1.1-373-g4e45e6b4 164465d2334a 495c73fb3bb0 2024-09-21T12:22:59.699 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi192.ywqqxe smithi192 running (5m) 5s ago 5m 16.7M - 19.1.1-373-g4e45e6b4 164465d2334a 270a01030cbe 2024-09-21T12:22:59.699 INFO:teuthology.orchestra.run.smithi003.stdout:mgr.smithi003.wztftl smithi003 *:8443,9283,8765 running (92s) 4s ago 11m 508M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 8ce0e66fd369 2024-09-21T12:22:59.699 INFO:teuthology.orchestra.run.smithi003.stdout:mgr.smithi192.qsaprd smithi192 *:8443,9283,8765 running (30s) 5s ago 9m 455M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 002a6171dd47 2024-09-21T12:22:59.699 INFO:teuthology.orchestra.run.smithi003.stdout:mon.smithi003 smithi003 running (11m) 4s ago 12m 56.9M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 16bccf2c7503 2024-09-21T12:22:59.699 INFO:teuthology.orchestra.run.smithi003.stdout:mon.smithi192 smithi192 running (9m) 5s ago 9m 43.1M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 4fe4c4b3dc5d 2024-09-21T12:22:59.699 INFO:teuthology.orchestra.run.smithi003.stdout:node-exporter.smithi003 smithi003 *:9100 running (15s) 4s ago 10m 8074k - 1.7.0 72c9c2088986 d9cb7ede9060 2024-09-21T12:22:59.699 INFO:teuthology.orchestra.run.smithi003.stdout:node-exporter.smithi192 smithi192 *:9100 running (9s) 5s ago 9m 3343k - 1.7.0 72c9c2088986 d8ec0acfce7e 2024-09-21T12:22:59.699 INFO:teuthology.orchestra.run.smithi003.stdout:osd.0 smithi003 running (8m) 4s ago 8m 200M 1217M 19.1.1-373-g4e45e6b4 164465d2334a d07f1489720d 2024-09-21T12:22:59.699 INFO:teuthology.orchestra.run.smithi003.stdout:osd.1 smithi003 running (8m) 4s ago 8m 209M 1217M 19.1.1-373-g4e45e6b4 164465d2334a 6abd75a07645 2024-09-21T12:22:59.699 INFO:teuthology.orchestra.run.smithi003.stdout:osd.2 smithi003 running (7m) 4s ago 7m 172M 1217M 19.1.1-373-g4e45e6b4 164465d2334a 3265369e573b 2024-09-21T12:22:59.699 INFO:teuthology.orchestra.run.smithi003.stdout:osd.3 smithi192 running (7m) 5s ago 7m 237M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 13efcfd71c05 2024-09-21T12:22:59.699 INFO:teuthology.orchestra.run.smithi003.stdout:osd.4 smithi192 running (6m) 5s ago 6m 202M 2240M 19.1.1-373-g4e45e6b4 164465d2334a f33bf453cb3e 2024-09-21T12:22:59.699 INFO:teuthology.orchestra.run.smithi003.stdout:osd.5 smithi192 running (6m) 5s ago 6m 180M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 12d7b7c8e985 2024-09-21T12:22:59.700 INFO:teuthology.orchestra.run.smithi003.stdout:prometheus.smithi003 smithi003 *:9095 running (36s) 4s ago 10m 51.6M - 2.43.0 a07b618ecd1d 33f6a0a4fd12 2024-09-21T12:22:59.700 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.698+0000 7f0a90e99640 1 -- 172.21.15.3:0/323037936 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f0a7407b0b0 msgr2=0x7f0a7407d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:22:59.700 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.698+0000 7f0a90e99640 1 --2- 172.21.15.3:0/323037936 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f0a7407b0b0 0x7f0a7407d570 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c005fd0 tx=0x7f0a7c00b390 comp rx=0 tx=0).stop 2024-09-21T12:22:59.700 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.698+0000 7f0a90e99640 1 -- 172.21.15.3:0/323037936 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0a8c101a60 msgr2=0x7f0a8c102e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:22:59.700 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.698+0000 7f0a90e99640 1 --2- 172.21.15.3:0/323037936 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0a8c101a60 0x7f0a8c102e40 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f0a80006010 tx=0x7f0a800046c0 comp rx=0 tx=0).stop 2024-09-21T12:22:59.700 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.698+0000 7f0a90e99640 1 -- 172.21.15.3:0/323037936 shutdown_connections 2024-09-21T12:22:59.700 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.698+0000 7f0a90e99640 1 --2- 172.21.15.3:0/323037936 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f0a7407b0b0 0x7f0a7407d570 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:22:59.700 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.698+0000 7f0a90e99640 1 --2- 172.21.15.3:0/323037936 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0a8c101a60 0x7f0a8c102e40 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:22:59.701 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.698+0000 7f0a90e99640 1 --2- 172.21.15.3:0/323037936 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a8c100860 0x7f0a8c104780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:22:59.701 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.698+0000 7f0a90e99640 1 -- 172.21.15.3:0/323037936 >> 172.21.15.3:0/323037936 conn(0x7f0a8c0fc010 msgr2=0x7f0a8c069cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:22:59.701 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.698+0000 7f0a90e99640 1 -- 172.21.15.3:0/323037936 shutdown_connections 2024-09-21T12:22:59.701 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.698+0000 7f0a90e99640 1 -- 172.21.15.3:0/323037936 wait complete. 2024-09-21T12:22:59.786 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.784+0000 7fcfae7f2640 1 -- 172.21.15.3:0/1575623572 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcfa81023f0 msgr2=0x7fcfa81047e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:22:59.786 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.784+0000 7fcfae7f2640 1 --2- 172.21.15.3:0/1575623572 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcfa81023f0 0x7fcfa81047e0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fcf980098b0 tx=0x7fcf9802a4d0 comp rx=0 tx=0).stop 2024-09-21T12:22:59.786 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.784+0000 7fcfae7f2640 1 -- 172.21.15.3:0/1575623572 shutdown_connections 2024-09-21T12:22:59.787 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.784+0000 7fcfae7f2640 1 --2- 172.21.15.3:0/1575623572 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcfa8104d20 0x7fcfa8107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:22:59.787 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.784+0000 7fcfae7f2640 1 --2- 172.21.15.3:0/1575623572 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcfa81023f0 0x7fcfa81047e0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:22:59.787 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.784+0000 7fcfae7f2640 1 -- 172.21.15.3:0/1575623572 >> 172.21.15.3:0/1575623572 conn(0x7fcfa80fc010 msgr2=0x7fcfa80fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:22:59.787 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.784+0000 7fcfae7f2640 1 -- 172.21.15.3:0/1575623572 shutdown_connections 2024-09-21T12:22:59.787 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.784+0000 7fcfae7f2640 1 -- 172.21.15.3:0/1575623572 wait complete. 2024-09-21T12:22:59.787 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.785+0000 7fcfae7f2640 1 Processor -- start 2024-09-21T12:22:59.787 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.785+0000 7fcfae7f2640 1 -- start start 2024-09-21T12:22:59.789 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.785+0000 7fcfae7f2640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcfa81023f0 0x7fcfa8101ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:22:59.789 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.785+0000 7fcfae7f2640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcfa8104d20 0x7fcfa81003a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:22:59.789 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.785+0000 7fcfae7f2640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fcfa810a7e0 con 0x7fcfa81023f0 2024-09-21T12:22:59.789 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.785+0000 7fcfae7f2640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fcfa810a660 con 0x7fcfa8104d20 2024-09-21T12:22:59.789 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.785+0000 7fcfa7fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcfa81023f0 0x7fcfa8101ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:22:59.789 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.785+0000 7fcfa7fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcfa81023f0 0x7fcfa8101ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44192/0 (socket says 172.21.15.3:44192) 2024-09-21T12:22:59.789 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.785+0000 7fcfa7fff640 1 -- 172.21.15.3:0/2411982493 learned_addr learned my addr 172.21.15.3:0/2411982493 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:22:59.789 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.786+0000 7fcfa77fe640 1 --2- 172.21.15.3:0/2411982493 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcfa8104d20 0x7fcfa81003a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:22:59.789 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.786+0000 7fcfa7fff640 1 -- 172.21.15.3:0/2411982493 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcfa8104d20 msgr2=0x7fcfa81003a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:22:59.789 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.786+0000 7fcfa7fff640 1 --2- 172.21.15.3:0/2411982493 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcfa8104d20 0x7fcfa81003a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:22:59.790 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.786+0000 7fcfa7fff640 1 -- 172.21.15.3:0/2411982493 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfa81008e0 con 0x7fcfa81023f0 2024-09-21T12:22:59.790 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.786+0000 7fcfa7fff640 1 --2- 172.21.15.3:0/2411982493 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcfa81023f0 0x7fcfa8101ce0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fcf980099d0 tx=0x7fcf980048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:22:59.790 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.786+0000 7fcfa57fa640 1 -- 172.21.15.3:0/2411982493 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcf9803f070 con 0x7fcfa81023f0 2024-09-21T12:22:59.790 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.786+0000 7fcfae7f2640 1 -- 172.21.15.3:0/2411982493 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfa8100b70 con 0x7fcfa81023f0 2024-09-21T12:22:59.790 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.786+0000 7fcfae7f2640 1 -- 172.21.15.3:0/2411982493 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfa81010a0 con 0x7fcfa81023f0 2024-09-21T12:22:59.790 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.786+0000 7fcfa57fa640 1 -- 172.21.15.3:0/2411982493 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcf98004c70 con 0x7fcfa81023f0 2024-09-21T12:22:59.790 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.786+0000 7fcfa57fa640 1 -- 172.21.15.3:0/2411982493 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcf98035030 con 0x7fcfa81023f0 2024-09-21T12:22:59.791 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.787+0000 7fcfae7f2640 1 -- 172.21.15.3:0/2411982493 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfa81027d0 con 0x7fcfa81023f0 2024-09-21T12:22:59.791 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.789+0000 7fcfa57fa640 1 -- 172.21.15.3:0/2411982493 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 32) ==== 103420+0+0 (secure 0 0 0) 0x7fcf98042070 con 0x7fcfa81023f0 2024-09-21T12:22:59.791 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.789+0000 7fcfa57fa640 1 --2- 172.21.15.3:0/2411982493 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fcf9007b050 0x7fcf9007d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:22:59.791 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.789+0000 7fcfa57fa640 1 -- 172.21.15.3:0/2411982493 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6156+0+0 (secure 0 0 0) 0x7fcf980bef30 con 0x7fcfa81023f0 2024-09-21T12:22:59.791 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.789+0000 7fcfa77fe640 1 --2- 172.21.15.3:0/2411982493 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fcf9007b050 0x7fcf9007d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:22:59.791 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.790+0000 7fcfa77fe640 1 --2- 172.21.15.3:0/2411982493 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fcf9007b050 0x7fcf9007d510 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c005fd0 tx=0x7fcf9c005e20 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:22:59.799 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:22:59.798+0000 7fcfa57fa640 1 -- 172.21.15.3:0/2411982493 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fcf9808a310 con 0x7fcfa81023f0 2024-09-21T12:22:59.951 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:59 smithi003 ceph-mon[28057]: pgmap v33: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:22:59.951 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:59 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:59.951 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:59 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:59.951 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:59 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:22:59.951 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:59 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:22:59.951 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:59 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:22:59.951 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:59 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:22:59.951 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:59 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:22:59.951 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:59 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:22:59.951 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:59 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:22:59.951 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:59 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:22:59.951 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:59 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:22:59.952 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:59 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:22:59.952 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:59 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:22:59.952 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:59 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:22:59.952 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:22:59 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:23:00.071 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:00.069+0000 7fcfae7f2640 1 -- 172.21.15.3:0/2411982493 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fcfa819f560 con 0x7fcfa81023f0 2024-09-21T12:23:00.072 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:00.070+0000 7fcfa57fa640 1 -- 172.21.15.3:0/2411982493 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7fcf9808f1c0 con 0x7fcfa81023f0 2024-09-21T12:23:00.072 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-21T12:23:00.072 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": { 2024-09-21T12:23:00.072 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2 2024-09-21T12:23:00.072 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:23:00.072 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": { 2024-09-21T12:23:00.072 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:23:00.072 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:23:00.072 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": { 2024-09-21T12:23:00.072 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 6 2024-09-21T12:23:00.073 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:23:00.073 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": { 2024-09-21T12:23:00.073 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 4 2024-09-21T12:23:00.073 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:23:00.073 INFO:teuthology.orchestra.run.smithi003.stdout: "overall": { 2024-09-21T12:23:00.073 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 12, 2024-09-21T12:23:00.073 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:23:00.073 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-21T12:23:00.073 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-21T12:23:00.074 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:00.072+0000 7fcfae7f2640 1 -- 172.21.15.3:0/2411982493 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fcf9007b050 msgr2=0x7fcf9007d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:23:00.074 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:00.072+0000 7fcfae7f2640 1 --2- 172.21.15.3:0/2411982493 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fcf9007b050 0x7fcf9007d510 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c005fd0 tx=0x7fcf9c005e20 comp rx=0 tx=0).stop 2024-09-21T12:23:00.074 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:00.072+0000 7fcfae7f2640 1 -- 172.21.15.3:0/2411982493 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcfa81023f0 msgr2=0x7fcfa8101ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:23:00.074 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:00.072+0000 7fcfae7f2640 1 --2- 172.21.15.3:0/2411982493 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcfa81023f0 0x7fcfa8101ce0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fcf980099d0 tx=0x7fcf980048f0 comp rx=0 tx=0).stop 2024-09-21T12:23:00.074 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:00.072+0000 7fcfae7f2640 1 -- 172.21.15.3:0/2411982493 shutdown_connections 2024-09-21T12:23:00.074 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:00.072+0000 7fcfae7f2640 1 --2- 172.21.15.3:0/2411982493 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fcf9007b050 0x7fcf9007d510 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:23:00.074 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:00.072+0000 7fcfae7f2640 1 --2- 172.21.15.3:0/2411982493 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcfa8104d20 0x7fcfa81003a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:23:00.075 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:00.072+0000 7fcfae7f2640 1 --2- 172.21.15.3:0/2411982493 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcfa81023f0 0x7fcfa8101ce0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:23:00.075 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:00.072+0000 7fcfae7f2640 1 -- 172.21.15.3:0/2411982493 >> 172.21.15.3:0/2411982493 conn(0x7fcfa80fc010 msgr2=0x7fcfa80fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:23:00.075 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:00.072+0000 7fcfae7f2640 1 -- 172.21.15.3:0/2411982493 shutdown_connections 2024-09-21T12:23:00.075 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:00.072+0000 7fcfae7f2640 1 -- 172.21.15.3:0/2411982493 wait complete. 2024-09-21T12:23:00.163 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:00.160+0000 7fc547016640 1 -- 172.21.15.3:0/3609570767 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc5401023f0 msgr2=0x7fc5401047e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:23:00.163 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:00.160+0000 7fc547016640 1 --2- 172.21.15.3:0/3609570767 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc5401023f0 0x7fc5401047e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fc5340098b0 tx=0x7fc53402a4d0 comp rx=0 tx=0).stop 2024-09-21T12:23:00.163 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:00.160+0000 7fc547016640 1 -- 172.21.15.3:0/3609570767 shutdown_connections 2024-09-21T12:23:00.163 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:00.160+0000 7fc547016640 1 --2- 172.21.15.3:0/3609570767 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc540104d20 0x7fc540107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:23:00.163 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:00.160+0000 7fc547016640 1 --2- 172.21.15.3:0/3609570767 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc5401023f0 0x7fc5401047e0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:23:00.163 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:00.160+0000 7fc547016640 1 -- 172.21.15.3:0/3609570767 >> 172.21.15.3:0/3609570767 conn(0x7fc5400fc010 msgr2=0x7fc5400fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:23:00.163 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:00.160+0000 7fc547016640 1 -- 172.21.15.3:0/3609570767 shutdown_connections 2024-09-21T12:23:00.163 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:00.160+0000 7fc547016640 1 -- 172.21.15.3:0/3609570767 wait complete. 2024-09-21T12:23:00.164 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:00.161+0000 7fc547016640 1 Processor -- start 2024-09-21T12:23:00.164 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:00.161+0000 7fc547016640 1 -- start start 2024-09-21T12:23:00.164 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:00.161+0000 7fc547016640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc5401023f0 0x7fc5401975c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:23:00.164 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:00.161+0000 7fc547016640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc540104d20 0x7fc540197b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:23:00.164 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:00.161+0000 7fc547016640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fc54010a830 con 0x7fc5401023f0 2024-09-21T12:23:00.164 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:00.161+0000 7fc547016640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc54010a6b0 con 0x7fc540104d20 2024-09-21T12:23:00.164 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:00.161+0000 7fc544db2640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc5401023f0 0x7fc5401975c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:23:00.164 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:00.161+0000 7fc544db2640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc5401023f0 0x7fc5401975c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44208/0 (socket says 172.21.15.3:44208) 2024-09-21T12:23:00.164 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:00.161+0000 7fc544db2640 1 -- 172.21.15.3:0/3975370791 learned_addr learned my addr 172.21.15.3:0/3975370791 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:23:00.167 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:00.162+0000 7fc544db2640 1 -- 172.21.15.3:0/3975370791 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc540104d20 msgr2=0x7fc540197b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:23:00.167 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:00.162+0000 7fc544db2640 1 --2- 172.21.15.3:0/3975370791 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc540104d20 0x7fc540197b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:23:00.167 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:00.162+0000 7fc544db2640 1 -- 172.21.15.3:0/3975370791 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc540198180 con 0x7fc5401023f0 2024-09-21T12:23:00.167 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:00.162+0000 7fc544db2640 1 --2- 172.21.15.3:0/3975370791 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc5401023f0 0x7fc5401975c0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fc5340099d0 tx=0x7fc5340048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:23:00.167 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:00.162+0000 7fc53dffb640 1 -- 172.21.15.3:0/3975370791 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc53403f070 con 0x7fc5401023f0 2024-09-21T12:23:00.167 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:00.162+0000 7fc547016640 1 -- 172.21.15.3:0/3975370791 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc54019cb60 con 0x7fc5401023f0 2024-09-21T12:23:00.167 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:00.162+0000 7fc53dffb640 1 -- 172.21.15.3:0/3975370791 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc534004c70 con 0x7fc5401023f0 2024-09-21T12:23:00.167 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:00.162+0000 7fc53dffb640 1 -- 172.21.15.3:0/3975370791 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc534035030 con 0x7fc5401023f0 2024-09-21T12:23:00.167 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:00.162+0000 7fc547016640 1 -- 172.21.15.3:0/3975370791 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc54019d170 con 0x7fc5401023f0 2024-09-21T12:23:00.167 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:00.163+0000 7fc547016640 1 -- 172.21.15.3:0/3975370791 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5401027d0 con 0x7fc5401023f0 2024-09-21T12:23:00.167 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:00.164+0000 7fc53dffb640 1 -- 172.21.15.3:0/3975370791 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 32) ==== 103420+0+0 (secure 0 0 0) 0x7fc534042070 con 0x7fc5401023f0 2024-09-21T12:23:00.168 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:00.164+0000 7fc53dffb640 1 --2- 172.21.15.3:0/3975370791 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fc53007b0b0 0x7fc53007d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:23:00.168 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:00.165+0000 7fc53dffb640 1 -- 172.21.15.3:0/3975370791 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6156+0+0 (secure 0 0 0) 0x7fc5340beea0 con 0x7fc5401023f0 2024-09-21T12:23:00.168 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:00.165+0000 7fc53ffff640 1 --2- 172.21.15.3:0/3975370791 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fc53007b0b0 0x7fc53007d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:23:00.168 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:00.165+0000 7fc53ffff640 1 --2- 172.21.15.3:0/3975370791 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fc53007b0b0 0x7fc53007d570 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc540198a70 tx=0x7fc52c006c90 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:23:00.170 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:00.169+0000 7fc53dffb640 1 -- 172.21.15.3:0/3975370791 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fc53408a300 con 0x7fc5401023f0 2024-09-21T12:23:00.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:59 smithi192 ceph-mon[35641]: pgmap v33: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:00.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:59 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:23:00.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:59 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:23:00.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:59 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:23:00.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:59 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:23:00.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:59 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:23:00.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:59 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:23:00.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:59 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:23:00.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:59 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:23:00.259 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:59 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:23:00.259 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:59 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:23:00.259 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:59 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:23:00.259 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:59 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:23:00.259 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:59 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:23:00.259 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:59 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:23:00.259 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:22:59 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:23:00.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:00.392+0000 7fc547016640 1 -- 172.21.15.3:0/3975370791 --> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fc540105700 con 0x7fc53007b0b0 2024-09-21T12:23:00.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:00.393+0000 7fc53dffb640 1 -- 172.21.15.3:0/3975370791 <== mgr.14756 v2:172.21.15.3:6800/1284098095 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+367 (secure 0 0 0) 0x7fc540105700 con 0x7fc53007b0b0 2024-09-21T12:23:00.395 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-21T12:23:00.395 INFO:teuthology.orchestra.run.smithi003.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T12:23:00.395 INFO:teuthology.orchestra.run.smithi003.stdout: "in_progress": true, 2024-09-21T12:23:00.395 INFO:teuthology.orchestra.run.smithi003.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-21T12:23:00.395 INFO:teuthology.orchestra.run.smithi003.stdout: "services_complete": [ 2024-09-21T12:23:00.395 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr" 2024-09-21T12:23:00.396 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-21T12:23:00.396 INFO:teuthology.orchestra.run.smithi003.stdout: "progress": "2/2 daemons upgraded", 2024-09-21T12:23:00.396 INFO:teuthology.orchestra.run.smithi003.stdout: "message": "Currently upgrading prometheus daemons", 2024-09-21T12:23:00.396 INFO:teuthology.orchestra.run.smithi003.stdout: "is_paused": false 2024-09-21T12:23:00.396 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-21T12:23:00.398 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:00.396+0000 7fc547016640 1 -- 172.21.15.3:0/3975370791 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fc53007b0b0 msgr2=0x7fc53007d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:23:00.398 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:00.396+0000 7fc547016640 1 --2- 172.21.15.3:0/3975370791 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fc53007b0b0 0x7fc53007d570 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fc540198a70 tx=0x7fc52c006c90 comp rx=0 tx=0).stop 2024-09-21T12:23:00.398 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:00.396+0000 7fc547016640 1 -- 172.21.15.3:0/3975370791 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc5401023f0 msgr2=0x7fc5401975c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:23:00.398 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:00.396+0000 7fc547016640 1 --2- 172.21.15.3:0/3975370791 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc5401023f0 0x7fc5401975c0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fc5340099d0 tx=0x7fc5340048f0 comp rx=0 tx=0).stop 2024-09-21T12:23:00.398 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:00.396+0000 7fc547016640 1 -- 172.21.15.3:0/3975370791 shutdown_connections 2024-09-21T12:23:00.398 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:00.396+0000 7fc547016640 1 --2- 172.21.15.3:0/3975370791 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fc53007b0b0 0x7fc53007d570 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:23:00.398 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:00.396+0000 7fc547016640 1 --2- 172.21.15.3:0/3975370791 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc540104d20 0x7fc540197b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:23:00.398 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:00.396+0000 7fc547016640 1 --2- 172.21.15.3:0/3975370791 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc5401023f0 0x7fc5401975c0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:23:00.398 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:00.396+0000 7fc547016640 1 -- 172.21.15.3:0/3975370791 >> 172.21.15.3:0/3975370791 conn(0x7fc5400fc010 msgr2=0x7fc5400fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:23:00.398 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:00.396+0000 7fc547016640 1 -- 172.21.15.3:0/3975370791 shutdown_connections 2024-09-21T12:23:00.398 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:00.396+0000 7fc547016640 1 -- 172.21.15.3:0/3975370791 wait complete. 2024-09-21T12:23:01.160 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:00 smithi192 ceph-mon[35641]: from='client.14830 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:23:01.160 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:00 smithi192 ceph-mon[35641]: from='client.14834 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:23:01.160 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:00 smithi192 ceph-mon[35641]: from='client.14838 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:23:01.160 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:00 smithi192 ceph-mon[35641]: from='client.? 172.21.15.3:0/2411982493' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:23:01.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:00 smithi003 ceph-mon[28057]: from='client.14830 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:23:01.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:00 smithi003 ceph-mon[28057]: from='client.14834 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:23:01.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:00 smithi003 ceph-mon[28057]: from='client.14838 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:23:01.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:00 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/2411982493' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:23:02.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:01 smithi003 ceph-mon[28057]: from='client.14846 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:23:02.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:01 smithi003 ceph-mon[28057]: pgmap v34: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:02.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:01 smithi192 ceph-mon[35641]: from='client.14846 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:23:02.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:01 smithi192 ceph-mon[35641]: pgmap v34: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:03.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:02 smithi003 ceph-mon[28057]: Upgrade: Updating prometheus.smithi003 2024-09-21T12:23:03.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:02 smithi003 ceph-mon[28057]: Deploying daemon prometheus.smithi003 on smithi003 2024-09-21T12:23:03.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:02 smithi192 ceph-mon[35641]: Upgrade: Updating prometheus.smithi003 2024-09-21T12:23:03.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:02 smithi192 ceph-mon[35641]: Deploying daemon prometheus.smithi003 on smithi003 2024-09-21T12:23:04.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:03 smithi003 ceph-mon[28057]: pgmap v35: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:04.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:03 smithi192 ceph-mon[35641]: pgmap v35: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:06.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:05 smithi192 ceph-mon[35641]: pgmap v36: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:06.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:05 smithi003 ceph-mon[28057]: pgmap v36: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:08.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:07 smithi192 ceph-mon[35641]: pgmap v37: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:08.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:07 smithi003 ceph-mon[28057]: pgmap v37: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:10.071 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:09 smithi003 ceph-mon[28057]: pgmap v38: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:10.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:09 smithi192 ceph-mon[35641]: pgmap v38: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:11.992 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:11 smithi003 ceph-mon[28057]: pgmap v39: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:12.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:11 smithi192 ceph-mon[35641]: pgmap v39: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:14.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:13 smithi192 ceph-mon[35641]: pgmap v40: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:14.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:13 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:23:14.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:13 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:23:14.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:13 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:23:14.311 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:13 smithi003 ceph-mon[28057]: pgmap v40: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:14.311 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:13 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:23:14.311 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:13 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:23:14.311 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:13 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:23:15.172 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:14 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:23:15.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:14 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:23:16.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:15 smithi003 ceph-mon[28057]: pgmap v41: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:16.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:15 smithi192 ceph-mon[35641]: pgmap v41: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:18.251 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:17 smithi003 ceph-mon[28057]: pgmap v42: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:18.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:17 smithi192 ceph-mon[35641]: pgmap v42: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:20.052 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:19 smithi003 ceph-mon[28057]: pgmap v43: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:20.052 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:19 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:23:20.052 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:19 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:23:20.052 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:19 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:23:20.052 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:19 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:23:20.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:19 smithi192 ceph-mon[35641]: pgmap v43: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:20.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:19 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:23:20.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:19 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:23:20.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:19 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:23:20.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:19 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:23:22.184 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:21 smithi003 ceph-mon[28057]: pgmap v44: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:22.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:21 smithi192 ceph-mon[35641]: pgmap v44: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:23.814 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:23 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:23:23.814 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:23 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:23:23.815 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:23 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:23:23.815 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:23 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:23:23.815 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:23 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:23:23.815 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:23 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T12:23:23.815 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:23 smithi003 ceph-mon[28057]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T12:23:23.815 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:23 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:23:23.815 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:23 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:23:23.815 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:23 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:23:23.815 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:23 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:23:23.815 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:23 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:23:23.815 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:23 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:23:23.815 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:23 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:23:23.815 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:23 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:23:23.815 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:23 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:23:23.816 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:23 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:23:23.816 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:23 smithi003 ceph-mon[28057]: pgmap v45: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:24.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:23 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:23:24.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:23 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:23:24.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:23 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:23:24.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:23 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:23:24.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:23 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:23:24.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:23 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T12:23:24.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:23 smithi192 ceph-mon[35641]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-21T12:23:24.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:23 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:23:24.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:23 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:23:24.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:23 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:23:24.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:23 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:23:24.009 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:23 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:23:24.009 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:23 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:23:24.009 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:23 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:23:24.009 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:23 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:23:24.009 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:23 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:23:24.009 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:23 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:23:24.009 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:23 smithi192 ceph-mon[35641]: pgmap v45: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:26.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:25 smithi192 ceph-mon[35641]: Upgrade: Updating alertmanager.smithi003 2024-09-21T12:23:26.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:25 smithi192 ceph-mon[35641]: Deploying daemon alertmanager.smithi003 on smithi003 2024-09-21T12:23:26.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:25 smithi192 ceph-mon[35641]: pgmap v46: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:26.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:25 smithi003 ceph-mon[28057]: Upgrade: Updating alertmanager.smithi003 2024-09-21T12:23:26.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:25 smithi003 ceph-mon[28057]: Deploying daemon alertmanager.smithi003 on smithi003 2024-09-21T12:23:26.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:25 smithi003 ceph-mon[28057]: pgmap v46: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:28.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:27 smithi003 ceph-mon[28057]: pgmap v47: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:28.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:27 smithi192 ceph-mon[35641]: pgmap v47: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:30.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:29 smithi192 ceph-mon[35641]: pgmap v48: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:30.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:29 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:23:30.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:29 smithi003 ceph-mon[28057]: pgmap v48: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:30.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:29 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:23:30.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.488+0000 7f04d13db640 1 -- 172.21.15.3:0/1289758822 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f04cc102b60 msgr2=0x7f04cc102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:23:30.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.488+0000 7f04d13db640 1 --2- 172.21.15.3:0/1289758822 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f04cc102b60 0x7f04cc102fe0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f04c0009880 tx=0x7f04c002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:23:30.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.488+0000 7f04d13db640 1 -- 172.21.15.3:0/1289758822 shutdown_connections 2024-09-21T12:23:30.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.488+0000 7f04d13db640 1 --2- 172.21.15.3:0/1289758822 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f04cc102b60 0x7f04cc102fe0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:23:30.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.488+0000 7f04d13db640 1 --2- 172.21.15.3:0/1289758822 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04cc101960 0x7f04cc101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:23:30.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.488+0000 7f04d13db640 1 -- 172.21.15.3:0/1289758822 >> 172.21.15.3:0/1289758822 conn(0x7f04cc0fd0f0 msgr2=0x7f04cc0ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:23:30.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.488+0000 7f04d13db640 1 -- 172.21.15.3:0/1289758822 shutdown_connections 2024-09-21T12:23:30.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.488+0000 7f04d13db640 1 -- 172.21.15.3:0/1289758822 wait complete. 2024-09-21T12:23:30.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.488+0000 7f04d13db640 1 Processor -- start 2024-09-21T12:23:30.492 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.489+0000 7f04d13db640 1 -- start start 2024-09-21T12:23:30.492 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.489+0000 7f04d13db640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04cc101960 0x7f04cc199710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:23:30.492 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.489+0000 7f04d13db640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f04cc102b60 0x7f04cc199c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:23:30.492 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.489+0000 7f04d13db640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f04cc10a820 con 0x7f04cc102b60 2024-09-21T12:23:30.492 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.489+0000 7f04d13db640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f04cc10a6a0 con 0x7f04cc101960 2024-09-21T12:23:30.492 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.489+0000 7f04ca7fc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f04cc102b60 0x7f04cc199c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:23:30.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.489+0000 7f04ca7fc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f04cc102b60 0x7f04cc199c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:38224/0 (socket says 172.21.15.3:38224) 2024-09-21T12:23:30.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.489+0000 7f04ca7fc640 1 -- 172.21.15.3:0/3592143142 learned_addr learned my addr 172.21.15.3:0/3592143142 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:23:30.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.489+0000 7f04caffd640 1 --2- 172.21.15.3:0/3592143142 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04cc101960 0x7f04cc199710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:23:30.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.489+0000 7f04ca7fc640 1 -- 172.21.15.3:0/3592143142 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04cc101960 msgr2=0x7f04cc199710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:23:30.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.489+0000 7f04ca7fc640 1 --2- 172.21.15.3:0/3592143142 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04cc101960 0x7f04cc199710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:23:30.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.489+0000 7f04ca7fc640 1 -- 172.21.15.3:0/3592143142 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04cc19a2d0 con 0x7f04cc102b60 2024-09-21T12:23:30.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.489+0000 7f04ca7fc640 1 --2- 172.21.15.3:0/3592143142 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f04cc102b60 0x7f04cc199c50 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f04c0006010 tx=0x7f04c00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:23:30.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.490+0000 7f04b3fff640 1 -- 172.21.15.3:0/3592143142 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f04c003f070 con 0x7f04cc102b60 2024-09-21T12:23:30.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.490+0000 7f04b3fff640 1 -- 172.21.15.3:0/3592143142 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f04c00044d0 con 0x7f04cc102b60 2024-09-21T12:23:30.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.490+0000 7f04d13db640 1 -- 172.21.15.3:0/3592143142 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04cc19ecb0 con 0x7f04cc102b60 2024-09-21T12:23:30.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.490+0000 7f04b3fff640 1 -- 172.21.15.3:0/3592143142 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f04c0035030 con 0x7f04cc102b60 2024-09-21T12:23:30.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.490+0000 7f04d13db640 1 -- 172.21.15.3:0/3592143142 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04cc19f260 con 0x7f04cc102b60 2024-09-21T12:23:30.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.491+0000 7f04d13db640 1 -- 172.21.15.3:0/3592143142 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04cc101d40 con 0x7f04cc102b60 2024-09-21T12:23:30.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.492+0000 7f04b3fff640 1 -- 172.21.15.3:0/3592143142 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f04c0042070 con 0x7f04cc102b60 2024-09-21T12:23:30.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.492+0000 7f04b3fff640 1 --2- 172.21.15.3:0/3592143142 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f04b407af30 0x7f04b407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:23:30.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.492+0000 7f04b3fff640 1 -- 172.21.15.3:0/3592143142 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6156+0+0 (secure 0 0 0) 0x7f04c00bed70 con 0x7f04cc102b60 2024-09-21T12:23:30.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.492+0000 7f04caffd640 1 --2- 172.21.15.3:0/3592143142 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f04b407af30 0x7f04b407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:23:30.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.493+0000 7f04caffd640 1 --2- 172.21.15.3:0/3592143142 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f04b407af30 0x7f04b407d3f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f04cc1029c0 tx=0x7f04bc008040 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:23:30.499 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.497+0000 7f04b3fff640 1 -- 172.21.15.3:0/3592143142 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f04c008a370 con 0x7f04cc102b60 2024-09-21T12:23:30.712 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.710+0000 7f04d13db640 1 -- 172.21.15.3:0/3592143142 --> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f04cc062740 con 0x7f04b407af30 2024-09-21T12:23:30.713 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.711+0000 7f04b3fff640 1 -- 172.21.15.3:0/3592143142 <== mgr.14756 v2:172.21.15.3:6800/1284098095 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+369 (secure 0 0 0) 0x7f04cc062740 con 0x7f04b407af30 2024-09-21T12:23:30.716 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.714+0000 7f04d13db640 1 -- 172.21.15.3:0/3592143142 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f04b407af30 msgr2=0x7f04b407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:23:30.716 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.714+0000 7f04d13db640 1 --2- 172.21.15.3:0/3592143142 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f04b407af30 0x7f04b407d3f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f04cc1029c0 tx=0x7f04bc008040 comp rx=0 tx=0).stop 2024-09-21T12:23:30.716 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.714+0000 7f04d13db640 1 -- 172.21.15.3:0/3592143142 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f04cc102b60 msgr2=0x7f04cc199c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:23:30.716 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.714+0000 7f04d13db640 1 --2- 172.21.15.3:0/3592143142 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f04cc102b60 0x7f04cc199c50 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f04c0006010 tx=0x7f04c00048f0 comp rx=0 tx=0).stop 2024-09-21T12:23:30.717 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.714+0000 7f04d13db640 1 -- 172.21.15.3:0/3592143142 shutdown_connections 2024-09-21T12:23:30.717 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.714+0000 7f04d13db640 1 --2- 172.21.15.3:0/3592143142 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f04b407af30 0x7f04b407d3f0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:23:30.717 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.714+0000 7f04d13db640 1 --2- 172.21.15.3:0/3592143142 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f04cc102b60 0x7f04cc199c50 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:23:30.717 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.714+0000 7f04d13db640 1 --2- 172.21.15.3:0/3592143142 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04cc101960 0x7f04cc199710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:23:30.717 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.714+0000 7f04d13db640 1 -- 172.21.15.3:0/3592143142 >> 172.21.15.3:0/3592143142 conn(0x7f04cc0fd0f0 msgr2=0x7f04cc103d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:23:30.717 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.714+0000 7f04d13db640 1 -- 172.21.15.3:0/3592143142 shutdown_connections 2024-09-21T12:23:30.718 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.714+0000 7f04d13db640 1 -- 172.21.15.3:0/3592143142 wait complete. 2024-09-21T12:23:30.725 INFO:teuthology.orchestra.run.smithi003.stdout:true 2024-09-21T12:23:30.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.807+0000 7fe09b5cf640 1 -- 172.21.15.3:0/145696305 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe094101970 msgr2=0x7fe094101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:23:30.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.807+0000 7fe09b5cf640 1 --2- 172.21.15.3:0/145696305 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe094101970 0x7fe094101d70 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fe090009880 tx=0x7fe09002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:23:30.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.807+0000 7fe09b5cf640 1 -- 172.21.15.3:0/145696305 shutdown_connections 2024-09-21T12:23:30.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.807+0000 7fe09b5cf640 1 --2- 172.21.15.3:0/145696305 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe094102b70 0x7fe094102ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:23:30.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.807+0000 7fe09b5cf640 1 --2- 172.21.15.3:0/145696305 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe094101970 0x7fe094101d70 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:23:30.809 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.807+0000 7fe09b5cf640 1 -- 172.21.15.3:0/145696305 >> 172.21.15.3:0/145696305 conn(0x7fe0940fd140 msgr2=0x7fe0940ff560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:23:30.810 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.807+0000 7fe09b5cf640 1 -- 172.21.15.3:0/145696305 shutdown_connections 2024-09-21T12:23:30.810 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.807+0000 7fe09b5cf640 1 -- 172.21.15.3:0/145696305 wait complete. 2024-09-21T12:23:30.811 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.808+0000 7fe09b5cf640 1 Processor -- start 2024-09-21T12:23:30.811 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.808+0000 7fe09b5cf640 1 -- start start 2024-09-21T12:23:30.811 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.808+0000 7fe09b5cf640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe094101970 0x7fe0941974e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:23:30.812 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.808+0000 7fe09b5cf640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe094102b70 0x7fe094197a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:23:30.812 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.808+0000 7fe09b5cf640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fe09410a7b0 con 0x7fe094102b70 2024-09-21T12:23:30.812 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.808+0000 7fe09b5cf640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe09410a630 con 0x7fe094101970 2024-09-21T12:23:30.812 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.808+0000 7fe098b6a640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe094102b70 0x7fe094197a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:23:30.812 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.808+0000 7fe098b6a640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe094102b70 0x7fe094197a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:38242/0 (socket says 172.21.15.3:38242) 2024-09-21T12:23:30.812 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.808+0000 7fe098b6a640 1 -- 172.21.15.3:0/3707728261 learned_addr learned my addr 172.21.15.3:0/3707728261 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:23:30.813 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.809+0000 7fe09936b640 1 --2- 172.21.15.3:0/3707728261 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe094101970 0x7fe0941974e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:23:30.813 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.809+0000 7fe098b6a640 1 -- 172.21.15.3:0/3707728261 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe094101970 msgr2=0x7fe0941974e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:23:30.813 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.809+0000 7fe098b6a640 1 --2- 172.21.15.3:0/3707728261 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe094101970 0x7fe0941974e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:23:30.813 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.809+0000 7fe098b6a640 1 -- 172.21.15.3:0/3707728261 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0941980a0 con 0x7fe094102b70 2024-09-21T12:23:30.813 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.809+0000 7fe09936b640 1 --2- 172.21.15.3:0/3707728261 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe094101970 0x7fe0941974e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T12:23:30.813 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.809+0000 7fe098b6a640 1 --2- 172.21.15.3:0/3707728261 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe094102b70 0x7fe094197a20 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fe08400e970 tx=0x7fe08400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:23:30.813 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.809+0000 7fe08a7fc640 1 -- 172.21.15.3:0/3707728261 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe08400cac0 con 0x7fe094102b70 2024-09-21T12:23:30.813 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.809+0000 7fe09b5cf640 1 -- 172.21.15.3:0/3707728261 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe09419cae0 con 0x7fe094102b70 2024-09-21T12:23:30.813 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.809+0000 7fe08a7fc640 1 -- 172.21.15.3:0/3707728261 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe0840054e0 con 0x7fe094102b70 2024-09-21T12:23:30.813 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.809+0000 7fe08a7fc640 1 -- 172.21.15.3:0/3707728261 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe084010430 con 0x7fe094102b70 2024-09-21T12:23:30.813 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.810+0000 7fe09b5cf640 1 -- 172.21.15.3:0/3707728261 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe09419d070 con 0x7fe094102b70 2024-09-21T12:23:30.814 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.810+0000 7fe09b5cf640 1 -- 172.21.15.3:0/3707728261 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe094101d70 con 0x7fe094102b70 2024-09-21T12:23:30.814 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.811+0000 7fe08a7fc640 1 -- 172.21.15.3:0/3707728261 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7fe084004f00 con 0x7fe094102b70 2024-09-21T12:23:30.814 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.812+0000 7fe08a7fc640 1 --2- 172.21.15.3:0/3707728261 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fe08007af80 0x7fe08007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:23:30.815 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.812+0000 7fe08a7fc640 1 -- 172.21.15.3:0/3707728261 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6156+0+0 (secure 0 0 0) 0x7fe08409e770 con 0x7fe094102b70 2024-09-21T12:23:30.815 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.812+0000 7fe09936b640 1 --2- 172.21.15.3:0/3707728261 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fe08007af80 0x7fe08007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:23:30.815 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.813+0000 7fe09936b640 1 --2- 172.21.15.3:0/3707728261 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fe08007af80 0x7fe08007d440 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe0900096c0 tx=0x7fe090009650 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:23:30.818 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:30.817+0000 7fe08a7fc640 1 -- 172.21.15.3:0/3707728261 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fe084069d50 con 0x7fe094102b70 2024-09-21T12:23:31.033 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:30 smithi003 ceph-mon[28057]: mgrmap e33: smithi003.wztftl(active, since 91s), standbys: smithi192.qsaprd 2024-09-21T12:23:31.036 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.034+0000 7fe09b5cf640 1 -- 172.21.15.3:0/3707728261 --> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fe094107140 con 0x7fe08007af80 2024-09-21T12:23:31.037 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.036+0000 7fe08a7fc640 1 -- 172.21.15.3:0/3707728261 <== mgr.14756 v2:172.21.15.3:6800/1284098095 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+369 (secure 0 0 0) 0x7fe094107140 con 0x7fe08007af80 2024-09-21T12:23:31.039 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.038+0000 7fe09b5cf640 1 -- 172.21.15.3:0/3707728261 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fe08007af80 msgr2=0x7fe08007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:23:31.039 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.038+0000 7fe09b5cf640 1 --2- 172.21.15.3:0/3707728261 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fe08007af80 0x7fe08007d440 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe0900096c0 tx=0x7fe090009650 comp rx=0 tx=0).stop 2024-09-21T12:23:31.039 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.038+0000 7fe09b5cf640 1 -- 172.21.15.3:0/3707728261 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe094102b70 msgr2=0x7fe094197a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:23:31.040 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.038+0000 7fe09b5cf640 1 --2- 172.21.15.3:0/3707728261 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe094102b70 0x7fe094197a20 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fe08400e970 tx=0x7fe08400ed70 comp rx=0 tx=0).stop 2024-09-21T12:23:31.040 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.038+0000 7fe09b5cf640 1 -- 172.21.15.3:0/3707728261 shutdown_connections 2024-09-21T12:23:31.040 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.038+0000 7fe09b5cf640 1 --2- 172.21.15.3:0/3707728261 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fe08007af80 0x7fe08007d440 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:23:31.040 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.038+0000 7fe09b5cf640 1 --2- 172.21.15.3:0/3707728261 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe094102b70 0x7fe094197a20 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:23:31.040 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.038+0000 7fe09b5cf640 1 --2- 172.21.15.3:0/3707728261 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe094101970 0x7fe0941974e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:23:31.040 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.038+0000 7fe09b5cf640 1 -- 172.21.15.3:0/3707728261 >> 172.21.15.3:0/3707728261 conn(0x7fe0940fd140 msgr2=0x7fe0940ff340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:23:31.040 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.038+0000 7fe09b5cf640 1 -- 172.21.15.3:0/3707728261 shutdown_connections 2024-09-21T12:23:31.040 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.038+0000 7fe09b5cf640 1 -- 172.21.15.3:0/3707728261 wait complete. 2024-09-21T12:23:31.127 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.125+0000 7f65faa76640 1 -- 172.21.15.3:0/1263682217 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f65f4102450 msgr2=0x7f65f4104840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:23:31.127 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.125+0000 7f65faa76640 1 --2- 172.21.15.3:0/1263682217 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f65f4102450 0x7f65f4104840 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f65e8009880 tx=0x7f65e802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:23:31.127 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.125+0000 7f65faa76640 1 -- 172.21.15.3:0/1263682217 shutdown_connections 2024-09-21T12:23:31.127 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.125+0000 7f65faa76640 1 --2- 172.21.15.3:0/1263682217 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65f4104d80 0x7f65f4107170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:23:31.127 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.125+0000 7f65faa76640 1 --2- 172.21.15.3:0/1263682217 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f65f4102450 0x7f65f4104840 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:23:31.127 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.125+0000 7f65faa76640 1 -- 172.21.15.3:0/1263682217 >> 172.21.15.3:0/1263682217 conn(0x7f65f40fc010 msgr2=0x7f65f40fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:23:31.127 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.125+0000 7f65faa76640 1 -- 172.21.15.3:0/1263682217 shutdown_connections 2024-09-21T12:23:31.127 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.125+0000 7f65faa76640 1 -- 172.21.15.3:0/1263682217 wait complete. 2024-09-21T12:23:31.129 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.126+0000 7f65faa76640 1 Processor -- start 2024-09-21T12:23:31.129 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.126+0000 7f65faa76640 1 -- start start 2024-09-21T12:23:31.129 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.126+0000 7f65faa76640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65f4102450 0x7f65f41974c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:23:31.129 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.126+0000 7f65faa76640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f65f4104d80 0x7f65f4197a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:23:31.129 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.126+0000 7f65faa76640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f65f410a7c0 con 0x7f65f4104d80 2024-09-21T12:23:31.129 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.126+0000 7f65faa76640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f65f410a640 con 0x7f65f4102450 2024-09-21T12:23:31.129 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.126+0000 7f65f3fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f65f4104d80 0x7f65f4197a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:23:31.129 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.126+0000 7f65f3fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f65f4104d80 0x7f65f4197a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:38252/0 (socket says 172.21.15.3:38252) 2024-09-21T12:23:31.129 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.126+0000 7f65f3fff640 1 -- 172.21.15.3:0/943135394 learned_addr learned my addr 172.21.15.3:0/943135394 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:23:31.129 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.126+0000 7f65f8812640 1 --2- 172.21.15.3:0/943135394 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65f4102450 0x7f65f41974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:23:31.130 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.127+0000 7f65f3fff640 1 -- 172.21.15.3:0/943135394 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65f4102450 msgr2=0x7f65f41974c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:23:31.130 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.127+0000 7f65f3fff640 1 --2- 172.21.15.3:0/943135394 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65f4102450 0x7f65f41974c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:23:31.130 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.127+0000 7f65f3fff640 1 -- 172.21.15.3:0/943135394 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65f4198080 con 0x7f65f4104d80 2024-09-21T12:23:31.130 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.127+0000 7f65f3fff640 1 --2- 172.21.15.3:0/943135394 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f65f4104d80 0x7f65f4197a00 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f65e000b3d0 tx=0x7f65e000b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:23:31.130 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.127+0000 7f65f1ffb640 1 -- 172.21.15.3:0/943135394 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f65e0015020 con 0x7f65f4104d80 2024-09-21T12:23:31.130 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.127+0000 7f65faa76640 1 -- 172.21.15.3:0/943135394 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65f419cac0 con 0x7f65f4104d80 2024-09-21T12:23:31.130 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.127+0000 7f65f1ffb640 1 -- 172.21.15.3:0/943135394 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f65e0011af0 con 0x7f65f4104d80 2024-09-21T12:23:31.130 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.127+0000 7f65f1ffb640 1 -- 172.21.15.3:0/943135394 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f65e0010d30 con 0x7f65f4104d80 2024-09-21T12:23:31.130 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.127+0000 7f65faa76640 1 -- 172.21.15.3:0/943135394 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65f419d0d0 con 0x7f65f4104d80 2024-09-21T12:23:31.131 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.128+0000 7f65faa76640 1 -- 172.21.15.3:0/943135394 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65f4102830 con 0x7f65f4104d80 2024-09-21T12:23:31.131 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.129+0000 7f65f1ffb640 1 -- 172.21.15.3:0/943135394 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f65e0018020 con 0x7f65f4104d80 2024-09-21T12:23:31.131 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.129+0000 7f65f1ffb640 1 --2- 172.21.15.3:0/943135394 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f65e407af30 0x7f65e407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:23:31.131 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.129+0000 7f65f1ffb640 1 -- 172.21.15.3:0/943135394 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6156+0+0 (secure 0 0 0) 0x7f65e009d9d0 con 0x7f65f4104d80 2024-09-21T12:23:31.131 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.129+0000 7f65f8812640 1 --2- 172.21.15.3:0/943135394 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f65e407af30 0x7f65e407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:23:31.131 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.130+0000 7f65f8812640 1 --2- 172.21.15.3:0/943135394 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f65e407af30 0x7f65e407d3f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f65e8005ab0 tx=0x7f65e8005a20 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:23:31.135 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.134+0000 7f65f1ffb640 1 -- 172.21.15.3:0/943135394 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f65e001f020 con 0x7f65f4104d80 2024-09-21T12:23:31.158 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:30 smithi192 ceph-mon[35641]: mgrmap e33: smithi003.wztftl(active, since 91s), standbys: smithi192.qsaprd 2024-09-21T12:23:31.331 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.330+0000 7f65faa76640 1 -- 172.21.15.3:0/943135394 --> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f65f4105640 con 0x7f65e407af30 2024-09-21T12:23:31.341 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.340+0000 7f65f1ffb640 1 -- 172.21.15.3:0/943135394 <== mgr.14756 v2:172.21.15.3:6800/1284098095 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f65f4105640 con 0x7f65e407af30 2024-09-21T12:23:31.342 INFO:teuthology.orchestra.run.smithi003.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:23:31.342 INFO:teuthology.orchestra.run.smithi003.stdout:alertmanager.smithi003 smithi003 *:9093,9094 running (9m) 12s ago 11m 25.8M - 0.25.0 c8568f914cd2 5c03f233277e 2024-09-21T12:23:31.342 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-exporter.smithi003 smithi003 running (2m) 12s ago 11m 8506k - 19.1.1-373-g4e45e6b4 164465d2334a 0c9ad60a4f5a 2024-09-21T12:23:31.342 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-exporter.smithi192 smithi192 running (2m) 37s ago 10m 8124k - 19.1.1-373-g4e45e6b4 164465d2334a d5be8a6e120f 2024-09-21T12:23:31.342 INFO:teuthology.orchestra.run.smithi003.stdout:crash.smithi003 smithi003 running (11m) 12s ago 11m 6899k - 19.1.1-373-g4e45e6b4 164465d2334a c63f209dc1dc 2024-09-21T12:23:31.342 INFO:teuthology.orchestra.run.smithi003.stdout:crash.smithi192 smithi192 running (10m) 37s ago 10m 6895k - 19.1.1-373-g4e45e6b4 164465d2334a cc70c9a7b2f7 2024-09-21T12:23:31.342 INFO:teuthology.orchestra.run.smithi003.stdout:grafana.smithi003 smithi003 *:3000 running (9m) 12s ago 11m 78.7M - 9.4.12 2bacad6d85d8 f504f60818f0 2024-09-21T12:23:31.342 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi003.ebjgyl smithi003 running (5m) 12s ago 5m 15.1M - 19.1.1-373-g4e45e6b4 164465d2334a 16e0b2cac16a 2024-09-21T12:23:31.342 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi003.gfkngj smithi003 running (5m) 12s ago 5m 144M - 19.1.1-373-g4e45e6b4 164465d2334a 109c04f87fbd 2024-09-21T12:23:31.342 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi192.ktdqns smithi192 running (5m) 37s ago 5m 16.7M - 19.1.1-373-g4e45e6b4 164465d2334a 495c73fb3bb0 2024-09-21T12:23:31.342 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi192.ywqqxe smithi192 running (5m) 37s ago 5m 16.7M - 19.1.1-373-g4e45e6b4 164465d2334a 270a01030cbe 2024-09-21T12:23:31.342 INFO:teuthology.orchestra.run.smithi003.stdout:mgr.smithi003.wztftl smithi003 *:8443,9283,8765 running (2m) 12s ago 12m 511M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 8ce0e66fd369 2024-09-21T12:23:31.343 INFO:teuthology.orchestra.run.smithi003.stdout:mgr.smithi192.qsaprd smithi192 *:8443,9283,8765 running (62s) 37s ago 10m 455M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 002a6171dd47 2024-09-21T12:23:31.343 INFO:teuthology.orchestra.run.smithi003.stdout:mon.smithi003 smithi003 running (12m) 12s ago 12m 57.6M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 16bccf2c7503 2024-09-21T12:23:31.343 INFO:teuthology.orchestra.run.smithi003.stdout:mon.smithi192 smithi192 running (10m) 37s ago 10m 43.1M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 4fe4c4b3dc5d 2024-09-21T12:23:31.343 INFO:teuthology.orchestra.run.smithi003.stdout:node-exporter.smithi003 smithi003 *:9100 running (47s) 12s ago 11m 7952k - 1.7.0 72c9c2088986 d9cb7ede9060 2024-09-21T12:23:31.343 INFO:teuthology.orchestra.run.smithi003.stdout:node-exporter.smithi192 smithi192 *:9100 running (41s) 37s ago 10m 3343k - 1.7.0 72c9c2088986 d8ec0acfce7e 2024-09-21T12:23:31.343 INFO:teuthology.orchestra.run.smithi003.stdout:osd.0 smithi003 running (9m) 12s ago 9m 200M 1217M 19.1.1-373-g4e45e6b4 164465d2334a d07f1489720d 2024-09-21T12:23:31.343 INFO:teuthology.orchestra.run.smithi003.stdout:osd.1 smithi003 running (8m) 12s ago 8m 210M 1217M 19.1.1-373-g4e45e6b4 164465d2334a 6abd75a07645 2024-09-21T12:23:31.343 INFO:teuthology.orchestra.run.smithi003.stdout:osd.2 smithi003 running (8m) 12s ago 8m 172M 1217M 19.1.1-373-g4e45e6b4 164465d2334a 3265369e573b 2024-09-21T12:23:31.343 INFO:teuthology.orchestra.run.smithi003.stdout:osd.3 smithi192 running (7m) 37s ago 7m 237M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 13efcfd71c05 2024-09-21T12:23:31.343 INFO:teuthology.orchestra.run.smithi003.stdout:osd.4 smithi192 running (7m) 37s ago 7m 202M 2240M 19.1.1-373-g4e45e6b4 164465d2334a f33bf453cb3e 2024-09-21T12:23:31.343 INFO:teuthology.orchestra.run.smithi003.stdout:osd.5 smithi192 running (6m) 37s ago 6m 180M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 12d7b7c8e985 2024-09-21T12:23:31.343 INFO:teuthology.orchestra.run.smithi003.stdout:prometheus.smithi003 smithi003 *:9095 running (18s) 12s ago 10m 39.3M - 2.51.0 1d3b7f56885b 64997a33fbbb 2024-09-21T12:23:31.344 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.342+0000 7f65faa76640 1 -- 172.21.15.3:0/943135394 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f65e407af30 msgr2=0x7f65e407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:23:31.344 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.342+0000 7f65faa76640 1 --2- 172.21.15.3:0/943135394 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f65e407af30 0x7f65e407d3f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f65e8005ab0 tx=0x7f65e8005a20 comp rx=0 tx=0).stop 2024-09-21T12:23:31.344 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.342+0000 7f65faa76640 1 -- 172.21.15.3:0/943135394 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f65f4104d80 msgr2=0x7f65f4197a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:23:31.344 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.342+0000 7f65faa76640 1 --2- 172.21.15.3:0/943135394 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f65f4104d80 0x7f65f4197a00 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f65e000b3d0 tx=0x7f65e000b890 comp rx=0 tx=0).stop 2024-09-21T12:23:31.344 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.342+0000 7f65faa76640 1 -- 172.21.15.3:0/943135394 shutdown_connections 2024-09-21T12:23:31.344 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.342+0000 7f65faa76640 1 --2- 172.21.15.3:0/943135394 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f65e407af30 0x7f65e407d3f0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:23:31.345 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.342+0000 7f65faa76640 1 --2- 172.21.15.3:0/943135394 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f65f4104d80 0x7f65f4197a00 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:23:31.345 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.342+0000 7f65faa76640 1 --2- 172.21.15.3:0/943135394 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f65f4102450 0x7f65f41974c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:23:31.345 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.342+0000 7f65faa76640 1 -- 172.21.15.3:0/943135394 >> 172.21.15.3:0/943135394 conn(0x7f65f40fc010 msgr2=0x7f65f40fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:23:31.345 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.342+0000 7f65faa76640 1 -- 172.21.15.3:0/943135394 shutdown_connections 2024-09-21T12:23:31.345 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.342+0000 7f65faa76640 1 -- 172.21.15.3:0/943135394 wait complete. 2024-09-21T12:23:31.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.426+0000 7f89080fb640 1 -- 172.21.15.3:0/1840334335 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f89001023f0 msgr2=0x7f89001047e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:23:31.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.426+0000 7f89080fb640 1 --2- 172.21.15.3:0/1840334335 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f89001023f0 0x7f89001047e0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f88f0009c50 tx=0x7f88f002a9a0 comp rx=0 tx=0).stop 2024-09-21T12:23:31.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.426+0000 7f89080fb640 1 -- 172.21.15.3:0/1840334335 shutdown_connections 2024-09-21T12:23:31.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.426+0000 7f89080fb640 1 --2- 172.21.15.3:0/1840334335 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8900104d20 0x7f8900107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:23:31.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.426+0000 7f89080fb640 1 --2- 172.21.15.3:0/1840334335 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f89001023f0 0x7f89001047e0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:23:31.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.426+0000 7f89080fb640 1 -- 172.21.15.3:0/1840334335 >> 172.21.15.3:0/1840334335 conn(0x7f89000fc010 msgr2=0x7f89000fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:23:31.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.426+0000 7f89080fb640 1 -- 172.21.15.3:0/1840334335 shutdown_connections 2024-09-21T12:23:31.429 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.426+0000 7f89080fb640 1 -- 172.21.15.3:0/1840334335 wait complete. 2024-09-21T12:23:31.430 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.427+0000 7f89080fb640 1 Processor -- start 2024-09-21T12:23:31.430 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.427+0000 7f89080fb640 1 -- start start 2024-09-21T12:23:31.430 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.427+0000 7f89080fb640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f89001023f0 0x7f8900199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:23:31.430 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.427+0000 7f89080fb640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8900104d20 0x7f8900199d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:23:31.430 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.427+0000 7f89080fb640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f890010a830 con 0x7f89001023f0 2024-09-21T12:23:31.431 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.427+0000 7f89080fb640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f890010a6b0 con 0x7f8900104d20 2024-09-21T12:23:31.431 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.427+0000 7f8905e97640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f89001023f0 0x7f8900199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:23:31.431 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.427+0000 7f8905e97640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f89001023f0 0x7f8900199840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:38272/0 (socket says 172.21.15.3:38272) 2024-09-21T12:23:31.431 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.427+0000 7f8905e97640 1 -- 172.21.15.3:0/1311307812 learned_addr learned my addr 172.21.15.3:0/1311307812 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:23:31.431 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.428+0000 7f8905696640 1 --2- 172.21.15.3:0/1311307812 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8900104d20 0x7f8900199d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:23:31.431 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.428+0000 7f8905e97640 1 -- 172.21.15.3:0/1311307812 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8900104d20 msgr2=0x7f8900199d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:23:31.431 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.428+0000 7f8905e97640 1 --2- 172.21.15.3:0/1311307812 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8900104d20 0x7f8900199d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:23:31.431 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.428+0000 7f8905e97640 1 -- 172.21.15.3:0/1311307812 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f890019a400 con 0x7f89001023f0 2024-09-21T12:23:31.431 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.428+0000 7f8905696640 1 --2- 172.21.15.3:0/1311307812 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8900104d20 0x7f8900199d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T12:23:31.431 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.428+0000 7f8905e97640 1 --2- 172.21.15.3:0/1311307812 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f89001023f0 0x7f8900199840 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f88f0009d70 tx=0x7f88f002fb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:23:31.431 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.428+0000 7f88feffd640 1 -- 172.21.15.3:0/1311307812 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f88f0034030 con 0x7f89001023f0 2024-09-21T12:23:31.431 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.428+0000 7f88feffd640 1 -- 172.21.15.3:0/1311307812 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f88f0030b20 con 0x7f89001023f0 2024-09-21T12:23:31.431 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.428+0000 7f89080fb640 1 -- 172.21.15.3:0/1311307812 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f890019ede0 con 0x7f89001023f0 2024-09-21T12:23:31.431 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.428+0000 7f88feffd640 1 -- 172.21.15.3:0/1311307812 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f88f0004740 con 0x7f89001023f0 2024-09-21T12:23:31.432 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.428+0000 7f89080fb640 1 -- 172.21.15.3:0/1311307812 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f890019f310 con 0x7f89001023f0 2024-09-21T12:23:31.432 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.429+0000 7f89080fb640 1 -- 172.21.15.3:0/1311307812 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8900102850 con 0x7f89001023f0 2024-09-21T12:23:31.432 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.430+0000 7f88feffd640 1 -- 172.21.15.3:0/1311307812 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f88f0037020 con 0x7f89001023f0 2024-09-21T12:23:31.432 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.430+0000 7f88feffd640 1 --2- 172.21.15.3:0/1311307812 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f88e807af80 0x7f88e807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:23:31.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.431+0000 7f88feffd640 1 -- 172.21.15.3:0/1311307812 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6156+0+0 (secure 0 0 0) 0x7f88f00befd0 con 0x7f89001023f0 2024-09-21T12:23:31.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.431+0000 7f8905696640 1 --2- 172.21.15.3:0/1311307812 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f88e807af80 0x7f88e807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:23:31.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.431+0000 7f8905696640 1 --2- 172.21.15.3:0/1311307812 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f88e807af80 0x7f88e807d440 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f88f4006fd0 tx=0x7f88f4008040 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:23:31.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.435+0000 7f88feffd640 1 -- 172.21.15.3:0/1311307812 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f88f008a650 con 0x7f89001023f0 2024-09-21T12:23:31.700 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.698+0000 7f89080fb640 1 -- 172.21.15.3:0/1311307812 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f8900062df0 con 0x7f89001023f0 2024-09-21T12:23:31.700 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.699+0000 7f88feffd640 1 -- 172.21.15.3:0/1311307812 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7f88f008f500 con 0x7f89001023f0 2024-09-21T12:23:31.700 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-21T12:23:31.701 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": { 2024-09-21T12:23:31.701 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2 2024-09-21T12:23:31.701 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:23:31.701 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": { 2024-09-21T12:23:31.701 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:23:31.701 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:23:31.701 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": { 2024-09-21T12:23:31.701 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 6 2024-09-21T12:23:31.701 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:23:31.701 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": { 2024-09-21T12:23:31.701 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 4 2024-09-21T12:23:31.701 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:23:31.701 INFO:teuthology.orchestra.run.smithi003.stdout: "overall": { 2024-09-21T12:23:31.702 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 12, 2024-09-21T12:23:31.702 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:23:31.702 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-21T12:23:31.702 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-21T12:23:31.703 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.701+0000 7f89080fb640 1 -- 172.21.15.3:0/1311307812 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f88e807af80 msgr2=0x7f88e807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:23:31.703 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.701+0000 7f89080fb640 1 --2- 172.21.15.3:0/1311307812 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f88e807af80 0x7f88e807d440 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f88f4006fd0 tx=0x7f88f4008040 comp rx=0 tx=0).stop 2024-09-21T12:23:31.703 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.701+0000 7f89080fb640 1 -- 172.21.15.3:0/1311307812 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f89001023f0 msgr2=0x7f8900199840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:23:31.703 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.701+0000 7f89080fb640 1 --2- 172.21.15.3:0/1311307812 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f89001023f0 0x7f8900199840 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f88f0009d70 tx=0x7f88f002fb90 comp rx=0 tx=0).stop 2024-09-21T12:23:31.703 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.701+0000 7f89080fb640 1 -- 172.21.15.3:0/1311307812 shutdown_connections 2024-09-21T12:23:31.703 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.701+0000 7f89080fb640 1 --2- 172.21.15.3:0/1311307812 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f88e807af80 0x7f88e807d440 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:23:31.703 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.701+0000 7f89080fb640 1 --2- 172.21.15.3:0/1311307812 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8900104d20 0x7f8900199d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:23:31.703 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.701+0000 7f89080fb640 1 --2- 172.21.15.3:0/1311307812 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f89001023f0 0x7f8900199840 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:23:31.703 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.701+0000 7f89080fb640 1 -- 172.21.15.3:0/1311307812 >> 172.21.15.3:0/1311307812 conn(0x7f89000fc010 msgr2=0x7f8900101b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:23:31.703 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.701+0000 7f89080fb640 1 -- 172.21.15.3:0/1311307812 shutdown_connections 2024-09-21T12:23:31.703 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.701+0000 7f89080fb640 1 -- 172.21.15.3:0/1311307812 wait complete. 2024-09-21T12:23:31.788 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.786+0000 7fda0ccd1640 1 -- 172.21.15.3:0/2894375052 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fda08102b60 msgr2=0x7fda08102fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:23:31.788 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.786+0000 7fda0ccd1640 1 --2- 172.21.15.3:0/2894375052 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fda08102b60 0x7fda08102fe0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fd9f0009880 tx=0x7fd9f002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:23:31.788 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.786+0000 7fda0ccd1640 1 -- 172.21.15.3:0/2894375052 shutdown_connections 2024-09-21T12:23:31.788 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.786+0000 7fda0ccd1640 1 --2- 172.21.15.3:0/2894375052 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fda08102b60 0x7fda08102fe0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:23:31.788 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.786+0000 7fda0ccd1640 1 --2- 172.21.15.3:0/2894375052 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda08101960 0x7fda08101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:23:31.788 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.786+0000 7fda0ccd1640 1 -- 172.21.15.3:0/2894375052 >> 172.21.15.3:0/2894375052 conn(0x7fda080fd0f0 msgr2=0x7fda080ff530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:23:31.788 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.786+0000 7fda0ccd1640 1 -- 172.21.15.3:0/2894375052 shutdown_connections 2024-09-21T12:23:31.788 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.786+0000 7fda0ccd1640 1 -- 172.21.15.3:0/2894375052 wait complete. 2024-09-21T12:23:31.790 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.787+0000 7fda0ccd1640 1 Processor -- start 2024-09-21T12:23:31.790 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.787+0000 7fda0ccd1640 1 -- start start 2024-09-21T12:23:31.790 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.787+0000 7fda0ccd1640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda08101960 0x7fda08075f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:23:31.790 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.787+0000 7fda0ccd1640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fda08102b60 0x7fda080745e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:23:31.790 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.787+0000 7fda0ccd1640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fda0810a7a0 con 0x7fda08102b60 2024-09-21T12:23:31.790 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.787+0000 7fda0ccd1640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fda0810a620 con 0x7fda08101960 2024-09-21T12:23:31.790 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.787+0000 7fd9fffff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fda08102b60 0x7fda080745e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:23:31.791 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.787+0000 7fd9fffff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fda08102b60 0x7fda080745e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:38290/0 (socket says 172.21.15.3:38290) 2024-09-21T12:23:31.791 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.787+0000 7fd9fffff640 1 -- 172.21.15.3:0/447783435 learned_addr learned my addr 172.21.15.3:0/447783435 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:23:31.791 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.788+0000 7fda0659c640 1 --2- 172.21.15.3:0/447783435 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda08101960 0x7fda08075f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:23:31.791 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.788+0000 7fd9fffff640 1 -- 172.21.15.3:0/447783435 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda08101960 msgr2=0x7fda08075f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:23:31.791 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.788+0000 7fd9fffff640 1 --2- 172.21.15.3:0/447783435 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda08101960 0x7fda08075f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:23:31.791 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.788+0000 7fd9fffff640 1 -- 172.21.15.3:0/447783435 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda08074b20 con 0x7fda08102b60 2024-09-21T12:23:31.791 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.788+0000 7fda0659c640 1 --2- 172.21.15.3:0/447783435 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda08101960 0x7fda08075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T12:23:31.791 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.788+0000 7fd9fffff640 1 --2- 172.21.15.3:0/447783435 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fda08102b60 0x7fda080745e0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fd9f0006010 tx=0x7fd9f00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:23:31.791 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.788+0000 7fd9ff7fe640 1 -- 172.21.15.3:0/447783435 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd9f003f070 con 0x7fda08102b60 2024-09-21T12:23:31.791 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.788+0000 7fd9ff7fe640 1 -- 172.21.15.3:0/447783435 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd9f00044d0 con 0x7fda08102b60 2024-09-21T12:23:31.791 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.788+0000 7fd9ff7fe640 1 -- 172.21.15.3:0/447783435 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd9f0035030 con 0x7fda08102b60 2024-09-21T12:23:31.791 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.788+0000 7fda0ccd1640 1 -- 172.21.15.3:0/447783435 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda08074db0 con 0x7fda08102b60 2024-09-21T12:23:31.791 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.788+0000 7fda0ccd1640 1 -- 172.21.15.3:0/447783435 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda080752e0 con 0x7fda08102b60 2024-09-21T12:23:31.792 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.789+0000 7fda0ccd1640 1 -- 172.21.15.3:0/447783435 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda08101d60 con 0x7fda08102b60 2024-09-21T12:23:31.792 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.790+0000 7fd9ff7fe640 1 -- 172.21.15.3:0/447783435 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7fd9f0042070 con 0x7fda08102b60 2024-09-21T12:23:31.792 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.791+0000 7fd9ff7fe640 1 --2- 172.21.15.3:0/447783435 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fd9f407af80 0x7fd9f407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:23:31.792 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.791+0000 7fd9ff7fe640 1 -- 172.21.15.3:0/447783435 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6156+0+0 (secure 0 0 0) 0x7fd9f00bed70 con 0x7fda08102b60 2024-09-21T12:23:31.792 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.791+0000 7fda0659c640 1 --2- 172.21.15.3:0/447783435 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fd9f407af80 0x7fd9f407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:23:31.793 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.791+0000 7fda0659c640 1 --2- 172.21.15.3:0/447783435 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fd9f407af80 0x7fd9f407d440 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd9f80058c0 tx=0x7fd9f8005d50 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:23:31.798 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:31.796+0000 7fd9ff7fe640 1 -- 172.21.15.3:0/447783435 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fd9f008a350 con 0x7fda08102b60 2024-09-21T12:23:32.014 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:32.012+0000 7fda0ccd1640 1 -- 172.21.15.3:0/447783435 --> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fda08062630 con 0x7fd9f407af80 2024-09-21T12:23:32.014 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:31 smithi003 ceph-mon[28057]: from='client.14850 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:23:32.014 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:31 smithi003 ceph-mon[28057]: pgmap v49: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-21T12:23:32.015 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:31 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/1311307812' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:23:32.015 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:32.014+0000 7fd9ff7fe640 1 -- 172.21.15.3:0/447783435 <== mgr.14756 v2:172.21.15.3:6800/1284098095 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+369 (secure 0 0 0) 0x7fda08062630 con 0x7fd9f407af80 2024-09-21T12:23:32.015 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-21T12:23:32.015 INFO:teuthology.orchestra.run.smithi003.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T12:23:32.015 INFO:teuthology.orchestra.run.smithi003.stdout: "in_progress": true, 2024-09-21T12:23:32.016 INFO:teuthology.orchestra.run.smithi003.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-21T12:23:32.016 INFO:teuthology.orchestra.run.smithi003.stdout: "services_complete": [ 2024-09-21T12:23:32.016 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr" 2024-09-21T12:23:32.016 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-21T12:23:32.016 INFO:teuthology.orchestra.run.smithi003.stdout: "progress": "2/2 daemons upgraded", 2024-09-21T12:23:32.016 INFO:teuthology.orchestra.run.smithi003.stdout: "message": "Currently upgrading alertmanager daemons", 2024-09-21T12:23:32.016 INFO:teuthology.orchestra.run.smithi003.stdout: "is_paused": false 2024-09-21T12:23:32.016 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-21T12:23:32.018 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:32.016+0000 7fda0ccd1640 1 -- 172.21.15.3:0/447783435 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fd9f407af80 msgr2=0x7fd9f407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:23:32.018 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:32.016+0000 7fda0ccd1640 1 --2- 172.21.15.3:0/447783435 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fd9f407af80 0x7fd9f407d440 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd9f80058c0 tx=0x7fd9f8005d50 comp rx=0 tx=0).stop 2024-09-21T12:23:32.018 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:32.016+0000 7fda0ccd1640 1 -- 172.21.15.3:0/447783435 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fda08102b60 msgr2=0x7fda080745e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:23:32.018 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:32.016+0000 7fda0ccd1640 1 --2- 172.21.15.3:0/447783435 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fda08102b60 0x7fda080745e0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fd9f0006010 tx=0x7fd9f00048f0 comp rx=0 tx=0).stop 2024-09-21T12:23:32.018 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:32.016+0000 7fda0ccd1640 1 -- 172.21.15.3:0/447783435 shutdown_connections 2024-09-21T12:23:32.018 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:32.016+0000 7fda0ccd1640 1 --2- 172.21.15.3:0/447783435 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fd9f407af80 0x7fd9f407d440 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:23:32.018 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:32.016+0000 7fda0ccd1640 1 --2- 172.21.15.3:0/447783435 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fda08102b60 0x7fda080745e0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:23:32.018 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:32.016+0000 7fda0ccd1640 1 --2- 172.21.15.3:0/447783435 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fda08101960 0x7fda08075f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:23:32.019 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:32.016+0000 7fda0ccd1640 1 -- 172.21.15.3:0/447783435 >> 172.21.15.3:0/447783435 conn(0x7fda080fd0f0 msgr2=0x7fda08105fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:23:32.019 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:32.016+0000 7fda0ccd1640 1 -- 172.21.15.3:0/447783435 shutdown_connections 2024-09-21T12:23:32.019 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:23:32.016+0000 7fda0ccd1640 1 -- 172.21.15.3:0/447783435 wait complete. 2024-09-21T12:23:32.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:31 smithi192 ceph-mon[35641]: from='client.14850 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:23:32.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:31 smithi192 ceph-mon[35641]: pgmap v49: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-21T12:23:32.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:31 smithi192 ceph-mon[35641]: from='client.? 172.21.15.3:0/1311307812' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:23:33.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:32 smithi003 ceph-mon[28057]: from='client.14854 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:23:33.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:32 smithi003 ceph-mon[28057]: from='client.14858 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:23:33.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:32 smithi192 ceph-mon[35641]: from='client.14854 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:23:33.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:32 smithi192 ceph-mon[35641]: from='client.14858 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:23:34.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:33 smithi192 ceph-mon[35641]: from='client.14866 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:23:34.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:33 smithi192 ceph-mon[35641]: pgmap v50: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-21T12:23:34.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:33 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:23:34.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:33 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:23:34.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:33 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:23:34.154 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:33 smithi003 ceph-mon[28057]: from='client.14866 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:23:34.154 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:33 smithi003 ceph-mon[28057]: pgmap v50: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-21T12:23:34.155 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:33 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:23:34.155 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:33 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:23:34.155 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:33 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:23:36.153 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:35 smithi003 ceph-mon[28057]: pgmap v51: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-21T12:23:36.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:35 smithi192 ceph-mon[35641]: pgmap v51: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-21T12:23:38.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:37 smithi192 ceph-mon[35641]: pgmap v52: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-21T12:23:38.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:37 smithi003 ceph-mon[28057]: pgmap v52: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-21T12:23:39.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:39 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:23:39.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:39 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:23:39.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:39 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:23:39.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:39 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:23:39.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:39 smithi192 ceph-mon[35641]: pgmap v53: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-21T12:23:39.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:39 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:23:39.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:39 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:23:39.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:39 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:23:39.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:39 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:23:39.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:39 smithi003 ceph-mon[28057]: pgmap v53: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-21T12:23:42.064 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:41 smithi003 ceph-mon[28057]: pgmap v54: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-21T12:23:42.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:41 smithi192 ceph-mon[35641]: pgmap v54: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 255 B/s wr, 0 op/s 2024-09-21T12:23:44.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:43 smithi003 ceph-mon[28057]: pgmap v55: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:44.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:43 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:23:44.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:43 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:23:44.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:43 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:23:44.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:43 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:23:44.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:43 smithi192 ceph-mon[35641]: pgmap v55: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:44.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:43 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:23:44.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:43 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:23:44.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:43 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:23:44.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:43 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:23:45.165 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:44 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:23:45.166 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:44 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-21T12:23:45.166 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:44 smithi003 ceph-mon[28057]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-21T12:23:45.166 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:44 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:23:45.166 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:44 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:23:45.166 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:44 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:23:45.166 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:44 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:23:45.166 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:44 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:23:45.166 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:44 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:23:45.166 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:44 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:23:45.166 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:44 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:23:45.166 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:44 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:23:45.166 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:44 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:23:45.166 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:44 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:23:45.167 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:44 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:23:45.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:44 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:23:45.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:44 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-21T12:23:45.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:44 smithi192 ceph-mon[35641]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-21T12:23:45.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:44 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:23:45.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:44 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:23:45.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:44 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:23:45.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:44 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:23:45.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:44 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:23:45.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:44 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:23:45.259 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:44 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:23:45.259 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:44 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:23:45.259 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:44 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:23:45.259 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:44 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:23:45.259 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:44 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:23:45.259 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:44 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:23:46.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:45 smithi192 ceph-mon[35641]: pgmap v56: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:46.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:45 smithi003 ceph-mon[28057]: pgmap v56: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:47.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:46 smithi192 ceph-mon[35641]: Upgrade: Updating grafana.smithi003 2024-09-21T12:23:47.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:46 smithi192 ceph-mon[35641]: Deploying daemon grafana.smithi003 on smithi003 2024-09-21T12:23:47.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:46 smithi003 ceph-mon[28057]: Upgrade: Updating grafana.smithi003 2024-09-21T12:23:47.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:46 smithi003 ceph-mon[28057]: Deploying daemon grafana.smithi003 on smithi003 2024-09-21T12:23:48.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:47 smithi192 ceph-mon[35641]: pgmap v57: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:48.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:47 smithi003 ceph-mon[28057]: pgmap v57: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:50.250 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:49 smithi003 ceph-mon[28057]: pgmap v58: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:50.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:49 smithi192 ceph-mon[35641]: pgmap v58: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:52.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:51 smithi192 ceph-mon[35641]: pgmap v59: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:52.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:51 smithi003 ceph-mon[28057]: pgmap v59: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:54.155 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:53 smithi003 ceph-mon[28057]: pgmap v60: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:54.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:53 smithi192 ceph-mon[35641]: pgmap v60: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:56.065 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:55 smithi003 ceph-mon[28057]: pgmap v61: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:56.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:55 smithi192 ceph-mon[35641]: pgmap v61: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:57.983 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:57 smithi003 ceph-mon[28057]: pgmap v62: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:57.983 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:57 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:23:57.983 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:57 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:23:57.983 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:57 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:23:58.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:57 smithi192 ceph-mon[35641]: pgmap v62: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:23:58.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:57 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:23:58.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:57 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:23:58.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:57 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:24:00.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:59 smithi003 ceph-mon[28057]: pgmap v63: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:00.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:23:59 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:24:00.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:59 smithi192 ceph-mon[35641]: pgmap v63: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:00.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:23:59 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:24:02.056 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:01 smithi003 ceph-mon[28057]: pgmap v64: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:02.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.104+0000 7f756c970640 1 -- 172.21.15.3:0/2159924723 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f75681023f0 msgr2=0x7f75681047e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:02.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.104+0000 7f756c970640 1 --2- 172.21.15.3:0/2159924723 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f75681023f0 0x7f75681047e0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f75580098b0 tx=0x7f755802a4d0 comp rx=0 tx=0).stop 2024-09-21T12:24:02.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.104+0000 7f756c970640 1 -- 172.21.15.3:0/2159924723 shutdown_connections 2024-09-21T12:24:02.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.104+0000 7f756c970640 1 --2- 172.21.15.3:0/2159924723 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7568104d20 0x7f7568107110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:02.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.104+0000 7f756c970640 1 --2- 172.21.15.3:0/2159924723 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f75681023f0 0x7f75681047e0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:02.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.104+0000 7f756c970640 1 -- 172.21.15.3:0/2159924723 >> 172.21.15.3:0/2159924723 conn(0x7f75680fc010 msgr2=0x7f75680fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:24:02.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.104+0000 7f756c970640 1 -- 172.21.15.3:0/2159924723 shutdown_connections 2024-09-21T12:24:02.108 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.104+0000 7f756c970640 1 -- 172.21.15.3:0/2159924723 wait complete. 2024-09-21T12:24:02.109 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.105+0000 7f756c970640 1 Processor -- start 2024-09-21T12:24:02.109 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.105+0000 7f756c970640 1 -- start start 2024-09-21T12:24:02.109 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.105+0000 7f756c970640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f75681023f0 0x7f7568197570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:24:02.109 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.105+0000 7f756c970640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7568104d20 0x7f7568197ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:24:02.109 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.105+0000 7f756c970640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f756810a7e0 con 0x7f7568104d20 2024-09-21T12:24:02.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.105+0000 7f756c970640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f756810a660 con 0x7f75681023f0 2024-09-21T12:24:02.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.105+0000 7f755ffff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7568104d20 0x7f7568197ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:24:02.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.105+0000 7f755ffff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7568104d20 0x7f7568197ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:49848/0 (socket says 172.21.15.3:49848) 2024-09-21T12:24:02.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.105+0000 7f755ffff640 1 -- 172.21.15.3:0/4188013261 learned_addr learned my addr 172.21.15.3:0/4188013261 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:24:02.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.106+0000 7f756659c640 1 --2- 172.21.15.3:0/4188013261 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f75681023f0 0x7f7568197570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:24:02.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.106+0000 7f755ffff640 1 -- 172.21.15.3:0/4188013261 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f75681023f0 msgr2=0x7f7568197570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:02.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.106+0000 7f755ffff640 1 --2- 172.21.15.3:0/4188013261 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f75681023f0 0x7f7568197570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:02.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.106+0000 7f755ffff640 1 -- 172.21.15.3:0/4188013261 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7568198130 con 0x7f7568104d20 2024-09-21T12:24:02.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.106+0000 7f755ffff640 1 --2- 172.21.15.3:0/4188013261 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7568104d20 0x7f7568197ab0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f755000e970 tx=0x7f755000ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:24:02.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.106+0000 7f755f7fe640 1 -- 172.21.15.3:0/4188013261 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f755000cac0 con 0x7f7568104d20 2024-09-21T12:24:02.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.106+0000 7f755f7fe640 1 -- 172.21.15.3:0/4188013261 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f75500054e0 con 0x7f7568104d20 2024-09-21T12:24:02.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.106+0000 7f755f7fe640 1 -- 172.21.15.3:0/4188013261 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7550010430 con 0x7f7568104d20 2024-09-21T12:24:02.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.106+0000 7f756c970640 1 -- 172.21.15.3:0/4188013261 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f756819cb70 con 0x7f7568104d20 2024-09-21T12:24:02.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.106+0000 7f756c970640 1 -- 172.21.15.3:0/4188013261 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f756819d100 con 0x7f7568104d20 2024-09-21T12:24:02.111 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.107+0000 7f756c970640 1 -- 172.21.15.3:0/4188013261 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75681027d0 con 0x7f7568104d20 2024-09-21T12:24:02.111 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.108+0000 7f755f7fe640 1 -- 172.21.15.3:0/4188013261 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f7550004ee0 con 0x7f7568104d20 2024-09-21T12:24:02.111 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.108+0000 7f755f7fe640 1 --2- 172.21.15.3:0/4188013261 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f755407af80 0x7f755407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:24:02.112 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.108+0000 7f755f7fe640 1 -- 172.21.15.3:0/4188013261 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6156+0+0 (secure 0 0 0) 0x7f755009e6a0 con 0x7f7568104d20 2024-09-21T12:24:02.112 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.108+0000 7f756659c640 1 --2- 172.21.15.3:0/4188013261 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f755407af80 0x7f755407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:24:02.112 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.109+0000 7f756659c640 1 --2- 172.21.15.3:0/4188013261 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f755407af80 0x7f755407d440 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7558000c00 tx=0x7f7558005a20 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:24:02.115 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.113+0000 7f755f7fe640 1 -- 172.21.15.3:0/4188013261 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f7550069d20 con 0x7f7568104d20 2024-09-21T12:24:02.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:01 smithi192 ceph-mon[35641]: pgmap v64: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:02.331 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.328+0000 7f756c970640 1 -- 172.21.15.3:0/4188013261 --> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f7568105700 con 0x7f755407af80 2024-09-21T12:24:02.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.329+0000 7f755f7fe640 1 -- 172.21.15.3:0/4188013261 <== mgr.14756 v2:172.21.15.3:6800/1284098095 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+364 (secure 0 0 0) 0x7f7568105700 con 0x7f755407af80 2024-09-21T12:24:02.334 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.331+0000 7f756c970640 1 -- 172.21.15.3:0/4188013261 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f755407af80 msgr2=0x7f755407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:02.334 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.331+0000 7f756c970640 1 --2- 172.21.15.3:0/4188013261 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f755407af80 0x7f755407d440 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7558000c00 tx=0x7f7558005a20 comp rx=0 tx=0).stop 2024-09-21T12:24:02.334 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.331+0000 7f756c970640 1 -- 172.21.15.3:0/4188013261 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7568104d20 msgr2=0x7f7568197ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:02.334 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.331+0000 7f756c970640 1 --2- 172.21.15.3:0/4188013261 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7568104d20 0x7f7568197ab0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f755000e970 tx=0x7f755000ee30 comp rx=0 tx=0).stop 2024-09-21T12:24:02.334 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.331+0000 7f756c970640 1 -- 172.21.15.3:0/4188013261 shutdown_connections 2024-09-21T12:24:02.335 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.331+0000 7f756c970640 1 --2- 172.21.15.3:0/4188013261 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f755407af80 0x7f755407d440 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:02.335 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.331+0000 7f756c970640 1 --2- 172.21.15.3:0/4188013261 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7568104d20 0x7f7568197ab0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:02.335 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.331+0000 7f756c970640 1 --2- 172.21.15.3:0/4188013261 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f75681023f0 0x7f7568197570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:02.335 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.331+0000 7f756c970640 1 -- 172.21.15.3:0/4188013261 >> 172.21.15.3:0/4188013261 conn(0x7f75680fc010 msgr2=0x7f75680fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:24:02.335 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.332+0000 7f756c970640 1 -- 172.21.15.3:0/4188013261 shutdown_connections 2024-09-21T12:24:02.335 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.332+0000 7f756c970640 1 -- 172.21.15.3:0/4188013261 wait complete. 2024-09-21T12:24:02.342 INFO:teuthology.orchestra.run.smithi003.stdout:true 2024-09-21T12:24:02.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.417+0000 7fe406287640 1 -- 172.21.15.3:0/4068041101 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe400102490 msgr2=0x7fe400104880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:02.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.417+0000 7fe406287640 1 --2- 172.21.15.3:0/4068041101 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe400102490 0x7fe400104880 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fe3f0009880 tx=0x7fe3f002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:24:02.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.417+0000 7fe406287640 1 -- 172.21.15.3:0/4068041101 shutdown_connections 2024-09-21T12:24:02.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.417+0000 7fe406287640 1 --2- 172.21.15.3:0/4068041101 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe400104dc0 0x7fe4001071b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:02.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.417+0000 7fe406287640 1 --2- 172.21.15.3:0/4068041101 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe400102490 0x7fe400104880 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:02.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.417+0000 7fe406287640 1 -- 172.21.15.3:0/4068041101 >> 172.21.15.3:0/4068041101 conn(0x7fe4000fc010 msgr2=0x7fe4000fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:24:02.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.417+0000 7fe406287640 1 -- 172.21.15.3:0/4068041101 shutdown_connections 2024-09-21T12:24:02.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.417+0000 7fe406287640 1 -- 172.21.15.3:0/4068041101 wait complete. 2024-09-21T12:24:02.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.417+0000 7fe406287640 1 Processor -- start 2024-09-21T12:24:02.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.417+0000 7fe406287640 1 -- start start 2024-09-21T12:24:02.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.418+0000 7fe406287640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe400102490 0x7fe400197520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:24:02.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.418+0000 7fe406287640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe400104dc0 0x7fe400197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:24:02.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.418+0000 7fe406287640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fe40010a7d0 con 0x7fe400104dc0 2024-09-21T12:24:02.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.418+0000 7fe406287640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe40010a650 con 0x7fe400102490 2024-09-21T12:24:02.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.418+0000 7fe3f7fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe400104dc0 0x7fe400197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:24:02.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.418+0000 7fe3f7fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe400104dc0 0x7fe400197a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:49860/0 (socket says 172.21.15.3:49860) 2024-09-21T12:24:02.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.418+0000 7fe3f7fff640 1 -- 172.21.15.3:0/1147841725 learned_addr learned my addr 172.21.15.3:0/1147841725 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:24:02.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.418+0000 7fe3fffff640 1 --2- 172.21.15.3:0/1147841725 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe400102490 0x7fe400197520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:24:02.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.418+0000 7fe3f7fff640 1 -- 172.21.15.3:0/1147841725 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe400102490 msgr2=0x7fe400197520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:02.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.418+0000 7fe3f7fff640 1 --2- 172.21.15.3:0/1147841725 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe400102490 0x7fe400197520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:02.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.418+0000 7fe3f7fff640 1 -- 172.21.15.3:0/1147841725 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4001980e0 con 0x7fe400104dc0 2024-09-21T12:24:02.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.418+0000 7fe3f7fff640 1 --2- 172.21.15.3:0/1147841725 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe400104dc0 0x7fe400197a60 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fe3e800e970 tx=0x7fe3e800ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:24:02.423 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.418+0000 7fe3fdffb640 1 -- 172.21.15.3:0/1147841725 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe3e800cac0 con 0x7fe400104dc0 2024-09-21T12:24:02.423 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.418+0000 7fe3fdffb640 1 -- 172.21.15.3:0/1147841725 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe3e80054e0 con 0x7fe400104dc0 2024-09-21T12:24:02.423 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.418+0000 7fe406287640 1 -- 172.21.15.3:0/1147841725 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe40019cb20 con 0x7fe400104dc0 2024-09-21T12:24:02.423 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.419+0000 7fe3fdffb640 1 -- 172.21.15.3:0/1147841725 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe3e8010430 con 0x7fe400104dc0 2024-09-21T12:24:02.423 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.419+0000 7fe406287640 1 -- 172.21.15.3:0/1147841725 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe40019d0b0 con 0x7fe400104dc0 2024-09-21T12:24:02.423 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.420+0000 7fe406287640 1 -- 172.21.15.3:0/1147841725 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe400102870 con 0x7fe400104dc0 2024-09-21T12:24:02.424 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.420+0000 7fe3fdffb640 1 -- 172.21.15.3:0/1147841725 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7fe3e8004ee0 con 0x7fe400104dc0 2024-09-21T12:24:02.424 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.421+0000 7fe3fdffb640 1 --2- 172.21.15.3:0/1147841725 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fe3ec07af80 0x7fe3ec07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:24:02.424 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.421+0000 7fe3fdffb640 1 -- 172.21.15.3:0/1147841725 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6156+0+0 (secure 0 0 0) 0x7fe3e809e5b0 con 0x7fe400104dc0 2024-09-21T12:24:02.424 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.421+0000 7fe3fffff640 1 --2- 172.21.15.3:0/1147841725 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fe3ec07af80 0x7fe3ec07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:24:02.424 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.421+0000 7fe3fffff640 1 --2- 172.21.15.3:0/1147841725 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fe3ec07af80 0x7fe3ec07d440 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe3f0000c00 tx=0x7fe3f00058d0 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:24:02.428 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.425+0000 7fe3fdffb640 1 -- 172.21.15.3:0/1147841725 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fe3e8069c30 con 0x7fe400104dc0 2024-09-21T12:24:02.637 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.635+0000 7fe406287640 1 -- 172.21.15.3:0/1147841725 --> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fe400105740 con 0x7fe3ec07af80 2024-09-21T12:24:02.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.636+0000 7fe3fdffb640 1 -- 172.21.15.3:0/1147841725 <== mgr.14756 v2:172.21.15.3:6800/1284098095 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+364 (secure 0 0 0) 0x7fe400105740 con 0x7fe3ec07af80 2024-09-21T12:24:02.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.638+0000 7fe406287640 1 -- 172.21.15.3:0/1147841725 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fe3ec07af80 msgr2=0x7fe3ec07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:02.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.638+0000 7fe406287640 1 --2- 172.21.15.3:0/1147841725 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fe3ec07af80 0x7fe3ec07d440 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fe3f0000c00 tx=0x7fe3f00058d0 comp rx=0 tx=0).stop 2024-09-21T12:24:02.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.638+0000 7fe406287640 1 -- 172.21.15.3:0/1147841725 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe400104dc0 msgr2=0x7fe400197a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:02.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.638+0000 7fe406287640 1 --2- 172.21.15.3:0/1147841725 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe400104dc0 0x7fe400197a60 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fe3e800e970 tx=0x7fe3e800ee30 comp rx=0 tx=0).stop 2024-09-21T12:24:02.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.638+0000 7fe406287640 1 -- 172.21.15.3:0/1147841725 shutdown_connections 2024-09-21T12:24:02.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.638+0000 7fe406287640 1 --2- 172.21.15.3:0/1147841725 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fe3ec07af80 0x7fe3ec07d440 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:02.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.638+0000 7fe406287640 1 --2- 172.21.15.3:0/1147841725 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe400104dc0 0x7fe400197a60 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:02.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.638+0000 7fe406287640 1 --2- 172.21.15.3:0/1147841725 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe400102490 0x7fe400197520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:02.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.638+0000 7fe406287640 1 -- 172.21.15.3:0/1147841725 >> 172.21.15.3:0/1147841725 conn(0x7fe4000fc010 msgr2=0x7fe4000fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:24:02.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.638+0000 7fe406287640 1 -- 172.21.15.3:0/1147841725 shutdown_connections 2024-09-21T12:24:02.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.638+0000 7fe406287640 1 -- 172.21.15.3:0/1147841725 wait complete. 2024-09-21T12:24:02.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.722+0000 7fd2d0aa7640 1 -- 172.21.15.3:0/2684744181 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd2cc101a60 msgr2=0x7fd2cc101ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:02.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.722+0000 7fd2d0aa7640 1 --2- 172.21.15.3:0/2684744181 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd2cc101a60 0x7fd2cc101ee0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fd2c0009880 tx=0x7fd2c002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:24:02.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.722+0000 7fd2d0aa7640 1 -- 172.21.15.3:0/2684744181 shutdown_connections 2024-09-21T12:24:02.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.722+0000 7fd2d0aa7640 1 --2- 172.21.15.3:0/2684744181 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd2cc101a60 0x7fd2cc101ee0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:02.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.722+0000 7fd2d0aa7640 1 --2- 172.21.15.3:0/2684744181 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd2cc100860 0x7fd2cc100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:02.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.722+0000 7fd2d0aa7640 1 -- 172.21.15.3:0/2684744181 >> 172.21.15.3:0/2684744181 conn(0x7fd2cc0fc010 msgr2=0x7fd2cc0fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:24:02.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.722+0000 7fd2d0aa7640 1 -- 172.21.15.3:0/2684744181 shutdown_connections 2024-09-21T12:24:02.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.722+0000 7fd2d0aa7640 1 -- 172.21.15.3:0/2684744181 wait complete. 2024-09-21T12:24:02.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.723+0000 7fd2d0aa7640 1 Processor -- start 2024-09-21T12:24:02.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.723+0000 7fd2d0aa7640 1 -- start start 2024-09-21T12:24:02.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.723+0000 7fd2d0aa7640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd2cc100860 0x7fd2cc197520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:24:02.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.723+0000 7fd2d0aa7640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd2cc101a60 0x7fd2cc197a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:24:02.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.723+0000 7fd2d0aa7640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fd2cc109680 con 0x7fd2cc101a60 2024-09-21T12:24:02.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.723+0000 7fd2d0aa7640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd2cc109500 con 0x7fd2cc100860 2024-09-21T12:24:02.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.723+0000 7fd2c9d9b640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd2cc101a60 0x7fd2cc197a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:24:02.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.723+0000 7fd2c9d9b640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd2cc101a60 0x7fd2cc197a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:49892/0 (socket says 172.21.15.3:49892) 2024-09-21T12:24:02.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.723+0000 7fd2c9d9b640 1 -- 172.21.15.3:0/1350616125 learned_addr learned my addr 172.21.15.3:0/1350616125 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:24:02.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.723+0000 7fd2ca59c640 1 --2- 172.21.15.3:0/1350616125 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd2cc100860 0x7fd2cc197520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:24:02.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.724+0000 7fd2c9d9b640 1 -- 172.21.15.3:0/1350616125 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd2cc100860 msgr2=0x7fd2cc197520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:02.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.724+0000 7fd2c9d9b640 1 --2- 172.21.15.3:0/1350616125 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd2cc100860 0x7fd2cc197520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:02.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.724+0000 7fd2c9d9b640 1 -- 172.21.15.3:0/1350616125 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2cc1980e0 con 0x7fd2cc101a60 2024-09-21T12:24:02.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.724+0000 7fd2c9d9b640 1 --2- 172.21.15.3:0/1350616125 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd2cc101a60 0x7fd2cc197a60 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fd2c0006010 tx=0x7fd2c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:24:02.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.724+0000 7fd2bb7fe640 1 -- 172.21.15.3:0/1350616125 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd2c003f070 con 0x7fd2cc101a60 2024-09-21T12:24:02.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.724+0000 7fd2d0aa7640 1 -- 172.21.15.3:0/1350616125 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2cc19cac0 con 0x7fd2cc101a60 2024-09-21T12:24:02.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.724+0000 7fd2bb7fe640 1 -- 172.21.15.3:0/1350616125 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd2c0004ac0 con 0x7fd2cc101a60 2024-09-21T12:24:02.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.724+0000 7fd2bb7fe640 1 -- 172.21.15.3:0/1350616125 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd2c0035030 con 0x7fd2cc101a60 2024-09-21T12:24:02.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.724+0000 7fd2d0aa7640 1 -- 172.21.15.3:0/1350616125 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2cc19d050 con 0x7fd2cc101a60 2024-09-21T12:24:02.729 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.725+0000 7fd2d0aa7640 1 -- 172.21.15.3:0/1350616125 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2cc100c60 con 0x7fd2cc101a60 2024-09-21T12:24:02.729 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.726+0000 7fd2bb7fe640 1 -- 172.21.15.3:0/1350616125 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7fd2c0042070 con 0x7fd2cc101a60 2024-09-21T12:24:02.729 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.726+0000 7fd2bb7fe640 1 --2- 172.21.15.3:0/1350616125 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fd2b407af30 0x7fd2b407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:24:02.729 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.727+0000 7fd2bb7fe640 1 -- 172.21.15.3:0/1350616125 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6156+0+0 (secure 0 0 0) 0x7fd2c00beca0 con 0x7fd2cc101a60 2024-09-21T12:24:02.729 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.727+0000 7fd2ca59c640 1 --2- 172.21.15.3:0/1350616125 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fd2b407af30 0x7fd2b407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:24:02.730 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.727+0000 7fd2ca59c640 1 --2- 172.21.15.3:0/1350616125 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fd2b407af30 0x7fd2b407d3f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc1018c0 tx=0x7fd2bc00b390 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:24:02.733 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.731+0000 7fd2bb7fe640 1 -- 172.21.15.3:0/1350616125 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fd2c008a200 con 0x7fd2cc101a60 2024-09-21T12:24:02.930 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.928+0000 7fd2d0aa7640 1 -- 172.21.15.3:0/1350616125 --> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fd2cc06a460 con 0x7fd2b407af30 2024-09-21T12:24:02.940 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.937+0000 7fd2bb7fe640 1 -- 172.21.15.3:0/1350616125 <== mgr.14756 v2:172.21.15.3:6800/1284098095 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fd2cc06a460 con 0x7fd2b407af30 2024-09-21T12:24:02.940 INFO:teuthology.orchestra.run.smithi003.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:24:02.940 INFO:teuthology.orchestra.run.smithi003.stdout:alertmanager.smithi003 smithi003 *:9093,9094 running (30s) 24s ago 11m 15.2M - 0.27.0 11f11916f8cd 14880018dfd3 2024-09-21T12:24:02.940 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-exporter.smithi003 smithi003 running (2m) 24s ago 11m 8530k - 19.1.1-373-g4e45e6b4 164465d2334a 0c9ad60a4f5a 2024-09-21T12:24:02.940 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-exporter.smithi192 smithi192 running (2m) 69s ago 11m 8124k - 19.1.1-373-g4e45e6b4 164465d2334a d5be8a6e120f 2024-09-21T12:24:02.940 INFO:teuthology.orchestra.run.smithi003.stdout:crash.smithi003 smithi003 running (11m) 24s ago 11m 6899k - 19.1.1-373-g4e45e6b4 164465d2334a c63f209dc1dc 2024-09-21T12:24:02.941 INFO:teuthology.orchestra.run.smithi003.stdout:crash.smithi192 smithi192 running (11m) 69s ago 11m 6895k - 19.1.1-373-g4e45e6b4 164465d2334a cc70c9a7b2f7 2024-09-21T12:24:02.941 INFO:teuthology.orchestra.run.smithi003.stdout:grafana.smithi003 smithi003 *:3000 starting - - - - 2024-09-21T12:24:02.941 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi003.ebjgyl smithi003 running (6m) 24s ago 6m 15.2M - 19.1.1-373-g4e45e6b4 164465d2334a 16e0b2cac16a 2024-09-21T12:24:02.941 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi003.gfkngj smithi003 running (6m) 24s ago 6m 145M - 19.1.1-373-g4e45e6b4 164465d2334a 109c04f87fbd 2024-09-21T12:24:02.941 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi192.ktdqns smithi192 running (6m) 69s ago 6m 16.7M - 19.1.1-373-g4e45e6b4 164465d2334a 495c73fb3bb0 2024-09-21T12:24:02.941 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi192.ywqqxe smithi192 running (6m) 69s ago 6m 16.7M - 19.1.1-373-g4e45e6b4 164465d2334a 270a01030cbe 2024-09-21T12:24:02.941 INFO:teuthology.orchestra.run.smithi003.stdout:mgr.smithi003.wztftl smithi003 *:8443,9283,8765 running (2m) 24s ago 13m 512M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 8ce0e66fd369 2024-09-21T12:24:02.941 INFO:teuthology.orchestra.run.smithi003.stdout:mgr.smithi192.qsaprd smithi192 *:8443,9283,8765 running (94s) 69s ago 10m 455M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 002a6171dd47 2024-09-21T12:24:02.941 INFO:teuthology.orchestra.run.smithi003.stdout:mon.smithi003 smithi003 running (13m) 24s ago 13m 59.4M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 16bccf2c7503 2024-09-21T12:24:02.941 INFO:teuthology.orchestra.run.smithi003.stdout:mon.smithi192 smithi192 running (10m) 69s ago 10m 43.1M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 4fe4c4b3dc5d 2024-09-21T12:24:02.941 INFO:teuthology.orchestra.run.smithi003.stdout:node-exporter.smithi003 smithi003 *:9100 running (78s) 24s ago 11m 8958k - 1.7.0 72c9c2088986 d9cb7ede9060 2024-09-21T12:24:02.941 INFO:teuthology.orchestra.run.smithi003.stdout:node-exporter.smithi192 smithi192 *:9100 running (72s) 69s ago 10m 3343k - 1.7.0 72c9c2088986 d8ec0acfce7e 2024-09-21T12:24:02.941 INFO:teuthology.orchestra.run.smithi003.stdout:osd.0 smithi003 running (9m) 24s ago 9m 201M 1217M 19.1.1-373-g4e45e6b4 164465d2334a d07f1489720d 2024-09-21T12:24:02.942 INFO:teuthology.orchestra.run.smithi003.stdout:osd.1 smithi003 running (9m) 24s ago 9m 210M 1217M 19.1.1-373-g4e45e6b4 164465d2334a 6abd75a07645 2024-09-21T12:24:02.942 INFO:teuthology.orchestra.run.smithi003.stdout:osd.2 smithi003 running (8m) 24s ago 8m 173M 1217M 19.1.1-373-g4e45e6b4 164465d2334a 3265369e573b 2024-09-21T12:24:02.942 INFO:teuthology.orchestra.run.smithi003.stdout:osd.3 smithi192 running (8m) 69s ago 8m 237M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 13efcfd71c05 2024-09-21T12:24:02.942 INFO:teuthology.orchestra.run.smithi003.stdout:osd.4 smithi192 running (7m) 69s ago 7m 202M 2240M 19.1.1-373-g4e45e6b4 164465d2334a f33bf453cb3e 2024-09-21T12:24:02.942 INFO:teuthology.orchestra.run.smithi003.stdout:osd.5 smithi192 running (7m) 69s ago 7m 180M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 12d7b7c8e985 2024-09-21T12:24:02.942 INFO:teuthology.orchestra.run.smithi003.stdout:prometheus.smithi003 smithi003 *:9095 running (49s) 24s ago 11m 41.8M - 2.51.0 1d3b7f56885b 64997a33fbbb 2024-09-21T12:24:02.943 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.940+0000 7fd2d0aa7640 1 -- 172.21.15.3:0/1350616125 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fd2b407af30 msgr2=0x7fd2b407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:02.943 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.940+0000 7fd2d0aa7640 1 --2- 172.21.15.3:0/1350616125 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fd2b407af30 0x7fd2b407d3f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc1018c0 tx=0x7fd2bc00b390 comp rx=0 tx=0).stop 2024-09-21T12:24:02.943 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.940+0000 7fd2d0aa7640 1 -- 172.21.15.3:0/1350616125 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd2cc101a60 msgr2=0x7fd2cc197a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:02.943 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.940+0000 7fd2d0aa7640 1 --2- 172.21.15.3:0/1350616125 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd2cc101a60 0x7fd2cc197a60 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fd2c0006010 tx=0x7fd2c00046c0 comp rx=0 tx=0).stop 2024-09-21T12:24:02.943 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.940+0000 7fd2d0aa7640 1 -- 172.21.15.3:0/1350616125 shutdown_connections 2024-09-21T12:24:02.943 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.940+0000 7fd2d0aa7640 1 --2- 172.21.15.3:0/1350616125 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fd2b407af30 0x7fd2b407d3f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:02.943 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.940+0000 7fd2d0aa7640 1 --2- 172.21.15.3:0/1350616125 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd2cc101a60 0x7fd2cc197a60 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:02.943 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.940+0000 7fd2d0aa7640 1 --2- 172.21.15.3:0/1350616125 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd2cc100860 0x7fd2cc197520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:02.943 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.940+0000 7fd2d0aa7640 1 -- 172.21.15.3:0/1350616125 >> 172.21.15.3:0/1350616125 conn(0x7fd2cc0fc010 msgr2=0x7fd2cc069d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:24:02.943 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.940+0000 7fd2d0aa7640 1 -- 172.21.15.3:0/1350616125 shutdown_connections 2024-09-21T12:24:02.944 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:02.940+0000 7fd2d0aa7640 1 -- 172.21.15.3:0/1350616125 wait complete. 2024-09-21T12:24:03.026 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.023+0000 7f1208264640 1 -- 172.21.15.3:0/3224067658 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1200100b20 msgr2=0x7f1200100f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:03.026 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.023+0000 7f1208264640 1 --2- 172.21.15.3:0/3224067658 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1200100b20 0x7f1200100f80 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f11f0009880 tx=0x7f11f002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:24:03.026 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.024+0000 7f1208264640 1 -- 172.21.15.3:0/3224067658 shutdown_connections 2024-09-21T12:24:03.027 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.024+0000 7f1208264640 1 --2- 172.21.15.3:0/3224067658 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1200100b20 0x7f1200100f80 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:03.027 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.024+0000 7f1208264640 1 --2- 172.21.15.3:0/3224067658 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f12001001e0 0x7f12001005e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:03.027 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.024+0000 7f1208264640 1 -- 172.21.15.3:0/3224067658 >> 172.21.15.3:0/3224067658 conn(0x7f12000fc010 msgr2=0x7f12000fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:24:03.027 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.024+0000 7f1208264640 1 -- 172.21.15.3:0/3224067658 shutdown_connections 2024-09-21T12:24:03.027 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.024+0000 7f1208264640 1 -- 172.21.15.3:0/3224067658 wait complete. 2024-09-21T12:24:03.028 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.024+0000 7f1208264640 1 Processor -- start 2024-09-21T12:24:03.028 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.024+0000 7f1208264640 1 -- start start 2024-09-21T12:24:03.028 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.024+0000 7f1208264640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f12001001e0 0x7f12001996f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:24:03.029 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.024+0000 7f1208264640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1200100b20 0x7f1200199c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:24:03.029 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.024+0000 7f1208264640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f120010c9f0 con 0x7f1200100b20 2024-09-21T12:24:03.029 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.024+0000 7f1208264640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f120010c870 con 0x7f12001001e0 2024-09-21T12:24:03.029 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.025+0000 7f12057ff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1200100b20 0x7f1200199c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:24:03.029 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.025+0000 7f12057ff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1200100b20 0x7f1200199c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:49914/0 (socket says 172.21.15.3:49914) 2024-09-21T12:24:03.029 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.025+0000 7f12057ff640 1 -- 172.21.15.3:0/884744028 learned_addr learned my addr 172.21.15.3:0/884744028 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:24:03.029 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.025+0000 7f1206000640 1 --2- 172.21.15.3:0/884744028 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f12001001e0 0x7f12001996f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:24:03.029 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.025+0000 7f12057ff640 1 -- 172.21.15.3:0/884744028 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f12001001e0 msgr2=0x7f12001996f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:03.029 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.025+0000 7f12057ff640 1 --2- 172.21.15.3:0/884744028 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f12001001e0 0x7f12001996f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:03.029 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.025+0000 7f12057ff640 1 -- 172.21.15.3:0/884744028 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f120019a2b0 con 0x7f1200100b20 2024-09-21T12:24:03.029 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.025+0000 7f12057ff640 1 --2- 172.21.15.3:0/884744028 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1200100b20 0x7f1200199c30 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f11f0006010 tx=0x7f11f00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:24:03.029 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.025+0000 7f11f6ffd640 1 -- 172.21.15.3:0/884744028 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f11f003f070 con 0x7f1200100b20 2024-09-21T12:24:03.029 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.025+0000 7f1208264640 1 -- 172.21.15.3:0/884744028 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f120019ec90 con 0x7f1200100b20 2024-09-21T12:24:03.030 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.025+0000 7f11f6ffd640 1 -- 172.21.15.3:0/884744028 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f11f00044d0 con 0x7f1200100b20 2024-09-21T12:24:03.030 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.025+0000 7f11f6ffd640 1 -- 172.21.15.3:0/884744028 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f11f0035030 con 0x7f1200100b20 2024-09-21T12:24:03.030 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.025+0000 7f1208264640 1 -- 172.21.15.3:0/884744028 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f120019f240 con 0x7f1200100b20 2024-09-21T12:24:03.030 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.027+0000 7f1208264640 1 -- 172.21.15.3:0/884744028 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12001005e0 con 0x7f1200100b20 2024-09-21T12:24:03.030 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.027+0000 7f11f6ffd640 1 -- 172.21.15.3:0/884744028 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f11f0042070 con 0x7f1200100b20 2024-09-21T12:24:03.031 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.028+0000 7f11f6ffd640 1 --2- 172.21.15.3:0/884744028 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f11ec07af30 0x7f11ec07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:24:03.031 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.028+0000 7f1206000640 1 --2- 172.21.15.3:0/884744028 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f11ec07af30 0x7f11ec07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:24:03.031 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.028+0000 7f11f6ffd640 1 -- 172.21.15.3:0/884744028 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6156+0+0 (secure 0 0 0) 0x7f11f00becc0 con 0x7f1200100b20 2024-09-21T12:24:03.031 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.029+0000 7f1206000640 1 --2- 172.21.15.3:0/884744028 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f11ec07af30 0x7f11ec07d3f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f11fc009990 tx=0x7f11fc009110 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:24:03.035 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.033+0000 7f11f6ffd640 1 -- 172.21.15.3:0/884744028 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f11f008a2c0 con 0x7f1200100b20 2024-09-21T12:24:03.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.327+0000 7f1208264640 1 -- 172.21.15.3:0/884744028 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f1200062df0 con 0x7f1200100b20 2024-09-21T12:24:03.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.328+0000 7f11f6ffd640 1 -- 172.21.15.3:0/884744028 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7f11f008f170 con 0x7f1200100b20 2024-09-21T12:24:03.331 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-21T12:24:03.331 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": { 2024-09-21T12:24:03.331 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2 2024-09-21T12:24:03.331 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:24:03.331 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": { 2024-09-21T12:24:03.331 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:24:03.331 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:24:03.331 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": { 2024-09-21T12:24:03.331 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 6 2024-09-21T12:24:03.331 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:24:03.331 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": { 2024-09-21T12:24:03.331 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 4 2024-09-21T12:24:03.331 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:24:03.332 INFO:teuthology.orchestra.run.smithi003.stdout: "overall": { 2024-09-21T12:24:03.332 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 12, 2024-09-21T12:24:03.332 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:24:03.332 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-21T12:24:03.332 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-21T12:24:03.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.330+0000 7f1208264640 1 -- 172.21.15.3:0/884744028 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f11ec07af30 msgr2=0x7f11ec07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:03.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.330+0000 7f1208264640 1 --2- 172.21.15.3:0/884744028 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f11ec07af30 0x7f11ec07d3f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f11fc009990 tx=0x7f11fc009110 comp rx=0 tx=0).stop 2024-09-21T12:24:03.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.330+0000 7f1208264640 1 -- 172.21.15.3:0/884744028 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1200100b20 msgr2=0x7f1200199c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:03.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.330+0000 7f1208264640 1 --2- 172.21.15.3:0/884744028 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1200100b20 0x7f1200199c30 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f11f0006010 tx=0x7f11f00048f0 comp rx=0 tx=0).stop 2024-09-21T12:24:03.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.330+0000 7f1208264640 1 -- 172.21.15.3:0/884744028 shutdown_connections 2024-09-21T12:24:03.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.330+0000 7f1208264640 1 --2- 172.21.15.3:0/884744028 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f11ec07af30 0x7f11ec07d3f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:03.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.330+0000 7f1208264640 1 --2- 172.21.15.3:0/884744028 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1200100b20 0x7f1200199c30 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:03.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.330+0000 7f1208264640 1 --2- 172.21.15.3:0/884744028 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f12001001e0 0x7f12001996f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:03.334 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.330+0000 7f1208264640 1 -- 172.21.15.3:0/884744028 >> 172.21.15.3:0/884744028 conn(0x7f12000fc010 msgr2=0x7f1200108ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:24:03.334 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.330+0000 7f1208264640 1 -- 172.21.15.3:0/884744028 shutdown_connections 2024-09-21T12:24:03.334 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.331+0000 7f1208264640 1 -- 172.21.15.3:0/884744028 wait complete. 2024-09-21T12:24:03.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.418+0000 7ff22a28f640 1 -- 172.21.15.3:0/3737437807 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff224104da0 msgr2=0x7ff224107190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:03.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.418+0000 7ff22a28f640 1 --2- 172.21.15.3:0/3737437807 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff224104da0 0x7ff224107190 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7ff218009880 tx=0x7ff21802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:24:03.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.418+0000 7ff22a28f640 1 -- 172.21.15.3:0/3737437807 shutdown_connections 2024-09-21T12:24:03.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.418+0000 7ff22a28f640 1 --2- 172.21.15.3:0/3737437807 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff224104da0 0x7ff224107190 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:03.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.418+0000 7ff22a28f640 1 --2- 172.21.15.3:0/3737437807 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff224102470 0x7ff224104860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:03.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.418+0000 7ff22a28f640 1 -- 172.21.15.3:0/3737437807 >> 172.21.15.3:0/3737437807 conn(0x7ff2240fc010 msgr2=0x7ff2240fe430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:24:03.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.418+0000 7ff22a28f640 1 -- 172.21.15.3:0/3737437807 shutdown_connections 2024-09-21T12:24:03.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.419+0000 7ff22a28f640 1 -- 172.21.15.3:0/3737437807 wait complete. 2024-09-21T12:24:03.423 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.419+0000 7ff22a28f640 1 Processor -- start 2024-09-21T12:24:03.423 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.419+0000 7ff22a28f640 1 -- start start 2024-09-21T12:24:03.424 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.419+0000 7ff22a28f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff224102470 0x7ff224197500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:24:03.424 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.420+0000 7ff22a28f640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff224104da0 0x7ff224197a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:24:03.424 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.420+0000 7ff22a28f640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7ff22410a7a0 con 0x7ff224102470 2024-09-21T12:24:03.424 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.420+0000 7ff22a28f640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff22410a620 con 0x7ff224104da0 2024-09-21T12:24:03.424 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.420+0000 7ff223fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff224102470 0x7ff224197500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:24:03.424 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.420+0000 7ff223fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff224102470 0x7ff224197500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:49944/0 (socket says 172.21.15.3:49944) 2024-09-21T12:24:03.424 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.420+0000 7ff223fff640 1 -- 172.21.15.3:0/2737761501 learned_addr learned my addr 172.21.15.3:0/2737761501 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:24:03.424 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.420+0000 7ff2237fe640 1 --2- 172.21.15.3:0/2737761501 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff224104da0 0x7ff224197a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:24:03.424 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.420+0000 7ff223fff640 1 -- 172.21.15.3:0/2737761501 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff224104da0 msgr2=0x7ff224197a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:03.424 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.420+0000 7ff223fff640 1 --2- 172.21.15.3:0/2737761501 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff224104da0 0x7ff224197a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:03.424 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.420+0000 7ff223fff640 1 -- 172.21.15.3:0/2737761501 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2241980c0 con 0x7ff224102470 2024-09-21T12:24:03.424 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.420+0000 7ff2237fe640 1 --2- 172.21.15.3:0/2737761501 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff224104da0 0x7ff224197a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:24:03.425 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.420+0000 7ff223fff640 1 --2- 172.21.15.3:0/2737761501 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff224102470 0x7ff224197500 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7ff21400c8f0 tx=0x7ff21400cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:24:03.425 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.420+0000 7ff2217fa640 1 -- 172.21.15.3:0/2737761501 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff2140079b0 con 0x7ff224102470 2024-09-21T12:24:03.425 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.420+0000 7ff2217fa640 1 -- 172.21.15.3:0/2737761501 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff2140054e0 con 0x7ff224102470 2024-09-21T12:24:03.425 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.420+0000 7ff2217fa640 1 -- 172.21.15.3:0/2737761501 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff214004dd0 con 0x7ff224102470 2024-09-21T12:24:03.425 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.420+0000 7ff22a28f640 1 -- 172.21.15.3:0/2737761501 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff22419cb00 con 0x7ff224102470 2024-09-21T12:24:03.425 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.421+0000 7ff22a28f640 1 -- 172.21.15.3:0/2737761501 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff22419d060 con 0x7ff224102470 2024-09-21T12:24:03.426 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.422+0000 7ff22a28f640 1 -- 172.21.15.3:0/2737761501 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff22410af80 con 0x7ff224102470 2024-09-21T12:24:03.426 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.422+0000 7ff2217fa640 1 -- 172.21.15.3:0/2737761501 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7ff214005020 con 0x7ff224102470 2024-09-21T12:24:03.426 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.423+0000 7ff2217fa640 1 --2- 172.21.15.3:0/2737761501 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7ff20c07aed0 0x7ff20c07d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:24:03.426 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.423+0000 7ff2217fa640 1 -- 172.21.15.3:0/2737761501 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6156+0+0 (secure 0 0 0) 0x7ff21409e050 con 0x7ff224102470 2024-09-21T12:24:03.426 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.423+0000 7ff2237fe640 1 --2- 172.21.15.3:0/2737761501 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7ff20c07aed0 0x7ff20c07d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:24:03.426 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.424+0000 7ff2237fe640 1 --2- 172.21.15.3:0/2737761501 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7ff20c07aed0 0x7ff20c07d390 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff218000c00 tx=0x7ff218005a20 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:24:03.430 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.428+0000 7ff2217fa640 1 -- 172.21.15.3:0/2737761501 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7ff214014030 con 0x7ff224102470 2024-09-21T12:24:03.636 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.634+0000 7ff22a28f640 1 -- 172.21.15.3:0/2737761501 --> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7ff224105780 con 0x7ff20c07aed0 2024-09-21T12:24:03.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.636+0000 7ff2217fa640 1 -- 172.21.15.3:0/2737761501 <== mgr.14756 v2:172.21.15.3:6800/1284098095 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+364 (secure 0 0 0) 0x7ff224105780 con 0x7ff20c07aed0 2024-09-21T12:24:03.638 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-21T12:24:03.638 INFO:teuthology.orchestra.run.smithi003.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T12:24:03.639 INFO:teuthology.orchestra.run.smithi003.stdout: "in_progress": true, 2024-09-21T12:24:03.639 INFO:teuthology.orchestra.run.smithi003.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-09-21T12:24:03.639 INFO:teuthology.orchestra.run.smithi003.stdout: "services_complete": [ 2024-09-21T12:24:03.639 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr" 2024-09-21T12:24:03.639 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-21T12:24:03.639 INFO:teuthology.orchestra.run.smithi003.stdout: "progress": "2/2 daemons upgraded", 2024-09-21T12:24:03.639 INFO:teuthology.orchestra.run.smithi003.stdout: "message": "Currently upgrading grafana daemons", 2024-09-21T12:24:03.639 INFO:teuthology.orchestra.run.smithi003.stdout: "is_paused": false 2024-09-21T12:24:03.639 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-21T12:24:03.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.638+0000 7ff22a28f640 1 -- 172.21.15.3:0/2737761501 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7ff20c07aed0 msgr2=0x7ff20c07d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:03.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.638+0000 7ff22a28f640 1 --2- 172.21.15.3:0/2737761501 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7ff20c07aed0 0x7ff20c07d390 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff218000c00 tx=0x7ff218005a20 comp rx=0 tx=0).stop 2024-09-21T12:24:03.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.638+0000 7ff22a28f640 1 -- 172.21.15.3:0/2737761501 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff224102470 msgr2=0x7ff224197500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:03.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.638+0000 7ff22a28f640 1 --2- 172.21.15.3:0/2737761501 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff224102470 0x7ff224197500 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7ff21400c8f0 tx=0x7ff21400cdb0 comp rx=0 tx=0).stop 2024-09-21T12:24:03.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.638+0000 7ff22a28f640 1 -- 172.21.15.3:0/2737761501 shutdown_connections 2024-09-21T12:24:03.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.638+0000 7ff22a28f640 1 --2- 172.21.15.3:0/2737761501 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7ff20c07aed0 0x7ff20c07d390 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:03.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.638+0000 7ff22a28f640 1 --2- 172.21.15.3:0/2737761501 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff224104da0 0x7ff224197a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:03.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.638+0000 7ff22a28f640 1 --2- 172.21.15.3:0/2737761501 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff224102470 0x7ff224197500 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:03.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.638+0000 7ff22a28f640 1 -- 172.21.15.3:0/2737761501 >> 172.21.15.3:0/2737761501 conn(0x7ff2240fc010 msgr2=0x7ff2240fe400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:24:03.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.638+0000 7ff22a28f640 1 -- 172.21.15.3:0/2737761501 shutdown_connections 2024-09-21T12:24:03.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:03.638+0000 7ff22a28f640 1 -- 172.21.15.3:0/2737761501 wait complete. 2024-09-21T12:24:04.211 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:03 smithi192 ceph-mon[35641]: from='client.14870 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:24:04.212 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:03 smithi192 ceph-mon[35641]: from='client.14874 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:24:04.212 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:03 smithi192 ceph-mon[35641]: pgmap v65: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:04.212 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:03 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:24:04.212 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:03 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:24:04.212 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:03 smithi192 ceph-mon[35641]: from='client.? 172.21.15.3:0/884744028' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:24:04.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:03 smithi003 ceph-mon[28057]: from='client.14870 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:24:04.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:03 smithi003 ceph-mon[28057]: from='client.14874 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:24:04.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:03 smithi003 ceph-mon[28057]: pgmap v65: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:04.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:03 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:24:04.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:03 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:24:04.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:03 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/884744028' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:24:05.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:04 smithi192 ceph-mon[35641]: from='client.14878 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:24:05.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:04 smithi192 ceph-mon[35641]: from='client.14886 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:24:05.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:04 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:24:05.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:04 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:24:05.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:04 smithi192 ceph-mon[35641]: pgmap v66: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:05.303 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:04 smithi003 ceph-mon[28057]: from='client.14878 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:24:05.303 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:04 smithi003 ceph-mon[28057]: from='client.14886 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:24:05.303 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:04 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:24:05.303 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:04 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:24:05.303 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:04 smithi003 ceph-mon[28057]: pgmap v66: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:08.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:07 smithi192 ceph-mon[35641]: pgmap v67: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:08.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:07 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:24:08.259 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:07 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:24:08.259 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:07 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:24:08.259 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:07 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:24:08.259 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:07 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:24:08.259 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:07 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-21T12:24:08.259 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:07 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:24:08.259 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:07 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:24:08.259 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:07 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:24:08.259 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:07 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:24:08.259 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:07 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:24:08.259 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:07 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:24:08.259 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:07 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:24:08.260 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:07 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:24:08.260 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:07 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:24:08.260 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:07 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:24:08.260 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:07 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:24:08.260 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:07 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:24:08.260 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:07 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:24:08.260 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:07 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:24:08.260 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:07 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:24:08.260 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:07 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-21T12:24:08.260 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:07 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-21T12:24:08.260 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:07 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-21T12:24:08.260 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:07 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T12:24:08.260 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:07 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T12:24:08.261 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:07 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-21T12:24:08.261 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:07 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-21T12:24:08.261 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:07 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-21T12:24:08.261 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:07 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-21T12:24:08.261 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:07 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-21T12:24:08.261 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:07 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-21T12:24:08.261 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:07 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-21T12:24:08.261 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:07 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-21T12:24:08.261 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:07 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-21T12:24:08.261 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:07 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-21T12:24:08.261 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:07 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-21T12:24:08.261 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:07 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-21T12:24:08.261 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:07 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-21T12:24:08.261 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:07 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T12:24:08.262 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:07 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T12:24:08.262 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:07 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-21T12:24:08.262 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:07 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-21T12:24:08.262 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:07 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-21T12:24:08.262 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:07 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-21T12:24:08.262 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:07 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-21T12:24:08.262 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:07 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-21T12:24:08.262 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:07 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-21T12:24:08.262 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:07 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-21T12:24:08.262 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:07 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-21T12:24:08.262 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:07 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-21T12:24:08.262 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:07 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-21T12:24:08.262 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:07 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T12:24:08.262 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:07 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T12:24:08.263 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:07 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T12:24:08.263 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:07 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T12:24:08.263 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:07 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T12:24:08.263 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:07 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T12:24:08.263 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:07 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T12:24:08.263 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:07 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T12:24:08.263 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:07 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T12:24:08.263 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:07 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T12:24:08.263 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:07 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T12:24:08.263 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:07 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T12:24:08.263 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:07 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-21T12:24:08.263 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:07 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-21T12:24:08.263 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:07 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-21T12:24:08.263 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:07 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:24:08.263 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:07 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:24:08.263 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:07 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:24:08.264 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:07 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:24:08.264 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:07 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:24:08.264 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:07 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:24:08.264 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:07 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:24:08.264 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:07 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:24:08.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:07 smithi003 ceph-mon[28057]: pgmap v67: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:08.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:07 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:24:08.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:07 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:24:08.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:07 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:24:08.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:07 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:24:08.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:07 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:24:08.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:07 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-21T12:24:08.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:07 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:24:08.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:07 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:24:08.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:07 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:24:08.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:07 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:24:08.331 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:07 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:24:08.331 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:07 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:24:08.331 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:07 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:24:08.331 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:07 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:24:08.331 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:07 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:24:08.331 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:07 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:24:08.331 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:07 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:24:08.331 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:07 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:24:08.331 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:07 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:24:08.331 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:07 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:24:08.331 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:07 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:24:08.331 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:07 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-21T12:24:08.331 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:07 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-21T12:24:08.331 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:07 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-21T12:24:08.332 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:07 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T12:24:08.332 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:07 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T12:24:08.332 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:07 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-21T12:24:08.332 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:07 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-21T12:24:08.332 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:07 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-21T12:24:08.332 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:07 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-21T12:24:08.332 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:07 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-21T12:24:08.333 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:07 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-21T12:24:08.333 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:07 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-21T12:24:08.333 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:07 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-21T12:24:08.333 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:07 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-21T12:24:08.333 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:07 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-21T12:24:08.333 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:07 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-21T12:24:08.333 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:07 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-21T12:24:08.333 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:07 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-21T12:24:08.333 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:07 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T12:24:08.333 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:07 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T12:24:08.333 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:07 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-21T12:24:08.333 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:07 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-21T12:24:08.333 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:07 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-21T12:24:08.334 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:07 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-21T12:24:08.334 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:07 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-21T12:24:08.334 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:07 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-21T12:24:08.334 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:07 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-21T12:24:08.334 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:07 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-21T12:24:08.334 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:07 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-21T12:24:08.334 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:07 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-21T12:24:08.334 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:07 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-21T12:24:08.334 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:07 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T12:24:08.334 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:07 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T12:24:08.334 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:07 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T12:24:08.334 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:07 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T12:24:08.334 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:07 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T12:24:08.334 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:07 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T12:24:08.335 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:07 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T12:24:08.335 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:07 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T12:24:08.335 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:07 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T12:24:08.335 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:07 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T12:24:08.335 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:07 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T12:24:08.335 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:07 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-21T12:24:08.335 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:07 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-21T12:24:08.335 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:07 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-21T12:24:08.335 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:07 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-21T12:24:08.335 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:07 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:24:08.335 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:07 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:24:08.335 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:07 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:24:08.335 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:07 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:24:08.335 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:07 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:24:08.335 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:07 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:24:08.336 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:07 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:24:08.336 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:07 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:24:09.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:08 smithi192 ceph-mon[35641]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-21T12:24:09.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:08 smithi192 ceph-mon[35641]: Upgrade: Finalizing container_image settings 2024-09-21T12:24:09.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:08 smithi192 ceph-mon[35641]: Upgrade: Complete! 2024-09-21T12:24:09.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:08 smithi003 ceph-mon[28057]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-21T12:24:09.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:08 smithi003 ceph-mon[28057]: Upgrade: Finalizing container_image settings 2024-09-21T12:24:09.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:08 smithi003 ceph-mon[28057]: Upgrade: Complete! 2024-09-21T12:24:10.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:09 smithi192 ceph-mon[35641]: pgmap v68: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:10.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:09 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:24:10.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:09 smithi003 ceph-mon[28057]: pgmap v68: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:10.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:09 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:24:12.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:11 smithi192 ceph-mon[35641]: pgmap v69: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:12.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:11 smithi003 ceph-mon[28057]: pgmap v69: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:14.154 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:13 smithi003 ceph-mon[28057]: pgmap v70: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:14.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:13 smithi192 ceph-mon[35641]: pgmap v70: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:15.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:14 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:24:15.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:14 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:24:16.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:15 smithi003 ceph-mon[28057]: pgmap v71: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:16.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:15 smithi192 ceph-mon[35641]: pgmap v71: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:18.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:17 smithi192 ceph-mon[35641]: pgmap v72: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:18.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:17 smithi003 ceph-mon[28057]: pgmap v72: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:20.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:19 smithi192 ceph-mon[35641]: pgmap v73: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:20.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:19 smithi003 ceph-mon[28057]: pgmap v73: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:22.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:21 smithi192 ceph-mon[35641]: pgmap v74: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:22.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:21 smithi003 ceph-mon[28057]: pgmap v74: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:24.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:23 smithi192 ceph-mon[35641]: pgmap v75: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:24.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:23 smithi003 ceph-mon[28057]: pgmap v75: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:26.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:25 smithi192 ceph-mon[35641]: pgmap v76: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:26.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:25 smithi003 ceph-mon[28057]: pgmap v76: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:28.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:27 smithi192 ceph-mon[35641]: pgmap v77: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:28.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:27 smithi003 ceph-mon[28057]: pgmap v77: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:30.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:29 smithi192 ceph-mon[35641]: pgmap v78: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:30.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:29 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:24:30.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:29 smithi003 ceph-mon[28057]: pgmap v78: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:30.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:29 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:24:32.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:31 smithi192 ceph-mon[35641]: pgmap v79: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:32.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:31 smithi003 ceph-mon[28057]: pgmap v79: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:33.741 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:33.738+0000 7f21683a9640 1 -- 172.21.15.3:0/320078091 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f21600ffc20 msgr2=0x7f2160100020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:33.742 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:33.738+0000 7f21683a9640 1 --2- 172.21.15.3:0/320078091 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f21600ffc20 0x7f2160100020 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f215c009880 tx=0x7f215c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:24:33.742 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:33.738+0000 7f21683a9640 1 -- 172.21.15.3:0/320078091 shutdown_connections 2024-09-21T12:24:33.742 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:33.738+0000 7f21683a9640 1 --2- 172.21.15.3:0/320078091 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2160102c00 0x7f2160103080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:33.742 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:33.738+0000 7f21683a9640 1 --2- 172.21.15.3:0/320078091 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f21600ffc20 0x7f2160100020 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:33.742 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:33.738+0000 7f21683a9640 1 -- 172.21.15.3:0/320078091 >> 172.21.15.3:0/320078091 conn(0x7f21600fb770 msgr2=0x7f21600fdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:24:33.742 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:33.738+0000 7f21683a9640 1 -- 172.21.15.3:0/320078091 shutdown_connections 2024-09-21T12:24:33.742 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:33.738+0000 7f21683a9640 1 -- 172.21.15.3:0/320078091 wait complete. 2024-09-21T12:24:33.742 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:33.739+0000 7f21683a9640 1 Processor -- start 2024-09-21T12:24:33.742 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:33.739+0000 7f21683a9640 1 -- start start 2024-09-21T12:24:33.742 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:33.739+0000 7f21683a9640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f21600ffc20 0x7f21601024f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:24:33.742 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:33.739+0000 7f21683a9640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2160102c00 0x7f2160100bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:24:33.743 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:33.739+0000 7f21683a9640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f216010a7b0 con 0x7f2160102c00 2024-09-21T12:24:33.743 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:33.739+0000 7f21683a9640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f216010a630 con 0x7f21600ffc20 2024-09-21T12:24:33.743 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:33.740+0000 7f2165944640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2160102c00 0x7f2160100bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:24:33.743 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:33.740+0000 7f2165944640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2160102c00 0x7f2160100bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50704/0 (socket says 172.21.15.3:50704) 2024-09-21T12:24:33.743 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:33.740+0000 7f2165944640 1 -- 172.21.15.3:0/643385153 learned_addr learned my addr 172.21.15.3:0/643385153 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:24:33.743 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:33.740+0000 7f2166145640 1 --2- 172.21.15.3:0/643385153 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f21600ffc20 0x7f21601024f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:24:33.743 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:33.740+0000 7f2165944640 1 -- 172.21.15.3:0/643385153 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f21600ffc20 msgr2=0x7f21601024f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:33.743 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:33.740+0000 7f2165944640 1 --2- 172.21.15.3:0/643385153 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f21600ffc20 0x7f21601024f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:33.743 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:33.740+0000 7f2165944640 1 -- 172.21.15.3:0/643385153 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21601010f0 con 0x7f2160102c00 2024-09-21T12:24:33.743 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:33.740+0000 7f2166145640 1 --2- 172.21.15.3:0/643385153 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f21600ffc20 0x7f21601024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:24:33.743 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:33.740+0000 7f2165944640 1 --2- 172.21.15.3:0/643385153 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2160102c00 0x7f2160100bb0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f215000c8f0 tx=0x7f215000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:24:33.744 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:33.740+0000 7f21577fe640 1 -- 172.21.15.3:0/643385153 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f21500079b0 con 0x7f2160102c00 2024-09-21T12:24:33.745 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:33.740+0000 7f21577fe640 1 -- 172.21.15.3:0/643385153 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f21500054e0 con 0x7f2160102c00 2024-09-21T12:24:33.745 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:33.740+0000 7f21683a9640 1 -- 172.21.15.3:0/643385153 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21601013e0 con 0x7f2160102c00 2024-09-21T12:24:33.745 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:33.740+0000 7f21577fe640 1 -- 172.21.15.3:0/643385153 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2150004dd0 con 0x7f2160102c00 2024-09-21T12:24:33.745 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:33.741+0000 7f21683a9640 1 -- 172.21.15.3:0/643385153 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2160101970 con 0x7f2160102c00 2024-09-21T12:24:33.745 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:33.742+0000 7f21683a9640 1 -- 172.21.15.3:0/643385153 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2160100020 con 0x7f2160102c00 2024-09-21T12:24:33.745 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:33.742+0000 7f21577fe640 1 -- 172.21.15.3:0/643385153 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f2150005020 con 0x7f2160102c00 2024-09-21T12:24:33.745 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:33.743+0000 7f21577fe640 1 --2- 172.21.15.3:0/643385153 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f214c07aed0 0x7f214c07d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:24:33.745 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:33.743+0000 7f21577fe640 1 -- 172.21.15.3:0/643385153 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6156+0+0 (secure 0 0 0) 0x7f215009dfd0 con 0x7f2160102c00 2024-09-21T12:24:33.745 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:33.743+0000 7f2166145640 1 --2- 172.21.15.3:0/643385153 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f214c07aed0 0x7f214c07d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:24:33.746 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:33.744+0000 7f2166145640 1 --2- 172.21.15.3:0/643385153 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f214c07aed0 0x7f214c07d390 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f215c000c00 tx=0x7f215c005a20 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:24:33.749 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:33.748+0000 7f21577fe640 1 -- 172.21.15.3:0/643385153 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f2150014030 con 0x7f2160102c00 2024-09-21T12:24:33.953 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:33.952+0000 7f21683a9640 1 -- 172.21.15.3:0/643385153 --> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f2160062630 con 0x7f214c07aed0 2024-09-21T12:24:33.954 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:33.953+0000 7f21577fe640 1 -- 172.21.15.3:0/643385153 <== mgr.14756 v2:172.21.15.3:6800/1284098095 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+175 (secure 0 0 0) 0x7f2160062630 con 0x7f214c07aed0 2024-09-21T12:24:33.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:33.955+0000 7f21683a9640 1 -- 172.21.15.3:0/643385153 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f214c07aed0 msgr2=0x7f214c07d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:33.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:33.955+0000 7f21683a9640 1 --2- 172.21.15.3:0/643385153 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f214c07aed0 0x7f214c07d390 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f215c000c00 tx=0x7f215c005a20 comp rx=0 tx=0).stop 2024-09-21T12:24:33.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:33.955+0000 7f21683a9640 1 -- 172.21.15.3:0/643385153 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2160102c00 msgr2=0x7f2160100bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:33.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:33.955+0000 7f21683a9640 1 --2- 172.21.15.3:0/643385153 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2160102c00 0x7f2160100bb0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f215000c8f0 tx=0x7f215000cdb0 comp rx=0 tx=0).stop 2024-09-21T12:24:33.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:33.955+0000 7f21683a9640 1 -- 172.21.15.3:0/643385153 shutdown_connections 2024-09-21T12:24:33.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:33.955+0000 7f21683a9640 1 --2- 172.21.15.3:0/643385153 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f214c07aed0 0x7f214c07d390 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:33.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:33.955+0000 7f21683a9640 1 --2- 172.21.15.3:0/643385153 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2160102c00 0x7f2160100bb0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:33.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:33.955+0000 7f21683a9640 1 --2- 172.21.15.3:0/643385153 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f21600ffc20 0x7f21601024f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:33.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:33.955+0000 7f21683a9640 1 -- 172.21.15.3:0/643385153 >> 172.21.15.3:0/643385153 conn(0x7f21600fb770 msgr2=0x7f2160106100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:24:33.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:33.955+0000 7f21683a9640 1 -- 172.21.15.3:0/643385153 shutdown_connections 2024-09-21T12:24:33.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:33.955+0000 7f21683a9640 1 -- 172.21.15.3:0/643385153 wait complete. 2024-09-21T12:24:33.994 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:33 smithi003 ceph-mon[28057]: pgmap v80: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:34.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:33 smithi192 ceph-mon[35641]: pgmap v80: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:34.677 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -e sha1=5c1cdc3c470dae78e91a0ed2bcf13509a046d301 -- bash -c 'ceph versions | jq -e '"'"'.mgr | length == 1'"'"'' 2024-09-21T12:24:34.984 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:24:35.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:35.491+0000 7f3844ab7640 1 -- 172.21.15.3:0/1083687202 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3840106800 msgr2=0x7f3840106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:35.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:35.491+0000 7f3844ab7640 1 --2- 172.21.15.3:0/1083687202 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3840106800 0x7f3840106be0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f3838009880 tx=0x7f383802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:24:35.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:35.492+0000 7f3844ab7640 1 -- 172.21.15.3:0/1083687202 shutdown_connections 2024-09-21T12:24:35.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:35.492+0000 7f3844ab7640 1 --2- 172.21.15.3:0/1083687202 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3840100800 0x7f3840100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:35.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:35.492+0000 7f3844ab7640 1 --2- 172.21.15.3:0/1083687202 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3840106800 0x7f3840106be0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:35.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:35.492+0000 7f3844ab7640 1 -- 172.21.15.3:0/1083687202 >> 172.21.15.3:0/1083687202 conn(0x7f38400fc520 msgr2=0x7f38400fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:24:35.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:35.492+0000 7f3844ab7640 1 -- 172.21.15.3:0/1083687202 shutdown_connections 2024-09-21T12:24:35.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:35.492+0000 7f3844ab7640 1 -- 172.21.15.3:0/1083687202 wait complete. 2024-09-21T12:24:35.494 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:35.492+0000 7f3844ab7640 1 Processor -- start 2024-09-21T12:24:35.495 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:35.492+0000 7f3844ab7640 1 -- start start 2024-09-21T12:24:35.496 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:35.493+0000 7f3844ab7640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3840100800 0x7f38400fcce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:24:35.496 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:35.493+0000 7f3844ab7640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3840106800 0x7f38400fd220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:24:35.496 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:35.493+0000 7f3844ab7640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f384010dcd0 con 0x7f3840106800 2024-09-21T12:24:35.496 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:35.493+0000 7f3844ab7640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f384010db50 con 0x7f3840100800 2024-09-21T12:24:35.496 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:35.493+0000 7f383dd9b640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3840106800 0x7f38400fd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:24:35.496 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:35.493+0000 7f383dd9b640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3840106800 0x7f38400fd220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50734/0 (socket says 172.21.15.3:50734) 2024-09-21T12:24:35.496 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:35.493+0000 7f383dd9b640 1 -- 172.21.15.3:0/1867861595 learned_addr learned my addr 172.21.15.3:0/1867861595 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:24:35.496 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:35.493+0000 7f383e59c640 1 --2- 172.21.15.3:0/1867861595 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3840100800 0x7f38400fcce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:24:35.496 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:35.493+0000 7f383dd9b640 1 -- 172.21.15.3:0/1867861595 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3840100800 msgr2=0x7f38400fcce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:35.496 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:35.493+0000 7f383dd9b640 1 --2- 172.21.15.3:0/1867861595 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3840100800 0x7f38400fcce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:35.496 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:35.493+0000 7f383dd9b640 1 -- 172.21.15.3:0/1867861595 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38400fd760 con 0x7f3840106800 2024-09-21T12:24:35.496 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:35.493+0000 7f383dd9b640 1 --2- 172.21.15.3:0/1867861595 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3840106800 0x7f38400fd220 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f382800d6f0 tx=0x7f382800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:24:35.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:35.494+0000 7f38377fe640 1 -- 172.21.15.3:0/1867861595 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3828017070 con 0x7f3840106800 2024-09-21T12:24:35.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:35.494+0000 7f38377fe640 1 -- 172.21.15.3:0/1867861595 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f382800de00 con 0x7f3840106800 2024-09-21T12:24:35.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:35.494+0000 7f38377fe640 1 -- 172.21.15.3:0/1867861595 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3828004bb0 con 0x7f3840106800 2024-09-21T12:24:35.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:35.494+0000 7f3844ab7640 1 -- 172.21.15.3:0/1867861595 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38400fda50 con 0x7f3840106800 2024-09-21T12:24:35.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:35.494+0000 7f3844ab7640 1 -- 172.21.15.3:0/1867861595 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38401a3e60 con 0x7f3840106800 2024-09-21T12:24:35.497 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:35.495+0000 7f3844ab7640 1 -- 172.21.15.3:0/1867861595 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3840101f40 con 0x7f3840106800 2024-09-21T12:24:35.498 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:35.495+0000 7f38377fe640 1 -- 172.21.15.3:0/1867861595 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f3828009a30 con 0x7f3840106800 2024-09-21T12:24:35.498 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:35.496+0000 7f38377fe640 1 --2- 172.21.15.3:0/1867861595 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f382c07af90 0x7f382c07d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:24:35.498 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:35.496+0000 7f383e59c640 1 --2- 172.21.15.3:0/1867861595 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f382c07af90 0x7f382c07d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:24:35.498 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:35.496+0000 7f38377fe640 1 -- 172.21.15.3:0/1867861595 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6156+0+0 (secure 0 0 0) 0x7f382809dac0 con 0x7f3840106800 2024-09-21T12:24:35.498 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:35.497+0000 7f383e59c640 1 --2- 172.21.15.3:0/1867861595 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f382c07af90 0x7f382c07d450 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f38380096c0 tx=0x7f3838031400 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:24:35.502 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:35.500+0000 7f38377fe640 1 -- 172.21.15.3:0/1867861595 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f3828069140 con 0x7f3840106800 2024-09-21T12:24:35.764 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:35.763+0000 7f3844ab7640 1 -- 172.21.15.3:0/1867861595 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f38400fe210 con 0x7f3840106800 2024-09-21T12:24:35.765 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:35.763+0000 7f38377fe640 1 -- 172.21.15.3:0/1867861595 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7f382806dff0 con 0x7f3840106800 2024-09-21T12:24:35.767 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:35.765+0000 7f3844ab7640 1 -- 172.21.15.3:0/1867861595 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f382c07af90 msgr2=0x7f382c07d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:35.767 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:35.765+0000 7f3844ab7640 1 --2- 172.21.15.3:0/1867861595 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f382c07af90 0x7f382c07d450 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f38380096c0 tx=0x7f3838031400 comp rx=0 tx=0).stop 2024-09-21T12:24:35.767 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:35.765+0000 7f3844ab7640 1 -- 172.21.15.3:0/1867861595 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3840106800 msgr2=0x7f38400fd220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:35.767 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:35.765+0000 7f3844ab7640 1 --2- 172.21.15.3:0/1867861595 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3840106800 0x7f38400fd220 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f382800d6f0 tx=0x7f382800dbb0 comp rx=0 tx=0).stop 2024-09-21T12:24:35.767 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:35.765+0000 7f3844ab7640 1 -- 172.21.15.3:0/1867861595 shutdown_connections 2024-09-21T12:24:35.767 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:35.765+0000 7f3844ab7640 1 --2- 172.21.15.3:0/1867861595 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f382c07af90 0x7f382c07d450 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:35.767 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:35.765+0000 7f3844ab7640 1 --2- 172.21.15.3:0/1867861595 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3840106800 0x7f38400fd220 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:35.767 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:35.765+0000 7f3844ab7640 1 --2- 172.21.15.3:0/1867861595 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3840100800 0x7f38400fcce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:35.768 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:35.765+0000 7f3844ab7640 1 -- 172.21.15.3:0/1867861595 >> 172.21.15.3:0/1867861595 conn(0x7f38400fc520 msgr2=0x7f384006a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:24:35.768 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:35.765+0000 7f3844ab7640 1 -- 172.21.15.3:0/1867861595 shutdown_connections 2024-09-21T12:24:35.768 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:35.766+0000 7f3844ab7640 1 -- 172.21.15.3:0/1867861595 wait complete. 2024-09-21T12:24:35.775 INFO:teuthology.orchestra.run.smithi003.stdout:true 2024-09-21T12:24:36.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:35 smithi003 ceph-mon[28057]: from='client.14890 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:24:36.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:35 smithi003 ceph-mon[28057]: pgmap v81: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:36.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:35 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/1867861595' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:24:36.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:35 smithi192 ceph-mon[35641]: from='client.14890 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:24:36.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:35 smithi192 ceph-mon[35641]: pgmap v81: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:36.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:35 smithi192 ceph-mon[35641]: from='client.? 172.21.15.3:0/1867861595' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:24:36.443 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -e sha1=5c1cdc3c470dae78e91a0ed2bcf13509a046d301 -- bash -c 'ceph versions | jq -e '"'"'.mgr | keys'"'"' | grep $sha1' 2024-09-21T12:24:36.703 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:24:37.195 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:37.189+0000 7f919d1e3640 1 -- 172.21.15.3:0/3446546242 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9198100810 msgr2=0x7f9198100c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:37.195 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:37.189+0000 7f919d1e3640 1 --2- 172.21.15.3:0/3446546242 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9198100810 0x7f9198100c70 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f918c009880 tx=0x7f918c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:24:37.195 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:37.190+0000 7f919d1e3640 1 -- 172.21.15.3:0/3446546242 shutdown_connections 2024-09-21T12:24:37.195 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:37.190+0000 7f919d1e3640 1 --2- 172.21.15.3:0/3446546242 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9198100810 0x7f9198100c70 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:37.195 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:37.190+0000 7f919d1e3640 1 --2- 172.21.15.3:0/3446546242 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9198106810 0x7f9198106bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:37.196 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:37.190+0000 7f919d1e3640 1 -- 172.21.15.3:0/3446546242 >> 172.21.15.3:0/3446546242 conn(0x7f91980fc510 msgr2=0x7f91980fe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:24:37.196 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:37.190+0000 7f919d1e3640 1 -- 172.21.15.3:0/3446546242 shutdown_connections 2024-09-21T12:24:37.196 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:37.190+0000 7f919d1e3640 1 -- 172.21.15.3:0/3446546242 wait complete. 2024-09-21T12:24:37.196 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:37.190+0000 7f919d1e3640 1 Processor -- start 2024-09-21T12:24:37.196 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:37.191+0000 7f919d1e3640 1 -- start start 2024-09-21T12:24:37.196 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:37.191+0000 7f919d1e3640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9198100810 0x7f919819d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:24:37.196 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:37.191+0000 7f919d1e3640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9198106810 0x7f919819dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:24:37.197 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:37.191+0000 7f919d1e3640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f919810dd40 con 0x7f9198100810 2024-09-21T12:24:37.197 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:37.191+0000 7f919d1e3640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f919810dbc0 con 0x7f9198106810 2024-09-21T12:24:37.197 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:37.191+0000 7f9196d9d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9198100810 0x7f919819d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:24:37.197 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:37.191+0000 7f9196d9d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9198100810 0x7f919819d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50748/0 (socket says 172.21.15.3:50748) 2024-09-21T12:24:37.197 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:37.191+0000 7f9196d9d640 1 -- 172.21.15.3:0/146064226 learned_addr learned my addr 172.21.15.3:0/146064226 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:24:37.197 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:37.191+0000 7f919659c640 1 --2- 172.21.15.3:0/146064226 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9198106810 0x7f919819dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:24:37.197 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:37.191+0000 7f9196d9d640 1 -- 172.21.15.3:0/146064226 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9198106810 msgr2=0x7f919819dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:37.198 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:37.191+0000 7f9196d9d640 1 --2- 172.21.15.3:0/146064226 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9198106810 0x7f919819dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:37.198 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:37.191+0000 7f9196d9d640 1 -- 172.21.15.3:0/146064226 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9198197860 con 0x7f9198100810 2024-09-21T12:24:37.198 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:37.191+0000 7f9196d9d640 1 --2- 172.21.15.3:0/146064226 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9198100810 0x7f919819d6a0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f918800b420 tx=0x7f918800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:24:37.198 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:37.192+0000 7f917ffff640 1 -- 172.21.15.3:0/146064226 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9188011630 con 0x7f9198100810 2024-09-21T12:24:37.198 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:37.192+0000 7f917ffff640 1 -- 172.21.15.3:0/146064226 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9188016070 con 0x7f9198100810 2024-09-21T12:24:37.198 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:37.192+0000 7f919d1e3640 1 -- 172.21.15.3:0/146064226 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9198197b50 con 0x7f9198100810 2024-09-21T12:24:37.199 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:37.192+0000 7f917ffff640 1 -- 172.21.15.3:0/146064226 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9188010d40 con 0x7f9198100810 2024-09-21T12:24:37.199 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:37.192+0000 7f919d1e3640 1 -- 172.21.15.3:0/146064226 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91981980e0 con 0x7f9198100810 2024-09-21T12:24:37.199 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:37.193+0000 7f919d1e3640 1 -- 172.21.15.3:0/146064226 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9198101f50 con 0x7f9198100810 2024-09-21T12:24:37.200 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:37.194+0000 7f917ffff640 1 -- 172.21.15.3:0/146064226 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f918801b460 con 0x7f9198100810 2024-09-21T12:24:37.200 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:37.194+0000 7f917ffff640 1 --2- 172.21.15.3:0/146064226 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f918007af30 0x7f918007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:24:37.200 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:37.194+0000 7f917ffff640 1 -- 172.21.15.3:0/146064226 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6156+0+0 (secure 0 0 0) 0x7f918809d740 con 0x7f9198100810 2024-09-21T12:24:37.200 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:37.194+0000 7f919659c640 1 --2- 172.21.15.3:0/146064226 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f918007af30 0x7f918007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:24:37.200 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:37.195+0000 7f919659c640 1 --2- 172.21.15.3:0/146064226 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f918007af30 0x7f918007d3f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f918c031460 tx=0x7f918c009560 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:24:37.201 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:37.199+0000 7f917ffff640 1 -- 172.21.15.3:0/146064226 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f9188068d40 con 0x7f9198100810 2024-09-21T12:24:37.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:37.461+0000 7f919d1e3640 1 -- 172.21.15.3:0/146064226 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f9198198d90 con 0x7f9198100810 2024-09-21T12:24:37.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:37.461+0000 7f917ffff640 1 -- 172.21.15.3:0/146064226 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7f918806dbf0 con 0x7f9198100810 2024-09-21T12:24:37.465 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:37.463+0000 7f919d1e3640 1 -- 172.21.15.3:0/146064226 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f918007af30 msgr2=0x7f918007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:37.465 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:37.463+0000 7f919d1e3640 1 --2- 172.21.15.3:0/146064226 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f918007af30 0x7f918007d3f0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f918c031460 tx=0x7f918c009560 comp rx=0 tx=0).stop 2024-09-21T12:24:37.465 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:37.463+0000 7f919d1e3640 1 -- 172.21.15.3:0/146064226 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9198100810 msgr2=0x7f919819d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:37.465 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:37.463+0000 7f919d1e3640 1 --2- 172.21.15.3:0/146064226 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9198100810 0x7f919819d6a0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f918800b420 tx=0x7f918800b8e0 comp rx=0 tx=0).stop 2024-09-21T12:24:37.466 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:37.464+0000 7f919d1e3640 1 -- 172.21.15.3:0/146064226 shutdown_connections 2024-09-21T12:24:37.466 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:37.464+0000 7f919d1e3640 1 --2- 172.21.15.3:0/146064226 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f918007af30 0x7f918007d3f0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:37.466 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:37.464+0000 7f919d1e3640 1 --2- 172.21.15.3:0/146064226 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9198106810 0x7f919819dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:37.466 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:37.464+0000 7f919d1e3640 1 --2- 172.21.15.3:0/146064226 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9198100810 0x7f919819d6a0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:37.466 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:37.464+0000 7f919d1e3640 1 -- 172.21.15.3:0/146064226 >> 172.21.15.3:0/146064226 conn(0x7f91980fc510 msgr2=0x7f919806a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:24:37.466 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:37.464+0000 7f919d1e3640 1 -- 172.21.15.3:0/146064226 shutdown_connections 2024-09-21T12:24:37.466 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:37.464+0000 7f919d1e3640 1 -- 172.21.15.3:0/146064226 wait complete. 2024-09-21T12:24:37.474 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)" 2024-09-21T12:24:38.083 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -e sha1=5c1cdc3c470dae78e91a0ed2bcf13509a046d301 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 2'"'"'' 2024-09-21T12:24:38.106 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:37 smithi003 ceph-mon[28057]: pgmap v82: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:38.106 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:37 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/146064226' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:24:38.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:37 smithi192 ceph-mon[35641]: pgmap v82: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:38.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:37 smithi192 ceph-mon[35641]: from='client.? 172.21.15.3:0/146064226' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:24:38.342 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:24:38.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:38.832+0000 7f7e13ccd640 1 -- 172.21.15.3:0/1576587281 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7e0c106800 msgr2=0x7f7e0c106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:38.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:38.832+0000 7f7e13ccd640 1 --2- 172.21.15.3:0/1576587281 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7e0c106800 0x7f7e0c106be0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f7e08009880 tx=0x7f7e0802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:24:38.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:38.832+0000 7f7e13ccd640 1 -- 172.21.15.3:0/1576587281 shutdown_connections 2024-09-21T12:24:38.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:38.832+0000 7f7e13ccd640 1 --2- 172.21.15.3:0/1576587281 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e0c100800 0x7f7e0c100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:38.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:38.832+0000 7f7e13ccd640 1 --2- 172.21.15.3:0/1576587281 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7e0c106800 0x7f7e0c106be0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:38.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:38.832+0000 7f7e13ccd640 1 -- 172.21.15.3:0/1576587281 >> 172.21.15.3:0/1576587281 conn(0x7f7e0c0fc520 msgr2=0x7f7e0c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:24:38.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:38.832+0000 7f7e13ccd640 1 -- 172.21.15.3:0/1576587281 shutdown_connections 2024-09-21T12:24:38.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:38.832+0000 7f7e13ccd640 1 -- 172.21.15.3:0/1576587281 wait complete. 2024-09-21T12:24:38.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:38.832+0000 7f7e13ccd640 1 Processor -- start 2024-09-21T12:24:38.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:38.833+0000 7f7e13ccd640 1 -- start start 2024-09-21T12:24:38.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:38.833+0000 7f7e13ccd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7e0c100800 0x7f7e0c19d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:24:38.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:38.833+0000 7f7e13ccd640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e0c106800 0x7f7e0c19dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:24:38.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:38.833+0000 7f7e13ccd640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f7e0c10dd30 con 0x7f7e0c100800 2024-09-21T12:24:38.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:38.833+0000 7f7e13ccd640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7e0c10dbb0 con 0x7f7e0c106800 2024-09-21T12:24:38.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:38.833+0000 7f7e11a69640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7e0c100800 0x7f7e0c19d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:24:38.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:38.833+0000 7f7e11a69640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7e0c100800 0x7f7e0c19d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:50768/0 (socket says 172.21.15.3:50768) 2024-09-21T12:24:38.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:38.833+0000 7f7e11a69640 1 -- 172.21.15.3:0/3592720970 learned_addr learned my addr 172.21.15.3:0/3592720970 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:24:38.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:38.833+0000 7f7e11268640 1 --2- 172.21.15.3:0/3592720970 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e0c106800 0x7f7e0c19dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:24:38.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:38.833+0000 7f7e11a69640 1 -- 172.21.15.3:0/3592720970 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e0c106800 msgr2=0x7f7e0c19dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:38.852 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:38.833+0000 7f7e11a69640 1 --2- 172.21.15.3:0/3592720970 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e0c106800 0x7f7e0c19dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:38.852 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:38.833+0000 7f7e11a69640 1 -- 172.21.15.3:0/3592720970 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e0c197820 con 0x7f7e0c100800 2024-09-21T12:24:38.852 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:38.833+0000 7f7e11268640 1 --2- 172.21.15.3:0/3592720970 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e0c106800 0x7f7e0c19dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:24:38.852 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:38.833+0000 7f7e11a69640 1 --2- 172.21.15.3:0/3592720970 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7e0c100800 0x7f7e0c19d6a0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f7e08031460 tx=0x7f7e080048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:24:38.852 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:38.834+0000 7f7e02ffd640 1 -- 172.21.15.3:0/3592720970 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7e0803f070 con 0x7f7e0c100800 2024-09-21T12:24:38.852 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:38.834+0000 7f7e13ccd640 1 -- 172.21.15.3:0/3592720970 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e0c197ab0 con 0x7f7e0c100800 2024-09-21T12:24:38.852 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:38.834+0000 7f7e02ffd640 1 -- 172.21.15.3:0/3592720970 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7e08004cf0 con 0x7f7e0c100800 2024-09-21T12:24:38.852 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:38.834+0000 7f7e02ffd640 1 -- 172.21.15.3:0/3592720970 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7e08035030 con 0x7f7e0c100800 2024-09-21T12:24:38.852 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:38.834+0000 7f7e13ccd640 1 -- 172.21.15.3:0/3592720970 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e0c197fe0 con 0x7f7e0c100800 2024-09-21T12:24:38.852 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:38.835+0000 7f7e13ccd640 1 -- 172.21.15.3:0/3592720970 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e0c101f40 con 0x7f7e0c100800 2024-09-21T12:24:38.852 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:38.835+0000 7f7e02ffd640 1 -- 172.21.15.3:0/3592720970 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f7e08042070 con 0x7f7e0c100800 2024-09-21T12:24:38.852 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:38.836+0000 7f7e02ffd640 1 --2- 172.21.15.3:0/3592720970 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f7df807af30 0x7f7df807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:24:38.852 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:38.836+0000 7f7e02ffd640 1 -- 172.21.15.3:0/3592720970 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6156+0+0 (secure 0 0 0) 0x7f7e080beb00 con 0x7f7e0c100800 2024-09-21T12:24:38.853 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:38.836+0000 7f7e11268640 1 --2- 172.21.15.3:0/3592720970 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f7df807af30 0x7f7df807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:24:38.853 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:38.836+0000 7f7e11268640 1 --2- 172.21.15.3:0/3592720970 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f7df807af30 0x7f7df807d3f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c104f40 tx=0x7f7dfc008040 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:24:38.853 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:38.840+0000 7f7e02ffd640 1 -- 172.21.15.3:0/3592720970 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f7e0808a100 con 0x7f7e0c100800 2024-09-21T12:24:39.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:39.105+0000 7f7e13ccd640 1 -- 172.21.15.3:0/3592720970 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f7e0c109d80 con 0x7f7e0c100800 2024-09-21T12:24:39.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:39.106+0000 7f7e02ffd640 1 -- 172.21.15.3:0/3592720970 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7f7e0808efb0 con 0x7f7e0c100800 2024-09-21T12:24:39.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:39.108+0000 7f7e13ccd640 1 -- 172.21.15.3:0/3592720970 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f7df807af30 msgr2=0x7f7df807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:39.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:39.108+0000 7f7e13ccd640 1 --2- 172.21.15.3:0/3592720970 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f7df807af30 0x7f7df807d3f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c104f40 tx=0x7f7dfc008040 comp rx=0 tx=0).stop 2024-09-21T12:24:39.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:39.108+0000 7f7e13ccd640 1 -- 172.21.15.3:0/3592720970 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7e0c100800 msgr2=0x7f7e0c19d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:39.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:39.108+0000 7f7e13ccd640 1 --2- 172.21.15.3:0/3592720970 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7e0c100800 0x7f7e0c19d6a0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f7e08031460 tx=0x7f7e080048f0 comp rx=0 tx=0).stop 2024-09-21T12:24:39.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:39.108+0000 7f7e13ccd640 1 -- 172.21.15.3:0/3592720970 shutdown_connections 2024-09-21T12:24:39.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:39.108+0000 7f7e13ccd640 1 --2- 172.21.15.3:0/3592720970 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f7df807af30 0x7f7df807d3f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:39.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:39.108+0000 7f7e13ccd640 1 --2- 172.21.15.3:0/3592720970 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7e0c106800 0x7f7e0c19dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:39.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:39.108+0000 7f7e13ccd640 1 --2- 172.21.15.3:0/3592720970 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7e0c100800 0x7f7e0c19d6a0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:39.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:39.108+0000 7f7e13ccd640 1 -- 172.21.15.3:0/3592720970 >> 172.21.15.3:0/3592720970 conn(0x7f7e0c0fc520 msgr2=0x7f7e0c06a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:24:39.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:39.108+0000 7f7e13ccd640 1 -- 172.21.15.3:0/3592720970 shutdown_connections 2024-09-21T12:24:39.111 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:39.108+0000 7f7e13ccd640 1 -- 172.21.15.3:0/3592720970 wait complete. 2024-09-21T12:24:39.119 INFO:teuthology.orchestra.run.smithi003.stdout:true 2024-09-21T12:24:39.779 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -e sha1=5c1cdc3c470dae78e91a0ed2bcf13509a046d301 -- bash -c 'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '"'"'.up_to_date | length == 2'"'"'' 2024-09-21T12:24:40.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:39 smithi003 ceph-mon[28057]: pgmap v83: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:40.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:39 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/3592720970' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:24:40.085 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:24:40.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:39 smithi192 ceph-mon[35641]: pgmap v83: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:40.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:39 smithi192 ceph-mon[35641]: from='client.? 172.21.15.3:0/3592720970' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:24:40.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:40.516+0000 7f694d09e640 1 -- 172.21.15.3:0/2184454989 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f69481067f0 msgr2=0x7f6948106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:40.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:40.516+0000 7f694d09e640 1 --2- 172.21.15.3:0/2184454989 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f69481067f0 0x7f6948106bd0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f6938009c20 tx=0x7f693802a970 comp rx=0 tx=0).stop 2024-09-21T12:24:40.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:40.516+0000 7f694d09e640 1 -- 172.21.15.3:0/2184454989 shutdown_connections 2024-09-21T12:24:40.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:40.516+0000 7f694d09e640 1 --2- 172.21.15.3:0/2184454989 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f69481007f0 0x7f6948100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:40.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:40.516+0000 7f694d09e640 1 --2- 172.21.15.3:0/2184454989 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f69481067f0 0x7f6948106bd0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:40.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:40.516+0000 7f694d09e640 1 -- 172.21.15.3:0/2184454989 >> 172.21.15.3:0/2184454989 conn(0x7f69480fc550 msgr2=0x7f69480fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:24:40.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:40.516+0000 7f694d09e640 1 -- 172.21.15.3:0/2184454989 shutdown_connections 2024-09-21T12:24:40.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:40.516+0000 7f694d09e640 1 -- 172.21.15.3:0/2184454989 wait complete. 2024-09-21T12:24:40.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:40.517+0000 7f694d09e640 1 Processor -- start 2024-09-21T12:24:40.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:40.517+0000 7f694d09e640 1 -- start start 2024-09-21T12:24:40.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:40.518+0000 7f694d09e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f69481007f0 0x7f694819f8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:24:40.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:40.518+0000 7f694d09e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f69481067f0 0x7f694819fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:24:40.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:40.518+0000 7f694d09e640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f694810dd20 con 0x7f69481067f0 2024-09-21T12:24:40.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:40.518+0000 7f694d09e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f694810dba0 con 0x7f69481007f0 2024-09-21T12:24:40.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:40.518+0000 7f694659c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f69481067f0 0x7f694819fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:24:40.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:40.518+0000 7f694659c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f69481067f0 0x7f694819fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33148/0 (socket says 172.21.15.3:33148) 2024-09-21T12:24:40.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:40.518+0000 7f694659c640 1 -- 172.21.15.3:0/489281698 learned_addr learned my addr 172.21.15.3:0/489281698 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:24:40.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:40.518+0000 7f6946d9d640 1 --2- 172.21.15.3:0/489281698 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f69481007f0 0x7f694819f8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:24:40.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:40.518+0000 7f694659c640 1 -- 172.21.15.3:0/489281698 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f69481007f0 msgr2=0x7f694819f8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:40.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:40.518+0000 7f694659c640 1 --2- 172.21.15.3:0/489281698 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f69481007f0 0x7f694819f8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:40.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:40.518+0000 7f694659c640 1 -- 172.21.15.3:0/489281698 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6948199a70 con 0x7f69481067f0 2024-09-21T12:24:40.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:40.518+0000 7f694659c640 1 --2- 172.21.15.3:0/489281698 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f69481067f0 0x7f694819fdf0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f693c00b420 tx=0x7f693c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:24:40.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:40.518+0000 7f692ffff640 1 -- 172.21.15.3:0/489281698 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f693c011630 con 0x7f69481067f0 2024-09-21T12:24:40.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:40.519+0000 7f694d09e640 1 -- 172.21.15.3:0/489281698 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6948199d60 con 0x7f69481067f0 2024-09-21T12:24:40.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:40.519+0000 7f692ffff640 1 -- 172.21.15.3:0/489281698 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f693c016070 con 0x7f69481067f0 2024-09-21T12:24:40.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:40.519+0000 7f692ffff640 1 -- 172.21.15.3:0/489281698 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f693c010d40 con 0x7f69481067f0 2024-09-21T12:24:40.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:40.519+0000 7f694d09e640 1 -- 172.21.15.3:0/489281698 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f694819a2f0 con 0x7f69481067f0 2024-09-21T12:24:40.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:40.520+0000 7f694d09e640 1 -- 172.21.15.3:0/489281698 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6948101f30 con 0x7f69481067f0 2024-09-21T12:24:40.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:40.520+0000 7f692ffff640 1 -- 172.21.15.3:0/489281698 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f693c0117d0 con 0x7f69481067f0 2024-09-21T12:24:40.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:40.521+0000 7f692ffff640 1 --2- 172.21.15.3:0/489281698 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f693007af30 0x7f693007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:24:40.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:40.521+0000 7f692ffff640 1 -- 172.21.15.3:0/489281698 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6156+0+0 (secure 0 0 0) 0x7f693c09d6d0 con 0x7f69481067f0 2024-09-21T12:24:40.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:40.521+0000 7f6946d9d640 1 --2- 172.21.15.3:0/489281698 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f693007af30 0x7f693007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:24:40.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:40.521+0000 7f6946d9d640 1 --2- 172.21.15.3:0/489281698 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f693007af30 0x7f693007d3f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6938009430 tx=0x7f693803c040 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:24:40.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:40.525+0000 7f692ffff640 1 -- 172.21.15.3:0/489281698 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f693c068cd0 con 0x7f69481067f0 2024-09-21T12:24:40.734 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:40.732+0000 7f694d09e640 1 -- 172.21.15.3:0/489281698 --> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] -- mgr_command(tid 0: {"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:5c1cdc3c470dae78e91a0ed2bcf13509a046d301", "target": ["mon-mgr", ""]}) -- 0x7f694819a600 con 0x7f693007af30 2024-09-21T12:24:42.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:41 smithi003 ceph-mon[28057]: from='client.14906 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:5c1cdc3c470dae78e91a0ed2bcf13509a046d301", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:24:42.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:41 smithi003 ceph-mon[28057]: pgmap v84: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:42.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:41 smithi192 ceph-mon[35641]: from='client.14906 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:5c1cdc3c470dae78e91a0ed2bcf13509a046d301", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:24:42.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:41 smithi192 ceph-mon[35641]: pgmap v84: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:42.559 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:42.557+0000 7f692ffff640 1 -- 172.21.15.3:0/489281698 <== mgr.14756 v2:172.21.15.3:6800/1284098095 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+5741 (secure 0 0 0) 0x7f694819a600 con 0x7f693007af30 2024-09-21T12:24:42.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:42.560+0000 7f694d09e640 1 -- 172.21.15.3:0/489281698 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f693007af30 msgr2=0x7f693007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:42.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:42.560+0000 7f694d09e640 1 --2- 172.21.15.3:0/489281698 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f693007af30 0x7f693007d3f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6938009430 tx=0x7f693803c040 comp rx=0 tx=0).stop 2024-09-21T12:24:42.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:42.560+0000 7f694d09e640 1 -- 172.21.15.3:0/489281698 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f69481067f0 msgr2=0x7f694819fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:42.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:42.560+0000 7f694d09e640 1 --2- 172.21.15.3:0/489281698 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f69481067f0 0x7f694819fdf0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f693c00b420 tx=0x7f693c00b8e0 comp rx=0 tx=0).stop 2024-09-21T12:24:42.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:42.561+0000 7f694d09e640 1 -- 172.21.15.3:0/489281698 shutdown_connections 2024-09-21T12:24:42.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:42.561+0000 7f694d09e640 1 --2- 172.21.15.3:0/489281698 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f693007af30 0x7f693007d3f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:42.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:42.561+0000 7f694d09e640 1 --2- 172.21.15.3:0/489281698 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f69481067f0 0x7f694819fdf0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:42.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:42.561+0000 7f694d09e640 1 --2- 172.21.15.3:0/489281698 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f69481007f0 0x7f694819f8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:42.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:42.561+0000 7f694d09e640 1 -- 172.21.15.3:0/489281698 >> 172.21.15.3:0/489281698 conn(0x7f69480fc550 msgr2=0x7f6948069d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:24:42.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:42.561+0000 7f694d09e640 1 -- 172.21.15.3:0/489281698 shutdown_connections 2024-09-21T12:24:42.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:42.561+0000 7f694d09e640 1 -- 172.21.15.3:0/489281698 wait complete. 2024-09-21T12:24:42.576 INFO:teuthology.orchestra.run.smithi003.stdout:true 2024-09-21T12:24:43.206 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:42 smithi003 ceph-mon[28057]: pgmap v85: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:43.235 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -e sha1=5c1cdc3c470dae78e91a0ed2bcf13509a046d301 -- bash -c 'ceph orch ps' 2024-09-21T12:24:43.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:42 smithi192 ceph-mon[35641]: pgmap v85: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:43.497 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:24:44.011 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:44.007+0000 7fa705d06640 1 -- 172.21.15.3:0/4215839916 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa700100800 msgr2=0x7fa700100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:44.011 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:44.007+0000 7fa705d06640 1 --2- 172.21.15.3:0/4215839916 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa700100800 0x7fa700100c60 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fa6f4009880 tx=0x7fa6f402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:24:44.011 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:44.007+0000 7fa705d06640 1 -- 172.21.15.3:0/4215839916 shutdown_connections 2024-09-21T12:24:44.012 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:44.007+0000 7fa705d06640 1 --2- 172.21.15.3:0/4215839916 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa700100800 0x7fa700100c60 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:44.012 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:44.007+0000 7fa705d06640 1 --2- 172.21.15.3:0/4215839916 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa700106800 0x7fa700106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:44.012 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:44.007+0000 7fa705d06640 1 -- 172.21.15.3:0/4215839916 >> 172.21.15.3:0/4215839916 conn(0x7fa7000fc520 msgr2=0x7fa7000fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:24:44.012 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:44.007+0000 7fa705d06640 1 -- 172.21.15.3:0/4215839916 shutdown_connections 2024-09-21T12:24:44.012 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:44.007+0000 7fa705d06640 1 -- 172.21.15.3:0/4215839916 wait complete. 2024-09-21T12:24:44.012 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:44.008+0000 7fa705d06640 1 Processor -- start 2024-09-21T12:24:44.012 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:44.008+0000 7fa705d06640 1 -- start start 2024-09-21T12:24:44.012 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:44.008+0000 7fa705d06640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa700100800 0x7fa7001023d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:24:44.012 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:44.008+0000 7fa705d06640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa700106800 0x7fa700102910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:24:44.012 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:44.008+0000 7fa705d06640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fa70010dcb0 con 0x7fa700106800 2024-09-21T12:24:44.012 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:44.008+0000 7fa705d06640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa70010db30 con 0x7fa700100800 2024-09-21T12:24:44.012 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:44.008+0000 7fa6feffd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa700106800 0x7fa700102910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:24:44.013 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:44.009+0000 7fa6feffd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa700106800 0x7fa700102910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33172/0 (socket says 172.21.15.3:33172) 2024-09-21T12:24:44.013 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:44.009+0000 7fa6feffd640 1 -- 172.21.15.3:0/1589574432 learned_addr learned my addr 172.21.15.3:0/1589574432 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:24:44.013 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:44.009+0000 7fa6ff7fe640 1 --2- 172.21.15.3:0/1589574432 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa700100800 0x7fa7001023d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:24:44.013 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:44.009+0000 7fa6feffd640 1 -- 172.21.15.3:0/1589574432 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa700100800 msgr2=0x7fa7001023d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:44.013 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:44.009+0000 7fa6feffd640 1 --2- 172.21.15.3:0/1589574432 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa700100800 0x7fa7001023d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:44.013 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:44.009+0000 7fa6feffd640 1 -- 172.21.15.3:0/1589574432 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa700102e50 con 0x7fa700106800 2024-09-21T12:24:44.013 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:44.009+0000 7fa6feffd640 1 --2- 172.21.15.3:0/1589574432 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa700106800 0x7fa700102910 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fa6f4031460 tx=0x7fa6f40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:24:44.013 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:44.009+0000 7fa6fcff9640 1 -- 172.21.15.3:0/1589574432 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa6f403f070 con 0x7fa700106800 2024-09-21T12:24:44.013 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:44.009+0000 7fa705d06640 1 -- 172.21.15.3:0/1589574432 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7001030e0 con 0x7fa700106800 2024-09-21T12:24:44.013 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:44.009+0000 7fa6fcff9640 1 -- 172.21.15.3:0/1589574432 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa6f4004cf0 con 0x7fa700106800 2024-09-21T12:24:44.013 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:44.009+0000 7fa6fcff9640 1 -- 172.21.15.3:0/1589574432 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa6f4035030 con 0x7fa700106800 2024-09-21T12:24:44.013 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:44.009+0000 7fa705d06640 1 -- 172.21.15.3:0/1589574432 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7001a3d10 con 0x7fa700106800 2024-09-21T12:24:44.014 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:44.010+0000 7fa705d06640 1 -- 172.21.15.3:0/1589574432 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa700101f40 con 0x7fa700106800 2024-09-21T12:24:44.014 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:44.011+0000 7fa6fcff9640 1 -- 172.21.15.3:0/1589574432 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7fa6f4042070 con 0x7fa700106800 2024-09-21T12:24:44.015 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:44.011+0000 7fa6fcff9640 1 --2- 172.21.15.3:0/1589574432 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fa6e807af30 0x7fa6e807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:24:44.015 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:44.012+0000 7fa6fcff9640 1 -- 172.21.15.3:0/1589574432 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6156+0+0 (secure 0 0 0) 0x7fa6f40beac0 con 0x7fa700106800 2024-09-21T12:24:44.015 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:44.012+0000 7fa6ff7fe640 1 --2- 172.21.15.3:0/1589574432 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fa6e807af30 0x7fa6e807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:24:44.015 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:44.012+0000 7fa6ff7fe640 1 --2- 172.21.15.3:0/1589574432 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fa6e807af30 0x7fa6e807d3f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa6f000abe0 tx=0x7fa6f000a2d0 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:24:44.017 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:44.016+0000 7fa6fcff9640 1 -- 172.21.15.3:0/1589574432 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fa6f408a020 con 0x7fa700106800 2024-09-21T12:24:44.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:44.214+0000 7fa705d06640 1 -- 172.21.15.3:0/1589574432 --> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fa70006a1b0 con 0x7fa6e807af30 2024-09-21T12:24:44.226 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:44.224+0000 7fa6fcff9640 1 -- 172.21.15.3:0/1589574432 <== mgr.14756 v2:172.21.15.3:6800/1284098095 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7fa70006a1b0 con 0x7fa6e807af30 2024-09-21T12:24:44.226 INFO:teuthology.orchestra.run.smithi003.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:24:44.226 INFO:teuthology.orchestra.run.smithi003.stdout:alertmanager.smithi003 smithi003 *:9093,9094 running (71s) 40s ago 12m 17.6M - 0.27.0 11f11916f8cd 14880018dfd3 2024-09-21T12:24:44.226 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-exporter.smithi003 smithi003 running (3m) 40s ago 12m 8564k - 19.1.1-373-g4e45e6b4 164465d2334a 0c9ad60a4f5a 2024-09-21T12:24:44.226 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-exporter.smithi192 smithi192 running (3m) 110s ago 11m 8124k - 19.1.1-373-g4e45e6b4 164465d2334a d5be8a6e120f 2024-09-21T12:24:44.227 INFO:teuthology.orchestra.run.smithi003.stdout:crash.smithi003 smithi003 running (12m) 40s ago 12m 6899k - 19.1.1-373-g4e45e6b4 164465d2334a c63f209dc1dc 2024-09-21T12:24:44.227 INFO:teuthology.orchestra.run.smithi003.stdout:crash.smithi192 smithi192 running (11m) 110s ago 11m 6895k - 19.1.1-373-g4e45e6b4 164465d2334a cc70c9a7b2f7 2024-09-21T12:24:44.227 INFO:teuthology.orchestra.run.smithi003.stdout:grafana.smithi003 smithi003 *:3000 running (46s) 40s ago 12m 46.3M - 10.4.8 5aad1d7cf004 19e26b3cb585 2024-09-21T12:24:44.227 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi003.ebjgyl smithi003 running (7m) 40s ago 7m 15.4M - 19.1.1-373-g4e45e6b4 164465d2334a 16e0b2cac16a 2024-09-21T12:24:44.227 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi003.gfkngj smithi003 running (6m) 40s ago 6m 144M - 19.1.1-373-g4e45e6b4 164465d2334a 109c04f87fbd 2024-09-21T12:24:44.227 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi192.ktdqns smithi192 running (6m) 110s ago 6m 16.7M - 19.1.1-373-g4e45e6b4 164465d2334a 495c73fb3bb0 2024-09-21T12:24:44.227 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi192.ywqqxe smithi192 running (7m) 110s ago 6m 16.7M - 19.1.1-373-g4e45e6b4 164465d2334a 270a01030cbe 2024-09-21T12:24:44.227 INFO:teuthology.orchestra.run.smithi003.stdout:mgr.smithi003.wztftl smithi003 *:8443,9283,8765 running (3m) 40s ago 13m 520M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 8ce0e66fd369 2024-09-21T12:24:44.227 INFO:teuthology.orchestra.run.smithi003.stdout:mgr.smithi192.qsaprd smithi192 *:8443,9283,8765 running (2m) 110s ago 11m 455M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 002a6171dd47 2024-09-21T12:24:44.227 INFO:teuthology.orchestra.run.smithi003.stdout:mon.smithi003 smithi003 running (13m) 40s ago 13m 59.5M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 16bccf2c7503 2024-09-21T12:24:44.227 INFO:teuthology.orchestra.run.smithi003.stdout:mon.smithi192 smithi192 running (11m) 110s ago 11m 43.1M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 4fe4c4b3dc5d 2024-09-21T12:24:44.227 INFO:teuthology.orchestra.run.smithi003.stdout:node-exporter.smithi003 smithi003 *:9100 running (2m) 40s ago 12m 10.9M - 1.7.0 72c9c2088986 d9cb7ede9060 2024-09-21T12:24:44.227 INFO:teuthology.orchestra.run.smithi003.stdout:node-exporter.smithi192 smithi192 *:9100 running (113s) 110s ago 11m 3343k - 1.7.0 72c9c2088986 d8ec0acfce7e 2024-09-21T12:24:44.228 INFO:teuthology.orchestra.run.smithi003.stdout:osd.0 smithi003 running (10m) 40s ago 10m 201M 1217M 19.1.1-373-g4e45e6b4 164465d2334a d07f1489720d 2024-09-21T12:24:44.228 INFO:teuthology.orchestra.run.smithi003.stdout:osd.1 smithi003 running (9m) 40s ago 9m 209M 1217M 19.1.1-373-g4e45e6b4 164465d2334a 6abd75a07645 2024-09-21T12:24:44.228 INFO:teuthology.orchestra.run.smithi003.stdout:osd.2 smithi003 running (9m) 40s ago 9m 172M 1217M 19.1.1-373-g4e45e6b4 164465d2334a 3265369e573b 2024-09-21T12:24:44.228 INFO:teuthology.orchestra.run.smithi003.stdout:osd.3 smithi192 running (8m) 110s ago 8m 237M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 13efcfd71c05 2024-09-21T12:24:44.228 INFO:teuthology.orchestra.run.smithi003.stdout:osd.4 smithi192 running (8m) 110s ago 8m 202M 2240M 19.1.1-373-g4e45e6b4 164465d2334a f33bf453cb3e 2024-09-21T12:24:44.228 INFO:teuthology.orchestra.run.smithi003.stdout:osd.5 smithi192 running (8m) 110s ago 8m 180M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 12d7b7c8e985 2024-09-21T12:24:44.228 INFO:teuthology.orchestra.run.smithi003.stdout:prometheus.smithi003 smithi003 *:9095 running (90s) 40s ago 12m 43.6M - 2.51.0 1d3b7f56885b 64997a33fbbb 2024-09-21T12:24:44.229 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:44.226+0000 7fa705d06640 1 -- 172.21.15.3:0/1589574432 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fa6e807af30 msgr2=0x7fa6e807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:44.229 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:44.226+0000 7fa705d06640 1 --2- 172.21.15.3:0/1589574432 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fa6e807af30 0x7fa6e807d3f0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fa6f000abe0 tx=0x7fa6f000a2d0 comp rx=0 tx=0).stop 2024-09-21T12:24:44.229 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:44.226+0000 7fa705d06640 1 -- 172.21.15.3:0/1589574432 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa700106800 msgr2=0x7fa700102910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:44.229 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:44.226+0000 7fa705d06640 1 --2- 172.21.15.3:0/1589574432 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa700106800 0x7fa700102910 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fa6f4031460 tx=0x7fa6f40048f0 comp rx=0 tx=0).stop 2024-09-21T12:24:44.229 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:44.227+0000 7fa705d06640 1 -- 172.21.15.3:0/1589574432 shutdown_connections 2024-09-21T12:24:44.229 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:44.227+0000 7fa705d06640 1 --2- 172.21.15.3:0/1589574432 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fa6e807af30 0x7fa6e807d3f0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:44.229 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:44.227+0000 7fa705d06640 1 --2- 172.21.15.3:0/1589574432 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa700106800 0x7fa700102910 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:44.229 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:44.227+0000 7fa705d06640 1 --2- 172.21.15.3:0/1589574432 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa700100800 0x7fa7001023d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:44.229 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:44.227+0000 7fa705d06640 1 -- 172.21.15.3:0/1589574432 >> 172.21.15.3:0/1589574432 conn(0x7fa7000fc520 msgr2=0x7fa7001045d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:24:44.229 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:44.227+0000 7fa705d06640 1 -- 172.21.15.3:0/1589574432 shutdown_connections 2024-09-21T12:24:44.230 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:44.227+0000 7fa705d06640 1 -- 172.21.15.3:0/1589574432 wait complete. 2024-09-21T12:24:44.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:44 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:24:44.895 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-21T12:24:44.895 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi003.front.sepia.ceph.com 2024-09-21T12:24:44.896 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -e sha1=5c1cdc3c470dae78e91a0ed2bcf13509a046d301 -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs true' 2024-09-21T12:24:45.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:44 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:24:45.159 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:24:45.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:45.611+0000 7f7ada4ac640 1 -- 172.21.15.3:0/860008448 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7ad4101900 msgr2=0x7f7ad4101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:45.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:45.611+0000 7f7ada4ac640 1 --2- 172.21.15.3:0/860008448 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7ad4101900 0x7f7ad4101d60 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f7ac8009880 tx=0x7f7ac802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:24:45.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:45.611+0000 7f7ada4ac640 1 -- 172.21.15.3:0/860008448 shutdown_connections 2024-09-21T12:24:45.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:45.611+0000 7f7ada4ac640 1 --2- 172.21.15.3:0/860008448 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7ad4101900 0x7f7ad4101d60 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:45.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:45.611+0000 7f7ada4ac640 1 --2- 172.21.15.3:0/860008448 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ad4107900 0x7f7ad4107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:45.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:45.611+0000 7f7ada4ac640 1 -- 172.21.15.3:0/860008448 >> 172.21.15.3:0/860008448 conn(0x7f7ad40fd600 msgr2=0x7f7ad40ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:24:45.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:45.611+0000 7f7ada4ac640 1 -- 172.21.15.3:0/860008448 shutdown_connections 2024-09-21T12:24:45.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:45.611+0000 7f7ada4ac640 1 -- 172.21.15.3:0/860008448 wait complete. 2024-09-21T12:24:45.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:45.612+0000 7f7ada4ac640 1 Processor -- start 2024-09-21T12:24:45.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:45.612+0000 7f7ada4ac640 1 -- start start 2024-09-21T12:24:45.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:45.612+0000 7f7ada4ac640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ad4101900 0x7f7ad40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:24:45.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:45.612+0000 7f7ada4ac640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7ad4107900 0x7f7ad4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:24:45.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:45.612+0000 7f7ada4ac640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f7ad410edb0 con 0x7f7ad4107900 2024-09-21T12:24:45.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:45.612+0000 7f7ada4ac640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7ad410ec30 con 0x7f7ad4101900 2024-09-21T12:24:45.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:45.612+0000 7f7ad37fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7ad4107900 0x7f7ad4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:24:45.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:45.612+0000 7f7ad37fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7ad4107900 0x7f7ad4074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33196/0 (socket says 172.21.15.3:33196) 2024-09-21T12:24:45.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:45.612+0000 7f7ad37fe640 1 -- 172.21.15.3:0/282711031 learned_addr learned my addr 172.21.15.3:0/282711031 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:24:45.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:45.613+0000 7f7ad3fff640 1 --2- 172.21.15.3:0/282711031 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ad4101900 0x7f7ad40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:24:45.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:45.613+0000 7f7ad37fe640 1 -- 172.21.15.3:0/282711031 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ad4101900 msgr2=0x7f7ad40744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:45.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:45.613+0000 7f7ad37fe640 1 --2- 172.21.15.3:0/282711031 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ad4101900 0x7f7ad40744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:45.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:45.613+0000 7f7ad37fe640 1 -- 172.21.15.3:0/282711031 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ad4074f70 con 0x7f7ad4107900 2024-09-21T12:24:45.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:45.613+0000 7f7ad3fff640 1 --2- 172.21.15.3:0/282711031 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ad4101900 0x7f7ad40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:24:45.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:45.613+0000 7f7ad37fe640 1 --2- 172.21.15.3:0/282711031 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7ad4107900 0x7f7ad4074a30 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f7ac8031460 tx=0x7f7ac80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:24:45.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:45.613+0000 7f7ad17fa640 1 -- 172.21.15.3:0/282711031 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7ac803f070 con 0x7f7ad4107900 2024-09-21T12:24:45.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:45.613+0000 7f7ad17fa640 1 -- 172.21.15.3:0/282711031 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7ac8004cf0 con 0x7f7ad4107900 2024-09-21T12:24:45.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:45.613+0000 7f7ada4ac640 1 -- 172.21.15.3:0/282711031 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ad4075200 con 0x7f7ad4107900 2024-09-21T12:24:45.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:45.613+0000 7f7ad17fa640 1 -- 172.21.15.3:0/282711031 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7ac8035030 con 0x7f7ad4107900 2024-09-21T12:24:45.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:45.613+0000 7f7ada4ac640 1 -- 172.21.15.3:0/282711031 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ad41a3dc0 con 0x7f7ad4107900 2024-09-21T12:24:45.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:45.614+0000 7f7ada4ac640 1 -- 172.21.15.3:0/282711031 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ad4103040 con 0x7f7ad4107900 2024-09-21T12:24:45.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:45.615+0000 7f7ad17fa640 1 -- 172.21.15.3:0/282711031 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f7ac8042070 con 0x7f7ad4107900 2024-09-21T12:24:45.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:45.615+0000 7f7ad17fa640 1 --2- 172.21.15.3:0/282711031 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f7abc07af80 0x7f7abc07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:24:45.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:45.616+0000 7f7ad17fa640 1 -- 172.21.15.3:0/282711031 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6156+0+0 (secure 0 0 0) 0x7f7ac80bea80 con 0x7f7ad4107900 2024-09-21T12:24:45.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:45.616+0000 7f7ad3fff640 1 --2- 172.21.15.3:0/282711031 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f7abc07af80 0x7f7abc07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:24:45.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:45.616+0000 7f7ad3fff640 1 --2- 172.21.15.3:0/282711031 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f7abc07af80 0x7f7abc07d440 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7ac40058c0 tx=0x7f7ac4005ec0 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:24:45.621 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:45.620+0000 7f7ad17fa640 1 -- 172.21.15.3:0/282711031 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f7ac808a060 con 0x7f7ad4107900 2024-09-21T12:24:45.808 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:45.806+0000 7f7ada4ac640 1 -- 172.21.15.3:0/282711031 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) -- 0x7f7ad4109e90 con 0x7f7ad4107900 2024-09-21T12:24:45.812 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:45.810+0000 7f7ad17fa640 1 -- 172.21.15.3:0/282711031 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=0 v62)=0 v62) ==== 125+0+0 (secure 0 0 0) 0x7f7ac808ef10 con 0x7f7ad4107900 2024-09-21T12:24:45.814 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:45.813+0000 7f7ada4ac640 1 -- 172.21.15.3:0/282711031 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f7abc07af80 msgr2=0x7f7abc07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:45.814 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:45.813+0000 7f7ada4ac640 1 --2- 172.21.15.3:0/282711031 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f7abc07af80 0x7f7abc07d440 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7ac40058c0 tx=0x7f7ac4005ec0 comp rx=0 tx=0).stop 2024-09-21T12:24:45.814 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:45.813+0000 7f7ada4ac640 1 -- 172.21.15.3:0/282711031 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7ad4107900 msgr2=0x7f7ad4074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:45.815 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:45.813+0000 7f7ada4ac640 1 --2- 172.21.15.3:0/282711031 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7ad4107900 0x7f7ad4074a30 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f7ac8031460 tx=0x7f7ac80048f0 comp rx=0 tx=0).stop 2024-09-21T12:24:45.815 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:45.813+0000 7f7ada4ac640 1 -- 172.21.15.3:0/282711031 shutdown_connections 2024-09-21T12:24:45.815 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:45.813+0000 7f7ada4ac640 1 --2- 172.21.15.3:0/282711031 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f7abc07af80 0x7f7abc07d440 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:45.815 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:45.813+0000 7f7ada4ac640 1 --2- 172.21.15.3:0/282711031 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7ad4107900 0x7f7ad4074a30 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:45.815 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:45.813+0000 7f7ada4ac640 1 --2- 172.21.15.3:0/282711031 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7ad4101900 0x7f7ad40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:45.815 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:45.813+0000 7f7ada4ac640 1 -- 172.21.15.3:0/282711031 >> 172.21.15.3:0/282711031 conn(0x7f7ad40fd600 msgr2=0x7f7ad40fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:24:45.815 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:45.813+0000 7f7ada4ac640 1 -- 172.21.15.3:0/282711031 shutdown_connections 2024-09-21T12:24:45.815 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:45.813+0000 7f7ada4ac640 1 -- 172.21.15.3:0/282711031 wait complete. 2024-09-21T12:24:46.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:45 smithi192 ceph-mon[35641]: from='client.14910 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:24:46.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:45 smithi192 ceph-mon[35641]: pgmap v86: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:46.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:45 smithi003 ceph-mon[28057]: from='client.14910 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:24:46.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:45 smithi003 ceph-mon[28057]: pgmap v86: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:46.449 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-21T12:24:46.449 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi003.front.sepia.ceph.com 2024-09-21T12:24:46.449 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -e sha1=5c1cdc3c470dae78e91a0ed2bcf13509a046d301 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-09-21T12:24:46.708 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:24:47.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:46 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/282711031' entity='client.admin' 2024-09-21T12:24:47.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:46 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:24:47.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:46 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:24:47.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:46 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:24:47.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:46 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:24:47.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:46 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T12:24:47.192 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:47.190+0000 7f24b195a640 1 -- 172.21.15.3:0/2064358119 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f24ac107900 msgr2=0x7f24ac107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:47.192 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:47.190+0000 7f24b195a640 1 --2- 172.21.15.3:0/2064358119 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f24ac107900 0x7f24ac107ce0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f249c009880 tx=0x7f249c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:24:47.192 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:47.190+0000 7f24b195a640 1 -- 172.21.15.3:0/2064358119 shutdown_connections 2024-09-21T12:24:47.192 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:47.190+0000 7f24b195a640 1 --2- 172.21.15.3:0/2064358119 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24ac101900 0x7f24ac101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:47.193 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:47.190+0000 7f24b195a640 1 --2- 172.21.15.3:0/2064358119 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f24ac107900 0x7f24ac107ce0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:47.193 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:47.190+0000 7f24b195a640 1 -- 172.21.15.3:0/2064358119 >> 172.21.15.3:0/2064358119 conn(0x7f24ac0fd600 msgr2=0x7f24ac0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:24:47.193 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:47.190+0000 7f24b195a640 1 -- 172.21.15.3:0/2064358119 shutdown_connections 2024-09-21T12:24:47.193 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:47.190+0000 7f24b195a640 1 -- 172.21.15.3:0/2064358119 wait complete. 2024-09-21T12:24:47.193 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:47.191+0000 7f24b195a640 1 Processor -- start 2024-09-21T12:24:47.193 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:47.191+0000 7f24b195a640 1 -- start start 2024-09-21T12:24:47.194 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:47.191+0000 7f24b195a640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24ac101900 0x7f24ac0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:24:47.194 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:47.191+0000 7f24b195a640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f24ac107900 0x7f24ac074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:24:47.195 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:47.191+0000 7f24b195a640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f24ac10edd0 con 0x7f24ac107900 2024-09-21T12:24:47.195 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:47.191+0000 7f24b195a640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f24ac10ec50 con 0x7f24ac101900 2024-09-21T12:24:47.195 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:47.191+0000 7f24a3fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f24ac107900 0x7f24ac074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:24:47.195 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:47.191+0000 7f24a3fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f24ac107900 0x7f24ac074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33212/0 (socket says 172.21.15.3:33212) 2024-09-21T12:24:47.195 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:47.191+0000 7f24a3fff640 1 -- 172.21.15.3:0/2360719787 learned_addr learned my addr 172.21.15.3:0/2360719787 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:24:47.195 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:47.191+0000 7f24aaffd640 1 --2- 172.21.15.3:0/2360719787 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24ac101900 0x7f24ac0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:24:47.195 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:47.192+0000 7f24a3fff640 1 -- 172.21.15.3:0/2360719787 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24ac101900 msgr2=0x7f24ac0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:47.195 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:47.192+0000 7f24a3fff640 1 --2- 172.21.15.3:0/2360719787 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24ac101900 0x7f24ac0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:47.195 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:47.192+0000 7f24a3fff640 1 -- 172.21.15.3:0/2360719787 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24ac074f70 con 0x7f24ac107900 2024-09-21T12:24:47.195 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:47.192+0000 7f24a3fff640 1 --2- 172.21.15.3:0/2360719787 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f24ac107900 0x7f24ac074a30 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f249400d6f0 tx=0x7f249400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:24:47.195 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:47.192+0000 7f24b0958640 1 -- 172.21.15.3:0/2360719787 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2494017070 con 0x7f24ac107900 2024-09-21T12:24:47.195 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:47.192+0000 7f24b0958640 1 -- 172.21.15.3:0/2360719787 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f249400de00 con 0x7f24ac107900 2024-09-21T12:24:47.195 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:47.192+0000 7f24b195a640 1 -- 172.21.15.3:0/2360719787 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24ac075260 con 0x7f24ac107900 2024-09-21T12:24:47.195 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:47.192+0000 7f24b0958640 1 -- 172.21.15.3:0/2360719787 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2494004bb0 con 0x7f24ac107900 2024-09-21T12:24:47.196 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:47.192+0000 7f24b195a640 1 -- 172.21.15.3:0/2360719787 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24ac1a3e80 con 0x7f24ac107900 2024-09-21T12:24:47.196 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:47.193+0000 7f24b195a640 1 -- 172.21.15.3:0/2360719787 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24ac103040 con 0x7f24ac107900 2024-09-21T12:24:47.196 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:47.194+0000 7f24b0958640 1 -- 172.21.15.3:0/2360719787 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f2494009a30 con 0x7f24ac107900 2024-09-21T12:24:47.196 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:47.194+0000 7f24b0958640 1 --2- 172.21.15.3:0/2360719787 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f249807af80 0x7f249807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:24:47.196 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:47.195+0000 7f24b0958640 1 -- 172.21.15.3:0/2360719787 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6156+0+0 (secure 0 0 0) 0x7f249409db70 con 0x7f24ac107900 2024-09-21T12:24:47.197 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:47.195+0000 7f24aaffd640 1 --2- 172.21.15.3:0/2360719787 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f249807af80 0x7f249807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:24:47.197 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:47.195+0000 7f24aaffd640 1 --2- 172.21.15.3:0/2360719787 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f249807af80 0x7f249807d440 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f249c0096c0 tx=0x7f249c031400 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:24:47.200 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:47.199+0000 7f24b0958640 1 -- 172.21.15.3:0/2360719787 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f2494069150 con 0x7f24ac107900 2024-09-21T12:24:47.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:46 smithi192 ceph-mon[35641]: from='client.? 172.21.15.3:0/282711031' entity='client.admin' 2024-09-21T12:24:47.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:46 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:24:47.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:46 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:24:47.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:46 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:24:47.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:46 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:24:47.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:46 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T12:24:47.387 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:47.386+0000 7f24b195a640 1 -- 172.21.15.3:0/2360719787 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) -- 0x7f24ac109e70 con 0x7f24ac107900 2024-09-21T12:24:47.388 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:47.386+0000 7f24b0958640 1 -- 172.21.15.3:0/2360719787 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v62)=0 v62) ==== 155+0+0 (secure 0 0 0) 0x7f249405ee20 con 0x7f24ac107900 2024-09-21T12:24:47.390 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:47.388+0000 7f24b195a640 1 -- 172.21.15.3:0/2360719787 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f249807af80 msgr2=0x7f249807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:47.390 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:47.388+0000 7f24b195a640 1 --2- 172.21.15.3:0/2360719787 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f249807af80 0x7f249807d440 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f249c0096c0 tx=0x7f249c031400 comp rx=0 tx=0).stop 2024-09-21T12:24:47.390 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:47.388+0000 7f24b195a640 1 -- 172.21.15.3:0/2360719787 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f24ac107900 msgr2=0x7f24ac074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:47.390 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:47.388+0000 7f24b195a640 1 --2- 172.21.15.3:0/2360719787 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f24ac107900 0x7f24ac074a30 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f249400d6f0 tx=0x7f249400dbb0 comp rx=0 tx=0).stop 2024-09-21T12:24:47.390 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:47.388+0000 7f24b195a640 1 -- 172.21.15.3:0/2360719787 shutdown_connections 2024-09-21T12:24:47.391 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:47.388+0000 7f24b195a640 1 --2- 172.21.15.3:0/2360719787 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f249807af80 0x7f249807d440 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:47.391 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:47.388+0000 7f24b195a640 1 --2- 172.21.15.3:0/2360719787 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f24ac107900 0x7f24ac074a30 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:47.391 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:47.388+0000 7f24b195a640 1 --2- 172.21.15.3:0/2360719787 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f24ac101900 0x7f24ac0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:47.391 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:47.388+0000 7f24b195a640 1 -- 172.21.15.3:0/2360719787 >> 172.21.15.3:0/2360719787 conn(0x7f24ac0fd600 msgr2=0x7f24ac0fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:24:47.391 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:47.388+0000 7f24b195a640 1 -- 172.21.15.3:0/2360719787 shutdown_connections 2024-09-21T12:24:47.391 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:47.388+0000 7f24b195a640 1 -- 172.21.15.3:0/2360719787 wait complete. 2024-09-21T12:24:48.021 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:47 smithi003 ceph-mon[28057]: from='mon.? -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T12:24:48.021 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:47 smithi003 ceph-mon[28057]: pgmap v87: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:48.056 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -e sha1=5c1cdc3c470dae78e91a0ed2bcf13509a046d301 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-09-21T12:24:48.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:47 smithi192 ceph-mon[35641]: from='mon.? -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T12:24:48.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:47 smithi192 ceph-mon[35641]: pgmap v87: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:48.320 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:24:48.816 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:48.803+0000 7f7c0a42a640 1 -- 172.21.15.3:0/1532231632 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7c04101900 msgr2=0x7f7c04101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:48.817 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:48.803+0000 7f7c0a42a640 1 --2- 172.21.15.3:0/1532231632 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7c04101900 0x7f7c04101d60 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f7bec009880 tx=0x7f7bec02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:24:48.817 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:48.803+0000 7f7c0a42a640 1 -- 172.21.15.3:0/1532231632 shutdown_connections 2024-09-21T12:24:48.817 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:48.803+0000 7f7c0a42a640 1 --2- 172.21.15.3:0/1532231632 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7c04101900 0x7f7c04101d60 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:48.817 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:48.803+0000 7f7c0a42a640 1 --2- 172.21.15.3:0/1532231632 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c04107900 0x7f7c04107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:48.817 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:48.803+0000 7f7c0a42a640 1 -- 172.21.15.3:0/1532231632 >> 172.21.15.3:0/1532231632 conn(0x7f7c040fd600 msgr2=0x7f7c040ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:24:48.817 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:48.803+0000 7f7c0a42a640 1 -- 172.21.15.3:0/1532231632 shutdown_connections 2024-09-21T12:24:48.817 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:48.803+0000 7f7c0a42a640 1 -- 172.21.15.3:0/1532231632 wait complete. 2024-09-21T12:24:48.817 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:48.804+0000 7f7c0a42a640 1 Processor -- start 2024-09-21T12:24:48.817 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:48.804+0000 7f7c0a42a640 1 -- start start 2024-09-21T12:24:48.817 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:48.804+0000 7f7c0a42a640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7c04101900 0x7f7c040744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:24:48.817 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:48.804+0000 7f7c0a42a640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c04107900 0x7f7c04074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:24:48.817 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:48.804+0000 7f7c0a42a640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f7c0410ee30 con 0x7f7c04101900 2024-09-21T12:24:48.818 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:48.804+0000 7f7c0a42a640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7c0410ecb0 con 0x7f7c04107900 2024-09-21T12:24:48.818 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:48.804+0000 7f7c03fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7c04101900 0x7f7c040744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:24:48.818 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:48.804+0000 7f7c03fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7c04101900 0x7f7c040744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33224/0 (socket says 172.21.15.3:33224) 2024-09-21T12:24:48.818 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:48.804+0000 7f7c03fff640 1 -- 172.21.15.3:0/3142994665 learned_addr learned my addr 172.21.15.3:0/3142994665 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:24:48.818 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:48.804+0000 7f7bfbfff640 1 --2- 172.21.15.3:0/3142994665 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c04107900 0x7f7c04074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:24:48.818 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:48.805+0000 7f7c03fff640 1 -- 172.21.15.3:0/3142994665 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c04107900 msgr2=0x7f7c04074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:48.818 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:48.805+0000 7f7c03fff640 1 --2- 172.21.15.3:0/3142994665 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c04107900 0x7f7c04074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:48.818 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:48.805+0000 7f7c03fff640 1 -- 172.21.15.3:0/3142994665 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c04074f70 con 0x7f7c04101900 2024-09-21T12:24:48.818 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:48.805+0000 7f7c03fff640 1 --2- 172.21.15.3:0/3142994665 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7c04101900 0x7f7c040744f0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f7bf400b420 tx=0x7f7bf400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:24:48.818 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:48.805+0000 7f7c01ffb640 1 -- 172.21.15.3:0/3142994665 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7bf4011630 con 0x7f7c04101900 2024-09-21T12:24:48.818 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:48.805+0000 7f7c0a42a640 1 -- 172.21.15.3:0/3142994665 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c04075260 con 0x7f7c04101900 2024-09-21T12:24:48.818 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:48.805+0000 7f7c01ffb640 1 -- 172.21.15.3:0/3142994665 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7bf4016070 con 0x7f7c04101900 2024-09-21T12:24:48.818 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:48.805+0000 7f7c01ffb640 1 -- 172.21.15.3:0/3142994665 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7bf4010d40 con 0x7f7c04101900 2024-09-21T12:24:48.818 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:48.805+0000 7f7c0a42a640 1 -- 172.21.15.3:0/3142994665 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c041a3f00 con 0x7f7c04101900 2024-09-21T12:24:48.819 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:48.806+0000 7f7c0a42a640 1 -- 172.21.15.3:0/3142994665 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c04103040 con 0x7f7c04101900 2024-09-21T12:24:48.819 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:48.807+0000 7f7c01ffb640 1 -- 172.21.15.3:0/3142994665 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f7bf401b460 con 0x7f7c04101900 2024-09-21T12:24:48.819 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:48.807+0000 7f7c01ffb640 1 --2- 172.21.15.3:0/3142994665 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f7bf007af30 0x7f7bf007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:24:48.819 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:48.807+0000 7f7c01ffb640 1 -- 172.21.15.3:0/3142994665 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6156+0+0 (secure 0 0 0) 0x7f7bf409d7b0 con 0x7f7c04101900 2024-09-21T12:24:48.819 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:48.808+0000 7f7bfbfff640 1 --2- 172.21.15.3:0/3142994665 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f7bf007af30 0x7f7bf007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:24:48.819 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:48.808+0000 7f7bfbfff640 1 --2- 172.21.15.3:0/3142994665 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f7bf007af30 0x7f7bf007d3f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7c04075f80 tx=0x7f7bec031400 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:24:48.819 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:48.812+0000 7f7c01ffb640 1 -- 172.21.15.3:0/3142994665 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f7bf4021250 con 0x7f7c04101900 2024-09-21T12:24:48.998 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:48.997+0000 7f7c0a42a640 1 -- 172.21.15.3:0/3142994665 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) -- 0x7f7c04109e90 con 0x7f7c04101900 2024-09-21T12:24:48.999 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:48.997+0000 7f7c01ffb640 1 -- 172.21.15.3:0/3142994665 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v62)=0 v62) ==== 163+0+0 (secure 0 0 0) 0x7f7bf4068db0 con 0x7f7c04101900 2024-09-21T12:24:49.001 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:48.999+0000 7f7c0a42a640 1 -- 172.21.15.3:0/3142994665 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f7bf007af30 msgr2=0x7f7bf007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:49.001 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:48.999+0000 7f7c0a42a640 1 --2- 172.21.15.3:0/3142994665 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f7bf007af30 0x7f7bf007d3f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7c04075f80 tx=0x7f7bec031400 comp rx=0 tx=0).stop 2024-09-21T12:24:49.001 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:48.999+0000 7f7c0a42a640 1 -- 172.21.15.3:0/3142994665 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7c04101900 msgr2=0x7f7c040744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:49.001 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:48.999+0000 7f7c0a42a640 1 --2- 172.21.15.3:0/3142994665 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7c04101900 0x7f7c040744f0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f7bf400b420 tx=0x7f7bf400b8e0 comp rx=0 tx=0).stop 2024-09-21T12:24:49.001 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:48.999+0000 7f7c0a42a640 1 -- 172.21.15.3:0/3142994665 shutdown_connections 2024-09-21T12:24:49.002 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:48.999+0000 7f7c0a42a640 1 --2- 172.21.15.3:0/3142994665 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f7bf007af30 0x7f7bf007d3f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:49.002 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:48.999+0000 7f7c0a42a640 1 --2- 172.21.15.3:0/3142994665 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7c04107900 0x7f7c04074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:49.002 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:48.999+0000 7f7c0a42a640 1 --2- 172.21.15.3:0/3142994665 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7c04101900 0x7f7c040744f0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:49.002 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:48.999+0000 7f7c0a42a640 1 -- 172.21.15.3:0/3142994665 >> 172.21.15.3:0/3142994665 conn(0x7f7c040fd600 msgr2=0x7f7c040fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:24:49.002 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:48.999+0000 7f7c0a42a640 1 -- 172.21.15.3:0/3142994665 shutdown_connections 2024-09-21T12:24:49.002 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:49.000+0000 7f7c0a42a640 1 -- 172.21.15.3:0/3142994665 wait complete. 2024-09-21T12:24:49.582 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -e sha1=5c1cdc3c470dae78e91a0ed2bcf13509a046d301 -- bash -c 'ceph config set global log_to_journald false --force' 2024-09-21T12:24:49.842 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:24:50.135 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:49 smithi003 ceph-mon[28057]: pgmap v88: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:50.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:49 smithi192 ceph-mon[35641]: pgmap v88: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:50.350 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:50.346+0000 7f1cce1a0640 1 -- 172.21.15.3:0/3717919602 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1cc81033e0 msgr2=0x7f1cc810b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:50.350 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:50.346+0000 7f1cce1a0640 1 --2- 172.21.15.3:0/3717919602 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1cc81033e0 0x7f1cc810b8d0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc009880 tx=0x7f1cbc02a530 comp rx=0 tx=0).stop 2024-09-21T12:24:50.350 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:50.346+0000 7f1cce1a0640 1 -- 172.21.15.3:0/3717919602 shutdown_connections 2024-09-21T12:24:50.350 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:50.346+0000 7f1cce1a0640 1 --2- 172.21.15.3:0/3717919602 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1cc81033e0 0x7f1cc810b8d0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:50.350 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:50.346+0000 7f1cce1a0640 1 --2- 172.21.15.3:0/3717919602 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1cc8102ac0 0x7f1cc8102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:50.350 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:50.346+0000 7f1cce1a0640 1 -- 172.21.15.3:0/3717919602 >> 172.21.15.3:0/3717919602 conn(0x7f1cc80fc520 msgr2=0x7f1cc80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:24:50.351 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:50.346+0000 7f1cce1a0640 1 -- 172.21.15.3:0/3717919602 shutdown_connections 2024-09-21T12:24:50.351 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:50.346+0000 7f1cce1a0640 1 -- 172.21.15.3:0/3717919602 wait complete. 2024-09-21T12:24:50.351 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:50.347+0000 7f1cce1a0640 1 Processor -- start 2024-09-21T12:24:50.351 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:50.347+0000 7f1cce1a0640 1 -- start start 2024-09-21T12:24:50.351 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:50.347+0000 7f1cce1a0640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1cc8102ac0 0x7f1cc8100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:24:50.351 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:50.347+0000 7f1cce1a0640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1cc81033e0 0x7f1cc8100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:24:50.351 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:50.347+0000 7f1cce1a0640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f1cc810edd0 con 0x7f1cc81033e0 2024-09-21T12:24:50.351 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:50.347+0000 7f1cce1a0640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f1cc810ec50 con 0x7f1cc8102ac0 2024-09-21T12:24:50.351 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:50.347+0000 7f1cc6ffd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1cc81033e0 0x7f1cc8100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:24:50.351 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:50.347+0000 7f1cc6ffd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1cc81033e0 0x7f1cc8100c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33246/0 (socket says 172.21.15.3:33246) 2024-09-21T12:24:50.351 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:50.347+0000 7f1cc6ffd640 1 -- 172.21.15.3:0/3167973138 learned_addr learned my addr 172.21.15.3:0/3167973138 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:24:50.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:50.347+0000 7f1cc77fe640 1 --2- 172.21.15.3:0/3167973138 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1cc8102ac0 0x7f1cc8100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:24:50.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:50.348+0000 7f1cc6ffd640 1 -- 172.21.15.3:0/3167973138 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1cc8102ac0 msgr2=0x7f1cc8100720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:50.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:50.348+0000 7f1cc6ffd640 1 --2- 172.21.15.3:0/3167973138 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1cc8102ac0 0x7f1cc8100720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:50.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:50.348+0000 7f1cc6ffd640 1 -- 172.21.15.3:0/3167973138 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cc81011a0 con 0x7f1cc81033e0 2024-09-21T12:24:50.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:50.348+0000 7f1cc6ffd640 1 --2- 172.21.15.3:0/3167973138 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1cc81033e0 0x7f1cc8100c60 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc031460 tx=0x7f1cbc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:24:50.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:50.348+0000 7f1cc4ff9640 1 -- 172.21.15.3:0/3167973138 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1cbc03f070 con 0x7f1cc81033e0 2024-09-21T12:24:50.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:50.348+0000 7f1cc4ff9640 1 -- 172.21.15.3:0/3167973138 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1cbc004ac0 con 0x7f1cc81033e0 2024-09-21T12:24:50.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:50.348+0000 7f1cce1a0640 1 -- 172.21.15.3:0/3167973138 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cc8101430 con 0x7f1cc81033e0 2024-09-21T12:24:50.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:50.348+0000 7f1cc4ff9640 1 -- 172.21.15.3:0/3167973138 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1cbc035030 con 0x7f1cc81033e0 2024-09-21T12:24:50.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:50.348+0000 7f1cce1a0640 1 -- 172.21.15.3:0/3167973138 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cc81a3d50 con 0x7f1cc81033e0 2024-09-21T12:24:50.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:50.349+0000 7f1cce1a0640 1 -- 172.21.15.3:0/3167973138 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cc806aa90 con 0x7f1cc81033e0 2024-09-21T12:24:50.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:50.350+0000 7f1cc4ff9640 1 -- 172.21.15.3:0/3167973138 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f1cbc042070 con 0x7f1cc81033e0 2024-09-21T12:24:50.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:50.350+0000 7f1cc4ff9640 1 --2- 172.21.15.3:0/3167973138 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f1cb007af30 0x7f1cb007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:24:50.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:50.351+0000 7f1cc77fe640 1 --2- 172.21.15.3:0/3167973138 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f1cb007af30 0x7f1cb007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:24:50.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:50.351+0000 7f1cc4ff9640 1 -- 172.21.15.3:0/3167973138 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6156+0+0 (secure 0 0 0) 0x7f1cbc0bea30 con 0x7f1cc81033e0 2024-09-21T12:24:50.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:50.351+0000 7f1cc77fe640 1 --2- 172.21.15.3:0/3167973138 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f1cb007af30 0x7f1cb007d3f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1cb8005e10 tx=0x7f1cb8005da0 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:24:50.356 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:50.355+0000 7f1cc4ff9640 1 -- 172.21.15.3:0/3167973138 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f1cbc08a030 con 0x7f1cc81033e0 2024-09-21T12:24:50.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:50.540+0000 7f1cce1a0640 1 -- 172.21.15.3:0/3167973138 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) -- 0x7f1cc8105f60 con 0x7f1cc81033e0 2024-09-21T12:24:50.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:50.541+0000 7f1cc4ff9640 1 -- 172.21.15.3:0/3167973138 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v62)=0 v62) ==== 135+0+0 (secure 0 0 0) 0x7f1cbc08eee0 con 0x7f1cc81033e0 2024-09-21T12:24:50.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:50.543+0000 7f1cce1a0640 1 -- 172.21.15.3:0/3167973138 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f1cb007af30 msgr2=0x7f1cb007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:50.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:50.543+0000 7f1cce1a0640 1 --2- 172.21.15.3:0/3167973138 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f1cb007af30 0x7f1cb007d3f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f1cb8005e10 tx=0x7f1cb8005da0 comp rx=0 tx=0).stop 2024-09-21T12:24:50.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:50.543+0000 7f1cce1a0640 1 -- 172.21.15.3:0/3167973138 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1cc81033e0 msgr2=0x7f1cc8100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:50.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:50.543+0000 7f1cce1a0640 1 --2- 172.21.15.3:0/3167973138 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1cc81033e0 0x7f1cc8100c60 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc031460 tx=0x7f1cbc0046c0 comp rx=0 tx=0).stop 2024-09-21T12:24:50.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:50.543+0000 7f1cce1a0640 1 -- 172.21.15.3:0/3167973138 shutdown_connections 2024-09-21T12:24:50.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:50.543+0000 7f1cce1a0640 1 --2- 172.21.15.3:0/3167973138 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f1cb007af30 0x7f1cb007d3f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:50.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:50.543+0000 7f1cce1a0640 1 --2- 172.21.15.3:0/3167973138 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1cc81033e0 0x7f1cc8100c60 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:50.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:50.543+0000 7f1cce1a0640 1 --2- 172.21.15.3:0/3167973138 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1cc8102ac0 0x7f1cc8100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:50.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:50.543+0000 7f1cce1a0640 1 -- 172.21.15.3:0/3167973138 >> 172.21.15.3:0/3167973138 conn(0x7f1cc80fc520 msgr2=0x7f1cc8108f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:24:50.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:50.544+0000 7f1cce1a0640 1 -- 172.21.15.3:0/3167973138 shutdown_connections 2024-09-21T12:24:50.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:50.544+0000 7f1cce1a0640 1 -- 172.21.15.3:0/3167973138 wait complete. 2024-09-21T12:24:51.145 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -e sha1=5c1cdc3c470dae78e91a0ed2bcf13509a046d301 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-09-21T12:24:51.415 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:24:51.908 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:51.885+0000 7f14bb63b640 1 -- 172.21.15.3:0/2270959503 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f14b41033d0 msgr2=0x7f14b410b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:51.908 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:51.885+0000 7f14bb63b640 1 --2- 172.21.15.3:0/2270959503 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f14b41033d0 0x7f14b410b8c0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f14a8009c20 tx=0x7f14a802aa00 comp rx=0 tx=0).stop 2024-09-21T12:24:51.908 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:51.885+0000 7f14bb63b640 1 -- 172.21.15.3:0/2270959503 shutdown_connections 2024-09-21T12:24:51.908 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:51.885+0000 7f14bb63b640 1 --2- 172.21.15.3:0/2270959503 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f14b41033d0 0x7f14b410b8c0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:51.909 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:51.885+0000 7f14bb63b640 1 --2- 172.21.15.3:0/2270959503 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f14b4102ab0 0x7f14b4102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:51.909 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:51.885+0000 7f14bb63b640 1 -- 172.21.15.3:0/2270959503 >> 172.21.15.3:0/2270959503 conn(0x7f14b40fc550 msgr2=0x7f14b40fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:24:51.909 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:51.885+0000 7f14bb63b640 1 -- 172.21.15.3:0/2270959503 shutdown_connections 2024-09-21T12:24:51.909 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:51.885+0000 7f14bb63b640 1 -- 172.21.15.3:0/2270959503 wait complete. 2024-09-21T12:24:51.909 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:51.886+0000 7f14bb63b640 1 Processor -- start 2024-09-21T12:24:51.909 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:51.886+0000 7f14bb63b640 1 -- start start 2024-09-21T12:24:51.909 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:51.887+0000 7f14bb63b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f14b4102ab0 0x7f14b419d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:24:51.909 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:51.887+0000 7f14bb63b640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f14b41033d0 0x7f14b419dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:24:51.909 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:51.887+0000 7f14bb63b640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f14b410ede0 con 0x7f14b41033d0 2024-09-21T12:24:51.909 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:51.887+0000 7f14bb63b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f14b410ec60 con 0x7f14b4102ab0 2024-09-21T12:24:51.909 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:51.887+0000 7f14b8bd6640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f14b41033d0 0x7f14b419dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:24:51.909 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:51.887+0000 7f14b8bd6640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f14b41033d0 0x7f14b419dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:48952/0 (socket says 172.21.15.3:48952) 2024-09-21T12:24:51.909 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:51.887+0000 7f14b8bd6640 1 -- 172.21.15.3:0/1335966108 learned_addr learned my addr 172.21.15.3:0/1335966108 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:24:51.909 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:51.887+0000 7f14b93d7640 1 --2- 172.21.15.3:0/1335966108 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f14b4102ab0 0x7f14b419d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:24:51.910 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:51.887+0000 7f14b8bd6640 1 -- 172.21.15.3:0/1335966108 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f14b4102ab0 msgr2=0x7f14b419d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:51.910 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:51.887+0000 7f14b8bd6640 1 --2- 172.21.15.3:0/1335966108 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f14b4102ab0 0x7f14b419d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:51.910 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:51.887+0000 7f14b8bd6640 1 -- 172.21.15.3:0/1335966108 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14b4197810 con 0x7f14b41033d0 2024-09-21T12:24:51.910 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:51.887+0000 7f14b8bd6640 1 --2- 172.21.15.3:0/1335966108 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f14b41033d0 0x7f14b419dbd0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f14a802af20 tx=0x7f14a802ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:24:51.910 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:51.887+0000 7f14b27fc640 1 -- 172.21.15.3:0/1335966108 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f14a8047070 con 0x7f14b41033d0 2024-09-21T12:24:51.910 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:51.887+0000 7f14b27fc640 1 -- 172.21.15.3:0/1335966108 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f14a802eeb0 con 0x7f14b41033d0 2024-09-21T12:24:51.910 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:51.887+0000 7f14bb63b640 1 -- 172.21.15.3:0/1335966108 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14b4197aa0 con 0x7f14b41033d0 2024-09-21T12:24:51.910 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:51.887+0000 7f14b27fc640 1 -- 172.21.15.3:0/1335966108 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f14a8033050 con 0x7f14b41033d0 2024-09-21T12:24:51.910 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:51.887+0000 7f14bb63b640 1 -- 172.21.15.3:0/1335966108 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14b4197fd0 con 0x7f14b41033d0 2024-09-21T12:24:51.910 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:51.888+0000 7f14bb63b640 1 -- 172.21.15.3:0/1335966108 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14b406a580 con 0x7f14b41033d0 2024-09-21T12:24:51.910 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:51.889+0000 7f14b27fc640 1 -- 172.21.15.3:0/1335966108 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f14a804a070 con 0x7f14b41033d0 2024-09-21T12:24:51.910 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:51.890+0000 7f14b27fc640 1 --2- 172.21.15.3:0/1335966108 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f149c07af90 0x7f149c07d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:24:51.911 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:51.890+0000 7f14b27fc640 1 -- 172.21.15.3:0/1335966108 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6156+0+0 (secure 0 0 0) 0x7f14a803e030 con 0x7f14b41033d0 2024-09-21T12:24:51.911 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:51.890+0000 7f14b93d7640 1 --2- 172.21.15.3:0/1335966108 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f149c07af90 0x7f149c07d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:24:51.911 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:51.890+0000 7f14b93d7640 1 --2- 172.21.15.3:0/1335966108 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f149c07af90 0x7f149c07d450 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f14ac005fd0 tx=0x7f14ac00b390 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:24:51.911 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:51.894+0000 7f14b27fc640 1 -- 172.21.15.3:0/1335966108 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f14a808a680 con 0x7f14b41033d0 2024-09-21T12:24:52.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:51 smithi003 ceph-mon[28057]: pgmap v89: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:52.103 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:52.102+0000 7f14bb63b640 1 -- 172.21.15.3:0/1335966108 --> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:5c1cdc3c470dae78e91a0ed2bcf13509a046d301", "target": ["mon-mgr", ""]}) -- 0x7f14b4198280 con 0x7f149c07af90 2024-09-21T12:24:52.112 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:52.111+0000 7f14b27fc640 1 -- 172.21.15.3:0/1335966108 <== mgr.14756 v2:172.21.15.3:6800/1284098095 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+89 (secure 0 0 0) 0x7f14b4198280 con 0x7f149c07af90 2024-09-21T12:24:52.112 INFO:teuthology.orchestra.run.smithi003.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:5c1cdc3c470dae78e91a0ed2bcf13509a046d301 2024-09-21T12:24:52.114 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:52.113+0000 7f14bb63b640 1 -- 172.21.15.3:0/1335966108 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f149c07af90 msgr2=0x7f149c07d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:52.115 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:52.113+0000 7f14bb63b640 1 --2- 172.21.15.3:0/1335966108 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f149c07af90 0x7f149c07d450 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f14ac005fd0 tx=0x7f14ac00b390 comp rx=0 tx=0).stop 2024-09-21T12:24:52.115 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:52.113+0000 7f14bb63b640 1 -- 172.21.15.3:0/1335966108 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f14b41033d0 msgr2=0x7f14b419dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:52.115 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:52.113+0000 7f14bb63b640 1 --2- 172.21.15.3:0/1335966108 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f14b41033d0 0x7f14b419dbd0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f14a802af20 tx=0x7f14a802ed40 comp rx=0 tx=0).stop 2024-09-21T12:24:52.115 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:52.113+0000 7f14bb63b640 1 -- 172.21.15.3:0/1335966108 shutdown_connections 2024-09-21T12:24:52.115 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:52.113+0000 7f14bb63b640 1 --2- 172.21.15.3:0/1335966108 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f149c07af90 0x7f149c07d450 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:52.115 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:52.113+0000 7f14bb63b640 1 --2- 172.21.15.3:0/1335966108 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f14b41033d0 0x7f14b419dbd0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:52.115 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:52.113+0000 7f14bb63b640 1 --2- 172.21.15.3:0/1335966108 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f14b4102ab0 0x7f14b419d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:52.115 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:52.113+0000 7f14bb63b640 1 -- 172.21.15.3:0/1335966108 >> 172.21.15.3:0/1335966108 conn(0x7f14b40fc550 msgr2=0x7f14b4108ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:24:52.115 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:52.113+0000 7f14bb63b640 1 -- 172.21.15.3:0/1335966108 shutdown_connections 2024-09-21T12:24:52.115 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:52.113+0000 7f14bb63b640 1 -- 172.21.15.3:0/1335966108 wait complete. 2024-09-21T12:24:52.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:51 smithi192 ceph-mon[35641]: pgmap v89: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:52.815 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-21T12:24:52.816 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi003.front.sepia.ceph.com 2024-09-21T12:24:52.816 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -e sha1=5c1cdc3c470dae78e91a0ed2bcf13509a046d301 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-09-21T12:24:53.090 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:24:53.468 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:53 smithi003 ceph-mon[28057]: from='client.14930 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:5c1cdc3c470dae78e91a0ed2bcf13509a046d301", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:24:53.469 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:53 smithi003 ceph-mon[28057]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:5c1cdc3c470dae78e91a0ed2bcf13509a046d301 2024-09-21T12:24:53.469 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:53 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:24:53.469 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:53 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:24:53.469 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:53 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:24:53.469 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:53 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:24:53.469 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:53 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:24:53.469 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:53 smithi003 ceph-mon[28057]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:5c1cdc3c470dae78e91a0ed2bcf13509a046d301 2024-09-21T12:24:53.469 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:53 smithi003 ceph-mon[28057]: pgmap v90: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:53.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:53 smithi192 ceph-mon[35641]: from='client.14930 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:5c1cdc3c470dae78e91a0ed2bcf13509a046d301", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:24:53.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:53 smithi192 ceph-mon[35641]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:5c1cdc3c470dae78e91a0ed2bcf13509a046d301 2024-09-21T12:24:53.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:53 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:24:53.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:53 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:24:53.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:53 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:24:53.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:53 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:24:53.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:53 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:24:53.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:53 smithi192 ceph-mon[35641]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:5c1cdc3c470dae78e91a0ed2bcf13509a046d301 2024-09-21T12:24:53.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:53 smithi192 ceph-mon[35641]: pgmap v90: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:53.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:53.686+0000 7f06d8417640 1 -- 172.21.15.3:0/326663070 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f06d0103490 msgr2=0x7f06d010b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:53.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:53.686+0000 7f06d8417640 1 --2- 172.21.15.3:0/326663070 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f06d0103490 0x7f06d010b980 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f06c0009880 tx=0x7f06c002a530 comp rx=0 tx=0).stop 2024-09-21T12:24:53.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:53.686+0000 7f06d8417640 1 -- 172.21.15.3:0/326663070 shutdown_connections 2024-09-21T12:24:53.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:53.686+0000 7f06d8417640 1 --2- 172.21.15.3:0/326663070 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f06d0103490 0x7f06d010b980 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:53.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:53.686+0000 7f06d8417640 1 --2- 172.21.15.3:0/326663070 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06d0102b70 0x7f06d0102f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:53.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:53.686+0000 7f06d8417640 1 -- 172.21.15.3:0/326663070 >> 172.21.15.3:0/326663070 conn(0x7f06d00fc550 msgr2=0x7f06d00fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:24:53.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:53.686+0000 7f06d8417640 1 -- 172.21.15.3:0/326663070 shutdown_connections 2024-09-21T12:24:53.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:53.686+0000 7f06d8417640 1 -- 172.21.15.3:0/326663070 wait complete. 2024-09-21T12:24:53.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:53.686+0000 7f06d8417640 1 Processor -- start 2024-09-21T12:24:53.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:53.686+0000 7f06d8417640 1 -- start start 2024-09-21T12:24:53.720 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:53.687+0000 7f06d8417640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06d0102b70 0x7f06d019d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:24:53.720 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:53.687+0000 7f06d8417640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f06d0103490 0x7f06d019db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:24:53.720 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:53.687+0000 7f06d8417640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f06d010ede0 con 0x7f06d0103490 2024-09-21T12:24:53.720 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:53.687+0000 7f06d8417640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f06d010ec60 con 0x7f06d0102b70 2024-09-21T12:24:53.720 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:53.687+0000 7f06d59b2640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f06d0103490 0x7f06d019db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:24:53.720 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:53.687+0000 7f06d59b2640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f06d0103490 0x7f06d019db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:48964/0 (socket says 172.21.15.3:48964) 2024-09-21T12:24:53.720 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:53.687+0000 7f06d59b2640 1 -- 172.21.15.3:0/3175144957 learned_addr learned my addr 172.21.15.3:0/3175144957 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:24:53.720 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:53.687+0000 7f06d61b3640 1 --2- 172.21.15.3:0/3175144957 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06d0102b70 0x7f06d019d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:24:53.720 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:53.687+0000 7f06d59b2640 1 -- 172.21.15.3:0/3175144957 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06d0102b70 msgr2=0x7f06d019d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:53.720 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:53.687+0000 7f06d59b2640 1 --2- 172.21.15.3:0/3175144957 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06d0102b70 0x7f06d019d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:53.720 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:53.687+0000 7f06d59b2640 1 -- 172.21.15.3:0/3175144957 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06d01977d0 con 0x7f06d0103490 2024-09-21T12:24:53.720 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:53.687+0000 7f06d59b2640 1 --2- 172.21.15.3:0/3175144957 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f06d0103490 0x7f06d019db90 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f06c0004f90 tx=0x7f06c00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:24:53.720 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:53.687+0000 7f06c77fe640 1 -- 172.21.15.3:0/3175144957 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f06c003f070 con 0x7f06d0103490 2024-09-21T12:24:53.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:53.688+0000 7f06d8417640 1 -- 172.21.15.3:0/3175144957 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06d0197a60 con 0x7f06d0103490 2024-09-21T12:24:53.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:53.688+0000 7f06c77fe640 1 -- 172.21.15.3:0/3175144957 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f06c0004c70 con 0x7f06d0103490 2024-09-21T12:24:53.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:53.688+0000 7f06c77fe640 1 -- 172.21.15.3:0/3175144957 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f06c0035030 con 0x7f06d0103490 2024-09-21T12:24:53.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:53.688+0000 7f06d8417640 1 -- 172.21.15.3:0/3175144957 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06d0197f90 con 0x7f06d0103490 2024-09-21T12:24:53.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:53.689+0000 7f06d8417640 1 -- 172.21.15.3:0/3175144957 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06d006a4c0 con 0x7f06d0103490 2024-09-21T12:24:53.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:53.689+0000 7f06c77fe640 1 -- 172.21.15.3:0/3175144957 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f06c0042070 con 0x7f06d0103490 2024-09-21T12:24:53.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:53.690+0000 7f06c77fe640 1 --2- 172.21.15.3:0/3175144957 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f06bc07af30 0x7f06bc07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:24:53.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:53.690+0000 7f06c77fe640 1 -- 172.21.15.3:0/3175144957 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6156+0+0 (secure 0 0 0) 0x7f06c00be980 con 0x7f06d0103490 2024-09-21T12:24:53.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:53.690+0000 7f06d61b3640 1 --2- 172.21.15.3:0/3175144957 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f06bc07af30 0x7f06bc07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:24:53.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:53.690+0000 7f06d61b3640 1 --2- 172.21.15.3:0/3175144957 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f06bc07af30 0x7f06bc07d3f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f06cc005fd0 tx=0x7f06cc00b390 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:24:53.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:53.694+0000 7f06c77fe640 1 -- 172.21.15.3:0/3175144957 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f06c0089f80 con 0x7f06d0103490 2024-09-21T12:24:53.903 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:53.901+0000 7f06d8417640 1 -- 172.21.15.3:0/3175144957 --> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f06d0198240 con 0x7f06bc07af30 2024-09-21T12:24:53.904 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:53.902+0000 7f06c77fe640 1 -- 172.21.15.3:0/3175144957 <== mgr.14756 v2:172.21.15.3:6800/1284098095 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+358 (secure 0 0 0) 0x7f06d0198240 con 0x7f06bc07af30 2024-09-21T12:24:53.906 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:53.904+0000 7f06d8417640 1 -- 172.21.15.3:0/3175144957 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f06bc07af30 msgr2=0x7f06bc07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:53.906 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:53.904+0000 7f06d8417640 1 --2- 172.21.15.3:0/3175144957 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f06bc07af30 0x7f06bc07d3f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f06cc005fd0 tx=0x7f06cc00b390 comp rx=0 tx=0).stop 2024-09-21T12:24:53.906 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:53.904+0000 7f06d8417640 1 -- 172.21.15.3:0/3175144957 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f06d0103490 msgr2=0x7f06d019db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:53.906 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:53.904+0000 7f06d8417640 1 --2- 172.21.15.3:0/3175144957 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f06d0103490 0x7f06d019db90 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f06c0004f90 tx=0x7f06c00048f0 comp rx=0 tx=0).stop 2024-09-21T12:24:53.907 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:53.904+0000 7f06d8417640 1 -- 172.21.15.3:0/3175144957 shutdown_connections 2024-09-21T12:24:53.907 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:53.904+0000 7f06d8417640 1 --2- 172.21.15.3:0/3175144957 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f06bc07af30 0x7f06bc07d3f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:53.907 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:53.904+0000 7f06d8417640 1 --2- 172.21.15.3:0/3175144957 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f06d0103490 0x7f06d019db90 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:53.907 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:53.904+0000 7f06d8417640 1 --2- 172.21.15.3:0/3175144957 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06d0102b70 0x7f06d019d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:53.907 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:53.905+0000 7f06d8417640 1 -- 172.21.15.3:0/3175144957 >> 172.21.15.3:0/3175144957 conn(0x7f06d00fc550 msgr2=0x7f06d0103db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:24:53.907 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:53.905+0000 7f06d8417640 1 -- 172.21.15.3:0/3175144957 shutdown_connections 2024-09-21T12:24:53.907 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:53.905+0000 7f06d8417640 1 -- 172.21.15.3:0/3175144957 wait complete. 2024-09-21T12:24:53.915 INFO:teuthology.orchestra.run.smithi003.stdout:true 2024-09-21T12:24:53.991 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:53.990+0000 7f4ba2408640 1 -- 172.21.15.3:0/2575545958 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4b9c100800 msgr2=0x7f4b9c100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:53.991 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:53.990+0000 7f4ba2408640 1 --2- 172.21.15.3:0/2575545958 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4b9c100800 0x7f4b9c100c60 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f4b90009880 tx=0x7f4b9002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:24:53.992 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:53.990+0000 7f4ba2408640 1 -- 172.21.15.3:0/2575545958 shutdown_connections 2024-09-21T12:24:53.992 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:53.990+0000 7f4ba2408640 1 --2- 172.21.15.3:0/2575545958 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4b9c100800 0x7f4b9c100c60 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:53.992 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:53.990+0000 7f4ba2408640 1 --2- 172.21.15.3:0/2575545958 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4b9c106800 0x7f4b9c106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:53.992 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:53.990+0000 7f4ba2408640 1 -- 172.21.15.3:0/2575545958 >> 172.21.15.3:0/2575545958 conn(0x7f4b9c0fc520 msgr2=0x7f4b9c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:24:53.992 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:53.990+0000 7f4ba2408640 1 -- 172.21.15.3:0/2575545958 shutdown_connections 2024-09-21T12:24:53.992 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:53.990+0000 7f4ba2408640 1 -- 172.21.15.3:0/2575545958 wait complete. 2024-09-21T12:24:53.993 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:53.990+0000 7f4ba2408640 1 Processor -- start 2024-09-21T12:24:53.994 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:53.990+0000 7f4ba2408640 1 -- start start 2024-09-21T12:24:53.994 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:53.991+0000 7f4ba2408640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4b9c100800 0x7f4b9c1987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:24:53.994 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:53.991+0000 7f4ba2408640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4b9c106800 0x7f4b9c198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:24:53.994 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:53.991+0000 7f4ba2408640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f4b9c10dcd0 con 0x7f4b9c106800 2024-09-21T12:24:53.994 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:53.991+0000 7f4ba2408640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f4b9c10db50 con 0x7f4b9c100800 2024-09-21T12:24:53.994 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:53.991+0000 7f4b9b7fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4b9c106800 0x7f4b9c198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:24:53.994 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:53.991+0000 7f4b9b7fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4b9c106800 0x7f4b9c198d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:48974/0 (socket says 172.21.15.3:48974) 2024-09-21T12:24:53.994 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:53.991+0000 7f4b9b7fe640 1 -- 172.21.15.3:0/4008605279 learned_addr learned my addr 172.21.15.3:0/4008605279 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:24:53.994 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:53.991+0000 7f4b9bfff640 1 --2- 172.21.15.3:0/4008605279 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4b9c100800 0x7f4b9c1987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:24:53.994 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:53.991+0000 7f4b9b7fe640 1 -- 172.21.15.3:0/4008605279 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4b9c100800 msgr2=0x7f4b9c1987e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:53.994 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:53.991+0000 7f4b9b7fe640 1 --2- 172.21.15.3:0/4008605279 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4b9c100800 0x7f4b9c1987e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:53.994 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:53.991+0000 7f4b9b7fe640 1 -- 172.21.15.3:0/4008605279 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b9c199320 con 0x7f4b9c106800 2024-09-21T12:24:53.994 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:53.992+0000 7f4b9b7fe640 1 --2- 172.21.15.3:0/4008605279 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4b9c106800 0x7f4b9c198d20 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f4b90031460 tx=0x7f4b900048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:24:53.995 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:53.992+0000 7f4b997fa640 1 -- 172.21.15.3:0/4008605279 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4b9003f070 con 0x7f4b9c106800 2024-09-21T12:24:53.995 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:53.992+0000 7f4b997fa640 1 -- 172.21.15.3:0/4008605279 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4b90004cf0 con 0x7f4b9c106800 2024-09-21T12:24:53.995 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:53.992+0000 7f4ba2408640 1 -- 172.21.15.3:0/4008605279 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b9c1995b0 con 0x7f4b9c106800 2024-09-21T12:24:53.995 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:53.992+0000 7f4b997fa640 1 -- 172.21.15.3:0/4008605279 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4b90035030 con 0x7f4b9c106800 2024-09-21T12:24:53.995 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:53.992+0000 7f4ba2408640 1 -- 172.21.15.3:0/4008605279 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b9c1a1b60 con 0x7f4b9c106800 2024-09-21T12:24:53.995 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:53.993+0000 7f4ba2408640 1 -- 172.21.15.3:0/4008605279 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b9c101f40 con 0x7f4b9c106800 2024-09-21T12:24:53.996 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:53.994+0000 7f4b997fa640 1 -- 172.21.15.3:0/4008605279 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f4b90042070 con 0x7f4b9c106800 2024-09-21T12:24:53.996 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:53.995+0000 7f4b997fa640 1 --2- 172.21.15.3:0/4008605279 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f4b8407af80 0x7f4b8407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:24:53.997 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:53.995+0000 7f4b997fa640 1 -- 172.21.15.3:0/4008605279 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6156+0+0 (secure 0 0 0) 0x7f4b900beb60 con 0x7f4b9c106800 2024-09-21T12:24:53.997 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:53.995+0000 7f4b9bfff640 1 --2- 172.21.15.3:0/4008605279 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f4b8407af80 0x7f4b8407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:24:53.997 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:53.996+0000 7f4b9bfff640 1 --2- 172.21.15.3:0/4008605279 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f4b8407af80 0x7f4b8407d440 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c005fd0 tx=0x7f4b8c005e20 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:24:54.002 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.000+0000 7f4b997fa640 1 -- 172.21.15.3:0/4008605279 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f4b9008a0c0 con 0x7f4b9c106800 2024-09-21T12:24:54.209 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.207+0000 7f4ba2408640 1 -- 172.21.15.3:0/4008605279 --> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f4b9c062630 con 0x7f4b8407af80 2024-09-21T12:24:54.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.209+0000 7f4b997fa640 1 -- 172.21.15.3:0/4008605279 <== mgr.14756 v2:172.21.15.3:6800/1284098095 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+358 (secure 0 0 0) 0x7f4b9c062630 con 0x7f4b8407af80 2024-09-21T12:24:54.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.211+0000 7f4ba2408640 1 -- 172.21.15.3:0/4008605279 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f4b8407af80 msgr2=0x7f4b8407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:54.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.211+0000 7f4ba2408640 1 --2- 172.21.15.3:0/4008605279 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f4b8407af80 0x7f4b8407d440 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c005fd0 tx=0x7f4b8c005e20 comp rx=0 tx=0).stop 2024-09-21T12:24:54.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.211+0000 7f4ba2408640 1 -- 172.21.15.3:0/4008605279 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4b9c106800 msgr2=0x7f4b9c198d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:54.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.211+0000 7f4ba2408640 1 --2- 172.21.15.3:0/4008605279 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4b9c106800 0x7f4b9c198d20 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f4b90031460 tx=0x7f4b900048f0 comp rx=0 tx=0).stop 2024-09-21T12:24:54.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.212+0000 7f4ba2408640 1 -- 172.21.15.3:0/4008605279 shutdown_connections 2024-09-21T12:24:54.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.212+0000 7f4ba2408640 1 --2- 172.21.15.3:0/4008605279 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f4b8407af80 0x7f4b8407d440 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:54.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.212+0000 7f4ba2408640 1 --2- 172.21.15.3:0/4008605279 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4b9c106800 0x7f4b9c198d20 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:54.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.212+0000 7f4ba2408640 1 --2- 172.21.15.3:0/4008605279 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4b9c100800 0x7f4b9c1987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:54.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.212+0000 7f4ba2408640 1 -- 172.21.15.3:0/4008605279 >> 172.21.15.3:0/4008605279 conn(0x7f4b9c0fc520 msgr2=0x7f4b9c0fcd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:24:54.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.212+0000 7f4ba2408640 1 -- 172.21.15.3:0/4008605279 shutdown_connections 2024-09-21T12:24:54.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.212+0000 7f4ba2408640 1 -- 172.21.15.3:0/4008605279 wait complete. 2024-09-21T12:24:54.246 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:54 smithi003 ceph-mon[28057]: from='client.14934 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:24:54.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.299+0000 7f17c2893640 1 -- 172.21.15.3:0/981687262 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f17bc100a90 msgr2=0x7f17bc1065d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:54.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.299+0000 7f17c2893640 1 --2- 172.21.15.3:0/981687262 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f17bc100a90 0x7f17bc1065d0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f17b0009880 tx=0x7f17b002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:24:54.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.299+0000 7f17c2893640 1 -- 172.21.15.3:0/981687262 shutdown_connections 2024-09-21T12:24:54.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.299+0000 7f17c2893640 1 --2- 172.21.15.3:0/981687262 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f17bc100a90 0x7f17bc1065d0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:54.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.299+0000 7f17c2893640 1 --2- 172.21.15.3:0/981687262 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17bc1000e0 0x7f17bc1004c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:54.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.299+0000 7f17c2893640 1 -- 172.21.15.3:0/981687262 >> 172.21.15.3:0/981687262 conn(0x7f17bc0fbc90 msgr2=0x7f17bc0fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:24:54.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.299+0000 7f17c2893640 1 -- 172.21.15.3:0/981687262 shutdown_connections 2024-09-21T12:24:54.301 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.299+0000 7f17c2893640 1 -- 172.21.15.3:0/981687262 wait complete. 2024-09-21T12:24:54.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.299+0000 7f17c2893640 1 Processor -- start 2024-09-21T12:24:54.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.299+0000 7f17c2893640 1 -- start start 2024-09-21T12:24:54.303 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.300+0000 7f17c2893640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f17bc1000e0 0x7f17bc101060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:24:54.303 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.300+0000 7f17c2893640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17bc100a90 0x7f17bc1015a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:24:54.303 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.300+0000 7f17c2893640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f17bc10ee30 con 0x7f17bc1000e0 2024-09-21T12:24:54.303 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.300+0000 7f17c2893640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f17bc10ecb0 con 0x7f17bc100a90 2024-09-21T12:24:54.303 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.300+0000 7f17bbfff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f17bc1000e0 0x7f17bc101060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:24:54.303 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.300+0000 7f17bbfff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f17bc1000e0 0x7f17bc101060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:48988/0 (socket says 172.21.15.3:48988) 2024-09-21T12:24:54.303 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.300+0000 7f17bbfff640 1 -- 172.21.15.3:0/1259738517 learned_addr learned my addr 172.21.15.3:0/1259738517 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:24:54.303 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.300+0000 7f17bb7fe640 1 --2- 172.21.15.3:0/1259738517 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17bc100a90 0x7f17bc1015a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:24:54.303 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.300+0000 7f17bbfff640 1 -- 172.21.15.3:0/1259738517 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17bc100a90 msgr2=0x7f17bc1015a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:54.303 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.300+0000 7f17bbfff640 1 --2- 172.21.15.3:0/1259738517 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17bc100a90 0x7f17bc1015a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:54.303 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.300+0000 7f17bbfff640 1 -- 172.21.15.3:0/1259738517 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17bc101ae0 con 0x7f17bc1000e0 2024-09-21T12:24:54.303 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.300+0000 7f17bbfff640 1 --2- 172.21.15.3:0/1259738517 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f17bc1000e0 0x7f17bc101060 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f17ac00c8a0 tx=0x7f17ac00cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:24:54.304 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.301+0000 7f17b97fa640 1 -- 172.21.15.3:0/1259738517 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f17ac0079b0 con 0x7f17bc1000e0 2024-09-21T12:24:54.304 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.301+0000 7f17b97fa640 1 -- 172.21.15.3:0/1259738517 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f17ac007b50 con 0x7f17bc1000e0 2024-09-21T12:24:54.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.302+0000 7f17b97fa640 1 -- 172.21.15.3:0/1259738517 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f17ac018700 con 0x7f17bc1000e0 2024-09-21T12:24:54.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.302+0000 7f17c2893640 1 -- 172.21.15.3:0/1259738517 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17bc101dd0 con 0x7f17bc1000e0 2024-09-21T12:24:54.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.302+0000 7f17c2893640 1 -- 172.21.15.3:0/1259738517 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17bc1a3e20 con 0x7f17bc1000e0 2024-09-21T12:24:54.305 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.303+0000 7f17c2893640 1 -- 172.21.15.3:0/1259738517 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17bc1031a0 con 0x7f17bc1000e0 2024-09-21T12:24:54.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.304+0000 7f17b97fa640 1 -- 172.21.15.3:0/1259738517 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f17ac007d00 con 0x7f17bc1000e0 2024-09-21T12:24:54.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.305+0000 7f17b97fa640 1 --2- 172.21.15.3:0/1259738517 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f17a407af80 0x7f17a407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:24:54.306 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.305+0000 7f17b97fa640 1 -- 172.21.15.3:0/1259738517 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6156+0+0 (secure 0 0 0) 0x7f17ac09e4b0 con 0x7f17bc1000e0 2024-09-21T12:24:54.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.305+0000 7f17bb7fe640 1 --2- 172.21.15.3:0/1259738517 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f17a407af80 0x7f17a407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:24:54.307 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.305+0000 7f17bb7fe640 1 --2- 172.21.15.3:0/1259738517 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f17a407af80 0x7f17a407d440 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f17bc102af0 tx=0x7f17b0031420 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:24:54.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.309+0000 7f17b97fa640 1 -- 172.21.15.3:0/1259738517 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f17ac014030 con 0x7f17bc1000e0 2024-09-21T12:24:54.507 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.505+0000 7f17c2893640 1 -- 172.21.15.3:0/1259738517 --> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f17bc109f50 con 0x7f17a407af80 2024-09-21T12:24:54.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:54 smithi192 ceph-mon[35641]: from='client.14934 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:24:54.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.515+0000 7f17b97fa640 1 -- 172.21.15.3:0/1259738517 <== mgr.14756 v2:172.21.15.3:6800/1284098095 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f17b00042c0 con 0x7f17a407af80 2024-09-21T12:24:54.517 INFO:teuthology.orchestra.run.smithi003.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:24:54.517 INFO:teuthology.orchestra.run.smithi003.stdout:alertmanager.smithi003 smithi003 *:9093,9094 running (82s) 51s ago 12m 17.6M - 0.27.0 11f11916f8cd 14880018dfd3 2024-09-21T12:24:54.517 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-exporter.smithi003 smithi003 running (3m) 51s ago 12m 8564k - 19.1.1-373-g4e45e6b4 164465d2334a 0c9ad60a4f5a 2024-09-21T12:24:54.517 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-exporter.smithi192 smithi192 running (3m) 2m ago 11m 8124k - 19.1.1-373-g4e45e6b4 164465d2334a d5be8a6e120f 2024-09-21T12:24:54.517 INFO:teuthology.orchestra.run.smithi003.stdout:crash.smithi003 smithi003 running (12m) 51s ago 12m 6899k - 19.1.1-373-g4e45e6b4 164465d2334a c63f209dc1dc 2024-09-21T12:24:54.517 INFO:teuthology.orchestra.run.smithi003.stdout:crash.smithi192 smithi192 running (11m) 2m ago 11m 6895k - 19.1.1-373-g4e45e6b4 164465d2334a cc70c9a7b2f7 2024-09-21T12:24:54.517 INFO:teuthology.orchestra.run.smithi003.stdout:grafana.smithi003 smithi003 *:3000 running (57s) 51s ago 12m 46.3M - 10.4.8 5aad1d7cf004 19e26b3cb585 2024-09-21T12:24:54.518 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi003.ebjgyl smithi003 running (7m) 51s ago 7m 15.4M - 19.1.1-373-g4e45e6b4 164465d2334a 16e0b2cac16a 2024-09-21T12:24:54.518 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi003.gfkngj smithi003 running (7m) 51s ago 7m 144M - 19.1.1-373-g4e45e6b4 164465d2334a 109c04f87fbd 2024-09-21T12:24:54.518 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi192.ktdqns smithi192 running (7m) 2m ago 7m 16.7M - 19.1.1-373-g4e45e6b4 164465d2334a 495c73fb3bb0 2024-09-21T12:24:54.518 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi192.ywqqxe smithi192 running (7m) 2m ago 7m 16.7M - 19.1.1-373-g4e45e6b4 164465d2334a 270a01030cbe 2024-09-21T12:24:54.518 INFO:teuthology.orchestra.run.smithi003.stdout:mgr.smithi003.wztftl smithi003 *:8443,9283,8765 running (3m) 51s ago 13m 520M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 8ce0e66fd369 2024-09-21T12:24:54.518 INFO:teuthology.orchestra.run.smithi003.stdout:mgr.smithi192.qsaprd smithi192 *:8443,9283,8765 running (2m) 2m ago 11m 455M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 002a6171dd47 2024-09-21T12:24:54.518 INFO:teuthology.orchestra.run.smithi003.stdout:mon.smithi003 smithi003 running (13m) 51s ago 14m 59.5M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 16bccf2c7503 2024-09-21T12:24:54.518 INFO:teuthology.orchestra.run.smithi003.stdout:mon.smithi192 smithi192 running (11m) 2m ago 11m 43.1M 2048M 19.1.1-373-g4e45e6b4 164465d2334a 4fe4c4b3dc5d 2024-09-21T12:24:54.518 INFO:teuthology.orchestra.run.smithi003.stdout:node-exporter.smithi003 smithi003 *:9100 running (2m) 51s ago 12m 10.9M - 1.7.0 72c9c2088986 d9cb7ede9060 2024-09-21T12:24:54.518 INFO:teuthology.orchestra.run.smithi003.stdout:node-exporter.smithi192 smithi192 *:9100 running (2m) 2m ago 11m 3343k - 1.7.0 72c9c2088986 d8ec0acfce7e 2024-09-21T12:24:54.518 INFO:teuthology.orchestra.run.smithi003.stdout:osd.0 smithi003 running (10m) 51s ago 10m 201M 1217M 19.1.1-373-g4e45e6b4 164465d2334a d07f1489720d 2024-09-21T12:24:54.518 INFO:teuthology.orchestra.run.smithi003.stdout:osd.1 smithi003 running (10m) 51s ago 10m 209M 1217M 19.1.1-373-g4e45e6b4 164465d2334a 6abd75a07645 2024-09-21T12:24:54.518 INFO:teuthology.orchestra.run.smithi003.stdout:osd.2 smithi003 running (9m) 51s ago 9m 172M 1217M 19.1.1-373-g4e45e6b4 164465d2334a 3265369e573b 2024-09-21T12:24:54.518 INFO:teuthology.orchestra.run.smithi003.stdout:osd.3 smithi192 running (9m) 2m ago 9m 237M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 13efcfd71c05 2024-09-21T12:24:54.519 INFO:teuthology.orchestra.run.smithi003.stdout:osd.4 smithi192 running (8m) 2m ago 8m 202M 2240M 19.1.1-373-g4e45e6b4 164465d2334a f33bf453cb3e 2024-09-21T12:24:54.519 INFO:teuthology.orchestra.run.smithi003.stdout:osd.5 smithi192 running (8m) 2m ago 8m 180M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 12d7b7c8e985 2024-09-21T12:24:54.519 INFO:teuthology.orchestra.run.smithi003.stdout:prometheus.smithi003 smithi003 *:9095 running (101s) 51s ago 12m 43.6M - 2.51.0 1d3b7f56885b 64997a33fbbb 2024-09-21T12:24:54.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.517+0000 7f17c2893640 1 -- 172.21.15.3:0/1259738517 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f17a407af80 msgr2=0x7f17a407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:54.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.518+0000 7f17c2893640 1 --2- 172.21.15.3:0/1259738517 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f17a407af80 0x7f17a407d440 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f17bc102af0 tx=0x7f17b0031420 comp rx=0 tx=0).stop 2024-09-21T12:24:54.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.518+0000 7f17c2893640 1 -- 172.21.15.3:0/1259738517 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f17bc1000e0 msgr2=0x7f17bc101060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:54.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.518+0000 7f17c2893640 1 --2- 172.21.15.3:0/1259738517 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f17bc1000e0 0x7f17bc101060 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f17ac00c8a0 tx=0x7f17ac00cd60 comp rx=0 tx=0).stop 2024-09-21T12:24:54.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.518+0000 7f17c2893640 1 -- 172.21.15.3:0/1259738517 shutdown_connections 2024-09-21T12:24:54.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.518+0000 7f17c2893640 1 --2- 172.21.15.3:0/1259738517 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f17a407af80 0x7f17a407d440 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:54.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.518+0000 7f17c2893640 1 --2- 172.21.15.3:0/1259738517 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f17bc100a90 0x7f17bc1015a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:54.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.518+0000 7f17c2893640 1 --2- 172.21.15.3:0/1259738517 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f17bc1000e0 0x7f17bc101060 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:54.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.518+0000 7f17c2893640 1 -- 172.21.15.3:0/1259738517 >> 172.21.15.3:0/1259738517 conn(0x7f17bc0fbc90 msgr2=0x7f17bc0fd120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:24:54.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.518+0000 7f17c2893640 1 -- 172.21.15.3:0/1259738517 shutdown_connections 2024-09-21T12:24:54.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.518+0000 7f17c2893640 1 -- 172.21.15.3:0/1259738517 wait complete. 2024-09-21T12:24:54.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.602+0000 7fec47719640 1 -- 172.21.15.3:0/2849742538 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fec40101000 msgr2=0x7fec4010dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:54.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.602+0000 7fec47719640 1 --2- 172.21.15.3:0/2849742538 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fec40101000 0x7fec4010dcc0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fec30009880 tx=0x7fec3002a490 comp rx=0 tx=0).stop 2024-09-21T12:24:54.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.602+0000 7fec47719640 1 -- 172.21.15.3:0/2849742538 shutdown_connections 2024-09-21T12:24:54.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.602+0000 7fec47719640 1 --2- 172.21.15.3:0/2849742538 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fec40101000 0x7fec4010dcc0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:54.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.602+0000 7fec47719640 1 --2- 172.21.15.3:0/2849742538 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec40100650 0x7fec40100a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:54.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.602+0000 7fec47719640 1 -- 172.21.15.3:0/2849742538 >> 172.21.15.3:0/2849742538 conn(0x7fec400fc520 msgr2=0x7fec400fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:24:54.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.602+0000 7fec47719640 1 -- 172.21.15.3:0/2849742538 shutdown_connections 2024-09-21T12:24:54.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.602+0000 7fec47719640 1 -- 172.21.15.3:0/2849742538 wait complete. 2024-09-21T12:24:54.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.603+0000 7fec47719640 1 Processor -- start 2024-09-21T12:24:54.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.603+0000 7fec47719640 1 -- start start 2024-09-21T12:24:54.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.603+0000 7fec47719640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec40100650 0x7fec4019f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:24:54.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.603+0000 7fec47719640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fec40101000 0x7fec4019fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:24:54.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.603+0000 7fec47719640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fec40110f70 con 0x7fec40101000 2024-09-21T12:24:54.606 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.603+0000 7fec47719640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fec40110df0 con 0x7fec40100650 2024-09-21T12:24:54.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.604+0000 7fec44cb4640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fec40101000 0x7fec4019fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:24:54.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.604+0000 7fec44cb4640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fec40101000 0x7fec4019fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:49002/0 (socket says 172.21.15.3:49002) 2024-09-21T12:24:54.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.604+0000 7fec44cb4640 1 -- 172.21.15.3:0/957271029 learned_addr learned my addr 172.21.15.3:0/957271029 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:24:54.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.604+0000 7fec454b5640 1 --2- 172.21.15.3:0/957271029 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec40100650 0x7fec4019f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:24:54.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.604+0000 7fec44cb4640 1 -- 172.21.15.3:0/957271029 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec40100650 msgr2=0x7fec4019f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:54.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.604+0000 7fec44cb4640 1 --2- 172.21.15.3:0/957271029 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec40100650 0x7fec4019f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:54.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.604+0000 7fec44cb4640 1 -- 172.21.15.3:0/957271029 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec40199a80 con 0x7fec40101000 2024-09-21T12:24:54.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.604+0000 7fec454b5640 1 --2- 172.21.15.3:0/957271029 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec40100650 0x7fec4019f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:24:54.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.604+0000 7fec44cb4640 1 --2- 172.21.15.3:0/957271029 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fec40101000 0x7fec4019fe00 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fec30031460 tx=0x7fec300048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:24:54.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.604+0000 7fec367fc640 1 -- 172.21.15.3:0/957271029 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fec3003f070 con 0x7fec40101000 2024-09-21T12:24:54.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.604+0000 7fec47719640 1 -- 172.21.15.3:0/957271029 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec40199d10 con 0x7fec40101000 2024-09-21T12:24:54.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.604+0000 7fec367fc640 1 -- 172.21.15.3:0/957271029 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fec30004cf0 con 0x7fec40101000 2024-09-21T12:24:54.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.604+0000 7fec367fc640 1 -- 172.21.15.3:0/957271029 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fec30035030 con 0x7fec40101000 2024-09-21T12:24:54.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.604+0000 7fec47719640 1 -- 172.21.15.3:0/957271029 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec4019a2a0 con 0x7fec40101000 2024-09-21T12:24:54.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.605+0000 7fec47719640 1 -- 172.21.15.3:0/957271029 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec4006aa90 con 0x7fec40101000 2024-09-21T12:24:54.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.606+0000 7fec367fc640 1 -- 172.21.15.3:0/957271029 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7fec30042070 con 0x7fec40101000 2024-09-21T12:24:54.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.607+0000 7fec367fc640 1 --2- 172.21.15.3:0/957271029 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fec2c07af30 0x7fec2c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:24:54.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.607+0000 7fec367fc640 1 -- 172.21.15.3:0/957271029 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6156+0+0 (secure 0 0 0) 0x7fec300beac0 con 0x7fec40101000 2024-09-21T12:24:54.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.607+0000 7fec454b5640 1 --2- 172.21.15.3:0/957271029 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fec2c07af30 0x7fec2c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:24:54.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.607+0000 7fec454b5640 1 --2- 172.21.15.3:0/957271029 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fec2c07af30 0x7fec2c07d3f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fec3c005fd0 tx=0x7fec3c005ec0 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:24:54.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.611+0000 7fec367fc640 1 -- 172.21.15.3:0/957271029 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fec3008a0c0 con 0x7fec40101000 2024-09-21T12:24:54.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.886+0000 7fec47719640 1 -- 172.21.15.3:0/957271029 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fec4010b3a0 con 0x7fec40101000 2024-09-21T12:24:54.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.886+0000 7fec367fc640 1 -- 172.21.15.3:0/957271029 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+735 (secure 0 0 0) 0x7fec3008ef70 con 0x7fec40101000 2024-09-21T12:24:54.888 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-21T12:24:54.888 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": { 2024-09-21T12:24:54.888 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2 2024-09-21T12:24:54.888 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:24:54.888 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": { 2024-09-21T12:24:54.888 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:24:54.889 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:24:54.889 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": { 2024-09-21T12:24:54.889 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 6 2024-09-21T12:24:54.889 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:24:54.889 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": { 2024-09-21T12:24:54.889 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 4 2024-09-21T12:24:54.889 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:24:54.889 INFO:teuthology.orchestra.run.smithi003.stdout: "overall": { 2024-09-21T12:24:54.889 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 12, 2024-09-21T12:24:54.889 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:24:54.889 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-21T12:24:54.889 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-21T12:24:54.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.889+0000 7fec47719640 1 -- 172.21.15.3:0/957271029 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fec2c07af30 msgr2=0x7fec2c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:54.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.889+0000 7fec47719640 1 --2- 172.21.15.3:0/957271029 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fec2c07af30 0x7fec2c07d3f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fec3c005fd0 tx=0x7fec3c005ec0 comp rx=0 tx=0).stop 2024-09-21T12:24:54.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.889+0000 7fec47719640 1 -- 172.21.15.3:0/957271029 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fec40101000 msgr2=0x7fec4019fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:54.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.889+0000 7fec47719640 1 --2- 172.21.15.3:0/957271029 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fec40101000 0x7fec4019fe00 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fec30031460 tx=0x7fec300048f0 comp rx=0 tx=0).stop 2024-09-21T12:24:54.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.889+0000 7fec47719640 1 -- 172.21.15.3:0/957271029 shutdown_connections 2024-09-21T12:24:54.892 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.889+0000 7fec47719640 1 --2- 172.21.15.3:0/957271029 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fec2c07af30 0x7fec2c07d3f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:54.892 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.889+0000 7fec47719640 1 --2- 172.21.15.3:0/957271029 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fec40101000 0x7fec4019fe00 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:54.892 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.889+0000 7fec47719640 1 --2- 172.21.15.3:0/957271029 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fec40100650 0x7fec4019f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:54.892 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.889+0000 7fec47719640 1 -- 172.21.15.3:0/957271029 >> 172.21.15.3:0/957271029 conn(0x7fec400fc520 msgr2=0x7fec400fd930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:24:54.892 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.890+0000 7fec47719640 1 -- 172.21.15.3:0/957271029 shutdown_connections 2024-09-21T12:24:54.892 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.890+0000 7fec47719640 1 -- 172.21.15.3:0/957271029 wait complete. 2024-09-21T12:24:54.977 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.975+0000 7f8f202e1640 1 -- 172.21.15.3:0/4098454208 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8f181033d0 msgr2=0x7f8f1810b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:54.977 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.975+0000 7f8f202e1640 1 --2- 172.21.15.3:0/4098454208 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8f181033d0 0x7f8f1810b8c0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f8f08009880 tx=0x7f8f0802a530 comp rx=0 tx=0).stop 2024-09-21T12:24:54.978 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.975+0000 7f8f202e1640 1 -- 172.21.15.3:0/4098454208 shutdown_connections 2024-09-21T12:24:54.978 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.975+0000 7f8f202e1640 1 --2- 172.21.15.3:0/4098454208 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8f181033d0 0x7f8f1810b8c0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:54.978 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.975+0000 7f8f202e1640 1 --2- 172.21.15.3:0/4098454208 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f18102ab0 0x7f8f18102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:54.978 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.975+0000 7f8f202e1640 1 -- 172.21.15.3:0/4098454208 >> 172.21.15.3:0/4098454208 conn(0x7f8f180fc550 msgr2=0x7f8f180fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:24:54.978 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.975+0000 7f8f202e1640 1 -- 172.21.15.3:0/4098454208 shutdown_connections 2024-09-21T12:24:54.978 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.975+0000 7f8f202e1640 1 -- 172.21.15.3:0/4098454208 wait complete. 2024-09-21T12:24:54.978 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.976+0000 7f8f202e1640 1 Processor -- start 2024-09-21T12:24:54.978 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.976+0000 7f8f202e1640 1 -- start start 2024-09-21T12:24:54.980 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.976+0000 7f8f202e1640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8f18102ab0 0x7f8f1819d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:24:54.980 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.976+0000 7f8f202e1640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f181033d0 0x7f8f1819dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:24:54.980 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.976+0000 7f8f202e1640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f8f1810ee40 con 0x7f8f18102ab0 2024-09-21T12:24:54.980 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.976+0000 7f8f202e1640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8f1810ecc0 con 0x7f8f181033d0 2024-09-21T12:24:54.980 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.976+0000 7f8f1e07d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8f18102ab0 0x7f8f1819d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:24:54.980 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.976+0000 7f8f1e07d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8f18102ab0 0x7f8f1819d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:49030/0 (socket says 172.21.15.3:49030) 2024-09-21T12:24:54.980 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.976+0000 7f8f1e07d640 1 -- 172.21.15.3:0/2568391232 learned_addr learned my addr 172.21.15.3:0/2568391232 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:24:54.980 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.977+0000 7f8f1d87c640 1 --2- 172.21.15.3:0/2568391232 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f181033d0 0x7f8f1819dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:24:54.981 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.977+0000 7f8f1e07d640 1 -- 172.21.15.3:0/2568391232 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f181033d0 msgr2=0x7f8f1819dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:54.981 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.977+0000 7f8f1e07d640 1 --2- 172.21.15.3:0/2568391232 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f181033d0 0x7f8f1819dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:54.981 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.977+0000 7f8f1e07d640 1 -- 172.21.15.3:0/2568391232 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f18197830 con 0x7f8f18102ab0 2024-09-21T12:24:54.981 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.977+0000 7f8f1e07d640 1 --2- 172.21.15.3:0/2568391232 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8f18102ab0 0x7f8f1819d6b0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f8f1400b420 tx=0x7f8f1400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:24:54.981 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.977+0000 7f8f0f7fe640 1 -- 172.21.15.3:0/2568391232 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8f14011630 con 0x7f8f18102ab0 2024-09-21T12:24:54.981 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.977+0000 7f8f0f7fe640 1 -- 172.21.15.3:0/2568391232 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8f14016070 con 0x7f8f18102ab0 2024-09-21T12:24:54.981 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.977+0000 7f8f202e1640 1 -- 172.21.15.3:0/2568391232 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f18197b20 con 0x7f8f18102ab0 2024-09-21T12:24:54.981 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.977+0000 7f8f0f7fe640 1 -- 172.21.15.3:0/2568391232 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8f14010d40 con 0x7f8f18102ab0 2024-09-21T12:24:54.981 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.977+0000 7f8f202e1640 1 -- 172.21.15.3:0/2568391232 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f181980b0 con 0x7f8f18102ab0 2024-09-21T12:24:54.981 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.978+0000 7f8f202e1640 1 -- 172.21.15.3:0/2568391232 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f1806a580 con 0x7f8f18102ab0 2024-09-21T12:24:54.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.979+0000 7f8f0f7fe640 1 -- 172.21.15.3:0/2568391232 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f8f1401b460 con 0x7f8f18102ab0 2024-09-21T12:24:54.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.979+0000 7f8f0f7fe640 1 --2- 172.21.15.3:0/2568391232 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f8f0407af80 0x7f8f0407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:24:54.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.980+0000 7f8f0f7fe640 1 -- 172.21.15.3:0/2568391232 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6156+0+0 (secure 0 0 0) 0x7f8f1409d740 con 0x7f8f18102ab0 2024-09-21T12:24:54.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.980+0000 7f8f1d87c640 1 --2- 172.21.15.3:0/2568391232 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f8f0407af80 0x7f8f0407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:24:54.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.980+0000 7f8f1d87c640 1 --2- 172.21.15.3:0/2568391232 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f8f0407af80 0x7f8f0407d440 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8f08031460 tx=0x7f8f08009560 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:24:54.985 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:54.984+0000 7f8f0f7fe640 1 -- 172.21.15.3:0/2568391232 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7f8f14068d20 con 0x7f8f18102ab0 2024-09-21T12:24:55.226 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.224+0000 7f8f202e1640 1 -- 172.21.15.3:0/2568391232 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f8f18105f50 con 0x7f8f18102ab0 2024-09-21T12:24:55.226 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.225+0000 7f8f0f7fe640 1 -- 172.21.15.3:0/2568391232 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) ==== 76+0+2010 (secure 0 0 0) 0x7f8f1406dbd0 con 0x7f8f18102ab0 2024-09-21T12:24:55.226 INFO:teuthology.orchestra.run.smithi003.stdout:e14 2024-09-21T12:24:55.227 INFO:teuthology.orchestra.run.smithi003.stdout:btime 2024-09-21T12:17:55:592931+0000 2024-09-21T12:24:55.227 INFO:teuthology.orchestra.run.smithi003.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T12:24:55.227 INFO:teuthology.orchestra.run.smithi003.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:24:55.227 INFO:teuthology.orchestra.run.smithi003.stdout:legacy client fscid: 1 2024-09-21T12:24:55.227 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:24:55.227 INFO:teuthology.orchestra.run.smithi003.stdout:Filesystem 'cephfs' (1) 2024-09-21T12:24:55.227 INFO:teuthology.orchestra.run.smithi003.stdout:fs_name cephfs 2024-09-21T12:24:55.227 INFO:teuthology.orchestra.run.smithi003.stdout:epoch 14 2024-09-21T12:24:55.227 INFO:teuthology.orchestra.run.smithi003.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T12:24:55.227 INFO:teuthology.orchestra.run.smithi003.stdout:created 2024-09-21T12:17:38.260099+0000 2024-09-21T12:24:55.227 INFO:teuthology.orchestra.run.smithi003.stdout:modified 2024-09-21T12:17:55.592927+0000 2024-09-21T12:24:55.227 INFO:teuthology.orchestra.run.smithi003.stdout:tableserver 0 2024-09-21T12:24:55.228 INFO:teuthology.orchestra.run.smithi003.stdout:root 0 2024-09-21T12:24:55.228 INFO:teuthology.orchestra.run.smithi003.stdout:session_timeout 60 2024-09-21T12:24:55.228 INFO:teuthology.orchestra.run.smithi003.stdout:session_autoclose 300 2024-09-21T12:24:55.228 INFO:teuthology.orchestra.run.smithi003.stdout:max_file_size 1099511627776 2024-09-21T12:24:55.228 INFO:teuthology.orchestra.run.smithi003.stdout:max_xattr_size 65536 2024-09-21T12:24:55.228 INFO:teuthology.orchestra.run.smithi003.stdout:required_client_features {} 2024-09-21T12:24:55.228 INFO:teuthology.orchestra.run.smithi003.stdout:last_failure 0 2024-09-21T12:24:55.228 INFO:teuthology.orchestra.run.smithi003.stdout:last_failure_osd_epoch 46 2024-09-21T12:24:55.228 INFO:teuthology.orchestra.run.smithi003.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:24:55.228 INFO:teuthology.orchestra.run.smithi003.stdout:max_mds 1 2024-09-21T12:24:55.228 INFO:teuthology.orchestra.run.smithi003.stdout:in 0 2024-09-21T12:24:55.228 INFO:teuthology.orchestra.run.smithi003.stdout:up {0=14564} 2024-09-21T12:24:55.228 INFO:teuthology.orchestra.run.smithi003.stdout:failed 2024-09-21T12:24:55.229 INFO:teuthology.orchestra.run.smithi003.stdout:damaged 2024-09-21T12:24:55.229 INFO:teuthology.orchestra.run.smithi003.stdout:stopped 2024-09-21T12:24:55.229 INFO:teuthology.orchestra.run.smithi003.stdout:data_pools [3] 2024-09-21T12:24:55.229 INFO:teuthology.orchestra.run.smithi003.stdout:metadata_pool 2 2024-09-21T12:24:55.229 INFO:teuthology.orchestra.run.smithi003.stdout:inline_data enabled 2024-09-21T12:24:55.229 INFO:teuthology.orchestra.run.smithi003.stdout:balancer 2024-09-21T12:24:55.229 INFO:teuthology.orchestra.run.smithi003.stdout:bal_rank_mask -1 2024-09-21T12:24:55.229 INFO:teuthology.orchestra.run.smithi003.stdout:standby_count_wanted 1 2024-09-21T12:24:55.229 INFO:teuthology.orchestra.run.smithi003.stdout:qdb_cluster leader: 14564 members: 14564 2024-09-21T12:24:55.229 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.cephfs.smithi003.gfkngj{0:14564} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.3:6828/3710817325,v1:172.21.15.3:6829/3710817325] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:24:55.229 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:24:55.229 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:24:55.229 INFO:teuthology.orchestra.run.smithi003.stdout:Standby daemons: 2024-09-21T12:24:55.229 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:24:55.229 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.cephfs.smithi192.ywqqxe{-1:24319} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.192:6824/4055220871,v1:172.21.15.192:6825/4055220871] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:24:55.230 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.cephfs.smithi192.ktdqns{-1:24337} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.192:6826/318800854,v1:172.21.15.192:6827/318800854] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:24:55.230 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.cephfs.smithi003.ebjgyl{-1:24345} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.3:6826/55902996,v1:172.21.15.3:6827/55902996] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:24:55.230 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 14 2024-09-21T12:24:55.230 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.227+0000 7f8f202e1640 1 -- 172.21.15.3:0/2568391232 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f8f0407af80 msgr2=0x7f8f0407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:55.231 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.227+0000 7f8f202e1640 1 --2- 172.21.15.3:0/2568391232 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f8f0407af80 0x7f8f0407d440 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8f08031460 tx=0x7f8f08009560 comp rx=0 tx=0).stop 2024-09-21T12:24:55.231 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.227+0000 7f8f202e1640 1 -- 172.21.15.3:0/2568391232 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8f18102ab0 msgr2=0x7f8f1819d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:55.231 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.227+0000 7f8f202e1640 1 --2- 172.21.15.3:0/2568391232 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8f18102ab0 0x7f8f1819d6b0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f8f1400b420 tx=0x7f8f1400b8e0 comp rx=0 tx=0).stop 2024-09-21T12:24:55.231 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.227+0000 7f8f202e1640 1 -- 172.21.15.3:0/2568391232 shutdown_connections 2024-09-21T12:24:55.231 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.227+0000 7f8f202e1640 1 --2- 172.21.15.3:0/2568391232 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f8f0407af80 0x7f8f0407d440 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:55.231 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.227+0000 7f8f202e1640 1 --2- 172.21.15.3:0/2568391232 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8f181033d0 0x7f8f1819dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:55.231 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.227+0000 7f8f202e1640 1 --2- 172.21.15.3:0/2568391232 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8f18102ab0 0x7f8f1819d6b0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:55.231 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.227+0000 7f8f202e1640 1 -- 172.21.15.3:0/2568391232 >> 172.21.15.3:0/2568391232 conn(0x7f8f180fc550 msgr2=0x7f8f18108e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:24:55.231 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.227+0000 7f8f202e1640 1 -- 172.21.15.3:0/2568391232 shutdown_connections 2024-09-21T12:24:55.231 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.227+0000 7f8f202e1640 1 -- 172.21.15.3:0/2568391232 wait complete. 2024-09-21T12:24:55.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.314+0000 7fbecba92640 1 -- 172.21.15.3:0/686759534 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbec4107900 msgr2=0x7fbec4107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:55.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.314+0000 7fbecba92640 1 --2- 172.21.15.3:0/686759534 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbec4107900 0x7fbec4107ce0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fbec0009880 tx=0x7fbec002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:24:55.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.314+0000 7fbecba92640 1 -- 172.21.15.3:0/686759534 shutdown_connections 2024-09-21T12:24:55.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.314+0000 7fbecba92640 1 --2- 172.21.15.3:0/686759534 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbec4101900 0x7fbec4101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:55.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.314+0000 7fbecba92640 1 --2- 172.21.15.3:0/686759534 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbec4107900 0x7fbec4107ce0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:55.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.314+0000 7fbecba92640 1 -- 172.21.15.3:0/686759534 >> 172.21.15.3:0/686759534 conn(0x7fbec40fd600 msgr2=0x7fbec40ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:24:55.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.314+0000 7fbecba92640 1 -- 172.21.15.3:0/686759534 shutdown_connections 2024-09-21T12:24:55.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.314+0000 7fbecba92640 1 -- 172.21.15.3:0/686759534 wait complete. 2024-09-21T12:24:55.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.315+0000 7fbecba92640 1 Processor -- start 2024-09-21T12:24:55.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.315+0000 7fbecba92640 1 -- start start 2024-09-21T12:24:55.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.315+0000 7fbecba92640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbec4101900 0x7fbec419d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:24:55.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.315+0000 7fbecba92640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbec4107900 0x7fbec419db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:24:55.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.315+0000 7fbecba92640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fbec410edd0 con 0x7fbec4107900 2024-09-21T12:24:55.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.315+0000 7fbecba92640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fbec410ec50 con 0x7fbec4101900 2024-09-21T12:24:55.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.315+0000 7fbec902d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbec4107900 0x7fbec419db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:24:55.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.315+0000 7fbec902d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbec4107900 0x7fbec419db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:49046/0 (socket says 172.21.15.3:49046) 2024-09-21T12:24:55.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.315+0000 7fbec902d640 1 -- 172.21.15.3:0/3488589435 learned_addr learned my addr 172.21.15.3:0/3488589435 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:24:55.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.315+0000 7fbec982e640 1 --2- 172.21.15.3:0/3488589435 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbec4101900 0x7fbec419d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:24:55.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.315+0000 7fbec902d640 1 -- 172.21.15.3:0/3488589435 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbec4101900 msgr2=0x7fbec419d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:55.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.315+0000 7fbec902d640 1 --2- 172.21.15.3:0/3488589435 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbec4101900 0x7fbec419d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:55.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.315+0000 7fbec902d640 1 -- 172.21.15.3:0/3488589435 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbec41977c0 con 0x7fbec4107900 2024-09-21T12:24:55.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.315+0000 7fbec982e640 1 --2- 172.21.15.3:0/3488589435 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbec4101900 0x7fbec419d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T12:24:55.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.316+0000 7fbec902d640 1 --2- 172.21.15.3:0/3488589435 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbec4107900 0x7fbec419db80 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fbeb400e970 tx=0x7fbeb400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:24:55.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.316+0000 7fbebaffd640 1 -- 172.21.15.3:0/3488589435 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbeb400cac0 con 0x7fbec4107900 2024-09-21T12:24:55.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.316+0000 7fbebaffd640 1 -- 172.21.15.3:0/3488589435 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbeb40054e0 con 0x7fbec4107900 2024-09-21T12:24:55.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.316+0000 7fbecba92640 1 -- 172.21.15.3:0/3488589435 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbec4197ab0 con 0x7fbec4107900 2024-09-21T12:24:55.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.316+0000 7fbebaffd640 1 -- 172.21.15.3:0/3488589435 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbeb4010430 con 0x7fbec4107900 2024-09-21T12:24:55.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.316+0000 7fbecba92640 1 -- 172.21.15.3:0/3488589435 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbec4198040 con 0x7fbec4107900 2024-09-21T12:24:55.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.317+0000 7fbecba92640 1 -- 172.21.15.3:0/3488589435 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbec4103040 con 0x7fbec4107900 2024-09-21T12:24:55.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.318+0000 7fbebaffd640 1 -- 172.21.15.3:0/3488589435 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7fbeb4004f00 con 0x7fbec4107900 2024-09-21T12:24:55.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.318+0000 7fbebaffd640 1 --2- 172.21.15.3:0/3488589435 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fbeb007af80 0x7fbeb007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:24:55.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.318+0000 7fbebaffd640 1 -- 172.21.15.3:0/3488589435 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6156+0+0 (secure 0 0 0) 0x7fbeb409e650 con 0x7fbec4107900 2024-09-21T12:24:55.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.318+0000 7fbec982e640 1 --2- 172.21.15.3:0/3488589435 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fbeb007af80 0x7fbeb007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:24:55.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.319+0000 7fbec982e640 1 --2- 172.21.15.3:0/3488589435 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fbeb007af80 0x7fbeb007d440 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbec0006010 tx=0x7fbec00095f0 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:24:55.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.323+0000 7fbebaffd640 1 -- 172.21.15.3:0/3488589435 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fbeb4069cd0 con 0x7fbec4107900 2024-09-21T12:24:55.531 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.529+0000 7fbecba92640 1 -- 172.21.15.3:0/3488589435 --> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fbec4198350 con 0x7fbeb007af80 2024-09-21T12:24:55.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.531+0000 7fbebaffd640 1 -- 172.21.15.3:0/3488589435 <== mgr.14756 v2:172.21.15.3:6800/1284098095 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+368 (secure 0 0 0) 0x7fbec4198350 con 0x7fbeb007af80 2024-09-21T12:24:55.533 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-21T12:24:55.533 INFO:teuthology.orchestra.run.smithi003.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T12:24:55.533 INFO:teuthology.orchestra.run.smithi003.stdout: "in_progress": true, 2024-09-21T12:24:55.533 INFO:teuthology.orchestra.run.smithi003.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T12:24:55.533 INFO:teuthology.orchestra.run.smithi003.stdout: "services_complete": [ 2024-09-21T12:24:55.533 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr" 2024-09-21T12:24:55.533 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-21T12:24:55.533 INFO:teuthology.orchestra.run.smithi003.stdout: "progress": "2/23 daemons upgraded", 2024-09-21T12:24:55.533 INFO:teuthology.orchestra.run.smithi003.stdout: "message": "Currently upgrading mon daemons", 2024-09-21T12:24:55.533 INFO:teuthology.orchestra.run.smithi003.stdout: "is_paused": false 2024-09-21T12:24:55.533 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-21T12:24:55.534 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.533+0000 7fbecba92640 1 -- 172.21.15.3:0/3488589435 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fbeb007af80 msgr2=0x7fbeb007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:55.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.533+0000 7fbecba92640 1 --2- 172.21.15.3:0/3488589435 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fbeb007af80 0x7fbeb007d440 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fbec0006010 tx=0x7fbec00095f0 comp rx=0 tx=0).stop 2024-09-21T12:24:55.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.533+0000 7fbecba92640 1 -- 172.21.15.3:0/3488589435 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbec4107900 msgr2=0x7fbec419db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:55.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.533+0000 7fbecba92640 1 --2- 172.21.15.3:0/3488589435 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbec4107900 0x7fbec419db80 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fbeb400e970 tx=0x7fbeb400ed70 comp rx=0 tx=0).stop 2024-09-21T12:24:55.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.533+0000 7fbecba92640 1 -- 172.21.15.3:0/3488589435 shutdown_connections 2024-09-21T12:24:55.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.533+0000 7fbecba92640 1 --2- 172.21.15.3:0/3488589435 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fbeb007af80 0x7fbeb007d440 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:55.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.533+0000 7fbecba92640 1 --2- 172.21.15.3:0/3488589435 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbec4107900 0x7fbec419db80 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:55.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.533+0000 7fbecba92640 1 --2- 172.21.15.3:0/3488589435 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbec4101900 0x7fbec419d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:55.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.533+0000 7fbecba92640 1 -- 172.21.15.3:0/3488589435 >> 172.21.15.3:0/3488589435 conn(0x7fbec40fd600 msgr2=0x7fbec40fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:24:55.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.533+0000 7fbecba92640 1 -- 172.21.15.3:0/3488589435 shutdown_connections 2024-09-21T12:24:55.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.533+0000 7fbecba92640 1 -- 172.21.15.3:0/3488589435 wait complete. 2024-09-21T12:24:55.622 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.620+0000 7fdac93dc640 1 -- 172.21.15.3:0/1225733265 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdac4101900 msgr2=0x7fdac4101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:55.622 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.620+0000 7fdac93dc640 1 --2- 172.21.15.3:0/1225733265 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdac4101900 0x7fdac4101d60 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fdab8009880 tx=0x7fdab802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:24:55.622 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.620+0000 7fdac93dc640 1 -- 172.21.15.3:0/1225733265 shutdown_connections 2024-09-21T12:24:55.622 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.620+0000 7fdac93dc640 1 --2- 172.21.15.3:0/1225733265 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdac4101900 0x7fdac4101d60 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:55.623 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.620+0000 7fdac93dc640 1 --2- 172.21.15.3:0/1225733265 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdac4107900 0x7fdac4107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:55.623 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.620+0000 7fdac93dc640 1 -- 172.21.15.3:0/1225733265 >> 172.21.15.3:0/1225733265 conn(0x7fdac40fd600 msgr2=0x7fdac40ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:24:55.623 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.620+0000 7fdac93dc640 1 -- 172.21.15.3:0/1225733265 shutdown_connections 2024-09-21T12:24:55.623 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.620+0000 7fdac93dc640 1 -- 172.21.15.3:0/1225733265 wait complete. 2024-09-21T12:24:55.623 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.621+0000 7fdac93dc640 1 Processor -- start 2024-09-21T12:24:55.624 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.621+0000 7fdac93dc640 1 -- start start 2024-09-21T12:24:55.625 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.621+0000 7fdac93dc640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdac4101900 0x7fdac419d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:24:55.625 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.621+0000 7fdac93dc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdac4107900 0x7fdac419dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:24:55.625 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.621+0000 7fdac93dc640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fdac410edb0 con 0x7fdac4107900 2024-09-21T12:24:55.625 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.621+0000 7fdac93dc640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fdac410ec30 con 0x7fdac4101900 2024-09-21T12:24:55.625 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.621+0000 7fdac27fc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdac4107900 0x7fdac419dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:24:55.625 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.621+0000 7fdac27fc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdac4107900 0x7fdac419dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:49058/0 (socket says 172.21.15.3:49058) 2024-09-21T12:24:55.625 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.621+0000 7fdac27fc640 1 -- 172.21.15.3:0/2861981216 learned_addr learned my addr 172.21.15.3:0/2861981216 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:24:55.625 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.622+0000 7fdac2ffd640 1 --2- 172.21.15.3:0/2861981216 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdac4101900 0x7fdac419d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:24:55.625 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.622+0000 7fdac27fc640 1 -- 172.21.15.3:0/2861981216 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdac4101900 msgr2=0x7fdac419d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:55.625 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.622+0000 7fdac27fc640 1 --2- 172.21.15.3:0/2861981216 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdac4101900 0x7fdac419d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:55.625 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.622+0000 7fdac27fc640 1 -- 172.21.15.3:0/2861981216 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdac4197800 con 0x7fdac4107900 2024-09-21T12:24:55.625 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.622+0000 7fdac27fc640 1 --2- 172.21.15.3:0/2861981216 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdac4107900 0x7fdac419dbc0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fdab8031460 tx=0x7fdab80045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:24:55.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.622+0000 7fdaabfff640 1 -- 172.21.15.3:0/2861981216 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdab803f070 con 0x7fdac4107900 2024-09-21T12:24:55.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.622+0000 7fdac93dc640 1 -- 172.21.15.3:0/2861981216 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdac4197a90 con 0x7fdac4107900 2024-09-21T12:24:55.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.622+0000 7fdaabfff640 1 -- 172.21.15.3:0/2861981216 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdab80035f0 con 0x7fdac4107900 2024-09-21T12:24:55.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.622+0000 7fdaabfff640 1 -- 172.21.15.3:0/2861981216 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdab8035030 con 0x7fdac4107900 2024-09-21T12:24:55.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.622+0000 7fdac93dc640 1 -- 172.21.15.3:0/2861981216 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdac4197fc0 con 0x7fdac4107900 2024-09-21T12:24:55.627 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.623+0000 7fdac93dc640 1 -- 172.21.15.3:0/2861981216 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdac4103040 con 0x7fdac4107900 2024-09-21T12:24:55.627 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.624+0000 7fdaabfff640 1 -- 172.21.15.3:0/2861981216 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7fdab8042070 con 0x7fdac4107900 2024-09-21T12:24:55.627 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.624+0000 7fdaabfff640 1 --2- 172.21.15.3:0/2861981216 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fdaac07af30 0x7fdaac07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:24:55.627 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.624+0000 7fdaabfff640 1 -- 172.21.15.3:0/2861981216 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6156+0+0 (secure 0 0 0) 0x7fdab80bea20 con 0x7fdac4107900 2024-09-21T12:24:55.627 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.625+0000 7fdac2ffd640 1 --2- 172.21.15.3:0/2861981216 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fdaac07af30 0x7fdaac07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:24:55.627 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.625+0000 7fdac2ffd640 1 --2- 172.21.15.3:0/2861981216 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fdaac07af30 0x7fdaac07d3f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdab4005fd0 tx=0x7fdab400b590 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:24:55.630 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.629+0000 7fdaabfff640 1 -- 172.21.15.3:0/2861981216 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196976 (secure 0 0 0) 0x7fdab808a020 con 0x7fdac4107900 2024-09-21T12:24:55.895 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.893+0000 7fdac93dc640 1 -- 172.21.15.3:0/2861981216 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fdac4109e90 con 0x7fdac4107900 2024-09-21T12:24:55.895 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.893+0000 7fdaabfff640 1 -- 172.21.15.3:0/2861981216 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7fdab80be0e0 con 0x7fdac4107900 2024-09-21T12:24:55.895 INFO:teuthology.orchestra.run.smithi003.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-21T12:24:55.896 INFO:teuthology.orchestra.run.smithi003.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:24:55.896 INFO:teuthology.orchestra.run.smithi003.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:24:55.897 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.896+0000 7fdac93dc640 1 -- 172.21.15.3:0/2861981216 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fdaac07af30 msgr2=0x7fdaac07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:55.898 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.896+0000 7fdac93dc640 1 --2- 172.21.15.3:0/2861981216 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fdaac07af30 0x7fdaac07d3f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fdab4005fd0 tx=0x7fdab400b590 comp rx=0 tx=0).stop 2024-09-21T12:24:55.898 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.896+0000 7fdac93dc640 1 -- 172.21.15.3:0/2861981216 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdac4107900 msgr2=0x7fdac419dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:24:55.898 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.896+0000 7fdac93dc640 1 --2- 172.21.15.3:0/2861981216 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdac4107900 0x7fdac419dbc0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fdab8031460 tx=0x7fdab80045e0 comp rx=0 tx=0).stop 2024-09-21T12:24:55.898 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.896+0000 7fdac93dc640 1 -- 172.21.15.3:0/2861981216 shutdown_connections 2024-09-21T12:24:55.898 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.896+0000 7fdac93dc640 1 --2- 172.21.15.3:0/2861981216 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fdaac07af30 0x7fdaac07d3f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:55.898 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.896+0000 7fdac93dc640 1 --2- 172.21.15.3:0/2861981216 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdac4107900 0x7fdac419dbc0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:55.898 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.896+0000 7fdac93dc640 1 --2- 172.21.15.3:0/2861981216 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdac4101900 0x7fdac419d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:24:55.898 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.896+0000 7fdac93dc640 1 -- 172.21.15.3:0/2861981216 >> 172.21.15.3:0/2861981216 conn(0x7fdac40fd600 msgr2=0x7fdac40fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:24:55.898 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.896+0000 7fdac93dc640 1 -- 172.21.15.3:0/2861981216 shutdown_connections 2024-09-21T12:24:55.898 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:24:55.896+0000 7fdac93dc640 1 -- 172.21.15.3:0/2861981216 wait complete. 2024-09-21T12:24:56.231 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:55 smithi003 ceph-mon[28057]: from='client.14938 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:24:56.231 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:55 smithi003 ceph-mon[28057]: from='client.14942 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:24:56.231 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:55 smithi003 ceph-mon[28057]: pgmap v91: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:56.232 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:55 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:24:56.232 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:55 smithi003 ceph-mon[28057]: Upgrade: Target is version 19.3.0-5103-g5c1cdc3c (squid) 2024-09-21T12:24:56.232 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:55 smithi003 ceph-mon[28057]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, digests ['quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472'] 2024-09-21T12:24:56.232 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:55 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:24:56.232 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:55 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:24:56.232 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:55 smithi003 ceph-mon[28057]: Upgrade: Setting container_image for all mgr 2024-09-21T12:24:56.232 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:55 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:24:56.232 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:55 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-21T12:24:56.233 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:55 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/957271029' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:24:56.233 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:55 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/2568391232' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-21T12:24:56.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:55 smithi192 ceph-mon[35641]: from='client.14938 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:24:56.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:55 smithi192 ceph-mon[35641]: from='client.14942 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:24:56.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:55 smithi192 ceph-mon[35641]: pgmap v91: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:56.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:55 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:24:56.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:55 smithi192 ceph-mon[35641]: Upgrade: Target is version 19.3.0-5103-g5c1cdc3c (squid) 2024-09-21T12:24:56.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:55 smithi192 ceph-mon[35641]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, digests ['quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472'] 2024-09-21T12:24:56.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:55 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:24:56.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:55 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:24:56.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:55 smithi192 ceph-mon[35641]: Upgrade: Setting container_image for all mgr 2024-09-21T12:24:56.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:55 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:24:56.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:55 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-21T12:24:56.259 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:55 smithi192 ceph-mon[35641]: from='client.? 172.21.15.3:0/957271029' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:24:56.259 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:55 smithi192 ceph-mon[35641]: from='client.? 172.21.15.3:0/2568391232' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-21T12:24:56.913 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:56 smithi003 ceph-mon[28057]: from='client.14954 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:24:56.913 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:56 smithi003 ceph-mon[28057]: from='client.? 172.21.15.3:0/2861981216' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-21T12:24:56.913 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:56 smithi003 ceph-mon[28057]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:24:56.913 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:56 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-21T12:24:56.914 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:56 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-21T12:24:56.914 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:56 smithi003 ceph-mon[28057]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:24:57.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:56 smithi192 ceph-mon[35641]: from='client.14954 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:24:57.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:56 smithi192 ceph-mon[35641]: from='client.? 172.21.15.3:0/2861981216' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-21T12:24:57.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:56 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:24:57.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:56 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-21T12:24:57.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:56 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-21T12:24:57.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:56 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:24:58.114 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:57 smithi003 ceph-mon[28057]: Upgrade: Updating mon.smithi003 2024-09-21T12:24:58.114 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:57 smithi003 ceph-mon[28057]: Deploying daemon mon.smithi003 on smithi003 2024-09-21T12:24:58.114 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:57 smithi003 ceph-mon[28057]: pgmap v92: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:58.114 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:57 smithi003 systemd[1]: Stopping Ceph mon.smithi003 for 641beec0-7812-11ef-baf6-efdc52797490... 2024-09-21T12:24:58.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:57 smithi192 ceph-mon[35641]: Upgrade: Updating mon.smithi003 2024-09-21T12:24:58.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:57 smithi192 ceph-mon[35641]: Deploying daemon mon.smithi003 on smithi003 2024-09-21T12:24:58.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:24:57 smithi192 ceph-mon[35641]: pgmap v92: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:24:58.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:58 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-mon-smithi003[28050]: 2024-09-21T12:24:58.134+0000 7f1cb2a7a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi003 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T12:24:58.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:58 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-mon-smithi003[28050]: 2024-09-21T12:24:58.134+0000 7f1cb2a7a640 -1 mon.smithi003@0(leader) e2 *** Got Signal Terminated *** 2024-09-21T12:24:58.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:58 smithi003 podman[108563]: 2024-09-21 12:24:58.308736511 +0000 UTC m=+0.269339487 container died 16bccf2c750392e6587a98d2400bb78eb3896ce56a2f0e9a141b9697643aafd2 (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-mon-smithi003, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, RELEASE=squid-4e45e6b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-21T12:24:58.941 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:58 smithi003 podman[108563]: 2024-09-21 12:24:58.664199774 +0000 UTC m=+0.624802749 container cleanup 16bccf2c750392e6587a98d2400bb78eb3896ce56a2f0e9a141b9697643aafd2 (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-mon-smithi003, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, RELEASE=squid-4e45e6b, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2) 2024-09-21T12:24:58.942 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:58 smithi003 bash[108563]: ceph-641beec0-7812-11ef-baf6-efdc52797490-mon-smithi003 2024-09-21T12:24:59.315 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:58 smithi003 podman[108575]: 2024-09-21 12:24:58.940641186 +0000 UTC m=+0.625679108 container remove 16bccf2c750392e6587a98d2400bb78eb3896ce56a2f0e9a141b9697643aafd2 (image=quay.ceph.io/ceph-ci/ceph:squid, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-mon-smithi003, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-4e45e6b, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2) 2024-09-21T12:24:59.316 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 systemd[1]: ceph-641beec0-7812-11ef-baf6-efdc52797490@mon.smithi003.service: Deactivated successfully. 2024-09-21T12:24:59.316 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 systemd[1]: Stopped Ceph mon.smithi003 for 641beec0-7812-11ef-baf6-efdc52797490. 2024-09-21T12:24:59.316 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 systemd[1]: ceph-641beec0-7812-11ef-baf6-efdc52797490@mon.smithi003.service: Consumed 14.661s CPU time. 2024-09-21T12:24:59.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 systemd[1]: Starting Ceph mon.smithi003 for 641beec0-7812-11ef-baf6-efdc52797490... 2024-09-21T12:24:59.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 podman[108703]: 2024-09-21 12:24:59.432647324 +0000 UTC m=+0.016901373 image pull 8f4d013db793795fef09ff5edf96e6b42ba8cd2c9158b2f0b7a5d7c1e657c063 quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 2024-09-21T12:24:59.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 podman[108703]: 2024-09-21 12:24:59.558316141 +0000 UTC m=+0.142570187 container create 4f2b2b2daf19a7576f564282b324a7e3a2d0bc644f7040d0aa279b2089d24874 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-mon-smithi003, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-21T12:25:00.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 podman[108703]: 2024-09-21 12:24:59.810992292 +0000 UTC m=+0.395246341 container init 4f2b2b2daf19a7576f564282b324a7e3a2d0bc644f7040d0aa279b2089d24874 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-mon-smithi003, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-21T12:25:00.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 podman[108703]: 2024-09-21 12:24:59.814831896 +0000 UTC m=+0.399085936 container start 4f2b2b2daf19a7576f564282b324a7e3a2d0bc644f7040d0aa279b2089d24874 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-mon-smithi003, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-21T12:25:00.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: set uid:gid to 167:167 (ceph:ceph) 2024-09-21T12:25:00.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev), process ceph-mon, pid 2 2024-09-21T12:25:00.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: pidfile_write: ignore empty --pid-file 2024-09-21T12:25:00.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: load: jerasure load: lrc 2024-09-21T12:25:00.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: RocksDB version: 7.9.2 2024-09-21T12:25:00.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Git sha 0 2024-09-21T12:25:00.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Compile date 2024-09-21 08:36:07 2024-09-21T12:25:00.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: DB SUMMARY 2024-09-21T12:25:00.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: DB Session ID: 8BIDX6P6EQDE38GXKTZH 2024-09-21T12:25:00.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: CURRENT file: CURRENT 2024-09-21T12:25:00.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: IDENTITY file: IDENTITY 2024-09-21T12:25:00.081 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: MANIFEST file: MANIFEST-000015 size: 1507 Bytes 2024-09-21T12:25:00.081 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi003/store.db dir, Total Num: 1, files: 000032.sst 2024-09-21T12:25:00.081 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi003/store.db: 000030.log size: 2615553 ; 2024-09-21T12:25:00.081 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.error_if_exists: 0 2024-09-21T12:25:00.081 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.create_if_missing: 0 2024-09-21T12:25:00.081 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.paranoid_checks: 1 2024-09-21T12:25:00.081 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T12:25:00.081 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T12:25:00.081 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T12:25:00.081 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.env: 0x55f7b2ac7120 2024-09-21T12:25:00.081 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.fs: PosixFileSystem 2024-09-21T12:25:00.081 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.info_log: 0x55f7b4d478e0 2024-09-21T12:25:00.081 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.max_file_opening_threads: 16 2024-09-21T12:25:00.083 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.statistics: (nil) 2024-09-21T12:25:00.083 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.use_fsync: 0 2024-09-21T12:25:00.083 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.max_log_file_size: 0 2024-09-21T12:25:00.083 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T12:25:00.083 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T12:25:00.083 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T12:25:00.083 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T12:25:00.083 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.allow_fallocate: 1 2024-09-21T12:25:00.083 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T12:25:00.083 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T12:25:00.083 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.use_direct_reads: 0 2024-09-21T12:25:00.084 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T12:25:00.084 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T12:25:00.084 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.db_log_dir: 2024-09-21T12:25:00.084 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.wal_dir: 2024-09-21T12:25:00.084 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T12:25:00.084 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T12:25:00.084 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T12:25:00.084 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T12:25:00.084 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T12:25:00.084 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T12:25:00.084 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T12:25:00.084 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T12:25:00.084 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.write_buffer_manager: 0x55f7b4d4bb80 2024-09-21T12:25:00.084 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T12:25:00.085 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T12:25:00.085 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T12:25:00.085 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T12:25:00.085 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T12:25:00.085 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T12:25:00.085 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T12:25:00.085 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T12:25:00.085 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.unordered_write: 0 2024-09-21T12:25:00.085 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T12:25:00.085 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T12:25:00.085 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T12:25:00.085 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T12:25:00.085 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.row_cache: None 2024-09-21T12:25:00.085 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.wal_filter: None 2024-09-21T12:25:00.085 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T12:25:00.086 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T12:25:00.086 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.two_write_queues: 0 2024-09-21T12:25:00.086 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T12:25:00.086 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.wal_compression: 0 2024-09-21T12:25:00.086 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.atomic_flush: 0 2024-09-21T12:25:00.086 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T12:25:00.086 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T12:25:00.086 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T12:25:00.086 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.log_readahead_size: 0 2024-09-21T12:25:00.086 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T12:25:00.086 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T12:25:00.086 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T12:25:00.086 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T12:25:00.086 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T12:25:00.087 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T12:25:00.087 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T12:25:00.087 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.max_background_jobs: 2 2024-09-21T12:25:00.087 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.max_background_compactions: -1 2024-09-21T12:25:00.087 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.max_subcompactions: 1 2024-09-21T12:25:00.087 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T12:25:00.087 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T12:25:00.087 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T12:25:00.087 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T12:25:00.087 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T12:25:00.087 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T12:25:00.087 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T12:25:00.087 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T12:25:00.087 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.max_open_files: -1 2024-09-21T12:25:00.087 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T12:25:00.088 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T12:25:00.088 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T12:25:00.088 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T12:25:00.088 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.max_background_flushes: -1 2024-09-21T12:25:00.088 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Compression algorithms supported: 2024-09-21T12:25:00.088 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: kZSTD supported: 0 2024-09-21T12:25:00.088 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: kXpressCompression supported: 0 2024-09-21T12:25:00.088 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: kBZip2Compression supported: 0 2024-09-21T12:25:00.088 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T12:25:00.088 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: kLZ4Compression supported: 1 2024-09-21T12:25:00.088 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: kZlibCompression supported: 1 2024-09-21T12:25:00.088 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T12:25:00.088 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: kSnappyCompression supported: 1 2024-09-21T12:25:00.088 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T12:25:00.089 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T12:25:00.089 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi003/store.db/MANIFEST-000015 2024-09-21T12:25:00.089 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T12:25:00.089 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T12:25:00.089 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.merge_operator: 2024-09-21T12:25:00.089 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.compaction_filter: None 2024-09-21T12:25:00.089 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T12:25:00.089 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T12:25:00.089 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T12:25:00.089 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T12:25:00.089 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55f7b4d47540) 2024-09-21T12:25:00.089 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: cache_index_and_filter_blocks: 1 2024-09-21T12:25:00.089 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T12:25:00.089 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T12:25:00.090 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: pin_top_level_index_and_filter: 1 2024-09-21T12:25:00.090 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: index_type: 0 2024-09-21T12:25:00.090 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: data_block_index_type: 0 2024-09-21T12:25:00.090 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: index_shortening: 1 2024-09-21T12:25:00.090 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T12:25:00.090 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: checksum: 4 2024-09-21T12:25:00.090 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: no_block_cache: 0 2024-09-21T12:25:00.090 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: block_cache: 0x55f7b4d3b610 2024-09-21T12:25:00.090 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: block_cache_name: BinnedLRUCache 2024-09-21T12:25:00.090 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: block_cache_options: 2024-09-21T12:25:00.090 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: capacity : 536870912 2024-09-21T12:25:00.090 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: num_shard_bits : 4 2024-09-21T12:25:00.090 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: strict_capacity_limit : 0 2024-09-21T12:25:00.090 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: high_pri_pool_ratio: 0.000 2024-09-21T12:25:00.090 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: block_cache_compressed: (nil) 2024-09-21T12:25:00.091 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: persistent_cache: (nil) 2024-09-21T12:25:00.091 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: block_size: 4096 2024-09-21T12:25:00.091 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: block_size_deviation: 10 2024-09-21T12:25:00.091 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: block_restart_interval: 16 2024-09-21T12:25:00.091 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: index_block_restart_interval: 1 2024-09-21T12:25:00.091 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: metadata_block_size: 4096 2024-09-21T12:25:00.091 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: partition_filters: 0 2024-09-21T12:25:00.091 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: use_delta_encoding: 1 2024-09-21T12:25:00.091 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: filter_policy: bloomfilter 2024-09-21T12:25:00.091 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: whole_key_filtering: 1 2024-09-21T12:25:00.091 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: verify_compression: 0 2024-09-21T12:25:00.091 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: read_amp_bytes_per_bit: 0 2024-09-21T12:25:00.091 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: format_version: 5 2024-09-21T12:25:00.091 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: enable_index_compression: 1 2024-09-21T12:25:00.092 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: block_align: 0 2024-09-21T12:25:00.092 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: max_auto_readahead_size: 262144 2024-09-21T12:25:00.092 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: prepopulate_block_cache: 0 2024-09-21T12:25:00.092 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: initial_auto_readahead_size: 8192 2024-09-21T12:25:00.092 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T12:25:00.092 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T12:25:00.092 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T12:25:00.092 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.compression: NoCompression 2024-09-21T12:25:00.092 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T12:25:00.092 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T12:25:00.092 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T12:25:00.092 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.num_levels: 7 2024-09-21T12:25:00.092 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T12:25:00.092 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T12:25:00.093 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T12:25:00.093 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T12:25:00.093 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T12:25:00.093 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T12:25:00.093 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T12:25:00.093 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T12:25:00.093 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T12:25:00.093 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T12:25:00.093 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T12:25:00.093 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T12:25:00.093 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T12:25:00.093 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T12:25:00.093 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T12:25:00.093 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T12:25:00.093 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T12:25:00.094 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T12:25:00.094 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T12:25:00.094 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T12:25:00.094 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T12:25:00.094 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T12:25:00.094 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T12:25:00.094 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T12:25:00.094 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T12:25:00.094 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T12:25:00.094 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T12:25:00.094 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T12:25:00.094 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T12:25:00.094 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T12:25:00.094 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T12:25:00.095 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T12:25:00.095 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T12:25:00.095 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T12:25:00.095 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T12:25:00.095 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T12:25:00.095 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T12:25:00.095 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T12:25:00.095 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T12:25:00.095 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T12:25:00.095 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T12:25:00.095 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T12:25:00.095 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T12:25:00.095 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T12:25:00.096 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T12:25:00.096 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T12:25:00.096 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T12:25:00.096 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T12:25:00.096 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T12:25:00.096 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T12:25:00.096 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T12:25:00.096 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T12:25:00.096 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T12:25:00.096 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T12:25:00.096 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.inplace_update_support: 0 2024-09-21T12:25:00.096 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T12:25:00.096 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T12:25:00.096 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T12:25:00.097 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T12:25:00.097 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.bloom_locality: 0 2024-09-21T12:25:00.097 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.max_successive_merges: 0 2024-09-21T12:25:00.097 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T12:25:00.097 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T12:25:00.097 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T12:25:00.097 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T12:25:00.097 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.ttl: 2592000 2024-09-21T12:25:00.097 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T12:25:00.097 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T12:25:00.097 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T12:25:00.097 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.enable_blob_files: false 2024-09-21T12:25:00.097 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.min_blob_size: 0 2024-09-21T12:25:00.097 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T12:25:00.098 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T12:25:00.098 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T12:25:00.098 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T12:25:00.098 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T12:25:00.098 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T12:25:00.098 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T12:25:00.098 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T12:25:00.098 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-21T12:25:00.098 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi003/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 34, last_sequence is 11982, log_number is 30,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 30 2024-09-21T12:25:00.098 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 30 2024-09-21T12:25:00.098 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: ec369571-99e7-4e17-9471-686f26b91b98 2024-09-21T12:25:00.098 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726921499842829, "job": 1, "event": "recovery_started", "wal_files": [30]} 2024-09-21T12:25:00.098 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #30 mode 2 2024-09-21T12:25:00.098 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726921499853407, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 35, "file_size": 2290563, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 11983, "largest_seqno": 13881, "table_properties": {"data_size": 2281706, "index_size": 5635, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 2181, "raw_key_size": 20220, "raw_average_key_size": 23, "raw_value_size": 2263412, "raw_average_value_size": 2631, "num_data_blocks": 256, "num_entries": 860, "num_filter_entries": 860, "num_deletions": 6, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726921499, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "ec369571-99e7-4e17-9471-686f26b91b98", "db_session_id": "8BIDX6P6EQDE38GXKTZH", "orig_file_number": 35, "seqno_to_time_mapping": "N/A"}} 2024-09-21T12:25:00.098 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726921499853548, "job": 1, "event": "recovery_finished"} 2024-09-21T12:25:00.099 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: [db/version_set.cc:5047] Creating manifest 37 2024-09-21T12:25:00.099 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-21T12:25:00.099 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi003/store.db/000030.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T12:25:00.099 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55f7b4d6ae00 2024-09-21T12:25:00.099 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: DB pointer 0x55f7b4e6c000 2024-09-21T12:25:00.099 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T12:25:00.099 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T12:25:00.099 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: ** DB Stats ** 2024-09-21T12:25:00.099 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T12:25:00.099 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T12:25:00.099 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T12:25:00.099 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T12:25:00.099 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T12:25:00.100 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T12:25:00.100 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T12:25:00.100 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: 2024-09-21T12:25:00.100 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: ** Compaction Stats [default] ** 2024-09-21T12:25:00.100 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T12:25:00.100 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T12:25:00.100 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: L0 1/0 2.18 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 573.0 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-21T12:25:00.100 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: L6 1/0 7.26 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-21T12:25:00.100 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: Sum 2/0 9.45 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 573.0 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-21T12:25:00.100 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 573.0 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-21T12:25:00.100 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: 2024-09-21T12:25:00.100 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: ** Compaction Stats [default] ** 2024-09-21T12:25:00.100 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T12:25:00.100 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T12:25:00.100 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 573.0 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-21T12:25:00.101 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: 2024-09-21T12:25:00.101 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T12:25:00.101 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: 2024-09-21T12:25:00.101 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T12:25:00.101 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: Flush(GB): cumulative 0.002, interval 0.002 2024-09-21T12:25:00.101 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T12:25:00.101 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T12:25:00.101 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T12:25:00.101 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T12:25:00.101 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: Cumulative compaction: 0.00 GB write, 143.25 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T12:25:00.101 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: Interval compaction: 0.00 GB write, 143.25 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T12:25:00.101 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T12:25:00.101 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: Block cache BinnedLRUCache@0x55f7b4d3b610#2 capacity: 512.00 MB usage: 8.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-09-21T12:25:00.101 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,2.28 KB,0.000435114%) IndexBlock(1,6.08 KB,0.00115931%) Misc(1,0.00 KB,0%) 2024-09-21T12:25:00.101 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: 2024-09-21T12:25:00.102 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T12:25:00.102 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: starting mon.smithi003 rank 0 at public addrs [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] at bind addrs [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi003 fsid 641beec0-7812-11ef-baf6-efdc52797490 2024-09-21T12:25:00.102 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: mon.smithi003@-1(???) e2 preinit fsid 641beec0-7812-11ef-baf6-efdc52797490 2024-09-21T12:25:00.102 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: mon.smithi003@-1(???).mds e14 new map 2024-09-21T12:25:00.102 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: mon.smithi003@-1(???).mds e14 print_map 2024-09-21T12:25:00.102 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: e14 2024-09-21T12:25:00.102 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: btime 2024-09-21T12:17:55:592931+0000 2024-09-21T12:25:00.102 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T12:25:00.102 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:25:00.102 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: legacy client fscid: 1 2024-09-21T12:25:00.102 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: 2024-09-21T12:25:00.102 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: Filesystem 'cephfs' (1) 2024-09-21T12:25:00.102 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: fs_name cephfs 2024-09-21T12:25:00.102 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: epoch 14 2024-09-21T12:25:00.102 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T12:25:00.103 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: created 2024-09-21T12:17:38.260099+0000 2024-09-21T12:25:00.103 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: modified 2024-09-21T12:17:55.592927+0000 2024-09-21T12:25:00.103 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: tableserver 0 2024-09-21T12:25:00.103 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: root 0 2024-09-21T12:25:00.103 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: session_timeout 60 2024-09-21T12:25:00.103 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: session_autoclose 300 2024-09-21T12:25:00.103 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: max_file_size 1099511627776 2024-09-21T12:25:00.103 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: max_xattr_size 65536 2024-09-21T12:25:00.103 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: required_client_features {} 2024-09-21T12:25:00.103 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: last_failure 0 2024-09-21T12:25:00.103 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: last_failure_osd_epoch 46 2024-09-21T12:25:00.103 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:25:00.103 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: max_mds 1 2024-09-21T12:25:00.103 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: in 0 2024-09-21T12:25:00.103 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: up {0=14564} 2024-09-21T12:25:00.104 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: failed 2024-09-21T12:25:00.104 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: damaged 2024-09-21T12:25:00.104 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: stopped 2024-09-21T12:25:00.104 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: data_pools [3] 2024-09-21T12:25:00.104 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: metadata_pool 2 2024-09-21T12:25:00.104 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: inline_data enabled 2024-09-21T12:25:00.104 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: balancer 2024-09-21T12:25:00.104 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: bal_rank_mask -1 2024-09-21T12:25:00.104 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: standby_count_wanted 1 2024-09-21T12:25:00.104 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: qdb_cluster leader: 14564 members: 14564 2024-09-21T12:25:00.104 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: [mds.cephfs.smithi003.gfkngj{0:14564} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.3:6828/3710817325,v1:172.21.15.3:6829/3710817325] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:25:00.104 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: 2024-09-21T12:25:00.104 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: 2024-09-21T12:25:00.104 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: Standby daemons: 2024-09-21T12:25:00.104 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: 2024-09-21T12:25:00.105 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: [mds.cephfs.smithi192.ywqqxe{-1:24319} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.192:6824/4055220871,v1:172.21.15.192:6825/4055220871] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:25:00.105 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: [mds.cephfs.smithi192.ktdqns{-1:24337} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.192:6826/318800854,v1:172.21.15.192:6827/318800854] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:25:00.105 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout: [mds.cephfs.smithi003.ebjgyl{-1:24345} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.3:6826/55902996,v1:172.21.15.3:6827/55902996] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:25:00.105 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: mon.smithi003@-1(???).osd e48 crush map has features 3314933000852226048, adjusting msgr requires 2024-09-21T12:25:00.105 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: mon.smithi003@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-09-21T12:25:00.105 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: mon.smithi003@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-09-21T12:25:00.105 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: mon.smithi003@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-09-21T12:25:00.105 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 ceph-mon[108723]: mon.smithi003@-1(???).paxosservice(auth 1..23) refresh upgraded, format 0 -> 3 2024-09-21T12:25:00.105 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 bash[108703]: 4f2b2b2daf19a7576f564282b324a7e3a2d0bc644f7040d0aa279b2089d24874 2024-09-21T12:25:00.105 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:24:59 smithi003 systemd[1]: Started Ceph mon.smithi003 for 641beec0-7812-11ef-baf6-efdc52797490. 2024-09-21T12:25:01.553 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:01 smithi003 ceph-mon[108723]: pgmap v93: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:01.554 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:01 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:25:01.554 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:01 smithi003 ceph-mon[108723]: pgmap v94: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:01.554 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:01 smithi003 ceph-mon[108723]: mon.smithi003 calling monitor election 2024-09-21T12:25:01.554 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:01 smithi003 ceph-mon[108723]: mon.smithi003 is new leader, mons smithi003,smithi192 in quorum (ranks 0,1) 2024-09-21T12:25:01.554 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:01 smithi003 ceph-mon[108723]: monmap epoch 2 2024-09-21T12:25:01.554 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:01 smithi003 ceph-mon[108723]: fsid 641beec0-7812-11ef-baf6-efdc52797490 2024-09-21T12:25:01.554 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:01 smithi003 ceph-mon[108723]: last_changed 2024-09-21T12:13:10.719146+0000 2024-09-21T12:25:01.554 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:01 smithi003 ceph-mon[108723]: created 2024-09-21T12:10:43.597094+0000 2024-09-21T12:25:01.554 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:01 smithi003 ceph-mon[108723]: min_mon_release 19 (squid) 2024-09-21T12:25:01.554 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:01 smithi003 ceph-mon[108723]: election_strategy: 1 2024-09-21T12:25:01.554 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:01 smithi003 ceph-mon[108723]: 0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.smithi003 2024-09-21T12:25:01.555 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:01 smithi003 ceph-mon[108723]: 1: [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] mon.smithi192 2024-09-21T12:25:01.556 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:01 smithi003 ceph-mon[108723]: fsmap cephfs:1 {0=cephfs.smithi003.gfkngj=up:active} 3 up:standby 2024-09-21T12:25:01.556 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:01 smithi003 ceph-mon[108723]: osdmap e48: 6 total, 6 up, 6 in 2024-09-21T12:25:01.556 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:01 smithi003 ceph-mon[108723]: mgrmap e33: smithi003.wztftl(active, since 3m), standbys: smithi192.qsaprd 2024-09-21T12:25:01.556 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:01 smithi003 ceph-mon[108723]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-21T12:25:01.556 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:01 smithi003 ceph-mon[108723]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:25:01.556 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:01 smithi003 ceph-mon[108723]: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:25:01.556 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:01 smithi003 ceph-mon[108723]: from='mgr.14756 ' entity='' 2024-09-21T12:25:01.556 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:01 smithi003 ceph-mon[108723]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:01.556 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:01 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:25:01.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:01 smithi192 ceph-mon[35641]: pgmap v93: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:01.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:01 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-21T12:25:01.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:01 smithi192 ceph-mon[35641]: pgmap v94: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:01.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:01 smithi192 ceph-mon[35641]: mon.smithi003 calling monitor election 2024-09-21T12:25:01.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:01 smithi192 ceph-mon[35641]: mon.smithi003 is new leader, mons smithi003,smithi192 in quorum (ranks 0,1) 2024-09-21T12:25:01.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:01 smithi192 ceph-mon[35641]: monmap epoch 2 2024-09-21T12:25:01.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:01 smithi192 ceph-mon[35641]: fsid 641beec0-7812-11ef-baf6-efdc52797490 2024-09-21T12:25:01.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:01 smithi192 ceph-mon[35641]: last_changed 2024-09-21T12:13:10.719146+0000 2024-09-21T12:25:01.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:01 smithi192 ceph-mon[35641]: created 2024-09-21T12:10:43.597094+0000 2024-09-21T12:25:01.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:01 smithi192 ceph-mon[35641]: min_mon_release 19 (squid) 2024-09-21T12:25:01.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:01 smithi192 ceph-mon[35641]: election_strategy: 1 2024-09-21T12:25:01.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:01 smithi192 ceph-mon[35641]: 0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.smithi003 2024-09-21T12:25:01.759 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:01 smithi192 ceph-mon[35641]: 1: [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] mon.smithi192 2024-09-21T12:25:01.759 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:01 smithi192 ceph-mon[35641]: fsmap cephfs:1 {0=cephfs.smithi003.gfkngj=up:active} 3 up:standby 2024-09-21T12:25:01.759 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:01 smithi192 ceph-mon[35641]: osdmap e48: 6 total, 6 up, 6 in 2024-09-21T12:25:01.759 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:01 smithi192 ceph-mon[35641]: mgrmap e33: smithi003.wztftl(active, since 3m), standbys: smithi192.qsaprd 2024-09-21T12:25:01.759 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:01 smithi192 ceph-mon[35641]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-21T12:25:01.759 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:01 smithi192 ceph-mon[35641]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:25:01.759 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:01 smithi192 ceph-mon[35641]: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:25:01.759 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:01 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='' 2024-09-21T12:25:01.759 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:01 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:01.759 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:01 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:25:04.154 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:03 smithi003 ceph-mon[108723]: pgmap v95: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:04.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:03 smithi192 ceph-mon[35641]: pgmap v95: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:06.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:05 smithi003 ceph-mon[108723]: pgmap v96: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:06.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:05 smithi192 ceph-mon[35641]: pgmap v96: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:07.393 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:07 smithi003 ceph-mon[108723]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:07.394 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:07 smithi003 ceph-mon[108723]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:07.394 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:07 smithi003 ceph-mon[108723]: pgmap v97: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:07.394 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:07 smithi003 ceph-mon[108723]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:07.394 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:07 smithi003 ceph-mon[108723]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:07.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:07 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:07.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:07 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:07.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:07 smithi192 ceph-mon[35641]: pgmap v97: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:07.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:07 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:07.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:07 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:10.231 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:09 smithi192 ceph-mon[35641]: pgmap v98: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:10.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:09 smithi003 ceph-mon[108723]: pgmap v98: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:11.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:10 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:11.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:10 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:11.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:10 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:25:11.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:10 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:25:11.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:10 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:11.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:10 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:25:11.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:10 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:25:11.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:10 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-21T12:25:11.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:10 smithi003 ceph-mon[108723]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:11.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:10 smithi003 ceph-mon[108723]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:11.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:10 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:25:11.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:10 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-21T12:25:11.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:10 smithi003 ceph-mon[108723]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:11.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:10 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-21T12:25:11.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:10 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "versions"}]: dispatch 2024-09-21T12:25:11.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:10 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-21T12:25:12.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:11 smithi003 ceph-mon[108723]: pgmap v99: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:12.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:11 smithi003 ceph-mon[108723]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:12.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:11 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-21T12:25:12.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:11 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-21T12:25:12.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:11 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:25:12.240 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:11 smithi192 ceph-mon[35641]: pgmap v99: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:12.240 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:11 smithi192 ceph-mon[35641]: from='mgr.14756 ' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:12.240 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:11 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-21T12:25:12.240 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:11 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-21T12:25:12.240 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:11 smithi192 ceph-mon[35641]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-21T12:25:13.169 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:12 smithi192 ceph-mon[35641]: Upgrade: Updating mon.smithi192 2024-09-21T12:25:13.169 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:12 smithi192 ceph-mon[35641]: Deploying daemon mon.smithi192 on smithi192 2024-09-21T12:25:13.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:12 smithi003 ceph-mon[108723]: Upgrade: Updating mon.smithi192 2024-09-21T12:25:13.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:12 smithi003 ceph-mon[108723]: Deploying daemon mon.smithi192 on smithi192 2024-09-21T12:25:13.424 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:13 smithi192 systemd[1]: Stopping Ceph mon.smithi192 for 641beec0-7812-11ef-baf6-efdc52797490... 2024-09-21T12:25:13.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:13 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-mon-smithi192[35637]: 2024-09-21T12:25:13.421+0000 7ff015bf4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi192 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T12:25:13.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:13 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-mon-smithi192[35637]: 2024-09-21T12:25:13.421+0000 7ff015bf4640 -1 mon.smithi192@1(peon) e2 *** Got Signal Terminated *** 2024-09-21T12:25:13.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:13 smithi192 podman[80169]: 2024-09-21 12:25:13.626562853 +0000 UTC m=+0.310499677 container died 4fe4c4b3dc5dca17a48d8360507baedb5913f7ff9b10cfe68cf53d1887f1530d (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-mon-smithi192, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-4e45e6b, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-21T12:25:14.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:14 smithi192 podman[80169]: 2024-09-21 12:25:14.047818297 +0000 UTC m=+0.731755122 container cleanup 4fe4c4b3dc5dca17a48d8360507baedb5913f7ff9b10cfe68cf53d1887f1530d (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-mon-smithi192, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-4e45e6b, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2) 2024-09-21T12:25:14.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:14 smithi192 bash[80169]: ceph-641beec0-7812-11ef-baf6-efdc52797490-mon-smithi192 2024-09-21T12:25:14.685 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:14 smithi192 podman[80180]: 2024-09-21 12:25:14.265786507 +0000 UTC m=+0.629825586 container remove 4fe4c4b3dc5dca17a48d8360507baedb5913f7ff9b10cfe68cf53d1887f1530d (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-mon-smithi192, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-4e45e6b, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T12:25:14.685 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:14 smithi192 systemd[1]: ceph-641beec0-7812-11ef-baf6-efdc52797490@mon.smithi192.service: Deactivated successfully. 2024-09-21T12:25:14.685 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:14 smithi192 systemd[1]: Stopped Ceph mon.smithi192 for 641beec0-7812-11ef-baf6-efdc52797490. 2024-09-21T12:25:14.685 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:14 smithi192 systemd[1]: ceph-641beec0-7812-11ef-baf6-efdc52797490@mon.smithi192.service: Consumed 7.458s CPU time. 2024-09-21T12:25:14.685 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:14 smithi192 systemd[1]: Starting Ceph mon.smithi192 for 641beec0-7812-11ef-baf6-efdc52797490... 2024-09-21T12:25:15.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:14 smithi192 podman[80306]: 2024-09-21 12:25:14.795555438 +0000 UTC m=+0.016009394 image pull 8f4d013db793795fef09ff5edf96e6b42ba8cd2c9158b2f0b7a5d7c1e657c063 quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 2024-09-21T12:25:15.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:14 smithi192 podman[80306]: 2024-09-21 12:25:14.917030487 +0000 UTC m=+0.137484429 container create 11edc5c1baba1a058459f81ba7a38375f20d4812b187b9ad298f4da49159a0f5 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-mon-smithi192, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-21T12:25:15.311 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 podman[80306]: 2024-09-21 12:25:15.13640862 +0000 UTC m=+0.356862566 container init 11edc5c1baba1a058459f81ba7a38375f20d4812b187b9ad298f4da49159a0f5 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-mon-smithi192, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T12:25:15.311 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 podman[80306]: 2024-09-21 12:25:15.139796121 +0000 UTC m=+0.360250064 container start 11edc5c1baba1a058459f81ba7a38375f20d4812b187b9ad298f4da49159a0f5 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-mon-smithi192, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-21T12:25:15.311 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: set uid:gid to 167:167 (ceph:ceph) 2024-09-21T12:25:15.311 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev), process ceph-mon, pid 2 2024-09-21T12:25:15.311 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: pidfile_write: ignore empty --pid-file 2024-09-21T12:25:15.312 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: load: jerasure load: lrc 2024-09-21T12:25:15.312 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: RocksDB version: 7.9.2 2024-09-21T12:25:15.312 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Git sha 0 2024-09-21T12:25:15.312 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Compile date 2024-09-21 08:36:07 2024-09-21T12:25:15.312 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: DB SUMMARY 2024-09-21T12:25:15.312 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: DB Session ID: 46HH3YFQN7WZIQJA889Y 2024-09-21T12:25:15.312 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: CURRENT file: CURRENT 2024-09-21T12:25:15.312 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: IDENTITY file: IDENTITY 2024-09-21T12:25:15.312 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: MANIFEST file: MANIFEST-000010 size: 1400 Bytes 2024-09-21T12:25:15.312 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi192/store.db dir, Total Num: 1, files: 000027.sst 2024-09-21T12:25:15.312 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi192/store.db: 000025.log size: 4512879 ; 2024-09-21T12:25:15.312 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.error_if_exists: 0 2024-09-21T12:25:15.312 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.create_if_missing: 0 2024-09-21T12:25:15.312 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.paranoid_checks: 1 2024-09-21T12:25:15.313 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-21T12:25:15.313 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-21T12:25:15.313 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-21T12:25:15.313 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.env: 0x5582ec04d120 2024-09-21T12:25:15.313 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.fs: PosixFileSystem 2024-09-21T12:25:15.313 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.info_log: 0x5582ecf198e0 2024-09-21T12:25:15.313 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.max_file_opening_threads: 16 2024-09-21T12:25:15.314 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.statistics: (nil) 2024-09-21T12:25:15.314 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.use_fsync: 0 2024-09-21T12:25:15.315 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.max_log_file_size: 0 2024-09-21T12:25:15.315 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-21T12:25:15.315 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-21T12:25:15.315 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.keep_log_file_num: 1000 2024-09-21T12:25:15.315 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.recycle_log_file_num: 0 2024-09-21T12:25:15.315 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.allow_fallocate: 1 2024-09-21T12:25:15.315 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.allow_mmap_reads: 0 2024-09-21T12:25:15.315 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.allow_mmap_writes: 0 2024-09-21T12:25:15.315 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.use_direct_reads: 0 2024-09-21T12:25:15.315 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-21T12:25:15.315 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.create_missing_column_families: 0 2024-09-21T12:25:15.315 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.db_log_dir: 2024-09-21T12:25:15.315 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.wal_dir: 2024-09-21T12:25:15.316 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-21T12:25:15.316 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-21T12:25:15.316 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-21T12:25:15.316 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-21T12:25:15.316 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-21T12:25:15.316 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-21T12:25:15.316 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.advise_random_on_open: 1 2024-09-21T12:25:15.316 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.db_write_buffer_size: 0 2024-09-21T12:25:15.316 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.write_buffer_manager: 0x5582ecf1db80 2024-09-21T12:25:15.316 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-21T12:25:15.316 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-21T12:25:15.316 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-21T12:25:15.316 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.rate_limiter: (nil) 2024-09-21T12:25:15.316 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-21T12:25:15.317 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.wal_recovery_mode: 2 2024-09-21T12:25:15.317 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.enable_thread_tracking: 0 2024-09-21T12:25:15.317 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.enable_pipelined_write: 0 2024-09-21T12:25:15.317 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.unordered_write: 0 2024-09-21T12:25:15.317 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-21T12:25:15.317 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-21T12:25:15.317 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-21T12:25:15.317 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-21T12:25:15.317 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.row_cache: None 2024-09-21T12:25:15.317 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.wal_filter: None 2024-09-21T12:25:15.317 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-21T12:25:15.317 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.allow_ingest_behind: 0 2024-09-21T12:25:15.317 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.two_write_queues: 0 2024-09-21T12:25:15.317 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.manual_wal_flush: 0 2024-09-21T12:25:15.318 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.wal_compression: 0 2024-09-21T12:25:15.318 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.atomic_flush: 0 2024-09-21T12:25:15.318 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-21T12:25:15.318 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-21T12:25:15.318 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-21T12:25:15.318 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.log_readahead_size: 0 2024-09-21T12:25:15.318 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-21T12:25:15.318 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.best_efforts_recovery: 0 2024-09-21T12:25:15.318 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-21T12:25:15.318 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-21T12:25:15.318 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.allow_data_in_errors: 0 2024-09-21T12:25:15.318 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.db_host_id: __hostname__ 2024-09-21T12:25:15.318 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-21T12:25:15.318 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.max_background_jobs: 2 2024-09-21T12:25:15.319 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.max_background_compactions: -1 2024-09-21T12:25:15.319 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.max_subcompactions: 1 2024-09-21T12:25:15.319 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-21T12:25:15.319 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-21T12:25:15.319 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-21T12:25:15.319 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.max_total_wal_size: 0 2024-09-21T12:25:15.319 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-21T12:25:15.319 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-21T12:25:15.319 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-21T12:25:15.319 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-21T12:25:15.319 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.max_open_files: -1 2024-09-21T12:25:15.319 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.bytes_per_sync: 0 2024-09-21T12:25:15.319 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-21T12:25:15.319 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-21T12:25:15.319 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.compaction_readahead_size: 0 2024-09-21T12:25:15.320 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.max_background_flushes: -1 2024-09-21T12:25:15.320 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Compression algorithms supported: 2024-09-21T12:25:15.320 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: kZSTD supported: 0 2024-09-21T12:25:15.320 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: kXpressCompression supported: 0 2024-09-21T12:25:15.320 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: kBZip2Compression supported: 0 2024-09-21T12:25:15.320 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-21T12:25:15.320 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: kLZ4Compression supported: 1 2024-09-21T12:25:15.320 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: kZlibCompression supported: 1 2024-09-21T12:25:15.320 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: kLZ4HCCompression supported: 1 2024-09-21T12:25:15.320 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: kSnappyCompression supported: 1 2024-09-21T12:25:15.320 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-21T12:25:15.320 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-21T12:25:15.320 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi192/store.db/MANIFEST-000010 2024-09-21T12:25:15.321 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-21T12:25:15.321 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-21T12:25:15.321 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.merge_operator: 2024-09-21T12:25:15.321 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.compaction_filter: None 2024-09-21T12:25:15.321 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.compaction_filter_factory: None 2024-09-21T12:25:15.321 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.sst_partitioner_factory: None 2024-09-21T12:25:15.321 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-21T12:25:15.321 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-21T12:25:15.321 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5582ecf19540) 2024-09-21T12:25:15.321 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: cache_index_and_filter_blocks: 1 2024-09-21T12:25:15.321 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-21T12:25:15.321 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-21T12:25:15.321 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: pin_top_level_index_and_filter: 1 2024-09-21T12:25:15.321 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: index_type: 0 2024-09-21T12:25:15.322 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: data_block_index_type: 0 2024-09-21T12:25:15.322 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: index_shortening: 1 2024-09-21T12:25:15.322 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-21T12:25:15.322 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: checksum: 4 2024-09-21T12:25:15.322 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: no_block_cache: 0 2024-09-21T12:25:15.322 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: block_cache: 0x5582ecf0d610 2024-09-21T12:25:15.322 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: block_cache_name: BinnedLRUCache 2024-09-21T12:25:15.322 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: block_cache_options: 2024-09-21T12:25:15.322 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: capacity : 536870912 2024-09-21T12:25:15.322 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: num_shard_bits : 4 2024-09-21T12:25:15.322 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: strict_capacity_limit : 0 2024-09-21T12:25:15.322 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: high_pri_pool_ratio: 0.000 2024-09-21T12:25:15.322 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: block_cache_compressed: (nil) 2024-09-21T12:25:15.322 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: persistent_cache: (nil) 2024-09-21T12:25:15.323 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: block_size: 4096 2024-09-21T12:25:15.323 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: block_size_deviation: 10 2024-09-21T12:25:15.323 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: block_restart_interval: 16 2024-09-21T12:25:15.323 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: index_block_restart_interval: 1 2024-09-21T12:25:15.323 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: metadata_block_size: 4096 2024-09-21T12:25:15.323 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: partition_filters: 0 2024-09-21T12:25:15.323 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: use_delta_encoding: 1 2024-09-21T12:25:15.323 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: filter_policy: bloomfilter 2024-09-21T12:25:15.323 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: whole_key_filtering: 1 2024-09-21T12:25:15.323 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: verify_compression: 0 2024-09-21T12:25:15.323 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: read_amp_bytes_per_bit: 0 2024-09-21T12:25:15.323 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: format_version: 5 2024-09-21T12:25:15.323 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: enable_index_compression: 1 2024-09-21T12:25:15.323 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: block_align: 0 2024-09-21T12:25:15.324 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: max_auto_readahead_size: 262144 2024-09-21T12:25:15.324 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: prepopulate_block_cache: 0 2024-09-21T12:25:15.324 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: initial_auto_readahead_size: 8192 2024-09-21T12:25:15.324 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: num_file_reads_for_auto_readahead: 2 2024-09-21T12:25:15.324 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.write_buffer_size: 33554432 2024-09-21T12:25:15.324 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.max_write_buffer_number: 2 2024-09-21T12:25:15.324 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.compression: NoCompression 2024-09-21T12:25:15.324 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.bottommost_compression: Disabled 2024-09-21T12:25:15.324 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.prefix_extractor: nullptr 2024-09-21T12:25:15.324 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-21T12:25:15.324 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.num_levels: 7 2024-09-21T12:25:15.324 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-21T12:25:15.324 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-21T12:25:15.324 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-21T12:25:15.325 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-21T12:25:15.325 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-21T12:25:15.325 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-21T12:25:15.325 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-21T12:25:15.325 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-21T12:25:15.325 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-21T12:25:15.325 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-21T12:25:15.325 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-21T12:25:15.325 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-21T12:25:15.325 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-21T12:25:15.325 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.compression_opts.level: 32767 2024-09-21T12:25:15.325 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.compression_opts.strategy: 0 2024-09-21T12:25:15.325 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-21T12:25:15.325 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-21T12:25:15.326 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-21T12:25:15.326 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-21T12:25:15.326 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.compression_opts.enabled: false 2024-09-21T12:25:15.326 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-21T12:25:15.326 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-21T12:25:15.326 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-21T12:25:15.326 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-21T12:25:15.326 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.target_file_size_base: 67108864 2024-09-21T12:25:15.326 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-21T12:25:15.326 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-21T12:25:15.326 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-21T12:25:15.326 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-21T12:25:15.326 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-21T12:25:15.326 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-21T12:25:15.327 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-21T12:25:15.327 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-21T12:25:15.327 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-21T12:25:15.327 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-21T12:25:15.327 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-21T12:25:15.327 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-21T12:25:15.327 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-21T12:25:15.327 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-21T12:25:15.327 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.arena_block_size: 1048576 2024-09-21T12:25:15.327 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-21T12:25:15.327 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-21T12:25:15.327 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.disable_auto_compactions: 0 2024-09-21T12:25:15.327 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-21T12:25:15.327 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-21T12:25:15.327 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-21T12:25:15.328 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-21T12:25:15.328 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-21T12:25:15.328 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-21T12:25:15.328 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-21T12:25:15.328 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-21T12:25:15.328 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-21T12:25:15.328 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-21T12:25:15.328 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-21T12:25:15.328 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.inplace_update_support: 0 2024-09-21T12:25:15.328 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-21T12:25:15.328 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-21T12:25:15.328 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-21T12:25:15.328 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-21T12:25:15.328 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.bloom_locality: 0 2024-09-21T12:25:15.328 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.max_successive_merges: 0 2024-09-21T12:25:15.329 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-21T12:25:15.329 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.paranoid_file_checks: 0 2024-09-21T12:25:15.329 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.force_consistency_checks: 1 2024-09-21T12:25:15.329 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.report_bg_io_stats: 0 2024-09-21T12:25:15.329 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.ttl: 2592000 2024-09-21T12:25:15.329 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-21T12:25:15.329 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-21T12:25:15.329 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-21T12:25:15.329 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.enable_blob_files: false 2024-09-21T12:25:15.329 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.min_blob_size: 0 2024-09-21T12:25:15.329 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.blob_file_size: 268435456 2024-09-21T12:25:15.329 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-21T12:25:15.329 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-21T12:25:15.329 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-21T12:25:15.329 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-21T12:25:15.330 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-21T12:25:15.330 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.blob_file_starting_level: 0 2024-09-21T12:25:15.330 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-21T12:25:15.330 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-21T12:25:15.330 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi192/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 29, last_sequence is 12184, log_number is 25,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 25 2024-09-21T12:25:15.330 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 25 2024-09-21T12:25:15.330 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: a95e49ac-a27b-45ff-96eb-bed58e187fb4 2024-09-21T12:25:15.330 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726921515166405, "job": 1, "event": "recovery_started", "wal_files": [25]} 2024-09-21T12:25:15.330 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #25 mode 2 2024-09-21T12:25:15.330 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726921515177192, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 30, "file_size": 2615300, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12189, "largest_seqno": 14819, "table_properties": {"data_size": 2604763, "index_size": 6418, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 3077, "raw_key_size": 27012, "raw_average_key_size": 22, "raw_value_size": 2580886, "raw_average_value_size": 2118, "num_data_blocks": 292, "num_entries": 1218, "num_filter_entries": 1218, "num_deletions": 257, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726921515, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "a95e49ac-a27b-45ff-96eb-bed58e187fb4", "db_session_id": "46HH3YFQN7WZIQJA889Y", "orig_file_number": 30, "seqno_to_time_mapping": "N/A"}} 2024-09-21T12:25:15.330 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726921515177329, "job": 1, "event": "recovery_finished"} 2024-09-21T12:25:15.330 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: [db/version_set.cc:5047] Creating manifest 32 2024-09-21T12:25:15.330 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-21T12:25:15.330 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi192/store.db/000025.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-21T12:25:15.331 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5582ecf3ce00 2024-09-21T12:25:15.331 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: DB pointer 0x5582ed03e000 2024-09-21T12:25:15.331 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-21T12:25:15.331 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-21T12:25:15.331 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: ** DB Stats ** 2024-09-21T12:25:15.331 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T12:25:15.331 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-21T12:25:15.331 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T12:25:15.331 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T12:25:15.331 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-21T12:25:15.331 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-21T12:25:15.331 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-21T12:25:15.332 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: 2024-09-21T12:25:15.332 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: ** Compaction Stats [default] ** 2024-09-21T12:25:15.332 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T12:25:15.332 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-21T12:25:15.332 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: L0 1/0 2.49 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 591.2 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-21T12:25:15.332 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: L6 1/0 7.26 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-21T12:25:15.332 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: Sum 2/0 9.76 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 591.2 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-21T12:25:15.332 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 591.2 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-21T12:25:15.332 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: 2024-09-21T12:25:15.332 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: ** Compaction Stats [default] ** 2024-09-21T12:25:15.332 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-21T12:25:15.332 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-21T12:25:15.332 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 591.2 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-09-21T12:25:15.332 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: 2024-09-21T12:25:15.332 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-21T12:25:15.333 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: 2024-09-21T12:25:15.333 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-21T12:25:15.333 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: Flush(GB): cumulative 0.002, interval 0.002 2024-09-21T12:25:15.333 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-21T12:25:15.333 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-21T12:25:15.333 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-21T12:25:15.333 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-21T12:25:15.333 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: Cumulative compaction: 0.00 GB write, 144.48 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T12:25:15.333 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: Interval compaction: 0.00 GB write, 144.48 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-21T12:25:15.333 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-21T12:25:15.333 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: Block cache BinnedLRUCache@0x5582ecf0d610#2 capacity: 512.00 MB usage: 9.86 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-21T12:25:15.333 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,3.28 KB,0.000625849%) IndexBlock(1,6.58 KB,0.00125468%) Misc(1,0.00 KB,0%) 2024-09-21T12:25:15.333 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: 2024-09-21T12:25:15.333 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-21T12:25:15.334 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: starting mon.smithi192 rank 1 at public addrs [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] at bind addrs [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi192 fsid 641beec0-7812-11ef-baf6-efdc52797490 2024-09-21T12:25:15.334 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: mon.smithi192@-1(???) e2 preinit fsid 641beec0-7812-11ef-baf6-efdc52797490 2024-09-21T12:25:15.334 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: mon.smithi192@-1(???).mds e14 new map 2024-09-21T12:25:15.334 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: mon.smithi192@-1(???).mds e14 print_map 2024-09-21T12:25:15.334 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: e14 2024-09-21T12:25:15.334 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: btime 2024-09-21T12:17:55:592931+0000 2024-09-21T12:25:15.334 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T12:25:15.334 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:25:15.334 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: legacy client fscid: 1 2024-09-21T12:25:15.334 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: 2024-09-21T12:25:15.334 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: Filesystem 'cephfs' (1) 2024-09-21T12:25:15.334 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: fs_name cephfs 2024-09-21T12:25:15.334 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: epoch 14 2024-09-21T12:25:15.334 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T12:25:15.334 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: created 2024-09-21T12:17:38.260099+0000 2024-09-21T12:25:15.335 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: modified 2024-09-21T12:17:55.592927+0000 2024-09-21T12:25:15.335 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: tableserver 0 2024-09-21T12:25:15.335 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: root 0 2024-09-21T12:25:15.335 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: session_timeout 60 2024-09-21T12:25:15.335 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: session_autoclose 300 2024-09-21T12:25:15.335 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: max_file_size 1099511627776 2024-09-21T12:25:15.335 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: max_xattr_size 65536 2024-09-21T12:25:15.335 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: required_client_features {} 2024-09-21T12:25:15.335 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: last_failure 0 2024-09-21T12:25:15.335 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: last_failure_osd_epoch 46 2024-09-21T12:25:15.335 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:25:15.335 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: max_mds 1 2024-09-21T12:25:15.335 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: in 0 2024-09-21T12:25:15.335 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: up {0=14564} 2024-09-21T12:25:15.336 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: failed 2024-09-21T12:25:15.336 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: damaged 2024-09-21T12:25:15.336 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: stopped 2024-09-21T12:25:15.336 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: data_pools [3] 2024-09-21T12:25:15.336 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: metadata_pool 2 2024-09-21T12:25:15.336 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: inline_data enabled 2024-09-21T12:25:15.336 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: balancer 2024-09-21T12:25:15.336 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: bal_rank_mask -1 2024-09-21T12:25:15.336 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: standby_count_wanted 1 2024-09-21T12:25:15.336 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: qdb_cluster leader: 14564 members: 14564 2024-09-21T12:25:15.336 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: [mds.cephfs.smithi003.gfkngj{0:14564} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.3:6828/3710817325,v1:172.21.15.3:6829/3710817325] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:25:15.336 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: 2024-09-21T12:25:15.336 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: 2024-09-21T12:25:15.336 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: Standby daemons: 2024-09-21T12:25:15.337 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: 2024-09-21T12:25:15.337 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: [mds.cephfs.smithi192.ywqqxe{-1:24319} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.192:6824/4055220871,v1:172.21.15.192:6825/4055220871] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:25:15.337 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: [mds.cephfs.smithi192.ktdqns{-1:24337} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.192:6826/318800854,v1:172.21.15.192:6827/318800854] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:25:15.337 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout: [mds.cephfs.smithi003.ebjgyl{-1:24345} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.3:6826/55902996,v1:172.21.15.3:6827/55902996] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:25:15.337 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: mon.smithi192@-1(???).osd e48 crush map has features 3314933000852226048, adjusting msgr requires 2024-09-21T12:25:15.337 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: mon.smithi192@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-09-21T12:25:15.337 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: mon.smithi192@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-09-21T12:25:15.337 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: mon.smithi192@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-09-21T12:25:15.337 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: mon.smithi192@-1(???).paxosservice(auth 1..24) refresh upgraded, format 0 -> 3 2024-09-21T12:25:15.337 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 bash[80306]: 11edc5c1baba1a058459f81ba7a38375f20d4812b187b9ad298f4da49159a0f5 2024-09-21T12:25:15.337 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 systemd[1]: Started Ceph mon.smithi192 for 641beec0-7812-11ef-baf6-efdc52797490. 2024-09-21T12:25:15.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: pgmap v100: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:15.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "mon metadata", "id": "smithi003"} : dispatch 2024-09-21T12:25:15.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "mon metadata", "id": "smithi192"} : dispatch 2024-09-21T12:25:15.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:15 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-21T12:25:15.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:15 smithi003 ceph-mon[108723]: pgmap v100: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:15.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:15 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "mon metadata", "id": "smithi003"} : dispatch 2024-09-21T12:25:15.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:15 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "mon metadata", "id": "smithi192"} : dispatch 2024-09-21T12:25:15.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:15 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "orch prometheus get-credentials"} : dispatch 2024-09-21T12:25:16.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:16 smithi003 ceph-mon[108723]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T12:25:16.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:16 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:25:16.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:16 smithi003 ceph-mon[108723]: pgmap v101: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:16.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:16 smithi003 ceph-mon[108723]: mon.smithi192 calling monitor election 2024-09-21T12:25:16.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:16 smithi003 ceph-mon[108723]: mon.smithi003 calling monitor election 2024-09-21T12:25:16.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:16 smithi003 ceph-mon[108723]: mon.smithi003 is new leader, mons smithi003,smithi192 in quorum (ranks 0,1) 2024-09-21T12:25:16.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:16 smithi003 ceph-mon[108723]: monmap epoch 2 2024-09-21T12:25:16.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:16 smithi003 ceph-mon[108723]: fsid 641beec0-7812-11ef-baf6-efdc52797490 2024-09-21T12:25:16.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:16 smithi003 ceph-mon[108723]: last_changed 2024-09-21T12:13:10.719146+0000 2024-09-21T12:25:16.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:16 smithi003 ceph-mon[108723]: created 2024-09-21T12:10:43.597094+0000 2024-09-21T12:25:16.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:16 smithi003 ceph-mon[108723]: min_mon_release 19 (squid) 2024-09-21T12:25:16.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:16 smithi003 ceph-mon[108723]: election_strategy: 1 2024-09-21T12:25:16.581 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:16 smithi003 ceph-mon[108723]: 0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.smithi003 2024-09-21T12:25:16.581 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:16 smithi003 ceph-mon[108723]: 1: [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] mon.smithi192 2024-09-21T12:25:16.581 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:16 smithi003 ceph-mon[108723]: fsmap cephfs:1 {0=cephfs.smithi003.gfkngj=up:active} 3 up:standby 2024-09-21T12:25:16.581 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:16 smithi003 ceph-mon[108723]: osdmap e48: 6 total, 6 up, 6 in 2024-09-21T12:25:16.581 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:16 smithi003 ceph-mon[108723]: mgrmap e33: smithi003.wztftl(active, since 3m), standbys: smithi192.qsaprd 2024-09-21T12:25:16.581 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:16 smithi003 ceph-mon[108723]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-21T12:25:16.581 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:16 smithi003 ceph-mon[108723]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:25:16.581 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:16 smithi003 ceph-mon[108723]: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:25:16.581 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:16 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:16.581 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:16 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:16.581 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:16 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:25:16.642 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:16 smithi192 ceph-mon[80326]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "orch prometheus get-credentials"}]: dispatch 2024-09-21T12:25:16.642 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:16 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:25:16.642 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:16 smithi192 ceph-mon[80326]: pgmap v101: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:16.642 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:16 smithi192 ceph-mon[80326]: mon.smithi192 calling monitor election 2024-09-21T12:25:16.642 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:16 smithi192 ceph-mon[80326]: mon.smithi003 calling monitor election 2024-09-21T12:25:16.642 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:16 smithi192 ceph-mon[80326]: mon.smithi003 is new leader, mons smithi003,smithi192 in quorum (ranks 0,1) 2024-09-21T12:25:16.642 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:16 smithi192 ceph-mon[80326]: monmap epoch 2 2024-09-21T12:25:16.643 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:16 smithi192 ceph-mon[80326]: fsid 641beec0-7812-11ef-baf6-efdc52797490 2024-09-21T12:25:16.643 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:16 smithi192 ceph-mon[80326]: last_changed 2024-09-21T12:13:10.719146+0000 2024-09-21T12:25:16.643 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:16 smithi192 ceph-mon[80326]: created 2024-09-21T12:10:43.597094+0000 2024-09-21T12:25:16.643 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:16 smithi192 ceph-mon[80326]: min_mon_release 19 (squid) 2024-09-21T12:25:16.643 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:16 smithi192 ceph-mon[80326]: election_strategy: 1 2024-09-21T12:25:16.643 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:16 smithi192 ceph-mon[80326]: 0: [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] mon.smithi003 2024-09-21T12:25:16.643 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:16 smithi192 ceph-mon[80326]: 1: [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] mon.smithi192 2024-09-21T12:25:16.643 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:16 smithi192 ceph-mon[80326]: fsmap cephfs:1 {0=cephfs.smithi003.gfkngj=up:active} 3 up:standby 2024-09-21T12:25:16.643 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:16 smithi192 ceph-mon[80326]: osdmap e48: 6 total, 6 up, 6 in 2024-09-21T12:25:16.643 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:16 smithi192 ceph-mon[80326]: mgrmap e33: smithi003.wztftl(active, since 3m), standbys: smithi192.qsaprd 2024-09-21T12:25:16.643 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:16 smithi192 ceph-mon[80326]: Health detail: HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-21T12:25:16.643 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:16 smithi192 ceph-mon[80326]: [WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:25:16.643 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:16 smithi192 ceph-mon[80326]: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:25:16.643 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:16 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:16.643 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:16 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:16.644 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:16 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:25:17.612 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:17 smithi192 ceph-mon[80326]: pgmap v102: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:17.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:17 smithi003 ceph-mon[108723]: pgmap v102: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:19.367 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:19 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:19.368 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:19 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:19.368 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:19 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:19.368 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:19 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:19.368 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:19 smithi003 ceph-mon[108723]: pgmap v103: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:19.427 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:19 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:19.427 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:19 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:19.427 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:19 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:19.427 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:19 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:19.428 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:19 smithi192 ceph-mon[80326]: pgmap v103: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:21.495 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:21 smithi192 ceph-mon[80326]: pgmap v104: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:21.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:21 smithi003 ceph-mon[108723]: pgmap v104: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:23.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:22 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:23.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:22 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:23.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:22 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:25:23.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:22 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:25:23.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:22 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:23.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:22 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:25:23.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:22 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:25:23.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:22 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:25:23.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:22 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:23.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:22 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.smithi003"} : dispatch 2024-09-21T12:25:23.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:22 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi003"}]': finished 2024-09-21T12:25:23.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:22 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.smithi192"} : dispatch 2024-09-21T12:25:23.259 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:22 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi192"}]': finished 2024-09-21T12:25:23.289 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:22 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:23.290 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:22 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:23.290 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:22 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:25:23.290 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:22 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:25:23.290 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:22 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:23.290 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:22 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:25:23.290 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:22 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:25:23.290 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:22 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:25:23.290 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:22 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:23.290 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:22 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.smithi003"} : dispatch 2024-09-21T12:25:23.290 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:22 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi003"}]': finished 2024-09-21T12:25:23.290 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:22 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config rm", "name": "container_image", "who": "mon.smithi192"} : dispatch 2024-09-21T12:25:23.290 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:22 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi192"}]': finished 2024-09-21T12:25:24.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:23 smithi003 ceph-mon[108723]: Upgrade: Setting container_image for all mon 2024-09-21T12:25:24.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:23 smithi003 ceph-mon[108723]: pgmap v105: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:24.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:23 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:24.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:23 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi003", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-21T12:25:24.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:23 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:25:24.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:23 smithi192 ceph-mon[80326]: Upgrade: Setting container_image for all mon 2024-09-21T12:25:24.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:23 smithi192 ceph-mon[80326]: pgmap v105: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:24.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:23 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:24.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:23 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi003", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-21T12:25:24.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:23 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:25:25.107 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:24 smithi003 ceph-mon[108723]: Upgrade: Updating crash.smithi003 (1/2) 2024-09-21T12:25:25.107 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:24 smithi003 ceph-mon[108723]: Deploying daemon crash.smithi003 on smithi003 2024-09-21T12:25:25.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:24 smithi192 ceph-mon[80326]: Upgrade: Updating crash.smithi003 (1/2) 2024-09-21T12:25:25.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:24 smithi192 ceph-mon[80326]: Deploying daemon crash.smithi003 on smithi003 2024-09-21T12:25:25.986 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:25 smithi003 ceph-mon[108723]: pgmap v106: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:25.988 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:25.983+0000 7f6b8cca2640 1 -- 172.21.15.3:0/1686717462 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6b88074eb0 msgr2=0x7f6b881123d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:25:25.988 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:25.983+0000 7f6b8cca2640 1 --2- 172.21.15.3:0/1686717462 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6b88074eb0 0x7f6b881123d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6b70009880 tx=0x7f6b7002a530 comp rx=0 tx=0).stop 2024-09-21T12:25:25.988 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:25.983+0000 7f6b8cca2640 1 -- 172.21.15.3:0/1686717462 shutdown_connections 2024-09-21T12:25:25.988 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:25.983+0000 7f6b8cca2640 1 --2- 172.21.15.3:0/1686717462 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6b88074eb0 0x7f6b881123d0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:25:25.988 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:25.983+0000 7f6b8cca2640 1 --2- 172.21.15.3:0/1686717462 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b88074590 0x7f6b88074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:25:25.988 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:25.983+0000 7f6b8cca2640 1 -- 172.21.15.3:0/1686717462 >> 172.21.15.3:0/1686717462 conn(0x7f6b880fd600 msgr2=0x7f6b880ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:25:25.988 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:25.983+0000 7f6b8cca2640 1 -- 172.21.15.3:0/1686717462 shutdown_connections 2024-09-21T12:25:25.988 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:25.983+0000 7f6b8cca2640 1 -- 172.21.15.3:0/1686717462 wait complete. 2024-09-21T12:25:25.989 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:25.984+0000 7f6b8cca2640 1 Processor -- start 2024-09-21T12:25:25.989 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:25.984+0000 7f6b8cca2640 1 -- start start 2024-09-21T12:25:25.989 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:25.984+0000 7f6b8cca2640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6b88074590 0x7f6b8819dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:25:25.989 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:25.984+0000 7f6b8cca2640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b88074eb0 0x7f6b8819e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:25:25.989 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:25.984+0000 7f6b8cca2640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f6b881153e0 con 0x7f6b88074590 2024-09-21T12:25:25.989 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:25.984+0000 7f6b8cca2640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6b88115260 con 0x7f6b88074eb0 2024-09-21T12:25:25.989 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:25.985+0000 7f6b8659c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6b88074590 0x7f6b8819dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:25:25.989 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:25.985+0000 7f6b8659c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6b88074590 0x7f6b8819dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56502/0 (socket says 172.21.15.3:56502) 2024-09-21T12:25:25.989 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:25.985+0000 7f6b8659c640 1 -- 172.21.15.3:0/3753853402 learned_addr learned my addr 172.21.15.3:0/3753853402 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:25:25.989 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:25.985+0000 7f6b7ffff640 1 --2- 172.21.15.3:0/3753853402 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b88074eb0 0x7f6b8819e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:25:25.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:25.985+0000 7f6b8659c640 1 -- 172.21.15.3:0/3753853402 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b88074eb0 msgr2=0x7f6b8819e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:25:25.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:25.985+0000 7f6b8659c640 1 --2- 172.21.15.3:0/3753853402 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b88074eb0 0x7f6b8819e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:25:25.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:25.985+0000 7f6b8659c640 1 -- 172.21.15.3:0/3753853402 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b881a28b0 con 0x7f6b88074590 2024-09-21T12:25:25.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:25.985+0000 7f6b8659c640 1 --2- 172.21.15.3:0/3753853402 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6b88074590 0x7f6b8819dfe0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6b7800c8f0 tx=0x7f6b7800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:25:25.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:25.985+0000 7f6b7f7fe640 1 -- 172.21.15.3:0/3753853402 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6b780079b0 con 0x7f6b88074590 2024-09-21T12:25:25.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:25.985+0000 7f6b7f7fe640 1 -- 172.21.15.3:0/3753853402 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6b780054e0 con 0x7f6b88074590 2024-09-21T12:25:25.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:25.985+0000 7f6b8cca2640 1 -- 172.21.15.3:0/3753853402 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b881a2ba0 con 0x7f6b88074590 2024-09-21T12:25:25.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:25.985+0000 7f6b7f7fe640 1 -- 172.21.15.3:0/3753853402 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6b78004dd0 con 0x7f6b88074590 2024-09-21T12:25:25.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:25.986+0000 7f6b8cca2640 1 -- 172.21.15.3:0/3753853402 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b881a3130 con 0x7f6b88074590 2024-09-21T12:25:25.991 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:25.987+0000 7f6b8cca2640 1 -- 172.21.15.3:0/3753853402 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b88075cd0 con 0x7f6b88074590 2024-09-21T12:25:25.991 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:25.987+0000 7f6b7f7fe640 1 -- 172.21.15.3:0/3753853402 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f6b78005020 con 0x7f6b88074590 2024-09-21T12:25:25.991 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:25.988+0000 7f6b7f7fe640 1 --2- 172.21.15.3:0/3753853402 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f6b7407af30 0x7f6b7407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:25:25.991 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:25.988+0000 7f6b7f7fe640 1 -- 172.21.15.3:0/3753853402 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6156+0+0 (secure 0 0 0) 0x7f6b7809de30 con 0x7f6b88074590 2024-09-21T12:25:25.991 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:25.988+0000 7f6b7ffff640 1 --2- 172.21.15.3:0/3753853402 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f6b7407af30 0x7f6b7407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:25:25.992 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:25.988+0000 7f6b7ffff640 1 --2- 172.21.15.3:0/3753853402 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f6b7407af30 0x7f6b7407d3f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6b881047f0 tx=0x7f6b70031400 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:25:25.995 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:25.993+0000 7f6b7f7fe640 1 -- 172.21.15.3:0/3753853402 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6b78014030 con 0x7f6b88074590 2024-09-21T12:25:26.204 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.201+0000 7f6b8cca2640 1 -- 172.21.15.3:0/3753853402 --> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f6b881a3440 con 0x7f6b7407af30 2024-09-21T12:25:26.205 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.202+0000 7f6b7f7fe640 1 -- 172.21.15.3:0/3753853402 <== mgr.14756 v2:172.21.15.3:6800/1284098095 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+385 (secure 0 0 0) 0x7f6b881a3440 con 0x7f6b7407af30 2024-09-21T12:25:26.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.205+0000 7f6b8cca2640 1 -- 172.21.15.3:0/3753853402 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f6b7407af30 msgr2=0x7f6b7407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:25:26.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.205+0000 7f6b8cca2640 1 --2- 172.21.15.3:0/3753853402 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f6b7407af30 0x7f6b7407d3f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6b881047f0 tx=0x7f6b70031400 comp rx=0 tx=0).stop 2024-09-21T12:25:26.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.205+0000 7f6b8cca2640 1 -- 172.21.15.3:0/3753853402 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6b88074590 msgr2=0x7f6b8819dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:25:26.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.205+0000 7f6b8cca2640 1 --2- 172.21.15.3:0/3753853402 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6b88074590 0x7f6b8819dfe0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6b7800c8f0 tx=0x7f6b7800cdb0 comp rx=0 tx=0).stop 2024-09-21T12:25:26.208 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.205+0000 7f6b8cca2640 1 -- 172.21.15.3:0/3753853402 shutdown_connections 2024-09-21T12:25:26.209 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.205+0000 7f6b8cca2640 1 --2- 172.21.15.3:0/3753853402 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f6b7407af30 0x7f6b7407d3f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:25:26.209 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.205+0000 7f6b8cca2640 1 --2- 172.21.15.3:0/3753853402 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b88074eb0 0x7f6b8819e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:25:26.209 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.205+0000 7f6b8cca2640 1 --2- 172.21.15.3:0/3753853402 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6b88074590 0x7f6b8819dfe0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:25:26.209 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.205+0000 7f6b8cca2640 1 -- 172.21.15.3:0/3753853402 >> 172.21.15.3:0/3753853402 conn(0x7f6b880fd600 msgr2=0x7f6b88104f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:25:26.209 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.205+0000 7f6b8cca2640 1 -- 172.21.15.3:0/3753853402 shutdown_connections 2024-09-21T12:25:26.209 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.205+0000 7f6b8cca2640 1 -- 172.21.15.3:0/3753853402 wait complete. 2024-09-21T12:25:26.217 INFO:teuthology.orchestra.run.smithi003.stdout:true 2024-09-21T12:25:26.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:25 smithi192 ceph-mon[80326]: pgmap v106: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:26.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.311+0000 7ff34a817640 1 -- 172.21.15.3:0/2837892198 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff3441033d0 msgr2=0x7ff34410b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:25:26.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.311+0000 7ff34a817640 1 --2- 172.21.15.3:0/2837892198 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff3441033d0 0x7ff34410b8c0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7ff338009880 tx=0x7ff33802a540 comp rx=0 tx=0).stop 2024-09-21T12:25:26.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.311+0000 7ff34a817640 1 -- 172.21.15.3:0/2837892198 shutdown_connections 2024-09-21T12:25:26.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.311+0000 7ff34a817640 1 --2- 172.21.15.3:0/2837892198 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff3441033d0 0x7ff34410b8c0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:25:26.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.311+0000 7ff34a817640 1 --2- 172.21.15.3:0/2837892198 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff344102ab0 0x7ff344102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:25:26.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.311+0000 7ff34a817640 1 -- 172.21.15.3:0/2837892198 >> 172.21.15.3:0/2837892198 conn(0x7ff3440fc550 msgr2=0x7ff3440fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:25:26.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.311+0000 7ff34a817640 1 -- 172.21.15.3:0/2837892198 shutdown_connections 2024-09-21T12:25:26.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.311+0000 7ff34a817640 1 -- 172.21.15.3:0/2837892198 wait complete. 2024-09-21T12:25:26.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.312+0000 7ff34a817640 1 Processor -- start 2024-09-21T12:25:26.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.312+0000 7ff34a817640 1 -- start start 2024-09-21T12:25:26.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.312+0000 7ff34a817640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff344102ab0 0x7ff34419f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:25:26.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.312+0000 7ff34a817640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff3441033d0 0x7ff34419fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:25:26.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.312+0000 7ff34a817640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7ff34410edc0 con 0x7ff3441033d0 2024-09-21T12:25:26.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.312+0000 7ff34a817640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff34410ec40 con 0x7ff344102ab0 2024-09-21T12:25:26.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.312+0000 7ff3437fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff3441033d0 0x7ff34419fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:25:26.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.312+0000 7ff3437fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff3441033d0 0x7ff34419fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56518/0 (socket says 172.21.15.3:56518) 2024-09-21T12:25:26.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.312+0000 7ff3437fe640 1 -- 172.21.15.3:0/3344270202 learned_addr learned my addr 172.21.15.3:0/3344270202 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:25:26.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.313+0000 7ff3437fe640 1 -- 172.21.15.3:0/3344270202 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff344102ab0 msgr2=0x7ff34419f800 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-21T12:25:26.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.313+0000 7ff3437fe640 1 --2- 172.21.15.3:0/3344270202 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff344102ab0 0x7ff34419f800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:25:26.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.313+0000 7ff3437fe640 1 -- 172.21.15.3:0/3344270202 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3441a03f0 con 0x7ff3441033d0 2024-09-21T12:25:26.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.313+0000 7ff3437fe640 1 --2- 172.21.15.3:0/3344270202 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff3441033d0 0x7ff34419fd40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff338031460 tx=0x7ff3380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:25:26.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.313+0000 7ff3417fa640 1 -- 172.21.15.3:0/3344270202 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff33803f070 con 0x7ff3441033d0 2024-09-21T12:25:26.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.313+0000 7ff3417fa640 1 -- 172.21.15.3:0/3344270202 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff338004ac0 con 0x7ff3441033d0 2024-09-21T12:25:26.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.313+0000 7ff34a817640 1 -- 172.21.15.3:0/3344270202 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff344199a80 con 0x7ff3441033d0 2024-09-21T12:25:26.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.313+0000 7ff3417fa640 1 -- 172.21.15.3:0/3344270202 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff338035030 con 0x7ff3441033d0 2024-09-21T12:25:26.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.313+0000 7ff34a817640 1 -- 172.21.15.3:0/3344270202 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff344199f80 con 0x7ff3441033d0 2024-09-21T12:25:26.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.314+0000 7ff34a817640 1 -- 172.21.15.3:0/3344270202 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff34406a580 con 0x7ff3441033d0 2024-09-21T12:25:26.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.315+0000 7ff3417fa640 1 -- 172.21.15.3:0/3344270202 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7ff338042070 con 0x7ff3441033d0 2024-09-21T12:25:26.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.316+0000 7ff3417fa640 1 --2- 172.21.15.3:0/3344270202 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7ff32c07af80 0x7ff32c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:25:26.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.316+0000 7ff3417fa640 1 -- 172.21.15.3:0/3344270202 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6156+0+0 (secure 0 0 0) 0x7ff3380be960 con 0x7ff3441033d0 2024-09-21T12:25:26.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.316+0000 7ff343fff640 1 --2- 172.21.15.3:0/3344270202 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7ff32c07af80 0x7ff32c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:25:26.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.316+0000 7ff343fff640 1 --2- 172.21.15.3:0/3344270202 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7ff32c07af80 0x7ff32c07d440 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff34419ab00 tx=0x7ff334005c00 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:25:26.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.321+0000 7ff3417fa640 1 -- 172.21.15.3:0/3344270202 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff338089fe0 con 0x7ff3441033d0 2024-09-21T12:25:26.548 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.546+0000 7ff34a817640 1 -- 172.21.15.3:0/3344270202 --> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7ff34419aff0 con 0x7ff32c07af80 2024-09-21T12:25:26.549 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.547+0000 7ff3417fa640 1 -- 172.21.15.3:0/3344270202 <== mgr.14756 v2:172.21.15.3:6800/1284098095 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+385 (secure 0 0 0) 0x7ff33400a520 con 0x7ff32c07af80 2024-09-21T12:25:26.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.549+0000 7ff34a817640 1 -- 172.21.15.3:0/3344270202 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7ff32c07af80 msgr2=0x7ff32c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:25:26.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.549+0000 7ff34a817640 1 --2- 172.21.15.3:0/3344270202 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7ff32c07af80 0x7ff32c07d440 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff34419ab00 tx=0x7ff334005c00 comp rx=0 tx=0).stop 2024-09-21T12:25:26.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.549+0000 7ff34a817640 1 -- 172.21.15.3:0/3344270202 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff3441033d0 msgr2=0x7ff34419fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:25:26.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.549+0000 7ff34a817640 1 --2- 172.21.15.3:0/3344270202 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff3441033d0 0x7ff34419fd40 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff338031460 tx=0x7ff3380046c0 comp rx=0 tx=0).stop 2024-09-21T12:25:26.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.549+0000 7ff34a817640 1 -- 172.21.15.3:0/3344270202 shutdown_connections 2024-09-21T12:25:26.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.549+0000 7ff34a817640 1 --2- 172.21.15.3:0/3344270202 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7ff32c07af80 0x7ff32c07d440 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:25:26.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.549+0000 7ff34a817640 1 --2- 172.21.15.3:0/3344270202 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff3441033d0 0x7ff34419fd40 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:25:26.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.549+0000 7ff34a817640 1 --2- 172.21.15.3:0/3344270202 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff344102ab0 0x7ff34419f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:25:26.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.549+0000 7ff34a817640 1 -- 172.21.15.3:0/3344270202 >> 172.21.15.3:0/3344270202 conn(0x7ff3440fc550 msgr2=0x7ff344100b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:25:26.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.549+0000 7ff34a817640 1 -- 172.21.15.3:0/3344270202 shutdown_connections 2024-09-21T12:25:26.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.549+0000 7ff34a817640 1 -- 172.21.15.3:0/3344270202 wait complete. 2024-09-21T12:25:26.637 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.634+0000 7f2d0db32640 1 -- 172.21.15.3:0/3606037830 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2d081033d0 msgr2=0x7f2d0810b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:25:26.637 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.634+0000 7f2d0db32640 1 --2- 172.21.15.3:0/3606037830 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2d081033d0 0x7f2d0810b8c0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f2cf0009880 tx=0x7f2cf002a530 comp rx=0 tx=0).stop 2024-09-21T12:25:26.637 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.635+0000 7f2d0db32640 1 -- 172.21.15.3:0/3606037830 shutdown_connections 2024-09-21T12:25:26.637 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.635+0000 7f2d0db32640 1 --2- 172.21.15.3:0/3606037830 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2d081033d0 0x7f2d0810b8c0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:25:26.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.635+0000 7f2d0db32640 1 --2- 172.21.15.3:0/3606037830 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d08102ab0 0x7f2d08102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:25:26.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.635+0000 7f2d0db32640 1 -- 172.21.15.3:0/3606037830 >> 172.21.15.3:0/3606037830 conn(0x7f2d080fc550 msgr2=0x7f2d080fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:25:26.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.635+0000 7f2d0db32640 1 -- 172.21.15.3:0/3606037830 shutdown_connections 2024-09-21T12:25:26.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.635+0000 7f2d0db32640 1 -- 172.21.15.3:0/3606037830 wait complete. 2024-09-21T12:25:26.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.635+0000 7f2d0db32640 1 Processor -- start 2024-09-21T12:25:26.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.635+0000 7f2d0db32640 1 -- start start 2024-09-21T12:25:26.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.636+0000 7f2d0db32640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d08102ab0 0x7f2d0819d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:25:26.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.636+0000 7f2d0db32640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2d081033d0 0x7f2d0819dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:25:26.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.636+0000 7f2d0db32640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f2d0810ee40 con 0x7f2d081033d0 2024-09-21T12:25:26.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.636+0000 7f2d0db32640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2d0810ecc0 con 0x7f2d08102ab0 2024-09-21T12:25:26.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.636+0000 7f2cfeffd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2d081033d0 0x7f2d0819dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:25:26.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.636+0000 7f2cfeffd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2d081033d0 0x7f2d0819dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56542/0 (socket says 172.21.15.3:56542) 2024-09-21T12:25:26.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.636+0000 7f2cfeffd640 1 -- 172.21.15.3:0/2400484054 learned_addr learned my addr 172.21.15.3:0/2400484054 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:25:26.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.636+0000 7f2d077fe640 1 --2- 172.21.15.3:0/2400484054 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d08102ab0 0x7f2d0819d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:25:26.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.636+0000 7f2cfeffd640 1 -- 172.21.15.3:0/2400484054 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d08102ab0 msgr2=0x7f2d0819d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:25:26.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.636+0000 7f2cfeffd640 1 --2- 172.21.15.3:0/2400484054 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d08102ab0 0x7f2d0819d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:25:26.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.636+0000 7f2cfeffd640 1 -- 172.21.15.3:0/2400484054 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d08197830 con 0x7f2d081033d0 2024-09-21T12:25:26.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.636+0000 7f2cfeffd640 1 --2- 172.21.15.3:0/2400484054 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2d081033d0 0x7f2d0819dbf0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2cf0031460 tx=0x7f2cf00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:25:26.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.636+0000 7f2d057fa640 1 -- 172.21.15.3:0/2400484054 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2cf003f070 con 0x7f2d081033d0 2024-09-21T12:25:26.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.636+0000 7f2d057fa640 1 -- 172.21.15.3:0/2400484054 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2cf0004ac0 con 0x7f2d081033d0 2024-09-21T12:25:26.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.637+0000 7f2d0db32640 1 -- 172.21.15.3:0/2400484054 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d08197ac0 con 0x7f2d081033d0 2024-09-21T12:25:26.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.637+0000 7f2d057fa640 1 -- 172.21.15.3:0/2400484054 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2cf0035030 con 0x7f2d081033d0 2024-09-21T12:25:26.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.637+0000 7f2d0db32640 1 -- 172.21.15.3:0/2400484054 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d08197ff0 con 0x7f2d081033d0 2024-09-21T12:25:26.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.638+0000 7f2d0db32640 1 -- 172.21.15.3:0/2400484054 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d0806a580 con 0x7f2d081033d0 2024-09-21T12:25:26.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.638+0000 7f2d057fa640 1 -- 172.21.15.3:0/2400484054 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f2cf0042070 con 0x7f2d081033d0 2024-09-21T12:25:26.642 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.639+0000 7f2d057fa640 1 --2- 172.21.15.3:0/2400484054 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f2cf407af40 0x7f2cf407d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:25:26.642 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.639+0000 7f2d057fa640 1 -- 172.21.15.3:0/2400484054 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6156+0+0 (secure 0 0 0) 0x7f2cf00bead0 con 0x7f2d081033d0 2024-09-21T12:25:26.642 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.639+0000 7f2d077fe640 1 --2- 172.21.15.3:0/2400484054 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f2cf407af40 0x7f2cf407d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:25:26.642 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.639+0000 7f2d077fe640 1 --2- 172.21.15.3:0/2400484054 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f2cf407af40 0x7f2cf407d400 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2cf8009890 tx=0x7f2cf8008040 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:25:26.645 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.643+0000 7f2d057fa640 1 -- 172.21.15.3:0/2400484054 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2cf008a0d0 con 0x7f2d081033d0 2024-09-21T12:25:26.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.844+0000 7f2d0db32640 1 -- 172.21.15.3:0/2400484054 --> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f2d08198360 con 0x7f2cf407af40 2024-09-21T12:25:26.856 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.853+0000 7f2d057fa640 1 -- 172.21.15.3:0/2400484054 <== mgr.14756 v2:172.21.15.3:6800/1284098095 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f2d08198360 con 0x7f2cf407af40 2024-09-21T12:25:26.856 INFO:teuthology.orchestra.run.smithi003.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:25:26.856 INFO:teuthology.orchestra.run.smithi003.stdout:alertmanager.smithi003 smithi003 *:9093,9094 running (114s) 20s ago 13m 19.0M - 0.27.0 11f11916f8cd 14880018dfd3 2024-09-21T12:25:26.856 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-exporter.smithi003 smithi003 running (4m) 20s ago 13m 8644k - 19.1.1-373-g4e45e6b4 164465d2334a 0c9ad60a4f5a 2024-09-21T12:25:26.856 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-exporter.smithi192 smithi192 running (4m) 8s ago 12m 8316k - 19.1.1-373-g4e45e6b4 164465d2334a d5be8a6e120f 2024-09-21T12:25:26.856 INFO:teuthology.orchestra.run.smithi003.stdout:crash.smithi003 smithi003 running (13m) 20s ago 13m 6899k - 19.1.1-373-g4e45e6b4 164465d2334a c63f209dc1dc 2024-09-21T12:25:26.856 INFO:teuthology.orchestra.run.smithi003.stdout:crash.smithi192 smithi192 running (12m) 8s ago 12m 6895k - 19.1.1-373-g4e45e6b4 164465d2334a cc70c9a7b2f7 2024-09-21T12:25:26.856 INFO:teuthology.orchestra.run.smithi003.stdout:grafana.smithi003 smithi003 *:3000 running (89s) 20s ago 12m 71.0M - 10.4.8 5aad1d7cf004 19e26b3cb585 2024-09-21T12:25:26.856 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi003.ebjgyl smithi003 running (7m) 20s ago 7m 15.9M - 19.1.1-373-g4e45e6b4 164465d2334a 16e0b2cac16a 2024-09-21T12:25:26.856 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi003.gfkngj smithi003 running (7m) 20s ago 7m 144M - 19.1.1-373-g4e45e6b4 164465d2334a 109c04f87fbd 2024-09-21T12:25:26.857 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi192.ktdqns smithi192 running (7m) 8s ago 7m 18.1M - 19.1.1-373-g4e45e6b4 164465d2334a 495c73fb3bb0 2024-09-21T12:25:26.857 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi192.ywqqxe smithi192 running (7m) 8s ago 7m 18.1M - 19.1.1-373-g4e45e6b4 164465d2334a 270a01030cbe 2024-09-21T12:25:26.857 INFO:teuthology.orchestra.run.smithi003.stdout:mgr.smithi003.wztftl smithi003 *:8443,9283,8765 running (3m) 20s ago 14m 521M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 8ce0e66fd369 2024-09-21T12:25:26.857 INFO:teuthology.orchestra.run.smithi003.stdout:mgr.smithi192.qsaprd smithi192 *:8443,9283,8765 running (2m) 8s ago 12m 457M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 002a6171dd47 2024-09-21T12:25:26.857 INFO:teuthology.orchestra.run.smithi003.stdout:mon.smithi003 smithi003 running (27s) 20s ago 14m 22.1M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 4f2b2b2daf19 2024-09-21T12:25:26.857 INFO:teuthology.orchestra.run.smithi003.stdout:mon.smithi192 smithi192 running (12s) 8s ago 12m 21.1M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 11edc5c1baba 2024-09-21T12:25:26.857 INFO:teuthology.orchestra.run.smithi003.stdout:node-exporter.smithi003 smithi003 *:9100 running (2m) 20s ago 13m 9.98M - 1.7.0 72c9c2088986 d9cb7ede9060 2024-09-21T12:25:26.857 INFO:teuthology.orchestra.run.smithi003.stdout:node-exporter.smithi192 smithi192 *:9100 running (2m) 8s ago 12m 12.3M - 1.7.0 72c9c2088986 d8ec0acfce7e 2024-09-21T12:25:26.857 INFO:teuthology.orchestra.run.smithi003.stdout:osd.0 smithi003 running (11m) 20s ago 11m 202M 1217M 19.1.1-373-g4e45e6b4 164465d2334a d07f1489720d 2024-09-21T12:25:26.857 INFO:teuthology.orchestra.run.smithi003.stdout:osd.1 smithi003 running (10m) 20s ago 10m 211M 1217M 19.1.1-373-g4e45e6b4 164465d2334a 6abd75a07645 2024-09-21T12:25:26.857 INFO:teuthology.orchestra.run.smithi003.stdout:osd.2 smithi003 running (10m) 20s ago 10m 174M 1217M 19.1.1-373-g4e45e6b4 164465d2334a 3265369e573b 2024-09-21T12:25:26.857 INFO:teuthology.orchestra.run.smithi003.stdout:osd.3 smithi192 running (9m) 8s ago 9m 240M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 13efcfd71c05 2024-09-21T12:25:26.858 INFO:teuthology.orchestra.run.smithi003.stdout:osd.4 smithi192 running (9m) 8s ago 9m 204M 2240M 19.1.1-373-g4e45e6b4 164465d2334a f33bf453cb3e 2024-09-21T12:25:26.858 INFO:teuthology.orchestra.run.smithi003.stdout:osd.5 smithi192 running (8m) 8s ago 8m 183M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 12d7b7c8e985 2024-09-21T12:25:26.858 INFO:teuthology.orchestra.run.smithi003.stdout:prometheus.smithi003 smithi003 *:9095 running (2m) 20s ago 12m 48.0M - 2.51.0 1d3b7f56885b 64997a33fbbb 2024-09-21T12:25:26.858 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.855+0000 7f2d0db32640 1 -- 172.21.15.3:0/2400484054 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f2cf407af40 msgr2=0x7f2cf407d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:25:26.858 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.855+0000 7f2d0db32640 1 --2- 172.21.15.3:0/2400484054 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f2cf407af40 0x7f2cf407d400 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f2cf8009890 tx=0x7f2cf8008040 comp rx=0 tx=0).stop 2024-09-21T12:25:26.859 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.855+0000 7f2d0db32640 1 -- 172.21.15.3:0/2400484054 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2d081033d0 msgr2=0x7f2d0819dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:25:26.859 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.855+0000 7f2d0db32640 1 --2- 172.21.15.3:0/2400484054 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2d081033d0 0x7f2d0819dbf0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f2cf0031460 tx=0x7f2cf00046c0 comp rx=0 tx=0).stop 2024-09-21T12:25:26.859 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.856+0000 7f2d0db32640 1 -- 172.21.15.3:0/2400484054 shutdown_connections 2024-09-21T12:25:26.859 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.856+0000 7f2d0db32640 1 --2- 172.21.15.3:0/2400484054 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f2cf407af40 0x7f2cf407d400 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:25:26.859 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.856+0000 7f2d0db32640 1 --2- 172.21.15.3:0/2400484054 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2d081033d0 0x7f2d0819dbf0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:25:26.859 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.856+0000 7f2d0db32640 1 --2- 172.21.15.3:0/2400484054 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2d08102ab0 0x7f2d0819d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:25:26.859 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.856+0000 7f2d0db32640 1 -- 172.21.15.3:0/2400484054 >> 172.21.15.3:0/2400484054 conn(0x7f2d080fc550 msgr2=0x7f2d08108e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:25:26.859 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.856+0000 7f2d0db32640 1 -- 172.21.15.3:0/2400484054 shutdown_connections 2024-09-21T12:25:26.859 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.856+0000 7f2d0db32640 1 -- 172.21.15.3:0/2400484054 wait complete. 2024-09-21T12:25:26.945 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.942+0000 7f7b6d3cd640 1 -- 172.21.15.3:0/3089989213 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7b681067f0 msgr2=0x7f7b68106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:25:26.945 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.942+0000 7f7b6d3cd640 1 --2- 172.21.15.3:0/3089989213 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7b681067f0 0x7f7b68106bd0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7b58009880 tx=0x7f7b5802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:25:26.945 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.942+0000 7f7b6d3cd640 1 -- 172.21.15.3:0/3089989213 shutdown_connections 2024-09-21T12:25:26.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.942+0000 7f7b6d3cd640 1 --2- 172.21.15.3:0/3089989213 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7b681007f0 0x7f7b68100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:25:26.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.942+0000 7f7b6d3cd640 1 --2- 172.21.15.3:0/3089989213 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7b681067f0 0x7f7b68106bd0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:25:26.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.942+0000 7f7b6d3cd640 1 -- 172.21.15.3:0/3089989213 >> 172.21.15.3:0/3089989213 conn(0x7f7b680fc550 msgr2=0x7f7b680fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:25:26.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.942+0000 7f7b6d3cd640 1 -- 172.21.15.3:0/3089989213 shutdown_connections 2024-09-21T12:25:26.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.942+0000 7f7b6d3cd640 1 -- 172.21.15.3:0/3089989213 wait complete. 2024-09-21T12:25:26.946 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.943+0000 7f7b6d3cd640 1 Processor -- start 2024-09-21T12:25:26.948 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.943+0000 7f7b6d3cd640 1 -- start start 2024-09-21T12:25:26.948 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.943+0000 7f7b6d3cd640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7b681007f0 0x7f7b681988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:25:26.948 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.943+0000 7f7b6d3cd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7b681067f0 0x7f7b68198e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:25:26.948 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.943+0000 7f7b6d3cd640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f7b6810dca0 con 0x7f7b681067f0 2024-09-21T12:25:26.948 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.943+0000 7f7b6d3cd640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7b6810db20 con 0x7f7b681007f0 2024-09-21T12:25:26.948 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.944+0000 7f7b667fc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7b681067f0 0x7f7b68198e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:25:26.948 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.944+0000 7f7b667fc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7b681067f0 0x7f7b68198e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56566/0 (socket says 172.21.15.3:56566) 2024-09-21T12:25:26.948 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.944+0000 7f7b667fc640 1 -- 172.21.15.3:0/3438607061 learned_addr learned my addr 172.21.15.3:0/3438607061 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:25:26.948 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.944+0000 7f7b66ffd640 1 --2- 172.21.15.3:0/3438607061 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7b681007f0 0x7f7b681988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:25:26.948 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.944+0000 7f7b667fc640 1 -- 172.21.15.3:0/3438607061 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7b681007f0 msgr2=0x7f7b681988d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:25:26.948 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.944+0000 7f7b667fc640 1 --2- 172.21.15.3:0/3438607061 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7b681007f0 0x7f7b681988d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:25:26.948 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.944+0000 7f7b667fc640 1 -- 172.21.15.3:0/3438607061 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b68199410 con 0x7f7b681067f0 2024-09-21T12:25:26.949 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.944+0000 7f7b667fc640 1 --2- 172.21.15.3:0/3438607061 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7b681067f0 0x7f7b68198e10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c00d8d0 tx=0x7f7b5c00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:25:26.949 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.944+0000 7f7b4ffff640 1 -- 172.21.15.3:0/3438607061 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7b5c017070 con 0x7f7b681067f0 2024-09-21T12:25:26.949 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.944+0000 7f7b4ffff640 1 -- 172.21.15.3:0/3438607061 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7b5c010460 con 0x7f7b681067f0 2024-09-21T12:25:26.949 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.944+0000 7f7b4ffff640 1 -- 172.21.15.3:0/3438607061 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7b5c00f5f0 con 0x7f7b681067f0 2024-09-21T12:25:26.949 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.944+0000 7f7b6d3cd640 1 -- 172.21.15.3:0/3438607061 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b68199700 con 0x7f7b681067f0 2024-09-21T12:25:26.949 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.945+0000 7f7b6d3cd640 1 -- 172.21.15.3:0/3438607061 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b681a1d00 con 0x7f7b681067f0 2024-09-21T12:25:26.950 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.946+0000 7f7b6d3cd640 1 -- 172.21.15.3:0/3438607061 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b68101f30 con 0x7f7b681067f0 2024-09-21T12:25:26.950 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.946+0000 7f7b4ffff640 1 -- 172.21.15.3:0/3438607061 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f7b5c009a30 con 0x7f7b681067f0 2024-09-21T12:25:26.950 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.947+0000 7f7b4ffff640 1 --2- 172.21.15.3:0/3438607061 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f7b5007af40 0x7f7b5007d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:25:26.950 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.947+0000 7f7b4ffff640 1 -- 172.21.15.3:0/3438607061 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6156+0+0 (secure 0 0 0) 0x7f7b5c09de30 con 0x7f7b681067f0 2024-09-21T12:25:26.950 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.947+0000 7f7b66ffd640 1 --2- 172.21.15.3:0/3438607061 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f7b5007af40 0x7f7b5007d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:25:26.950 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.948+0000 7f7b66ffd640 1 --2- 172.21.15.3:0/3438607061 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f7b5007af40 0x7f7b5007d400 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7b580096c0 tx=0x7f7b58031400 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:25:26.954 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:26.952+0000 7f7b4ffff640 1 -- 172.21.15.3:0/3438607061 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7b68199700 con 0x7f7b681067f0 2024-09-21T12:25:27.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.236+0000 7f7b6d3cd640 1 -- 172.21.15.3:0/3438607061 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f7b6806a2c0 con 0x7f7b681067f0 2024-09-21T12:25:27.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.237+0000 7f7b4ffff640 1 -- 172.21.15.3:0/3438607061 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+733 (secure 0 0 0) 0x7f7b6806a2c0 con 0x7f7b681067f0 2024-09-21T12:25:27.240 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-21T12:25:27.240 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": { 2024-09-21T12:25:27.240 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:25:27.240 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:25:27.240 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": { 2024-09-21T12:25:27.240 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:25:27.240 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:25:27.240 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": { 2024-09-21T12:25:27.240 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 6 2024-09-21T12:25:27.240 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:25:27.241 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": { 2024-09-21T12:25:27.241 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 4 2024-09-21T12:25:27.241 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:25:27.241 INFO:teuthology.orchestra.run.smithi003.stdout: "overall": { 2024-09-21T12:25:27.241 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 10, 2024-09-21T12:25:27.241 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 4 2024-09-21T12:25:27.241 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-21T12:25:27.241 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-21T12:25:27.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.239+0000 7f7b6d3cd640 1 -- 172.21.15.3:0/3438607061 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f7b5007af40 msgr2=0x7f7b5007d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:25:27.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.239+0000 7f7b6d3cd640 1 --2- 172.21.15.3:0/3438607061 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f7b5007af40 0x7f7b5007d400 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f7b580096c0 tx=0x7f7b58031400 comp rx=0 tx=0).stop 2024-09-21T12:25:27.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.239+0000 7f7b6d3cd640 1 -- 172.21.15.3:0/3438607061 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7b681067f0 msgr2=0x7f7b68198e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:25:27.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.239+0000 7f7b6d3cd640 1 --2- 172.21.15.3:0/3438607061 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7b681067f0 0x7f7b68198e10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c00d8d0 tx=0x7f7b5c00dd90 comp rx=0 tx=0).stop 2024-09-21T12:25:27.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.239+0000 7f7b6d3cd640 1 -- 172.21.15.3:0/3438607061 shutdown_connections 2024-09-21T12:25:27.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.239+0000 7f7b6d3cd640 1 --2- 172.21.15.3:0/3438607061 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f7b5007af40 0x7f7b5007d400 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:25:27.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.239+0000 7f7b6d3cd640 1 --2- 172.21.15.3:0/3438607061 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7b681067f0 0x7f7b68198e10 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:25:27.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.239+0000 7f7b6d3cd640 1 --2- 172.21.15.3:0/3438607061 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7b681007f0 0x7f7b681988d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:25:27.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.239+0000 7f7b6d3cd640 1 -- 172.21.15.3:0/3438607061 >> 172.21.15.3:0/3438607061 conn(0x7f7b680fc550 msgr2=0x7f7b680fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:25:27.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.239+0000 7f7b6d3cd640 1 -- 172.21.15.3:0/3438607061 shutdown_connections 2024-09-21T12:25:27.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.239+0000 7f7b6d3cd640 1 -- 172.21.15.3:0/3438607061 wait complete. 2024-09-21T12:25:27.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.323+0000 7fce8e276640 1 -- 172.21.15.3:0/1550095956 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fce88100800 msgr2=0x7fce88100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:25:27.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.323+0000 7fce8e276640 1 --2- 172.21.15.3:0/1550095956 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fce88100800 0x7fce88100c60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fce7c009880 tx=0x7fce7c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:25:27.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.323+0000 7fce8e276640 1 -- 172.21.15.3:0/1550095956 shutdown_connections 2024-09-21T12:25:27.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.323+0000 7fce8e276640 1 --2- 172.21.15.3:0/1550095956 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fce88100800 0x7fce88100c60 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:25:27.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.323+0000 7fce8e276640 1 --2- 172.21.15.3:0/1550095956 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce88106800 0x7fce88106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:25:27.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.323+0000 7fce8e276640 1 -- 172.21.15.3:0/1550095956 >> 172.21.15.3:0/1550095956 conn(0x7fce880fc520 msgr2=0x7fce880fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:25:27.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.323+0000 7fce8e276640 1 -- 172.21.15.3:0/1550095956 shutdown_connections 2024-09-21T12:25:27.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.323+0000 7fce8e276640 1 -- 172.21.15.3:0/1550095956 wait complete. 2024-09-21T12:25:27.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.324+0000 7fce8e276640 1 Processor -- start 2024-09-21T12:25:27.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.324+0000 7fce8e276640 1 -- start start 2024-09-21T12:25:27.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.324+0000 7fce8e276640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fce88100800 0x7fce8810d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:25:27.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.324+0000 7fce8e276640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce88106800 0x7fce8810db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:25:27.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.324+0000 7fce8e276640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fce8806a8e0 con 0x7fce88100800 2024-09-21T12:25:27.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.324+0000 7fce8e276640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fce8806a760 con 0x7fce88106800 2024-09-21T12:25:27.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.324+0000 7fce87fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fce88100800 0x7fce8810d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:25:27.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.324+0000 7fce87fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fce88100800 0x7fce8810d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56598/0 (socket says 172.21.15.3:56598) 2024-09-21T12:25:27.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.324+0000 7fce87fff640 1 -- 172.21.15.3:0/1477734058 learned_addr learned my addr 172.21.15.3:0/1477734058 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:25:27.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.324+0000 7fce877fe640 1 --2- 172.21.15.3:0/1477734058 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce88106800 0x7fce8810db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:25:27.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.325+0000 7fce87fff640 1 -- 172.21.15.3:0/1477734058 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce88106800 msgr2=0x7fce8810db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:25:27.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.325+0000 7fce87fff640 1 --2- 172.21.15.3:0/1477734058 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce88106800 0x7fce8810db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:25:27.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.325+0000 7fce87fff640 1 -- 172.21.15.3:0/1477734058 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce8810e0d0 con 0x7fce88100800 2024-09-21T12:25:27.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.325+0000 7fce87fff640 1 --2- 172.21.15.3:0/1477734058 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fce88100800 0x7fce8810d650 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fce7800d8d0 tx=0x7fce7800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:25:27.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.325+0000 7fce857fa640 1 -- 172.21.15.3:0/1477734058 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fce78017030 con 0x7fce88100800 2024-09-21T12:25:27.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.325+0000 7fce8e276640 1 -- 172.21.15.3:0/1477734058 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce8810e3c0 con 0x7fce88100800 2024-09-21T12:25:27.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.325+0000 7fce857fa640 1 -- 172.21.15.3:0/1477734058 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fce78004020 con 0x7fce88100800 2024-09-21T12:25:27.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.325+0000 7fce857fa640 1 -- 172.21.15.3:0/1477734058 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fce780047a0 con 0x7fce88100800 2024-09-21T12:25:27.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.325+0000 7fce8e276640 1 -- 172.21.15.3:0/1477734058 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce881a3e60 con 0x7fce88100800 2024-09-21T12:25:27.331 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.326+0000 7fce8e276640 1 -- 172.21.15.3:0/1477734058 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce88101f40 con 0x7fce88100800 2024-09-21T12:25:27.331 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.327+0000 7fce857fa640 1 -- 172.21.15.3:0/1477734058 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7fce780041d0 con 0x7fce88100800 2024-09-21T12:25:27.331 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.327+0000 7fce857fa640 1 --2- 172.21.15.3:0/1477734058 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fce7007af30 0x7fce7007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:25:27.331 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.328+0000 7fce857fa640 1 -- 172.21.15.3:0/1477734058 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6156+0+0 (secure 0 0 0) 0x7fce78018070 con 0x7fce88100800 2024-09-21T12:25:27.331 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.328+0000 7fce877fe640 1 --2- 172.21.15.3:0/1477734058 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fce7007af30 0x7fce7007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:25:27.331 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.328+0000 7fce877fe640 1 --2- 172.21.15.3:0/1477734058 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fce7007af30 0x7fce7007d3f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fce8810f0e0 tx=0x7fce7c031400 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:25:27.334 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.332+0000 7fce857fa640 1 -- 172.21.15.3:0/1477734058 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fce780a4080 con 0x7fce88100800 2024-09-21T12:25:27.562 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.560+0000 7fce8e276640 1 -- 172.21.15.3:0/1477734058 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fce881a4180 con 0x7fce88100800 2024-09-21T12:25:27.563 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.560+0000 7fce857fa640 1 -- 172.21.15.3:0/1477734058 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) ==== 76+0+2010 (secure 0 0 0) 0x7fce780693b0 con 0x7fce88100800 2024-09-21T12:25:27.563 INFO:teuthology.orchestra.run.smithi003.stdout:e14 2024-09-21T12:25:27.563 INFO:teuthology.orchestra.run.smithi003.stdout:btime 2024-09-21T12:17:55:592931+0000 2024-09-21T12:25:27.563 INFO:teuthology.orchestra.run.smithi003.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T12:25:27.563 INFO:teuthology.orchestra.run.smithi003.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:25:27.564 INFO:teuthology.orchestra.run.smithi003.stdout:legacy client fscid: 1 2024-09-21T12:25:27.564 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:25:27.564 INFO:teuthology.orchestra.run.smithi003.stdout:Filesystem 'cephfs' (1) 2024-09-21T12:25:27.564 INFO:teuthology.orchestra.run.smithi003.stdout:fs_name cephfs 2024-09-21T12:25:27.564 INFO:teuthology.orchestra.run.smithi003.stdout:epoch 14 2024-09-21T12:25:27.564 INFO:teuthology.orchestra.run.smithi003.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T12:25:27.564 INFO:teuthology.orchestra.run.smithi003.stdout:created 2024-09-21T12:17:38.260099+0000 2024-09-21T12:25:27.564 INFO:teuthology.orchestra.run.smithi003.stdout:modified 2024-09-21T12:17:55.592927+0000 2024-09-21T12:25:27.564 INFO:teuthology.orchestra.run.smithi003.stdout:tableserver 0 2024-09-21T12:25:27.564 INFO:teuthology.orchestra.run.smithi003.stdout:root 0 2024-09-21T12:25:27.564 INFO:teuthology.orchestra.run.smithi003.stdout:session_timeout 60 2024-09-21T12:25:27.564 INFO:teuthology.orchestra.run.smithi003.stdout:session_autoclose 300 2024-09-21T12:25:27.564 INFO:teuthology.orchestra.run.smithi003.stdout:max_file_size 1099511627776 2024-09-21T12:25:27.564 INFO:teuthology.orchestra.run.smithi003.stdout:max_xattr_size 65536 2024-09-21T12:25:27.564 INFO:teuthology.orchestra.run.smithi003.stdout:required_client_features {} 2024-09-21T12:25:27.564 INFO:teuthology.orchestra.run.smithi003.stdout:last_failure 0 2024-09-21T12:25:27.565 INFO:teuthology.orchestra.run.smithi003.stdout:last_failure_osd_epoch 46 2024-09-21T12:25:27.565 INFO:teuthology.orchestra.run.smithi003.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:25:27.565 INFO:teuthology.orchestra.run.smithi003.stdout:max_mds 1 2024-09-21T12:25:27.565 INFO:teuthology.orchestra.run.smithi003.stdout:in 0 2024-09-21T12:25:27.565 INFO:teuthology.orchestra.run.smithi003.stdout:up {0=14564} 2024-09-21T12:25:27.565 INFO:teuthology.orchestra.run.smithi003.stdout:failed 2024-09-21T12:25:27.565 INFO:teuthology.orchestra.run.smithi003.stdout:damaged 2024-09-21T12:25:27.565 INFO:teuthology.orchestra.run.smithi003.stdout:stopped 2024-09-21T12:25:27.565 INFO:teuthology.orchestra.run.smithi003.stdout:data_pools [3] 2024-09-21T12:25:27.565 INFO:teuthology.orchestra.run.smithi003.stdout:metadata_pool 2 2024-09-21T12:25:27.565 INFO:teuthology.orchestra.run.smithi003.stdout:inline_data enabled 2024-09-21T12:25:27.565 INFO:teuthology.orchestra.run.smithi003.stdout:balancer 2024-09-21T12:25:27.565 INFO:teuthology.orchestra.run.smithi003.stdout:bal_rank_mask -1 2024-09-21T12:25:27.565 INFO:teuthology.orchestra.run.smithi003.stdout:standby_count_wanted 1 2024-09-21T12:25:27.566 INFO:teuthology.orchestra.run.smithi003.stdout:qdb_cluster leader: 14564 members: 14564 2024-09-21T12:25:27.566 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.cephfs.smithi003.gfkngj{0:14564} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.3:6828/3710817325,v1:172.21.15.3:6829/3710817325] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:25:27.566 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:25:27.566 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:25:27.566 INFO:teuthology.orchestra.run.smithi003.stdout:Standby daemons: 2024-09-21T12:25:27.566 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:25:27.566 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.cephfs.smithi192.ywqqxe{-1:24319} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.192:6824/4055220871,v1:172.21.15.192:6825/4055220871] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:25:27.566 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.cephfs.smithi192.ktdqns{-1:24337} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.192:6826/318800854,v1:172.21.15.192:6827/318800854] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:25:27.566 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.cephfs.smithi003.ebjgyl{-1:24345} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.3:6826/55902996,v1:172.21.15.3:6827/55902996] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:25:27.567 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 14 2024-09-21T12:25:27.567 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.563+0000 7fce8e276640 1 -- 172.21.15.3:0/1477734058 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fce7007af30 msgr2=0x7fce7007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:25:27.567 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.563+0000 7fce8e276640 1 --2- 172.21.15.3:0/1477734058 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fce7007af30 0x7fce7007d3f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fce8810f0e0 tx=0x7fce7c031400 comp rx=0 tx=0).stop 2024-09-21T12:25:27.567 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.563+0000 7fce8e276640 1 -- 172.21.15.3:0/1477734058 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fce88100800 msgr2=0x7fce8810d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:25:27.567 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.563+0000 7fce8e276640 1 --2- 172.21.15.3:0/1477734058 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fce88100800 0x7fce8810d650 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fce7800d8d0 tx=0x7fce7800dd90 comp rx=0 tx=0).stop 2024-09-21T12:25:27.567 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.563+0000 7fce8e276640 1 -- 172.21.15.3:0/1477734058 shutdown_connections 2024-09-21T12:25:27.567 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.563+0000 7fce8e276640 1 --2- 172.21.15.3:0/1477734058 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fce7007af30 0x7fce7007d3f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:25:27.567 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.563+0000 7fce8e276640 1 --2- 172.21.15.3:0/1477734058 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce88106800 0x7fce8810db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:25:27.568 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.563+0000 7fce8e276640 1 --2- 172.21.15.3:0/1477734058 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fce88100800 0x7fce8810d650 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:25:27.568 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.563+0000 7fce8e276640 1 -- 172.21.15.3:0/1477734058 >> 172.21.15.3:0/1477734058 conn(0x7fce880fc520 msgr2=0x7fce880fca10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:25:27.568 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.563+0000 7fce8e276640 1 -- 172.21.15.3:0/1477734058 shutdown_connections 2024-09-21T12:25:27.568 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.563+0000 7fce8e276640 1 -- 172.21.15.3:0/1477734058 wait complete. 2024-09-21T12:25:27.651 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.648+0000 7f6150fa7640 1 -- 172.21.15.3:0/1858707283 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f614c107900 msgr2=0x7f614c107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:25:27.651 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.648+0000 7f6150fa7640 1 --2- 172.21.15.3:0/1858707283 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f614c107900 0x7f614c107ce0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f613c009880 tx=0x7f613c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:25:27.651 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.648+0000 7f6150fa7640 1 -- 172.21.15.3:0/1858707283 shutdown_connections 2024-09-21T12:25:27.651 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.648+0000 7f6150fa7640 1 --2- 172.21.15.3:0/1858707283 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f614c101900 0x7f614c101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:25:27.651 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.648+0000 7f6150fa7640 1 --2- 172.21.15.3:0/1858707283 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f614c107900 0x7f614c107ce0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:25:27.651 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.648+0000 7f6150fa7640 1 -- 172.21.15.3:0/1858707283 >> 172.21.15.3:0/1858707283 conn(0x7f614c0fd600 msgr2=0x7f614c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:25:27.651 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.648+0000 7f6150fa7640 1 -- 172.21.15.3:0/1858707283 shutdown_connections 2024-09-21T12:25:27.652 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.648+0000 7f6150fa7640 1 -- 172.21.15.3:0/1858707283 wait complete. 2024-09-21T12:25:27.652 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.649+0000 7f6150fa7640 1 Processor -- start 2024-09-21T12:25:27.652 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.649+0000 7f6150fa7640 1 -- start start 2024-09-21T12:25:27.653 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.649+0000 7f6150fa7640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f614c101900 0x7f614c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:25:27.653 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.649+0000 7f6150fa7640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f614c107900 0x7f614c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:25:27.653 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.649+0000 7f6150fa7640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f614c10edd0 con 0x7f614c101900 2024-09-21T12:25:27.653 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.649+0000 7f6150fa7640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f614c10ec50 con 0x7f614c107900 2024-09-21T12:25:27.653 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.649+0000 7f614a59c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f614c101900 0x7f614c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:25:27.653 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.649+0000 7f614a59c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f614c101900 0x7f614c0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56618/0 (socket says 172.21.15.3:56618) 2024-09-21T12:25:27.654 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.649+0000 7f614a59c640 1 -- 172.21.15.3:0/3278958138 learned_addr learned my addr 172.21.15.3:0/3278958138 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:25:27.654 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.649+0000 7f6143fff640 1 --2- 172.21.15.3:0/3278958138 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f614c107900 0x7f614c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:25:27.654 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.649+0000 7f614a59c640 1 -- 172.21.15.3:0/3278958138 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f614c107900 msgr2=0x7f614c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:25:27.654 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.649+0000 7f614a59c640 1 --2- 172.21.15.3:0/3278958138 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f614c107900 0x7f614c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:25:27.654 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.649+0000 7f614a59c640 1 -- 172.21.15.3:0/3278958138 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f614c074f70 con 0x7f614c101900 2024-09-21T12:25:27.654 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.649+0000 7f614a59c640 1 --2- 172.21.15.3:0/3278958138 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f614c101900 0x7f614c0744f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f613c031460 tx=0x7f613c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:25:27.654 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.650+0000 7f61437fe640 1 -- 172.21.15.3:0/3278958138 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f613c03f070 con 0x7f614c101900 2024-09-21T12:25:27.654 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.650+0000 7f61437fe640 1 -- 172.21.15.3:0/3278958138 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f613c004b10 con 0x7f614c101900 2024-09-21T12:25:27.654 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.650+0000 7f6150fa7640 1 -- 172.21.15.3:0/3278958138 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f614c075200 con 0x7f614c101900 2024-09-21T12:25:27.654 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.650+0000 7f61437fe640 1 -- 172.21.15.3:0/3278958138 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f613c035030 con 0x7f614c101900 2024-09-21T12:25:27.654 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.650+0000 7f6150fa7640 1 -- 172.21.15.3:0/3278958138 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f614c1a3d80 con 0x7f614c101900 2024-09-21T12:25:27.654 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.651+0000 7f6150fa7640 1 -- 172.21.15.3:0/3278958138 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f614c103040 con 0x7f614c101900 2024-09-21T12:25:27.655 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.651+0000 7f61437fe640 1 -- 172.21.15.3:0/3278958138 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f613c042070 con 0x7f614c101900 2024-09-21T12:25:27.655 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.652+0000 7f61437fe640 1 --2- 172.21.15.3:0/3278958138 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f613807af90 0x7f613807d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:25:27.655 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.652+0000 7f61437fe640 1 -- 172.21.15.3:0/3278958138 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6156+0+0 (secure 0 0 0) 0x7f613c0bea70 con 0x7f614c101900 2024-09-21T12:25:27.655 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.652+0000 7f6143fff640 1 --2- 172.21.15.3:0/3278958138 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f613807af90 0x7f613807d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:25:27.655 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.653+0000 7f6143fff640 1 --2- 172.21.15.3:0/3278958138 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f613807af90 0x7f613807d450 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6134005fd0 tx=0x7f6134005850 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:25:27.659 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.656+0000 7f61437fe640 1 -- 172.21.15.3:0/3278958138 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f613c08a0f0 con 0x7f614c101900 2024-09-21T12:25:27.866 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.863+0000 7f6150fa7640 1 -- 172.21.15.3:0/3278958138 --> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f614c062630 con 0x7f613807af90 2024-09-21T12:25:27.867 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.865+0000 7f61437fe640 1 -- 172.21.15.3:0/3278958138 <== mgr.14756 v2:172.21.15.3:6800/1284098095 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+385 (secure 0 0 0) 0x7f614c062630 con 0x7f613807af90 2024-09-21T12:25:27.867 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-21T12:25:27.867 INFO:teuthology.orchestra.run.smithi003.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T12:25:27.867 INFO:teuthology.orchestra.run.smithi003.stdout: "in_progress": true, 2024-09-21T12:25:27.868 INFO:teuthology.orchestra.run.smithi003.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T12:25:27.868 INFO:teuthology.orchestra.run.smithi003.stdout: "services_complete": [ 2024-09-21T12:25:27.868 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr", 2024-09-21T12:25:27.868 INFO:teuthology.orchestra.run.smithi003.stdout: "mon" 2024-09-21T12:25:27.868 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-21T12:25:27.868 INFO:teuthology.orchestra.run.smithi003.stdout: "progress": "4/23 daemons upgraded", 2024-09-21T12:25:27.868 INFO:teuthology.orchestra.run.smithi003.stdout: "message": "Currently upgrading crash daemons", 2024-09-21T12:25:27.868 INFO:teuthology.orchestra.run.smithi003.stdout: "is_paused": false 2024-09-21T12:25:27.868 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-21T12:25:27.870 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.868+0000 7f6150fa7640 1 -- 172.21.15.3:0/3278958138 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f613807af90 msgr2=0x7f613807d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:25:27.870 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.868+0000 7f6150fa7640 1 --2- 172.21.15.3:0/3278958138 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f613807af90 0x7f613807d450 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6134005fd0 tx=0x7f6134005850 comp rx=0 tx=0).stop 2024-09-21T12:25:27.870 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.868+0000 7f6150fa7640 1 -- 172.21.15.3:0/3278958138 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f614c101900 msgr2=0x7f614c0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:25:27.870 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.868+0000 7f6150fa7640 1 --2- 172.21.15.3:0/3278958138 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f614c101900 0x7f614c0744f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f613c031460 tx=0x7f613c0045e0 comp rx=0 tx=0).stop 2024-09-21T12:25:27.870 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.868+0000 7f6150fa7640 1 -- 172.21.15.3:0/3278958138 shutdown_connections 2024-09-21T12:25:27.870 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.868+0000 7f6150fa7640 1 --2- 172.21.15.3:0/3278958138 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f613807af90 0x7f613807d450 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:25:27.870 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.868+0000 7f6150fa7640 1 --2- 172.21.15.3:0/3278958138 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f614c107900 0x7f614c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:25:27.870 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.868+0000 7f6150fa7640 1 --2- 172.21.15.3:0/3278958138 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f614c101900 0x7f614c0744f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:25:27.870 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.868+0000 7f6150fa7640 1 -- 172.21.15.3:0/3278958138 >> 172.21.15.3:0/3278958138 conn(0x7f614c0fd600 msgr2=0x7f614c0fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:25:27.870 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.868+0000 7f6150fa7640 1 -- 172.21.15.3:0/3278958138 shutdown_connections 2024-09-21T12:25:27.870 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.868+0000 7f6150fa7640 1 -- 172.21.15.3:0/3278958138 wait complete. 2024-09-21T12:25:27.955 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.952+0000 7ff637abd640 1 -- 172.21.15.3:0/4015326286 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff630100800 msgr2=0x7ff630100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:25:27.955 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.952+0000 7ff637abd640 1 --2- 172.21.15.3:0/4015326286 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff630100800 0x7ff630100c60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff620009880 tx=0x7ff62002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:25:27.955 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.952+0000 7ff637abd640 1 -- 172.21.15.3:0/4015326286 shutdown_connections 2024-09-21T12:25:27.955 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.952+0000 7ff637abd640 1 --2- 172.21.15.3:0/4015326286 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff630100800 0x7ff630100c60 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:25:27.955 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.952+0000 7ff637abd640 1 --2- 172.21.15.3:0/4015326286 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff630106800 0x7ff630106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:25:27.955 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.952+0000 7ff637abd640 1 -- 172.21.15.3:0/4015326286 >> 172.21.15.3:0/4015326286 conn(0x7ff6300fc520 msgr2=0x7ff6300fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:25:27.955 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.952+0000 7ff637abd640 1 -- 172.21.15.3:0/4015326286 shutdown_connections 2024-09-21T12:25:27.956 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.952+0000 7ff637abd640 1 -- 172.21.15.3:0/4015326286 wait complete. 2024-09-21T12:25:27.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.953+0000 7ff637abd640 1 Processor -- start 2024-09-21T12:25:27.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.953+0000 7ff637abd640 1 -- start start 2024-09-21T12:25:27.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.953+0000 7ff637abd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff630100800 0x7ff6301987c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:25:27.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.953+0000 7ff637abd640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff630106800 0x7ff630198d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:25:27.957 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.953+0000 7ff637abd640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7ff63010dcb0 con 0x7ff630100800 2024-09-21T12:25:27.958 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.953+0000 7ff637abd640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff63010db30 con 0x7ff630106800 2024-09-21T12:25:27.958 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.954+0000 7ff635859640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff630100800 0x7ff6301987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:25:27.958 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.954+0000 7ff635859640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff630100800 0x7ff6301987c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56640/0 (socket says 172.21.15.3:56640) 2024-09-21T12:25:27.958 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.954+0000 7ff635859640 1 -- 172.21.15.3:0/1540038486 learned_addr learned my addr 172.21.15.3:0/1540038486 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:25:27.958 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.954+0000 7ff635058640 1 --2- 172.21.15.3:0/1540038486 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff630106800 0x7ff630198d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:25:27.958 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.954+0000 7ff635859640 1 -- 172.21.15.3:0/1540038486 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff630106800 msgr2=0x7ff630198d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:25:27.958 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.954+0000 7ff635859640 1 --2- 172.21.15.3:0/1540038486 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff630106800 0x7ff630198d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:25:27.958 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.954+0000 7ff635859640 1 -- 172.21.15.3:0/1540038486 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff630199350 con 0x7ff630100800 2024-09-21T12:25:27.958 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.954+0000 7ff635859640 1 --2- 172.21.15.3:0/1540038486 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff630100800 0x7ff6301987c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff62c00d8d0 tx=0x7ff62c00dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:25:27.958 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.954+0000 7ff626ffd640 1 -- 172.21.15.3:0/1540038486 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff62c017030 con 0x7ff630100800 2024-09-21T12:25:27.958 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.954+0000 7ff626ffd640 1 -- 172.21.15.3:0/1540038486 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff62c004020 con 0x7ff630100800 2024-09-21T12:25:27.958 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.954+0000 7ff637abd640 1 -- 172.21.15.3:0/1540038486 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6301a1830 con 0x7ff630100800 2024-09-21T12:25:27.958 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.954+0000 7ff626ffd640 1 -- 172.21.15.3:0/1540038486 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff62c0047a0 con 0x7ff630100800 2024-09-21T12:25:27.959 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.954+0000 7ff637abd640 1 -- 172.21.15.3:0/1540038486 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6301a1c30 con 0x7ff630100800 2024-09-21T12:25:27.959 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.956+0000 7ff637abd640 1 -- 172.21.15.3:0/1540038486 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff630101f40 con 0x7ff630100800 2024-09-21T12:25:27.959 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.956+0000 7ff626ffd640 1 -- 172.21.15.3:0/1540038486 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7ff62c0041d0 con 0x7ff630100800 2024-09-21T12:25:27.959 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.956+0000 7ff626ffd640 1 --2- 172.21.15.3:0/1540038486 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7ff61c07af80 0x7ff61c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:25:27.960 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.957+0000 7ff626ffd640 1 -- 172.21.15.3:0/1540038486 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 6156+0+0 (secure 0 0 0) 0x7ff62c018070 con 0x7ff630100800 2024-09-21T12:25:27.960 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.957+0000 7ff635058640 1 --2- 172.21.15.3:0/1540038486 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7ff61c07af80 0x7ff61c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:25:27.960 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.957+0000 7ff635058640 1 --2- 172.21.15.3:0/1540038486 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7ff61c07af80 0x7ff61c07d440 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff63006ad40 tx=0x7ff620031400 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:25:27.963 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:27.961+0000 7ff626ffd640 1 -- 172.21.15.3:0/1540038486 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff62c0693e0 con 0x7ff630100800 2024-09-21T12:25:28.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:27 smithi192 ceph-mon[80326]: from='client.34100 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:25:28.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:27 smithi192 ceph-mon[80326]: from='client.34104 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:25:28.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:27 smithi192 ceph-mon[80326]: pgmap v107: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:28.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:27 smithi192 ceph-mon[80326]: from='client.34108 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:25:28.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:27 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:28.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:27 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:28.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:27 smithi192 ceph-mon[80326]: from='client.? 172.21.15.3:0/3438607061' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:25:28.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:27 smithi192 ceph-mon[80326]: from='client.? 172.21.15.3:0/1477734058' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:25:28.227 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:28.225+0000 7ff637abd640 1 -- 172.21.15.3:0/1540038486 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7ff630100c60 con 0x7ff630100800 2024-09-21T12:25:28.228 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:27 smithi003 ceph-mon[108723]: from='client.34100 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:25:28.228 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:27 smithi003 ceph-mon[108723]: from='client.34104 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:25:28.228 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:27 smithi003 ceph-mon[108723]: pgmap v107: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:28.228 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:27 smithi003 ceph-mon[108723]: from='client.34108 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:25:28.228 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:27 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:28.228 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:27 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:28.228 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:27 smithi003 ceph-mon[108723]: from='client.? 172.21.15.3:0/3438607061' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:25:28.228 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:27 smithi003 ceph-mon[108723]: from='client.? 172.21.15.3:0/1477734058' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:25:28.229 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:28.225+0000 7ff626ffd640 1 -- 172.21.15.3:0/1540038486 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7ff62c06e290 con 0x7ff630100800 2024-09-21T12:25:28.229 INFO:teuthology.orchestra.run.smithi003.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-21T12:25:28.229 INFO:teuthology.orchestra.run.smithi003.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:25:28.229 INFO:teuthology.orchestra.run.smithi003.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:25:28.231 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:28.228+0000 7ff637abd640 1 -- 172.21.15.3:0/1540038486 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7ff61c07af80 msgr2=0x7ff61c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:25:28.231 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:28.228+0000 7ff637abd640 1 --2- 172.21.15.3:0/1540038486 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7ff61c07af80 0x7ff61c07d440 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ff63006ad40 tx=0x7ff620031400 comp rx=0 tx=0).stop 2024-09-21T12:25:28.231 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:28.228+0000 7ff637abd640 1 -- 172.21.15.3:0/1540038486 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff630100800 msgr2=0x7ff6301987c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:25:28.231 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:28.228+0000 7ff637abd640 1 --2- 172.21.15.3:0/1540038486 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff630100800 0x7ff6301987c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7ff62c00d8d0 tx=0x7ff62c00dd90 comp rx=0 tx=0).stop 2024-09-21T12:25:28.231 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:28.228+0000 7ff637abd640 1 -- 172.21.15.3:0/1540038486 shutdown_connections 2024-09-21T12:25:28.231 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:28.228+0000 7ff637abd640 1 --2- 172.21.15.3:0/1540038486 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7ff61c07af80 0x7ff61c07d440 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:25:28.231 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:28.228+0000 7ff637abd640 1 --2- 172.21.15.3:0/1540038486 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff630106800 0x7ff630198d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:25:28.231 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:28.228+0000 7ff637abd640 1 --2- 172.21.15.3:0/1540038486 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff630100800 0x7ff6301987c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:25:28.231 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:28.228+0000 7ff637abd640 1 -- 172.21.15.3:0/1540038486 >> 172.21.15.3:0/1540038486 conn(0x7ff6300fc520 msgr2=0x7ff6300fcdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:25:28.231 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:28.228+0000 7ff637abd640 1 -- 172.21.15.3:0/1540038486 shutdown_connections 2024-09-21T12:25:28.231 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:28.228+0000 7ff637abd640 1 -- 172.21.15.3:0/1540038486 wait complete. 2024-09-21T12:25:29.117 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:28 smithi192 ceph-mon[80326]: from='client.34120 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:25:29.117 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:28 smithi192 ceph-mon[80326]: from='client.? 172.21.15.3:0/1540038486' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:25:29.117 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:28 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:29.117 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:28 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi192", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-21T12:25:29.117 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:28 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:25:29.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:28 smithi003 ceph-mon[108723]: from='client.34120 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:25:29.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:28 smithi003 ceph-mon[108723]: from='client.? 172.21.15.3:0/1540038486' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:25:29.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:28 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:29.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:28 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "auth get-or-create", "entity": "client.crash.smithi192", "caps": ["mon", "profile crash", "mgr", "profile crash"]} : dispatch 2024-09-21T12:25:29.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:28 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:25:30.171 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:29 smithi192 ceph-mon[80326]: Upgrade: Updating crash.smithi192 (2/2) 2024-09-21T12:25:30.171 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:29 smithi192 ceph-mon[80326]: Deploying daemon crash.smithi192 on smithi192 2024-09-21T12:25:30.171 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:29 smithi192 ceph-mon[80326]: pgmap v108: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:30.171 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:29 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:25:30.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:29 smithi003 ceph-mon[108723]: Upgrade: Updating crash.smithi192 (2/2) 2024-09-21T12:25:30.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:29 smithi003 ceph-mon[108723]: Deploying daemon crash.smithi192 on smithi192 2024-09-21T12:25:30.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:29 smithi003 ceph-mon[108723]: pgmap v108: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:30.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:29 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:25:32.043 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:31 smithi192 ceph-mon[80326]: pgmap v109: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:32.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:31 smithi003 ceph-mon[108723]: pgmap v109: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:33.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:33 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:33.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:33 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:33.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:33 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:25:33.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:33 smithi003 ceph-mon[108723]: pgmap v110: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:33.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:33 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:33.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:33 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:33.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:33 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:25:33.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:33 smithi192 ceph-mon[80326]: pgmap v110: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:36.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:35 smithi003 ceph-mon[108723]: pgmap v111: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:36.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:35 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:36.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:35 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:36.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:35 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:36.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:35 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:36.146 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:35 smithi192 ceph-mon[80326]: pgmap v111: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:36.147 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:35 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:36.147 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:35 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:36.147 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:35 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:36.147 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:35 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:38.217 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:37 smithi003 ceph-mon[108723]: pgmap v112: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:38.217 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:37 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:38.217 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:37 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:38.217 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:37 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:38.217 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:37 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:38.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:37 smithi192 ceph-mon[80326]: pgmap v112: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:38.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:37 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:38.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:37 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:38.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:37 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:38.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:37 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:40.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:39 smithi003 ceph-mon[108723]: pgmap v113: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:40.081 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:39 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:40.081 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:39 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:40.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:39 smithi192 ceph-mon[80326]: pgmap v113: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:40.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:39 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:40.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:39 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:42.060 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:41 smithi003 ceph-mon[108723]: pgmap v114: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:42.060 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:41 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:42.060 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:41 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:42.060 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:41 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:25:42.060 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:41 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:25:42.060 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:41 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:42.060 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:41 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:25:42.060 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:41 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:25:42.060 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:41 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:25:42.061 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:41 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:25:42.061 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:41 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:42.061 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:41 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi003"} : dispatch 2024-09-21T12:25:42.061 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:41 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi003"}]': finished 2024-09-21T12:25:42.061 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:41 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi192"} : dispatch 2024-09-21T12:25:42.061 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:41 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi192"}]': finished 2024-09-21T12:25:42.061 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:41 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16} : dispatch 2024-09-21T12:25:42.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:41 smithi192 ceph-mon[80326]: pgmap v114: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:42.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:41 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:42.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:41 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:42.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:41 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:25:42.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:41 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:25:42.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:41 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:42.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:41 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:25:42.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:41 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:25:42.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:41 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:25:42.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:41 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:25:42.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:41 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:42.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:41 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi003"} : dispatch 2024-09-21T12:25:42.259 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:41 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi003"}]': finished 2024-09-21T12:25:42.259 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:41 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi192"} : dispatch 2024-09-21T12:25:42.259 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:41 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi192"}]': finished 2024-09-21T12:25:42.259 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:41 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16} : dispatch 2024-09-21T12:25:43.005 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:42 smithi003 ceph-mon[108723]: Upgrade: Setting container_image for all crash 2024-09-21T12:25:43.005 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:42 smithi003 ceph-mon[108723]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-21T12:25:43.005 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:42 smithi003 ceph-mon[108723]: Upgrade: osd.0 is safe to restart 2024-09-21T12:25:43.005 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:42 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:43.005 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:42 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T12:25:43.005 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:42 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:25:43.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:42 smithi192 ceph-mon[80326]: Upgrade: Setting container_image for all crash 2024-09-21T12:25:43.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:42 smithi192 ceph-mon[80326]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-21T12:25:43.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:42 smithi192 ceph-mon[80326]: Upgrade: osd.0 is safe to restart 2024-09-21T12:25:43.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:42 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:43.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:42 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "auth get", "entity": "osd.0"} : dispatch 2024-09-21T12:25:43.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:42 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:25:44.021 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:43 smithi003 ceph-mon[108723]: Upgrade: Updating osd.0 2024-09-21T12:25:44.022 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:43 smithi003 ceph-mon[108723]: Deploying daemon osd.0 on smithi003 2024-09-21T12:25:44.022 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:43 smithi003 ceph-mon[108723]: pgmap v115: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:44.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:43 smithi192 ceph-mon[80326]: Upgrade: Updating osd.0 2024-09-21T12:25:44.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:43 smithi192 ceph-mon[80326]: Deploying daemon osd.0 on smithi003 2024-09-21T12:25:44.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:43 smithi192 ceph-mon[80326]: pgmap v115: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:45.226 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:44 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:25:45.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:44 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:25:45.579 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:25:45 smithi003 systemd[1]: Stopping Ceph osd.0 for 641beec0-7812-11ef-baf6-efdc52797490... 2024-09-21T12:25:45.580 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:25:45 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-0[49420]: 2024-09-21T12:25:45.454+0000 7f4437395640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T12:25:45.580 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:25:45 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-0[49420]: 2024-09-21T12:25:45.454+0000 7f4437395640 -1 osd.0 48 *** Got signal Terminated *** 2024-09-21T12:25:45.580 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:25:45 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-0[49420]: 2024-09-21T12:25:45.454+0000 7f4437395640 -1 osd.0 48 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T12:25:46.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:45 smithi192 ceph-mon[80326]: pgmap v116: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:46.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:45 smithi192 ceph-mon[80326]: osd.0 marked itself down and dead 2024-09-21T12:25:46.283 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:45 smithi003 ceph-mon[108723]: pgmap v116: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:46.284 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:45 smithi003 ceph-mon[108723]: osd.0 marked itself down and dead 2024-09-21T12:25:46.579 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:25:46 smithi003 podman[116713]: 2024-09-21 12:25:46.282866712 +0000 UTC m=+0.908511765 container died d07f1489720da5127f449c1e7121b26b6fbf4def9021875501fd6111b62a8adf (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-4e45e6b) 2024-09-21T12:25:46.914 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:25:46 smithi003 podman[116713]: 2024-09-21 12:25:46.653963141 +0000 UTC m=+1.279608169 container cleanup d07f1489720da5127f449c1e7121b26b6fbf4def9021875501fd6111b62a8adf (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-0, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-4e45e6b, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T12:25:46.914 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:25:46 smithi003 bash[116713]: ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-0 2024-09-21T12:25:47.249 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:46 smithi003 ceph-mon[108723]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T12:25:47.249 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:46 smithi003 ceph-mon[108723]: osdmap e49: 6 total, 5 up, 6 in 2024-09-21T12:25:47.249 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:46 smithi003 ceph-mon[108723]: osdmap e50: 6 total, 5 up, 6 in 2024-09-21T12:25:47.249 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:25:46 smithi003 podman[116731]: 2024-09-21 12:25:46.913452195 +0000 UTC m=+0.624775355 container remove d07f1489720da5127f449c1e7121b26b6fbf4def9021875501fd6111b62a8adf (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-0, RELEASE=squid-4e45e6b, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-21T12:25:47.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:46 smithi192 ceph-mon[80326]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T12:25:47.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:46 smithi192 ceph-mon[80326]: osdmap e49: 6 total, 5 up, 6 in 2024-09-21T12:25:47.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:46 smithi192 ceph-mon[80326]: osdmap e50: 6 total, 5 up, 6 in 2024-09-21T12:25:47.544 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:25:47 smithi003 podman[116816]: 2024-09-21 12:25:47.151065267 +0000 UTC m=+0.016776593 image pull 8f4d013db793795fef09ff5edf96e6b42ba8cd2c9158b2f0b7a5d7c1e657c063 quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 2024-09-21T12:25:47.544 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:25:47 smithi003 podman[116816]: 2024-09-21 12:25:47.272911082 +0000 UTC m=+0.138622441 container create 91eef214a9576b5dcadb3ac542f0c5d4efdc6e3e2ef0c1ff73a79df9cdf29e9b (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-0-deactivate, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS) 2024-09-21T12:25:47.829 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:25:47 smithi003 podman[116816]: 2024-09-21 12:25:47.542435258 +0000 UTC m=+0.408146584 container init 91eef214a9576b5dcadb3ac542f0c5d4efdc6e3e2ef0c1ff73a79df9cdf29e9b (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-0-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, io.buildah.version=1.37.2) 2024-09-21T12:25:47.830 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:25:47 smithi003 podman[116816]: 2024-09-21 12:25:47.546698675 +0000 UTC m=+0.412410000 container start 91eef214a9576b5dcadb3ac542f0c5d4efdc6e3e2ef0c1ff73a79df9cdf29e9b (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-0-deactivate, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731) 2024-09-21T12:25:47.830 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:25:47 smithi003 podman[116816]: 2024-09-21 12:25:47.625822922 +0000 UTC m=+0.491534238 container attach 91eef214a9576b5dcadb3ac542f0c5d4efdc6e3e2ef0c1ff73a79df9cdf29e9b (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-0-deactivate, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T12:25:47.830 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:25:47 smithi003 podman[116816]: 2024-09-21 12:25:47.750040593 +0000 UTC m=+0.615751912 container died 91eef214a9576b5dcadb3ac542f0c5d4efdc6e3e2ef0c1ff73a79df9cdf29e9b (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-0-deactivate, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T12:25:48.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:47 smithi192 ceph-mon[80326]: pgmap v118: 65 pgs: 9 stale+active+clean, 56 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:48.280 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:47 smithi003 ceph-mon[108723]: pgmap v118: 65 pgs: 9 stale+active+clean, 56 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:48.579 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:25:48 smithi003 podman[116840]: 2024-09-21 12:25:48.279274018 +0000 UTC m=+0.518374401 container remove 91eef214a9576b5dcadb3ac542f0c5d4efdc6e3e2ef0c1ff73a79df9cdf29e9b (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-0-deactivate, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-21T12:25:48.580 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:25:48 smithi003 systemd[1]: ceph-641beec0-7812-11ef-baf6-efdc52797490@osd.0.service: Deactivated successfully. 2024-09-21T12:25:48.580 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:25:48 smithi003 systemd[1]: Stopped Ceph osd.0 for 641beec0-7812-11ef-baf6-efdc52797490. 2024-09-21T12:25:48.580 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:25:48 smithi003 systemd[1]: ceph-641beec0-7812-11ef-baf6-efdc52797490@osd.0.service: Consumed 53.985s CPU time. 2024-09-21T12:25:48.580 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:25:48 smithi003 systemd[1]: Starting Ceph osd.0 for 641beec0-7812-11ef-baf6-efdc52797490... 2024-09-21T12:25:48.996 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:48 smithi003 ceph-mon[108723]: pgmap v120: 65 pgs: 9 stale+active+clean, 56 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:48.996 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:25:48 smithi003 podman[116940]: 2024-09-21 12:25:48.645947076 +0000 UTC m=+0.017440229 image pull 8f4d013db793795fef09ff5edf96e6b42ba8cd2c9158b2f0b7a5d7c1e657c063 quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 2024-09-21T12:25:48.996 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:25:48 smithi003 podman[116940]: 2024-09-21 12:25:48.772406654 +0000 UTC m=+0.143899788 container create e0fb94431f4a982c1e0bff480aa80244fade9743445e14021911ff430865ef33 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-0-activate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-21T12:25:48.996 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:25:48 smithi003 podman[116940]: 2024-09-21 12:25:48.991522776 +0000 UTC m=+0.363015930 container init e0fb94431f4a982c1e0bff480aa80244fade9743445e14021911ff430865ef33 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-0-activate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-21T12:25:48.996 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:25:48 smithi003 podman[116940]: 2024-09-21 12:25:48.995211198 +0000 UTC m=+0.366704340 container start e0fb94431f4a982c1e0bff480aa80244fade9743445e14021911ff430865ef33 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-0-activate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2) 2024-09-21T12:25:49.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:48 smithi192 ceph-mon[80326]: pgmap v120: 65 pgs: 9 stale+active+clean, 56 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:25:49.329 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:25:49 smithi003 podman[116940]: 2024-09-21 12:25:49.091864859 +0000 UTC m=+0.463358005 container attach e0fb94431f4a982c1e0bff480aa80244fade9743445e14021911ff430865ef33 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-0-activate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-21T12:25:49.329 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:25:49 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-0-activate[116955]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:25:49.330 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:25:49 smithi003 bash[116940]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:25:49.330 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:25:49 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-0-activate[116955]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:25:49.330 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:25:49 smithi003 bash[116940]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:25:51.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:50 smithi192 ceph-mon[80326]: pgmap v121: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 55/279 objects degraded (19.713%) 2024-09-21T12:25:51.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:50 smithi192 ceph-mon[80326]: Health check failed: Degraded data redundancy: 55/279 objects degraded (19.713%), 19 pgs degraded (PG_DEGRADED) 2024-09-21T12:25:51.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:50 smithi003 ceph-mon[108723]: pgmap v121: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 55/279 objects degraded (19.713%) 2024-09-21T12:25:51.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:50 smithi003 ceph-mon[108723]: Health check failed: Degraded data redundancy: 55/279 objects degraded (19.713%), 19 pgs degraded (PG_DEGRADED) 2024-09-21T12:25:52.282 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:25:51 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-0-activate[116955]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-09-21T12:25:52.282 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:25:51 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-0-activate[116955]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:25:52.282 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:25:51 smithi003 bash[116940]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-09-21T12:25:52.283 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:25:51 smithi003 bash[116940]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:25:52.283 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:25:51 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-0-activate[116955]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:25:52.283 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:25:51 smithi003 bash[116940]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:25:52.283 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:25:51 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-0-activate[116955]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-21T12:25:52.283 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:25:51 smithi003 bash[116940]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-21T12:25:52.283 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:25:51 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-0-activate[116955]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-0 --no-mon-config 2024-09-21T12:25:52.283 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:25:51 smithi003 bash[116940]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-0 --no-mon-config 2024-09-21T12:25:52.283 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:25:52 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-0-activate[116955]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-21T12:25:52.283 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:25:52 smithi003 bash[116940]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-21T12:25:52.579 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:25:52 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-0-activate[116955]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-0/block 2024-09-21T12:25:52.580 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:25:52 smithi003 bash[116940]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-0/block 2024-09-21T12:25:52.580 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:25:52 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-0-activate[116955]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-21T12:25:52.580 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:25:52 smithi003 bash[116940]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-21T12:25:52.580 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:25:52 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-0-activate[116955]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-21T12:25:52.580 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:25:52 smithi003 bash[116940]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-21T12:25:52.580 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:25:52 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-0-activate[116955]: --> ceph-volume lvm activate successful for osd ID: 0 2024-09-21T12:25:52.580 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:25:52 smithi003 bash[116940]: --> ceph-volume lvm activate successful for osd ID: 0 2024-09-21T12:25:52.580 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:25:52 smithi003 podman[116940]: 2024-09-21 12:25:52.313732163 +0000 UTC m=+3.685225311 container died e0fb94431f4a982c1e0bff480aa80244fade9743445e14021911ff430865ef33 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-0-activate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0) 2024-09-21T12:25:53.305 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:25:52 smithi003 podman[117174]: 2024-09-21 12:25:52.987362232 +0000 UTC m=+0.663205896 container remove e0fb94431f4a982c1e0bff480aa80244fade9743445e14021911ff430865ef33 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-0-activate, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T12:25:53.305 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:25:53 smithi003 podman[117235]: 2024-09-21 12:25:53.103724182 +0000 UTC m=+0.016606992 image pull 8f4d013db793795fef09ff5edf96e6b42ba8cd2c9158b2f0b7a5d7c1e657c063 quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 2024-09-21T12:25:53.306 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:25:53 smithi003 podman[117235]: 2024-09-21 12:25:53.205008923 +0000 UTC m=+0.117891730 container create 0f2234f333eccf3398f01842fad43f70bae9b4fd5c26c96a4a3c4c18589f369e (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-0, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-21T12:25:53.829 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:25:53 smithi003 podman[117235]: 2024-09-21 12:25:53.432656366 +0000 UTC m=+0.345539177 container init 0f2234f333eccf3398f01842fad43f70bae9b4fd5c26c96a4a3c4c18589f369e (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-0, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3) 2024-09-21T12:25:53.829 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:25:53 smithi003 podman[117235]: 2024-09-21 12:25:53.43622332 +0000 UTC m=+0.349106129 container start 0f2234f333eccf3398f01842fad43f70bae9b4fd5c26c96a4a3c4c18589f369e (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-0, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T12:25:53.829 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:25:53 smithi003 ceph-osd[117253]: -- 172.21.15.3:0/2832635362 <== mon.0 v2:172.21.15.3:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55df61fe41e0 con 0x55df61181c00 2024-09-21T12:25:53.830 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:25:53 smithi003 bash[117235]: 0f2234f333eccf3398f01842fad43f70bae9b4fd5c26c96a4a3c4c18589f369e 2024-09-21T12:25:53.830 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:25:53 smithi003 systemd[1]: Started Ceph osd.0 for 641beec0-7812-11ef-baf6-efdc52797490. 2024-09-21T12:25:54.154 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:53 smithi003 ceph-mon[108723]: pgmap v122: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 55/279 objects degraded (19.713%) 2024-09-21T12:25:54.154 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:53 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:54.154 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:53 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:54.155 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:53 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:25:54.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:53 smithi192 ceph-mon[80326]: pgmap v122: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 55/279 objects degraded (19.713%) 2024-09-21T12:25:54.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:53 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:54.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:53 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:54.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:53 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:25:55.111 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:25:54 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-0[117249]: 2024-09-21T12:25:54.834+0000 7f747ed7c640 -1 Falling back to public interface 2024-09-21T12:25:56.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:55 smithi003 ceph-mon[108723]: pgmap v123: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 55/279 objects degraded (19.713%) 2024-09-21T12:25:56.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:55 smithi192 ceph-mon[80326]: pgmap v123: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 55/279 objects degraded (19.713%) 2024-09-21T12:25:58.205 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:57 smithi003 ceph-mon[108723]: pgmap v124: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 55/279 objects degraded (19.713%) 2024-09-21T12:25:58.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:57 smithi192 ceph-mon[80326]: pgmap v124: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 55/279 objects degraded (19.713%) 2024-09-21T12:25:58.320 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.318+0000 7f3d9cc9b640 1 -- 172.21.15.3:0/1964142907 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3d981033e0 msgr2=0x7f3d9810b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:25:58.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.318+0000 7f3d9cc9b640 1 --2- 172.21.15.3:0/1964142907 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3d981033e0 0x7f3d9810b8d0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c009880 tx=0x7f3d8c02a530 comp rx=0 tx=0).stop 2024-09-21T12:25:58.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.319+0000 7f3d9cc9b640 1 -- 172.21.15.3:0/1964142907 shutdown_connections 2024-09-21T12:25:58.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.319+0000 7f3d9cc9b640 1 --2- 172.21.15.3:0/1964142907 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3d981033e0 0x7f3d9810b8d0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:25:58.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.319+0000 7f3d9cc9b640 1 --2- 172.21.15.3:0/1964142907 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d98102ac0 0x7f3d98102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:25:58.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.319+0000 7f3d9cc9b640 1 -- 172.21.15.3:0/1964142907 >> 172.21.15.3:0/1964142907 conn(0x7f3d980fc520 msgr2=0x7f3d980fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:25:58.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.319+0000 7f3d9cc9b640 1 -- 172.21.15.3:0/1964142907 shutdown_connections 2024-09-21T12:25:58.321 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.319+0000 7f3d9cc9b640 1 -- 172.21.15.3:0/1964142907 wait complete. 2024-09-21T12:25:58.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.319+0000 7f3d9cc9b640 1 Processor -- start 2024-09-21T12:25:58.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.319+0000 7f3d9cc9b640 1 -- start start 2024-09-21T12:25:58.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.320+0000 7f3d9cc9b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d98102ac0 0x7f3d98100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:25:58.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.320+0000 7f3d9cc9b640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3d981033e0 0x7f3d98100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:25:58.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.320+0000 7f3d9cc9b640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f3d9810edf0 con 0x7f3d981033e0 2024-09-21T12:25:58.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.320+0000 7f3d9cc9b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3d9810ec70 con 0x7f3d98102ac0 2024-09-21T12:25:58.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.320+0000 7f3d95d9b640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3d981033e0 0x7f3d98100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:25:58.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.320+0000 7f3d95d9b640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3d981033e0 0x7f3d98100c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:42594/0 (socket says 172.21.15.3:42594) 2024-09-21T12:25:58.323 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.320+0000 7f3d95d9b640 1 -- 172.21.15.3:0/2962588425 learned_addr learned my addr 172.21.15.3:0/2962588425 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:25:58.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.320+0000 7f3d9659c640 1 --2- 172.21.15.3:0/2962588425 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d98102ac0 0x7f3d98100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:25:58.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.320+0000 7f3d95d9b640 1 -- 172.21.15.3:0/2962588425 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d98102ac0 msgr2=0x7f3d98100720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:25:58.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.320+0000 7f3d95d9b640 1 --2- 172.21.15.3:0/2962588425 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d98102ac0 0x7f3d98100720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:25:58.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.320+0000 7f3d95d9b640 1 -- 172.21.15.3:0/2962588425 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d981011a0 con 0x7f3d981033e0 2024-09-21T12:25:58.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.320+0000 7f3d9659c640 1 --2- 172.21.15.3:0/2962588425 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d98102ac0 0x7f3d98100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:25:58.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.321+0000 7f3d95d9b640 1 --2- 172.21.15.3:0/2962588425 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3d981033e0 0x7f3d98100c60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c031460 tx=0x7f3d8c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:25:58.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.321+0000 7f3d877fe640 1 -- 172.21.15.3:0/2962588425 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3d8c03f070 con 0x7f3d981033e0 2024-09-21T12:25:58.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.321+0000 7f3d9cc9b640 1 -- 172.21.15.3:0/2962588425 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d98101430 con 0x7f3d981033e0 2024-09-21T12:25:58.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.321+0000 7f3d877fe640 1 -- 172.21.15.3:0/2962588425 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3d8c004ac0 con 0x7f3d981033e0 2024-09-21T12:25:58.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.321+0000 7f3d877fe640 1 -- 172.21.15.3:0/2962588425 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3d8c035030 con 0x7f3d981033e0 2024-09-21T12:25:58.324 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.321+0000 7f3d9cc9b640 1 -- 172.21.15.3:0/2962588425 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d981a3de0 con 0x7f3d981033e0 2024-09-21T12:25:58.325 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.322+0000 7f3d9cc9b640 1 -- 172.21.15.3:0/2962588425 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d9806aa90 con 0x7f3d981033e0 2024-09-21T12:25:58.325 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.323+0000 7f3d877fe640 1 -- 172.21.15.3:0/2962588425 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f3d8c042070 con 0x7f3d981033e0 2024-09-21T12:25:58.325 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.323+0000 7f3d877fe640 1 --2- 172.21.15.3:0/2962588425 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f3d8007af30 0x7f3d8007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:25:58.325 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.323+0000 7f3d9659c640 1 --2- 172.21.15.3:0/2962588425 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f3d8007af30 0x7f3d8007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:25:58.325 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.323+0000 7f3d877fe640 1 -- 172.21.15.3:0/2962588425 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6156+0+0 (secure 0 0 0) 0x7f3d8c0bea30 con 0x7f3d981033e0 2024-09-21T12:25:58.326 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.324+0000 7f3d9659c640 1 --2- 172.21.15.3:0/2962588425 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f3d8007af30 0x7f3d8007d3f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3d88005fd0 tx=0x7f3d88005ea0 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:25:58.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.329+0000 7f3d877fe640 1 -- 172.21.15.3:0/2962588425 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3d8c08a030 con 0x7f3d981033e0 2024-09-21T12:25:58.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.550+0000 7f3d9cc9b640 1 -- 172.21.15.3:0/2962588425 --> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f3d98062630 con 0x7f3d8007af30 2024-09-21T12:25:58.554 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.552+0000 7f3d877fe640 1 -- 172.21.15.3:0/2962588425 <== mgr.14756 v2:172.21.15.3:6800/1284098095 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f3d98062630 con 0x7f3d8007af30 2024-09-21T12:25:58.556 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.555+0000 7f3d9cc9b640 1 -- 172.21.15.3:0/2962588425 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f3d8007af30 msgr2=0x7f3d8007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:25:58.556 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.555+0000 7f3d9cc9b640 1 --2- 172.21.15.3:0/2962588425 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f3d8007af30 0x7f3d8007d3f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3d88005fd0 tx=0x7f3d88005ea0 comp rx=0 tx=0).stop 2024-09-21T12:25:58.556 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.555+0000 7f3d9cc9b640 1 -- 172.21.15.3:0/2962588425 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3d981033e0 msgr2=0x7f3d98100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:25:58.556 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.555+0000 7f3d9cc9b640 1 --2- 172.21.15.3:0/2962588425 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3d981033e0 0x7f3d98100c60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f3d8c031460 tx=0x7f3d8c0046c0 comp rx=0 tx=0).stop 2024-09-21T12:25:58.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.555+0000 7f3d9cc9b640 1 -- 172.21.15.3:0/2962588425 shutdown_connections 2024-09-21T12:25:58.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.555+0000 7f3d9cc9b640 1 --2- 172.21.15.3:0/2962588425 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f3d8007af30 0x7f3d8007d3f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:25:58.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.555+0000 7f3d9cc9b640 1 --2- 172.21.15.3:0/2962588425 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3d981033e0 0x7f3d98100c60 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:25:58.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.555+0000 7f3d9cc9b640 1 --2- 172.21.15.3:0/2962588425 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3d98102ac0 0x7f3d98100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:25:58.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.555+0000 7f3d9cc9b640 1 -- 172.21.15.3:0/2962588425 >> 172.21.15.3:0/2962588425 conn(0x7f3d980fc520 msgr2=0x7f3d98108f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:25:58.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.555+0000 7f3d9cc9b640 1 -- 172.21.15.3:0/2962588425 shutdown_connections 2024-09-21T12:25:58.557 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.555+0000 7f3d9cc9b640 1 -- 172.21.15.3:0/2962588425 wait complete. 2024-09-21T12:25:58.567 INFO:teuthology.orchestra.run.smithi003.stdout:true 2024-09-21T12:25:58.668 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.666+0000 7f318ef1a640 1 -- 172.21.15.3:0/684891053 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3188074f40 msgr2=0x7f318810dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:25:58.668 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.666+0000 7f318ef1a640 1 --2- 172.21.15.3:0/684891053 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3188074f40 0x7f318810dc00 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f3174009880 tx=0x7f317402a530 comp rx=0 tx=0).stop 2024-09-21T12:25:58.668 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.666+0000 7f318ef1a640 1 -- 172.21.15.3:0/684891053 shutdown_connections 2024-09-21T12:25:58.668 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.666+0000 7f318ef1a640 1 --2- 172.21.15.3:0/684891053 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3188074f40 0x7f318810dc00 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:25:58.668 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.666+0000 7f318ef1a640 1 --2- 172.21.15.3:0/684891053 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3188074620 0x7f3188074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:25:58.669 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.666+0000 7f318ef1a640 1 -- 172.21.15.3:0/684891053 >> 172.21.15.3:0/684891053 conn(0x7f31880fd5e0 msgr2=0x7f31880ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:25:58.669 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.667+0000 7f318ef1a640 1 -- 172.21.15.3:0/684891053 shutdown_connections 2024-09-21T12:25:58.669 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.667+0000 7f318ef1a640 1 -- 172.21.15.3:0/684891053 wait complete. 2024-09-21T12:25:58.669 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.667+0000 7f318ef1a640 1 Processor -- start 2024-09-21T12:25:58.669 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.667+0000 7f318ef1a640 1 -- start start 2024-09-21T12:25:58.669 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.668+0000 7f318ef1a640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3188074620 0x7f318819f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:25:58.670 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.668+0000 7f318ef1a640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3188074f40 0x7f318819fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:25:58.670 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.668+0000 7f318ef1a640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f3188110fd0 con 0x7f3188074f40 2024-09-21T12:25:58.670 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.668+0000 7f318ef1a640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3188110e50 con 0x7f3188074620 2024-09-21T12:25:58.670 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.668+0000 7f3187fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3188074f40 0x7f318819fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:25:58.670 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.668+0000 7f3187fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3188074f40 0x7f318819fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:42622/0 (socket says 172.21.15.3:42622) 2024-09-21T12:25:58.670 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.668+0000 7f3187fff640 1 -- 172.21.15.3:0/556949756 learned_addr learned my addr 172.21.15.3:0/556949756 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:25:58.670 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.668+0000 7f318ccb6640 1 --2- 172.21.15.3:0/556949756 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3188074620 0x7f318819f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:25:58.671 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.668+0000 7f318ccb6640 1 -- 172.21.15.3:0/556949756 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3188074f40 msgr2=0x7f318819fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:25:58.671 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.668+0000 7f318ccb6640 1 --2- 172.21.15.3:0/556949756 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3188074f40 0x7f318819fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:25:58.671 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.668+0000 7f318ccb6640 1 -- 172.21.15.3:0/556949756 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3188199a20 con 0x7f3188074620 2024-09-21T12:25:58.671 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.669+0000 7f318ccb6640 1 --2- 172.21.15.3:0/556949756 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3188074620 0x7f318819f860 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f317c00e970 tx=0x7f317c00ee30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:25:58.671 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.669+0000 7f3185ffb640 1 -- 172.21.15.3:0/556949756 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f317c00cac0 con 0x7f3188074620 2024-09-21T12:25:58.671 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.669+0000 7f3185ffb640 1 -- 172.21.15.3:0/556949756 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f317c00cc60 con 0x7f3188074620 2024-09-21T12:25:58.671 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.669+0000 7f318ef1a640 1 -- 172.21.15.3:0/556949756 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3188199d10 con 0x7f3188074620 2024-09-21T12:25:58.671 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.669+0000 7f3185ffb640 1 -- 172.21.15.3:0/556949756 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f317c018720 con 0x7f3188074620 2024-09-21T12:25:58.671 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.669+0000 7f318ef1a640 1 -- 172.21.15.3:0/556949756 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f318819a2a0 con 0x7f3188074620 2024-09-21T12:25:58.672 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.670+0000 7f318ef1a640 1 -- 172.21.15.3:0/556949756 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3188075cd0 con 0x7f3188074620 2024-09-21T12:25:58.672 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.671+0000 7f3185ffb640 1 -- 172.21.15.3:0/556949756 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f317c010430 con 0x7f3188074620 2024-09-21T12:25:58.673 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.672+0000 7f3185ffb640 1 --2- 172.21.15.3:0/556949756 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f317807af30 0x7f317807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:25:58.673 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.672+0000 7f3185ffb640 1 -- 172.21.15.3:0/556949756 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6156+0+0 (secure 0 0 0) 0x7f317c09e5c0 con 0x7f3188074620 2024-09-21T12:25:58.673 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.672+0000 7f3187fff640 1 --2- 172.21.15.3:0/556949756 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f317807af30 0x7f317807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:25:58.674 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.672+0000 7f3187fff640 1 --2- 172.21.15.3:0/556949756 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f317807af30 0x7f317807d3f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f318810ac30 tx=0x7f3174031400 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:25:58.678 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.677+0000 7f3185ffb640 1 -- 172.21.15.3:0/556949756 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f317c069bc0 con 0x7f3188074620 2024-09-21T12:25:58.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.884+0000 7f318ef1a640 1 -- 172.21.15.3:0/556949756 --> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f318819af50 con 0x7f317807af30 2024-09-21T12:25:58.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.885+0000 7f3185ffb640 1 -- 172.21.15.3:0/556949756 <== mgr.14756 v2:172.21.15.3:6800/1284098095 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f318819af50 con 0x7f317807af30 2024-09-21T12:25:58.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.889+0000 7f318ef1a640 1 -- 172.21.15.3:0/556949756 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f317807af30 msgr2=0x7f317807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:25:58.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.889+0000 7f318ef1a640 1 --2- 172.21.15.3:0/556949756 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f317807af30 0x7f317807d3f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f318810ac30 tx=0x7f3174031400 comp rx=0 tx=0).stop 2024-09-21T12:25:58.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.889+0000 7f318ef1a640 1 -- 172.21.15.3:0/556949756 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3188074620 msgr2=0x7f318819f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:25:58.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.889+0000 7f318ef1a640 1 --2- 172.21.15.3:0/556949756 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3188074620 0x7f318819f860 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f317c00e970 tx=0x7f317c00ee30 comp rx=0 tx=0).stop 2024-09-21T12:25:58.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.889+0000 7f318ef1a640 1 -- 172.21.15.3:0/556949756 shutdown_connections 2024-09-21T12:25:58.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.889+0000 7f318ef1a640 1 --2- 172.21.15.3:0/556949756 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f317807af30 0x7f317807d3f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:25:58.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.889+0000 7f318ef1a640 1 --2- 172.21.15.3:0/556949756 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3188074f40 0x7f318819fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:25:58.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.889+0000 7f318ef1a640 1 --2- 172.21.15.3:0/556949756 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3188074620 0x7f318819f860 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:25:58.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.889+0000 7f318ef1a640 1 -- 172.21.15.3:0/556949756 >> 172.21.15.3:0/556949756 conn(0x7f31880fd5e0 msgr2=0x7f318810b270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:25:58.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.889+0000 7f318ef1a640 1 -- 172.21.15.3:0/556949756 shutdown_connections 2024-09-21T12:25:58.891 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.889+0000 7f318ef1a640 1 -- 172.21.15.3:0/556949756 wait complete. 2024-09-21T12:25:58.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.978+0000 7f82f6fac640 1 -- 172.21.15.3:0/2483103223 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f82f01007f0 msgr2=0x7f82f0100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:25:58.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.978+0000 7f82f6fac640 1 --2- 172.21.15.3:0/2483103223 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f82f01007f0 0x7f82f0100c50 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f82dc009880 tx=0x7f82dc02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:25:58.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.978+0000 7f82f6fac640 1 -- 172.21.15.3:0/2483103223 shutdown_connections 2024-09-21T12:25:58.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.978+0000 7f82f6fac640 1 --2- 172.21.15.3:0/2483103223 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f82f01007f0 0x7f82f0100c50 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:25:58.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.978+0000 7f82f6fac640 1 --2- 172.21.15.3:0/2483103223 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82f01067f0 0x7f82f0106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:25:58.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.978+0000 7f82f6fac640 1 -- 172.21.15.3:0/2483103223 >> 172.21.15.3:0/2483103223 conn(0x7f82f00fc550 msgr2=0x7f82f00fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:25:58.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.978+0000 7f82f6fac640 1 -- 172.21.15.3:0/2483103223 shutdown_connections 2024-09-21T12:25:58.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.978+0000 7f82f6fac640 1 -- 172.21.15.3:0/2483103223 wait complete. 2024-09-21T12:25:58.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.979+0000 7f82f6fac640 1 Processor -- start 2024-09-21T12:25:58.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.979+0000 7f82f6fac640 1 -- start start 2024-09-21T12:25:58.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.979+0000 7f82f6fac640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f82f01007f0 0x7f82f019f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:25:58.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.979+0000 7f82f6fac640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82f01067f0 0x7f82f019fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:25:58.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.979+0000 7f82f6fac640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f82f010dcc0 con 0x7f82f01007f0 2024-09-21T12:25:58.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.979+0000 7f82f6fac640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f82f010db40 con 0x7f82f01067f0 2024-09-21T12:25:58.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.979+0000 7f82f4d48640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f82f01007f0 0x7f82f019f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:25:58.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.979+0000 7f82f4d48640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f82f01007f0 0x7f82f019f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:42650/0 (socket says 172.21.15.3:42650) 2024-09-21T12:25:58.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.979+0000 7f82f4d48640 1 -- 172.21.15.3:0/3894671769 learned_addr learned my addr 172.21.15.3:0/3894671769 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:25:58.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.979+0000 7f82effff640 1 --2- 172.21.15.3:0/3894671769 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82f01067f0 0x7f82f019fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:25:58.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.979+0000 7f82f4d48640 1 -- 172.21.15.3:0/3894671769 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82f01067f0 msgr2=0x7f82f019fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:25:58.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.979+0000 7f82f4d48640 1 --2- 172.21.15.3:0/3894671769 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82f01067f0 0x7f82f019fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:25:58.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.979+0000 7f82f4d48640 1 -- 172.21.15.3:0/3894671769 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82f01999b0 con 0x7f82f01007f0 2024-09-21T12:25:58.984 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.980+0000 7f82f4d48640 1 --2- 172.21.15.3:0/3894671769 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f82f01007f0 0x7f82f019f7f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f82e400e970 tx=0x7f82e400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:25:58.984 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.980+0000 7f82edffb640 1 -- 172.21.15.3:0/3894671769 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f82e400cac0 con 0x7f82f01007f0 2024-09-21T12:25:58.984 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.980+0000 7f82f6fac640 1 -- 172.21.15.3:0/3894671769 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82f0199ca0 con 0x7f82f01007f0 2024-09-21T12:25:58.984 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.980+0000 7f82edffb640 1 -- 172.21.15.3:0/3894671769 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f82e40054e0 con 0x7f82f01007f0 2024-09-21T12:25:58.984 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.980+0000 7f82edffb640 1 -- 172.21.15.3:0/3894671769 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f82e4010430 con 0x7f82f01007f0 2024-09-21T12:25:58.984 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.980+0000 7f82f6fac640 1 -- 172.21.15.3:0/3894671769 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82f019a200 con 0x7f82f01007f0 2024-09-21T12:25:58.985 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.981+0000 7f82f6fac640 1 -- 172.21.15.3:0/3894671769 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82f0101f30 con 0x7f82f01007f0 2024-09-21T12:25:58.985 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.982+0000 7f82edffb640 1 -- 172.21.15.3:0/3894671769 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f82e4004ea0 con 0x7f82f01007f0 2024-09-21T12:25:58.985 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.982+0000 7f82edffb640 1 --2- 172.21.15.3:0/3894671769 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f82e007af30 0x7f82e007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:25:58.985 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.983+0000 7f82effff640 1 --2- 172.21.15.3:0/3894671769 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f82e007af30 0x7f82e007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:25:58.985 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.983+0000 7f82edffb640 1 -- 172.21.15.3:0/3894671769 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6156+0+0 (secure 0 0 0) 0x7f82e409e740 con 0x7f82f01007f0 2024-09-21T12:25:58.985 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.983+0000 7f82effff640 1 --2- 172.21.15.3:0/3894671769 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f82e007af30 0x7f82e007d3f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f82f019b1a0 tx=0x7f82dc031400 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:25:58.988 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:58.987+0000 7f82edffb640 1 -- 172.21.15.3:0/3894671769 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f82e4069d40 con 0x7f82f01007f0 2024-09-21T12:25:59.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.185+0000 7f82f6fac640 1 -- 172.21.15.3:0/3894671769 --> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f82f019a570 con 0x7f82e007af30 2024-09-21T12:25:59.197 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.195+0000 7f82edffb640 1 -- 172.21.15.3:0/3894671769 <== mgr.14756 v2:172.21.15.3:6800/1284098095 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f82f019a570 con 0x7f82e007af30 2024-09-21T12:25:59.197 INFO:teuthology.orchestra.run.smithi003.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:25:59.197 INFO:teuthology.orchestra.run.smithi003.stdout:alertmanager.smithi003 smithi003 *:9093,9094 running (2m) 0s ago 13m 19.0M - 0.27.0 11f11916f8cd 14880018dfd3 2024-09-21T12:25:59.197 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-exporter.smithi003 smithi003 running (4m) 0s ago 13m 8715k - 19.1.1-373-g4e45e6b4 164465d2334a 0c9ad60a4f5a 2024-09-21T12:25:59.197 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-exporter.smithi192 smithi192 running (4m) 24s ago 13m 8338k - 19.1.1-373-g4e45e6b4 164465d2334a d5be8a6e120f 2024-09-21T12:25:59.197 INFO:teuthology.orchestra.run.smithi003.stdout:crash.smithi003 smithi003 running (32s) 0s ago 13m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 0ada67250dba 2024-09-21T12:25:59.197 INFO:teuthology.orchestra.run.smithi003.stdout:crash.smithi192 smithi192 running (27s) 24s ago 13m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 52e279085b2e 2024-09-21T12:25:59.198 INFO:teuthology.orchestra.run.smithi003.stdout:grafana.smithi003 smithi003 *:3000 running (2m) 0s ago 13m 79.7M - 10.4.8 5aad1d7cf004 19e26b3cb585 2024-09-21T12:25:59.198 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi003.ebjgyl smithi003 running (8m) 0s ago 8m 16.6M - 19.1.1-373-g4e45e6b4 164465d2334a 16e0b2cac16a 2024-09-21T12:25:59.198 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi003.gfkngj smithi003 running (8m) 0s ago 8m 143M - 19.1.1-373-g4e45e6b4 164465d2334a 109c04f87fbd 2024-09-21T12:25:59.198 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi192.ktdqns smithi192 running (8m) 24s ago 8m 18.2M - 19.1.1-373-g4e45e6b4 164465d2334a 495c73fb3bb0 2024-09-21T12:25:59.198 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi192.ywqqxe smithi192 running (8m) 24s ago 8m 18.2M - 19.1.1-373-g4e45e6b4 164465d2334a 270a01030cbe 2024-09-21T12:25:59.198 INFO:teuthology.orchestra.run.smithi003.stdout:mgr.smithi003.wztftl smithi003 *:8443,9283,8765 running (4m) 0s ago 14m 523M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 8ce0e66fd369 2024-09-21T12:25:59.198 INFO:teuthology.orchestra.run.smithi003.stdout:mgr.smithi192.qsaprd smithi192 *:8443,9283,8765 running (3m) 24s ago 12m 457M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 002a6171dd47 2024-09-21T12:25:59.198 INFO:teuthology.orchestra.run.smithi003.stdout:mon.smithi003 smithi003 running (59s) 0s ago 15m 37.7M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 4f2b2b2daf19 2024-09-21T12:25:59.198 INFO:teuthology.orchestra.run.smithi003.stdout:mon.smithi192 smithi192 running (44s) 24s ago 12m 25.9M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 11edc5c1baba 2024-09-21T12:25:59.198 INFO:teuthology.orchestra.run.smithi003.stdout:node-exporter.smithi003 smithi003 *:9100 running (3m) 0s ago 13m 10.7M - 1.7.0 72c9c2088986 d9cb7ede9060 2024-09-21T12:25:59.198 INFO:teuthology.orchestra.run.smithi003.stdout:node-exporter.smithi192 smithi192 *:9100 running (3m) 24s ago 12m 11.6M - 1.7.0 72c9c2088986 d8ec0acfce7e 2024-09-21T12:25:59.199 INFO:teuthology.orchestra.run.smithi003.stdout:osd.0 smithi003 running (6s) 0s ago 11m 12.2M 1217M 19.3.0-5103-g5c1cdc3c 8f4d013db793 0f2234f333ec 2024-09-21T12:25:59.199 INFO:teuthology.orchestra.run.smithi003.stdout:osd.1 smithi003 running (11m) 0s ago 11m 212M 1217M 19.1.1-373-g4e45e6b4 164465d2334a 6abd75a07645 2024-09-21T12:25:59.199 INFO:teuthology.orchestra.run.smithi003.stdout:osd.2 smithi003 running (10m) 0s ago 10m 172M 1217M 19.1.1-373-g4e45e6b4 164465d2334a 3265369e573b 2024-09-21T12:25:59.199 INFO:teuthology.orchestra.run.smithi003.stdout:osd.3 smithi192 running (10m) 24s ago 10m 238M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 13efcfd71c05 2024-09-21T12:25:59.199 INFO:teuthology.orchestra.run.smithi003.stdout:osd.4 smithi192 running (9m) 24s ago 9m 204M 2240M 19.1.1-373-g4e45e6b4 164465d2334a f33bf453cb3e 2024-09-21T12:25:59.199 INFO:teuthology.orchestra.run.smithi003.stdout:osd.5 smithi192 running (9m) 24s ago 9m 182M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 12d7b7c8e985 2024-09-21T12:25:59.199 INFO:teuthology.orchestra.run.smithi003.stdout:prometheus.smithi003 smithi003 *:9095 running (2m) 0s ago 13m 50.2M - 2.51.0 1d3b7f56885b 64997a33fbbb 2024-09-21T12:25:59.200 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.198+0000 7f82f6fac640 1 -- 172.21.15.3:0/3894671769 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f82e007af30 msgr2=0x7f82e007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:25:59.200 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.198+0000 7f82f6fac640 1 --2- 172.21.15.3:0/3894671769 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f82e007af30 0x7f82e007d3f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f82f019b1a0 tx=0x7f82dc031400 comp rx=0 tx=0).stop 2024-09-21T12:25:59.200 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.198+0000 7f82f6fac640 1 -- 172.21.15.3:0/3894671769 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f82f01007f0 msgr2=0x7f82f019f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:25:59.200 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.198+0000 7f82f6fac640 1 --2- 172.21.15.3:0/3894671769 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f82f01007f0 0x7f82f019f7f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f82e400e970 tx=0x7f82e400ed70 comp rx=0 tx=0).stop 2024-09-21T12:25:59.200 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.198+0000 7f82f6fac640 1 -- 172.21.15.3:0/3894671769 shutdown_connections 2024-09-21T12:25:59.200 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.198+0000 7f82f6fac640 1 --2- 172.21.15.3:0/3894671769 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f82e007af30 0x7f82e007d3f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:25:59.200 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.198+0000 7f82f6fac640 1 --2- 172.21.15.3:0/3894671769 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f82f01067f0 0x7f82f019fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:25:59.200 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.198+0000 7f82f6fac640 1 --2- 172.21.15.3:0/3894671769 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f82f01007f0 0x7f82f019f7f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:25:59.200 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.198+0000 7f82f6fac640 1 -- 172.21.15.3:0/3894671769 >> 172.21.15.3:0/3894671769 conn(0x7f82f00fc550 msgr2=0x7f82f00fcc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:25:59.200 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.198+0000 7f82f6fac640 1 -- 172.21.15.3:0/3894671769 shutdown_connections 2024-09-21T12:25:59.200 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.198+0000 7f82f6fac640 1 -- 172.21.15.3:0/3894671769 wait complete. 2024-09-21T12:25:59.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.284+0000 7f7ff12e4640 1 -- 172.21.15.3:0/2148685446 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7fec107900 msgr2=0x7f7fec107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:25:59.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.284+0000 7f7ff12e4640 1 --2- 172.21.15.3:0/2148685446 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7fec107900 0x7f7fec107ce0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc009880 tx=0x7f7fdc02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:25:59.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.284+0000 7f7ff12e4640 1 -- 172.21.15.3:0/2148685446 shutdown_connections 2024-09-21T12:25:59.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.284+0000 7f7ff12e4640 1 --2- 172.21.15.3:0/2148685446 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7fec101900 0x7f7fec101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:25:59.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.284+0000 7f7ff12e4640 1 --2- 172.21.15.3:0/2148685446 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7fec107900 0x7f7fec107ce0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:25:59.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.284+0000 7f7ff12e4640 1 -- 172.21.15.3:0/2148685446 >> 172.21.15.3:0/2148685446 conn(0x7f7fec0fd5e0 msgr2=0x7f7fec0ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:25:59.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.284+0000 7f7ff12e4640 1 -- 172.21.15.3:0/2148685446 shutdown_connections 2024-09-21T12:25:59.286 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.284+0000 7f7ff12e4640 1 -- 172.21.15.3:0/2148685446 wait complete. 2024-09-21T12:25:59.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.284+0000 7f7ff12e4640 1 Processor -- start 2024-09-21T12:25:59.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.285+0000 7f7ff12e4640 1 -- start start 2024-09-21T12:25:59.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.285+0000 7f7ff12e4640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7fec101900 0x7f7fec19d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:25:59.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.285+0000 7f7ff12e4640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7fec107900 0x7f7fec19dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:25:59.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.285+0000 7f7ff12e4640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f7fec10edb0 con 0x7f7fec107900 2024-09-21T12:25:59.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.285+0000 7f7ff12e4640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7fec10ec30 con 0x7f7fec101900 2024-09-21T12:25:59.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.285+0000 7f7fea7fc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7fec107900 0x7f7fec19dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:25:59.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.285+0000 7f7fea7fc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7fec107900 0x7f7fec19dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:42662/0 (socket says 172.21.15.3:42662) 2024-09-21T12:25:59.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.285+0000 7f7fea7fc640 1 -- 172.21.15.3:0/830064367 learned_addr learned my addr 172.21.15.3:0/830064367 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:25:59.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.285+0000 7f7feaffd640 1 --2- 172.21.15.3:0/830064367 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7fec101900 0x7f7fec19d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:25:59.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.285+0000 7f7fea7fc640 1 -- 172.21.15.3:0/830064367 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7fec101900 msgr2=0x7f7fec19d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:25:59.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.285+0000 7f7fea7fc640 1 --2- 172.21.15.3:0/830064367 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7fec101900 0x7f7fec19d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:25:59.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.285+0000 7f7fea7fc640 1 -- 172.21.15.3:0/830064367 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fec197770 con 0x7f7fec107900 2024-09-21T12:25:59.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.286+0000 7f7fea7fc640 1 --2- 172.21.15.3:0/830064367 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7fec107900 0x7f7fec19dbe0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7fe000e970 tx=0x7f7fe000ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:25:59.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.286+0000 7f7fd3fff640 1 -- 172.21.15.3:0/830064367 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7fe000cac0 con 0x7f7fec107900 2024-09-21T12:25:59.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.286+0000 7f7ff12e4640 1 -- 172.21.15.3:0/830064367 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7fec197a60 con 0x7f7fec107900 2024-09-21T12:25:59.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.286+0000 7f7fd3fff640 1 -- 172.21.15.3:0/830064367 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7fe000cc60 con 0x7f7fec107900 2024-09-21T12:25:59.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.286+0000 7f7fd3fff640 1 -- 172.21.15.3:0/830064367 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7fe0018720 con 0x7f7fec107900 2024-09-21T12:25:59.289 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.286+0000 7f7ff12e4640 1 -- 172.21.15.3:0/830064367 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7fec197fc0 con 0x7f7fec107900 2024-09-21T12:25:59.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.287+0000 7f7ff12e4640 1 -- 172.21.15.3:0/830064367 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7fec103040 con 0x7f7fec107900 2024-09-21T12:25:59.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.288+0000 7f7fd3fff640 1 -- 172.21.15.3:0/830064367 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f7fe0010430 con 0x7f7fec107900 2024-09-21T12:25:59.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.288+0000 7f7fd3fff640 1 --2- 172.21.15.3:0/830064367 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f7fd407af30 0x7f7fd407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:25:59.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.288+0000 7f7fd3fff640 1 -- 172.21.15.3:0/830064367 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6156+0+0 (secure 0 0 0) 0x7f7fe009e6c0 con 0x7f7fec107900 2024-09-21T12:25:59.290 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.289+0000 7f7feaffd640 1 --2- 172.21.15.3:0/830064367 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f7fd407af30 0x7f7fd407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:25:59.291 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.289+0000 7f7feaffd640 1 --2- 172.21.15.3:0/830064367 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f7fd407af30 0x7f7fd407d3f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc0096c0 tx=0x7f7fdc031400 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:25:59.295 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.293+0000 7f7fd3fff640 1 -- 172.21.15.3:0/830064367 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7fe0069c20 con 0x7f7fec107900 2024-09-21T12:25:59.564 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.563+0000 7f7ff12e4640 1 -- 172.21.15.3:0/830064367 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f7fec104b10 con 0x7f7fec107900 2024-09-21T12:25:59.565 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.563+0000 7f7fd3fff640 1 -- 172.21.15.3:0/830064367 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+732 (secure 0 0 0) 0x7f7fe006ead0 con 0x7f7fec107900 2024-09-21T12:25:59.565 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-21T12:25:59.565 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": { 2024-09-21T12:25:59.565 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:25:59.565 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:25:59.565 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": { 2024-09-21T12:25:59.566 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:25:59.566 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:25:59.566 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": { 2024-09-21T12:25:59.566 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 5 2024-09-21T12:25:59.566 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:25:59.566 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": { 2024-09-21T12:25:59.566 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 4 2024-09-21T12:25:59.566 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:25:59.566 INFO:teuthology.orchestra.run.smithi003.stdout: "overall": { 2024-09-21T12:25:59.566 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 9, 2024-09-21T12:25:59.566 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 4 2024-09-21T12:25:59.566 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-21T12:25:59.566 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-21T12:25:59.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.567+0000 7f7ff12e4640 1 -- 172.21.15.3:0/830064367 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f7fd407af30 msgr2=0x7f7fd407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:25:59.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.567+0000 7f7ff12e4640 1 --2- 172.21.15.3:0/830064367 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f7fd407af30 0x7f7fd407d3f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7fdc0096c0 tx=0x7f7fdc031400 comp rx=0 tx=0).stop 2024-09-21T12:25:59.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.567+0000 7f7ff12e4640 1 -- 172.21.15.3:0/830064367 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7fec107900 msgr2=0x7f7fec19dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:25:59.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.567+0000 7f7ff12e4640 1 --2- 172.21.15.3:0/830064367 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7fec107900 0x7f7fec19dbe0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7fe000e970 tx=0x7f7fe000ee30 comp rx=0 tx=0).stop 2024-09-21T12:25:59.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.567+0000 7f7ff12e4640 1 -- 172.21.15.3:0/830064367 shutdown_connections 2024-09-21T12:25:59.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.567+0000 7f7ff12e4640 1 --2- 172.21.15.3:0/830064367 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f7fd407af30 0x7f7fd407d3f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:25:59.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.567+0000 7f7ff12e4640 1 --2- 172.21.15.3:0/830064367 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7fec107900 0x7f7fec19dbe0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:25:59.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.567+0000 7f7ff12e4640 1 --2- 172.21.15.3:0/830064367 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7fec101900 0x7f7fec19d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:25:59.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.567+0000 7f7ff12e4640 1 -- 172.21.15.3:0/830064367 >> 172.21.15.3:0/830064367 conn(0x7f7fec0fd5e0 msgr2=0x7f7fec0fefe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:25:59.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.567+0000 7f7ff12e4640 1 -- 172.21.15.3:0/830064367 shutdown_connections 2024-09-21T12:25:59.570 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.567+0000 7f7ff12e4640 1 -- 172.21.15.3:0/830064367 wait complete. 2024-09-21T12:25:59.676 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.674+0000 7f9ed821e640 1 -- 172.21.15.3:0/2644978218 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ed0100800 msgr2=0x7f9ed0100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:25:59.676 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.674+0000 7f9ed821e640 1 --2- 172.21.15.3:0/2644978218 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ed0100800 0x7f9ed0100c60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9ec0009880 tx=0x7f9ec002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:25:59.676 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.674+0000 7f9ed821e640 1 -- 172.21.15.3:0/2644978218 shutdown_connections 2024-09-21T12:25:59.676 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.674+0000 7f9ed821e640 1 --2- 172.21.15.3:0/2644978218 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ed0100800 0x7f9ed0100c60 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:25:59.676 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.674+0000 7f9ed821e640 1 --2- 172.21.15.3:0/2644978218 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ed0106800 0x7f9ed0106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:25:59.676 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.674+0000 7f9ed821e640 1 -- 172.21.15.3:0/2644978218 >> 172.21.15.3:0/2644978218 conn(0x7f9ed00fc520 msgr2=0x7f9ed00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:25:59.676 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.674+0000 7f9ed821e640 1 -- 172.21.15.3:0/2644978218 shutdown_connections 2024-09-21T12:25:59.676 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.674+0000 7f9ed821e640 1 -- 172.21.15.3:0/2644978218 wait complete. 2024-09-21T12:25:59.678 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.675+0000 7f9ed821e640 1 Processor -- start 2024-09-21T12:25:59.678 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.675+0000 7f9ed821e640 1 -- start start 2024-09-21T12:25:59.678 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.675+0000 7f9ed821e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ed0100800 0x7f9ed019d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:25:59.678 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.675+0000 7f9ed821e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ed0106800 0x7f9ed019dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:25:59.678 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.675+0000 7f9ed821e640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f9ed010dcd0 con 0x7f9ed0100800 2024-09-21T12:25:59.678 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.675+0000 7f9ed821e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9ed010db50 con 0x7f9ed0106800 2024-09-21T12:25:59.678 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.675+0000 7f9ed5fba640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ed0100800 0x7f9ed019d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:25:59.678 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.675+0000 7f9ed5fba640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ed0100800 0x7f9ed019d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:42676/0 (socket says 172.21.15.3:42676) 2024-09-21T12:25:59.679 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.675+0000 7f9ed5fba640 1 -- 172.21.15.3:0/2264911521 learned_addr learned my addr 172.21.15.3:0/2264911521 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:25:59.679 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.675+0000 7f9ed57b9640 1 --2- 172.21.15.3:0/2264911521 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ed0106800 0x7f9ed019dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:25:59.679 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.675+0000 7f9ed5fba640 1 -- 172.21.15.3:0/2264911521 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ed0106800 msgr2=0x7f9ed019dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:25:59.679 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.675+0000 7f9ed5fba640 1 --2- 172.21.15.3:0/2264911521 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ed0106800 0x7f9ed019dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:25:59.679 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.675+0000 7f9ed5fba640 1 -- 172.21.15.3:0/2264911521 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ed01977f0 con 0x7f9ed0100800 2024-09-21T12:25:59.679 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.676+0000 7f9ed5fba640 1 --2- 172.21.15.3:0/2264911521 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ed0100800 0x7f9ed019d670 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc00d6f0 tx=0x7f9ecc00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:25:59.679 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.676+0000 7f9ec6ffd640 1 -- 172.21.15.3:0/2264911521 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9ecc017070 con 0x7f9ed0100800 2024-09-21T12:25:59.679 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.676+0000 7f9ec6ffd640 1 -- 172.21.15.3:0/2264911521 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9ecc00de00 con 0x7f9ed0100800 2024-09-21T12:25:59.679 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.676+0000 7f9ed821e640 1 -- 172.21.15.3:0/2264911521 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ed0197ae0 con 0x7f9ed0100800 2024-09-21T12:25:59.679 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.676+0000 7f9ec6ffd640 1 -- 172.21.15.3:0/2264911521 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9ecc004bb0 con 0x7f9ed0100800 2024-09-21T12:25:59.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.676+0000 7f9ed821e640 1 -- 172.21.15.3:0/2264911521 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ed0198070 con 0x7f9ed0100800 2024-09-21T12:25:59.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.677+0000 7f9ed821e640 1 -- 172.21.15.3:0/2264911521 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ed0101f40 con 0x7f9ed0100800 2024-09-21T12:25:59.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.678+0000 7f9ec6ffd640 1 -- 172.21.15.3:0/2264911521 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f9ecc004e60 con 0x7f9ed0100800 2024-09-21T12:25:59.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.678+0000 7f9ec6ffd640 1 --2- 172.21.15.3:0/2264911521 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f9ebc07af30 0x7f9ebc07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:25:59.681 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.678+0000 7f9ec6ffd640 1 -- 172.21.15.3:0/2264911521 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6156+0+0 (secure 0 0 0) 0x7f9ecc09dcb0 con 0x7f9ed0100800 2024-09-21T12:25:59.681 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.678+0000 7f9ed57b9640 1 --2- 172.21.15.3:0/2264911521 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f9ebc07af30 0x7f9ebc07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:25:59.681 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.679+0000 7f9ed57b9640 1 --2- 172.21.15.3:0/2264911521 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f9ebc07af30 0x7f9ebc07d3f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9ec0031460 tx=0x7f9ec0009560 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:25:59.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.683+0000 7f9ec6ffd640 1 -- 172.21.15.3:0/2264911521 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9ecc069250 con 0x7f9ed0100800 2024-09-21T12:25:59.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:59 smithi003 ceph-mon[108723]: from='client.34130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:25:59.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:59 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:59.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:59 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:59.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:59 smithi003 ceph-mon[108723]: pgmap v125: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 55/279 objects degraded (19.713%) 2024-09-21T12:25:59.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:59 smithi003 ceph-mon[108723]: from='client.44123 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:25:59.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:59 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:59.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:59 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:59.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:59 smithi003 ceph-mon[108723]: from='client.? 172.21.15.3:0/830064367' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:25:59.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:59 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:25:59.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:25:59 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:25:59.923 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.921+0000 7f9ed821e640 1 -- 172.21.15.3:0/2264911521 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f9ed0109d80 con 0x7f9ed0100800 2024-09-21T12:25:59.923 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.922+0000 7f9ec6ffd640 1 -- 172.21.15.3:0/2264911521 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) ==== 76+0+2010 (secure 0 0 0) 0x7f9ecc06e100 con 0x7f9ed0100800 2024-09-21T12:25:59.924 INFO:teuthology.orchestra.run.smithi003.stdout:e14 2024-09-21T12:25:59.924 INFO:teuthology.orchestra.run.smithi003.stdout:btime 2024-09-21T12:17:55:592931+0000 2024-09-21T12:25:59.924 INFO:teuthology.orchestra.run.smithi003.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T12:25:59.924 INFO:teuthology.orchestra.run.smithi003.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:25:59.924 INFO:teuthology.orchestra.run.smithi003.stdout:legacy client fscid: 1 2024-09-21T12:25:59.924 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:25:59.924 INFO:teuthology.orchestra.run.smithi003.stdout:Filesystem 'cephfs' (1) 2024-09-21T12:25:59.924 INFO:teuthology.orchestra.run.smithi003.stdout:fs_name cephfs 2024-09-21T12:25:59.924 INFO:teuthology.orchestra.run.smithi003.stdout:epoch 14 2024-09-21T12:25:59.924 INFO:teuthology.orchestra.run.smithi003.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T12:25:59.924 INFO:teuthology.orchestra.run.smithi003.stdout:created 2024-09-21T12:17:38.260099+0000 2024-09-21T12:25:59.924 INFO:teuthology.orchestra.run.smithi003.stdout:modified 2024-09-21T12:17:55.592927+0000 2024-09-21T12:25:59.924 INFO:teuthology.orchestra.run.smithi003.stdout:tableserver 0 2024-09-21T12:25:59.925 INFO:teuthology.orchestra.run.smithi003.stdout:root 0 2024-09-21T12:25:59.925 INFO:teuthology.orchestra.run.smithi003.stdout:session_timeout 60 2024-09-21T12:25:59.925 INFO:teuthology.orchestra.run.smithi003.stdout:session_autoclose 300 2024-09-21T12:25:59.925 INFO:teuthology.orchestra.run.smithi003.stdout:max_file_size 1099511627776 2024-09-21T12:25:59.925 INFO:teuthology.orchestra.run.smithi003.stdout:max_xattr_size 65536 2024-09-21T12:25:59.925 INFO:teuthology.orchestra.run.smithi003.stdout:required_client_features {} 2024-09-21T12:25:59.925 INFO:teuthology.orchestra.run.smithi003.stdout:last_failure 0 2024-09-21T12:25:59.925 INFO:teuthology.orchestra.run.smithi003.stdout:last_failure_osd_epoch 46 2024-09-21T12:25:59.925 INFO:teuthology.orchestra.run.smithi003.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:25:59.925 INFO:teuthology.orchestra.run.smithi003.stdout:max_mds 1 2024-09-21T12:25:59.925 INFO:teuthology.orchestra.run.smithi003.stdout:in 0 2024-09-21T12:25:59.925 INFO:teuthology.orchestra.run.smithi003.stdout:up {0=14564} 2024-09-21T12:25:59.925 INFO:teuthology.orchestra.run.smithi003.stdout:failed 2024-09-21T12:25:59.925 INFO:teuthology.orchestra.run.smithi003.stdout:damaged 2024-09-21T12:25:59.926 INFO:teuthology.orchestra.run.smithi003.stdout:stopped 2024-09-21T12:25:59.926 INFO:teuthology.orchestra.run.smithi003.stdout:data_pools [3] 2024-09-21T12:25:59.926 INFO:teuthology.orchestra.run.smithi003.stdout:metadata_pool 2 2024-09-21T12:25:59.926 INFO:teuthology.orchestra.run.smithi003.stdout:inline_data enabled 2024-09-21T12:25:59.926 INFO:teuthology.orchestra.run.smithi003.stdout:balancer 2024-09-21T12:25:59.926 INFO:teuthology.orchestra.run.smithi003.stdout:bal_rank_mask -1 2024-09-21T12:25:59.926 INFO:teuthology.orchestra.run.smithi003.stdout:standby_count_wanted 1 2024-09-21T12:25:59.926 INFO:teuthology.orchestra.run.smithi003.stdout:qdb_cluster leader: 14564 members: 14564 2024-09-21T12:25:59.926 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.cephfs.smithi003.gfkngj{0:14564} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.3:6828/3710817325,v1:172.21.15.3:6829/3710817325] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:25:59.926 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:25:59.926 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:25:59.926 INFO:teuthology.orchestra.run.smithi003.stdout:Standby daemons: 2024-09-21T12:25:59.926 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:25:59.926 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.cephfs.smithi192.ywqqxe{-1:24319} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.192:6824/4055220871,v1:172.21.15.192:6825/4055220871] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:25:59.927 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.cephfs.smithi192.ktdqns{-1:24337} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.192:6826/318800854,v1:172.21.15.192:6827/318800854] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:25:59.927 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.cephfs.smithi003.ebjgyl{-1:24345} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.3:6826/55902996,v1:172.21.15.3:6827/55902996] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:25:59.927 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 14 2024-09-21T12:25:59.927 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.924+0000 7f9ed821e640 1 -- 172.21.15.3:0/2264911521 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f9ebc07af30 msgr2=0x7f9ebc07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:25:59.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.924+0000 7f9ed821e640 1 --2- 172.21.15.3:0/2264911521 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f9ebc07af30 0x7f9ebc07d3f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9ec0031460 tx=0x7f9ec0009560 comp rx=0 tx=0).stop 2024-09-21T12:25:59.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.924+0000 7f9ed821e640 1 -- 172.21.15.3:0/2264911521 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ed0100800 msgr2=0x7f9ed019d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:25:59.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.924+0000 7f9ed821e640 1 --2- 172.21.15.3:0/2264911521 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ed0100800 0x7f9ed019d670 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9ecc00d6f0 tx=0x7f9ecc00dbb0 comp rx=0 tx=0).stop 2024-09-21T12:25:59.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.924+0000 7f9ed821e640 1 -- 172.21.15.3:0/2264911521 shutdown_connections 2024-09-21T12:25:59.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.924+0000 7f9ed821e640 1 --2- 172.21.15.3:0/2264911521 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f9ebc07af30 0x7f9ebc07d3f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:25:59.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.924+0000 7f9ed821e640 1 --2- 172.21.15.3:0/2264911521 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ed0106800 0x7f9ed019dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:25:59.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.924+0000 7f9ed821e640 1 --2- 172.21.15.3:0/2264911521 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ed0100800 0x7f9ed019d670 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:25:59.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.924+0000 7f9ed821e640 1 -- 172.21.15.3:0/2264911521 >> 172.21.15.3:0/2264911521 conn(0x7f9ed00fc520 msgr2=0x7f9ed006a4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:25:59.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.924+0000 7f9ed821e640 1 -- 172.21.15.3:0/2264911521 shutdown_connections 2024-09-21T12:25:59.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:25:59.924+0000 7f9ed821e640 1 -- 172.21.15.3:0/2264911521 wait complete. 2024-09-21T12:26:00.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:59 smithi192 ceph-mon[80326]: from='client.34130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:26:00.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:59 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:26:00.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:59 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:26:00.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:59 smithi192 ceph-mon[80326]: pgmap v125: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 55/279 objects degraded (19.713%) 2024-09-21T12:26:00.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:59 smithi192 ceph-mon[80326]: from='client.44123 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:26:00.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:59 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:26:00.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:59 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:26:00.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:59 smithi192 ceph-mon[80326]: from='client.? 172.21.15.3:0/830064367' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:26:00.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:59 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:26:00.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:25:59 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:26:00.015 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.013+0000 7f4b2d15a640 1 -- 172.21.15.3:0/3191884640 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4b28102b50 msgr2=0x7f4b28102f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:26:00.015 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.013+0000 7f4b2d15a640 1 --2- 172.21.15.3:0/3191884640 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4b28102b50 0x7f4b28102f30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4b18009880 tx=0x7f4b1802a530 comp rx=0 tx=0).stop 2024-09-21T12:26:00.015 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.013+0000 7f4b2d15a640 1 -- 172.21.15.3:0/3191884640 shutdown_connections 2024-09-21T12:26:00.015 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.013+0000 7f4b2d15a640 1 --2- 172.21.15.3:0/3191884640 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4b28103470 0x7f4b2810b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:26:00.015 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.013+0000 7f4b2d15a640 1 --2- 172.21.15.3:0/3191884640 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4b28102b50 0x7f4b28102f30 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:26:00.015 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.013+0000 7f4b2d15a640 1 -- 172.21.15.3:0/3191884640 >> 172.21.15.3:0/3191884640 conn(0x7f4b280fc550 msgr2=0x7f4b280fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:26:00.015 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.013+0000 7f4b2d15a640 1 -- 172.21.15.3:0/3191884640 shutdown_connections 2024-09-21T12:26:00.015 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.013+0000 7f4b2d15a640 1 -- 172.21.15.3:0/3191884640 wait complete. 2024-09-21T12:26:00.017 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.014+0000 7f4b2d15a640 1 Processor -- start 2024-09-21T12:26:00.017 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.014+0000 7f4b2d15a640 1 -- start start 2024-09-21T12:26:00.017 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.015+0000 7f4b2d15a640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4b28102b50 0x7f4b2819d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:26:00.017 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.015+0000 7f4b2d15a640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4b28103470 0x7f4b2819db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:26:00.017 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.015+0000 7f4b2d15a640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f4b2810ede0 con 0x7f4b28103470 2024-09-21T12:26:00.017 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.015+0000 7f4b2d15a640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f4b2810ec60 con 0x7f4b28102b50 2024-09-21T12:26:00.017 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.015+0000 7f4b2659c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4b28103470 0x7f4b2819db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:26:00.017 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.015+0000 7f4b26d9d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4b28102b50 0x7f4b2819d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:26:00.017 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.015+0000 7f4b2659c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4b28103470 0x7f4b2819db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:42686/0 (socket says 172.21.15.3:42686) 2024-09-21T12:26:00.017 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.015+0000 7f4b2659c640 1 -- 172.21.15.3:0/1132454870 learned_addr learned my addr 172.21.15.3:0/1132454870 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:26:00.017 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.015+0000 7f4b26d9d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4b28102b50 0x7f4b2819d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.3:56788/0 (socket says 172.21.15.3:56788) 2024-09-21T12:26:00.017 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.015+0000 7f4b2659c640 1 -- 172.21.15.3:0/1132454870 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4b28102b50 msgr2=0x7f4b2819d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:26:00.018 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.015+0000 7f4b2659c640 1 --2- 172.21.15.3:0/1132454870 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4b28102b50 0x7f4b2819d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:26:00.018 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.015+0000 7f4b2659c640 1 -- 172.21.15.3:0/1132454870 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b281977d0 con 0x7f4b28103470 2024-09-21T12:26:00.018 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.015+0000 7f4b26d9d640 1 --2- 172.21.15.3:0/1132454870 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4b28102b50 0x7f4b2819d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T12:26:00.019 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.015+0000 7f4b2659c640 1 --2- 172.21.15.3:0/1132454870 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4b28103470 0x7f4b2819db90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c00d6f0 tx=0x7f4b1c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:26:00.019 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.016+0000 7f4b0ffff640 1 -- 172.21.15.3:0/1132454870 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4b1c017070 con 0x7f4b28103470 2024-09-21T12:26:00.019 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.016+0000 7f4b0ffff640 1 -- 172.21.15.3:0/1132454870 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4b1c00de00 con 0x7f4b28103470 2024-09-21T12:26:00.019 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.016+0000 7f4b0ffff640 1 -- 172.21.15.3:0/1132454870 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4b1c004bb0 con 0x7f4b28103470 2024-09-21T12:26:00.019 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.016+0000 7f4b2d15a640 1 -- 172.21.15.3:0/1132454870 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b28197ac0 con 0x7f4b28103470 2024-09-21T12:26:00.019 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.016+0000 7f4b2d15a640 1 -- 172.21.15.3:0/1132454870 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b28198050 con 0x7f4b28103470 2024-09-21T12:26:00.019 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.017+0000 7f4b2d15a640 1 -- 172.21.15.3:0/1132454870 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b2806a4e0 con 0x7f4b28103470 2024-09-21T12:26:00.019 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.018+0000 7f4b0ffff640 1 -- 172.21.15.3:0/1132454870 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f4b1c004e60 con 0x7f4b28103470 2024-09-21T12:26:00.020 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.018+0000 7f4b0ffff640 1 --2- 172.21.15.3:0/1132454870 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f4b1007af30 0x7f4b1007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:26:00.020 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.018+0000 7f4b26d9d640 1 --2- 172.21.15.3:0/1132454870 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f4b1007af30 0x7f4b1007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:26:00.020 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.018+0000 7f4b0ffff640 1 -- 172.21.15.3:0/1132454870 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6156+0+0 (secure 0 0 0) 0x7f4b1c09dba0 con 0x7f4b28103470 2024-09-21T12:26:00.020 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.019+0000 7f4b26d9d640 1 --2- 172.21.15.3:0/1132454870 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f4b1007af30 0x7f4b1007d3f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4b180096c0 tx=0x7f4b18004f30 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:26:00.024 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.023+0000 7f4b0ffff640 1 -- 172.21.15.3:0/1132454870 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4b1c0691a0 con 0x7f4b28103470 2024-09-21T12:26:00.258 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.257+0000 7f4b2d15a640 1 -- 172.21.15.3:0/1132454870 --> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f4b28198300 con 0x7f4b1007af30 2024-09-21T12:26:00.259 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.258+0000 7f4b0ffff640 1 -- 172.21.15.3:0/1132454870 <== mgr.14756 v2:172.21.15.3:6800/1284098095 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f4b28198300 con 0x7f4b1007af30 2024-09-21T12:26:00.260 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-21T12:26:00.260 INFO:teuthology.orchestra.run.smithi003.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T12:26:00.260 INFO:teuthology.orchestra.run.smithi003.stdout: "in_progress": true, 2024-09-21T12:26:00.260 INFO:teuthology.orchestra.run.smithi003.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T12:26:00.260 INFO:teuthology.orchestra.run.smithi003.stdout: "services_complete": [ 2024-09-21T12:26:00.260 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr", 2024-09-21T12:26:00.260 INFO:teuthology.orchestra.run.smithi003.stdout: "mon", 2024-09-21T12:26:00.260 INFO:teuthology.orchestra.run.smithi003.stdout: "crash" 2024-09-21T12:26:00.260 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-21T12:26:00.260 INFO:teuthology.orchestra.run.smithi003.stdout: "progress": "7/23 daemons upgraded", 2024-09-21T12:26:00.260 INFO:teuthology.orchestra.run.smithi003.stdout: "message": "Currently upgrading osd daemons", 2024-09-21T12:26:00.260 INFO:teuthology.orchestra.run.smithi003.stdout: "is_paused": false 2024-09-21T12:26:00.260 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-21T12:26:00.262 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.260+0000 7f4b2d15a640 1 -- 172.21.15.3:0/1132454870 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f4b1007af30 msgr2=0x7f4b1007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:26:00.262 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.260+0000 7f4b2d15a640 1 --2- 172.21.15.3:0/1132454870 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f4b1007af30 0x7f4b1007d3f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4b180096c0 tx=0x7f4b18004f30 comp rx=0 tx=0).stop 2024-09-21T12:26:00.263 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.261+0000 7f4b2d15a640 1 -- 172.21.15.3:0/1132454870 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4b28103470 msgr2=0x7f4b2819db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:26:00.263 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.261+0000 7f4b2d15a640 1 --2- 172.21.15.3:0/1132454870 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4b28103470 0x7f4b2819db90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c00d6f0 tx=0x7f4b1c00dbb0 comp rx=0 tx=0).stop 2024-09-21T12:26:00.263 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.261+0000 7f4b2d15a640 1 -- 172.21.15.3:0/1132454870 shutdown_connections 2024-09-21T12:26:00.263 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.261+0000 7f4b2d15a640 1 --2- 172.21.15.3:0/1132454870 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f4b1007af30 0x7f4b1007d3f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:26:00.263 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.261+0000 7f4b2d15a640 1 --2- 172.21.15.3:0/1132454870 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4b28103470 0x7f4b2819db90 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:26:00.263 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.261+0000 7f4b2d15a640 1 --2- 172.21.15.3:0/1132454870 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4b28102b50 0x7f4b2819d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:26:00.263 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.261+0000 7f4b2d15a640 1 -- 172.21.15.3:0/1132454870 >> 172.21.15.3:0/1132454870 conn(0x7f4b280fc550 msgr2=0x7f4b28108f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:26:00.263 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.261+0000 7f4b2d15a640 1 -- 172.21.15.3:0/1132454870 shutdown_connections 2024-09-21T12:26:00.263 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.261+0000 7f4b2d15a640 1 -- 172.21.15.3:0/1132454870 wait complete. 2024-09-21T12:26:00.351 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.349+0000 7fe37c867640 1 -- 172.21.15.3:0/476794059 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe378101070 msgr2=0x7fe37810dd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:26:00.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.349+0000 7fe37c867640 1 --2- 172.21.15.3:0/476794059 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe378101070 0x7fe37810dd30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe36c009880 tx=0x7fe36c02a490 comp rx=0 tx=0).stop 2024-09-21T12:26:00.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.349+0000 7fe37c867640 1 -- 172.21.15.3:0/476794059 shutdown_connections 2024-09-21T12:26:00.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.349+0000 7fe37c867640 1 --2- 172.21.15.3:0/476794059 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe378101070 0x7fe37810dd30 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:26:00.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.349+0000 7fe37c867640 1 --2- 172.21.15.3:0/476794059 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe3781006c0 0x7fe378100aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:26:00.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.349+0000 7fe37c867640 1 -- 172.21.15.3:0/476794059 >> 172.21.15.3:0/476794059 conn(0x7fe3780fc550 msgr2=0x7fe3780fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:26:00.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.350+0000 7fe37c867640 1 -- 172.21.15.3:0/476794059 shutdown_connections 2024-09-21T12:26:00.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.350+0000 7fe37c867640 1 -- 172.21.15.3:0/476794059 wait complete. 2024-09-21T12:26:00.353 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.350+0000 7fe37c867640 1 Processor -- start 2024-09-21T12:26:00.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.350+0000 7fe37c867640 1 -- start start 2024-09-21T12:26:00.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.351+0000 7fe37c867640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe3781006c0 0x7fe37819f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:26:00.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.351+0000 7fe37c867640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe378101070 0x7fe37819fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:26:00.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.351+0000 7fe37c867640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fe378110f60 con 0x7fe3781006c0 2024-09-21T12:26:00.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.351+0000 7fe37c867640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe378110de0 con 0x7fe378101070 2024-09-21T12:26:00.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.351+0000 7fe37659c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe3781006c0 0x7fe37819f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:26:00.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.351+0000 7fe37659c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe3781006c0 0x7fe37819f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:42690/0 (socket says 172.21.15.3:42690) 2024-09-21T12:26:00.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.351+0000 7fe37659c640 1 -- 172.21.15.3:0/81047647 learned_addr learned my addr 172.21.15.3:0/81047647 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:26:00.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.351+0000 7fe375d9b640 1 --2- 172.21.15.3:0/81047647 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe378101070 0x7fe37819fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:26:00.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.351+0000 7fe37659c640 1 -- 172.21.15.3:0/81047647 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe378101070 msgr2=0x7fe37819fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:26:00.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.351+0000 7fe37659c640 1 --2- 172.21.15.3:0/81047647 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe378101070 0x7fe37819fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:26:00.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.351+0000 7fe37659c640 1 -- 172.21.15.3:0/81047647 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe378199950 con 0x7fe3781006c0 2024-09-21T12:26:00.355 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.351+0000 7fe37659c640 1 --2- 172.21.15.3:0/81047647 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe3781006c0 0x7fe37819f790 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe36800e970 tx=0x7fe36800ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:26:00.355 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.352+0000 7fe3677fe640 1 -- 172.21.15.3:0/81047647 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe36800cac0 con 0x7fe3781006c0 2024-09-21T12:26:00.355 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.352+0000 7fe37c867640 1 -- 172.21.15.3:0/81047647 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe378199c40 con 0x7fe3781006c0 2024-09-21T12:26:00.355 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.352+0000 7fe3677fe640 1 -- 172.21.15.3:0/81047647 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe36800cc60 con 0x7fe3781006c0 2024-09-21T12:26:00.355 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.352+0000 7fe3677fe640 1 -- 172.21.15.3:0/81047647 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe368018720 con 0x7fe3781006c0 2024-09-21T12:26:00.355 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.352+0000 7fe37c867640 1 -- 172.21.15.3:0/81047647 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe37819a1a0 con 0x7fe3781006c0 2024-09-21T12:26:00.355 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.353+0000 7fe37c867640 1 -- 172.21.15.3:0/81047647 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe37806a500 con 0x7fe3781006c0 2024-09-21T12:26:00.355 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.354+0000 7fe3677fe640 1 -- 172.21.15.3:0/81047647 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7fe368010430 con 0x7fe3781006c0 2024-09-21T12:26:00.356 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.354+0000 7fe3677fe640 1 --2- 172.21.15.3:0/81047647 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fe36007af30 0x7fe36007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:26:00.356 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.355+0000 7fe3677fe640 1 -- 172.21.15.3:0/81047647 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 6156+0+0 (secure 0 0 0) 0x7fe36809e620 con 0x7fe3781006c0 2024-09-21T12:26:00.356 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.355+0000 7fe375d9b640 1 --2- 172.21.15.3:0/81047647 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fe36007af30 0x7fe36007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:26:00.357 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.355+0000 7fe375d9b640 1 --2- 172.21.15.3:0/81047647 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fe36007af30 0x7fe36007d3f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe37819b140 tx=0x7fe36c031400 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:26:00.364 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.363+0000 7fe3677fe640 1 -- 172.21.15.3:0/81047647 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe368069c20 con 0x7fe3781006c0 2024-09-21T12:26:00.579 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:26:00 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-0[117249]: 2024-09-21T12:26:00.471+0000 7f747ed7c640 -1 osd.0 48 log_to_monitors true 2024-09-21T12:26:00.637 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.636+0000 7fe37c867640 1 -- 172.21.15.3:0/81047647 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fe37819ae80 con 0x7fe3781006c0 2024-09-21T12:26:00.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.636+0000 7fe3677fe640 1 -- 172.21.15.3:0/81047647 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+1517 (secure 0 0 0) 0x7fe36806ead0 con 0x7fe3781006c0 2024-09-21T12:26:00.638 INFO:teuthology.orchestra.run.smithi003.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Degraded data redundancy: 55/279 objects degraded (19.713%), 19 pgs degraded 2024-09-21T12:26:00.638 INFO:teuthology.orchestra.run.smithi003.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:26:00.638 INFO:teuthology.orchestra.run.smithi003.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:26:00.638 INFO:teuthology.orchestra.run.smithi003.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-21T12:26:00.638 INFO:teuthology.orchestra.run.smithi003.stdout: osd.0 (root=default,host=smithi003) is down 2024-09-21T12:26:00.638 INFO:teuthology.orchestra.run.smithi003.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 55/279 objects degraded (19.713%), 19 pgs degraded 2024-09-21T12:26:00.638 INFO:teuthology.orchestra.run.smithi003.stdout: pg 1.0 is active+undersized+degraded, acting [3,1] 2024-09-21T12:26:00.638 INFO:teuthology.orchestra.run.smithi003.stdout: pg 2.0 is active+undersized+degraded, acting [3,1] 2024-09-21T12:26:00.638 INFO:teuthology.orchestra.run.smithi003.stdout: pg 2.1 is active+undersized+degraded, acting [2,1] 2024-09-21T12:26:00.639 INFO:teuthology.orchestra.run.smithi003.stdout: pg 2.2 is active+undersized+degraded, acting [5,1] 2024-09-21T12:26:00.639 INFO:teuthology.orchestra.run.smithi003.stdout: pg 2.4 is active+undersized+degraded, acting [1,4] 2024-09-21T12:26:00.639 INFO:teuthology.orchestra.run.smithi003.stdout: pg 2.5 is active+undersized+degraded, acting [3,4] 2024-09-21T12:26:00.639 INFO:teuthology.orchestra.run.smithi003.stdout: pg 2.8 is active+undersized+degraded, acting [3,5] 2024-09-21T12:26:00.639 INFO:teuthology.orchestra.run.smithi003.stdout: pg 2.9 is active+undersized+degraded, acting [1,4] 2024-09-21T12:26:00.639 INFO:teuthology.orchestra.run.smithi003.stdout: pg 2.c is active+undersized+degraded, acting [2,3] 2024-09-21T12:26:00.639 INFO:teuthology.orchestra.run.smithi003.stdout: pg 2.e is active+undersized+degraded, acting [2,3] 2024-09-21T12:26:00.639 INFO:teuthology.orchestra.run.smithi003.stdout: pg 2.f is active+undersized+degraded, acting [4,5] 2024-09-21T12:26:00.639 INFO:teuthology.orchestra.run.smithi003.stdout: pg 2.10 is active+undersized+degraded, acting [2,1] 2024-09-21T12:26:00.639 INFO:teuthology.orchestra.run.smithi003.stdout: pg 2.13 is active+undersized+degraded, acting [4,2] 2024-09-21T12:26:00.639 INFO:teuthology.orchestra.run.smithi003.stdout: pg 2.15 is active+undersized+degraded, acting [1,3] 2024-09-21T12:26:00.639 INFO:teuthology.orchestra.run.smithi003.stdout: pg 2.19 is active+undersized+degraded, acting [4,2] 2024-09-21T12:26:00.639 INFO:teuthology.orchestra.run.smithi003.stdout: pg 2.1b is active+undersized+degraded, acting [1,5] 2024-09-21T12:26:00.639 INFO:teuthology.orchestra.run.smithi003.stdout: pg 2.1d is active+undersized+degraded, acting [3,5] 2024-09-21T12:26:00.640 INFO:teuthology.orchestra.run.smithi003.stdout: pg 2.1e is active+undersized+degraded, acting [2,5] 2024-09-21T12:26:00.640 INFO:teuthology.orchestra.run.smithi003.stdout: pg 2.1f is active+undersized+degraded, acting [3,4] 2024-09-21T12:26:00.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.638+0000 7fe37c867640 1 -- 172.21.15.3:0/81047647 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fe36007af30 msgr2=0x7fe36007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:26:00.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.638+0000 7fe37c867640 1 --2- 172.21.15.3:0/81047647 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fe36007af30 0x7fe36007d3f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe37819b140 tx=0x7fe36c031400 comp rx=0 tx=0).stop 2024-09-21T12:26:00.640 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.638+0000 7fe37c867640 1 -- 172.21.15.3:0/81047647 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe3781006c0 msgr2=0x7fe37819f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:26:00.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.638+0000 7fe37c867640 1 --2- 172.21.15.3:0/81047647 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe3781006c0 0x7fe37819f790 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fe36800e970 tx=0x7fe36800ee30 comp rx=0 tx=0).stop 2024-09-21T12:26:00.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.638+0000 7fe37c867640 1 -- 172.21.15.3:0/81047647 shutdown_connections 2024-09-21T12:26:00.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.638+0000 7fe37c867640 1 --2- 172.21.15.3:0/81047647 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fe36007af30 0x7fe36007d3f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:26:00.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.638+0000 7fe37c867640 1 --2- 172.21.15.3:0/81047647 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe378101070 0x7fe37819fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:26:00.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.638+0000 7fe37c867640 1 --2- 172.21.15.3:0/81047647 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe3781006c0 0x7fe37819f790 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:26:00.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.638+0000 7fe37c867640 1 -- 172.21.15.3:0/81047647 >> 172.21.15.3:0/81047647 conn(0x7fe3780fc550 msgr2=0x7fe3780fd950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:26:00.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.639+0000 7fe37c867640 1 -- 172.21.15.3:0/81047647 shutdown_connections 2024-09-21T12:26:00.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:00.639+0000 7fe37c867640 1 -- 172.21.15.3:0/81047647 wait complete. 2024-09-21T12:26:00.943 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:26:00 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-0[117249]: 2024-09-21T12:26:00.724+0000 7f7472b1e640 -1 osd.0 48 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T12:26:00.944 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:00 smithi003 ceph-mon[108723]: from='client.34138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:26:00.944 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:00 smithi003 ceph-mon[108723]: from='client.? 172.21.15.3:0/2264911521' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:26:00.944 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:00 smithi003 ceph-mon[108723]: from='osd.0 [v2:172.21.15.3:6802/114667124,v1:172.21.15.3:6803/114667124]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T12:26:00.944 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:00 smithi003 ceph-mon[108723]: from='client.? 172.21.15.3:0/81047647' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:26:00.998 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:00 smithi192 ceph-mon[80326]: from='client.34138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:26:00.998 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:00 smithi192 ceph-mon[80326]: from='client.? 172.21.15.3:0/2264911521' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:26:00.998 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:00 smithi192 ceph-mon[80326]: from='osd.0 [v2:172.21.15.3:6802/114667124,v1:172.21.15.3:6803/114667124]' entity='osd.0' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]} : dispatch 2024-09-21T12:26:00.998 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:00 smithi192 ceph-mon[80326]: from='client.? 172.21.15.3:0/81047647' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:26:02.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:01 smithi192 ceph-mon[80326]: from='client.34150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:26:02.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:01 smithi192 ceph-mon[80326]: from='osd.0 [v2:172.21.15.3:6802/114667124,v1:172.21.15.3:6803/114667124]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T12:26:02.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:01 smithi192 ceph-mon[80326]: osdmap e51: 6 total, 5 up, 6 in 2024-09-21T12:26:02.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:01 smithi192 ceph-mon[80326]: from='osd.0 [v2:172.21.15.3:6802/114667124,v1:172.21.15.3:6803/114667124]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi003", "root=default"]} : dispatch 2024-09-21T12:26:02.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:01 smithi192 ceph-mon[80326]: pgmap v127: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 55/279 objects degraded (19.713%) 2024-09-21T12:26:02.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:01 smithi003 ceph-mon[108723]: from='client.34150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:26:02.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:01 smithi003 ceph-mon[108723]: from='osd.0 [v2:172.21.15.3:6802/114667124,v1:172.21.15.3:6803/114667124]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-21T12:26:02.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:01 smithi003 ceph-mon[108723]: osdmap e51: 6 total, 5 up, 6 in 2024-09-21T12:26:02.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:01 smithi003 ceph-mon[108723]: from='osd.0 [v2:172.21.15.3:6802/114667124,v1:172.21.15.3:6803/114667124]' entity='osd.0' cmd={"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi003", "root=default"]} : dispatch 2024-09-21T12:26:02.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:01 smithi003 ceph-mon[108723]: pgmap v127: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 55/279 objects degraded (19.713%) 2024-09-21T12:26:03.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:02 smithi192 ceph-mon[80326]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T12:26:03.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:02 smithi192 ceph-mon[80326]: osd.0 [v2:172.21.15.3:6802/114667124,v1:172.21.15.3:6803/114667124] boot 2024-09-21T12:26:03.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:02 smithi192 ceph-mon[80326]: osdmap e52: 6 total, 6 up, 6 in 2024-09-21T12:26:03.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:02 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T12:26:03.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:02 smithi192 ceph-mon[80326]: osdmap e53: 6 total, 6 up, 6 in 2024-09-21T12:26:03.054 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:02 smithi003 ceph-mon[108723]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T12:26:03.054 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:02 smithi003 ceph-mon[108723]: osd.0 [v2:172.21.15.3:6802/114667124,v1:172.21.15.3:6803/114667124] boot 2024-09-21T12:26:03.054 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:02 smithi003 ceph-mon[108723]: osdmap e52: 6 total, 6 up, 6 in 2024-09-21T12:26:03.054 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:02 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd metadata", "id": 0} : dispatch 2024-09-21T12:26:03.054 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:02 smithi003 ceph-mon[108723]: osdmap e53: 6 total, 6 up, 6 in 2024-09-21T12:26:04.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:03 smithi192 ceph-mon[80326]: pgmap v130: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 55/279 objects degraded (19.713%) 2024-09-21T12:26:04.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:03 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:26:04.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:03 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:26:04.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:03 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:26:04.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:03 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:26:04.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:03 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:26:04.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:03 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:26:04.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:03 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:26:04.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:03 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:26:04.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:03 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:26:04.259 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:03 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-21T12:26:04.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:03 smithi003 ceph-mon[108723]: pgmap v130: 65 pgs: 15 active+undersized, 19 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 55/279 objects degraded (19.713%) 2024-09-21T12:26:04.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:03 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:26:04.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:03 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:26:04.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:03 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:26:04.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:03 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:26:04.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:03 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:26:04.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:03 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:26:04.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:03 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:26:04.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:03 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:26:04.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:03 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:26:04.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:03 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-21T12:26:05.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:04 smithi192 ceph-mon[80326]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-21T12:26:05.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:04 smithi192 ceph-mon[80326]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-21T12:26:05.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:04 smithi003 ceph-mon[108723]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-21T12:26:05.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:04 smithi003 ceph-mon[108723]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-21T12:26:06.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:05 smithi192 ceph-mon[80326]: pgmap v131: 65 pgs: 6 active+undersized, 3 active+undersized+degraded, 56 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 8/279 objects degraded (2.867%) 2024-09-21T12:26:06.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:05 smithi192 ceph-mon[80326]: Health check update: Degraded data redundancy: 8/279 objects degraded (2.867%), 3 pgs degraded (PG_DEGRADED) 2024-09-21T12:26:06.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:05 smithi003 ceph-mon[108723]: pgmap v131: 65 pgs: 6 active+undersized, 3 active+undersized+degraded, 56 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 8/279 objects degraded (2.867%) 2024-09-21T12:26:06.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:05 smithi003 ceph-mon[108723]: Health check update: Degraded data redundancy: 8/279 objects degraded (2.867%), 3 pgs degraded (PG_DEGRADED) 2024-09-21T12:26:07.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:06 smithi192 ceph-mon[80326]: pgmap v132: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:26:07.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:06 smithi192 ceph-mon[80326]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 8/279 objects degraded (2.867%), 3 pgs degraded) 2024-09-21T12:26:07.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:06 smithi003 ceph-mon[108723]: pgmap v132: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:26:07.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:06 smithi003 ceph-mon[108723]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 8/279 objects degraded (2.867%), 3 pgs degraded) 2024-09-21T12:26:10.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:09 smithi192 ceph-mon[80326]: pgmap v133: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:26:10.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:09 smithi003 ceph-mon[108723]: pgmap v133: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:26:12.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:11 smithi192 ceph-mon[80326]: pgmap v134: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:26:12.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:11 smithi003 ceph-mon[108723]: pgmap v134: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:26:14.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:13 smithi192 ceph-mon[80326]: pgmap v135: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:26:14.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:13 smithi003 ceph-mon[108723]: pgmap v135: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:26:16.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:15 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:26:16.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:15 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:26:16.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:15 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:26:16.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:15 smithi192 ceph-mon[80326]: pgmap v136: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:26:16.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:15 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:26:16.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:15 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:26:16.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:15 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:26:16.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:15 smithi003 ceph-mon[108723]: pgmap v136: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:26:18.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:17 smithi192 ceph-mon[80326]: pgmap v137: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:26:18.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:17 smithi003 ceph-mon[108723]: pgmap v137: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:26:19.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:18 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-21T12:26:19.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:18 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16} : dispatch 2024-09-21T12:26:20.235 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:19 smithi003 ceph-mon[108723]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-21T12:26:20.235 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:19 smithi003 ceph-mon[108723]: Upgrade: osd.1 is safe to restart 2024-09-21T12:26:20.235 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:19 smithi003 ceph-mon[108723]: pgmap v138: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:26:20.235 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:19 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:26:20.235 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:19 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T12:26:20.236 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:19 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:26:20.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:19 smithi192 ceph-mon[80326]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-21T12:26:20.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:19 smithi192 ceph-mon[80326]: Upgrade: osd.1 is safe to restart 2024-09-21T12:26:20.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:19 smithi192 ceph-mon[80326]: pgmap v138: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:26:20.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:19 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:26:20.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:19 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "auth get", "entity": "osd.1"} : dispatch 2024-09-21T12:26:20.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:19 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:26:21.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:20 smithi003 ceph-mon[108723]: Upgrade: Updating osd.1 2024-09-21T12:26:21.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:20 smithi003 ceph-mon[108723]: Deploying daemon osd.1 on smithi003 2024-09-21T12:26:21.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:20 smithi192 ceph-mon[80326]: Upgrade: Updating osd.1 2024-09-21T12:26:21.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:20 smithi192 ceph-mon[80326]: Deploying daemon osd.1 on smithi003 2024-09-21T12:26:22.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:21 smithi003 ceph-mon[108723]: pgmap v139: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:26:22.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:21 smithi192 ceph-mon[80326]: pgmap v139: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:26:23.021 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:26:22 smithi003 systemd[1]: Stopping Ceph osd.1 for 641beec0-7812-11ef-baf6-efdc52797490... 2024-09-21T12:26:23.329 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:26:23 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-1[57084]: 2024-09-21T12:26:23.042+0000 7f50db061640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T12:26:23.329 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:26:23 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-1[57084]: 2024-09-21T12:26:23.042+0000 7f50db061640 -1 osd.1 53 *** Got signal Terminated *** 2024-09-21T12:26:23.329 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:26:23 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-1[57084]: 2024-09-21T12:26:23.042+0000 7f50db061640 -1 osd.1 53 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T12:26:24.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:23 smithi192 ceph-mon[80326]: pgmap v140: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:26:24.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:23 smithi192 ceph-mon[80326]: osd.1 marked itself down and dead 2024-09-21T12:26:24.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:23 smithi003 ceph-mon[108723]: pgmap v140: 65 pgs: 65 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:26:24.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:23 smithi003 ceph-mon[108723]: osd.1 marked itself down and dead 2024-09-21T12:26:24.727 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:26:24 smithi003 podman[121950]: 2024-09-21 12:26:24.457451445 +0000 UTC m=+1.543484499 container died 6abd75a07645e22e93769e36cc84e227c8753503fc16a14fcc4d45d722cd8ff5 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-1, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, RELEASE=squid-4e45e6b, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-21T12:26:25.079 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:26:24 smithi003 podman[121950]: 2024-09-21 12:26:24.834057234 +0000 UTC m=+1.920090275 container cleanup 6abd75a07645e22e93769e36cc84e227c8753503fc16a14fcc4d45d722cd8ff5 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-1, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-4e45e6b, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-21T12:26:25.080 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:26:24 smithi003 bash[121950]: ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-1 2024-09-21T12:26:25.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:24 smithi003 ceph-mon[108723]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T12:26:25.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:24 smithi003 ceph-mon[108723]: osdmap e54: 6 total, 5 up, 6 in 2024-09-21T12:26:25.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:24 smithi192 ceph-mon[80326]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T12:26:25.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:24 smithi192 ceph-mon[80326]: osdmap e54: 6 total, 5 up, 6 in 2024-09-21T12:26:25.464 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:26:25 smithi003 podman[121976]: 2024-09-21 12:26:25.12719107 +0000 UTC m=+0.670519024 container remove 6abd75a07645e22e93769e36cc84e227c8753503fc16a14fcc4d45d722cd8ff5 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-1, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-4e45e6b, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-21T12:26:25.775 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:26:25 smithi003 podman[122065]: 2024-09-21 12:26:25.366403042 +0000 UTC m=+0.016551976 image pull 8f4d013db793795fef09ff5edf96e6b42ba8cd2c9158b2f0b7a5d7c1e657c063 quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 2024-09-21T12:26:25.775 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:26:25 smithi003 podman[122065]: 2024-09-21 12:26:25.511505477 +0000 UTC m=+0.161654453 container create 0ad328b70afc012d4acaf41d66cbe64b1f76399c83b3fe6caf75920a96cc1215 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-1-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T12:26:25.775 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:26:25 smithi003 podman[122065]: 2024-09-21 12:26:25.77464528 +0000 UTC m=+0.424794222 container init 0ad328b70afc012d4acaf41d66cbe64b1f76399c83b3fe6caf75920a96cc1215 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-1-deactivate, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3) 2024-09-21T12:26:26.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:25 smithi003 ceph-mon[108723]: pgmap v142: 65 pgs: 29 peering, 3 stale+active+clean, 33 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:26:26.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:25 smithi003 ceph-mon[108723]: Health check failed: Reduced data availability: 9 pgs peering (PG_AVAILABILITY) 2024-09-21T12:26:26.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:25 smithi003 ceph-mon[108723]: osdmap e55: 6 total, 5 up, 6 in 2024-09-21T12:26:26.080 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:26:25 smithi003 podman[122065]: 2024-09-21 12:26:25.778222391 +0000 UTC m=+0.428371329 container start 0ad328b70afc012d4acaf41d66cbe64b1f76399c83b3fe6caf75920a96cc1215 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-1-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-21T12:26:26.080 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:26:25 smithi003 podman[122065]: 2024-09-21 12:26:25.857728247 +0000 UTC m=+0.507877201 container attach 0ad328b70afc012d4acaf41d66cbe64b1f76399c83b3fe6caf75920a96cc1215 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-1-deactivate, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T12:26:26.080 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:26:25 smithi003 podman[122065]: 2024-09-21 12:26:25.975923781 +0000 UTC m=+0.626072716 container died 0ad328b70afc012d4acaf41d66cbe64b1f76399c83b3fe6caf75920a96cc1215 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-1-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3) 2024-09-21T12:26:26.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:25 smithi192 ceph-mon[80326]: pgmap v142: 65 pgs: 29 peering, 3 stale+active+clean, 33 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:26:26.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:25 smithi192 ceph-mon[80326]: Health check failed: Reduced data availability: 9 pgs peering (PG_AVAILABILITY) 2024-09-21T12:26:26.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:25 smithi192 ceph-mon[80326]: osdmap e55: 6 total, 5 up, 6 in 2024-09-21T12:26:26.974 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:26:26 smithi003 podman[122087]: 2024-09-21 12:26:26.628162438 +0000 UTC m=+0.646716986 container remove 0ad328b70afc012d4acaf41d66cbe64b1f76399c83b3fe6caf75920a96cc1215 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-1-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T12:26:26.974 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:26:26 smithi003 systemd[1]: ceph-641beec0-7812-11ef-baf6-efdc52797490@osd.1.service: Deactivated successfully. 2024-09-21T12:26:26.974 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:26:26 smithi003 systemd[1]: Stopped Ceph osd.1 for 641beec0-7812-11ef-baf6-efdc52797490. 2024-09-21T12:26:26.974 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:26:26 smithi003 systemd[1]: ceph-641beec0-7812-11ef-baf6-efdc52797490@osd.1.service: Consumed 58.444s CPU time. 2024-09-21T12:26:26.974 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:26:26 smithi003 systemd[1]: Starting Ceph osd.1 for 641beec0-7812-11ef-baf6-efdc52797490... 2024-09-21T12:26:27.229 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:26 smithi003 ceph-mon[108723]: pgmap v144: 65 pgs: 3 active+undersized, 29 peering, 2 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2/279 objects degraded (0.717%) 2024-09-21T12:26:27.229 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:26 smithi003 ceph-mon[108723]: Health check failed: Degraded data redundancy: 2/279 objects degraded (0.717%), 2 pgs degraded (PG_DEGRADED) 2024-09-21T12:26:27.229 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:26:27 smithi003 podman[122189]: 2024-09-21 12:26:26.991450107 +0000 UTC m=+0.017422267 image pull 8f4d013db793795fef09ff5edf96e6b42ba8cd2c9158b2f0b7a5d7c1e657c063 quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 2024-09-21T12:26:27.229 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:26:27 smithi003 podman[122189]: 2024-09-21 12:26:27.121186095 +0000 UTC m=+0.147158239 container create 7613362c7b29338d86b3f9700235fa3b31d86a8ade7c8eec23676323c1709386 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-1-activate, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD) 2024-09-21T12:26:27.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:26 smithi192 ceph-mon[80326]: pgmap v144: 65 pgs: 3 active+undersized, 29 peering, 2 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2/279 objects degraded (0.717%) 2024-09-21T12:26:27.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:26 smithi192 ceph-mon[80326]: Health check failed: Degraded data redundancy: 2/279 objects degraded (0.717%), 2 pgs degraded (PG_DEGRADED) 2024-09-21T12:26:27.513 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:26:27 smithi003 podman[122189]: 2024-09-21 12:26:27.373706633 +0000 UTC m=+0.399678786 container init 7613362c7b29338d86b3f9700235fa3b31d86a8ade7c8eec23676323c1709386 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-1-activate, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3) 2024-09-21T12:26:27.513 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:26:27 smithi003 podman[122189]: 2024-09-21 12:26:27.377263531 +0000 UTC m=+0.403235678 container start 7613362c7b29338d86b3f9700235fa3b31d86a8ade7c8eec23676323c1709386 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-1-activate, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=) 2024-09-21T12:26:27.513 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:26:27 smithi003 podman[122189]: 2024-09-21 12:26:27.474024393 +0000 UTC m=+0.499996547 container attach 7613362c7b29338d86b3f9700235fa3b31d86a8ade7c8eec23676323c1709386 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-1-activate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T12:26:27.829 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:26:27 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-1-activate[122204]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:26:27.829 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:26:27 smithi003 bash[122189]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:26:27.829 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:26:27 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-1-activate[122204]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:26:27.830 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:26:27 smithi003 bash[122189]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:26:30.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:29 smithi192 ceph-mon[80326]: pgmap v145: 65 pgs: 3 active+undersized, 29 peering, 2 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2/279 objects degraded (0.717%) 2024-09-21T12:26:30.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:29 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:26:30.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:29 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:26:30.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:29 smithi003 ceph-mon[108723]: pgmap v145: 65 pgs: 3 active+undersized, 29 peering, 2 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2/279 objects degraded (0.717%) 2024-09-21T12:26:30.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:29 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:26:30.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:29 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:26:30.716 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:26:30 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-1-activate[122204]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-09-21T12:26:30.716 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:26:30 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-1-activate[122204]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:26:30.716 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:26:30 smithi003 bash[122189]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-09-21T12:26:30.717 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:26:30 smithi003 bash[122189]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:26:30.717 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:26:30 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-1-activate[122204]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:26:30.717 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:26:30 smithi003 bash[122189]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:26:30.717 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:26:30 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-1-activate[122204]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-21T12:26:30.717 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:26:30 smithi003 bash[122189]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-21T12:26:30.717 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:26:30 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-1-activate[122204]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-1 --no-mon-config 2024-09-21T12:26:30.717 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:26:30 smithi003 bash[122189]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-1 --no-mon-config 2024-09-21T12:26:30.717 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:26:30 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-1-activate[122204]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-21T12:26:30.717 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:26:30 smithi003 bash[122189]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-21T12:26:30.734 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:30.729+0000 7f71f4a3d640 1 -- 172.21.15.3:0/953138261 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f71f0101900 msgr2=0x7f71f0101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:26:30.734 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:30.729+0000 7f71f4a3d640 1 --2- 172.21.15.3:0/953138261 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f71f0101900 0x7f71f0101d60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f71e4009880 tx=0x7f71e402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:26:30.735 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:30.729+0000 7f71f4a3d640 1 -- 172.21.15.3:0/953138261 shutdown_connections 2024-09-21T12:26:30.735 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:30.729+0000 7f71f4a3d640 1 --2- 172.21.15.3:0/953138261 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f71f0101900 0x7f71f0101d60 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:26:30.735 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:30.729+0000 7f71f4a3d640 1 --2- 172.21.15.3:0/953138261 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71f0107900 0x7f71f0107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:26:30.735 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:30.729+0000 7f71f4a3d640 1 -- 172.21.15.3:0/953138261 >> 172.21.15.3:0/953138261 conn(0x7f71f00fd600 msgr2=0x7f71f00ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:26:30.735 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:30.729+0000 7f71f4a3d640 1 -- 172.21.15.3:0/953138261 shutdown_connections 2024-09-21T12:26:30.735 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:30.729+0000 7f71f4a3d640 1 -- 172.21.15.3:0/953138261 wait complete. 2024-09-21T12:26:30.735 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:30.730+0000 7f71f4a3d640 1 Processor -- start 2024-09-21T12:26:30.735 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:30.730+0000 7f71f4a3d640 1 -- start start 2024-09-21T12:26:30.736 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:30.730+0000 7f71f4a3d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f71f0101900 0x7f71f00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:26:30.736 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:30.730+0000 7f71f4a3d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71f0107900 0x7f71f0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:26:30.736 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:30.730+0000 7f71f4a3d640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f71f010edb0 con 0x7f71f0101900 2024-09-21T12:26:30.736 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:30.730+0000 7f71f4a3d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f71f010ec30 con 0x7f71f0107900 2024-09-21T12:26:30.736 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:30.730+0000 7f71ee59c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f71f0101900 0x7f71f00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:26:30.736 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:30.731+0000 7f71ee59c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f71f0101900 0x7f71f00744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44784/0 (socket says 172.21.15.3:44784) 2024-09-21T12:26:30.736 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:30.731+0000 7f71ee59c640 1 -- 172.21.15.3:0/474259233 learned_addr learned my addr 172.21.15.3:0/474259233 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:26:30.736 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:30.731+0000 7f71edd9b640 1 --2- 172.21.15.3:0/474259233 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71f0107900 0x7f71f0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:26:30.737 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:30.731+0000 7f71ee59c640 1 -- 172.21.15.3:0/474259233 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71f0107900 msgr2=0x7f71f0074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:26:30.737 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:30.731+0000 7f71ee59c640 1 --2- 172.21.15.3:0/474259233 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71f0107900 0x7f71f0074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:26:30.737 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:30.731+0000 7f71ee59c640 1 -- 172.21.15.3:0/474259233 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71f0074f70 con 0x7f71f0101900 2024-09-21T12:26:30.737 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:30.731+0000 7f71ee59c640 1 --2- 172.21.15.3:0/474259233 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f71f0101900 0x7f71f00744f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f71e000c8a0 tx=0x7f71e000cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:26:30.737 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:30.731+0000 7f71df7fe640 1 -- 172.21.15.3:0/474259233 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f71e00079b0 con 0x7f71f0101900 2024-09-21T12:26:30.737 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:30.731+0000 7f71f4a3d640 1 -- 172.21.15.3:0/474259233 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71f0075260 con 0x7f71f0101900 2024-09-21T12:26:30.737 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:30.731+0000 7f71df7fe640 1 -- 172.21.15.3:0/474259233 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f71e0007b50 con 0x7f71f0101900 2024-09-21T12:26:30.737 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:30.731+0000 7f71df7fe640 1 -- 172.21.15.3:0/474259233 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f71e0018700 con 0x7f71f0101900 2024-09-21T12:26:30.737 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:30.732+0000 7f71f4a3d640 1 -- 172.21.15.3:0/474259233 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71f01a3df0 con 0x7f71f0101900 2024-09-21T12:26:30.739 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:30.733+0000 7f71f4a3d640 1 -- 172.21.15.3:0/474259233 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71f0103040 con 0x7f71f0101900 2024-09-21T12:26:30.739 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:30.733+0000 7f71df7fe640 1 -- 172.21.15.3:0/474259233 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f71e0007d00 con 0x7f71f0101900 2024-09-21T12:26:30.739 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:30.734+0000 7f71df7fe640 1 --2- 172.21.15.3:0/474259233 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f71d807af40 0x7f71d807d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:26:30.739 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:30.734+0000 7f71df7fe640 1 -- 172.21.15.3:0/474259233 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6156+0+0 (secure 0 0 0) 0x7f71e009e260 con 0x7f71f0101900 2024-09-21T12:26:30.739 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:30.734+0000 7f71edd9b640 1 --2- 172.21.15.3:0/474259233 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f71d807af40 0x7f71d807d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:26:30.739 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:30.734+0000 7f71edd9b640 1 --2- 172.21.15.3:0/474259233 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f71d807af40 0x7f71d807d400 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f71f0075f80 tx=0x7f71e4031400 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:26:30.741 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:30.739+0000 7f71df7fe640 1 -- 172.21.15.3:0/474259233 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f71e0014030 con 0x7f71f0101900 2024-09-21T12:26:30.961 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:30.958+0000 7f71f4a3d640 1 -- 172.21.15.3:0/474259233 --> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f71f0062630 con 0x7f71d807af40 2024-09-21T12:26:30.962 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:30.959+0000 7f71df7fe640 1 -- 172.21.15.3:0/474259233 <== mgr.14756 v2:172.21.15.3:6800/1284098095 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f71f0062630 con 0x7f71d807af40 2024-09-21T12:26:30.964 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:30.962+0000 7f71f4a3d640 1 -- 172.21.15.3:0/474259233 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f71d807af40 msgr2=0x7f71d807d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:26:30.964 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:30.962+0000 7f71f4a3d640 1 --2- 172.21.15.3:0/474259233 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f71d807af40 0x7f71d807d400 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f71f0075f80 tx=0x7f71e4031400 comp rx=0 tx=0).stop 2024-09-21T12:26:30.965 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:30.962+0000 7f71f4a3d640 1 -- 172.21.15.3:0/474259233 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f71f0101900 msgr2=0x7f71f00744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:26:30.965 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:30.962+0000 7f71f4a3d640 1 --2- 172.21.15.3:0/474259233 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f71f0101900 0x7f71f00744f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f71e000c8a0 tx=0x7f71e000cd60 comp rx=0 tx=0).stop 2024-09-21T12:26:30.965 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:30.962+0000 7f71f4a3d640 1 -- 172.21.15.3:0/474259233 shutdown_connections 2024-09-21T12:26:30.965 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:30.962+0000 7f71f4a3d640 1 --2- 172.21.15.3:0/474259233 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f71d807af40 0x7f71d807d400 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:26:30.965 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:30.962+0000 7f71f4a3d640 1 --2- 172.21.15.3:0/474259233 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f71f0107900 0x7f71f0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:26:30.965 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:30.962+0000 7f71f4a3d640 1 --2- 172.21.15.3:0/474259233 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f71f0101900 0x7f71f00744f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:26:30.965 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:30.962+0000 7f71f4a3d640 1 -- 172.21.15.3:0/474259233 >> 172.21.15.3:0/474259233 conn(0x7f71f00fd600 msgr2=0x7f71f00fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:26:30.965 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:30.962+0000 7f71f4a3d640 1 -- 172.21.15.3:0/474259233 shutdown_connections 2024-09-21T12:26:30.965 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:30.962+0000 7f71f4a3d640 1 -- 172.21.15.3:0/474259233 wait complete. 2024-09-21T12:26:30.974 INFO:teuthology.orchestra.run.smithi003.stdout:true 2024-09-21T12:26:30.974 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:30 smithi003 ceph-mon[108723]: pgmap v146: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 37/279 objects degraded (13.262%) 2024-09-21T12:26:30.974 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:30 smithi003 ceph-mon[108723]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 9 pgs peering) 2024-09-21T12:26:30.974 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:26:30 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-1-activate[122204]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-1/block 2024-09-21T12:26:30.974 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:26:30 smithi003 bash[122189]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-1/block 2024-09-21T12:26:30.974 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:26:30 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-1-activate[122204]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-21T12:26:30.975 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:26:30 smithi003 bash[122189]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-21T12:26:30.975 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:26:30 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-1-activate[122204]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-21T12:26:30.975 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:26:30 smithi003 bash[122189]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-21T12:26:30.975 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:26:30 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-1-activate[122204]: --> ceph-volume lvm activate successful for osd ID: 1 2024-09-21T12:26:30.975 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:26:30 smithi003 bash[122189]: --> ceph-volume lvm activate successful for osd ID: 1 2024-09-21T12:26:30.975 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:26:30 smithi003 podman[122189]: 2024-09-21 12:26:30.749255425 +0000 UTC m=+3.775227569 container died 7613362c7b29338d86b3f9700235fa3b31d86a8ade7c8eec23676323c1709386 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-1-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True) 2024-09-21T12:26:31.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.053+0000 7f285ae3f640 1 -- 172.21.15.3:0/1343212419 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2854100800 msgr2=0x7f2854100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:26:31.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.053+0000 7f285ae3f640 1 --2- 172.21.15.3:0/1343212419 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2854100800 0x7f2854100c60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f2848009880 tx=0x7f284802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:26:31.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.053+0000 7f285ae3f640 1 -- 172.21.15.3:0/1343212419 shutdown_connections 2024-09-21T12:26:31.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.053+0000 7f285ae3f640 1 --2- 172.21.15.3:0/1343212419 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2854100800 0x7f2854100c60 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:26:31.057 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.053+0000 7f285ae3f640 1 --2- 172.21.15.3:0/1343212419 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2854106800 0x7f2854106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:26:31.057 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.053+0000 7f285ae3f640 1 -- 172.21.15.3:0/1343212419 >> 172.21.15.3:0/1343212419 conn(0x7f28540fc520 msgr2=0x7f28540fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:26:31.057 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.053+0000 7f285ae3f640 1 -- 172.21.15.3:0/1343212419 shutdown_connections 2024-09-21T12:26:31.057 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.053+0000 7f285ae3f640 1 -- 172.21.15.3:0/1343212419 wait complete. 2024-09-21T12:26:31.057 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.054+0000 7f285ae3f640 1 Processor -- start 2024-09-21T12:26:31.057 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.054+0000 7f285ae3f640 1 -- start start 2024-09-21T12:26:31.058 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.054+0000 7f285ae3f640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2854100800 0x7f285419d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:26:31.058 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.054+0000 7f285ae3f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2854106800 0x7f285419dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:26:31.058 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.054+0000 7f285ae3f640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f285410dcd0 con 0x7f2854106800 2024-09-21T12:26:31.058 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.054+0000 7f285ae3f640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f285410db50 con 0x7f2854100800 2024-09-21T12:26:31.059 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.054+0000 7f2853fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2854106800 0x7f285419dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:26:31.059 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.054+0000 7f2858bdb640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2854100800 0x7f285419d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:26:31.059 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.054+0000 7f2853fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2854106800 0x7f285419dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44792/0 (socket says 172.21.15.3:44792) 2024-09-21T12:26:31.059 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.054+0000 7f2853fff640 1 -- 172.21.15.3:0/169246951 learned_addr learned my addr 172.21.15.3:0/169246951 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:26:31.059 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.055+0000 7f2853fff640 1 -- 172.21.15.3:0/169246951 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2854100800 msgr2=0x7f285419d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:26:31.059 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.055+0000 7f2853fff640 1 --2- 172.21.15.3:0/169246951 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2854100800 0x7f285419d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:26:31.059 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.055+0000 7f2853fff640 1 -- 172.21.15.3:0/169246951 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28541977f0 con 0x7f2854106800 2024-09-21T12:26:31.059 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.055+0000 7f2853fff640 1 --2- 172.21.15.3:0/169246951 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2854106800 0x7f285419dbb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2848031460 tx=0x7f28480045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:26:31.059 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.055+0000 7f2851ffb640 1 -- 172.21.15.3:0/169246951 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f284803f070 con 0x7f2854106800 2024-09-21T12:26:31.059 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.055+0000 7f2851ffb640 1 -- 172.21.15.3:0/169246951 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2848004b10 con 0x7f2854106800 2024-09-21T12:26:31.059 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.055+0000 7f285ae3f640 1 -- 172.21.15.3:0/169246951 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2854197a80 con 0x7f2854106800 2024-09-21T12:26:31.059 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.055+0000 7f2851ffb640 1 -- 172.21.15.3:0/169246951 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2848035030 con 0x7f2854106800 2024-09-21T12:26:31.059 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.055+0000 7f285ae3f640 1 -- 172.21.15.3:0/169246951 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2854197fb0 con 0x7f2854106800 2024-09-21T12:26:31.060 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.056+0000 7f285ae3f640 1 -- 172.21.15.3:0/169246951 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2854101f40 con 0x7f2854106800 2024-09-21T12:26:31.060 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.057+0000 7f2851ffb640 1 -- 172.21.15.3:0/169246951 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f2848042070 con 0x7f2854106800 2024-09-21T12:26:31.060 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.058+0000 7f2851ffb640 1 --2- 172.21.15.3:0/169246951 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f283c07af90 0x7f283c07d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:26:31.060 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.058+0000 7f2851ffb640 1 -- 172.21.15.3:0/169246951 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6156+0+0 (secure 0 0 0) 0x7f28480bea60 con 0x7f2854106800 2024-09-21T12:26:31.060 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.058+0000 7f2858bdb640 1 --2- 172.21.15.3:0/169246951 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f283c07af90 0x7f283c07d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:26:31.061 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.058+0000 7f2858bdb640 1 --2- 172.21.15.3:0/169246951 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f283c07af90 0x7f283c07d450 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2844005fd0 tx=0x7f284400b390 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:26:31.065 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.062+0000 7f2851ffb640 1 -- 172.21.15.3:0/169246951 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f284808a040 con 0x7f2854106800 2024-09-21T12:26:31.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:30 smithi192 ceph-mon[80326]: pgmap v146: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 37/279 objects degraded (13.262%) 2024-09-21T12:26:31.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:30 smithi192 ceph-mon[80326]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 9 pgs peering) 2024-09-21T12:26:31.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.271+0000 7f285ae3f640 1 -- 172.21.15.3:0/169246951 --> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f2854198320 con 0x7f283c07af90 2024-09-21T12:26:31.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.273+0000 7f2851ffb640 1 -- 172.21.15.3:0/169246951 <== mgr.14756 v2:172.21.15.3:6800/1284098095 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f2854198320 con 0x7f283c07af90 2024-09-21T12:26:31.277 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.275+0000 7f285ae3f640 1 -- 172.21.15.3:0/169246951 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f283c07af90 msgr2=0x7f283c07d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:26:31.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.275+0000 7f285ae3f640 1 --2- 172.21.15.3:0/169246951 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f283c07af90 0x7f283c07d450 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2844005fd0 tx=0x7f284400b390 comp rx=0 tx=0).stop 2024-09-21T12:26:31.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.275+0000 7f285ae3f640 1 -- 172.21.15.3:0/169246951 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2854106800 msgr2=0x7f285419dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:26:31.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.275+0000 7f285ae3f640 1 --2- 172.21.15.3:0/169246951 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2854106800 0x7f285419dbb0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f2848031460 tx=0x7f28480045e0 comp rx=0 tx=0).stop 2024-09-21T12:26:31.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.275+0000 7f285ae3f640 1 -- 172.21.15.3:0/169246951 shutdown_connections 2024-09-21T12:26:31.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.275+0000 7f285ae3f640 1 --2- 172.21.15.3:0/169246951 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f283c07af90 0x7f283c07d450 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:26:31.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.275+0000 7f285ae3f640 1 --2- 172.21.15.3:0/169246951 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2854106800 0x7f285419dbb0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:26:31.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.275+0000 7f285ae3f640 1 --2- 172.21.15.3:0/169246951 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2854100800 0x7f285419d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:26:31.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.275+0000 7f285ae3f640 1 -- 172.21.15.3:0/169246951 >> 172.21.15.3:0/169246951 conn(0x7f28540fc520 msgr2=0x7f285406a490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:26:31.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.275+0000 7f285ae3f640 1 -- 172.21.15.3:0/169246951 shutdown_connections 2024-09-21T12:26:31.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.275+0000 7f285ae3f640 1 -- 172.21.15.3:0/169246951 wait complete. 2024-09-21T12:26:31.362 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.360+0000 7ff99bb6d640 1 -- 172.21.15.3:0/808861422 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff9941033d0 msgr2=0x7ff99410b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:26:31.363 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.360+0000 7ff99bb6d640 1 --2- 172.21.15.3:0/808861422 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff9941033d0 0x7ff99410b8c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff990009880 tx=0x7ff99002a530 comp rx=0 tx=0).stop 2024-09-21T12:26:31.363 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.360+0000 7ff99bb6d640 1 -- 172.21.15.3:0/808861422 shutdown_connections 2024-09-21T12:26:31.363 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.360+0000 7ff99bb6d640 1 --2- 172.21.15.3:0/808861422 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff9941033d0 0x7ff99410b8c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:26:31.363 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.360+0000 7ff99bb6d640 1 --2- 172.21.15.3:0/808861422 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff994102ab0 0x7ff994102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:26:31.363 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.360+0000 7ff99bb6d640 1 -- 172.21.15.3:0/808861422 >> 172.21.15.3:0/808861422 conn(0x7ff9940fc550 msgr2=0x7ff9940fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:26:31.363 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.360+0000 7ff99bb6d640 1 -- 172.21.15.3:0/808861422 shutdown_connections 2024-09-21T12:26:31.363 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.360+0000 7ff99bb6d640 1 -- 172.21.15.3:0/808861422 wait complete. 2024-09-21T12:26:31.364 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.360+0000 7ff99bb6d640 1 Processor -- start 2024-09-21T12:26:31.365 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.361+0000 7ff99bb6d640 1 -- start start 2024-09-21T12:26:31.365 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.361+0000 7ff99bb6d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff994102ab0 0x7ff994100710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:26:31.365 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.361+0000 7ff99bb6d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9941033d0 0x7ff994100c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:26:31.365 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.361+0000 7ff99bb6d640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7ff99410ede0 con 0x7ff994102ab0 2024-09-21T12:26:31.365 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.361+0000 7ff99bb6d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff99410ec60 con 0x7ff9941033d0 2024-09-21T12:26:31.365 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.361+0000 7ff999909640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff994102ab0 0x7ff994100710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:26:31.365 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.361+0000 7ff999909640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff994102ab0 0x7ff994100710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44814/0 (socket says 172.21.15.3:44814) 2024-09-21T12:26:31.365 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.361+0000 7ff999909640 1 -- 172.21.15.3:0/1868809204 learned_addr learned my addr 172.21.15.3:0/1868809204 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:26:31.365 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.361+0000 7ff999108640 1 --2- 172.21.15.3:0/1868809204 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9941033d0 0x7ff994100c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:26:31.365 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.361+0000 7ff999909640 1 -- 172.21.15.3:0/1868809204 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9941033d0 msgr2=0x7ff994100c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:26:31.365 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.361+0000 7ff999909640 1 --2- 172.21.15.3:0/1868809204 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9941033d0 0x7ff994100c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:26:31.365 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.361+0000 7ff999909640 1 -- 172.21.15.3:0/1868809204 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff994101190 con 0x7ff994102ab0 2024-09-21T12:26:31.366 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.361+0000 7ff999909640 1 --2- 172.21.15.3:0/1868809204 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff994102ab0 0x7ff994100710 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff98800d6f0 tx=0x7ff98800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:26:31.366 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.361+0000 7ff986ffd640 1 -- 172.21.15.3:0/1868809204 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff988017070 con 0x7ff994102ab0 2024-09-21T12:26:31.366 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.361+0000 7ff986ffd640 1 -- 172.21.15.3:0/1868809204 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff98800de00 con 0x7ff994102ab0 2024-09-21T12:26:31.366 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.362+0000 7ff986ffd640 1 -- 172.21.15.3:0/1868809204 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff988004bb0 con 0x7ff994102ab0 2024-09-21T12:26:31.366 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.362+0000 7ff99bb6d640 1 -- 172.21.15.3:0/1868809204 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff994101480 con 0x7ff994102ab0 2024-09-21T12:26:31.366 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.362+0000 7ff99bb6d640 1 -- 172.21.15.3:0/1868809204 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9941a3e90 con 0x7ff994102ab0 2024-09-21T12:26:31.367 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.363+0000 7ff99bb6d640 1 -- 172.21.15.3:0/1868809204 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff99406a580 con 0x7ff994102ab0 2024-09-21T12:26:31.367 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.363+0000 7ff986ffd640 1 -- 172.21.15.3:0/1868809204 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7ff988004e60 con 0x7ff994102ab0 2024-09-21T12:26:31.367 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.364+0000 7ff986ffd640 1 --2- 172.21.15.3:0/1868809204 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7ff98007af40 0x7ff98007d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:26:31.367 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.364+0000 7ff986ffd640 1 -- 172.21.15.3:0/1868809204 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6156+0+0 (secure 0 0 0) 0x7ff98809dc30 con 0x7ff994102ab0 2024-09-21T12:26:31.367 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.364+0000 7ff999108640 1 --2- 172.21.15.3:0/1868809204 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7ff98007af40 0x7ff98007d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:26:31.367 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.364+0000 7ff999108640 1 --2- 172.21.15.3:0/1868809204 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7ff98007af40 0x7ff98007d400 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff9941021a0 tx=0x7ff9900095c0 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:26:31.370 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.368+0000 7ff986ffd640 1 -- 172.21.15.3:0/1868809204 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff988069230 con 0x7ff994102ab0 2024-09-21T12:26:31.579 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:26:31 smithi003 podman[122444]: 2024-09-21 12:26:31.444635186 +0000 UTC m=+0.688889844 container remove 7613362c7b29338d86b3f9700235fa3b31d86a8ade7c8eec23676323c1709386 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-1-activate, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T12:26:31.584 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.582+0000 7ff99bb6d640 1 -- 172.21.15.3:0/1868809204 --> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7ff994062630 con 0x7ff98007af40 2024-09-21T12:26:31.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.591+0000 7ff986ffd640 1 -- 172.21.15.3:0/1868809204 <== mgr.14756 v2:172.21.15.3:6800/1284098095 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7ff994062630 con 0x7ff98007af40 2024-09-21T12:26:31.594 INFO:teuthology.orchestra.run.smithi003.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:26:31.594 INFO:teuthology.orchestra.run.smithi003.stdout:alertmanager.smithi003 smithi003 *:9093,9094 running (2m) 32s ago 14m 19.0M - 0.27.0 11f11916f8cd 14880018dfd3 2024-09-21T12:26:31.594 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-exporter.smithi003 smithi003 running (5m) 32s ago 14m 8715k - 19.1.1-373-g4e45e6b4 164465d2334a 0c9ad60a4f5a 2024-09-21T12:26:31.594 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-exporter.smithi192 smithi192 running (5m) 56s ago 13m 8338k - 19.1.1-373-g4e45e6b4 164465d2334a d5be8a6e120f 2024-09-21T12:26:31.594 INFO:teuthology.orchestra.run.smithi003.stdout:crash.smithi003 smithi003 running (65s) 32s ago 14m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 0ada67250dba 2024-09-21T12:26:31.594 INFO:teuthology.orchestra.run.smithi003.stdout:crash.smithi192 smithi192 running (60s) 56s ago 13m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 52e279085b2e 2024-09-21T12:26:31.594 INFO:teuthology.orchestra.run.smithi003.stdout:grafana.smithi003 smithi003 *:3000 running (2m) 32s ago 14m 79.7M - 10.4.8 5aad1d7cf004 19e26b3cb585 2024-09-21T12:26:31.594 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi003.ebjgyl smithi003 running (8m) 32s ago 8m 16.6M - 19.1.1-373-g4e45e6b4 164465d2334a 16e0b2cac16a 2024-09-21T12:26:31.595 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi003.gfkngj smithi003 running (8m) 32s ago 8m 143M - 19.1.1-373-g4e45e6b4 164465d2334a 109c04f87fbd 2024-09-21T12:26:31.595 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi192.ktdqns smithi192 running (8m) 56s ago 8m 18.2M - 19.1.1-373-g4e45e6b4 164465d2334a 495c73fb3bb0 2024-09-21T12:26:31.595 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi192.ywqqxe smithi192 running (8m) 56s ago 8m 18.2M - 19.1.1-373-g4e45e6b4 164465d2334a 270a01030cbe 2024-09-21T12:26:31.595 INFO:teuthology.orchestra.run.smithi003.stdout:mgr.smithi003.wztftl smithi003 *:8443,9283,8765 running (5m) 32s ago 15m 523M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 8ce0e66fd369 2024-09-21T12:26:31.595 INFO:teuthology.orchestra.run.smithi003.stdout:mgr.smithi192.qsaprd smithi192 *:8443,9283,8765 running (4m) 56s ago 13m 457M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 002a6171dd47 2024-09-21T12:26:31.595 INFO:teuthology.orchestra.run.smithi003.stdout:mon.smithi003 smithi003 running (92s) 32s ago 15m 37.7M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 4f2b2b2daf19 2024-09-21T12:26:31.595 INFO:teuthology.orchestra.run.smithi003.stdout:mon.smithi192 smithi192 running (76s) 56s ago 13m 25.9M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 11edc5c1baba 2024-09-21T12:26:31.595 INFO:teuthology.orchestra.run.smithi003.stdout:node-exporter.smithi003 smithi003 *:9100 running (3m) 32s ago 14m 10.7M - 1.7.0 72c9c2088986 d9cb7ede9060 2024-09-21T12:26:31.595 INFO:teuthology.orchestra.run.smithi003.stdout:node-exporter.smithi192 smithi192 *:9100 running (3m) 56s ago 13m 11.6M - 1.7.0 72c9c2088986 d8ec0acfce7e 2024-09-21T12:26:31.595 INFO:teuthology.orchestra.run.smithi003.stdout:osd.0 smithi003 running (38s) 32s ago 12m 12.2M 1217M 19.3.0-5103-g5c1cdc3c 8f4d013db793 0f2234f333ec 2024-09-21T12:26:31.595 INFO:teuthology.orchestra.run.smithi003.stdout:osd.1 smithi003 running (11m) 32s ago 11m 212M 1217M 19.1.1-373-g4e45e6b4 164465d2334a 6abd75a07645 2024-09-21T12:26:31.595 INFO:teuthology.orchestra.run.smithi003.stdout:osd.2 smithi003 running (11m) 32s ago 11m 172M 1217M 19.1.1-373-g4e45e6b4 164465d2334a 3265369e573b 2024-09-21T12:26:31.595 INFO:teuthology.orchestra.run.smithi003.stdout:osd.3 smithi192 running (10m) 56s ago 10m 238M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 13efcfd71c05 2024-09-21T12:26:31.595 INFO:teuthology.orchestra.run.smithi003.stdout:osd.4 smithi192 running (10m) 56s ago 10m 204M 2240M 19.1.1-373-g4e45e6b4 164465d2334a f33bf453cb3e 2024-09-21T12:26:31.596 INFO:teuthology.orchestra.run.smithi003.stdout:osd.5 smithi192 running (9m) 56s ago 9m 182M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 12d7b7c8e985 2024-09-21T12:26:31.596 INFO:teuthology.orchestra.run.smithi003.stdout:prometheus.smithi003 smithi003 *:9095 running (3m) 32s ago 13m 50.2M - 2.51.0 1d3b7f56885b 64997a33fbbb 2024-09-21T12:26:31.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.593+0000 7ff99bb6d640 1 -- 172.21.15.3:0/1868809204 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7ff98007af40 msgr2=0x7ff98007d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:26:31.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.593+0000 7ff99bb6d640 1 --2- 172.21.15.3:0/1868809204 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7ff98007af40 0x7ff98007d400 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff9941021a0 tx=0x7ff9900095c0 comp rx=0 tx=0).stop 2024-09-21T12:26:31.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.593+0000 7ff99bb6d640 1 -- 172.21.15.3:0/1868809204 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff994102ab0 msgr2=0x7ff994100710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:26:31.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.593+0000 7ff99bb6d640 1 --2- 172.21.15.3:0/1868809204 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff994102ab0 0x7ff994100710 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff98800d6f0 tx=0x7ff98800dbb0 comp rx=0 tx=0).stop 2024-09-21T12:26:31.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.594+0000 7ff99bb6d640 1 -- 172.21.15.3:0/1868809204 shutdown_connections 2024-09-21T12:26:31.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.594+0000 7ff99bb6d640 1 --2- 172.21.15.3:0/1868809204 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7ff98007af40 0x7ff98007d400 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:26:31.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.594+0000 7ff99bb6d640 1 --2- 172.21.15.3:0/1868809204 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff9941033d0 0x7ff994100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:26:31.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.594+0000 7ff99bb6d640 1 --2- 172.21.15.3:0/1868809204 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff994102ab0 0x7ff994100710 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:26:31.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.594+0000 7ff99bb6d640 1 -- 172.21.15.3:0/1868809204 >> 172.21.15.3:0/1868809204 conn(0x7ff9940fc550 msgr2=0x7ff994108ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:26:31.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.594+0000 7ff99bb6d640 1 -- 172.21.15.3:0/1868809204 shutdown_connections 2024-09-21T12:26:31.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.594+0000 7ff99bb6d640 1 -- 172.21.15.3:0/1868809204 wait complete. 2024-09-21T12:26:31.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.677+0000 7f969521b640 1 -- 172.21.15.3:0/1345194592 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9690101900 msgr2=0x7f9690101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:26:31.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.677+0000 7f969521b640 1 --2- 172.21.15.3:0/1345194592 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9690101900 0x7f9690101d60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9684009880 tx=0x7f968402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:26:31.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.677+0000 7f969521b640 1 -- 172.21.15.3:0/1345194592 shutdown_connections 2024-09-21T12:26:31.680 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.677+0000 7f969521b640 1 --2- 172.21.15.3:0/1345194592 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9690101900 0x7f9690101d60 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:26:31.681 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.677+0000 7f969521b640 1 --2- 172.21.15.3:0/1345194592 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9690107900 0x7f9690107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:26:31.681 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.677+0000 7f969521b640 1 -- 172.21.15.3:0/1345194592 >> 172.21.15.3:0/1345194592 conn(0x7f96900fd600 msgr2=0x7f96900ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:26:31.681 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.677+0000 7f969521b640 1 -- 172.21.15.3:0/1345194592 shutdown_connections 2024-09-21T12:26:31.681 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.677+0000 7f969521b640 1 -- 172.21.15.3:0/1345194592 wait complete. 2024-09-21T12:26:31.683 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.678+0000 7f969521b640 1 Processor -- start 2024-09-21T12:26:31.683 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.678+0000 7f969521b640 1 -- start start 2024-09-21T12:26:31.683 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.679+0000 7f969521b640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9690101900 0x7f969019d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:26:31.683 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.679+0000 7f969521b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9690107900 0x7f969019dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:26:31.683 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.679+0000 7f969521b640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f969010edd0 con 0x7f9690101900 2024-09-21T12:26:31.683 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.679+0000 7f969521b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f969010ec50 con 0x7f9690107900 2024-09-21T12:26:31.683 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.679+0000 7f968ed9d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9690101900 0x7f969019d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:26:31.683 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.679+0000 7f968ed9d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9690101900 0x7f969019d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44834/0 (socket says 172.21.15.3:44834) 2024-09-21T12:26:31.683 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.679+0000 7f968ed9d640 1 -- 172.21.15.3:0/3943553726 learned_addr learned my addr 172.21.15.3:0/3943553726 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:26:31.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.679+0000 7f968e59c640 1 --2- 172.21.15.3:0/3943553726 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9690107900 0x7f969019dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:26:31.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.679+0000 7f968ed9d640 1 -- 172.21.15.3:0/3943553726 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9690107900 msgr2=0x7f969019dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:26:31.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.679+0000 7f968ed9d640 1 --2- 172.21.15.3:0/3943553726 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9690107900 0x7f969019dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:26:31.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.679+0000 7f968ed9d640 1 -- 172.21.15.3:0/3943553726 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9690197800 con 0x7f9690101900 2024-09-21T12:26:31.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.679+0000 7f968ed9d640 1 --2- 172.21.15.3:0/3943553726 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9690101900 0x7f969019d680 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f968000d6f0 tx=0x7f968000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:26:31.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.679+0000 7f9677fff640 1 -- 172.21.15.3:0/3943553726 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9680017070 con 0x7f9690101900 2024-09-21T12:26:31.684 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.679+0000 7f969521b640 1 -- 172.21.15.3:0/3943553726 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9690197af0 con 0x7f9690101900 2024-09-21T12:26:31.685 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.679+0000 7f9677fff640 1 -- 172.21.15.3:0/3943553726 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f968000de00 con 0x7f9690101900 2024-09-21T12:26:31.685 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.679+0000 7f9677fff640 1 -- 172.21.15.3:0/3943553726 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9680004bb0 con 0x7f9690101900 2024-09-21T12:26:31.685 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.680+0000 7f969521b640 1 -- 172.21.15.3:0/3943553726 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9690198050 con 0x7f9690101900 2024-09-21T12:26:31.685 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.680+0000 7f969521b640 1 -- 172.21.15.3:0/3943553726 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9690103040 con 0x7f9690101900 2024-09-21T12:26:31.686 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.681+0000 7f9677fff640 1 -- 172.21.15.3:0/3943553726 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f9680004e60 con 0x7f9690101900 2024-09-21T12:26:31.686 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.682+0000 7f9677fff640 1 --2- 172.21.15.3:0/3943553726 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f967807af30 0x7f967807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:26:31.686 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.682+0000 7f9677fff640 1 -- 172.21.15.3:0/3943553726 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6156+0+0 (secure 0 0 0) 0x7f968009dba0 con 0x7f9690101900 2024-09-21T12:26:31.686 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.682+0000 7f968e59c640 1 --2- 172.21.15.3:0/3943553726 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f967807af30 0x7f967807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:26:31.686 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.682+0000 7f968e59c640 1 --2- 172.21.15.3:0/3943553726 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f967807af30 0x7f967807d3f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9690198b50 tx=0x7f9684031400 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:26:31.688 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.686+0000 7f9677fff640 1 -- 172.21.15.3:0/3943553726 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f96800691a0 con 0x7f9690101900 2024-09-21T12:26:31.835 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:26:31 smithi003 podman[122552]: 2024-09-21 12:26:31.568579731 +0000 UTC m=+0.016602676 image pull 8f4d013db793795fef09ff5edf96e6b42ba8cd2c9158b2f0b7a5d7c1e657c063 quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 2024-09-21T12:26:31.835 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:26:31 smithi003 podman[122552]: 2024-09-21 12:26:31.704229241 +0000 UTC m=+0.152252176 container create 198ba21d051848d81e773372782a2cbdd1466f05669932b5584bbfc115902802 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-1, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-21T12:26:31.958 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.955+0000 7f969521b640 1 -- 172.21.15.3:0/3943553726 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f9690109e70 con 0x7f9690101900 2024-09-21T12:26:31.958 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-21T12:26:31.959 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": { 2024-09-21T12:26:31.959 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:26:31.959 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:26:31.959 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": { 2024-09-21T12:26:31.959 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:26:31.959 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:26:31.959 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": { 2024-09-21T12:26:31.959 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 4, 2024-09-21T12:26:31.959 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 1 2024-09-21T12:26:31.961 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:26:31.961 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": { 2024-09-21T12:26:31.961 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 4 2024-09-21T12:26:31.961 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:26:31.961 INFO:teuthology.orchestra.run.smithi003.stdout: "overall": { 2024-09-21T12:26:31.961 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 8, 2024-09-21T12:26:31.961 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 5 2024-09-21T12:26:31.961 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-21T12:26:31.961 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-21T12:26:31.962 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.956+0000 7f9677fff640 1 -- 172.21.15.3:0/3943553726 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+836 (secure 0 0 0) 0x7f968006e050 con 0x7f9690101900 2024-09-21T12:26:31.962 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.958+0000 7f969521b640 1 -- 172.21.15.3:0/3943553726 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f967807af30 msgr2=0x7f967807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:26:31.962 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.958+0000 7f969521b640 1 --2- 172.21.15.3:0/3943553726 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f967807af30 0x7f967807d3f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9690198b50 tx=0x7f9684031400 comp rx=0 tx=0).stop 2024-09-21T12:26:31.962 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.958+0000 7f969521b640 1 -- 172.21.15.3:0/3943553726 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9690101900 msgr2=0x7f969019d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:26:31.962 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.958+0000 7f969521b640 1 --2- 172.21.15.3:0/3943553726 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9690101900 0x7f969019d680 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f968000d6f0 tx=0x7f968000dbb0 comp rx=0 tx=0).stop 2024-09-21T12:26:31.963 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.958+0000 7f969521b640 1 -- 172.21.15.3:0/3943553726 shutdown_connections 2024-09-21T12:26:31.963 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.958+0000 7f969521b640 1 --2- 172.21.15.3:0/3943553726 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f967807af30 0x7f967807d3f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:26:31.963 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.958+0000 7f969521b640 1 --2- 172.21.15.3:0/3943553726 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9690107900 0x7f969019dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:26:31.963 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.958+0000 7f969521b640 1 --2- 172.21.15.3:0/3943553726 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9690101900 0x7f969019d680 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:26:31.963 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.958+0000 7f969521b640 1 -- 172.21.15.3:0/3943553726 >> 172.21.15.3:0/3943553726 conn(0x7f96900fd600 msgr2=0x7f96900fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:26:31.963 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.958+0000 7f969521b640 1 -- 172.21.15.3:0/3943553726 shutdown_connections 2024-09-21T12:26:31.963 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:31.958+0000 7f969521b640 1 -- 172.21.15.3:0/3943553726 wait complete. 2024-09-21T12:26:32.049 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.045+0000 7fa0ceaf3640 1 -- 172.21.15.3:0/4240597461 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa0c81000c0 msgr2=0x7fa0c81004a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:26:32.049 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.045+0000 7fa0ceaf3640 1 --2- 172.21.15.3:0/4240597461 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa0c81000c0 0x7fa0c81004a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fa0b80097e0 tx=0x7fa0b802a3f0 comp rx=0 tx=0).stop 2024-09-21T12:26:32.049 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.046+0000 7fa0ceaf3640 1 -- 172.21.15.3:0/4240597461 shutdown_connections 2024-09-21T12:26:32.049 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.046+0000 7fa0ceaf3640 1 --2- 172.21.15.3:0/4240597461 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa0c8100a70 0x7fa0c8106610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:26:32.049 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.046+0000 7fa0ceaf3640 1 --2- 172.21.15.3:0/4240597461 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa0c81000c0 0x7fa0c81004a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:26:32.049 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.046+0000 7fa0ceaf3640 1 -- 172.21.15.3:0/4240597461 >> 172.21.15.3:0/4240597461 conn(0x7fa0c80fbc90 msgr2=0x7fa0c80fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:26:32.049 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.046+0000 7fa0ceaf3640 1 -- 172.21.15.3:0/4240597461 shutdown_connections 2024-09-21T12:26:32.049 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.046+0000 7fa0ceaf3640 1 -- 172.21.15.3:0/4240597461 wait complete. 2024-09-21T12:26:32.049 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.046+0000 7fa0ceaf3640 1 Processor -- start 2024-09-21T12:26:32.049 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.046+0000 7fa0ceaf3640 1 -- start start 2024-09-21T12:26:32.051 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.047+0000 7fa0ceaf3640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa0c81000c0 0x7fa0c8101040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:26:32.051 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.047+0000 7fa0ceaf3640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa0c8100a70 0x7fa0c8101580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:26:32.051 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.047+0000 7fa0ceaf3640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c810ee80 con 0x7fa0c8100a70 2024-09-21T12:26:32.051 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.047+0000 7fa0ceaf3640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa0c810ed00 con 0x7fa0c81000c0 2024-09-21T12:26:32.051 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.047+0000 7fa0c7fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa0c8100a70 0x7fa0c8101580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:26:32.051 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.047+0000 7fa0c7fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa0c8100a70 0x7fa0c8101580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44864/0 (socket says 172.21.15.3:44864) 2024-09-21T12:26:32.051 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.047+0000 7fa0c7fff640 1 -- 172.21.15.3:0/1451113326 learned_addr learned my addr 172.21.15.3:0/1451113326 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:26:32.051 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.047+0000 7fa0cc88f640 1 --2- 172.21.15.3:0/1451113326 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa0c81000c0 0x7fa0c8101040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:26:32.051 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.047+0000 7fa0c7fff640 1 -- 172.21.15.3:0/1451113326 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa0c81000c0 msgr2=0x7fa0c8101040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:26:32.051 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.047+0000 7fa0c7fff640 1 --2- 172.21.15.3:0/1451113326 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa0c81000c0 0x7fa0c8101040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:26:32.051 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.047+0000 7fa0c7fff640 1 -- 172.21.15.3:0/1451113326 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0c8101ac0 con 0x7fa0c8100a70 2024-09-21T12:26:32.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.047+0000 7fa0c7fff640 1 --2- 172.21.15.3:0/1451113326 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa0c8100a70 0x7fa0c8101580 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc00e940 tx=0x7fa0bc00ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:26:32.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.047+0000 7fa0c5ffb640 1 -- 172.21.15.3:0/1451113326 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa0bc00cac0 con 0x7fa0c8100a70 2024-09-21T12:26:32.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.047+0000 7fa0ceaf3640 1 -- 172.21.15.3:0/1451113326 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0c8101db0 con 0x7fa0c8100a70 2024-09-21T12:26:32.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.047+0000 7fa0c5ffb640 1 -- 172.21.15.3:0/1451113326 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa0bc0054e0 con 0x7fa0c8100a70 2024-09-21T12:26:32.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.047+0000 7fa0c5ffb640 1 -- 172.21.15.3:0/1451113326 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa0bc004d40 con 0x7fa0c8100a70 2024-09-21T12:26:32.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.048+0000 7fa0ceaf3640 1 -- 172.21.15.3:0/1451113326 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0c81a3fd0 con 0x7fa0c8100a70 2024-09-21T12:26:32.053 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.049+0000 7fa0ceaf3640 1 -- 172.21.15.3:0/1451113326 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0c8103180 con 0x7fa0c8100a70 2024-09-21T12:26:32.053 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.049+0000 7fa0c5ffb640 1 -- 172.21.15.3:0/1451113326 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7fa0bc005020 con 0x7fa0c8100a70 2024-09-21T12:26:32.053 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.050+0000 7fa0c5ffb640 1 --2- 172.21.15.3:0/1451113326 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fa0b007af30 0x7fa0b007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:26:32.053 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.050+0000 7fa0c5ffb640 1 -- 172.21.15.3:0/1451113326 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6156+0+0 (secure 0 0 0) 0x7fa0bc09e6c0 con 0x7fa0c8100a70 2024-09-21T12:26:32.053 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.050+0000 7fa0cc88f640 1 --2- 172.21.15.3:0/1451113326 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fa0b007af30 0x7fa0b007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:26:32.053 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.050+0000 7fa0cc88f640 1 --2- 172.21.15.3:0/1451113326 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fa0b007af30 0x7fa0b007d3f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa0b80095f0 tx=0x7fa0b80058b0 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:26:32.057 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.054+0000 7fa0c5ffb640 1 -- 172.21.15.3:0/1451113326 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa0bc069c20 con 0x7fa0c8100a70 2024-09-21T12:26:32.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:31 smithi192 ceph-mon[80326]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:26:32.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:31 smithi192 ceph-mon[80326]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:26:32.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:31 smithi192 ceph-mon[80326]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:26:32.296 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:31 smithi003 ceph-mon[108723]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:26:32.296 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:31 smithi003 ceph-mon[108723]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:26:32.297 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:31 smithi003 ceph-mon[108723]: from='client.34168 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:26:32.297 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:26:31 smithi003 podman[122552]: 2024-09-21 12:26:31.965689272 +0000 UTC m=+0.413712218 container init 198ba21d051848d81e773372782a2cbdd1466f05669932b5584bbfc115902802 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-21T12:26:32.297 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:26:31 smithi003 podman[122552]: 2024-09-21 12:26:31.969193497 +0000 UTC m=+0.417216423 container start 198ba21d051848d81e773372782a2cbdd1466f05669932b5584bbfc115902802 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-1, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-21T12:26:32.297 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:26:32 smithi003 bash[122552]: 198ba21d051848d81e773372782a2cbdd1466f05669932b5584bbfc115902802 2024-09-21T12:26:32.297 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:26:32 smithi003 systemd[1]: Started Ceph osd.1 for 641beec0-7812-11ef-baf6-efdc52797490. 2024-09-21T12:26:32.297 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.293+0000 7fa0ceaf3640 1 -- 172.21.15.3:0/1451113326 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fa0c8102570 con 0x7fa0c8100a70 2024-09-21T12:26:32.298 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.294+0000 7fa0c5ffb640 1 -- 172.21.15.3:0/1451113326 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) ==== 76+0+2010 (secure 0 0 0) 0x7fa0bc06ead0 con 0x7fa0c8100a70 2024-09-21T12:26:32.298 INFO:teuthology.orchestra.run.smithi003.stdout:e14 2024-09-21T12:26:32.298 INFO:teuthology.orchestra.run.smithi003.stdout:btime 2024-09-21T12:17:55:592931+0000 2024-09-21T12:26:32.298 INFO:teuthology.orchestra.run.smithi003.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T12:26:32.298 INFO:teuthology.orchestra.run.smithi003.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:26:32.298 INFO:teuthology.orchestra.run.smithi003.stdout:legacy client fscid: 1 2024-09-21T12:26:32.298 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:26:32.298 INFO:teuthology.orchestra.run.smithi003.stdout:Filesystem 'cephfs' (1) 2024-09-21T12:26:32.298 INFO:teuthology.orchestra.run.smithi003.stdout:fs_name cephfs 2024-09-21T12:26:32.298 INFO:teuthology.orchestra.run.smithi003.stdout:epoch 14 2024-09-21T12:26:32.299 INFO:teuthology.orchestra.run.smithi003.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T12:26:32.299 INFO:teuthology.orchestra.run.smithi003.stdout:created 2024-09-21T12:17:38.260099+0000 2024-09-21T12:26:32.299 INFO:teuthology.orchestra.run.smithi003.stdout:modified 2024-09-21T12:17:55.592927+0000 2024-09-21T12:26:32.299 INFO:teuthology.orchestra.run.smithi003.stdout:tableserver 0 2024-09-21T12:26:32.299 INFO:teuthology.orchestra.run.smithi003.stdout:root 0 2024-09-21T12:26:32.299 INFO:teuthology.orchestra.run.smithi003.stdout:session_timeout 60 2024-09-21T12:26:32.299 INFO:teuthology.orchestra.run.smithi003.stdout:session_autoclose 300 2024-09-21T12:26:32.299 INFO:teuthology.orchestra.run.smithi003.stdout:max_file_size 1099511627776 2024-09-21T12:26:32.299 INFO:teuthology.orchestra.run.smithi003.stdout:max_xattr_size 65536 2024-09-21T12:26:32.299 INFO:teuthology.orchestra.run.smithi003.stdout:required_client_features {} 2024-09-21T12:26:32.299 INFO:teuthology.orchestra.run.smithi003.stdout:last_failure 0 2024-09-21T12:26:32.299 INFO:teuthology.orchestra.run.smithi003.stdout:last_failure_osd_epoch 46 2024-09-21T12:26:32.299 INFO:teuthology.orchestra.run.smithi003.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:26:32.299 INFO:teuthology.orchestra.run.smithi003.stdout:max_mds 1 2024-09-21T12:26:32.300 INFO:teuthology.orchestra.run.smithi003.stdout:in 0 2024-09-21T12:26:32.300 INFO:teuthology.orchestra.run.smithi003.stdout:up {0=14564} 2024-09-21T12:26:32.300 INFO:teuthology.orchestra.run.smithi003.stdout:failed 2024-09-21T12:26:32.300 INFO:teuthology.orchestra.run.smithi003.stdout:damaged 2024-09-21T12:26:32.300 INFO:teuthology.orchestra.run.smithi003.stdout:stopped 2024-09-21T12:26:32.300 INFO:teuthology.orchestra.run.smithi003.stdout:data_pools [3] 2024-09-21T12:26:32.300 INFO:teuthology.orchestra.run.smithi003.stdout:metadata_pool 2 2024-09-21T12:26:32.300 INFO:teuthology.orchestra.run.smithi003.stdout:inline_data enabled 2024-09-21T12:26:32.300 INFO:teuthology.orchestra.run.smithi003.stdout:balancer 2024-09-21T12:26:32.300 INFO:teuthology.orchestra.run.smithi003.stdout:bal_rank_mask -1 2024-09-21T12:26:32.300 INFO:teuthology.orchestra.run.smithi003.stdout:standby_count_wanted 1 2024-09-21T12:26:32.300 INFO:teuthology.orchestra.run.smithi003.stdout:qdb_cluster leader: 14564 members: 14564 2024-09-21T12:26:32.300 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.cephfs.smithi003.gfkngj{0:14564} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.3:6828/3710817325,v1:172.21.15.3:6829/3710817325] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:26:32.300 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:26:32.301 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:26:32.301 INFO:teuthology.orchestra.run.smithi003.stdout:Standby daemons: 2024-09-21T12:26:32.301 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:26:32.301 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.cephfs.smithi192.ywqqxe{-1:24319} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.192:6824/4055220871,v1:172.21.15.192:6825/4055220871] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:26:32.301 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.cephfs.smithi192.ktdqns{-1:24337} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.192:6826/318800854,v1:172.21.15.192:6827/318800854] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:26:32.301 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.cephfs.smithi003.ebjgyl{-1:24345} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.3:6826/55902996,v1:172.21.15.3:6827/55902996] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:26:32.301 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 14 2024-09-21T12:26:32.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.297+0000 7fa0ceaf3640 1 -- 172.21.15.3:0/1451113326 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fa0b007af30 msgr2=0x7fa0b007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:26:32.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.297+0000 7fa0ceaf3640 1 --2- 172.21.15.3:0/1451113326 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fa0b007af30 0x7fa0b007d3f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa0b80095f0 tx=0x7fa0b80058b0 comp rx=0 tx=0).stop 2024-09-21T12:26:32.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.297+0000 7fa0ceaf3640 1 -- 172.21.15.3:0/1451113326 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa0c8100a70 msgr2=0x7fa0c8101580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:26:32.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.297+0000 7fa0ceaf3640 1 --2- 172.21.15.3:0/1451113326 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa0c8100a70 0x7fa0c8101580 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa0bc00e940 tx=0x7fa0bc00ee00 comp rx=0 tx=0).stop 2024-09-21T12:26:32.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.297+0000 7fa0ceaf3640 1 -- 172.21.15.3:0/1451113326 shutdown_connections 2024-09-21T12:26:32.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.298+0000 7fa0ceaf3640 1 --2- 172.21.15.3:0/1451113326 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fa0b007af30 0x7fa0b007d3f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:26:32.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.298+0000 7fa0ceaf3640 1 --2- 172.21.15.3:0/1451113326 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa0c8100a70 0x7fa0c8101580 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:26:32.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.298+0000 7fa0ceaf3640 1 --2- 172.21.15.3:0/1451113326 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa0c81000c0 0x7fa0c8101040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:26:32.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.298+0000 7fa0ceaf3640 1 -- 172.21.15.3:0/1451113326 >> 172.21.15.3:0/1451113326 conn(0x7fa0c80fbc90 msgr2=0x7fa0c80fd1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:26:32.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.298+0000 7fa0ceaf3640 1 -- 172.21.15.3:0/1451113326 shutdown_connections 2024-09-21T12:26:32.302 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.298+0000 7fa0ceaf3640 1 -- 172.21.15.3:0/1451113326 wait complete. 2024-09-21T12:26:32.392 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.388+0000 7f0bac9bc640 1 -- 172.21.15.3:0/1361020087 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ba8107960 msgr2=0x7f0ba8107d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:26:32.392 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.388+0000 7f0bac9bc640 1 --2- 172.21.15.3:0/1361020087 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ba8107960 0x7f0ba8107d40 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0b98009880 tx=0x7f0b9802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:26:32.392 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.389+0000 7f0bac9bc640 1 -- 172.21.15.3:0/1361020087 shutdown_connections 2024-09-21T12:26:32.392 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.389+0000 7f0bac9bc640 1 --2- 172.21.15.3:0/1361020087 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ba8101960 0x7f0ba8101dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:26:32.392 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.389+0000 7f0bac9bc640 1 --2- 172.21.15.3:0/1361020087 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ba8107960 0x7f0ba8107d40 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:26:32.392 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.389+0000 7f0bac9bc640 1 -- 172.21.15.3:0/1361020087 >> 172.21.15.3:0/1361020087 conn(0x7f0ba80fd680 msgr2=0x7f0ba80ffaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:26:32.392 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.389+0000 7f0bac9bc640 1 -- 172.21.15.3:0/1361020087 shutdown_connections 2024-09-21T12:26:32.393 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.389+0000 7f0bac9bc640 1 -- 172.21.15.3:0/1361020087 wait complete. 2024-09-21T12:26:32.393 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.389+0000 7f0bac9bc640 1 Processor -- start 2024-09-21T12:26:32.393 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.390+0000 7f0bac9bc640 1 -- start start 2024-09-21T12:26:32.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.390+0000 7f0bac9bc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ba8101960 0x7f0ba80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:26:32.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.390+0000 7f0bac9bc640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ba8107960 0x7f0ba8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:26:32.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.390+0000 7f0bac9bc640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f0ba810ee10 con 0x7f0ba8101960 2024-09-21T12:26:32.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.390+0000 7f0bac9bc640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0ba810ec90 con 0x7f0ba8107960 2024-09-21T12:26:32.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.390+0000 7f0ba659c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ba8101960 0x7f0ba80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:26:32.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.390+0000 7f0ba659c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ba8101960 0x7f0ba80744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44888/0 (socket says 172.21.15.3:44888) 2024-09-21T12:26:32.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.390+0000 7f0ba659c640 1 -- 172.21.15.3:0/1660160869 learned_addr learned my addr 172.21.15.3:0/1660160869 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:26:32.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.390+0000 7f0ba5d9b640 1 --2- 172.21.15.3:0/1660160869 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ba8107960 0x7f0ba8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:26:32.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.390+0000 7f0ba659c640 1 -- 172.21.15.3:0/1660160869 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ba8107960 msgr2=0x7f0ba8074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:26:32.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.390+0000 7f0ba659c640 1 --2- 172.21.15.3:0/1660160869 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ba8107960 0x7f0ba8074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:26:32.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.390+0000 7f0ba659c640 1 -- 172.21.15.3:0/1660160869 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ba8076270 con 0x7f0ba8101960 2024-09-21T12:26:32.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.391+0000 7f0ba659c640 1 --2- 172.21.15.3:0/1660160869 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ba8101960 0x7f0ba80744f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0b98031460 tx=0x7f0b980045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:26:32.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.391+0000 7f0b977fe640 1 -- 172.21.15.3:0/1660160869 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0b9803f070 con 0x7f0ba8101960 2024-09-21T12:26:32.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.391+0000 7f0b977fe640 1 -- 172.21.15.3:0/1660160869 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0b98004b10 con 0x7f0ba8101960 2024-09-21T12:26:32.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.391+0000 7f0bac9bc640 1 -- 172.21.15.3:0/1660160869 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ba8074f70 con 0x7f0ba8101960 2024-09-21T12:26:32.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.391+0000 7f0b977fe640 1 -- 172.21.15.3:0/1660160869 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0b98035030 con 0x7f0ba8101960 2024-09-21T12:26:32.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.391+0000 7f0bac9bc640 1 -- 172.21.15.3:0/1660160869 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ba81a8380 con 0x7f0ba8101960 2024-09-21T12:26:32.396 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.392+0000 7f0bac9bc640 1 -- 172.21.15.3:0/1660160869 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ba81030a0 con 0x7f0ba8101960 2024-09-21T12:26:32.396 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.393+0000 7f0b977fe640 1 -- 172.21.15.3:0/1660160869 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f0b98042070 con 0x7f0ba8101960 2024-09-21T12:26:32.396 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.393+0000 7f0b977fe640 1 --2- 172.21.15.3:0/1660160869 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f0b9007afe0 0x7f0b9007d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:26:32.396 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.394+0000 7f0b977fe640 1 -- 172.21.15.3:0/1660160869 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6156+0+0 (secure 0 0 0) 0x7f0b980be990 con 0x7f0ba8101960 2024-09-21T12:26:32.396 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.394+0000 7f0ba5d9b640 1 --2- 172.21.15.3:0/1660160869 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f0b9007afe0 0x7f0b9007d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:26:32.397 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.394+0000 7f0ba5d9b640 1 --2- 172.21.15.3:0/1660160869 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f0b9007afe0 0x7f0b9007d4a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0ba8075cb0 tx=0x7f0b9c00b5b0 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:26:32.404 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.401+0000 7f0b977fe640 1 -- 172.21.15.3:0/1660160869 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0b9808a0b0 con 0x7f0ba8101960 2024-09-21T12:26:32.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.615+0000 7f0bac9bc640 1 -- 172.21.15.3:0/1660160869 --> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f0ba8062630 con 0x7f0b9007afe0 2024-09-21T12:26:32.619 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.617+0000 7f0b977fe640 1 -- 172.21.15.3:0/1660160869 <== mgr.14756 v2:172.21.15.3:6800/1284098095 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f0ba8062630 con 0x7f0b9007afe0 2024-09-21T12:26:32.619 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-21T12:26:32.619 INFO:teuthology.orchestra.run.smithi003.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T12:26:32.619 INFO:teuthology.orchestra.run.smithi003.stdout: "in_progress": true, 2024-09-21T12:26:32.619 INFO:teuthology.orchestra.run.smithi003.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T12:26:32.619 INFO:teuthology.orchestra.run.smithi003.stdout: "services_complete": [ 2024-09-21T12:26:32.620 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr", 2024-09-21T12:26:32.620 INFO:teuthology.orchestra.run.smithi003.stdout: "mon", 2024-09-21T12:26:32.620 INFO:teuthology.orchestra.run.smithi003.stdout: "crash" 2024-09-21T12:26:32.620 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-21T12:26:32.620 INFO:teuthology.orchestra.run.smithi003.stdout: "progress": "7/23 daemons upgraded", 2024-09-21T12:26:32.620 INFO:teuthology.orchestra.run.smithi003.stdout: "message": "Currently upgrading osd daemons", 2024-09-21T12:26:32.620 INFO:teuthology.orchestra.run.smithi003.stdout: "is_paused": false 2024-09-21T12:26:32.620 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-21T12:26:32.621 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.618+0000 7f0bac9bc640 1 -- 172.21.15.3:0/1660160869 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f0b9007afe0 msgr2=0x7f0b9007d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:26:32.621 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.618+0000 7f0bac9bc640 1 --2- 172.21.15.3:0/1660160869 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f0b9007afe0 0x7f0b9007d4a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f0ba8075cb0 tx=0x7f0b9c00b5b0 comp rx=0 tx=0).stop 2024-09-21T12:26:32.622 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.618+0000 7f0bac9bc640 1 -- 172.21.15.3:0/1660160869 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ba8101960 msgr2=0x7f0ba80744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:26:32.622 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.619+0000 7f0bac9bc640 1 --2- 172.21.15.3:0/1660160869 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ba8101960 0x7f0ba80744f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f0b98031460 tx=0x7f0b980045e0 comp rx=0 tx=0).stop 2024-09-21T12:26:32.622 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.619+0000 7f0bac9bc640 1 -- 172.21.15.3:0/1660160869 shutdown_connections 2024-09-21T12:26:32.622 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.619+0000 7f0bac9bc640 1 --2- 172.21.15.3:0/1660160869 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f0b9007afe0 0x7f0b9007d4a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:26:32.622 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.619+0000 7f0bac9bc640 1 --2- 172.21.15.3:0/1660160869 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0ba8107960 0x7f0ba8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:26:32.622 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.619+0000 7f0bac9bc640 1 --2- 172.21.15.3:0/1660160869 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0ba8101960 0x7f0ba80744f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:26:32.622 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.619+0000 7f0bac9bc640 1 -- 172.21.15.3:0/1660160869 >> 172.21.15.3:0/1660160869 conn(0x7f0ba80fd680 msgr2=0x7f0ba80ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:26:32.622 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.619+0000 7f0bac9bc640 1 -- 172.21.15.3:0/1660160869 shutdown_connections 2024-09-21T12:26:32.622 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.619+0000 7f0bac9bc640 1 -- 172.21.15.3:0/1660160869 wait complete. 2024-09-21T12:26:32.707 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.703+0000 7f4e3c0cc640 1 -- 172.21.15.3:0/1320073844 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4e341000e0 msgr2=0x7f4e341004c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:26:32.708 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.703+0000 7f4e3c0cc640 1 --2- 172.21.15.3:0/1320073844 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4e341000e0 0x7f4e341004c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4e30009880 tx=0x7f4e3002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:26:32.708 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.704+0000 7f4e3c0cc640 1 -- 172.21.15.3:0/1320073844 shutdown_connections 2024-09-21T12:26:32.708 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.704+0000 7f4e3c0cc640 1 --2- 172.21.15.3:0/1320073844 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4e34100a90 0x7f4e341065d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:26:32.708 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.704+0000 7f4e3c0cc640 1 --2- 172.21.15.3:0/1320073844 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4e341000e0 0x7f4e341004c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:26:32.708 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.704+0000 7f4e3c0cc640 1 -- 172.21.15.3:0/1320073844 >> 172.21.15.3:0/1320073844 conn(0x7f4e340fbc90 msgr2=0x7f4e340fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:26:32.708 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.704+0000 7f4e3c0cc640 1 -- 172.21.15.3:0/1320073844 shutdown_connections 2024-09-21T12:26:32.708 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.704+0000 7f4e3c0cc640 1 -- 172.21.15.3:0/1320073844 wait complete. 2024-09-21T12:26:32.708 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.704+0000 7f4e3c0cc640 1 Processor -- start 2024-09-21T12:26:32.708 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.704+0000 7f4e3c0cc640 1 -- start start 2024-09-21T12:26:32.708 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.704+0000 7f4e3c0cc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4e341000e0 0x7f4e3419f8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:26:32.708 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.705+0000 7f4e3c0cc640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4e34100a90 0x7f4e3419fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:26:32.708 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.705+0000 7f4e3c0cc640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f4e3410ee50 con 0x7f4e341000e0 2024-09-21T12:26:32.709 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.705+0000 7f4e3c0cc640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f4e3410ecd0 con 0x7f4e34100a90 2024-09-21T12:26:32.709 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.705+0000 7f4e39e68640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4e341000e0 0x7f4e3419f8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:26:32.709 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.705+0000 7f4e39e68640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4e341000e0 0x7f4e3419f8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:44908/0 (socket says 172.21.15.3:44908) 2024-09-21T12:26:32.709 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.705+0000 7f4e39e68640 1 -- 172.21.15.3:0/1370913879 learned_addr learned my addr 172.21.15.3:0/1370913879 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:26:32.709 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.705+0000 7f4e39667640 1 --2- 172.21.15.3:0/1370913879 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4e34100a90 0x7f4e3419fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:26:32.709 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.705+0000 7f4e39e68640 1 -- 172.21.15.3:0/1370913879 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4e34100a90 msgr2=0x7f4e3419fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:26:32.709 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.705+0000 7f4e39e68640 1 --2- 172.21.15.3:0/1370913879 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4e34100a90 0x7f4e3419fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:26:32.709 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.705+0000 7f4e39e68640 1 -- 172.21.15.3:0/1370913879 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e34199ab0 con 0x7f4e341000e0 2024-09-21T12:26:32.709 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.705+0000 7f4e39e68640 1 --2- 172.21.15.3:0/1370913879 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4e341000e0 0x7f4e3419f8f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4e30031460 tx=0x7f4e300045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:26:32.710 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.705+0000 7f4e2affd640 1 -- 172.21.15.3:0/1370913879 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4e3003f070 con 0x7f4e341000e0 2024-09-21T12:26:32.711 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.705+0000 7f4e2affd640 1 -- 172.21.15.3:0/1370913879 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4e300035f0 con 0x7f4e341000e0 2024-09-21T12:26:32.711 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.705+0000 7f4e3c0cc640 1 -- 172.21.15.3:0/1370913879 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e34199d40 con 0x7f4e341000e0 2024-09-21T12:26:32.711 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.705+0000 7f4e2affd640 1 -- 172.21.15.3:0/1370913879 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4e30035030 con 0x7f4e341000e0 2024-09-21T12:26:32.711 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.706+0000 7f4e3c0cc640 1 -- 172.21.15.3:0/1370913879 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e3419a270 con 0x7f4e341000e0 2024-09-21T12:26:32.711 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.707+0000 7f4e3c0cc640 1 -- 172.21.15.3:0/1370913879 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e341031a0 con 0x7f4e341000e0 2024-09-21T12:26:32.711 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.707+0000 7f4e2affd640 1 -- 172.21.15.3:0/1370913879 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f4e30042070 con 0x7f4e341000e0 2024-09-21T12:26:32.711 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.708+0000 7f4e2affd640 1 --2- 172.21.15.3:0/1370913879 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f4e2007af80 0x7f4e2007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:26:32.711 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.708+0000 7f4e39667640 1 --2- 172.21.15.3:0/1370913879 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f4e2007af80 0x7f4e2007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:26:32.711 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.708+0000 7f4e2affd640 1 -- 172.21.15.3:0/1370913879 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 6156+0+0 (secure 0 0 0) 0x7f4e300be860 con 0x7f4e341000e0 2024-09-21T12:26:32.711 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.708+0000 7f4e39667640 1 --2- 172.21.15.3:0/1370913879 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f4e2007af80 0x7f4e2007d440 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4e34102ff0 tx=0x7f4e2400b390 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:26:32.715 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.712+0000 7f4e2affd640 1 -- 172.21.15.3:0/1370913879 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4e30089ee0 con 0x7f4e341000e0 2024-09-21T12:26:32.984 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.981+0000 7f4e3c0cc640 1 -- 172.21.15.3:0/1370913879 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f4e3419afe0 con 0x7f4e341000e0 2024-09-21T12:26:32.984 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.981+0000 7f4e2affd640 1 -- 172.21.15.3:0/1370913879 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+1182 (secure 0 0 0) 0x7f4e3008ed90 con 0x7f4e341000e0 2024-09-21T12:26:32.984 INFO:teuthology.orchestra.run.smithi003.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Degraded data redundancy: 37/279 objects degraded (13.262%), 13 pgs degraded 2024-09-21T12:26:32.984 INFO:teuthology.orchestra.run.smithi003.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:26:32.984 INFO:teuthology.orchestra.run.smithi003.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:26:32.984 INFO:teuthology.orchestra.run.smithi003.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-21T12:26:32.984 INFO:teuthology.orchestra.run.smithi003.stdout: osd.1 (root=default,host=smithi003) is down 2024-09-21T12:26:32.984 INFO:teuthology.orchestra.run.smithi003.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 37/279 objects degraded (13.262%), 13 pgs degraded 2024-09-21T12:26:32.984 INFO:teuthology.orchestra.run.smithi003.stdout: pg 1.0 is active+undersized+degraded, acting [3,0] 2024-09-21T12:26:32.984 INFO:teuthology.orchestra.run.smithi003.stdout: pg 2.0 is active+undersized+degraded, acting [3,0] 2024-09-21T12:26:32.985 INFO:teuthology.orchestra.run.smithi003.stdout: pg 2.1 is active+undersized+degraded, acting [2,0] 2024-09-21T12:26:32.985 INFO:teuthology.orchestra.run.smithi003.stdout: pg 2.2 is active+undersized+degraded, acting [5,0] 2024-09-21T12:26:32.985 INFO:teuthology.orchestra.run.smithi003.stdout: pg 2.3 is active+undersized+degraded, acting [5,2] 2024-09-21T12:26:32.985 INFO:teuthology.orchestra.run.smithi003.stdout: pg 2.4 is active+undersized+degraded, acting [0,4] 2024-09-21T12:26:32.985 INFO:teuthology.orchestra.run.smithi003.stdout: pg 2.6 is active+undersized+degraded, acting [3,4] 2024-09-21T12:26:32.985 INFO:teuthology.orchestra.run.smithi003.stdout: pg 2.9 is active+undersized+degraded, acting [4,0] 2024-09-21T12:26:32.985 INFO:teuthology.orchestra.run.smithi003.stdout: pg 2.a is active+undersized+degraded, acting [4,3] 2024-09-21T12:26:32.985 INFO:teuthology.orchestra.run.smithi003.stdout: pg 2.d is active+undersized+degraded, acting [3,2] 2024-09-21T12:26:32.985 INFO:teuthology.orchestra.run.smithi003.stdout: pg 2.10 is active+undersized+degraded, acting [2,0] 2024-09-21T12:26:32.985 INFO:teuthology.orchestra.run.smithi003.stdout: pg 2.15 is active+undersized+degraded, acting [3,0] 2024-09-21T12:26:32.985 INFO:teuthology.orchestra.run.smithi003.stdout: pg 2.1b is active+undersized+degraded, acting [0,5] 2024-09-21T12:26:32.986 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.984+0000 7f4e3c0cc640 1 -- 172.21.15.3:0/1370913879 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f4e2007af80 msgr2=0x7f4e2007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:26:32.987 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.984+0000 7f4e3c0cc640 1 --2- 172.21.15.3:0/1370913879 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f4e2007af80 0x7f4e2007d440 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4e34102ff0 tx=0x7f4e2400b390 comp rx=0 tx=0).stop 2024-09-21T12:26:32.987 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.984+0000 7f4e3c0cc640 1 -- 172.21.15.3:0/1370913879 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4e341000e0 msgr2=0x7f4e3419f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:26:32.987 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.984+0000 7f4e3c0cc640 1 --2- 172.21.15.3:0/1370913879 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4e341000e0 0x7f4e3419f8f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f4e30031460 tx=0x7f4e300045e0 comp rx=0 tx=0).stop 2024-09-21T12:26:32.987 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.984+0000 7f4e3c0cc640 1 -- 172.21.15.3:0/1370913879 shutdown_connections 2024-09-21T12:26:32.987 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.984+0000 7f4e3c0cc640 1 --2- 172.21.15.3:0/1370913879 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f4e2007af80 0x7f4e2007d440 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:26:32.987 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.984+0000 7f4e3c0cc640 1 --2- 172.21.15.3:0/1370913879 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4e34100a90 0x7f4e3419fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:26:32.987 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.984+0000 7f4e3c0cc640 1 --2- 172.21.15.3:0/1370913879 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4e341000e0 0x7f4e3419f8f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:26:32.987 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.984+0000 7f4e3c0cc640 1 -- 172.21.15.3:0/1370913879 >> 172.21.15.3:0/1370913879 conn(0x7f4e340fbc90 msgr2=0x7f4e340fc070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:26:32.987 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.984+0000 7f4e3c0cc640 1 -- 172.21.15.3:0/1370913879 shutdown_connections 2024-09-21T12:26:32.987 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:26:32.984+0000 7f4e3c0cc640 1 -- 172.21.15.3:0/1370913879 wait complete. 2024-09-21T12:26:33.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:32 smithi192 ceph-mon[80326]: from='client.? 172.21.15.3:0/3943553726' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:26:33.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:32 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:26:33.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:32 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:26:33.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:32 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:26:33.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:32 smithi192 ceph-mon[80326]: from='client.? 172.21.15.3:0/1451113326' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:26:33.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:32 smithi192 ceph-mon[80326]: from='client.34182 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:26:33.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:32 smithi192 ceph-mon[80326]: pgmap v147: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 37/279 objects degraded (13.262%) 2024-09-21T12:26:33.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:32 smithi003 ceph-mon[108723]: from='client.? 172.21.15.3:0/3943553726' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:26:33.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:32 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:26:33.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:32 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:26:33.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:32 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:26:33.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:32 smithi003 ceph-mon[108723]: from='client.? 172.21.15.3:0/1451113326' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:26:33.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:32 smithi003 ceph-mon[108723]: from='client.34182 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:26:33.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:32 smithi003 ceph-mon[108723]: pgmap v147: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 37/279 objects degraded (13.262%) 2024-09-21T12:26:34.114 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:33 smithi003 ceph-mon[108723]: from='client.? 172.21.15.3:0/1370913879' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:26:34.114 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:26:33 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-1[122588]: 2024-09-21T12:26:33.856+0000 7f700e58a640 -1 Falling back to public interface 2024-09-21T12:26:34.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:33 smithi192 ceph-mon[80326]: from='client.? 172.21.15.3:0/1370913879' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:26:35.256 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:34 smithi003 ceph-mon[108723]: pgmap v148: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 37/279 objects degraded (13.262%) 2024-09-21T12:26:35.256 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:34 smithi003 ceph-mon[108723]: Health check update: Degraded data redundancy: 37/279 objects degraded (13.262%), 13 pgs degraded (PG_DEGRADED) 2024-09-21T12:26:35.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:34 smithi192 ceph-mon[80326]: pgmap v148: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 37/279 objects degraded (13.262%) 2024-09-21T12:26:35.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:34 smithi192 ceph-mon[80326]: Health check update: Degraded data redundancy: 37/279 objects degraded (13.262%), 13 pgs degraded (PG_DEGRADED) 2024-09-21T12:26:38.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:37 smithi192 ceph-mon[80326]: pgmap v149: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 37/279 objects degraded (13.262%) 2024-09-21T12:26:38.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:37 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:26:38.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:37 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:26:38.320 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:37 smithi003 ceph-mon[108723]: pgmap v149: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 37/279 objects degraded (13.262%) 2024-09-21T12:26:38.320 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:37 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:26:38.320 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:37 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:26:39.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:38 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:26:39.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:38 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:26:39.331 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:38 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:26:39.331 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:38 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:26:39.655 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:26:39 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-1[122588]: 2024-09-21T12:26:39.479+0000 7f700e58a640 -1 osd.1 53 log_to_monitors true 2024-09-21T12:26:40.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:39 smithi192 ceph-mon[80326]: pgmap v150: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 37/279 objects degraded (13.262%) 2024-09-21T12:26:40.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:39 smithi192 ceph-mon[80326]: from='osd.1 [v2:172.21.15.3:6810/675361839,v1:172.21.15.3:6811/675361839]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T12:26:40.329 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:26:39 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-1[122588]: 2024-09-21T12:26:39.945+0000 7f7006334640 -1 osd.1 53 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T12:26:40.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:39 smithi003 ceph-mon[108723]: pgmap v150: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 37/279 objects degraded (13.262%) 2024-09-21T12:26:40.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:39 smithi003 ceph-mon[108723]: from='osd.1 [v2:172.21.15.3:6810/675361839,v1:172.21.15.3:6811/675361839]' entity='osd.1' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]} : dispatch 2024-09-21T12:26:41.232 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:40 smithi003 ceph-mon[108723]: from='osd.1 [v2:172.21.15.3:6810/675361839,v1:172.21.15.3:6811/675361839]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T12:26:41.232 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:40 smithi003 ceph-mon[108723]: osdmap e56: 6 total, 5 up, 6 in 2024-09-21T12:26:41.232 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:40 smithi003 ceph-mon[108723]: from='osd.1 [v2:172.21.15.3:6810/675361839,v1:172.21.15.3:6811/675361839]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi003", "root=default"]} : dispatch 2024-09-21T12:26:41.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:40 smithi192 ceph-mon[80326]: from='osd.1 [v2:172.21.15.3:6810/675361839,v1:172.21.15.3:6811/675361839]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-21T12:26:41.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:40 smithi192 ceph-mon[80326]: osdmap e56: 6 total, 5 up, 6 in 2024-09-21T12:26:41.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:40 smithi192 ceph-mon[80326]: from='osd.1 [v2:172.21.15.3:6810/675361839,v1:172.21.15.3:6811/675361839]' entity='osd.1' cmd={"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi003", "root=default"]} : dispatch 2024-09-21T12:26:42.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:41 smithi192 ceph-mon[80326]: pgmap v152: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 37/279 objects degraded (13.262%) 2024-09-21T12:26:42.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:41 smithi192 ceph-mon[80326]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T12:26:42.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:41 smithi192 ceph-mon[80326]: osd.1 [v2:172.21.15.3:6810/675361839,v1:172.21.15.3:6811/675361839] boot 2024-09-21T12:26:42.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:41 smithi192 ceph-mon[80326]: osdmap e57: 6 total, 6 up, 6 in 2024-09-21T12:26:42.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:41 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T12:26:42.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:41 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:26:42.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:41 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:26:42.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:41 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:26:42.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:41 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:26:42.259 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:41 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:26:42.259 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:41 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:26:42.259 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:41 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:26:42.259 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:41 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:26:42.259 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:41 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:26:42.259 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:41 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16} : dispatch 2024-09-21T12:26:42.259 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:41 smithi192 ceph-mon[80326]: osdmap e58: 6 total, 6 up, 6 in 2024-09-21T12:26:42.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:41 smithi003 ceph-mon[108723]: pgmap v152: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 37/279 objects degraded (13.262%) 2024-09-21T12:26:42.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:41 smithi003 ceph-mon[108723]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T12:26:42.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:41 smithi003 ceph-mon[108723]: osd.1 [v2:172.21.15.3:6810/675361839,v1:172.21.15.3:6811/675361839] boot 2024-09-21T12:26:42.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:41 smithi003 ceph-mon[108723]: osdmap e57: 6 total, 6 up, 6 in 2024-09-21T12:26:42.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:41 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd metadata", "id": 1} : dispatch 2024-09-21T12:26:42.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:41 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:26:42.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:41 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:26:42.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:41 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:26:42.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:41 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:26:42.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:41 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:26:42.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:41 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:26:42.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:41 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:26:42.331 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:41 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:26:42.331 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:41 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:26:42.331 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:41 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16} : dispatch 2024-09-21T12:26:42.331 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:41 smithi003 ceph-mon[108723]: osdmap e58: 6 total, 6 up, 6 in 2024-09-21T12:26:43.235 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:42 smithi003 ceph-mon[108723]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-21T12:26:43.235 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:42 smithi003 ceph-mon[108723]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-21T12:26:43.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:42 smithi192 ceph-mon[80326]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-21T12:26:43.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:42 smithi192 ceph-mon[80326]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-21T12:26:44.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:43 smithi192 ceph-mon[80326]: pgmap v155: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 37/279 objects degraded (13.262%) 2024-09-21T12:26:44.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:43 smithi003 ceph-mon[108723]: pgmap v155: 65 pgs: 21 active+undersized, 13 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 37/279 objects degraded (13.262%) 2024-09-21T12:26:46.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:45 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:26:46.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:45 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:26:46.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:45 smithi192 ceph-mon[80326]: pgmap v156: 65 pgs: 7 active+undersized, 7 active+undersized+degraded, 51 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 18/279 objects degraded (6.452%) 2024-09-21T12:26:46.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:45 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:26:46.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:45 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:26:46.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:45 smithi003 ceph-mon[108723]: pgmap v156: 65 pgs: 7 active+undersized, 7 active+undersized+degraded, 51 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 18/279 objects degraded (6.452%) 2024-09-21T12:26:47.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:46 smithi192 ceph-mon[80326]: Health check update: Degraded data redundancy: 18/279 objects degraded (6.452%), 7 pgs degraded (PG_DEGRADED) 2024-09-21T12:26:47.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:46 smithi003 ceph-mon[108723]: Health check update: Degraded data redundancy: 18/279 objects degraded (6.452%), 7 pgs degraded (PG_DEGRADED) 2024-09-21T12:26:48.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:47 smithi192 ceph-mon[80326]: pgmap v157: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:26:48.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:47 smithi003 ceph-mon[108723]: pgmap v157: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:26:49.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:48 smithi192 ceph-mon[80326]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 18/279 objects degraded (6.452%), 7 pgs degraded) 2024-09-21T12:26:49.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:48 smithi003 ceph-mon[108723]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 18/279 objects degraded (6.452%), 7 pgs degraded) 2024-09-21T12:26:50.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:49 smithi192 ceph-mon[80326]: pgmap v158: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:26:50.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:49 smithi003 ceph-mon[108723]: pgmap v158: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:26:52.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:51 smithi192 ceph-mon[80326]: pgmap v159: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:26:52.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:51 smithi003 ceph-mon[108723]: pgmap v159: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:26:54.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:53 smithi192 ceph-mon[80326]: pgmap v160: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:26:54.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:53 smithi003 ceph-mon[108723]: pgmap v160: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:26:56.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:55 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:26:56.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:55 smithi192 ceph-mon[80326]: pgmap v161: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:26:56.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:55 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:26:56.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:55 smithi003 ceph-mon[108723]: pgmap v161: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:26:57.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:56 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16} : dispatch 2024-09-21T12:26:57.059 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:56 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16} : dispatch 2024-09-21T12:26:58.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:57 smithi192 ceph-mon[80326]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-21T12:26:58.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:57 smithi192 ceph-mon[80326]: Upgrade: osd.2 is safe to restart 2024-09-21T12:26:58.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:57 smithi192 ceph-mon[80326]: pgmap v162: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:26:58.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:57 smithi003 ceph-mon[108723]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-21T12:26:58.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:57 smithi003 ceph-mon[108723]: Upgrade: osd.2 is safe to restart 2024-09-21T12:26:58.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:57 smithi003 ceph-mon[108723]: pgmap v162: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:26:59.237 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:58 smithi003 ceph-mon[108723]: Upgrade: Updating osd.2 2024-09-21T12:26:59.237 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:58 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:26:59.237 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:58 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T12:26:59.237 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:58 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:26:59.238 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:58 smithi003 ceph-mon[108723]: Deploying daemon osd.2 on smithi003 2024-09-21T12:26:59.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:58 smithi192 ceph-mon[80326]: Upgrade: Updating osd.2 2024-09-21T12:26:59.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:58 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:26:59.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:58 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "auth get", "entity": "osd.2"} : dispatch 2024-09-21T12:26:59.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:58 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:26:59.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:58 smithi192 ceph-mon[80326]: Deploying daemon osd.2 on smithi003 2024-09-21T12:27:00.237 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:59 smithi003 ceph-mon[108723]: pgmap v163: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:27:00.237 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:59 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:27:00.237 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:26:59 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:27:00.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:59 smithi192 ceph-mon[80326]: pgmap v163: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:27:00.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:59 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:27:00.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:26:59 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:27:01.176 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:27:00 smithi003 systemd[1]: Stopping Ceph osd.2 for 641beec0-7812-11ef-baf6-efdc52797490... 2024-09-21T12:27:01.579 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:27:01 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-2[64593]: 2024-09-21T12:27:01.174+0000 7f589387f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T12:27:01.579 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:27:01 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-2[64593]: 2024-09-21T12:27:01.174+0000 7f589387f640 -1 osd.2 58 *** Got signal Terminated *** 2024-09-21T12:27:01.579 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:27:01 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-2[64593]: 2024-09-21T12:27:01.174+0000 7f589387f640 -1 osd.2 58 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T12:27:02.191 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:01 smithi003 ceph-mon[108723]: pgmap v164: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:27:02.191 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:01 smithi003 ceph-mon[108723]: osd.2 marked itself down and dead 2024-09-21T12:27:02.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:01 smithi192 ceph-mon[80326]: pgmap v164: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:27:02.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:01 smithi192 ceph-mon[80326]: osd.2 marked itself down and dead 2024-09-21T12:27:02.579 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:27:02 smithi003 podman[127484]: 2024-09-21 12:27:02.436010844 +0000 UTC m=+1.375896185 container died 3265369e573bd3c89f3b3ad78cd35789c78ea4fbd9bf7b23acdd539e5f2c4a59 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, RELEASE=squid-4e45e6b, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-21T12:27:03.076 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:02 smithi003 ceph-mon[108723]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T12:27:03.076 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:02 smithi003 ceph-mon[108723]: osdmap e59: 6 total, 5 up, 6 in 2024-09-21T12:27:03.076 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:27:02 smithi003 podman[127484]: 2024-09-21 12:27:02.84077389 +0000 UTC m=+1.780659231 container cleanup 3265369e573bd3c89f3b3ad78cd35789c78ea4fbd9bf7b23acdd539e5f2c4a59 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-4e45e6b, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True) 2024-09-21T12:27:03.076 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:27:02 smithi003 bash[127484]: ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-2 2024-09-21T12:27:03.077 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.073+0000 7f23ba7b3640 1 -- 172.21.15.3:0/295306840 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f23b4106800 msgr2=0x7f23b4106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:27:03.077 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.073+0000 7f23ba7b3640 1 --2- 172.21.15.3:0/295306840 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f23b4106800 0x7f23b4106be0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f23a4009880 tx=0x7f23a402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:27:03.077 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.073+0000 7f23ba7b3640 1 -- 172.21.15.3:0/295306840 shutdown_connections 2024-09-21T12:27:03.078 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.073+0000 7f23ba7b3640 1 --2- 172.21.15.3:0/295306840 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f23b4100800 0x7f23b4100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:03.078 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.073+0000 7f23ba7b3640 1 --2- 172.21.15.3:0/295306840 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f23b4106800 0x7f23b4106be0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:03.078 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.073+0000 7f23ba7b3640 1 -- 172.21.15.3:0/295306840 >> 172.21.15.3:0/295306840 conn(0x7f23b40fc520 msgr2=0x7f23b40fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:27:03.078 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.073+0000 7f23ba7b3640 1 -- 172.21.15.3:0/295306840 shutdown_connections 2024-09-21T12:27:03.078 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.073+0000 7f23ba7b3640 1 -- 172.21.15.3:0/295306840 wait complete. 2024-09-21T12:27:03.078 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.074+0000 7f23ba7b3640 1 Processor -- start 2024-09-21T12:27:03.078 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.074+0000 7f23ba7b3640 1 -- start start 2024-09-21T12:27:03.078 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.074+0000 7f23ba7b3640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f23b4100800 0x7f23b41987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:27:03.078 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.074+0000 7f23ba7b3640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f23b4106800 0x7f23b4198d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:27:03.078 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.074+0000 7f23ba7b3640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f23b410dcd0 con 0x7f23b4106800 2024-09-21T12:27:03.081 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.074+0000 7f23ba7b3640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f23b410db50 con 0x7f23b4100800 2024-09-21T12:27:03.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.075+0000 7f23b37fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f23b4106800 0x7f23b4198d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:27:03.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.075+0000 7f23b37fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f23b4106800 0x7f23b4198d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47912/0 (socket says 172.21.15.3:47912) 2024-09-21T12:27:03.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.075+0000 7f23b37fe640 1 -- 172.21.15.3:0/968440383 learned_addr learned my addr 172.21.15.3:0/968440383 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:27:03.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.075+0000 7f23b3fff640 1 --2- 172.21.15.3:0/968440383 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f23b4100800 0x7f23b41987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:27:03.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.075+0000 7f23b37fe640 1 -- 172.21.15.3:0/968440383 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f23b4100800 msgr2=0x7f23b41987e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:27:03.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.075+0000 7f23b37fe640 1 --2- 172.21.15.3:0/968440383 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f23b4100800 0x7f23b41987e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:03.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.075+0000 7f23b37fe640 1 -- 172.21.15.3:0/968440383 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23b4199320 con 0x7f23b4106800 2024-09-21T12:27:03.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.075+0000 7f23b37fe640 1 --2- 172.21.15.3:0/968440383 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f23b4106800 0x7f23b4198d20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f23a800d6f0 tx=0x7f23a800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:27:03.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.076+0000 7f23b17fa640 1 -- 172.21.15.3:0/968440383 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f23a8017070 con 0x7f23b4106800 2024-09-21T12:27:03.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.076+0000 7f23b17fa640 1 -- 172.21.15.3:0/968440383 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f23a800de00 con 0x7f23b4106800 2024-09-21T12:27:03.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.076+0000 7f23ba7b3640 1 -- 172.21.15.3:0/968440383 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23b4199610 con 0x7f23b4106800 2024-09-21T12:27:03.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.076+0000 7f23b17fa640 1 -- 172.21.15.3:0/968440383 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f23a8004bb0 con 0x7f23b4106800 2024-09-21T12:27:03.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.076+0000 7f23ba7b3640 1 -- 172.21.15.3:0/968440383 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23b41a1c10 con 0x7f23b4106800 2024-09-21T12:27:03.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.077+0000 7f23ba7b3640 1 -- 172.21.15.3:0/968440383 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23b4101f40 con 0x7f23b4106800 2024-09-21T12:27:03.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.078+0000 7f23b17fa640 1 -- 172.21.15.3:0/968440383 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f23a8004e60 con 0x7f23b4106800 2024-09-21T12:27:03.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.078+0000 7f23b17fa640 1 --2- 172.21.15.3:0/968440383 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f239c07af30 0x7f239c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:27:03.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.079+0000 7f23b17fa640 1 -- 172.21.15.3:0/968440383 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 6156+0+0 (secure 0 0 0) 0x7f23a809dba0 con 0x7f23b4106800 2024-09-21T12:27:03.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.079+0000 7f23b3fff640 1 --2- 172.21.15.3:0/968440383 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f239c07af30 0x7f239c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:27:03.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.079+0000 7f23b3fff640 1 --2- 172.21.15.3:0/968440383 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f239c07af30 0x7f239c07d3f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f23a40096c0 tx=0x7f23a4031400 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:27:03.085 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.084+0000 7f23b17fa640 1 -- 172.21.15.3:0/968440383 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f23b4199610 con 0x7f23b4106800 2024-09-21T12:27:03.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:02 smithi192 ceph-mon[80326]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T12:27:03.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:02 smithi192 ceph-mon[80326]: osdmap e59: 6 total, 5 up, 6 in 2024-09-21T12:27:03.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.325+0000 7f23ba7b3640 1 -- 172.21.15.3:0/968440383 --> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f23b4062630 con 0x7f239c07af30 2024-09-21T12:27:03.327 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:27:03 smithi003 podman[127510]: 2024-09-21 12:27:03.075419876 +0000 UTC m=+0.634252403 container remove 3265369e573bd3c89f3b3ad78cd35789c78ea4fbd9bf7b23acdd539e5f2c4a59 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-4e45e6b, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-21T12:27:03.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.327+0000 7f23b17fa640 1 -- 172.21.15.3:0/968440383 <== mgr.14756 v2:172.21.15.3:6800/1284098095 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f23b4062630 con 0x7f239c07af30 2024-09-21T12:27:03.331 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.330+0000 7f23ba7b3640 1 -- 172.21.15.3:0/968440383 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f239c07af30 msgr2=0x7f239c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:27:03.331 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.330+0000 7f23ba7b3640 1 --2- 172.21.15.3:0/968440383 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f239c07af30 0x7f239c07d3f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f23a40096c0 tx=0x7f23a4031400 comp rx=0 tx=0).stop 2024-09-21T12:27:03.331 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.330+0000 7f23ba7b3640 1 -- 172.21.15.3:0/968440383 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f23b4106800 msgr2=0x7f23b4198d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:27:03.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.330+0000 7f23ba7b3640 1 --2- 172.21.15.3:0/968440383 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f23b4106800 0x7f23b4198d20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f23a800d6f0 tx=0x7f23a800dbb0 comp rx=0 tx=0).stop 2024-09-21T12:27:03.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.330+0000 7f23ba7b3640 1 -- 172.21.15.3:0/968440383 shutdown_connections 2024-09-21T12:27:03.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.330+0000 7f23ba7b3640 1 --2- 172.21.15.3:0/968440383 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f239c07af30 0x7f239c07d3f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:03.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.330+0000 7f23ba7b3640 1 --2- 172.21.15.3:0/968440383 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f23b4106800 0x7f23b4198d20 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:03.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.330+0000 7f23ba7b3640 1 --2- 172.21.15.3:0/968440383 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f23b4100800 0x7f23b41987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:03.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.330+0000 7f23ba7b3640 1 -- 172.21.15.3:0/968440383 >> 172.21.15.3:0/968440383 conn(0x7f23b40fc520 msgr2=0x7f23b40fcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:27:03.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.330+0000 7f23ba7b3640 1 -- 172.21.15.3:0/968440383 shutdown_connections 2024-09-21T12:27:03.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.330+0000 7f23ba7b3640 1 -- 172.21.15.3:0/968440383 wait complete. 2024-09-21T12:27:03.341 INFO:teuthology.orchestra.run.smithi003.stdout:true 2024-09-21T12:27:03.417 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.415+0000 7ff021922640 1 -- 172.21.15.3:0/3643862640 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff01c1067f0 msgr2=0x7ff01c106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:27:03.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.416+0000 7ff021922640 1 --2- 172.21.15.3:0/3643862640 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff01c1067f0 0x7ff01c106bd0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff004009880 tx=0x7ff00402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:27:03.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.416+0000 7ff021922640 1 -- 172.21.15.3:0/3643862640 shutdown_connections 2024-09-21T12:27:03.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.416+0000 7ff021922640 1 --2- 172.21.15.3:0/3643862640 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff01c1007f0 0x7ff01c100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:03.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.416+0000 7ff021922640 1 --2- 172.21.15.3:0/3643862640 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff01c1067f0 0x7ff01c106bd0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:03.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.416+0000 7ff021922640 1 -- 172.21.15.3:0/3643862640 >> 172.21.15.3:0/3643862640 conn(0x7ff01c0fc550 msgr2=0x7ff01c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:27:03.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.416+0000 7ff021922640 1 -- 172.21.15.3:0/3643862640 shutdown_connections 2024-09-21T12:27:03.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.416+0000 7ff021922640 1 -- 172.21.15.3:0/3643862640 wait complete. 2024-09-21T12:27:03.418 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.416+0000 7ff021922640 1 Processor -- start 2024-09-21T12:27:03.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.416+0000 7ff021922640 1 -- start start 2024-09-21T12:27:03.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.417+0000 7ff021922640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff01c1007f0 0x7ff01c19d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:27:03.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.417+0000 7ff021922640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff01c1067f0 0x7ff01c19dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:27:03.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.417+0000 7ff021922640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7ff01c10dca0 con 0x7ff01c1007f0 2024-09-21T12:27:03.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.417+0000 7ff021922640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7ff01c10db20 con 0x7ff01c1067f0 2024-09-21T12:27:03.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.417+0000 7ff01affd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff01c1007f0 0x7ff01c19d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:27:03.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.417+0000 7ff01affd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff01c1007f0 0x7ff01c19d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47918/0 (socket says 172.21.15.3:47918) 2024-09-21T12:27:03.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.417+0000 7ff01affd640 1 -- 172.21.15.3:0/2237590381 learned_addr learned my addr 172.21.15.3:0/2237590381 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:27:03.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.417+0000 7ff01a7fc640 1 --2- 172.21.15.3:0/2237590381 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff01c1067f0 0x7ff01c19dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:27:03.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.417+0000 7ff01affd640 1 -- 172.21.15.3:0/2237590381 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff01c1067f0 msgr2=0x7ff01c19dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:27:03.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.417+0000 7ff01affd640 1 --2- 172.21.15.3:0/2237590381 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff01c1067f0 0x7ff01c19dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:03.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.417+0000 7ff01affd640 1 -- 172.21.15.3:0/2237590381 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff01c197750 con 0x7ff01c1007f0 2024-09-21T12:27:03.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.417+0000 7ff01affd640 1 --2- 172.21.15.3:0/2237590381 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff01c1007f0 0x7ff01c19d680 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff004031460 tx=0x7ff0040048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:27:03.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.418+0000 7ff020920640 1 -- 172.21.15.3:0/2237590381 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff00403f070 con 0x7ff01c1007f0 2024-09-21T12:27:03.420 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.418+0000 7ff020920640 1 -- 172.21.15.3:0/2237590381 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7ff0040044d0 con 0x7ff01c1007f0 2024-09-21T12:27:03.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.418+0000 7ff020920640 1 -- 172.21.15.3:0/2237590381 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7ff004035030 con 0x7ff01c1007f0 2024-09-21T12:27:03.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.418+0000 7ff021922640 1 -- 172.21.15.3:0/2237590381 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff01c1979e0 con 0x7ff01c1007f0 2024-09-21T12:27:03.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.418+0000 7ff021922640 1 -- 172.21.15.3:0/2237590381 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff01c197ee0 con 0x7ff01c1007f0 2024-09-21T12:27:03.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.419+0000 7ff021922640 1 -- 172.21.15.3:0/2237590381 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff01c101f30 con 0x7ff01c1007f0 2024-09-21T12:27:03.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.419+0000 7ff020920640 1 -- 172.21.15.3:0/2237590381 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7ff004042070 con 0x7ff01c1007f0 2024-09-21T12:27:03.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.420+0000 7ff020920640 1 --2- 172.21.15.3:0/2237590381 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7ff00807af40 0x7ff00807d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:27:03.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.420+0000 7ff020920640 1 -- 172.21.15.3:0/2237590381 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 6156+0+0 (secure 0 0 0) 0x7ff0040beab0 con 0x7ff01c1007f0 2024-09-21T12:27:03.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.420+0000 7ff01a7fc640 1 --2- 172.21.15.3:0/2237590381 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7ff00807af40 0x7ff00807d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:27:03.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.421+0000 7ff01a7fc640 1 --2- 172.21.15.3:0/2237590381 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7ff00807af40 0x7ff00807d400 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff01c198fa0 tx=0x7ff00c00a2d0 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:27:03.426 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.425+0000 7ff020920640 1 -- 172.21.15.3:0/2237590381 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7ff004004cf0 con 0x7ff01c1007f0 2024-09-21T12:27:03.579 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:27:03 smithi003 podman[127624]: 2024-09-21 12:27:03.335318245 +0000 UTC m=+0.018489925 image pull 8f4d013db793795fef09ff5edf96e6b42ba8cd2c9158b2f0b7a5d7c1e657c063 quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 2024-09-21T12:27:03.579 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:27:03 smithi003 podman[127624]: 2024-09-21 12:27:03.459797307 +0000 UTC m=+0.142968971 container create 71b31882f0a6b77ccb1e3463261f6ae4cb0fab4e5f692a8ff0b15c7ba37223e4 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-2-deactivate, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3) 2024-09-21T12:27:03.635 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.633+0000 7ff021922640 1 -- 172.21.15.3:0/2237590381 --> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7ff01c198190 con 0x7ff00807af40 2024-09-21T12:27:03.636 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.635+0000 7ff020920640 1 -- 172.21.15.3:0/2237590381 <== mgr.14756 v2:172.21.15.3:6800/1284098095 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7ff01c198190 con 0x7ff00807af40 2024-09-21T12:27:03.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.637+0000 7ff021922640 1 -- 172.21.15.3:0/2237590381 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7ff00807af40 msgr2=0x7ff00807d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:27:03.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.637+0000 7ff021922640 1 --2- 172.21.15.3:0/2237590381 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7ff00807af40 0x7ff00807d400 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff01c198fa0 tx=0x7ff00c00a2d0 comp rx=0 tx=0).stop 2024-09-21T12:27:03.638 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.637+0000 7ff021922640 1 -- 172.21.15.3:0/2237590381 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff01c1007f0 msgr2=0x7ff01c19d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:27:03.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.637+0000 7ff021922640 1 --2- 172.21.15.3:0/2237590381 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff01c1007f0 0x7ff01c19d680 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff004031460 tx=0x7ff0040048f0 comp rx=0 tx=0).stop 2024-09-21T12:27:03.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.637+0000 7ff021922640 1 -- 172.21.15.3:0/2237590381 shutdown_connections 2024-09-21T12:27:03.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.637+0000 7ff021922640 1 --2- 172.21.15.3:0/2237590381 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7ff00807af40 0x7ff00807d400 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:03.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.637+0000 7ff021922640 1 --2- 172.21.15.3:0/2237590381 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7ff01c1067f0 0x7ff01c19dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:03.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.637+0000 7ff021922640 1 --2- 172.21.15.3:0/2237590381 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7ff01c1007f0 0x7ff01c19d680 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:03.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.637+0000 7ff021922640 1 -- 172.21.15.3:0/2237590381 >> 172.21.15.3:0/2237590381 conn(0x7ff01c0fc550 msgr2=0x7ff01c069e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:27:03.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.637+0000 7ff021922640 1 -- 172.21.15.3:0/2237590381 shutdown_connections 2024-09-21T12:27:03.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.637+0000 7ff021922640 1 -- 172.21.15.3:0/2237590381 wait complete. 2024-09-21T12:27:03.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.722+0000 7f88874e6640 1 -- 172.21.15.3:0/52692476 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8880100860 msgr2=0x7f8880100cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:27:03.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.722+0000 7f88874e6640 1 --2- 172.21.15.3:0/52692476 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8880100860 0x7f8880100cc0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f8870009880 tx=0x7f887002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:27:03.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.722+0000 7f88874e6640 1 -- 172.21.15.3:0/52692476 shutdown_connections 2024-09-21T12:27:03.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.722+0000 7f88874e6640 1 --2- 172.21.15.3:0/52692476 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8880100860 0x7f8880100cc0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:03.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.722+0000 7f88874e6640 1 --2- 172.21.15.3:0/52692476 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8880106860 0x7f8880106c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:03.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.722+0000 7f88874e6640 1 -- 172.21.15.3:0/52692476 >> 172.21.15.3:0/52692476 conn(0x7f88800fc580 msgr2=0x7f88800fe9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:27:03.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.722+0000 7f88874e6640 1 -- 172.21.15.3:0/52692476 shutdown_connections 2024-09-21T12:27:03.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.722+0000 7f88874e6640 1 -- 172.21.15.3:0/52692476 wait complete. 2024-09-21T12:27:03.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.723+0000 7f88874e6640 1 Processor -- start 2024-09-21T12:27:03.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.723+0000 7f88874e6640 1 -- start start 2024-09-21T12:27:03.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.723+0000 7f88874e6640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8880100860 0x7f888019d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:27:03.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.723+0000 7f88874e6640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8880106860 0x7f888019dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:27:03.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.723+0000 7f88874e6640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f888010dd90 con 0x7f8880100860 2024-09-21T12:27:03.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.723+0000 7f88874e6640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f888010dc10 con 0x7f8880106860 2024-09-21T12:27:03.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.723+0000 7f8885282640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8880100860 0x7f888019d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:27:03.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.723+0000 7f8885282640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8880100860 0x7f888019d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47938/0 (socket says 172.21.15.3:47938) 2024-09-21T12:27:03.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.723+0000 7f8885282640 1 -- 172.21.15.3:0/3327802371 learned_addr learned my addr 172.21.15.3:0/3327802371 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:27:03.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.724+0000 7f8884a81640 1 --2- 172.21.15.3:0/3327802371 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8880106860 0x7f888019dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:27:03.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.724+0000 7f8885282640 1 -- 172.21.15.3:0/3327802371 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8880106860 msgr2=0x7f888019dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:27:03.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.724+0000 7f8885282640 1 --2- 172.21.15.3:0/3327802371 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8880106860 0x7f888019dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:03.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.724+0000 7f8885282640 1 -- 172.21.15.3:0/3327802371 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88801978a0 con 0x7f8880100860 2024-09-21T12:27:03.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.724+0000 7f8885282640 1 --2- 172.21.15.3:0/3327802371 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8880100860 0x7f888019d6e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f887c00b420 tx=0x7f887c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:27:03.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.724+0000 7f88767fc640 1 -- 172.21.15.3:0/3327802371 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f887c011630 con 0x7f8880100860 2024-09-21T12:27:03.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.724+0000 7f88767fc640 1 -- 172.21.15.3:0/3327802371 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f887c016070 con 0x7f8880100860 2024-09-21T12:27:03.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.724+0000 7f88874e6640 1 -- 172.21.15.3:0/3327802371 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8880197b90 con 0x7f8880100860 2024-09-21T12:27:03.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.724+0000 7f88767fc640 1 -- 172.21.15.3:0/3327802371 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f887c010d40 con 0x7f8880100860 2024-09-21T12:27:03.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.724+0000 7f88874e6640 1 -- 172.21.15.3:0/3327802371 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88801980f0 con 0x7f8880100860 2024-09-21T12:27:03.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.725+0000 7f88874e6640 1 -- 172.21.15.3:0/3327802371 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8880101fa0 con 0x7f8880100860 2024-09-21T12:27:03.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.726+0000 7f88767fc640 1 -- 172.21.15.3:0/3327802371 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f887c01b460 con 0x7f8880100860 2024-09-21T12:27:03.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.727+0000 7f88767fc640 1 --2- 172.21.15.3:0/3327802371 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f886c07af80 0x7f886c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:27:03.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.727+0000 7f88767fc640 1 -- 172.21.15.3:0/3327802371 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 6156+0+0 (secure 0 0 0) 0x7f887c09d610 con 0x7f8880100860 2024-09-21T12:27:03.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.727+0000 7f8884a81640 1 --2- 172.21.15.3:0/3327802371 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f886c07af80 0x7f886c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:27:03.729 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.727+0000 7f8884a81640 1 --2- 172.21.15.3:0/3327802371 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f886c07af80 0x7f886c07d440 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8880199090 tx=0x7f8870031400 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:27:03.736 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.735+0000 7f88767fc640 1 -- 172.21.15.3:0/3327802371 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f887c068c90 con 0x7f8880100860 2024-09-21T12:27:03.896 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:27:03 smithi003 podman[127624]: 2024-09-21 12:27:03.712906932 +0000 UTC m=+0.396078604 container init 71b31882f0a6b77ccb1e3463261f6ae4cb0fab4e5f692a8ff0b15c7ba37223e4 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-2-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-21T12:27:03.897 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:27:03 smithi003 podman[127624]: 2024-09-21 12:27:03.71652019 +0000 UTC m=+0.399691858 container start 71b31882f0a6b77ccb1e3463261f6ae4cb0fab4e5f692a8ff0b15c7ba37223e4 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-2-deactivate, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T12:27:03.897 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:27:03 smithi003 podman[127624]: 2024-09-21 12:27:03.812868842 +0000 UTC m=+0.496040515 container attach 71b31882f0a6b77ccb1e3463261f6ae4cb0fab4e5f692a8ff0b15c7ba37223e4 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-2-deactivate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3) 2024-09-21T12:27:03.941 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.939+0000 7f88874e6640 1 -- 172.21.15.3:0/3327802371 --> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f8880198dd0 con 0x7f886c07af80 2024-09-21T12:27:03.951 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.950+0000 7f88767fc640 1 -- 172.21.15.3:0/3327802371 <== mgr.14756 v2:172.21.15.3:6800/1284098095 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f8880198dd0 con 0x7f886c07af80 2024-09-21T12:27:03.951 INFO:teuthology.orchestra.run.smithi003.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:27:03.951 INFO:teuthology.orchestra.run.smithi003.stdout:alertmanager.smithi003 smithi003 *:9093,9094 running (3m) 26s ago 14m 19.0M - 0.27.0 11f11916f8cd 14880018dfd3 2024-09-21T12:27:03.952 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-exporter.smithi003 smithi003 running (5m) 26s ago 14m 8762k - 19.1.1-373-g4e45e6b4 164465d2334a 0c9ad60a4f5a 2024-09-21T12:27:03.952 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-exporter.smithi192 smithi192 running (5m) 88s ago 14m 8338k - 19.1.1-373-g4e45e6b4 164465d2334a d5be8a6e120f 2024-09-21T12:27:03.952 INFO:teuthology.orchestra.run.smithi003.stdout:crash.smithi003 smithi003 running (97s) 26s ago 14m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 0ada67250dba 2024-09-21T12:27:03.952 INFO:teuthology.orchestra.run.smithi003.stdout:crash.smithi192 smithi192 running (92s) 88s ago 14m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 52e279085b2e 2024-09-21T12:27:03.952 INFO:teuthology.orchestra.run.smithi003.stdout:grafana.smithi003 smithi003 *:3000 running (3m) 26s ago 14m 81.0M - 10.4.8 5aad1d7cf004 19e26b3cb585 2024-09-21T12:27:03.952 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi003.ebjgyl smithi003 running (9m) 26s ago 9m 16.9M - 19.1.1-373-g4e45e6b4 164465d2334a 16e0b2cac16a 2024-09-21T12:27:03.952 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi003.gfkngj smithi003 running (9m) 26s ago 9m 143M - 19.1.1-373-g4e45e6b4 164465d2334a 109c04f87fbd 2024-09-21T12:27:03.952 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi192.ktdqns smithi192 running (9m) 88s ago 9m 18.2M - 19.1.1-373-g4e45e6b4 164465d2334a 495c73fb3bb0 2024-09-21T12:27:03.952 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi192.ywqqxe smithi192 running (9m) 88s ago 9m 18.2M - 19.1.1-373-g4e45e6b4 164465d2334a 270a01030cbe 2024-09-21T12:27:03.952 INFO:teuthology.orchestra.run.smithi003.stdout:mgr.smithi003.wztftl smithi003 *:8443,9283,8765 running (5m) 26s ago 16m 524M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 8ce0e66fd369 2024-09-21T12:27:03.952 INFO:teuthology.orchestra.run.smithi003.stdout:mgr.smithi192.qsaprd smithi192 *:8443,9283,8765 running (4m) 88s ago 13m 457M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 002a6171dd47 2024-09-21T12:27:03.952 INFO:teuthology.orchestra.run.smithi003.stdout:mon.smithi003 smithi003 running (2m) 26s ago 16m 40.3M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 4f2b2b2daf19 2024-09-21T12:27:03.952 INFO:teuthology.orchestra.run.smithi003.stdout:mon.smithi192 smithi192 running (109s) 88s ago 13m 25.9M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 11edc5c1baba 2024-09-21T12:27:03.952 INFO:teuthology.orchestra.run.smithi003.stdout:node-exporter.smithi003 smithi003 *:9100 running (4m) 26s ago 14m 9.79M - 1.7.0 72c9c2088986 d9cb7ede9060 2024-09-21T12:27:03.953 INFO:teuthology.orchestra.run.smithi003.stdout:node-exporter.smithi192 smithi192 *:9100 running (4m) 88s ago 14m 11.6M - 1.7.0 72c9c2088986 d8ec0acfce7e 2024-09-21T12:27:03.953 INFO:teuthology.orchestra.run.smithi003.stdout:osd.0 smithi003 running (70s) 26s ago 12m 81.4M 1217M 19.3.0-5103-g5c1cdc3c 8f4d013db793 0f2234f333ec 2024-09-21T12:27:03.953 INFO:teuthology.orchestra.run.smithi003.stdout:osd.1 smithi003 running (32s) 26s ago 12m 12.2M 1217M 19.3.0-5103-g5c1cdc3c 8f4d013db793 198ba21d0518 2024-09-21T12:27:03.953 INFO:teuthology.orchestra.run.smithi003.stdout:osd.2 smithi003 running (11m) 26s ago 11m 171M 1217M 19.1.1-373-g4e45e6b4 164465d2334a 3265369e573b 2024-09-21T12:27:03.953 INFO:teuthology.orchestra.run.smithi003.stdout:osd.3 smithi192 running (11m) 88s ago 11m 238M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 13efcfd71c05 2024-09-21T12:27:03.953 INFO:teuthology.orchestra.run.smithi003.stdout:osd.4 smithi192 running (10m) 88s ago 10m 204M 2240M 19.1.1-373-g4e45e6b4 164465d2334a f33bf453cb3e 2024-09-21T12:27:03.953 INFO:teuthology.orchestra.run.smithi003.stdout:osd.5 smithi192 running (10m) 88s ago 10m 182M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 12d7b7c8e985 2024-09-21T12:27:03.953 INFO:teuthology.orchestra.run.smithi003.stdout:prometheus.smithi003 smithi003 *:9095 running (3m) 26s ago 14m 54.5M - 2.51.0 1d3b7f56885b 64997a33fbbb 2024-09-21T12:27:03.954 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.952+0000 7f88874e6640 1 -- 172.21.15.3:0/3327802371 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f886c07af80 msgr2=0x7f886c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:27:03.954 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.952+0000 7f88874e6640 1 --2- 172.21.15.3:0/3327802371 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f886c07af80 0x7f886c07d440 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8880199090 tx=0x7f8870031400 comp rx=0 tx=0).stop 2024-09-21T12:27:03.954 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.952+0000 7f88874e6640 1 -- 172.21.15.3:0/3327802371 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8880100860 msgr2=0x7f888019d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:27:03.954 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.952+0000 7f88874e6640 1 --2- 172.21.15.3:0/3327802371 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8880100860 0x7f888019d6e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f887c00b420 tx=0x7f887c00b8e0 comp rx=0 tx=0).stop 2024-09-21T12:27:03.954 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.952+0000 7f88874e6640 1 -- 172.21.15.3:0/3327802371 shutdown_connections 2024-09-21T12:27:03.954 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.952+0000 7f88874e6640 1 --2- 172.21.15.3:0/3327802371 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f886c07af80 0x7f886c07d440 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:03.954 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.952+0000 7f88874e6640 1 --2- 172.21.15.3:0/3327802371 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8880106860 0x7f888019dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:03.954 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.952+0000 7f88874e6640 1 --2- 172.21.15.3:0/3327802371 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8880100860 0x7f888019d6e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:03.955 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.952+0000 7f88874e6640 1 -- 172.21.15.3:0/3327802371 >> 172.21.15.3:0/3327802371 conn(0x7f88800fc580 msgr2=0x7f888006a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:27:03.955 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.952+0000 7f88874e6640 1 -- 172.21.15.3:0/3327802371 shutdown_connections 2024-09-21T12:27:03.955 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:03.952+0000 7f88874e6640 1 -- 172.21.15.3:0/3327802371 wait complete. 2024-09-21T12:27:04.039 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.037+0000 7f8651758640 1 -- 172.21.15.3:0/3189770284 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f864c107900 msgr2=0x7f864c107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:27:04.039 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.037+0000 7f8651758640 1 --2- 172.21.15.3:0/3189770284 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f864c107900 0x7f864c107ce0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f863c009c20 tx=0x7f863c02a970 comp rx=0 tx=0).stop 2024-09-21T12:27:04.039 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.037+0000 7f8651758640 1 -- 172.21.15.3:0/3189770284 shutdown_connections 2024-09-21T12:27:04.039 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.037+0000 7f8651758640 1 --2- 172.21.15.3:0/3189770284 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f864c101900 0x7f864c101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:04.040 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.037+0000 7f8651758640 1 --2- 172.21.15.3:0/3189770284 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f864c107900 0x7f864c107ce0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:04.040 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.037+0000 7f8651758640 1 -- 172.21.15.3:0/3189770284 >> 172.21.15.3:0/3189770284 conn(0x7f864c0fd600 msgr2=0x7f864c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:27:04.040 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.037+0000 7f8651758640 1 -- 172.21.15.3:0/3189770284 shutdown_connections 2024-09-21T12:27:04.040 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.037+0000 7f8651758640 1 -- 172.21.15.3:0/3189770284 wait complete. 2024-09-21T12:27:04.040 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.038+0000 7f8651758640 1 Processor -- start 2024-09-21T12:27:04.040 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.038+0000 7f8651758640 1 -- start start 2024-09-21T12:27:04.041 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.038+0000 7f8651758640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f864c101900 0x7f864c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:27:04.041 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.038+0000 7f8651758640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f864c107900 0x7f864c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:27:04.041 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.038+0000 7f8651758640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f864c10edd0 con 0x7f864c101900 2024-09-21T12:27:04.041 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.038+0000 7f8651758640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f864c10ec50 con 0x7f864c107900 2024-09-21T12:27:04.042 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.038+0000 7f864affd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f864c101900 0x7f864c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:27:04.042 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.038+0000 7f864affd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f864c101900 0x7f864c0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47954/0 (socket says 172.21.15.3:47954) 2024-09-21T12:27:04.042 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.038+0000 7f864affd640 1 -- 172.21.15.3:0/3990677674 learned_addr learned my addr 172.21.15.3:0/3990677674 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:27:04.042 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.038+0000 7f864a7fc640 1 --2- 172.21.15.3:0/3990677674 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f864c107900 0x7f864c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:27:04.042 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.039+0000 7f864affd640 1 -- 172.21.15.3:0/3990677674 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f864c107900 msgr2=0x7f864c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:27:04.042 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.039+0000 7f864affd640 1 --2- 172.21.15.3:0/3990677674 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f864c107900 0x7f864c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:04.042 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.039+0000 7f864affd640 1 -- 172.21.15.3:0/3990677674 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f864c074f70 con 0x7f864c101900 2024-09-21T12:27:04.042 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.039+0000 7f864a7fc640 1 --2- 172.21.15.3:0/3990677674 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f864c107900 0x7f864c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:27:04.042 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.039+0000 7f864affd640 1 --2- 172.21.15.3:0/3990677674 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f864c101900 0x7f864c0744f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f863c005cc0 tx=0x7f863c02f5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:27:04.042 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.039+0000 7f8643fff640 1 -- 172.21.15.3:0/3990677674 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f863c047070 con 0x7f864c101900 2024-09-21T12:27:04.042 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.039+0000 7f8651758640 1 -- 172.21.15.3:0/3990677674 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f864c075200 con 0x7f864c101900 2024-09-21T12:27:04.042 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.039+0000 7f8643fff640 1 -- 172.21.15.3:0/3990677674 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f863c02f7e0 con 0x7f864c101900 2024-09-21T12:27:04.042 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.039+0000 7f8643fff640 1 -- 172.21.15.3:0/3990677674 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f863c034070 con 0x7f864c101900 2024-09-21T12:27:04.043 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.039+0000 7f8651758640 1 -- 172.21.15.3:0/3990677674 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f864c1a3d60 con 0x7f864c101900 2024-09-21T12:27:04.043 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.040+0000 7f8651758640 1 -- 172.21.15.3:0/3990677674 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f864c103040 con 0x7f864c101900 2024-09-21T12:27:04.043 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.041+0000 7f8643fff640 1 -- 172.21.15.3:0/3990677674 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f863c04a070 con 0x7f864c101900 2024-09-21T12:27:04.043 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.041+0000 7f8643fff640 1 --2- 172.21.15.3:0/3990677674 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f863807af30 0x7f863807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:27:04.044 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.042+0000 7f8643fff640 1 -- 172.21.15.3:0/3990677674 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 6156+0+0 (secure 0 0 0) 0x7f863c0bef80 con 0x7f864c101900 2024-09-21T12:27:04.044 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.042+0000 7f864a7fc640 1 --2- 172.21.15.3:0/3990677674 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f863807af30 0x7f863807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:27:04.044 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.042+0000 7f864a7fc640 1 --2- 172.21.15.3:0/3990677674 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f863807af30 0x7f863807d3f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8634005fd0 tx=0x7f8634005ea0 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:27:04.047 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.046+0000 7f8643fff640 1 -- 172.21.15.3:0/3990677674 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f863c03f070 con 0x7f864c101900 2024-09-21T12:27:04.155 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:03 smithi003 ceph-mon[108723]: pgmap v166: 65 pgs: 9 stale+active+clean, 56 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:27:04.155 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:03 smithi003 ceph-mon[108723]: osdmap e60: 6 total, 5 up, 6 in 2024-09-21T12:27:04.156 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:27:03 smithi003 podman[127624]: 2024-09-21 12:27:03.928191914 +0000 UTC m=+0.611363589 container died 71b31882f0a6b77ccb1e3463261f6ae4cb0fab4e5f692a8ff0b15c7ba37223e4 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True) 2024-09-21T12:27:04.159 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:03 smithi192 ceph-mon[80326]: pgmap v166: 65 pgs: 9 stale+active+clean, 56 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:27:04.159 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:03 smithi192 ceph-mon[80326]: osdmap e60: 6 total, 5 up, 6 in 2024-09-21T12:27:04.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.328+0000 7f8651758640 1 -- 172.21.15.3:0/3990677674 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f864c109e70 con 0x7f864c101900 2024-09-21T12:27:04.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.328+0000 7f8643fff640 1 -- 172.21.15.3:0/3990677674 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+836 (secure 0 0 0) 0x7f863c08a4e0 con 0x7f864c101900 2024-09-21T12:27:04.330 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-21T12:27:04.330 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": { 2024-09-21T12:27:04.330 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:27:04.331 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:27:04.331 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": { 2024-09-21T12:27:04.331 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:27:04.331 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:27:04.331 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": { 2024-09-21T12:27:04.331 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 3, 2024-09-21T12:27:04.331 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:27:04.331 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:27:04.331 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": { 2024-09-21T12:27:04.331 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 4 2024-09-21T12:27:04.331 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:27:04.331 INFO:teuthology.orchestra.run.smithi003.stdout: "overall": { 2024-09-21T12:27:04.331 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 7, 2024-09-21T12:27:04.332 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 6 2024-09-21T12:27:04.332 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-21T12:27:04.332 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-21T12:27:04.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.331+0000 7f8651758640 1 -- 172.21.15.3:0/3990677674 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f863807af30 msgr2=0x7f863807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:27:04.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.331+0000 7f8651758640 1 --2- 172.21.15.3:0/3990677674 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f863807af30 0x7f863807d3f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8634005fd0 tx=0x7f8634005ea0 comp rx=0 tx=0).stop 2024-09-21T12:27:04.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.331+0000 7f8651758640 1 -- 172.21.15.3:0/3990677674 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f864c101900 msgr2=0x7f864c0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:27:04.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.331+0000 7f8651758640 1 --2- 172.21.15.3:0/3990677674 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f864c101900 0x7f864c0744f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f863c005cc0 tx=0x7f863c02f5f0 comp rx=0 tx=0).stop 2024-09-21T12:27:04.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.331+0000 7f8651758640 1 -- 172.21.15.3:0/3990677674 shutdown_connections 2024-09-21T12:27:04.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.331+0000 7f8651758640 1 --2- 172.21.15.3:0/3990677674 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f863807af30 0x7f863807d3f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:04.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.331+0000 7f8651758640 1 --2- 172.21.15.3:0/3990677674 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f864c107900 0x7f864c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:04.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.331+0000 7f8651758640 1 --2- 172.21.15.3:0/3990677674 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f864c101900 0x7f864c0744f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:04.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.331+0000 7f8651758640 1 -- 172.21.15.3:0/3990677674 >> 172.21.15.3:0/3990677674 conn(0x7f864c0fd600 msgr2=0x7f864c0fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:27:04.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.331+0000 7f8651758640 1 -- 172.21.15.3:0/3990677674 shutdown_connections 2024-09-21T12:27:04.333 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.331+0000 7f8651758640 1 -- 172.21.15.3:0/3990677674 wait complete. 2024-09-21T12:27:04.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.416+0000 7f0c207c3640 1 -- 172.21.15.3:0/1251356460 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0c18101900 msgr2=0x7f0c18101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:27:04.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.416+0000 7f0c207c3640 1 --2- 172.21.15.3:0/1251356460 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0c18101900 0x7f0c18101d60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0c08009880 tx=0x7f0c0802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:27:04.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.417+0000 7f0c207c3640 1 -- 172.21.15.3:0/1251356460 shutdown_connections 2024-09-21T12:27:04.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.417+0000 7f0c207c3640 1 --2- 172.21.15.3:0/1251356460 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0c18101900 0x7f0c18101d60 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:04.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.417+0000 7f0c207c3640 1 --2- 172.21.15.3:0/1251356460 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c18107900 0x7f0c18107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:04.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.417+0000 7f0c207c3640 1 -- 172.21.15.3:0/1251356460 >> 172.21.15.3:0/1251356460 conn(0x7f0c180fd600 msgr2=0x7f0c180ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:27:04.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.417+0000 7f0c207c3640 1 -- 172.21.15.3:0/1251356460 shutdown_connections 2024-09-21T12:27:04.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.417+0000 7f0c207c3640 1 -- 172.21.15.3:0/1251356460 wait complete. 2024-09-21T12:27:04.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.417+0000 7f0c207c3640 1 Processor -- start 2024-09-21T12:27:04.419 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.417+0000 7f0c207c3640 1 -- start start 2024-09-21T12:27:04.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.418+0000 7f0c207c3640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c18101900 0x7f0c1819f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:27:04.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.418+0000 7f0c207c3640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0c18107900 0x7f0c1819fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:27:04.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.418+0000 7f0c207c3640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f0c1810edd0 con 0x7f0c18107900 2024-09-21T12:27:04.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.418+0000 7f0c207c3640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0c1810ec50 con 0x7f0c18101900 2024-09-21T12:27:04.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.418+0000 7f0c1dd5e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0c18107900 0x7f0c1819fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:27:04.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.418+0000 7f0c1dd5e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0c18107900 0x7f0c1819fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47962/0 (socket says 172.21.15.3:47962) 2024-09-21T12:27:04.421 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.418+0000 7f0c1dd5e640 1 -- 172.21.15.3:0/169448589 learned_addr learned my addr 172.21.15.3:0/169448589 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:27:04.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.418+0000 7f0c1e55f640 1 --2- 172.21.15.3:0/169448589 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c18101900 0x7f0c1819f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:27:04.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.418+0000 7f0c1dd5e640 1 -- 172.21.15.3:0/169448589 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c18101900 msgr2=0x7f0c1819f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:27:04.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.418+0000 7f0c1dd5e640 1 --2- 172.21.15.3:0/169448589 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c18101900 0x7f0c1819f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:04.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.418+0000 7f0c1dd5e640 1 -- 172.21.15.3:0/169448589 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c181999f0 con 0x7f0c18107900 2024-09-21T12:27:04.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.418+0000 7f0c1dd5e640 1 --2- 172.21.15.3:0/169448589 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0c18107900 0x7f0c1819fd70 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0c08031460 tx=0x7f0c08004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:27:04.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.419+0000 7f0c0f7fe640 1 -- 172.21.15.3:0/169448589 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0c0803f070 con 0x7f0c18107900 2024-09-21T12:27:04.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.419+0000 7f0c0f7fe640 1 -- 172.21.15.3:0/169448589 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0c080035f0 con 0x7f0c18107900 2024-09-21T12:27:04.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.419+0000 7f0c207c3640 1 -- 172.21.15.3:0/169448589 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c18199c80 con 0x7f0c18107900 2024-09-21T12:27:04.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.419+0000 7f0c0f7fe640 1 -- 172.21.15.3:0/169448589 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0c08035030 con 0x7f0c18107900 2024-09-21T12:27:04.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.419+0000 7f0c207c3640 1 -- 172.21.15.3:0/169448589 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c1819a1b0 con 0x7f0c18107900 2024-09-21T12:27:04.422 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.420+0000 7f0c207c3640 1 -- 172.21.15.3:0/169448589 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c18103040 con 0x7f0c18107900 2024-09-21T12:27:04.423 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.420+0000 7f0c0f7fe640 1 -- 172.21.15.3:0/169448589 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f0c08042070 con 0x7f0c18107900 2024-09-21T12:27:04.423 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.421+0000 7f0c0f7fe640 1 --2- 172.21.15.3:0/169448589 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f0c0407af80 0x7f0c0407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:27:04.423 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.421+0000 7f0c0f7fe640 1 -- 172.21.15.3:0/169448589 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 6156+0+0 (secure 0 0 0) 0x7f0c080be830 con 0x7f0c18107900 2024-09-21T12:27:04.423 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.421+0000 7f0c1e55f640 1 --2- 172.21.15.3:0/169448589 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f0c0407af80 0x7f0c0407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:27:04.423 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.421+0000 7f0c1e55f640 1 --2- 172.21.15.3:0/169448589 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f0c0407af80 0x7f0c0407d440 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0c1819ab30 tx=0x7f0c14005f90 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:27:04.426 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.425+0000 7f0c0f7fe640 1 -- 172.21.15.3:0/169448589 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0c08089eb0 con 0x7f0c18107900 2024-09-21T12:27:04.657 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.655+0000 7f0c207c3640 1 -- 172.21.15.3:0/169448589 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f0c1819af50 con 0x7f0c18107900 2024-09-21T12:27:04.658 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.656+0000 7f0c0f7fe640 1 -- 172.21.15.3:0/169448589 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) ==== 76+0+2010 (secure 0 0 0) 0x7f0c0808ed60 con 0x7f0c18107900 2024-09-21T12:27:04.658 INFO:teuthology.orchestra.run.smithi003.stdout:e14 2024-09-21T12:27:04.658 INFO:teuthology.orchestra.run.smithi003.stdout:btime 2024-09-21T12:17:55:592931+0000 2024-09-21T12:27:04.658 INFO:teuthology.orchestra.run.smithi003.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T12:27:04.658 INFO:teuthology.orchestra.run.smithi003.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:27:04.658 INFO:teuthology.orchestra.run.smithi003.stdout:legacy client fscid: 1 2024-09-21T12:27:04.658 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:27:04.658 INFO:teuthology.orchestra.run.smithi003.stdout:Filesystem 'cephfs' (1) 2024-09-21T12:27:04.659 INFO:teuthology.orchestra.run.smithi003.stdout:fs_name cephfs 2024-09-21T12:27:04.659 INFO:teuthology.orchestra.run.smithi003.stdout:epoch 14 2024-09-21T12:27:04.659 INFO:teuthology.orchestra.run.smithi003.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T12:27:04.659 INFO:teuthology.orchestra.run.smithi003.stdout:created 2024-09-21T12:17:38.260099+0000 2024-09-21T12:27:04.659 INFO:teuthology.orchestra.run.smithi003.stdout:modified 2024-09-21T12:17:55.592927+0000 2024-09-21T12:27:04.659 INFO:teuthology.orchestra.run.smithi003.stdout:tableserver 0 2024-09-21T12:27:04.659 INFO:teuthology.orchestra.run.smithi003.stdout:root 0 2024-09-21T12:27:04.659 INFO:teuthology.orchestra.run.smithi003.stdout:session_timeout 60 2024-09-21T12:27:04.659 INFO:teuthology.orchestra.run.smithi003.stdout:session_autoclose 300 2024-09-21T12:27:04.659 INFO:teuthology.orchestra.run.smithi003.stdout:max_file_size 1099511627776 2024-09-21T12:27:04.659 INFO:teuthology.orchestra.run.smithi003.stdout:max_xattr_size 65536 2024-09-21T12:27:04.659 INFO:teuthology.orchestra.run.smithi003.stdout:required_client_features {} 2024-09-21T12:27:04.660 INFO:teuthology.orchestra.run.smithi003.stdout:last_failure 0 2024-09-21T12:27:04.660 INFO:teuthology.orchestra.run.smithi003.stdout:last_failure_osd_epoch 46 2024-09-21T12:27:04.660 INFO:teuthology.orchestra.run.smithi003.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:27:04.660 INFO:teuthology.orchestra.run.smithi003.stdout:max_mds 1 2024-09-21T12:27:04.660 INFO:teuthology.orchestra.run.smithi003.stdout:in 0 2024-09-21T12:27:04.660 INFO:teuthology.orchestra.run.smithi003.stdout:up {0=14564} 2024-09-21T12:27:04.660 INFO:teuthology.orchestra.run.smithi003.stdout:failed 2024-09-21T12:27:04.660 INFO:teuthology.orchestra.run.smithi003.stdout:damaged 2024-09-21T12:27:04.660 INFO:teuthology.orchestra.run.smithi003.stdout:stopped 2024-09-21T12:27:04.660 INFO:teuthology.orchestra.run.smithi003.stdout:data_pools [3] 2024-09-21T12:27:04.660 INFO:teuthology.orchestra.run.smithi003.stdout:metadata_pool 2 2024-09-21T12:27:04.660 INFO:teuthology.orchestra.run.smithi003.stdout:inline_data enabled 2024-09-21T12:27:04.661 INFO:teuthology.orchestra.run.smithi003.stdout:balancer 2024-09-21T12:27:04.661 INFO:teuthology.orchestra.run.smithi003.stdout:bal_rank_mask -1 2024-09-21T12:27:04.661 INFO:teuthology.orchestra.run.smithi003.stdout:standby_count_wanted 1 2024-09-21T12:27:04.661 INFO:teuthology.orchestra.run.smithi003.stdout:qdb_cluster leader: 14564 members: 14564 2024-09-21T12:27:04.661 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.cephfs.smithi003.gfkngj{0:14564} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.3:6828/3710817325,v1:172.21.15.3:6829/3710817325] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:27:04.661 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:27:04.661 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:27:04.661 INFO:teuthology.orchestra.run.smithi003.stdout:Standby daemons: 2024-09-21T12:27:04.661 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:27:04.661 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.cephfs.smithi192.ywqqxe{-1:24319} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.192:6824/4055220871,v1:172.21.15.192:6825/4055220871] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:27:04.661 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.cephfs.smithi192.ktdqns{-1:24337} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.192:6826/318800854,v1:172.21.15.192:6827/318800854] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:27:04.661 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.cephfs.smithi003.ebjgyl{-1:24345} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.3:6826/55902996,v1:172.21.15.3:6827/55902996] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:27:04.662 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 14 2024-09-21T12:27:04.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.658+0000 7f0c207c3640 1 -- 172.21.15.3:0/169448589 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f0c0407af80 msgr2=0x7f0c0407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:27:04.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.658+0000 7f0c207c3640 1 --2- 172.21.15.3:0/169448589 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f0c0407af80 0x7f0c0407d440 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0c1819ab30 tx=0x7f0c14005f90 comp rx=0 tx=0).stop 2024-09-21T12:27:04.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.658+0000 7f0c207c3640 1 -- 172.21.15.3:0/169448589 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0c18107900 msgr2=0x7f0c1819fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:27:04.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.658+0000 7f0c207c3640 1 --2- 172.21.15.3:0/169448589 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0c18107900 0x7f0c1819fd70 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f0c08031460 tx=0x7f0c08004530 comp rx=0 tx=0).stop 2024-09-21T12:27:04.662 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.658+0000 7f0c207c3640 1 -- 172.21.15.3:0/169448589 shutdown_connections 2024-09-21T12:27:04.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.658+0000 7f0c207c3640 1 --2- 172.21.15.3:0/169448589 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f0c0407af80 0x7f0c0407d440 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:04.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.658+0000 7f0c207c3640 1 --2- 172.21.15.3:0/169448589 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0c18107900 0x7f0c1819fd70 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:04.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.658+0000 7f0c207c3640 1 --2- 172.21.15.3:0/169448589 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0c18101900 0x7f0c1819f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:04.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.658+0000 7f0c207c3640 1 -- 172.21.15.3:0/169448589 >> 172.21.15.3:0/169448589 conn(0x7f0c180fd600 msgr2=0x7f0c180fdcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:27:04.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.658+0000 7f0c207c3640 1 -- 172.21.15.3:0/169448589 shutdown_connections 2024-09-21T12:27:04.663 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.658+0000 7f0c207c3640 1 -- 172.21.15.3:0/169448589 wait complete. 2024-09-21T12:27:04.760 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:27:04 smithi003 podman[127693]: 2024-09-21 12:27:04.591939036 +0000 UTC m=+0.657043237 container remove 71b31882f0a6b77ccb1e3463261f6ae4cb0fab4e5f692a8ff0b15c7ba37223e4 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-2-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-21T12:27:04.760 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:27:04 smithi003 systemd[1]: ceph-641beec0-7812-11ef-baf6-efdc52797490@osd.2.service: Deactivated successfully. 2024-09-21T12:27:04.760 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:27:04 smithi003 systemd[1]: Stopped Ceph osd.2 for 641beec0-7812-11ef-baf6-efdc52797490. 2024-09-21T12:27:04.760 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:27:04 smithi003 systemd[1]: ceph-641beec0-7812-11ef-baf6-efdc52797490@osd.2.service: Consumed 47.137s CPU time. 2024-09-21T12:27:04.762 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.758+0000 7f79c0173640 1 -- 172.21.15.3:0/3448521416 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f79b8101060 msgr2=0x7f79b810dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:27:04.762 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.758+0000 7f79c0173640 1 --2- 172.21.15.3:0/3448521416 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f79b8101060 0x7f79b810dd20 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f79a8009880 tx=0x7f79a802a490 comp rx=0 tx=0).stop 2024-09-21T12:27:04.762 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.758+0000 7f79c0173640 1 -- 172.21.15.3:0/3448521416 shutdown_connections 2024-09-21T12:27:04.762 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.758+0000 7f79c0173640 1 --2- 172.21.15.3:0/3448521416 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f79b8101060 0x7f79b810dd20 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:04.762 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.758+0000 7f79c0173640 1 --2- 172.21.15.3:0/3448521416 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f79b81006b0 0x7f79b8100a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:04.763 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.758+0000 7f79c0173640 1 -- 172.21.15.3:0/3448521416 >> 172.21.15.3:0/3448521416 conn(0x7f79b80fc580 msgr2=0x7f79b80fe9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:27:04.763 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.758+0000 7f79c0173640 1 -- 172.21.15.3:0/3448521416 shutdown_connections 2024-09-21T12:27:04.763 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.758+0000 7f79c0173640 1 -- 172.21.15.3:0/3448521416 wait complete. 2024-09-21T12:27:04.763 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.759+0000 7f79c0173640 1 Processor -- start 2024-09-21T12:27:04.763 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.759+0000 7f79c0173640 1 -- start start 2024-09-21T12:27:04.763 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.759+0000 7f79c0173640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f79b81006b0 0x7f79b819f840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:27:04.763 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.759+0000 7f79c0173640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f79b8101060 0x7f79b819fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:27:04.763 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.759+0000 7f79c0173640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f79b8110fd0 con 0x7f79b8101060 2024-09-21T12:27:04.763 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.759+0000 7f79c0173640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f79b8110e50 con 0x7f79b81006b0 2024-09-21T12:27:04.763 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.759+0000 7f79bd70e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f79b8101060 0x7f79b819fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:27:04.763 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.759+0000 7f79bdf0f640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f79b81006b0 0x7f79b819f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:27:04.763 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.759+0000 7f79bd70e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f79b8101060 0x7f79b819fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:47984/0 (socket says 172.21.15.3:47984) 2024-09-21T12:27:04.764 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.759+0000 7f79bd70e640 1 -- 172.21.15.3:0/3362719632 learned_addr learned my addr 172.21.15.3:0/3362719632 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:27:04.764 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.760+0000 7f79bdf0f640 1 -- 172.21.15.3:0/3362719632 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f79b8101060 msgr2=0x7f79b819fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:27:04.764 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.760+0000 7f79bdf0f640 1 --2- 172.21.15.3:0/3362719632 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f79b8101060 0x7f79b819fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:04.764 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.760+0000 7f79bdf0f640 1 -- 172.21.15.3:0/3362719632 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79b8199a00 con 0x7f79b81006b0 2024-09-21T12:27:04.764 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.760+0000 7f79bd70e640 1 --2- 172.21.15.3:0/3362719632 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f79b8101060 0x7f79b819fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T12:27:04.764 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.760+0000 7f79bdf0f640 1 --2- 172.21.15.3:0/3362719632 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f79b81006b0 0x7f79b819f840 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f79b4005fd0 tx=0x7f79b400dd60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:27:04.764 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.760+0000 7f79aeffd640 1 -- 172.21.15.3:0/3362719632 <== mon.1 v2:172.21.15.192:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f79b400be30 con 0x7f79b81006b0 2024-09-21T12:27:04.764 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.760+0000 7f79aeffd640 1 -- 172.21.15.3:0/3362719632 <== mon.1 v2:172.21.15.192:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f79b4004030 con 0x7f79b81006b0 2024-09-21T12:27:04.764 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.760+0000 7f79c0173640 1 -- 172.21.15.3:0/3362719632 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79b8199cf0 con 0x7f79b81006b0 2024-09-21T12:27:04.764 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.760+0000 7f79aeffd640 1 -- 172.21.15.3:0/3362719632 <== mon.1 v2:172.21.15.192:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f79b4003cd0 con 0x7f79b81006b0 2024-09-21T12:27:04.764 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.760+0000 7f79c0173640 1 -- 172.21.15.3:0/3362719632 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79b819a250 con 0x7f79b81006b0 2024-09-21T12:27:04.765 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.762+0000 7f79c0173640 1 -- 172.21.15.3:0/3362719632 --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79b806ada0 con 0x7f79b81006b0 2024-09-21T12:27:04.766 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.763+0000 7f79aeffd640 1 -- 172.21.15.3:0/3362719632 <== mon.1 v2:172.21.15.192:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f79b40041e0 con 0x7f79b81006b0 2024-09-21T12:27:04.766 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.763+0000 7f79aeffd640 1 --2- 172.21.15.3:0/3362719632 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f79a407af30 0x7f79a407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:27:04.766 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.763+0000 7f79aeffd640 1 -- 172.21.15.3:0/3362719632 <== mon.1 v2:172.21.15.192:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 6156+0+0 (secure 0 0 0) 0x7f79b409d910 con 0x7f79b81006b0 2024-09-21T12:27:04.766 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.763+0000 7f79bd70e640 1 --2- 172.21.15.3:0/3362719632 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f79a407af30 0x7f79a407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:27:04.766 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.764+0000 7f79bd70e640 1 --2- 172.21.15.3:0/3362719632 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f79a407af30 0x7f79a407d3f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f79b819b1f0 tx=0x7f79a80058d0 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:27:04.769 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.768+0000 7f79aeffd640 1 -- 172.21.15.3:0/3362719632 <== mon.1 v2:172.21.15.192:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f79b4017020 con 0x7f79b81006b0 2024-09-21T12:27:04.991 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.989+0000 7f79c0173640 1 -- 172.21.15.3:0/3362719632 --> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f79b819af30 con 0x7f79a407af30 2024-09-21T12:27:04.992 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.990+0000 7f79aeffd640 1 -- 172.21.15.3:0/3362719632 <== mgr.14756 v2:172.21.15.3:6800/1284098095 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f79b819af30 con 0x7f79a407af30 2024-09-21T12:27:04.992 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-21T12:27:04.992 INFO:teuthology.orchestra.run.smithi003.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T12:27:04.992 INFO:teuthology.orchestra.run.smithi003.stdout: "in_progress": true, 2024-09-21T12:27:04.992 INFO:teuthology.orchestra.run.smithi003.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T12:27:04.992 INFO:teuthology.orchestra.run.smithi003.stdout: "services_complete": [ 2024-09-21T12:27:04.993 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr", 2024-09-21T12:27:04.993 INFO:teuthology.orchestra.run.smithi003.stdout: "mon", 2024-09-21T12:27:04.993 INFO:teuthology.orchestra.run.smithi003.stdout: "crash" 2024-09-21T12:27:04.993 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-21T12:27:04.993 INFO:teuthology.orchestra.run.smithi003.stdout: "progress": "8/23 daemons upgraded", 2024-09-21T12:27:04.993 INFO:teuthology.orchestra.run.smithi003.stdout: "message": "Currently upgrading osd daemons", 2024-09-21T12:27:04.993 INFO:teuthology.orchestra.run.smithi003.stdout: "is_paused": false 2024-09-21T12:27:04.993 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-21T12:27:04.994 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.993+0000 7f79c0173640 1 -- 172.21.15.3:0/3362719632 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f79a407af30 msgr2=0x7f79a407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:27:04.994 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.993+0000 7f79c0173640 1 --2- 172.21.15.3:0/3362719632 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f79a407af30 0x7f79a407d3f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f79b819b1f0 tx=0x7f79a80058d0 comp rx=0 tx=0).stop 2024-09-21T12:27:04.994 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.993+0000 7f79c0173640 1 -- 172.21.15.3:0/3362719632 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f79b81006b0 msgr2=0x7f79b819f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:27:04.995 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.993+0000 7f79c0173640 1 --2- 172.21.15.3:0/3362719632 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f79b81006b0 0x7f79b819f840 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f79b4005fd0 tx=0x7f79b400dd60 comp rx=0 tx=0).stop 2024-09-21T12:27:04.995 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.993+0000 7f79c0173640 1 -- 172.21.15.3:0/3362719632 shutdown_connections 2024-09-21T12:27:04.995 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.993+0000 7f79c0173640 1 --2- 172.21.15.3:0/3362719632 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f79a407af30 0x7f79a407d3f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:04.995 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.993+0000 7f79c0173640 1 --2- 172.21.15.3:0/3362719632 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f79b8101060 0x7f79b819fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:04.995 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.993+0000 7f79c0173640 1 --2- 172.21.15.3:0/3362719632 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f79b81006b0 0x7f79b819f840 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:04.995 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.993+0000 7f79c0173640 1 -- 172.21.15.3:0/3362719632 >> 172.21.15.3:0/3362719632 conn(0x7f79b80fc580 msgr2=0x7f79b80fd980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:27:04.995 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.993+0000 7f79c0173640 1 -- 172.21.15.3:0/3362719632 shutdown_connections 2024-09-21T12:27:04.995 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:04.993+0000 7f79c0173640 1 -- 172.21.15.3:0/3362719632 wait complete. 2024-09-21T12:27:05.072 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:27:04 smithi003 systemd[1]: Starting Ceph osd.2 for 641beec0-7812-11ef-baf6-efdc52797490... 2024-09-21T12:27:05.072 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:04 smithi003 ceph-mon[108723]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:27:05.072 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:04 smithi003 ceph-mon[108723]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:27:05.072 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:04 smithi003 ceph-mon[108723]: from='client.34200 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:27:05.073 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:04 smithi003 ceph-mon[108723]: from='client.? 172.21.15.3:0/3990677674' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:27:05.073 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:04 smithi003 ceph-mon[108723]: from='client.? 172.21.15.3:0/169448589' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:27:05.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:05.078+0000 7fd629ee4640 1 -- 172.21.15.3:0/1289763346 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd624101900 msgr2=0x7fd624101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:27:05.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:05.078+0000 7fd629ee4640 1 --2- 172.21.15.3:0/1289763346 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd624101900 0x7fd624101d60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd618009880 tx=0x7fd61802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:27:05.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:05.078+0000 7fd629ee4640 1 -- 172.21.15.3:0/1289763346 shutdown_connections 2024-09-21T12:27:05.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:05.078+0000 7fd629ee4640 1 --2- 172.21.15.3:0/1289763346 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd624101900 0x7fd624101d60 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:05.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:05.078+0000 7fd629ee4640 1 --2- 172.21.15.3:0/1289763346 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd624107900 0x7fd624107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:05.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:05.078+0000 7fd629ee4640 1 -- 172.21.15.3:0/1289763346 >> 172.21.15.3:0/1289763346 conn(0x7fd6240fd5e0 msgr2=0x7fd6240ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:27:05.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:05.078+0000 7fd629ee4640 1 -- 172.21.15.3:0/1289763346 shutdown_connections 2024-09-21T12:27:05.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:05.078+0000 7fd629ee4640 1 -- 172.21.15.3:0/1289763346 wait complete. 2024-09-21T12:27:05.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:05.078+0000 7fd629ee4640 1 Processor -- start 2024-09-21T12:27:05.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:05.078+0000 7fd629ee4640 1 -- start start 2024-09-21T12:27:05.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:05.079+0000 7fd629ee4640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd624101900 0x7fd62419d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:27:05.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:05.079+0000 7fd629ee4640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd624107900 0x7fd62419dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:27:05.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:05.079+0000 7fd629ee4640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fd62410edd0 con 0x7fd624107900 2024-09-21T12:27:05.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:05.079+0000 7fd629ee4640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd62410ec50 con 0x7fd624101900 2024-09-21T12:27:05.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:05.079+0000 7fd622ffd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd624107900 0x7fd62419dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:27:05.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:05.079+0000 7fd6237fe640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd624101900 0x7fd62419d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:27:05.083 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:05.079+0000 7fd622ffd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd624107900 0x7fd62419dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:48010/0 (socket says 172.21.15.3:48010) 2024-09-21T12:27:05.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:05.079+0000 7fd622ffd640 1 -- 172.21.15.3:0/3885283733 learned_addr learned my addr 172.21.15.3:0/3885283733 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:27:05.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:05.079+0000 7fd622ffd640 1 -- 172.21.15.3:0/3885283733 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd624101900 msgr2=0x7fd62419d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:27:05.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:05.079+0000 7fd622ffd640 1 --2- 172.21.15.3:0/3885283733 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd624101900 0x7fd62419d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:05.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:05.079+0000 7fd622ffd640 1 -- 172.21.15.3:0/3885283733 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd624197820 con 0x7fd624107900 2024-09-21T12:27:05.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:05.079+0000 7fd6237fe640 1 --2- 172.21.15.3:0/3885283733 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd624101900 0x7fd62419d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T12:27:05.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:05.079+0000 7fd622ffd640 1 --2- 172.21.15.3:0/3885283733 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd624107900 0x7fd62419dbe0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd618031460 tx=0x7fd618004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:27:05.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:05.079+0000 7fd620ff9640 1 -- 172.21.15.3:0/3885283733 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd61803f070 con 0x7fd624107900 2024-09-21T12:27:05.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:05.080+0000 7fd629ee4640 1 -- 172.21.15.3:0/3885283733 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd624197ab0 con 0x7fd624107900 2024-09-21T12:27:05.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:05.080+0000 7fd629ee4640 1 -- 172.21.15.3:0/3885283733 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd624197fe0 con 0x7fd624107900 2024-09-21T12:27:05.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:05.080+0000 7fd620ff9640 1 -- 172.21.15.3:0/3885283733 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd6180035f0 con 0x7fd624107900 2024-09-21T12:27:05.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:05.080+0000 7fd620ff9640 1 -- 172.21.15.3:0/3885283733 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd618035030 con 0x7fd624107900 2024-09-21T12:27:05.084 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:05.081+0000 7fd629ee4640 1 -- 172.21.15.3:0/3885283733 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd610005290 con 0x7fd624107900 2024-09-21T12:27:05.085 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:05.082+0000 7fd620ff9640 1 -- 172.21.15.3:0/3885283733 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7fd618042070 con 0x7fd624107900 2024-09-21T12:27:05.085 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:05.082+0000 7fd620ff9640 1 --2- 172.21.15.3:0/3885283733 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fd60c07af80 0x7fd60c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:27:05.085 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:05.082+0000 7fd620ff9640 1 -- 172.21.15.3:0/3885283733 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 6156+0+0 (secure 0 0 0) 0x7fd6180be760 con 0x7fd624107900 2024-09-21T12:27:05.085 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:05.082+0000 7fd6237fe640 1 --2- 172.21.15.3:0/3885283733 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fd60c07af80 0x7fd60c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:27:05.085 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:05.083+0000 7fd6237fe640 1 --2- 172.21.15.3:0/3885283733 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fd60c07af80 0x7fd60c07d440 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd614009fc0 tx=0x7fd614005f90 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:27:05.088 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:05.087+0000 7fd620ff9640 1 -- 172.21.15.3:0/3885283733 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd618089de0 con 0x7fd624107900 2024-09-21T12:27:05.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:04 smithi192 ceph-mon[80326]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:27:05.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:04 smithi192 ceph-mon[80326]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:27:05.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:04 smithi192 ceph-mon[80326]: from='client.34200 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:27:05.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:04 smithi192 ceph-mon[80326]: from='client.? 172.21.15.3:0/3990677674' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:27:05.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:04 smithi192 ceph-mon[80326]: from='client.? 172.21.15.3:0/169448589' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:27:05.329 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:27:05 smithi003 podman[127858]: 2024-09-21 12:27:04.974132006 +0000 UTC m=+0.017407509 image pull 8f4d013db793795fef09ff5edf96e6b42ba8cd2c9158b2f0b7a5d7c1e657c063 quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 2024-09-21T12:27:05.329 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:27:05 smithi003 podman[127858]: 2024-09-21 12:27:05.110033418 +0000 UTC m=+0.153308910 container create b8d14a4411442b741e758f1de2f01e2abe8107f6671d6b32e3752fafc4b839a6 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-2-activate, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-21T12:27:05.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:05.353+0000 7fd629ee4640 1 -- 172.21.15.3:0/3885283733 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fd610005580 con 0x7fd624107900 2024-09-21T12:27:05.355 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:05.353+0000 7fd620ff9640 1 -- 172.21.15.3:0/3885283733 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+737 (secure 0 0 0) 0x7fd61808ec90 con 0x7fd624107900 2024-09-21T12:27:05.355 INFO:teuthology.orchestra.run.smithi003.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data; 1 osds down; Degraded data redundancy: 10/279 objects degraded (3.584%), 5 pgs degraded 2024-09-21T12:27:05.355 INFO:teuthology.orchestra.run.smithi003.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:27:05.355 INFO:teuthology.orchestra.run.smithi003.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:27:05.355 INFO:teuthology.orchestra.run.smithi003.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-21T12:27:05.355 INFO:teuthology.orchestra.run.smithi003.stdout: osd.2 (root=default,host=smithi003) is down 2024-09-21T12:27:05.356 INFO:teuthology.orchestra.run.smithi003.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 10/279 objects degraded (3.584%), 5 pgs degraded 2024-09-21T12:27:05.356 INFO:teuthology.orchestra.run.smithi003.stdout: pg 2.3 is active+undersized+degraded, acting [5,1] 2024-09-21T12:27:05.356 INFO:teuthology.orchestra.run.smithi003.stdout: pg 2.7 is active+undersized+degraded, acting [3,4] 2024-09-21T12:27:05.356 INFO:teuthology.orchestra.run.smithi003.stdout: pg 2.c is active+undersized+degraded, acting [3,0] 2024-09-21T12:27:05.356 INFO:teuthology.orchestra.run.smithi003.stdout: pg 2.16 is active+undersized+degraded, acting [5,3] 2024-09-21T12:27:05.356 INFO:teuthology.orchestra.run.smithi003.stdout: pg 2.1c is active+undersized+degraded, acting [4,5] 2024-09-21T12:27:05.358 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:05.356+0000 7fd629ee4640 1 -- 172.21.15.3:0/3885283733 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fd60c07af80 msgr2=0x7fd60c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:27:05.358 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:05.356+0000 7fd629ee4640 1 --2- 172.21.15.3:0/3885283733 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fd60c07af80 0x7fd60c07d440 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd614009fc0 tx=0x7fd614005f90 comp rx=0 tx=0).stop 2024-09-21T12:27:05.358 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:05.356+0000 7fd629ee4640 1 -- 172.21.15.3:0/3885283733 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd624107900 msgr2=0x7fd62419dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:27:05.358 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:05.356+0000 7fd629ee4640 1 --2- 172.21.15.3:0/3885283733 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd624107900 0x7fd62419dbe0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fd618031460 tx=0x7fd618004530 comp rx=0 tx=0).stop 2024-09-21T12:27:05.358 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:05.356+0000 7fd629ee4640 1 -- 172.21.15.3:0/3885283733 shutdown_connections 2024-09-21T12:27:05.358 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:05.356+0000 7fd629ee4640 1 --2- 172.21.15.3:0/3885283733 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fd60c07af80 0x7fd60c07d440 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:05.359 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:05.356+0000 7fd629ee4640 1 --2- 172.21.15.3:0/3885283733 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd624107900 0x7fd62419dbe0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:05.359 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:05.356+0000 7fd629ee4640 1 --2- 172.21.15.3:0/3885283733 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd624101900 0x7fd62419d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:05.359 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:05.356+0000 7fd629ee4640 1 -- 172.21.15.3:0/3885283733 >> 172.21.15.3:0/3885283733 conn(0x7fd6240fd5e0 msgr2=0x7fd6240fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:27:05.359 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:05.356+0000 7fd629ee4640 1 -- 172.21.15.3:0/3885283733 shutdown_connections 2024-09-21T12:27:05.359 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:05.356+0000 7fd629ee4640 1 -- 172.21.15.3:0/3885283733 wait complete. 2024-09-21T12:27:05.830 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:27:05 smithi003 podman[127858]: 2024-09-21 12:27:05.388843932 +0000 UTC m=+0.432119430 container init b8d14a4411442b741e758f1de2f01e2abe8107f6671d6b32e3752fafc4b839a6 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-2-activate, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.license=GPLv2) 2024-09-21T12:27:05.830 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:27:05 smithi003 podman[127858]: 2024-09-21 12:27:05.392732705 +0000 UTC m=+0.436008196 container start b8d14a4411442b741e758f1de2f01e2abe8107f6671d6b32e3752fafc4b839a6 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-2-activate, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-21T12:27:05.830 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:27:05 smithi003 podman[127858]: 2024-09-21 12:27:05.479674732 +0000 UTC m=+0.522950236 container attach b8d14a4411442b741e758f1de2f01e2abe8107f6671d6b32e3752fafc4b839a6 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-2-activate, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T12:27:05.830 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:27:05 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-2-activate[127896]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:27:05.830 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:27:05 smithi003 bash[127858]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:27:05.830 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:27:05 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-2-activate[127896]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:27:05.830 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:27:05 smithi003 bash[127858]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:27:06.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:05 smithi192 ceph-mon[80326]: pgmap v168: 65 pgs: 7 active+undersized, 7 stale+active+clean, 5 active+undersized+degraded, 46 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 10/279 objects degraded (3.584%) 2024-09-21T12:27:06.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:05 smithi192 ceph-mon[80326]: Health check failed: Degraded data redundancy: 10/279 objects degraded (3.584%), 5 pgs degraded (PG_DEGRADED) 2024-09-21T12:27:06.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:05 smithi192 ceph-mon[80326]: from='client.? 172.21.15.3:0/3885283733' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:27:06.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:05 smithi003 ceph-mon[108723]: pgmap v168: 65 pgs: 7 active+undersized, 7 stale+active+clean, 5 active+undersized+degraded, 46 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 10/279 objects degraded (3.584%) 2024-09-21T12:27:06.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:05 smithi003 ceph-mon[108723]: Health check failed: Degraded data redundancy: 10/279 objects degraded (3.584%), 5 pgs degraded (PG_DEGRADED) 2024-09-21T12:27:06.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:05 smithi003 ceph-mon[108723]: from='client.? 172.21.15.3:0/3885283733' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:27:07.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:06 smithi192 ceph-mon[80326]: from='client.44191 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:27:07.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:06 smithi003 ceph-mon[108723]: from='client.44191 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:27:08.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:07 smithi192 ceph-mon[80326]: pgmap v169: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 35/279 objects degraded (12.545%) 2024-09-21T12:27:08.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:07 smithi003 ceph-mon[108723]: pgmap v169: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 35/279 objects degraded (12.545%) 2024-09-21T12:27:08.646 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:27:08 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-2-activate[127896]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-09-21T12:27:08.646 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:27:08 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-2-activate[127896]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:27:08.646 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:27:08 smithi003 bash[127858]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-09-21T12:27:08.646 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:27:08 smithi003 bash[127858]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:27:08.646 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:27:08 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-2-activate[127896]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:27:08.646 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:27:08 smithi003 bash[127858]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:27:08.646 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:27:08 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-2-activate[127896]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-21T12:27:08.646 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:27:08 smithi003 bash[127858]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-21T12:27:08.647 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:27:08 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-2-activate[127896]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-2 --no-mon-config 2024-09-21T12:27:08.647 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:27:08 smithi003 bash[127858]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-2 --no-mon-config 2024-09-21T12:27:09.080 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:27:08 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-2-activate[127896]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-21T12:27:09.080 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:27:08 smithi003 bash[127858]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-21T12:27:09.080 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:27:08 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-2-activate[127896]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-2/block 2024-09-21T12:27:09.080 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:27:08 smithi003 bash[127858]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-2/block 2024-09-21T12:27:09.080 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:27:08 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-2-activate[127896]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-21T12:27:09.081 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:27:08 smithi003 bash[127858]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-21T12:27:09.081 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:27:08 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-2-activate[127896]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-21T12:27:09.081 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:27:08 smithi003 bash[127858]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-21T12:27:09.081 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:27:08 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-2-activate[127896]: --> ceph-volume lvm activate successful for osd ID: 2 2024-09-21T12:27:09.081 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:27:08 smithi003 bash[127858]: --> ceph-volume lvm activate successful for osd ID: 2 2024-09-21T12:27:09.081 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:27:08 smithi003 podman[127858]: 2024-09-21 12:27:08.758725573 +0000 UTC m=+3.802001073 container died b8d14a4411442b741e758f1de2f01e2abe8107f6671d6b32e3752fafc4b839a6 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-2-activate, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-21T12:27:09.766 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:27:09 smithi003 podman[128112]: 2024-09-21 12:27:09.416940621 +0000 UTC m=+0.646943760 container remove b8d14a4411442b741e758f1de2f01e2abe8107f6671d6b32e3752fafc4b839a6 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-2-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T12:27:09.767 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:27:09 smithi003 podman[128172]: 2024-09-21 12:27:09.536396181 +0000 UTC m=+0.016991161 image pull 8f4d013db793795fef09ff5edf96e6b42ba8cd2c9158b2f0b7a5d7c1e657c063 quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 2024-09-21T12:27:09.767 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:27:09 smithi003 podman[128172]: 2024-09-21 12:27:09.651292856 +0000 UTC m=+0.131887877 container create e630341e13d42b1dd592c7d5af862d9c3ba31b208e91b9d7aea828e79c7e60a2 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.schema-version=1.0) 2024-09-21T12:27:10.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:09 smithi192 ceph-mon[80326]: pgmap v170: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 35/279 objects degraded (12.545%) 2024-09-21T12:27:10.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:09 smithi003 ceph-mon[108723]: pgmap v170: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 35/279 objects degraded (12.545%) 2024-09-21T12:27:10.330 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:27:09 smithi003 podman[128172]: 2024-09-21 12:27:09.903876053 +0000 UTC m=+0.384471038 container init e630341e13d42b1dd592c7d5af862d9c3ba31b208e91b9d7aea828e79c7e60a2 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-2, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-21T12:27:10.330 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:27:09 smithi003 podman[128172]: 2024-09-21 12:27:09.907291255 +0000 UTC m=+0.387886234 container start e630341e13d42b1dd592c7d5af862d9c3ba31b208e91b9d7aea828e79c7e60a2 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-21T12:27:10.330 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:27:09 smithi003 ceph-osd[128191]: -- 172.21.15.3:0/2350393702 <== mon.0 v2:172.21.15.3:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e83fd5a1e0 con 0x55e83fcea000 2024-09-21T12:27:10.330 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:27:10 smithi003 bash[128172]: e630341e13d42b1dd592c7d5af862d9c3ba31b208e91b9d7aea828e79c7e60a2 2024-09-21T12:27:10.330 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:27:10 smithi003 systemd[1]: Started Ceph osd.2 for 641beec0-7812-11ef-baf6-efdc52797490. 2024-09-21T12:27:11.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:11 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:27:11.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:11 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:27:11.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:11 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:27:11.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:11 smithi003 ceph-mon[108723]: pgmap v171: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 35/279 objects degraded (12.545%) 2024-09-21T12:27:11.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:11 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:27:11.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:11 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:27:11.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:11 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:27:11.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:11 smithi192 ceph-mon[80326]: pgmap v171: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 35/279 objects degraded (12.545%) 2024-09-21T12:27:12.079 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:27:11 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-2[128187]: 2024-09-21T12:27:11.797+0000 7f466b11f640 -1 Falling back to public interface 2024-09-21T12:27:14.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:13 smithi192 ceph-mon[80326]: pgmap v172: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 35/279 objects degraded (12.545%) 2024-09-21T12:27:14.325 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:13 smithi003 ceph-mon[108723]: pgmap v172: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 35/279 objects degraded (12.545%) 2024-09-21T12:27:15.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:15 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:27:15.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:15 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:27:15.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:15 smithi192 ceph-mon[80326]: pgmap v173: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 35/279 objects degraded (12.545%) 2024-09-21T12:27:15.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:15 smithi192 ceph-mon[80326]: Health check update: Degraded data redundancy: 35/279 objects degraded (12.545%), 12 pgs degraded (PG_DEGRADED) 2024-09-21T12:27:15.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:15 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:27:15.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:15 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:27:15.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:15 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:27:15.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:15 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:27:16.005 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:15 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:27:16.006 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:15 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:27:16.006 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:15 smithi003 ceph-mon[108723]: pgmap v173: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 35/279 objects degraded (12.545%) 2024-09-21T12:27:16.006 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:15 smithi003 ceph-mon[108723]: Health check update: Degraded data redundancy: 35/279 objects degraded (12.545%), 12 pgs degraded (PG_DEGRADED) 2024-09-21T12:27:16.006 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:15 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:27:16.006 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:15 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:27:16.006 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:15 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:27:16.006 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:15 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:27:17.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:16 smithi003 ceph-mon[108723]: from='osd.2 [v2:172.21.15.3:6818/3403894100,v1:172.21.15.3:6819/3403894100]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T12:27:17.080 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:27:16 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-2[128187]: 2024-09-21T12:27:16.786+0000 7f466b11f640 -1 osd.2 58 log_to_monitors true 2024-09-21T12:27:17.080 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:27:16 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-2[128187]: 2024-09-21T12:27:16.866+0000 7f4662ec9640 -1 osd.2 58 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T12:27:17.157 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:16 smithi192 ceph-mon[80326]: from='osd.2 [v2:172.21.15.3:6818/3403894100,v1:172.21.15.3:6819/3403894100]' entity='osd.2' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]} : dispatch 2024-09-21T12:27:18.208 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:17 smithi003 ceph-mon[108723]: from='osd.2 [v2:172.21.15.3:6818/3403894100,v1:172.21.15.3:6819/3403894100]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T12:27:18.208 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:17 smithi003 ceph-mon[108723]: osdmap e61: 6 total, 5 up, 6 in 2024-09-21T12:27:18.209 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:17 smithi003 ceph-mon[108723]: from='osd.2 [v2:172.21.15.3:6818/3403894100,v1:172.21.15.3:6819/3403894100]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi003", "root=default"]} : dispatch 2024-09-21T12:27:18.209 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:17 smithi003 ceph-mon[108723]: pgmap v175: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 35/279 objects degraded (12.545%) 2024-09-21T12:27:18.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:17 smithi192 ceph-mon[80326]: from='osd.2 [v2:172.21.15.3:6818/3403894100,v1:172.21.15.3:6819/3403894100]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-21T12:27:18.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:17 smithi192 ceph-mon[80326]: osdmap e61: 6 total, 5 up, 6 in 2024-09-21T12:27:18.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:17 smithi192 ceph-mon[80326]: from='osd.2 [v2:172.21.15.3:6818/3403894100,v1:172.21.15.3:6819/3403894100]' entity='osd.2' cmd={"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi003", "root=default"]} : dispatch 2024-09-21T12:27:18.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:17 smithi192 ceph-mon[80326]: pgmap v175: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 35/279 objects degraded (12.545%) 2024-09-21T12:27:19.114 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:18 smithi003 ceph-mon[108723]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T12:27:19.114 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:18 smithi003 ceph-mon[108723]: osd.2 [v2:172.21.15.3:6818/3403894100,v1:172.21.15.3:6819/3403894100] boot 2024-09-21T12:27:19.114 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:18 smithi003 ceph-mon[108723]: osdmap e62: 6 total, 6 up, 6 in 2024-09-21T12:27:19.114 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:18 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T12:27:19.114 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:18 smithi003 ceph-mon[108723]: osdmap e63: 6 total, 6 up, 6 in 2024-09-21T12:27:19.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:18 smithi192 ceph-mon[80326]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T12:27:19.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:18 smithi192 ceph-mon[80326]: osd.2 [v2:172.21.15.3:6818/3403894100,v1:172.21.15.3:6819/3403894100] boot 2024-09-21T12:27:19.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:18 smithi192 ceph-mon[80326]: osdmap e62: 6 total, 6 up, 6 in 2024-09-21T12:27:19.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:18 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd metadata", "id": 2} : dispatch 2024-09-21T12:27:19.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:18 smithi192 ceph-mon[80326]: osdmap e63: 6 total, 6 up, 6 in 2024-09-21T12:27:20.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:19 smithi192 ceph-mon[80326]: pgmap v178: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 35/279 objects degraded (12.545%) 2024-09-21T12:27:20.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:19 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:27:20.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:19 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:27:20.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:19 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:27:20.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:19 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:27:20.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:19 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:27:20.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:19 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:27:20.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:19 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:27:20.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:19 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:27:20.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:19 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:27:20.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:19 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16} : dispatch 2024-09-21T12:27:20.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:19 smithi003 ceph-mon[108723]: pgmap v178: 65 pgs: 15 active+undersized, 12 active+undersized+degraded, 38 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 35/279 objects degraded (12.545%) 2024-09-21T12:27:20.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:19 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:27:20.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:19 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:27:20.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:19 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:27:20.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:19 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:27:20.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:19 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:27:20.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:19 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:27:20.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:19 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:27:20.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:19 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:27:20.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:19 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:27:20.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:19 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16} : dispatch 2024-09-21T12:27:21.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:20 smithi192 ceph-mon[80326]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-21T12:27:21.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:20 smithi192 ceph-mon[80326]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-21T12:27:21.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:20 smithi003 ceph-mon[108723]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-21T12:27:21.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:20 smithi003 ceph-mon[108723]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-21T12:27:22.235 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:21 smithi192 ceph-mon[80326]: pgmap v179: 65 pgs: 4 active+undersized, 5 active+undersized+degraded, 56 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 17/279 objects degraded (6.093%) 2024-09-21T12:27:22.235 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:21 smithi192 ceph-mon[80326]: Health check update: Degraded data redundancy: 17/279 objects degraded (6.093%), 5 pgs degraded (PG_DEGRADED) 2024-09-21T12:27:22.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:21 smithi003 ceph-mon[108723]: pgmap v179: 65 pgs: 4 active+undersized, 5 active+undersized+degraded, 56 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 17/279 objects degraded (6.093%) 2024-09-21T12:27:22.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:21 smithi003 ceph-mon[108723]: Health check update: Degraded data redundancy: 17/279 objects degraded (6.093%), 5 pgs degraded (PG_DEGRADED) 2024-09-21T12:27:23.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:22 smithi192 ceph-mon[80326]: pgmap v180: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:27:23.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:22 smithi192 ceph-mon[80326]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 17/279 objects degraded (6.093%), 5 pgs degraded) 2024-09-21T12:27:23.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:22 smithi003 ceph-mon[108723]: pgmap v180: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:27:23.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:22 smithi003 ceph-mon[108723]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 17/279 objects degraded (6.093%), 5 pgs degraded) 2024-09-21T12:27:26.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:25 smithi192 ceph-mon[80326]: pgmap v181: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:27:26.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:25 smithi003 ceph-mon[108723]: pgmap v181: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:27:28.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:27 smithi192 ceph-mon[80326]: pgmap v182: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:27:28.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:27 smithi003 ceph-mon[108723]: pgmap v182: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:27:30.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:29 smithi192 ceph-mon[80326]: pgmap v183: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:27:30.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:29 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:27:30.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:29 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:27:30.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:29 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:27:30.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:29 smithi003 ceph-mon[108723]: pgmap v183: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:27:30.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:29 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:27:30.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:29 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:27:30.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:29 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:27:32.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:31 smithi192 ceph-mon[80326]: pgmap v184: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:27:32.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:31 smithi003 ceph-mon[108723]: pgmap v184: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:27:34.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:33 smithi192 ceph-mon[80326]: pgmap v185: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:27:34.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:33 smithi003 ceph-mon[108723]: pgmap v185: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:27:35.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:34 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16} : dispatch 2024-09-21T12:27:35.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:34 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16} : dispatch 2024-09-21T12:27:35.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.456+0000 7f5d8544c640 1 -- 172.21.15.3:0/1249037360 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5d801069a0 msgr2=0x7f5d80106d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:27:35.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.456+0000 7f5d8544c640 1 --2- 172.21.15.3:0/1249037360 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5d801069a0 0x7f5d80106d80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5d70009880 tx=0x7f5d7002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:27:35.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.456+0000 7f5d8544c640 1 -- 172.21.15.3:0/1249037360 shutdown_connections 2024-09-21T12:27:35.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.456+0000 7f5d8544c640 1 --2- 172.21.15.3:0/1249037360 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5d800ffdc0 0x7f5d80100220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:35.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.456+0000 7f5d8544c640 1 --2- 172.21.15.3:0/1249037360 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5d801069a0 0x7f5d80106d80 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:35.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.456+0000 7f5d8544c640 1 -- 172.21.15.3:0/1249037360 >> 172.21.15.3:0/1249037360 conn(0x7f5d800fbc90 msgr2=0x7f5d800fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:27:35.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.456+0000 7f5d8544c640 1 -- 172.21.15.3:0/1249037360 shutdown_connections 2024-09-21T12:27:35.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.456+0000 7f5d8544c640 1 -- 172.21.15.3:0/1249037360 wait complete. 2024-09-21T12:27:35.459 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.456+0000 7f5d8544c640 1 Processor -- start 2024-09-21T12:27:35.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.457+0000 7f5d8544c640 1 -- start start 2024-09-21T12:27:35.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.457+0000 7f5d8544c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5d800ffdc0 0x7f5d8019d6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:27:35.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.457+0000 7f5d8544c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5d801069a0 0x7f5d8019dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:27:35.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.457+0000 7f5d8544c640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f5d8010ef20 con 0x7f5d801069a0 2024-09-21T12:27:35.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.457+0000 7f5d8544c640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5d8010eda0 con 0x7f5d800ffdc0 2024-09-21T12:27:35.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.457+0000 7f5d7e7fc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5d801069a0 0x7f5d8019dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:27:35.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.457+0000 7f5d7e7fc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5d801069a0 0x7f5d8019dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45436/0 (socket says 172.21.15.3:45436) 2024-09-21T12:27:35.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.457+0000 7f5d7effd640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5d800ffdc0 0x7f5d8019d6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:27:35.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.457+0000 7f5d7e7fc640 1 -- 172.21.15.3:0/2749596169 learned_addr learned my addr 172.21.15.3:0/2749596169 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:27:35.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.457+0000 7f5d7e7fc640 1 -- 172.21.15.3:0/2749596169 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5d800ffdc0 msgr2=0x7f5d8019d6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:27:35.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.457+0000 7f5d7e7fc640 1 --2- 172.21.15.3:0/2749596169 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5d800ffdc0 0x7f5d8019d6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:35.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.457+0000 7f5d7e7fc640 1 -- 172.21.15.3:0/2749596169 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d801978b0 con 0x7f5d801069a0 2024-09-21T12:27:35.460 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.457+0000 7f5d7e7fc640 1 --2- 172.21.15.3:0/2749596169 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5d801069a0 0x7f5d8019dc30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5d7400e970 tx=0x7f5d7400ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:27:35.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.458+0000 7f5d67fff640 1 -- 172.21.15.3:0/2749596169 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5d7400cac0 con 0x7f5d801069a0 2024-09-21T12:27:35.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.458+0000 7f5d67fff640 1 -- 172.21.15.3:0/2749596169 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5d7400cc60 con 0x7f5d801069a0 2024-09-21T12:27:35.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.458+0000 7f5d8544c640 1 -- 172.21.15.3:0/2749596169 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d80197ba0 con 0x7f5d801069a0 2024-09-21T12:27:35.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.458+0000 7f5d67fff640 1 -- 172.21.15.3:0/2749596169 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5d74018720 con 0x7f5d801069a0 2024-09-21T12:27:35.461 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.458+0000 7f5d8544c640 1 -- 172.21.15.3:0/2749596169 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d80198130 con 0x7f5d801069a0 2024-09-21T12:27:35.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.459+0000 7f5d8544c640 1 -- 172.21.15.3:0/2749596169 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d801030e0 con 0x7f5d801069a0 2024-09-21T12:27:35.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.460+0000 7f5d67fff640 1 -- 172.21.15.3:0/2749596169 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f5d74010430 con 0x7f5d801069a0 2024-09-21T12:27:35.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.460+0000 7f5d67fff640 1 --2- 172.21.15.3:0/2749596169 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f5d6807af40 0x7f5d6807d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:27:35.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.460+0000 7f5d7effd640 1 --2- 172.21.15.3:0/2749596169 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f5d6807af40 0x7f5d6807d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:27:35.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.460+0000 7f5d67fff640 1 -- 172.21.15.3:0/2749596169 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6156+0+0 (secure 0 0 0) 0x7f5d7409e600 con 0x7f5d801069a0 2024-09-21T12:27:35.462 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.461+0000 7f5d7effd640 1 --2- 172.21.15.3:0/2749596169 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f5d6807af40 0x7f5d6807d400 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5d70000c00 tx=0x7f5d70031400 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:27:35.466 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.465+0000 7f5d67fff640 1 -- 172.21.15.3:0/2749596169 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5d74069c00 con 0x7f5d801069a0 2024-09-21T12:27:35.673 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.671+0000 7f5d8544c640 1 -- 172.21.15.3:0/2749596169 --> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f5d80198e50 con 0x7f5d6807af40 2024-09-21T12:27:35.673 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.672+0000 7f5d67fff640 1 -- 172.21.15.3:0/2749596169 <== mgr.14756 v2:172.21.15.3:6800/1284098095 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f5d80198e50 con 0x7f5d6807af40 2024-09-21T12:27:35.676 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.674+0000 7f5d8544c640 1 -- 172.21.15.3:0/2749596169 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f5d6807af40 msgr2=0x7f5d6807d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:27:35.676 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.674+0000 7f5d8544c640 1 --2- 172.21.15.3:0/2749596169 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f5d6807af40 0x7f5d6807d400 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5d70000c00 tx=0x7f5d70031400 comp rx=0 tx=0).stop 2024-09-21T12:27:35.676 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.674+0000 7f5d8544c640 1 -- 172.21.15.3:0/2749596169 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5d801069a0 msgr2=0x7f5d8019dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:27:35.676 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.674+0000 7f5d8544c640 1 --2- 172.21.15.3:0/2749596169 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5d801069a0 0x7f5d8019dc30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5d7400e970 tx=0x7f5d7400ee30 comp rx=0 tx=0).stop 2024-09-21T12:27:35.676 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.674+0000 7f5d8544c640 1 -- 172.21.15.3:0/2749596169 shutdown_connections 2024-09-21T12:27:35.676 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.674+0000 7f5d8544c640 1 --2- 172.21.15.3:0/2749596169 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f5d6807af40 0x7f5d6807d400 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:35.676 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.674+0000 7f5d8544c640 1 --2- 172.21.15.3:0/2749596169 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5d801069a0 0x7f5d8019dc30 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:35.676 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.674+0000 7f5d8544c640 1 --2- 172.21.15.3:0/2749596169 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5d800ffdc0 0x7f5d8019d6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:35.676 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.674+0000 7f5d8544c640 1 -- 172.21.15.3:0/2749596169 >> 172.21.15.3:0/2749596169 conn(0x7f5d800fbc90 msgr2=0x7f5d800fc510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:27:35.677 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.675+0000 7f5d8544c640 1 -- 172.21.15.3:0/2749596169 shutdown_connections 2024-09-21T12:27:35.677 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.675+0000 7f5d8544c640 1 -- 172.21.15.3:0/2749596169 wait complete. 2024-09-21T12:27:35.685 INFO:teuthology.orchestra.run.smithi003.stdout:true 2024-09-21T12:27:35.762 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.760+0000 7f3e13187640 1 -- 172.21.15.3:0/151561291 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e0c100800 msgr2=0x7f3e0c100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:27:35.762 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.760+0000 7f3e13187640 1 --2- 172.21.15.3:0/151561291 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e0c100800 0x7f3e0c100c60 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc009c20 tx=0x7f3dfc02a970 comp rx=0 tx=0).stop 2024-09-21T12:27:35.762 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.760+0000 7f3e13187640 1 -- 172.21.15.3:0/151561291 shutdown_connections 2024-09-21T12:27:35.762 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.760+0000 7f3e13187640 1 --2- 172.21.15.3:0/151561291 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e0c100800 0x7f3e0c100c60 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:35.762 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.760+0000 7f3e13187640 1 --2- 172.21.15.3:0/151561291 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e0c106800 0x7f3e0c106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:35.762 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.760+0000 7f3e13187640 1 -- 172.21.15.3:0/151561291 >> 172.21.15.3:0/151561291 conn(0x7f3e0c0fc520 msgr2=0x7f3e0c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:27:35.763 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.760+0000 7f3e13187640 1 -- 172.21.15.3:0/151561291 shutdown_connections 2024-09-21T12:27:35.763 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.760+0000 7f3e13187640 1 -- 172.21.15.3:0/151561291 wait complete. 2024-09-21T12:27:35.764 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.761+0000 7f3e13187640 1 Processor -- start 2024-09-21T12:27:35.764 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.761+0000 7f3e13187640 1 -- start start 2024-09-21T12:27:35.764 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.761+0000 7f3e13187640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e0c100800 0x7f3e0c1987c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:27:35.764 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.762+0000 7f3e13187640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e0c106800 0x7f3e0c198d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:27:35.764 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.762+0000 7f3e13187640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f3e0c10dcb0 con 0x7f3e0c100800 2024-09-21T12:27:35.765 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.762+0000 7f3e13187640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3e0c10db30 con 0x7f3e0c106800 2024-09-21T12:27:35.765 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.762+0000 7f3e10f23640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e0c100800 0x7f3e0c1987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:27:35.765 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.762+0000 7f3e10f23640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e0c100800 0x7f3e0c1987c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45446/0 (socket says 172.21.15.3:45446) 2024-09-21T12:27:35.765 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.762+0000 7f3e10f23640 1 -- 172.21.15.3:0/1255672901 learned_addr learned my addr 172.21.15.3:0/1255672901 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:27:35.765 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.762+0000 7f3e0bfff640 1 --2- 172.21.15.3:0/1255672901 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e0c106800 0x7f3e0c198d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:27:35.765 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.762+0000 7f3e10f23640 1 -- 172.21.15.3:0/1255672901 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e0c106800 msgr2=0x7f3e0c198d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:27:35.765 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.762+0000 7f3e10f23640 1 --2- 172.21.15.3:0/1255672901 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e0c106800 0x7f3e0c198d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:35.765 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.762+0000 7f3e10f23640 1 -- 172.21.15.3:0/1255672901 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e0c199300 con 0x7f3e0c100800 2024-09-21T12:27:35.765 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.762+0000 7f3e10f23640 1 --2- 172.21.15.3:0/1255672901 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e0c100800 0x7f3e0c1987c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3e0400d8d0 tx=0x7f3e0400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:27:35.765 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.762+0000 7f3e09ffb640 1 -- 172.21.15.3:0/1255672901 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3e04017070 con 0x7f3e0c100800 2024-09-21T12:27:35.765 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.762+0000 7f3e09ffb640 1 -- 172.21.15.3:0/1255672901 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3e04010460 con 0x7f3e0c100800 2024-09-21T12:27:35.765 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.762+0000 7f3e09ffb640 1 -- 172.21.15.3:0/1255672901 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3e0400f5f0 con 0x7f3e0c100800 2024-09-21T12:27:35.765 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.763+0000 7f3e13187640 1 -- 172.21.15.3:0/1255672901 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e0c1995f0 con 0x7f3e0c100800 2024-09-21T12:27:35.766 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.763+0000 7f3e13187640 1 -- 172.21.15.3:0/1255672901 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e0c1a1bf0 con 0x7f3e0c100800 2024-09-21T12:27:35.766 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.764+0000 7f3e13187640 1 -- 172.21.15.3:0/1255672901 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e0c101f40 con 0x7f3e0c100800 2024-09-21T12:27:35.766 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.765+0000 7f3e09ffb640 1 -- 172.21.15.3:0/1255672901 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f3e04009a30 con 0x7f3e0c100800 2024-09-21T12:27:35.767 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.765+0000 7f3e09ffb640 1 --2- 172.21.15.3:0/1255672901 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f3df807af80 0x7f3df807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:27:35.767 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.766+0000 7f3e09ffb640 1 -- 172.21.15.3:0/1255672901 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6156+0+0 (secure 0 0 0) 0x7f3e0409dde0 con 0x7f3e0c100800 2024-09-21T12:27:35.767 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.766+0000 7f3e0bfff640 1 --2- 172.21.15.3:0/1255672901 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f3df807af80 0x7f3df807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:27:35.768 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.766+0000 7f3e0bfff640 1 --2- 172.21.15.3:0/1255672901 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f3df807af80 0x7f3df807d440 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc009430 tx=0x7f3dfc03c040 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:27:35.771 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.770+0000 7f3e09ffb640 1 -- 172.21.15.3:0/1255672901 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3e0c1995f0 con 0x7f3e0c100800 2024-09-21T12:27:35.981 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.979+0000 7f3e13187640 1 -- 172.21.15.3:0/1255672901 --> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f3e0c062630 con 0x7f3df807af80 2024-09-21T12:27:35.982 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.981+0000 7f3e09ffb640 1 -- 172.21.15.3:0/1255672901 <== mgr.14756 v2:172.21.15.3:6800/1284098095 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f3e0c062630 con 0x7f3df807af80 2024-09-21T12:27:35.985 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.983+0000 7f3e13187640 1 -- 172.21.15.3:0/1255672901 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f3df807af80 msgr2=0x7f3df807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:27:35.985 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.983+0000 7f3e13187640 1 --2- 172.21.15.3:0/1255672901 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f3df807af80 0x7f3df807d440 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc009430 tx=0x7f3dfc03c040 comp rx=0 tx=0).stop 2024-09-21T12:27:35.985 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.983+0000 7f3e13187640 1 -- 172.21.15.3:0/1255672901 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e0c100800 msgr2=0x7f3e0c1987c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:27:35.985 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.983+0000 7f3e13187640 1 --2- 172.21.15.3:0/1255672901 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e0c100800 0x7f3e0c1987c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3e0400d8d0 tx=0x7f3e0400dd90 comp rx=0 tx=0).stop 2024-09-21T12:27:35.985 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.983+0000 7f3e13187640 1 -- 172.21.15.3:0/1255672901 shutdown_connections 2024-09-21T12:27:35.985 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.983+0000 7f3e13187640 1 --2- 172.21.15.3:0/1255672901 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f3df807af80 0x7f3df807d440 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:35.985 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.983+0000 7f3e13187640 1 --2- 172.21.15.3:0/1255672901 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3e0c106800 0x7f3e0c198d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:35.985 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.983+0000 7f3e13187640 1 --2- 172.21.15.3:0/1255672901 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3e0c100800 0x7f3e0c1987c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:35.985 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.983+0000 7f3e13187640 1 -- 172.21.15.3:0/1255672901 >> 172.21.15.3:0/1255672901 conn(0x7f3e0c0fc520 msgr2=0x7f3e0c0fcd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:27:35.985 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.983+0000 7f3e13187640 1 -- 172.21.15.3:0/1255672901 shutdown_connections 2024-09-21T12:27:35.986 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:35.983+0000 7f3e13187640 1 -- 172.21.15.3:0/1255672901 wait complete. 2024-09-21T12:27:36.069 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.067+0000 7fedff6bb640 1 -- 172.21.15.3:0/1605108485 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fedf8101900 msgr2=0x7fedf8101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:27:36.069 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.067+0000 7fedff6bb640 1 --2- 172.21.15.3:0/1605108485 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fedf8101900 0x7fedf8101d60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fede8009880 tx=0x7fede802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:27:36.069 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.067+0000 7fedff6bb640 1 -- 172.21.15.3:0/1605108485 shutdown_connections 2024-09-21T12:27:36.069 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.067+0000 7fedff6bb640 1 --2- 172.21.15.3:0/1605108485 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fedf8101900 0x7fedf8101d60 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:36.069 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.067+0000 7fedff6bb640 1 --2- 172.21.15.3:0/1605108485 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fedf8107900 0x7fedf8107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:36.069 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.067+0000 7fedff6bb640 1 -- 172.21.15.3:0/1605108485 >> 172.21.15.3:0/1605108485 conn(0x7fedf80fd600 msgr2=0x7fedf80ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:27:36.070 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:35 smithi003 ceph-mon[108723]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-21T12:27:36.070 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:35 smithi003 ceph-mon[108723]: Upgrade: osd.3 is safe to restart 2024-09-21T12:27:36.070 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:35 smithi003 ceph-mon[108723]: pgmap v186: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:27:36.070 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:35 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:27:36.070 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:35 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T12:27:36.070 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:35 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:27:36.072 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.068+0000 7fedff6bb640 1 -- 172.21.15.3:0/1605108485 shutdown_connections 2024-09-21T12:27:36.072 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.068+0000 7fedff6bb640 1 -- 172.21.15.3:0/1605108485 wait complete. 2024-09-21T12:27:36.072 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.068+0000 7fedff6bb640 1 Processor -- start 2024-09-21T12:27:36.072 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.068+0000 7fedff6bb640 1 -- start start 2024-09-21T12:27:36.072 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.069+0000 7fedff6bb640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fedf8101900 0x7fedf819f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:27:36.072 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.069+0000 7fedff6bb640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fedf8107900 0x7fedf819fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:27:36.072 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.069+0000 7fedff6bb640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fedf810edd0 con 0x7fedf8107900 2024-09-21T12:27:36.072 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.069+0000 7fedff6bb640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fedf810ec50 con 0x7fedf8101900 2024-09-21T12:27:36.072 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.069+0000 7fedfcc56640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fedf8107900 0x7fedf819fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:27:36.072 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.069+0000 7fedfcc56640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fedf8107900 0x7fedf819fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45466/0 (socket says 172.21.15.3:45466) 2024-09-21T12:27:36.072 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.069+0000 7fedfcc56640 1 -- 172.21.15.3:0/2980561596 learned_addr learned my addr 172.21.15.3:0/2980561596 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:27:36.072 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.069+0000 7fedfd457640 1 --2- 172.21.15.3:0/2980561596 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fedf8101900 0x7fedf819f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:27:36.073 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.069+0000 7fedfcc56640 1 -- 172.21.15.3:0/2980561596 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fedf8101900 msgr2=0x7fedf819f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:27:36.073 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.069+0000 7fedfcc56640 1 --2- 172.21.15.3:0/2980561596 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fedf8101900 0x7fedf819f850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:36.073 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.069+0000 7fedfcc56640 1 -- 172.21.15.3:0/2980561596 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedf8199a10 con 0x7fedf8107900 2024-09-21T12:27:36.073 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.069+0000 7fedfcc56640 1 --2- 172.21.15.3:0/2980561596 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fedf8107900 0x7fedf819fd90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fede8031460 tx=0x7fede80045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:27:36.073 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.069+0000 7fedee7fc640 1 -- 172.21.15.3:0/2980561596 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fede803f070 con 0x7fedf8107900 2024-09-21T12:27:36.073 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.069+0000 7fedee7fc640 1 -- 172.21.15.3:0/2980561596 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fede8004b10 con 0x7fedf8107900 2024-09-21T12:27:36.073 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.070+0000 7fedff6bb640 1 -- 172.21.15.3:0/2980561596 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedf8199ca0 con 0x7fedf8107900 2024-09-21T12:27:36.073 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.070+0000 7fedee7fc640 1 -- 172.21.15.3:0/2980561596 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fede8035030 con 0x7fedf8107900 2024-09-21T12:27:36.073 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.070+0000 7fedff6bb640 1 -- 172.21.15.3:0/2980561596 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedf819a1d0 con 0x7fedf8107900 2024-09-21T12:27:36.074 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.071+0000 7fedff6bb640 1 -- 172.21.15.3:0/2980561596 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedf8103040 con 0x7fedf8107900 2024-09-21T12:27:36.074 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.072+0000 7fedee7fc640 1 -- 172.21.15.3:0/2980561596 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7fede8042070 con 0x7fedf8107900 2024-09-21T12:27:36.074 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.072+0000 7fedee7fc640 1 --2- 172.21.15.3:0/2980561596 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fede407af90 0x7fede407d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:27:36.074 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.072+0000 7fedee7fc640 1 -- 172.21.15.3:0/2980561596 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6156+0+0 (secure 0 0 0) 0x7fede80be9c0 con 0x7fedf8107900 2024-09-21T12:27:36.074 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.072+0000 7fedfd457640 1 --2- 172.21.15.3:0/2980561596 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fede407af90 0x7fede407d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:27:36.074 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.073+0000 7fedfd457640 1 --2- 172.21.15.3:0/2980561596 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fede407af90 0x7fede407d450 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fedf819ab50 tx=0x7fedf400b390 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:27:36.078 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.077+0000 7fedee7fc640 1 -- 172.21.15.3:0/2980561596 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fede808a040 con 0x7fedf8107900 2024-09-21T12:27:36.181 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:35 smithi192 ceph-mon[80326]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-21T12:27:36.181 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:35 smithi192 ceph-mon[80326]: Upgrade: osd.3 is safe to restart 2024-09-21T12:27:36.181 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:35 smithi192 ceph-mon[80326]: pgmap v186: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:27:36.181 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:35 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:27:36.181 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:35 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "auth get", "entity": "osd.3"} : dispatch 2024-09-21T12:27:36.182 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:35 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:27:36.275 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.273+0000 7fedff6bb640 1 -- 172.21.15.3:0/2980561596 --> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fedf819b010 con 0x7fede407af90 2024-09-21T12:27:36.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.283+0000 7fedee7fc640 1 -- 172.21.15.3:0/2980561596 <== mgr.14756 v2:172.21.15.3:6800/1284098095 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7fedf819b010 con 0x7fede407af90 2024-09-21T12:27:36.284 INFO:teuthology.orchestra.run.smithi003.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:27:36.285 INFO:teuthology.orchestra.run.smithi003.stdout:alertmanager.smithi003 smithi003 *:9093,9094 running (4m) 21s ago 15m 19.0M - 0.27.0 11f11916f8cd 14880018dfd3 2024-09-21T12:27:36.285 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-exporter.smithi003 smithi003 running (6m) 21s ago 15m 8820k - 19.1.1-373-g4e45e6b4 164465d2334a 0c9ad60a4f5a 2024-09-21T12:27:36.285 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-exporter.smithi192 smithi192 running (6m) 2m ago 14m 8338k - 19.1.1-373-g4e45e6b4 164465d2334a d5be8a6e120f 2024-09-21T12:27:36.285 INFO:teuthology.orchestra.run.smithi003.stdout:crash.smithi003 smithi003 running (2m) 21s ago 15m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 0ada67250dba 2024-09-21T12:27:36.285 INFO:teuthology.orchestra.run.smithi003.stdout:crash.smithi192 smithi192 running (2m) 2m ago 14m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 52e279085b2e 2024-09-21T12:27:36.285 INFO:teuthology.orchestra.run.smithi003.stdout:grafana.smithi003 smithi003 *:3000 running (3m) 21s ago 15m 78.8M - 10.4.8 5aad1d7cf004 19e26b3cb585 2024-09-21T12:27:36.285 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi003.ebjgyl smithi003 running (9m) 21s ago 9m 17.2M - 19.1.1-373-g4e45e6b4 164465d2334a 16e0b2cac16a 2024-09-21T12:27:36.285 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi003.gfkngj smithi003 running (9m) 21s ago 9m 143M - 19.1.1-373-g4e45e6b4 164465d2334a 109c04f87fbd 2024-09-21T12:27:36.285 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi192.ktdqns smithi192 running (9m) 2m ago 9m 18.2M - 19.1.1-373-g4e45e6b4 164465d2334a 495c73fb3bb0 2024-09-21T12:27:36.285 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi192.ywqqxe smithi192 running (9m) 2m ago 9m 18.2M - 19.1.1-373-g4e45e6b4 164465d2334a 270a01030cbe 2024-09-21T12:27:36.285 INFO:teuthology.orchestra.run.smithi003.stdout:mgr.smithi003.wztftl smithi003 *:8443,9283,8765 running (6m) 21s ago 16m 525M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 8ce0e66fd369 2024-09-21T12:27:36.285 INFO:teuthology.orchestra.run.smithi003.stdout:mgr.smithi192.qsaprd smithi192 *:8443,9283,8765 running (5m) 2m ago 14m 457M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 002a6171dd47 2024-09-21T12:27:36.285 INFO:teuthology.orchestra.run.smithi003.stdout:mon.smithi003 smithi003 running (2m) 21s ago 16m 41.7M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 4f2b2b2daf19 2024-09-21T12:27:36.286 INFO:teuthology.orchestra.run.smithi003.stdout:mon.smithi192 smithi192 running (2m) 2m ago 14m 25.9M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 11edc5c1baba 2024-09-21T12:27:36.286 INFO:teuthology.orchestra.run.smithi003.stdout:node-exporter.smithi003 smithi003 *:9100 running (4m) 21s ago 15m 9353k - 1.7.0 72c9c2088986 d9cb7ede9060 2024-09-21T12:27:36.286 INFO:teuthology.orchestra.run.smithi003.stdout:node-exporter.smithi192 smithi192 *:9100 running (4m) 2m ago 14m 11.6M - 1.7.0 72c9c2088986 d8ec0acfce7e 2024-09-21T12:27:36.286 INFO:teuthology.orchestra.run.smithi003.stdout:osd.0 smithi003 running (103s) 21s ago 13m 82.1M 1217M 19.3.0-5103-g5c1cdc3c 8f4d013db793 0f2234f333ec 2024-09-21T12:27:36.286 INFO:teuthology.orchestra.run.smithi003.stdout:osd.1 smithi003 running (64s) 21s ago 12m 85.4M 1217M 19.3.0-5103-g5c1cdc3c 8f4d013db793 198ba21d0518 2024-09-21T12:27:36.286 INFO:teuthology.orchestra.run.smithi003.stdout:osd.2 smithi003 running (26s) 21s ago 12m 11.1M 1217M 19.3.0-5103-g5c1cdc3c 8f4d013db793 e630341e13d4 2024-09-21T12:27:36.286 INFO:teuthology.orchestra.run.smithi003.stdout:osd.3 smithi192 running (11m) 2m ago 11m 238M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 13efcfd71c05 2024-09-21T12:27:36.286 INFO:teuthology.orchestra.run.smithi003.stdout:osd.4 smithi192 running (11m) 2m ago 11m 204M 2240M 19.1.1-373-g4e45e6b4 164465d2334a f33bf453cb3e 2024-09-21T12:27:36.286 INFO:teuthology.orchestra.run.smithi003.stdout:osd.5 smithi192 running (10m) 2m ago 10m 182M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 12d7b7c8e985 2024-09-21T12:27:36.286 INFO:teuthology.orchestra.run.smithi003.stdout:prometheus.smithi003 smithi003 *:9095 running (4m) 21s ago 14m 54.6M - 2.51.0 1d3b7f56885b 64997a33fbbb 2024-09-21T12:27:36.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.285+0000 7fedff6bb640 1 -- 172.21.15.3:0/2980561596 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fede407af90 msgr2=0x7fede407d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:27:36.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.285+0000 7fedff6bb640 1 --2- 172.21.15.3:0/2980561596 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fede407af90 0x7fede407d450 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fedf819ab50 tx=0x7fedf400b390 comp rx=0 tx=0).stop 2024-09-21T12:27:36.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.285+0000 7fedff6bb640 1 -- 172.21.15.3:0/2980561596 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fedf8107900 msgr2=0x7fedf819fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:27:36.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.285+0000 7fedff6bb640 1 --2- 172.21.15.3:0/2980561596 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fedf8107900 0x7fedf819fd90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fede8031460 tx=0x7fede80045e0 comp rx=0 tx=0).stop 2024-09-21T12:27:36.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.285+0000 7fedff6bb640 1 -- 172.21.15.3:0/2980561596 shutdown_connections 2024-09-21T12:27:36.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.285+0000 7fedff6bb640 1 --2- 172.21.15.3:0/2980561596 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fede407af90 0x7fede407d450 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:36.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.285+0000 7fedff6bb640 1 --2- 172.21.15.3:0/2980561596 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fedf8107900 0x7fedf819fd90 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:36.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.285+0000 7fedff6bb640 1 --2- 172.21.15.3:0/2980561596 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fedf8101900 0x7fedf819f850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:36.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.285+0000 7fedff6bb640 1 -- 172.21.15.3:0/2980561596 >> 172.21.15.3:0/2980561596 conn(0x7fedf80fd600 msgr2=0x7fedf8074480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:27:36.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.285+0000 7fedff6bb640 1 -- 172.21.15.3:0/2980561596 shutdown_connections 2024-09-21T12:27:36.287 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.285+0000 7fedff6bb640 1 -- 172.21.15.3:0/2980561596 wait complete. 2024-09-21T12:27:36.370 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.368+0000 7f325b845640 1 -- 172.21.15.3:0/1107782966 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3254101900 msgr2=0x7f3254101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:27:36.370 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.368+0000 7f325b845640 1 --2- 172.21.15.3:0/1107782966 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3254101900 0x7f3254101d60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3250009880 tx=0x7f325002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:27:36.370 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.368+0000 7f325b845640 1 -- 172.21.15.3:0/1107782966 shutdown_connections 2024-09-21T12:27:36.370 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.368+0000 7f325b845640 1 --2- 172.21.15.3:0/1107782966 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3254101900 0x7f3254101d60 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:36.370 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.368+0000 7f325b845640 1 --2- 172.21.15.3:0/1107782966 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3254107900 0x7f3254107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:36.370 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.368+0000 7f325b845640 1 -- 172.21.15.3:0/1107782966 >> 172.21.15.3:0/1107782966 conn(0x7f32540fd600 msgr2=0x7f32540ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:27:36.371 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.368+0000 7f325b845640 1 -- 172.21.15.3:0/1107782966 shutdown_connections 2024-09-21T12:27:36.371 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.368+0000 7f325b845640 1 -- 172.21.15.3:0/1107782966 wait complete. 2024-09-21T12:27:36.373 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.369+0000 7f325b845640 1 Processor -- start 2024-09-21T12:27:36.373 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.369+0000 7f325b845640 1 -- start start 2024-09-21T12:27:36.373 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.369+0000 7f325b845640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3254101900 0x7f325419f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:27:36.373 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.369+0000 7f325b845640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3254107900 0x7f325419fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:27:36.373 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.369+0000 7f325b845640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f32540756c0 con 0x7f3254107900 2024-09-21T12:27:36.373 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.369+0000 7f325b845640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f3254075540 con 0x7f3254101900 2024-09-21T12:27:36.373 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.369+0000 7f3258de0640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3254107900 0x7f325419fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:27:36.373 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.369+0000 7f3258de0640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3254107900 0x7f325419fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45480/0 (socket says 172.21.15.3:45480) 2024-09-21T12:27:36.373 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.369+0000 7f3258de0640 1 -- 172.21.15.3:0/2938026132 learned_addr learned my addr 172.21.15.3:0/2938026132 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:27:36.373 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.370+0000 7f32595e1640 1 --2- 172.21.15.3:0/2938026132 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3254101900 0x7f325419f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:27:36.374 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.370+0000 7f3258de0640 1 -- 172.21.15.3:0/2938026132 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3254101900 msgr2=0x7f325419f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:27:36.374 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.370+0000 7f3258de0640 1 --2- 172.21.15.3:0/2938026132 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3254101900 0x7f325419f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:36.374 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.370+0000 7f3258de0640 1 -- 172.21.15.3:0/2938026132 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3254199990 con 0x7f3254107900 2024-09-21T12:27:36.374 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.370+0000 7f3258de0640 1 --2- 172.21.15.3:0/2938026132 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3254107900 0x7f325419fd10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3250031460 tx=0x7f32500045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:27:36.374 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.370+0000 7f32467fc640 1 -- 172.21.15.3:0/2938026132 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f325003f070 con 0x7f3254107900 2024-09-21T12:27:36.374 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.370+0000 7f32467fc640 1 -- 172.21.15.3:0/2938026132 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f32500035f0 con 0x7f3254107900 2024-09-21T12:27:36.374 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.370+0000 7f325b845640 1 -- 172.21.15.3:0/2938026132 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3254199c20 con 0x7f3254107900 2024-09-21T12:27:36.374 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.370+0000 7f32467fc640 1 -- 172.21.15.3:0/2938026132 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3250035030 con 0x7f3254107900 2024-09-21T12:27:36.374 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.370+0000 7f325b845640 1 -- 172.21.15.3:0/2938026132 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f325419a150 con 0x7f3254107900 2024-09-21T12:27:36.374 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.371+0000 7f325b845640 1 -- 172.21.15.3:0/2938026132 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3254103040 con 0x7f3254107900 2024-09-21T12:27:36.375 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.372+0000 7f32467fc640 1 -- 172.21.15.3:0/2938026132 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f3250042070 con 0x7f3254107900 2024-09-21T12:27:36.375 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.372+0000 7f32467fc640 1 --2- 172.21.15.3:0/2938026132 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f324007af80 0x7f324007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:27:36.375 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.372+0000 7f32467fc640 1 -- 172.21.15.3:0/2938026132 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6156+0+0 (secure 0 0 0) 0x7f32500be860 con 0x7f3254107900 2024-09-21T12:27:36.375 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.373+0000 7f32595e1640 1 --2- 172.21.15.3:0/2938026132 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f324007af80 0x7f324007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:27:36.375 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.373+0000 7f32595e1640 1 --2- 172.21.15.3:0/2938026132 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f324007af80 0x7f324007d440 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f325419aad0 tx=0x7f324800b390 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:27:36.378 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.377+0000 7f32467fc640 1 -- 172.21.15.3:0/2938026132 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3250089ee0 con 0x7f3254107900 2024-09-21T12:27:36.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.637+0000 7f325b845640 1 -- 172.21.15.3:0/2938026132 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f325419aec0 con 0x7f3254107900 2024-09-21T12:27:36.639 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.638+0000 7f32467fc640 1 -- 172.21.15.3:0/2938026132 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+836 (secure 0 0 0) 0x7f325008c400 con 0x7f3254107900 2024-09-21T12:27:36.639 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-21T12:27:36.639 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": { 2024-09-21T12:27:36.639 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:27:36.640 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:27:36.640 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": { 2024-09-21T12:27:36.640 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:27:36.640 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:27:36.640 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": { 2024-09-21T12:27:36.640 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 3, 2024-09-21T12:27:36.640 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 3 2024-09-21T12:27:36.640 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:27:36.640 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": { 2024-09-21T12:27:36.640 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 4 2024-09-21T12:27:36.640 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:27:36.640 INFO:teuthology.orchestra.run.smithi003.stdout: "overall": { 2024-09-21T12:27:36.640 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 7, 2024-09-21T12:27:36.641 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 7 2024-09-21T12:27:36.641 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-21T12:27:36.641 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-21T12:27:36.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.640+0000 7f325b845640 1 -- 172.21.15.3:0/2938026132 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f324007af80 msgr2=0x7f324007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:27:36.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.640+0000 7f325b845640 1 --2- 172.21.15.3:0/2938026132 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f324007af80 0x7f324007d440 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f325419aad0 tx=0x7f324800b390 comp rx=0 tx=0).stop 2024-09-21T12:27:36.641 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.640+0000 7f325b845640 1 -- 172.21.15.3:0/2938026132 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3254107900 msgr2=0x7f325419fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:27:36.642 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.640+0000 7f325b845640 1 --2- 172.21.15.3:0/2938026132 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3254107900 0x7f325419fd10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3250031460 tx=0x7f32500045e0 comp rx=0 tx=0).stop 2024-09-21T12:27:36.642 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.640+0000 7f325b845640 1 -- 172.21.15.3:0/2938026132 shutdown_connections 2024-09-21T12:27:36.642 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.640+0000 7f325b845640 1 --2- 172.21.15.3:0/2938026132 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f324007af80 0x7f324007d440 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:36.642 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.640+0000 7f325b845640 1 --2- 172.21.15.3:0/2938026132 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3254107900 0x7f325419fd10 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:36.642 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.640+0000 7f325b845640 1 --2- 172.21.15.3:0/2938026132 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3254101900 0x7f325419f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:36.642 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.640+0000 7f325b845640 1 -- 172.21.15.3:0/2938026132 >> 172.21.15.3:0/2938026132 conn(0x7f32540fd600 msgr2=0x7f32540fee40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:27:36.642 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.640+0000 7f325b845640 1 -- 172.21.15.3:0/2938026132 shutdown_connections 2024-09-21T12:27:36.642 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.640+0000 7f325b845640 1 -- 172.21.15.3:0/2938026132 wait complete. 2024-09-21T12:27:36.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.724+0000 7f308240c640 1 -- 172.21.15.3:0/2151505366 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f307c101900 msgr2=0x7f307c101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:27:36.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.724+0000 7f308240c640 1 --2- 172.21.15.3:0/2151505366 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f307c101900 0x7f307c101d60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3070009880 tx=0x7f307002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:27:36.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.724+0000 7f308240c640 1 -- 172.21.15.3:0/2151505366 shutdown_connections 2024-09-21T12:27:36.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.724+0000 7f308240c640 1 --2- 172.21.15.3:0/2151505366 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f307c101900 0x7f307c101d60 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:36.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.724+0000 7f308240c640 1 --2- 172.21.15.3:0/2151505366 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f307c107900 0x7f307c107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:36.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.724+0000 7f308240c640 1 -- 172.21.15.3:0/2151505366 >> 172.21.15.3:0/2151505366 conn(0x7f307c0fd600 msgr2=0x7f307c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:27:36.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.724+0000 7f308240c640 1 -- 172.21.15.3:0/2151505366 shutdown_connections 2024-09-21T12:27:36.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.724+0000 7f308240c640 1 -- 172.21.15.3:0/2151505366 wait complete. 2024-09-21T12:27:36.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.725+0000 7f308240c640 1 Processor -- start 2024-09-21T12:27:36.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.725+0000 7f308240c640 1 -- start start 2024-09-21T12:27:36.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.725+0000 7f308240c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f307c101900 0x7f307c19d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:27:36.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.725+0000 7f308240c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f307c107900 0x7f307c19dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:27:36.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.725+0000 7f308240c640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f307c10edb0 con 0x7f307c107900 2024-09-21T12:27:36.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.725+0000 7f308240c640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f307c10ec30 con 0x7f307c101900 2024-09-21T12:27:36.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.725+0000 7f307b7fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f307c107900 0x7f307c19dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:27:36.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.725+0000 7f307b7fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f307c107900 0x7f307c19dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45492/0 (socket says 172.21.15.3:45492) 2024-09-21T12:27:36.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.725+0000 7f307b7fe640 1 -- 172.21.15.3:0/3751956635 learned_addr learned my addr 172.21.15.3:0/3751956635 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:27:36.729 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.725+0000 7f307bfff640 1 --2- 172.21.15.3:0/3751956635 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f307c101900 0x7f307c19d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:27:36.729 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.726+0000 7f307b7fe640 1 -- 172.21.15.3:0/3751956635 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f307c101900 msgr2=0x7f307c19d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:27:36.729 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.726+0000 7f307b7fe640 1 --2- 172.21.15.3:0/3751956635 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f307c101900 0x7f307c19d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:36.729 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.726+0000 7f307b7fe640 1 -- 172.21.15.3:0/3751956635 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f307c197800 con 0x7f307c107900 2024-09-21T12:27:36.729 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.726+0000 7f307b7fe640 1 --2- 172.21.15.3:0/3751956635 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f307c107900 0x7f307c19dbc0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3070031460 tx=0x7f30700048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:27:36.729 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.726+0000 7f30797fa640 1 -- 172.21.15.3:0/3751956635 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f307003f070 con 0x7f307c107900 2024-09-21T12:27:36.729 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.726+0000 7f308240c640 1 -- 172.21.15.3:0/3751956635 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f307c197a90 con 0x7f307c107900 2024-09-21T12:27:36.729 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.726+0000 7f30797fa640 1 -- 172.21.15.3:0/3751956635 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f3070004cf0 con 0x7f307c107900 2024-09-21T12:27:36.729 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.726+0000 7f30797fa640 1 -- 172.21.15.3:0/3751956635 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3070035030 con 0x7f307c107900 2024-09-21T12:27:36.729 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.726+0000 7f308240c640 1 -- 172.21.15.3:0/3751956635 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f307c197fc0 con 0x7f307c107900 2024-09-21T12:27:36.730 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.727+0000 7f308240c640 1 -- 172.21.15.3:0/3751956635 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f307c103040 con 0x7f307c107900 2024-09-21T12:27:36.730 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.728+0000 7f30797fa640 1 -- 172.21.15.3:0/3751956635 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f3070042070 con 0x7f307c107900 2024-09-21T12:27:36.730 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.728+0000 7f30797fa640 1 --2- 172.21.15.3:0/3751956635 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f306407af30 0x7f306407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:27:36.730 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.729+0000 7f30797fa640 1 -- 172.21.15.3:0/3751956635 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6156+0+0 (secure 0 0 0) 0x7f30700beac0 con 0x7f307c107900 2024-09-21T12:27:36.730 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.729+0000 7f307bfff640 1 --2- 172.21.15.3:0/3751956635 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f306407af30 0x7f306407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:27:36.731 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.729+0000 7f307bfff640 1 --2- 172.21.15.3:0/3751956635 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f306407af30 0x7f306407d3f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f306c005e10 tx=0x7f306c005da0 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:27:36.734 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.733+0000 7f30797fa640 1 -- 172.21.15.3:0/3751956635 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f307008a0c0 con 0x7f307c107900 2024-09-21T12:27:36.963 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.961+0000 7f308240c640 1 -- 172.21.15.3:0/3751956635 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f307c198d30 con 0x7f307c107900 2024-09-21T12:27:36.963 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.962+0000 7f30797fa640 1 -- 172.21.15.3:0/3751956635 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) ==== 76+0+2010 (secure 0 0 0) 0x7f307008ef70 con 0x7f307c107900 2024-09-21T12:27:36.963 INFO:teuthology.orchestra.run.smithi003.stdout:e14 2024-09-21T12:27:36.963 INFO:teuthology.orchestra.run.smithi003.stdout:btime 2024-09-21T12:17:55:592931+0000 2024-09-21T12:27:36.964 INFO:teuthology.orchestra.run.smithi003.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T12:27:36.964 INFO:teuthology.orchestra.run.smithi003.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:27:36.964 INFO:teuthology.orchestra.run.smithi003.stdout:legacy client fscid: 1 2024-09-21T12:27:36.964 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:27:36.964 INFO:teuthology.orchestra.run.smithi003.stdout:Filesystem 'cephfs' (1) 2024-09-21T12:27:36.964 INFO:teuthology.orchestra.run.smithi003.stdout:fs_name cephfs 2024-09-21T12:27:36.964 INFO:teuthology.orchestra.run.smithi003.stdout:epoch 14 2024-09-21T12:27:36.964 INFO:teuthology.orchestra.run.smithi003.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T12:27:36.964 INFO:teuthology.orchestra.run.smithi003.stdout:created 2024-09-21T12:17:38.260099+0000 2024-09-21T12:27:36.964 INFO:teuthology.orchestra.run.smithi003.stdout:modified 2024-09-21T12:17:55.592927+0000 2024-09-21T12:27:36.964 INFO:teuthology.orchestra.run.smithi003.stdout:tableserver 0 2024-09-21T12:27:36.964 INFO:teuthology.orchestra.run.smithi003.stdout:root 0 2024-09-21T12:27:36.964 INFO:teuthology.orchestra.run.smithi003.stdout:session_timeout 60 2024-09-21T12:27:36.964 INFO:teuthology.orchestra.run.smithi003.stdout:session_autoclose 300 2024-09-21T12:27:36.965 INFO:teuthology.orchestra.run.smithi003.stdout:max_file_size 1099511627776 2024-09-21T12:27:36.965 INFO:teuthology.orchestra.run.smithi003.stdout:max_xattr_size 65536 2024-09-21T12:27:36.965 INFO:teuthology.orchestra.run.smithi003.stdout:required_client_features {} 2024-09-21T12:27:36.965 INFO:teuthology.orchestra.run.smithi003.stdout:last_failure 0 2024-09-21T12:27:36.965 INFO:teuthology.orchestra.run.smithi003.stdout:last_failure_osd_epoch 46 2024-09-21T12:27:36.965 INFO:teuthology.orchestra.run.smithi003.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:27:36.965 INFO:teuthology.orchestra.run.smithi003.stdout:max_mds 1 2024-09-21T12:27:36.965 INFO:teuthology.orchestra.run.smithi003.stdout:in 0 2024-09-21T12:27:36.965 INFO:teuthology.orchestra.run.smithi003.stdout:up {0=14564} 2024-09-21T12:27:36.965 INFO:teuthology.orchestra.run.smithi003.stdout:failed 2024-09-21T12:27:36.965 INFO:teuthology.orchestra.run.smithi003.stdout:damaged 2024-09-21T12:27:36.965 INFO:teuthology.orchestra.run.smithi003.stdout:stopped 2024-09-21T12:27:36.965 INFO:teuthology.orchestra.run.smithi003.stdout:data_pools [3] 2024-09-21T12:27:36.965 INFO:teuthology.orchestra.run.smithi003.stdout:metadata_pool 2 2024-09-21T12:27:36.966 INFO:teuthology.orchestra.run.smithi003.stdout:inline_data enabled 2024-09-21T12:27:36.966 INFO:teuthology.orchestra.run.smithi003.stdout:balancer 2024-09-21T12:27:36.966 INFO:teuthology.orchestra.run.smithi003.stdout:bal_rank_mask -1 2024-09-21T12:27:36.966 INFO:teuthology.orchestra.run.smithi003.stdout:standby_count_wanted 1 2024-09-21T12:27:36.966 INFO:teuthology.orchestra.run.smithi003.stdout:qdb_cluster leader: 14564 members: 14564 2024-09-21T12:27:36.966 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.cephfs.smithi003.gfkngj{0:14564} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.3:6828/3710817325,v1:172.21.15.3:6829/3710817325] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:27:36.966 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:27:36.966 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:27:36.966 INFO:teuthology.orchestra.run.smithi003.stdout:Standby daemons: 2024-09-21T12:27:36.966 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:27:36.966 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.cephfs.smithi192.ywqqxe{-1:24319} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.192:6824/4055220871,v1:172.21.15.192:6825/4055220871] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:27:36.966 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.cephfs.smithi192.ktdqns{-1:24337} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.192:6826/318800854,v1:172.21.15.192:6827/318800854] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:27:36.966 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.cephfs.smithi003.ebjgyl{-1:24345} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.3:6826/55902996,v1:172.21.15.3:6827/55902996] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:27:36.967 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 14 2024-09-21T12:27:36.967 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.964+0000 7f308240c640 1 -- 172.21.15.3:0/3751956635 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f306407af30 msgr2=0x7f306407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:27:36.967 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.964+0000 7f308240c640 1 --2- 172.21.15.3:0/3751956635 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f306407af30 0x7f306407d3f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f306c005e10 tx=0x7f306c005da0 comp rx=0 tx=0).stop 2024-09-21T12:27:36.967 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.964+0000 7f308240c640 1 -- 172.21.15.3:0/3751956635 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f307c107900 msgr2=0x7f307c19dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:27:36.967 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.964+0000 7f308240c640 1 --2- 172.21.15.3:0/3751956635 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f307c107900 0x7f307c19dbc0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f3070031460 tx=0x7f30700048f0 comp rx=0 tx=0).stop 2024-09-21T12:27:36.967 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.964+0000 7f308240c640 1 -- 172.21.15.3:0/3751956635 shutdown_connections 2024-09-21T12:27:36.968 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.964+0000 7f308240c640 1 --2- 172.21.15.3:0/3751956635 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f306407af30 0x7f306407d3f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:36.968 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.964+0000 7f308240c640 1 --2- 172.21.15.3:0/3751956635 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f307c107900 0x7f307c19dbc0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:36.968 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.964+0000 7f308240c640 1 --2- 172.21.15.3:0/3751956635 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f307c101900 0x7f307c19d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:36.968 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.964+0000 7f308240c640 1 -- 172.21.15.3:0/3751956635 >> 172.21.15.3:0/3751956635 conn(0x7f307c0fd600 msgr2=0x7f307c0fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:27:36.968 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.964+0000 7f308240c640 1 -- 172.21.15.3:0/3751956635 shutdown_connections 2024-09-21T12:27:36.968 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:36.964+0000 7f308240c640 1 -- 172.21.15.3:0/3751956635 wait complete. 2024-09-21T12:27:37.051 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.049+0000 7f2c2214a640 1 -- 172.21.15.3:0/456677043 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2c1c107900 msgr2=0x7f2c1c107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:27:37.051 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.049+0000 7f2c2214a640 1 --2- 172.21.15.3:0/456677043 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2c1c107900 0x7f2c1c107ce0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c009880 tx=0x7f2c0c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:27:37.051 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.049+0000 7f2c2214a640 1 -- 172.21.15.3:0/456677043 shutdown_connections 2024-09-21T12:27:37.051 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.049+0000 7f2c2214a640 1 --2- 172.21.15.3:0/456677043 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c1c101900 0x7f2c1c101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:37.051 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.049+0000 7f2c2214a640 1 --2- 172.21.15.3:0/456677043 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2c1c107900 0x7f2c1c107ce0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:37.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.049+0000 7f2c2214a640 1 -- 172.21.15.3:0/456677043 >> 172.21.15.3:0/456677043 conn(0x7f2c1c0fd600 msgr2=0x7f2c1c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:27:37.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.049+0000 7f2c2214a640 1 -- 172.21.15.3:0/456677043 shutdown_connections 2024-09-21T12:27:37.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.049+0000 7f2c2214a640 1 -- 172.21.15.3:0/456677043 wait complete. 2024-09-21T12:27:37.052 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.050+0000 7f2c2214a640 1 Processor -- start 2024-09-21T12:27:37.053 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.050+0000 7f2c2214a640 1 -- start start 2024-09-21T12:27:37.053 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.050+0000 7f2c2214a640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2c1c101900 0x7f2c1c19d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:27:37.053 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.050+0000 7f2c2214a640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c1c107900 0x7f2c1c19db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:27:37.053 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.050+0000 7f2c2214a640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f2c1c10edd0 con 0x7f2c1c101900 2024-09-21T12:27:37.053 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.050+0000 7f2c2214a640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2c1c10ec50 con 0x7f2c1c107900 2024-09-21T12:27:37.053 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.050+0000 7f2c1b7fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2c1c101900 0x7f2c1c19d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:27:37.054 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.050+0000 7f2c1b7fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2c1c101900 0x7f2c1c19d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45506/0 (socket says 172.21.15.3:45506) 2024-09-21T12:27:37.054 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.050+0000 7f2c1b7fe640 1 -- 172.21.15.3:0/3037920873 learned_addr learned my addr 172.21.15.3:0/3037920873 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:27:37.054 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.051+0000 7f2c1affd640 1 --2- 172.21.15.3:0/3037920873 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c1c107900 0x7f2c1c19db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:27:37.054 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.051+0000 7f2c1b7fe640 1 -- 172.21.15.3:0/3037920873 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c1c107900 msgr2=0x7f2c1c19db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:27:37.054 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.051+0000 7f2c1b7fe640 1 --2- 172.21.15.3:0/3037920873 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c1c107900 0x7f2c1c19db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:37.054 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.051+0000 7f2c1b7fe640 1 -- 172.21.15.3:0/3037920873 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c1c1977c0 con 0x7f2c1c101900 2024-09-21T12:27:37.054 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.051+0000 7f2c1affd640 1 --2- 172.21.15.3:0/3037920873 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c1c107900 0x7f2c1c19db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:27:37.054 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.051+0000 7f2c1b7fe640 1 --2- 172.21.15.3:0/3037920873 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2c1c101900 0x7f2c1c19d640 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c031460 tx=0x7f2c0c004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:27:37.054 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.051+0000 7f2c18ff9640 1 -- 172.21.15.3:0/3037920873 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2c0c03f070 con 0x7f2c1c101900 2024-09-21T12:27:37.054 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.051+0000 7f2c18ff9640 1 -- 172.21.15.3:0/3037920873 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2c0c0035f0 con 0x7f2c1c101900 2024-09-21T12:27:37.054 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.051+0000 7f2c2214a640 1 -- 172.21.15.3:0/3037920873 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c1c197a50 con 0x7f2c1c101900 2024-09-21T12:27:37.054 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.051+0000 7f2c18ff9640 1 -- 172.21.15.3:0/3037920873 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2c0c035030 con 0x7f2c1c101900 2024-09-21T12:27:37.054 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.051+0000 7f2c2214a640 1 -- 172.21.15.3:0/3037920873 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c1c197f80 con 0x7f2c1c101900 2024-09-21T12:27:37.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.052+0000 7f2c2214a640 1 -- 172.21.15.3:0/3037920873 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c1c103040 con 0x7f2c1c101900 2024-09-21T12:27:37.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.053+0000 7f2c18ff9640 1 -- 172.21.15.3:0/3037920873 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f2c0c042070 con 0x7f2c1c101900 2024-09-21T12:27:37.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.053+0000 7f2c18ff9640 1 --2- 172.21.15.3:0/3037920873 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f2c0407af30 0x7f2c0407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:27:37.055 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.054+0000 7f2c1affd640 1 --2- 172.21.15.3:0/3037920873 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f2c0407af30 0x7f2c0407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:27:37.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.054+0000 7f2c18ff9640 1 -- 172.21.15.3:0/3037920873 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6156+0+0 (secure 0 0 0) 0x7f2c0c0be9b0 con 0x7f2c1c101900 2024-09-21T12:27:37.056 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.054+0000 7f2c1affd640 1 --2- 172.21.15.3:0/3037920873 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f2c0407af30 0x7f2c0407d3f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c0ffbf0 tx=0x7f2c10005f90 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:27:37.059 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.058+0000 7f2c18ff9640 1 -- 172.21.15.3:0/3037920873 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2c0c089fb0 con 0x7f2c1c101900 2024-09-21T12:27:37.165 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:36 smithi192 ceph-mon[80326]: Upgrade: Updating osd.3 2024-09-21T12:27:37.166 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:36 smithi192 ceph-mon[80326]: Deploying daemon osd.3 on smithi192 2024-09-21T12:27:37.166 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:36 smithi192 ceph-mon[80326]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:27:37.166 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:36 smithi192 ceph-mon[80326]: from='client.? 172.21.15.3:0/2938026132' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:27:37.263 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.262+0000 7f2c2214a640 1 -- 172.21.15.3:0/3037920873 --> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f2c1c198230 con 0x7f2c0407af30 2024-09-21T12:27:37.264 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:36 smithi003 ceph-mon[108723]: Upgrade: Updating osd.3 2024-09-21T12:27:37.264 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:36 smithi003 ceph-mon[108723]: Deploying daemon osd.3 on smithi192 2024-09-21T12:27:37.264 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:36 smithi003 ceph-mon[108723]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:27:37.264 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:36 smithi003 ceph-mon[108723]: from='client.? 172.21.15.3:0/2938026132' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:27:37.265 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.263+0000 7f2c18ff9640 1 -- 172.21.15.3:0/3037920873 <== mgr.14756 v2:172.21.15.3:6800/1284098095 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+400 (secure 0 0 0) 0x7f2c1c198230 con 0x7f2c0407af30 2024-09-21T12:27:37.265 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-21T12:27:37.265 INFO:teuthology.orchestra.run.smithi003.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T12:27:37.265 INFO:teuthology.orchestra.run.smithi003.stdout: "in_progress": true, 2024-09-21T12:27:37.265 INFO:teuthology.orchestra.run.smithi003.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T12:27:37.265 INFO:teuthology.orchestra.run.smithi003.stdout: "services_complete": [ 2024-09-21T12:27:37.265 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr", 2024-09-21T12:27:37.265 INFO:teuthology.orchestra.run.smithi003.stdout: "mon", 2024-09-21T12:27:37.265 INFO:teuthology.orchestra.run.smithi003.stdout: "crash" 2024-09-21T12:27:37.265 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-21T12:27:37.265 INFO:teuthology.orchestra.run.smithi003.stdout: "progress": "9/23 daemons upgraded", 2024-09-21T12:27:37.266 INFO:teuthology.orchestra.run.smithi003.stdout: "message": "Currently upgrading osd daemons", 2024-09-21T12:27:37.266 INFO:teuthology.orchestra.run.smithi003.stdout: "is_paused": false 2024-09-21T12:27:37.266 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-21T12:27:37.267 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.265+0000 7f2c2214a640 1 -- 172.21.15.3:0/3037920873 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f2c0407af30 msgr2=0x7f2c0407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:27:37.267 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.265+0000 7f2c2214a640 1 --2- 172.21.15.3:0/3037920873 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f2c0407af30 0x7f2c0407d3f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c0ffbf0 tx=0x7f2c10005f90 comp rx=0 tx=0).stop 2024-09-21T12:27:37.267 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.265+0000 7f2c2214a640 1 -- 172.21.15.3:0/3037920873 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2c1c101900 msgr2=0x7f2c1c19d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:27:37.267 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.265+0000 7f2c2214a640 1 --2- 172.21.15.3:0/3037920873 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2c1c101900 0x7f2c1c19d640 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c031460 tx=0x7f2c0c004530 comp rx=0 tx=0).stop 2024-09-21T12:27:37.267 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.265+0000 7f2c2214a640 1 -- 172.21.15.3:0/3037920873 shutdown_connections 2024-09-21T12:27:37.267 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.265+0000 7f2c2214a640 1 --2- 172.21.15.3:0/3037920873 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f2c0407af30 0x7f2c0407d3f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:37.267 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.265+0000 7f2c2214a640 1 --2- 172.21.15.3:0/3037920873 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2c1c107900 0x7f2c1c19db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:37.267 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.265+0000 7f2c2214a640 1 --2- 172.21.15.3:0/3037920873 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2c1c101900 0x7f2c1c19d640 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:37.267 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.265+0000 7f2c2214a640 1 -- 172.21.15.3:0/3037920873 >> 172.21.15.3:0/3037920873 conn(0x7f2c1c0fd600 msgr2=0x7f2c1c0fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:27:37.269 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.266+0000 7f2c2214a640 1 -- 172.21.15.3:0/3037920873 shutdown_connections 2024-09-21T12:27:37.269 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.266+0000 7f2c2214a640 1 -- 172.21.15.3:0/3037920873 wait complete. 2024-09-21T12:27:37.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.350+0000 7f92dd7cf640 1 -- 172.21.15.3:0/2399697312 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f92d8107900 msgr2=0x7f92d8107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:27:37.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.350+0000 7f92dd7cf640 1 --2- 172.21.15.3:0/2399697312 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f92d8107900 0x7f92d8107ce0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f92c8009880 tx=0x7f92c802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:27:37.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.350+0000 7f92dd7cf640 1 -- 172.21.15.3:0/2399697312 shutdown_connections 2024-09-21T12:27:37.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.350+0000 7f92dd7cf640 1 --2- 172.21.15.3:0/2399697312 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92d8101900 0x7f92d8101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:37.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.350+0000 7f92dd7cf640 1 --2- 172.21.15.3:0/2399697312 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f92d8107900 0x7f92d8107ce0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:37.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.350+0000 7f92dd7cf640 1 -- 172.21.15.3:0/2399697312 >> 172.21.15.3:0/2399697312 conn(0x7f92d80fd600 msgr2=0x7f92d80ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:27:37.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.350+0000 7f92dd7cf640 1 -- 172.21.15.3:0/2399697312 shutdown_connections 2024-09-21T12:27:37.352 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.350+0000 7f92dd7cf640 1 -- 172.21.15.3:0/2399697312 wait complete. 2024-09-21T12:27:37.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.351+0000 7f92dd7cf640 1 Processor -- start 2024-09-21T12:27:37.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.351+0000 7f92dd7cf640 1 -- start start 2024-09-21T12:27:37.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.351+0000 7f92dd7cf640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f92d8101900 0x7f92d80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:27:37.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.351+0000 7f92dd7cf640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92d8107900 0x7f92d8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:27:37.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.351+0000 7f92dd7cf640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f92d810edd0 con 0x7f92d8101900 2024-09-21T12:27:37.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.351+0000 7f92dd7cf640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f92d810ec50 con 0x7f92d8107900 2024-09-21T12:27:37.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.351+0000 7f92d6ffd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f92d8101900 0x7f92d80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:27:37.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.351+0000 7f92d6ffd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f92d8101900 0x7f92d80744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:45536/0 (socket says 172.21.15.3:45536) 2024-09-21T12:27:37.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.351+0000 7f92d6ffd640 1 -- 172.21.15.3:0/580325991 learned_addr learned my addr 172.21.15.3:0/580325991 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:27:37.354 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.351+0000 7f92d67fc640 1 --2- 172.21.15.3:0/580325991 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92d8107900 0x7f92d8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:27:37.355 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.352+0000 7f92d6ffd640 1 -- 172.21.15.3:0/580325991 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92d8107900 msgr2=0x7f92d8074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:27:37.355 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.352+0000 7f92d6ffd640 1 --2- 172.21.15.3:0/580325991 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92d8107900 0x7f92d8074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:37.355 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.352+0000 7f92d6ffd640 1 -- 172.21.15.3:0/580325991 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92d8074f70 con 0x7f92d8101900 2024-09-21T12:27:37.355 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.352+0000 7f92d6ffd640 1 --2- 172.21.15.3:0/580325991 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f92d8101900 0x7f92d80744f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f92c8031460 tx=0x7f92c8004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:27:37.355 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.352+0000 7f92bffff640 1 -- 172.21.15.3:0/580325991 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f92c803f070 con 0x7f92d8101900 2024-09-21T12:27:37.355 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.352+0000 7f92bffff640 1 -- 172.21.15.3:0/580325991 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f92c80035f0 con 0x7f92d8101900 2024-09-21T12:27:37.355 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.352+0000 7f92dd7cf640 1 -- 172.21.15.3:0/580325991 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92d8075200 con 0x7f92d8101900 2024-09-21T12:27:37.355 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.352+0000 7f92bffff640 1 -- 172.21.15.3:0/580325991 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f92c8035030 con 0x7f92d8101900 2024-09-21T12:27:37.355 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.352+0000 7f92dd7cf640 1 -- 172.21.15.3:0/580325991 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92d81a3d60 con 0x7f92d8101900 2024-09-21T12:27:37.356 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.353+0000 7f92dd7cf640 1 -- 172.21.15.3:0/580325991 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92d8103040 con 0x7f92d8101900 2024-09-21T12:27:37.356 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.354+0000 7f92bffff640 1 -- 172.21.15.3:0/580325991 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f92c8042070 con 0x7f92d8101900 2024-09-21T12:27:37.356 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.354+0000 7f92bffff640 1 --2- 172.21.15.3:0/580325991 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f92c007af80 0x7f92c007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:27:37.356 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.354+0000 7f92d67fc640 1 --2- 172.21.15.3:0/580325991 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f92c007af80 0x7f92c007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:27:37.357 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.354+0000 7f92bffff640 1 -- 172.21.15.3:0/580325991 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(63..63 src has 1..63) ==== 6156+0+0 (secure 0 0 0) 0x7f92c80be830 con 0x7f92d8101900 2024-09-21T12:27:37.357 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.355+0000 7f92d67fc640 1 --2- 172.21.15.3:0/580325991 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f92c007af80 0x7f92c007d440 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f92d8075f80 tx=0x7f92cc005f90 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:27:37.360 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.359+0000 7f92bffff640 1 -- 172.21.15.3:0/580325991 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f92c8089eb0 con 0x7f92d8101900 2024-09-21T12:27:37.621 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.620+0000 7f92dd7cf640 1 -- 172.21.15.3:0/580325991 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f92d8109e70 con 0x7f92d8101900 2024-09-21T12:27:37.621 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.620+0000 7f92bffff640 1 -- 172.21.15.3:0/580325991 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7f92c808ed60 con 0x7f92d8101900 2024-09-21T12:27:37.622 INFO:teuthology.orchestra.run.smithi003.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-21T12:27:37.622 INFO:teuthology.orchestra.run.smithi003.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:27:37.622 INFO:teuthology.orchestra.run.smithi003.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:27:37.624 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.622+0000 7f92dd7cf640 1 -- 172.21.15.3:0/580325991 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f92c007af80 msgr2=0x7f92c007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:27:37.624 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.622+0000 7f92dd7cf640 1 --2- 172.21.15.3:0/580325991 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f92c007af80 0x7f92c007d440 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f92d8075f80 tx=0x7f92cc005f90 comp rx=0 tx=0).stop 2024-09-21T12:27:37.624 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.622+0000 7f92dd7cf640 1 -- 172.21.15.3:0/580325991 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f92d8101900 msgr2=0x7f92d80744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:27:37.624 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.622+0000 7f92dd7cf640 1 --2- 172.21.15.3:0/580325991 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f92d8101900 0x7f92d80744f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f92c8031460 tx=0x7f92c8004530 comp rx=0 tx=0).stop 2024-09-21T12:27:37.624 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.622+0000 7f92dd7cf640 1 -- 172.21.15.3:0/580325991 shutdown_connections 2024-09-21T12:27:37.625 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.622+0000 7f92dd7cf640 1 --2- 172.21.15.3:0/580325991 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f92c007af80 0x7f92c007d440 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:37.625 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.622+0000 7f92dd7cf640 1 --2- 172.21.15.3:0/580325991 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f92d8107900 0x7f92d8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:37.625 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.622+0000 7f92dd7cf640 1 --2- 172.21.15.3:0/580325991 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f92d8101900 0x7f92d80744f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:27:37.625 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.622+0000 7f92dd7cf640 1 -- 172.21.15.3:0/580325991 >> 172.21.15.3:0/580325991 conn(0x7f92d80fd600 msgr2=0x7f92d80fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:27:37.625 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.623+0000 7f92dd7cf640 1 -- 172.21.15.3:0/580325991 shutdown_connections 2024-09-21T12:27:37.625 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:27:37.623+0000 7f92dd7cf640 1 -- 172.21.15.3:0/580325991 wait complete. 2024-09-21T12:27:38.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:37 smithi192 ceph-mon[80326]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:27:38.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:37 smithi192 ceph-mon[80326]: from='client.34232 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:27:38.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:37 smithi192 ceph-mon[80326]: pgmap v187: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:27:38.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:37 smithi192 ceph-mon[80326]: from='client.? 172.21.15.3:0/3751956635' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:27:38.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:37 smithi192 ceph-mon[80326]: from='client.? 172.21.15.3:0/580325991' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:27:38.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:37 smithi003 ceph-mon[108723]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:27:38.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:37 smithi003 ceph-mon[108723]: from='client.34232 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:27:38.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:37 smithi003 ceph-mon[108723]: pgmap v187: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:27:38.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:37 smithi003 ceph-mon[108723]: from='client.? 172.21.15.3:0/3751956635' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:27:38.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:37 smithi003 ceph-mon[108723]: from='client.? 172.21.15.3:0/580325991' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:27:38.691 INFO:journalctl@ceph.osd.3.smithi192.stdout:Sep 21 12:27:38 smithi192 systemd[1]: Stopping Ceph osd.3 for 641beec0-7812-11ef-baf6-efdc52797490... 2024-09-21T12:27:38.951 INFO:journalctl@ceph.osd.3.smithi192.stdout:Sep 21 12:27:38 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-3[41613]: 2024-09-21T12:27:38.710+0000 7fc1657ce640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T12:27:38.951 INFO:journalctl@ceph.osd.3.smithi192.stdout:Sep 21 12:27:38 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-3[41613]: 2024-09-21T12:27:38.710+0000 7fc1657ce640 -1 osd.3 63 *** Got signal Terminated *** 2024-09-21T12:27:38.951 INFO:journalctl@ceph.osd.3.smithi192.stdout:Sep 21 12:27:38 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-3[41613]: 2024-09-21T12:27:38.710+0000 7fc1657ce640 -1 osd.3 63 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T12:27:39.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:38 smithi192 ceph-mon[80326]: from='client.34244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:27:39.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:38 smithi192 ceph-mon[80326]: osd.3 marked itself down and dead 2024-09-21T12:27:39.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:38 smithi003 ceph-mon[108723]: from='client.34244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:27:39.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:38 smithi003 ceph-mon[108723]: osd.3 marked itself down and dead 2024-09-21T12:27:39.757 INFO:journalctl@ceph.osd.3.smithi192.stdout:Sep 21 12:27:39 smithi192 podman[87711]: 2024-09-21 12:27:39.443036177 +0000 UTC m=+0.847186770 container died 13efcfd71c057438ae15a20ee7347ec8bc79a09edc27ff3831b6ed85a4f1b2c1 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-3, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-4e45e6b, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T12:27:40.132 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:39 smithi192 ceph-mon[80326]: pgmap v188: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:27:40.132 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:39 smithi192 ceph-mon[80326]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T12:27:40.132 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:39 smithi192 ceph-mon[80326]: osdmap e64: 6 total, 5 up, 6 in 2024-09-21T12:27:40.132 INFO:journalctl@ceph.osd.3.smithi192.stdout:Sep 21 12:27:39 smithi192 podman[87711]: 2024-09-21 12:27:39.876985599 +0000 UTC m=+1.281136190 container cleanup 13efcfd71c057438ae15a20ee7347ec8bc79a09edc27ff3831b6ed85a4f1b2c1 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-4e45e6b, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-21T12:27:40.132 INFO:journalctl@ceph.osd.3.smithi192.stdout:Sep 21 12:27:39 smithi192 bash[87711]: ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-3 2024-09-21T12:27:40.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:39 smithi003 ceph-mon[108723]: pgmap v188: 65 pgs: 65 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:27:40.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:39 smithi003 ceph-mon[108723]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T12:27:40.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:39 smithi003 ceph-mon[108723]: osdmap e64: 6 total, 5 up, 6 in 2024-09-21T12:27:40.508 INFO:journalctl@ceph.osd.3.smithi192.stdout:Sep 21 12:27:40 smithi192 podman[87735]: 2024-09-21 12:27:40.131203988 +0000 UTC m=+0.682360348 container remove 13efcfd71c057438ae15a20ee7347ec8bc79a09edc27ff3831b6ed85a4f1b2c1 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-3, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=squid-4e45e6b, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-21T12:27:40.852 INFO:journalctl@ceph.osd.3.smithi192.stdout:Sep 21 12:27:40 smithi192 podman[87825]: 2024-09-21 12:27:40.441974541 +0000 UTC m=+0.016390066 image pull 8f4d013db793795fef09ff5edf96e6b42ba8cd2c9158b2f0b7a5d7c1e657c063 quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 2024-09-21T12:27:40.853 INFO:journalctl@ceph.osd.3.smithi192.stdout:Sep 21 12:27:40 smithi192 podman[87825]: 2024-09-21 12:27:40.557889932 +0000 UTC m=+0.132305443 container create 1de9738abe30ed21ba12df62b8a9084de27e62452d8a97f8e069de517224517f (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-3-deactivate, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T12:27:40.853 INFO:journalctl@ceph.osd.3.smithi192.stdout:Sep 21 12:27:40 smithi192 podman[87825]: 2024-09-21 12:27:40.768570441 +0000 UTC m=+0.342985952 container init 1de9738abe30ed21ba12df62b8a9084de27e62452d8a97f8e069de517224517f (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, io.buildah.version=1.37.2, ceph=True) 2024-09-21T12:27:40.853 INFO:journalctl@ceph.osd.3.smithi192.stdout:Sep 21 12:27:40 smithi192 podman[87825]: 2024-09-21 12:27:40.772341039 +0000 UTC m=+0.346756569 container start 1de9738abe30ed21ba12df62b8a9084de27e62452d8a97f8e069de517224517f (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-21T12:27:40.853 INFO:journalctl@ceph.osd.3.smithi192.stdout:Sep 21 12:27:40 smithi192 podman[87825]: 2024-09-21 12:27:40.851815436 +0000 UTC m=+0.426230973 container attach 1de9738abe30ed21ba12df62b8a9084de27e62452d8a97f8e069de517224517f (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-3-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True) 2024-09-21T12:27:41.255 INFO:journalctl@ceph.osd.3.smithi192.stdout:Sep 21 12:27:40 smithi192 podman[87825]: 2024-09-21 12:27:40.96512461 +0000 UTC m=+0.539540125 container died 1de9738abe30ed21ba12df62b8a9084de27e62452d8a97f8e069de517224517f (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-3-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-21T12:27:41.256 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:40 smithi192 ceph-mon[80326]: osdmap e65: 6 total, 5 up, 6 in 2024-09-21T12:27:41.256 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:40 smithi192 ceph-mon[80326]: pgmap v191: 65 pgs: 4 active+undersized, 27 peering, 1 stale+active+clean, 3 active+undersized+degraded, 30 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 9/279 objects degraded (3.226%) 2024-09-21T12:27:41.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:40 smithi003 ceph-mon[108723]: osdmap e65: 6 total, 5 up, 6 in 2024-09-21T12:27:41.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:40 smithi003 ceph-mon[108723]: pgmap v191: 65 pgs: 4 active+undersized, 27 peering, 1 stale+active+clean, 3 active+undersized+degraded, 30 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 9/279 objects degraded (3.226%) 2024-09-21T12:27:41.968 INFO:journalctl@ceph.osd.3.smithi192.stdout:Sep 21 12:27:41 smithi192 podman[87849]: 2024-09-21 12:27:41.548851069 +0000 UTC m=+0.574023875 container remove 1de9738abe30ed21ba12df62b8a9084de27e62452d8a97f8e069de517224517f (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-3-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T12:27:41.969 INFO:journalctl@ceph.osd.3.smithi192.stdout:Sep 21 12:27:41 smithi192 systemd[1]: ceph-641beec0-7812-11ef-baf6-efdc52797490@osd.3.service: Deactivated successfully. 2024-09-21T12:27:41.969 INFO:journalctl@ceph.osd.3.smithi192.stdout:Sep 21 12:27:41 smithi192 systemd[1]: Stopped Ceph osd.3 for 641beec0-7812-11ef-baf6-efdc52797490. 2024-09-21T12:27:41.969 INFO:journalctl@ceph.osd.3.smithi192.stdout:Sep 21 12:27:41 smithi192 systemd[1]: ceph-641beec0-7812-11ef-baf6-efdc52797490@osd.3.service: Consumed 1min 501ms CPU time. 2024-09-21T12:27:41.969 INFO:journalctl@ceph.osd.3.smithi192.stdout:Sep 21 12:27:41 smithi192 systemd[1]: Starting Ceph osd.3 for 641beec0-7812-11ef-baf6-efdc52797490... 2024-09-21T12:27:42.253 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:41 smithi192 ceph-mon[80326]: Health check failed: Reduced data availability: 12 pgs peering (PG_AVAILABILITY) 2024-09-21T12:27:42.253 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:41 smithi192 ceph-mon[80326]: Health check failed: Degraded data redundancy: 9/279 objects degraded (3.226%), 3 pgs degraded (PG_DEGRADED) 2024-09-21T12:27:42.253 INFO:journalctl@ceph.osd.3.smithi192.stdout:Sep 21 12:27:41 smithi192 podman[87950]: 2024-09-21 12:27:41.882472565 +0000 UTC m=+0.016275746 image pull 8f4d013db793795fef09ff5edf96e6b42ba8cd2c9158b2f0b7a5d7c1e657c063 quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 2024-09-21T12:27:42.253 INFO:journalctl@ceph.osd.3.smithi192.stdout:Sep 21 12:27:42 smithi192 podman[87950]: 2024-09-21 12:27:42.00826275 +0000 UTC m=+0.142065922 container create 2546285c9e378f947bc9f17f828dcdeae9153a1e7290e3982acc8da0ab7ba83f (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-3-activate, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-21T12:27:42.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:41 smithi003 ceph-mon[108723]: Health check failed: Reduced data availability: 12 pgs peering (PG_AVAILABILITY) 2024-09-21T12:27:42.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:41 smithi003 ceph-mon[108723]: Health check failed: Degraded data redundancy: 9/279 objects degraded (3.226%), 3 pgs degraded (PG_DEGRADED) 2024-09-21T12:27:42.508 INFO:journalctl@ceph.osd.3.smithi192.stdout:Sep 21 12:27:42 smithi192 podman[87950]: 2024-09-21 12:27:42.252244479 +0000 UTC m=+0.386047655 container init 2546285c9e378f947bc9f17f828dcdeae9153a1e7290e3982acc8da0ab7ba83f (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-3-activate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T12:27:42.508 INFO:journalctl@ceph.osd.3.smithi192.stdout:Sep 21 12:27:42 smithi192 podman[87950]: 2024-09-21 12:27:42.255949523 +0000 UTC m=+0.389752695 container start 2546285c9e378f947bc9f17f828dcdeae9153a1e7290e3982acc8da0ab7ba83f (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-3-activate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0) 2024-09-21T12:27:42.508 INFO:journalctl@ceph.osd.3.smithi192.stdout:Sep 21 12:27:42 smithi192 podman[87950]: 2024-09-21 12:27:42.344149414 +0000 UTC m=+0.477952596 container attach 2546285c9e378f947bc9f17f828dcdeae9153a1e7290e3982acc8da0ab7ba83f (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-3-activate, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-21T12:27:42.508 INFO:journalctl@ceph.osd.3.smithi192.stdout:Sep 21 12:27:42 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-3-activate[87965]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:27:42.508 INFO:journalctl@ceph.osd.3.smithi192.stdout:Sep 21 12:27:42 smithi192 bash[87950]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:27:42.508 INFO:journalctl@ceph.osd.3.smithi192.stdout:Sep 21 12:27:42 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-3-activate[87965]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:27:42.508 INFO:journalctl@ceph.osd.3.smithi192.stdout:Sep 21 12:27:42 smithi192 bash[87950]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:27:43.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:42 smithi192 ceph-mon[80326]: pgmap v192: 65 pgs: 6 active+undersized, 27 peering, 5 active+undersized+degraded, 27 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 13/279 objects degraded (4.659%) 2024-09-21T12:27:43.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:42 smithi003 ceph-mon[108723]: pgmap v192: 65 pgs: 6 active+undersized, 27 peering, 5 active+undersized+degraded, 27 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 13/279 objects degraded (4.659%) 2024-09-21T12:27:45.650 INFO:journalctl@ceph.osd.3.smithi192.stdout:Sep 21 12:27:45 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-3-activate[87965]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-09-21T12:27:45.650 INFO:journalctl@ceph.osd.3.smithi192.stdout:Sep 21 12:27:45 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-3-activate[87965]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:27:45.650 INFO:journalctl@ceph.osd.3.smithi192.stdout:Sep 21 12:27:45 smithi192 bash[87950]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-09-21T12:27:45.650 INFO:journalctl@ceph.osd.3.smithi192.stdout:Sep 21 12:27:45 smithi192 bash[87950]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:27:45.650 INFO:journalctl@ceph.osd.3.smithi192.stdout:Sep 21 12:27:45 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-3-activate[87965]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:27:45.651 INFO:journalctl@ceph.osd.3.smithi192.stdout:Sep 21 12:27:45 smithi192 bash[87950]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:27:45.651 INFO:journalctl@ceph.osd.3.smithi192.stdout:Sep 21 12:27:45 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-3-activate[87965]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-21T12:27:45.651 INFO:journalctl@ceph.osd.3.smithi192.stdout:Sep 21 12:27:45 smithi192 bash[87950]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-21T12:27:45.651 INFO:journalctl@ceph.osd.3.smithi192.stdout:Sep 21 12:27:45 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-3-activate[87965]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-3 --no-mon-config 2024-09-21T12:27:45.651 INFO:journalctl@ceph.osd.3.smithi192.stdout:Sep 21 12:27:45 smithi192 bash[87950]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_4 --path /var/lib/ceph/osd/ceph-3 --no-mon-config 2024-09-21T12:27:45.651 INFO:journalctl@ceph.osd.3.smithi192.stdout:Sep 21 12:27:45 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-3-activate[87965]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3/block 2024-09-21T12:27:45.651 INFO:journalctl@ceph.osd.3.smithi192.stdout:Sep 21 12:27:45 smithi192 bash[87950]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3/block 2024-09-21T12:27:45.974 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:45 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:27:45.974 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:45 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:27:45.974 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:45 smithi192 ceph-mon[80326]: pgmap v193: 65 pgs: 16 active+undersized, 9 peering, 13 active+undersized+degraded, 27 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 45/279 objects degraded (16.129%) 2024-09-21T12:27:45.974 INFO:journalctl@ceph.osd.3.smithi192.stdout:Sep 21 12:27:45 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-3-activate[87965]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-3/block 2024-09-21T12:27:45.974 INFO:journalctl@ceph.osd.3.smithi192.stdout:Sep 21 12:27:45 smithi192 bash[87950]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-3/block 2024-09-21T12:27:45.974 INFO:journalctl@ceph.osd.3.smithi192.stdout:Sep 21 12:27:45 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-3-activate[87965]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-21T12:27:45.974 INFO:journalctl@ceph.osd.3.smithi192.stdout:Sep 21 12:27:45 smithi192 bash[87950]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-21T12:27:45.975 INFO:journalctl@ceph.osd.3.smithi192.stdout:Sep 21 12:27:45 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-3-activate[87965]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-21T12:27:45.975 INFO:journalctl@ceph.osd.3.smithi192.stdout:Sep 21 12:27:45 smithi192 bash[87950]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-21T12:27:45.975 INFO:journalctl@ceph.osd.3.smithi192.stdout:Sep 21 12:27:45 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-3-activate[87965]: --> ceph-volume lvm activate successful for osd ID: 3 2024-09-21T12:27:45.975 INFO:journalctl@ceph.osd.3.smithi192.stdout:Sep 21 12:27:45 smithi192 bash[87950]: --> ceph-volume lvm activate successful for osd ID: 3 2024-09-21T12:27:45.975 INFO:journalctl@ceph.osd.3.smithi192.stdout:Sep 21 12:27:45 smithi192 podman[87950]: 2024-09-21 12:27:45.677926199 +0000 UTC m=+3.811729378 container died 2546285c9e378f947bc9f17f828dcdeae9153a1e7290e3982acc8da0ab7ba83f (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-3-activate, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-21T12:27:46.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:45 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:27:46.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:45 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:27:46.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:45 smithi003 ceph-mon[108723]: pgmap v193: 65 pgs: 16 active+undersized, 9 peering, 13 active+undersized+degraded, 27 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 45/279 objects degraded (16.129%) 2024-09-21T12:27:46.664 INFO:journalctl@ceph.osd.3.smithi192.stdout:Sep 21 12:27:46 smithi192 podman[88173]: 2024-09-21 12:27:46.340081541 +0000 UTC m=+0.655534548 container remove 2546285c9e378f947bc9f17f828dcdeae9153a1e7290e3982acc8da0ab7ba83f (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-3-activate, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-21T12:27:46.665 INFO:journalctl@ceph.osd.3.smithi192.stdout:Sep 21 12:27:46 smithi192 podman[88234]: 2024-09-21 12:27:46.453092631 +0000 UTC m=+0.015693160 image pull 8f4d013db793795fef09ff5edf96e6b42ba8cd2c9158b2f0b7a5d7c1e657c063 quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 2024-09-21T12:27:46.665 INFO:journalctl@ceph.osd.3.smithi192.stdout:Sep 21 12:27:46 smithi192 podman[88234]: 2024-09-21 12:27:46.550981596 +0000 UTC m=+0.113582116 container create 1b5fae2f2dd9a6890b335f3a54d25c770a77b2fac0a58e5cf698f2de43787c50 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-3, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-21T12:27:46.975 INFO:journalctl@ceph.osd.3.smithi192.stdout:Sep 21 12:27:46 smithi192 podman[88234]: 2024-09-21 12:27:46.795091673 +0000 UTC m=+0.357692201 container init 1b5fae2f2dd9a6890b335f3a54d25c770a77b2fac0a58e5cf698f2de43787c50 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-3, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=) 2024-09-21T12:27:46.975 INFO:journalctl@ceph.osd.3.smithi192.stdout:Sep 21 12:27:46 smithi192 podman[88234]: 2024-09-21 12:27:46.79874391 +0000 UTC m=+0.361344431 container start 1b5fae2f2dd9a6890b335f3a54d25c770a77b2fac0a58e5cf698f2de43787c50 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-3, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-21T12:27:46.975 INFO:journalctl@ceph.osd.3.smithi192.stdout:Sep 21 12:27:46 smithi192 ceph-osd[88253]: -- 172.21.15.192:0/1132950192 <== mon.1 v2:172.21.15.192:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5577b5efe1e0 con 0x5577b5e8e000 2024-09-21T12:27:46.975 INFO:journalctl@ceph.osd.3.smithi192.stdout:Sep 21 12:27:46 smithi192 bash[88234]: 1b5fae2f2dd9a6890b335f3a54d25c770a77b2fac0a58e5cf698f2de43787c50 2024-09-21T12:27:46.975 INFO:journalctl@ceph.osd.3.smithi192.stdout:Sep 21 12:27:46 smithi192 systemd[1]: Started Ceph osd.3 for 641beec0-7812-11ef-baf6-efdc52797490. 2024-09-21T12:27:47.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:46 smithi192 ceph-mon[80326]: pgmap v194: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 62/279 objects degraded (22.222%) 2024-09-21T12:27:47.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:46 smithi192 ceph-mon[80326]: Health check update: Degraded data redundancy: 62/279 objects degraded (22.222%), 18 pgs degraded (PG_DEGRADED) 2024-09-21T12:27:47.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:46 smithi192 ceph-mon[80326]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-09-21T12:27:47.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:46 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:27:47.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:46 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:27:47.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:46 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:27:47.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:46 smithi003 ceph-mon[108723]: pgmap v194: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 62/279 objects degraded (22.222%) 2024-09-21T12:27:47.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:46 smithi003 ceph-mon[108723]: Health check update: Degraded data redundancy: 62/279 objects degraded (22.222%), 18 pgs degraded (PG_DEGRADED) 2024-09-21T12:27:47.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:46 smithi003 ceph-mon[108723]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-09-21T12:27:47.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:46 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:27:47.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:46 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:27:47.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:46 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:27:48.507 INFO:journalctl@ceph.osd.3.smithi192.stdout:Sep 21 12:27:48 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-3[88249]: 2024-09-21T12:27:48.421+0000 7f1fc5162640 -1 Falling back to public interface 2024-09-21T12:27:50.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:49 smithi192 ceph-mon[80326]: pgmap v195: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 62/279 objects degraded (22.222%) 2024-09-21T12:27:50.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:49 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:27:50.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:49 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:27:50.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:49 smithi003 ceph-mon[108723]: pgmap v195: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 62/279 objects degraded (22.222%) 2024-09-21T12:27:50.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:49 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:27:50.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:49 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:27:51.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:51 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:27:51.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:51 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:27:51.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:51 smithi003 ceph-mon[108723]: pgmap v196: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 62/279 objects degraded (22.222%) 2024-09-21T12:27:51.626 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:51 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:27:51.626 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:51 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:27:51.626 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:51 smithi192 ceph-mon[80326]: pgmap v196: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 62/279 objects degraded (22.222%) 2024-09-21T12:27:54.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:53 smithi192 ceph-mon[80326]: pgmap v197: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 62/279 objects degraded (22.222%) 2024-09-21T12:27:54.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:53 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:27:54.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:53 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:27:54.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:53 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:27:54.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:53 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:27:54.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:53 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:27:54.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:53 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:27:54.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:53 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:27:54.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:53 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:27:54.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:53 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:27:54.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:53 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-21T12:27:54.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:53 smithi003 ceph-mon[108723]: pgmap v197: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 62/279 objects degraded (22.222%) 2024-09-21T12:27:54.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:53 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:27:54.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:53 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:27:54.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:53 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:27:54.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:53 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:27:54.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:53 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:27:54.331 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:53 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:27:54.331 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:53 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:27:54.331 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:53 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:27:54.331 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:53 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:27:54.331 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:53 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-21T12:27:54.757 INFO:journalctl@ceph.osd.3.smithi192.stdout:Sep 21 12:27:54 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-3[88249]: 2024-09-21T12:27:54.374+0000 7f1fc5162640 -1 osd.3 63 log_to_monitors true 2024-09-21T12:27:55.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:54 smithi192 ceph-mon[80326]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-21T12:27:55.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:54 smithi192 ceph-mon[80326]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-09-21T12:27:55.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:54 smithi192 ceph-mon[80326]: from='osd.3 [v2:172.21.15.192:6800/121626729,v1:172.21.15.192:6801/121626729]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T12:27:55.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:54 smithi192 ceph-mon[80326]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T12:27:55.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:54 smithi003 ceph-mon[108723]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-21T12:27:55.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:54 smithi003 ceph-mon[108723]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-09-21T12:27:55.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:54 smithi003 ceph-mon[108723]: from='osd.3 [v2:172.21.15.192:6800/121626729,v1:172.21.15.192:6801/121626729]' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T12:27:55.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:54 smithi003 ceph-mon[108723]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]} : dispatch 2024-09-21T12:27:56.257 INFO:journalctl@ceph.osd.3.smithi192.stdout:Sep 21 12:27:55 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-3[88249]: 2024-09-21T12:27:55.857+0000 7f1fb8f04640 -1 osd.3 63 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T12:27:56.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:55 smithi192 ceph-mon[80326]: pgmap v198: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 62/279 objects degraded (22.222%) 2024-09-21T12:27:56.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:55 smithi192 ceph-mon[80326]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T12:27:56.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:55 smithi192 ceph-mon[80326]: from='osd.3 [v2:172.21.15.192:6800/121626729,v1:172.21.15.192:6801/121626729]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi192", "root=default"]} : dispatch 2024-09-21T12:27:56.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:55 smithi192 ceph-mon[80326]: osdmap e66: 6 total, 5 up, 6 in 2024-09-21T12:27:56.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:55 smithi192 ceph-mon[80326]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi192", "root=default"]} : dispatch 2024-09-21T12:27:56.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:55 smithi192 ceph-mon[80326]: from='osd.3 ' entity='osd.3' 2024-09-21T12:27:56.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:55 smithi003 ceph-mon[108723]: pgmap v198: 65 pgs: 20 active+undersized, 18 active+undersized+degraded, 27 active+clean; 276 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 62/279 objects degraded (22.222%) 2024-09-21T12:27:56.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:55 smithi003 ceph-mon[108723]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-21T12:27:56.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:55 smithi003 ceph-mon[108723]: from='osd.3 [v2:172.21.15.192:6800/121626729,v1:172.21.15.192:6801/121626729]' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi192", "root=default"]} : dispatch 2024-09-21T12:27:56.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:55 smithi003 ceph-mon[108723]: osdmap e66: 6 total, 5 up, 6 in 2024-09-21T12:27:56.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:55 smithi003 ceph-mon[108723]: from='osd.3 ' entity='osd.3' cmd={"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi192", "root=default"]} : dispatch 2024-09-21T12:27:56.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:55 smithi003 ceph-mon[108723]: from='osd.3 ' entity='osd.3' 2024-09-21T12:27:57.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:56 smithi192 ceph-mon[80326]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T12:27:57.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:56 smithi192 ceph-mon[80326]: osd.3 [v2:172.21.15.192:6800/121626729,v1:172.21.15.192:6801/121626729] boot 2024-09-21T12:27:57.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:56 smithi192 ceph-mon[80326]: osdmap e67: 6 total, 6 up, 6 in 2024-09-21T12:27:57.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:56 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T12:27:57.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:56 smithi003 ceph-mon[108723]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T12:27:57.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:56 smithi003 ceph-mon[108723]: osd.3 [v2:172.21.15.192:6800/121626729,v1:172.21.15.192:6801/121626729] boot 2024-09-21T12:27:57.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:56 smithi003 ceph-mon[108723]: osdmap e67: 6 total, 6 up, 6 in 2024-09-21T12:27:57.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:56 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd metadata", "id": 3} : dispatch 2024-09-21T12:27:58.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:57 smithi192 ceph-mon[80326]: pgmap v201: 65 pgs: 3 peering, 19 active+undersized, 16 active+undersized+degraded, 27 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 58/279 objects degraded (20.789%) 2024-09-21T12:27:58.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:57 smithi192 ceph-mon[80326]: Health check update: Degraded data redundancy: 58/279 objects degraded (20.789%), 16 pgs degraded (PG_DEGRADED) 2024-09-21T12:27:58.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:57 smithi192 ceph-mon[80326]: osdmap e68: 6 total, 6 up, 6 in 2024-09-21T12:27:58.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:57 smithi003 ceph-mon[108723]: pgmap v201: 65 pgs: 3 peering, 19 active+undersized, 16 active+undersized+degraded, 27 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 58/279 objects degraded (20.789%) 2024-09-21T12:27:58.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:57 smithi003 ceph-mon[108723]: Health check update: Degraded data redundancy: 58/279 objects degraded (20.789%), 16 pgs degraded (PG_DEGRADED) 2024-09-21T12:27:58.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:57 smithi003 ceph-mon[108723]: osdmap e68: 6 total, 6 up, 6 in 2024-09-21T12:28:00.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:59 smithi192 ceph-mon[80326]: pgmap v203: 65 pgs: 3 peering, 19 active+undersized, 16 active+undersized+degraded, 27 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 58/279 objects degraded (20.789%) 2024-09-21T12:28:00.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:59 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:28:00.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:27:59 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:28:00.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:59 smithi003 ceph-mon[108723]: pgmap v203: 65 pgs: 3 peering, 19 active+undersized, 16 active+undersized+degraded, 27 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 58/279 objects degraded (20.789%) 2024-09-21T12:28:00.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:59 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:28:00.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:27:59 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:28:01.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:00 smithi192 ceph-mon[80326]: pgmap v204: 65 pgs: 3 peering, 62 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:28:01.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:00 smithi192 ceph-mon[80326]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 58/279 objects degraded (20.789%), 16 pgs degraded) 2024-09-21T12:28:01.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:00 smithi003 ceph-mon[108723]: pgmap v204: 65 pgs: 3 peering, 62 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:28:01.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:00 smithi003 ceph-mon[108723]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 58/279 objects degraded (20.789%), 16 pgs degraded) 2024-09-21T12:28:04.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:03 smithi192 ceph-mon[80326]: pgmap v205: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:28:04.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:03 smithi003 ceph-mon[108723]: pgmap v205: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:28:06.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:05 smithi192 ceph-mon[80326]: pgmap v206: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:28:06.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:05 smithi003 ceph-mon[108723]: pgmap v206: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:28:07.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:07.720+0000 7fa94a720640 1 -- 172.21.15.3:0/3104427417 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa9441033e0 msgr2=0x7fa94410b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:28:07.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:07.721+0000 7fa94a720640 1 --2- 172.21.15.3:0/3104427417 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa9441033e0 0x7fa94410b8d0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa938009880 tx=0x7fa93802a530 comp rx=0 tx=0).stop 2024-09-21T12:28:07.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:07.721+0000 7fa94a720640 1 -- 172.21.15.3:0/3104427417 shutdown_connections 2024-09-21T12:28:07.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:07.721+0000 7fa94a720640 1 --2- 172.21.15.3:0/3104427417 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa9441033e0 0x7fa94410b8d0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:07.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:07.721+0000 7fa94a720640 1 --2- 172.21.15.3:0/3104427417 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa944102ac0 0x7fa944102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:07.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:07.721+0000 7fa94a720640 1 -- 172.21.15.3:0/3104427417 >> 172.21.15.3:0/3104427417 conn(0x7fa9440fc520 msgr2=0x7fa9440fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:28:07.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:07.721+0000 7fa94a720640 1 -- 172.21.15.3:0/3104427417 shutdown_connections 2024-09-21T12:28:07.726 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:07.721+0000 7fa94a720640 1 -- 172.21.15.3:0/3104427417 wait complete. 2024-09-21T12:28:07.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:07.721+0000 7fa94a720640 1 Processor -- start 2024-09-21T12:28:07.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:07.721+0000 7fa94a720640 1 -- start start 2024-09-21T12:28:07.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:07.722+0000 7fa94a720640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa944102ac0 0x7fa94419f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:28:07.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:07.722+0000 7fa94a720640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa9441033e0 0x7fa94419fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:28:07.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:07.722+0000 7fa94a720640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fa94410edd0 con 0x7fa9441033e0 2024-09-21T12:28:07.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:07.722+0000 7fa94a720640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa94410ec50 con 0x7fa944102ac0 2024-09-21T12:28:07.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:07.722+0000 7fa9437fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa9441033e0 0x7fa94419fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:28:07.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:07.722+0000 7fa9437fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa9441033e0 0x7fa94419fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41678/0 (socket says 172.21.15.3:41678) 2024-09-21T12:28:07.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:07.722+0000 7fa9437fe640 1 -- 172.21.15.3:0/2833175046 learned_addr learned my addr 172.21.15.3:0/2833175046 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:28:07.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:07.722+0000 7fa943fff640 1 --2- 172.21.15.3:0/2833175046 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa944102ac0 0x7fa94419f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:28:07.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:07.722+0000 7fa9437fe640 1 -- 172.21.15.3:0/2833175046 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa944102ac0 msgr2=0x7fa94419f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:28:07.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:07.722+0000 7fa9437fe640 1 --2- 172.21.15.3:0/2833175046 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa944102ac0 0x7fa94419f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:07.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:07.722+0000 7fa9437fe640 1 -- 172.21.15.3:0/2833175046 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9441999b0 con 0x7fa9441033e0 2024-09-21T12:28:07.728 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:07.723+0000 7fa9437fe640 1 --2- 172.21.15.3:0/2833175046 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa9441033e0 0x7fa94419fd30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa938031460 tx=0x7fa938004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:28:07.729 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:07.723+0000 7fa9417fa640 1 -- 172.21.15.3:0/2833175046 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa93803f070 con 0x7fa9441033e0 2024-09-21T12:28:07.729 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:07.723+0000 7fa9417fa640 1 -- 172.21.15.3:0/2833175046 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa9380035f0 con 0x7fa9441033e0 2024-09-21T12:28:07.729 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:07.723+0000 7fa94a720640 1 -- 172.21.15.3:0/2833175046 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa944199c40 con 0x7fa9441033e0 2024-09-21T12:28:07.729 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:07.723+0000 7fa9417fa640 1 -- 172.21.15.3:0/2833175046 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa938035030 con 0x7fa9441033e0 2024-09-21T12:28:07.729 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:07.723+0000 7fa94a720640 1 -- 172.21.15.3:0/2833175046 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa94419a170 con 0x7fa9441033e0 2024-09-21T12:28:07.730 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:07.724+0000 7fa94a720640 1 -- 172.21.15.3:0/2833175046 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa94406aa90 con 0x7fa9441033e0 2024-09-21T12:28:07.730 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:07.725+0000 7fa9417fa640 1 -- 172.21.15.3:0/2833175046 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7fa938042070 con 0x7fa9441033e0 2024-09-21T12:28:07.730 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:07.725+0000 7fa9417fa640 1 --2- 172.21.15.3:0/2833175046 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fa92c07af30 0x7fa92c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:28:07.731 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:07.726+0000 7fa9417fa640 1 -- 172.21.15.3:0/2833175046 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6156+0+0 (secure 0 0 0) 0x7fa9380be9a0 con 0x7fa9441033e0 2024-09-21T12:28:07.731 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:07.726+0000 7fa943fff640 1 --2- 172.21.15.3:0/2833175046 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fa92c07af30 0x7fa92c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:28:07.731 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:07.726+0000 7fa943fff640 1 --2- 172.21.15.3:0/2833175046 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fa92c07af30 0x7fa92c07d3f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa94419aaf0 tx=0x7fa93400b390 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:28:07.731 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:07.730+0000 7fa9417fa640 1 -- 172.21.15.3:0/2833175046 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa938089f00 con 0x7fa9441033e0 2024-09-21T12:28:07.938 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:07.936+0000 7fa94a720640 1 -- 172.21.15.3:0/2833175046 --> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fa94410b3e0 con 0x7fa92c07af30 2024-09-21T12:28:07.939 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:07.938+0000 7fa9417fa640 1 -- 172.21.15.3:0/2833175046 <== mgr.14756 v2:172.21.15.3:6800/1284098095 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7fa934010be0 con 0x7fa92c07af30 2024-09-21T12:28:07.941 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:07.940+0000 7fa94a720640 1 -- 172.21.15.3:0/2833175046 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fa92c07af30 msgr2=0x7fa92c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:28:07.941 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:07.940+0000 7fa94a720640 1 --2- 172.21.15.3:0/2833175046 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fa92c07af30 0x7fa92c07d3f0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa94419aaf0 tx=0x7fa93400b390 comp rx=0 tx=0).stop 2024-09-21T12:28:07.942 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:07.940+0000 7fa94a720640 1 -- 172.21.15.3:0/2833175046 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa9441033e0 msgr2=0x7fa94419fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:28:07.942 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:07.940+0000 7fa94a720640 1 --2- 172.21.15.3:0/2833175046 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa9441033e0 0x7fa94419fd30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fa938031460 tx=0x7fa938004530 comp rx=0 tx=0).stop 2024-09-21T12:28:07.942 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:07.940+0000 7fa94a720640 1 -- 172.21.15.3:0/2833175046 shutdown_connections 2024-09-21T12:28:07.942 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:07.940+0000 7fa94a720640 1 --2- 172.21.15.3:0/2833175046 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fa92c07af30 0x7fa92c07d3f0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:07.942 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:07.940+0000 7fa94a720640 1 --2- 172.21.15.3:0/2833175046 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa9441033e0 0x7fa94419fd30 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:07.942 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:07.940+0000 7fa94a720640 1 --2- 172.21.15.3:0/2833175046 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa944102ac0 0x7fa94419f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:07.942 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:07.940+0000 7fa94a720640 1 -- 172.21.15.3:0/2833175046 >> 172.21.15.3:0/2833175046 conn(0x7fa9440fc520 msgr2=0x7fa944100b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:28:07.942 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:07.940+0000 7fa94a720640 1 -- 172.21.15.3:0/2833175046 shutdown_connections 2024-09-21T12:28:07.942 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:07.940+0000 7fa94a720640 1 -- 172.21.15.3:0/2833175046 wait complete. 2024-09-21T12:28:07.951 INFO:teuthology.orchestra.run.smithi003.stdout:true 2024-09-21T12:28:08.027 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.025+0000 7f572913c640 1 -- 172.21.15.3:0/3967701916 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f57241067f0 msgr2=0x7f5724106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:28:08.027 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.025+0000 7f572913c640 1 --2- 172.21.15.3:0/3967701916 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f57241067f0 0x7f5724106bd0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5714009880 tx=0x7f571402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:28:08.027 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:07 smithi003 ceph-mon[108723]: pgmap v207: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:28:08.029 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.025+0000 7f572913c640 1 -- 172.21.15.3:0/3967701916 shutdown_connections 2024-09-21T12:28:08.029 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.025+0000 7f572913c640 1 --2- 172.21.15.3:0/3967701916 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f57241007f0 0x7f5724100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:08.029 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.025+0000 7f572913c640 1 --2- 172.21.15.3:0/3967701916 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f57241067f0 0x7f5724106bd0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:08.029 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.025+0000 7f572913c640 1 -- 172.21.15.3:0/3967701916 >> 172.21.15.3:0/3967701916 conn(0x7f57240fc550 msgr2=0x7f57240fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:28:08.029 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.026+0000 7f572913c640 1 -- 172.21.15.3:0/3967701916 shutdown_connections 2024-09-21T12:28:08.029 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.026+0000 7f572913c640 1 -- 172.21.15.3:0/3967701916 wait complete. 2024-09-21T12:28:08.029 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.026+0000 7f572913c640 1 Processor -- start 2024-09-21T12:28:08.029 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.027+0000 7f572913c640 1 -- start start 2024-09-21T12:28:08.029 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.027+0000 7f572913c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f57241007f0 0x7f572419d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:28:08.029 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.027+0000 7f572913c640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f57241067f0 0x7f572419db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:28:08.029 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.027+0000 7f572913c640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f572410dca0 con 0x7f57241007f0 2024-09-21T12:28:08.029 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.027+0000 7f572913c640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f572410db20 con 0x7f57241067f0 2024-09-21T12:28:08.030 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.027+0000 7f5722d9d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f57241007f0 0x7f572419d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:28:08.030 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.027+0000 7f5722d9d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f57241007f0 0x7f572419d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41694/0 (socket says 172.21.15.3:41694) 2024-09-21T12:28:08.030 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.027+0000 7f5722d9d640 1 -- 172.21.15.3:0/743490400 learned_addr learned my addr 172.21.15.3:0/743490400 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:28:08.030 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.027+0000 7f571bfff640 1 --2- 172.21.15.3:0/743490400 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f57241067f0 0x7f572419db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:28:08.030 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.027+0000 7f5722d9d640 1 -- 172.21.15.3:0/743490400 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f57241067f0 msgr2=0x7f572419db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:28:08.030 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.027+0000 7f5722d9d640 1 --2- 172.21.15.3:0/743490400 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f57241067f0 0x7f572419db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:08.030 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.027+0000 7f5722d9d640 1 -- 172.21.15.3:0/743490400 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5724197790 con 0x7f57241007f0 2024-09-21T12:28:08.031 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.028+0000 7f5722d9d640 1 --2- 172.21.15.3:0/743490400 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f57241007f0 0x7f572419d610 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5714031460 tx=0x7f57140045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:28:08.031 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.028+0000 7f5720d99640 1 -- 172.21.15.3:0/743490400 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f571403f070 con 0x7f57241007f0 2024-09-21T12:28:08.031 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.028+0000 7f572913c640 1 -- 172.21.15.3:0/743490400 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5724197a20 con 0x7f57241007f0 2024-09-21T12:28:08.031 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.028+0000 7f5720d99640 1 -- 172.21.15.3:0/743490400 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f57140035f0 con 0x7f57241007f0 2024-09-21T12:28:08.031 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.028+0000 7f5720d99640 1 -- 172.21.15.3:0/743490400 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5714035030 con 0x7f57241007f0 2024-09-21T12:28:08.031 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.028+0000 7f572913c640 1 -- 172.21.15.3:0/743490400 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5724197f50 con 0x7f57241007f0 2024-09-21T12:28:08.031 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.029+0000 7f572913c640 1 -- 172.21.15.3:0/743490400 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5724101f30 con 0x7f57241007f0 2024-09-21T12:28:08.031 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.030+0000 7f5720d99640 1 -- 172.21.15.3:0/743490400 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f5714042070 con 0x7f57241007f0 2024-09-21T12:28:08.032 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.030+0000 7f5720d99640 1 --2- 172.21.15.3:0/743490400 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f571007af30 0x7f571007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:28:08.032 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.030+0000 7f5720d99640 1 -- 172.21.15.3:0/743490400 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6156+0+0 (secure 0 0 0) 0x7f57140be970 con 0x7f57241007f0 2024-09-21T12:28:08.032 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.030+0000 7f571bfff640 1 --2- 172.21.15.3:0/743490400 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f571007af30 0x7f571007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:28:08.032 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.031+0000 7f571bfff640 1 --2- 172.21.15.3:0/743490400 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f571007af30 0x7f571007d3f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f57240ffb10 tx=0x7f570c00b390 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:28:08.036 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.035+0000 7f5720d99640 1 -- 172.21.15.3:0/743490400 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f57140c0e20 con 0x7f57241007f0 2024-09-21T12:28:08.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.237+0000 7f572913c640 1 -- 172.21.15.3:0/743490400 --> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f57241982c0 con 0x7f571007af30 2024-09-21T12:28:08.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.238+0000 7f5720d99640 1 -- 172.21.15.3:0/743490400 <== mgr.14756 v2:172.21.15.3:6800/1284098095 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7f57241982c0 con 0x7f571007af30 2024-09-21T12:28:08.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.241+0000 7f572913c640 1 -- 172.21.15.3:0/743490400 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f571007af30 msgr2=0x7f571007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:28:08.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.241+0000 7f572913c640 1 --2- 172.21.15.3:0/743490400 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f571007af30 0x7f571007d3f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f57240ffb10 tx=0x7f570c00b390 comp rx=0 tx=0).stop 2024-09-21T12:28:08.242 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.241+0000 7f572913c640 1 -- 172.21.15.3:0/743490400 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f57241007f0 msgr2=0x7f572419d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:28:08.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.241+0000 7f572913c640 1 --2- 172.21.15.3:0/743490400 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f57241007f0 0x7f572419d610 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5714031460 tx=0x7f57140045e0 comp rx=0 tx=0).stop 2024-09-21T12:28:08.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.241+0000 7f572913c640 1 -- 172.21.15.3:0/743490400 shutdown_connections 2024-09-21T12:28:08.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.241+0000 7f572913c640 1 --2- 172.21.15.3:0/743490400 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f571007af30 0x7f571007d3f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:08.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.241+0000 7f572913c640 1 --2- 172.21.15.3:0/743490400 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f57241067f0 0x7f572419db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:08.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.241+0000 7f572913c640 1 --2- 172.21.15.3:0/743490400 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f57241007f0 0x7f572419d610 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:08.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.241+0000 7f572913c640 1 -- 172.21.15.3:0/743490400 >> 172.21.15.3:0/743490400 conn(0x7f57240fc550 msgr2=0x7f5724069ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:28:08.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.241+0000 7f572913c640 1 -- 172.21.15.3:0/743490400 shutdown_connections 2024-09-21T12:28:08.243 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.241+0000 7f572913c640 1 -- 172.21.15.3:0/743490400 wait complete. 2024-09-21T12:28:08.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:07 smithi192 ceph-mon[80326]: pgmap v207: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:28:08.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.325+0000 7f975a5d9640 1 -- 172.21.15.3:0/1566029794 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9754107900 msgr2=0x7f9754107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:28:08.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.325+0000 7f975a5d9640 1 --2- 172.21.15.3:0/1566029794 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9754107900 0x7f9754107ce0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9744009880 tx=0x7f974402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:28:08.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.325+0000 7f975a5d9640 1 -- 172.21.15.3:0/1566029794 shutdown_connections 2024-09-21T12:28:08.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.325+0000 7f975a5d9640 1 --2- 172.21.15.3:0/1566029794 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9754101900 0x7f9754101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:08.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.325+0000 7f975a5d9640 1 --2- 172.21.15.3:0/1566029794 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9754107900 0x7f9754107ce0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:08.327 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.325+0000 7f975a5d9640 1 -- 172.21.15.3:0/1566029794 >> 172.21.15.3:0/1566029794 conn(0x7f97540fd600 msgr2=0x7f97540ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:28:08.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.325+0000 7f975a5d9640 1 -- 172.21.15.3:0/1566029794 shutdown_connections 2024-09-21T12:28:08.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.326+0000 7f975a5d9640 1 -- 172.21.15.3:0/1566029794 wait complete. 2024-09-21T12:28:08.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.326+0000 7f975a5d9640 1 Processor -- start 2024-09-21T12:28:08.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.326+0000 7f975a5d9640 1 -- start start 2024-09-21T12:28:08.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.327+0000 7f975a5d9640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9754101900 0x7f975419d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:28:08.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.327+0000 7f975a5d9640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9754107900 0x7f975419db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:28:08.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.327+0000 7f975a5d9640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f975410edb0 con 0x7f9754101900 2024-09-21T12:28:08.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.327+0000 7f975a5d9640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f975410ec30 con 0x7f9754107900 2024-09-21T12:28:08.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.327+0000 7f9753fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9754101900 0x7f975419d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:28:08.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.327+0000 7f9753fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9754101900 0x7f975419d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41710/0 (socket says 172.21.15.3:41710) 2024-09-21T12:28:08.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.327+0000 7f9753fff640 1 -- 172.21.15.3:0/3331135555 learned_addr learned my addr 172.21.15.3:0/3331135555 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:28:08.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.327+0000 7f97537fe640 1 --2- 172.21.15.3:0/3331135555 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9754107900 0x7f975419db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:28:08.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.327+0000 7f9753fff640 1 -- 172.21.15.3:0/3331135555 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9754107900 msgr2=0x7f975419db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:28:08.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.327+0000 7f9753fff640 1 --2- 172.21.15.3:0/3331135555 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9754107900 0x7f975419db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:08.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.327+0000 7f9753fff640 1 -- 172.21.15.3:0/3331135555 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97541977c0 con 0x7f9754101900 2024-09-21T12:28:08.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.327+0000 7f9753fff640 1 --2- 172.21.15.3:0/3331135555 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9754101900 0x7f975419d640 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9744031460 tx=0x7f97440045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:28:08.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.327+0000 7f97517fa640 1 -- 172.21.15.3:0/3331135555 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f974403f070 con 0x7f9754101900 2024-09-21T12:28:08.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.328+0000 7f97517fa640 1 -- 172.21.15.3:0/3331135555 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f97440035f0 con 0x7f9754101900 2024-09-21T12:28:08.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.328+0000 7f975a5d9640 1 -- 172.21.15.3:0/3331135555 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9754197a50 con 0x7f9754101900 2024-09-21T12:28:08.330 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.328+0000 7f97517fa640 1 -- 172.21.15.3:0/3331135555 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9744035030 con 0x7f9754101900 2024-09-21T12:28:08.331 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.328+0000 7f975a5d9640 1 -- 172.21.15.3:0/3331135555 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9754197f80 con 0x7f9754101900 2024-09-21T12:28:08.331 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.329+0000 7f975a5d9640 1 -- 172.21.15.3:0/3331135555 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9754103040 con 0x7f9754101900 2024-09-21T12:28:08.331 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.330+0000 7f97517fa640 1 -- 172.21.15.3:0/3331135555 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f9744042070 con 0x7f9754101900 2024-09-21T12:28:08.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.330+0000 7f97517fa640 1 --2- 172.21.15.3:0/3331135555 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f973c07af30 0x7f973c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:28:08.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.330+0000 7f97537fe640 1 --2- 172.21.15.3:0/3331135555 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f973c07af30 0x7f973c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:28:08.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.330+0000 7f97517fa640 1 -- 172.21.15.3:0/3331135555 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6156+0+0 (secure 0 0 0) 0x7f97440be970 con 0x7f9754101900 2024-09-21T12:28:08.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.331+0000 7f97537fe640 1 --2- 172.21.15.3:0/3331135555 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f973c07af30 0x7f973c07d3f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9754100e00 tx=0x7f974800b390 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:28:08.336 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.335+0000 7f97517fa640 1 -- 172.21.15.3:0/3331135555 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f97440c0e20 con 0x7f9754101900 2024-09-21T12:28:08.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.531+0000 7f975a5d9640 1 -- 172.21.15.3:0/3331135555 --> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f9754198230 con 0x7f973c07af30 2024-09-21T12:28:08.542 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.541+0000 7f97517fa640 1 -- 172.21.15.3:0/3331135555 <== mgr.14756 v2:172.21.15.3:6800/1284098095 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f9754198230 con 0x7f973c07af30 2024-09-21T12:28:08.543 INFO:teuthology.orchestra.run.smithi003.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:28:08.543 INFO:teuthology.orchestra.run.smithi003.stdout:alertmanager.smithi003 smithi003 *:9093,9094 running (4m) 53s ago 15m 19.0M - 0.27.0 11f11916f8cd 14880018dfd3 2024-09-21T12:28:08.543 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-exporter.smithi003 smithi003 running (7m) 53s ago 16m 8820k - 19.1.1-373-g4e45e6b4 164465d2334a 0c9ad60a4f5a 2024-09-21T12:28:08.543 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-exporter.smithi192 smithi192 running (6m) 18s ago 15m 8514k - 19.1.1-373-g4e45e6b4 164465d2334a d5be8a6e120f 2024-09-21T12:28:08.543 INFO:teuthology.orchestra.run.smithi003.stdout:crash.smithi003 smithi003 running (2m) 53s ago 15m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 0ada67250dba 2024-09-21T12:28:08.543 INFO:teuthology.orchestra.run.smithi003.stdout:crash.smithi192 smithi192 running (2m) 18s ago 15m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 52e279085b2e 2024-09-21T12:28:08.543 INFO:teuthology.orchestra.run.smithi003.stdout:grafana.smithi003 smithi003 *:3000 running (4m) 53s ago 15m 78.8M - 10.4.8 5aad1d7cf004 19e26b3cb585 2024-09-21T12:28:08.543 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi003.ebjgyl smithi003 running (10m) 53s ago 10m 17.2M - 19.1.1-373-g4e45e6b4 164465d2334a 16e0b2cac16a 2024-09-21T12:28:08.543 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi003.gfkngj smithi003 running (10m) 53s ago 10m 143M - 19.1.1-373-g4e45e6b4 164465d2334a 109c04f87fbd 2024-09-21T12:28:08.544 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi192.ktdqns smithi192 running (10m) 18s ago 10m 19.1M - 19.1.1-373-g4e45e6b4 164465d2334a 495c73fb3bb0 2024-09-21T12:28:08.544 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi192.ywqqxe smithi192 running (10m) 18s ago 10m 19.2M - 19.1.1-373-g4e45e6b4 164465d2334a 270a01030cbe 2024-09-21T12:28:08.544 INFO:teuthology.orchestra.run.smithi003.stdout:mgr.smithi003.wztftl smithi003 *:8443,9283,8765 running (6m) 53s ago 17m 525M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 8ce0e66fd369 2024-09-21T12:28:08.544 INFO:teuthology.orchestra.run.smithi003.stdout:mgr.smithi192.qsaprd smithi192 *:8443,9283,8765 running (5m) 18s ago 15m 458M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 002a6171dd47 2024-09-21T12:28:08.544 INFO:teuthology.orchestra.run.smithi003.stdout:mon.smithi003 smithi003 running (3m) 53s ago 17m 41.7M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 4f2b2b2daf19 2024-09-21T12:28:08.544 INFO:teuthology.orchestra.run.smithi003.stdout:mon.smithi192 smithi192 running (2m) 18s ago 14m 37.4M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 11edc5c1baba 2024-09-21T12:28:08.544 INFO:teuthology.orchestra.run.smithi003.stdout:node-exporter.smithi003 smithi003 *:9100 running (5m) 53s ago 15m 9353k - 1.7.0 72c9c2088986 d9cb7ede9060 2024-09-21T12:28:08.544 INFO:teuthology.orchestra.run.smithi003.stdout:node-exporter.smithi192 smithi192 *:9100 running (5m) 18s ago 15m 11.5M - 1.7.0 72c9c2088986 d8ec0acfce7e 2024-09-21T12:28:08.544 INFO:teuthology.orchestra.run.smithi003.stdout:osd.0 smithi003 running (2m) 53s ago 13m 82.1M 1217M 19.3.0-5103-g5c1cdc3c 8f4d013db793 0f2234f333ec 2024-09-21T12:28:08.544 INFO:teuthology.orchestra.run.smithi003.stdout:osd.1 smithi003 running (96s) 53s ago 13m 85.4M 1217M 19.3.0-5103-g5c1cdc3c 8f4d013db793 198ba21d0518 2024-09-21T12:28:08.544 INFO:teuthology.orchestra.run.smithi003.stdout:osd.2 smithi003 running (58s) 53s ago 12m 11.1M 1217M 19.3.0-5103-g5c1cdc3c 8f4d013db793 e630341e13d4 2024-09-21T12:28:08.544 INFO:teuthology.orchestra.run.smithi003.stdout:osd.3 smithi192 running (22s) 18s ago 12m 11.5M 2240M 19.3.0-5103-g5c1cdc3c 8f4d013db793 1b5fae2f2dd9 2024-09-21T12:28:08.544 INFO:teuthology.orchestra.run.smithi003.stdout:osd.4 smithi192 running (11m) 18s ago 11m 205M 2240M 19.1.1-373-g4e45e6b4 164465d2334a f33bf453cb3e 2024-09-21T12:28:08.544 INFO:teuthology.orchestra.run.smithi003.stdout:osd.5 smithi192 running (11m) 18s ago 11m 181M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 12d7b7c8e985 2024-09-21T12:28:08.545 INFO:teuthology.orchestra.run.smithi003.stdout:prometheus.smithi003 smithi003 *:9095 running (4m) 53s ago 15m 54.6M - 2.51.0 1d3b7f56885b 64997a33fbbb 2024-09-21T12:28:08.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.543+0000 7f975a5d9640 1 -- 172.21.15.3:0/3331135555 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f973c07af30 msgr2=0x7f973c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:28:08.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.543+0000 7f975a5d9640 1 --2- 172.21.15.3:0/3331135555 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f973c07af30 0x7f973c07d3f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9754100e00 tx=0x7f974800b390 comp rx=0 tx=0).stop 2024-09-21T12:28:08.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.543+0000 7f975a5d9640 1 -- 172.21.15.3:0/3331135555 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9754101900 msgr2=0x7f975419d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:28:08.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.543+0000 7f975a5d9640 1 --2- 172.21.15.3:0/3331135555 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9754101900 0x7f975419d640 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f9744031460 tx=0x7f97440045e0 comp rx=0 tx=0).stop 2024-09-21T12:28:08.545 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.543+0000 7f975a5d9640 1 -- 172.21.15.3:0/3331135555 shutdown_connections 2024-09-21T12:28:08.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.543+0000 7f975a5d9640 1 --2- 172.21.15.3:0/3331135555 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f973c07af30 0x7f973c07d3f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:08.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.543+0000 7f975a5d9640 1 --2- 172.21.15.3:0/3331135555 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9754107900 0x7f975419db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:08.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.543+0000 7f975a5d9640 1 --2- 172.21.15.3:0/3331135555 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9754101900 0x7f975419d640 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:08.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.543+0000 7f975a5d9640 1 -- 172.21.15.3:0/3331135555 >> 172.21.15.3:0/3331135555 conn(0x7f97540fd600 msgr2=0x7f97540ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:28:08.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.544+0000 7f975a5d9640 1 -- 172.21.15.3:0/3331135555 shutdown_connections 2024-09-21T12:28:08.546 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.544+0000 7f975a5d9640 1 -- 172.21.15.3:0/3331135555 wait complete. 2024-09-21T12:28:08.629 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.627+0000 7f76ed847640 1 -- 172.21.15.3:0/1914150695 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f76e8100140 msgr2=0x7f76e8100520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:28:08.629 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.627+0000 7f76ed847640 1 --2- 172.21.15.3:0/1914150695 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f76e8100140 0x7f76e8100520 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f76d8009880 tx=0x7f76d802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:28:08.629 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.627+0000 7f76ed847640 1 -- 172.21.15.3:0/1914150695 shutdown_connections 2024-09-21T12:28:08.629 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.627+0000 7f76ed847640 1 --2- 172.21.15.3:0/1914150695 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f76e8100af0 0x7f76e8106630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:08.629 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.627+0000 7f76ed847640 1 --2- 172.21.15.3:0/1914150695 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f76e8100140 0x7f76e8100520 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:08.630 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.627+0000 7f76ed847640 1 -- 172.21.15.3:0/1914150695 >> 172.21.15.3:0/1914150695 conn(0x7f76e80fbc90 msgr2=0x7f76e80fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:28:08.630 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.627+0000 7f76ed847640 1 -- 172.21.15.3:0/1914150695 shutdown_connections 2024-09-21T12:28:08.630 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.628+0000 7f76ed847640 1 -- 172.21.15.3:0/1914150695 wait complete. 2024-09-21T12:28:08.631 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.628+0000 7f76ed847640 1 Processor -- start 2024-09-21T12:28:08.631 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.628+0000 7f76ed847640 1 -- start start 2024-09-21T12:28:08.631 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.628+0000 7f76ed847640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f76e8100140 0x7f76e81010c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:28:08.631 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.628+0000 7f76ed847640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f76e8100af0 0x7f76e8101600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:28:08.632 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.628+0000 7f76ed847640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f76e810ee60 con 0x7f76e8100140 2024-09-21T12:28:08.632 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.628+0000 7f76ed847640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f76e810ece0 con 0x7f76e8100af0 2024-09-21T12:28:08.632 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.628+0000 7f76e6ffd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f76e8100140 0x7f76e81010c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:28:08.632 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.628+0000 7f76e6ffd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f76e8100140 0x7f76e81010c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41730/0 (socket says 172.21.15.3:41730) 2024-09-21T12:28:08.632 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.628+0000 7f76e6ffd640 1 -- 172.21.15.3:0/2772920974 learned_addr learned my addr 172.21.15.3:0/2772920974 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:28:08.632 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.629+0000 7f76dffff640 1 --2- 172.21.15.3:0/2772920974 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f76e8100af0 0x7f76e8101600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:28:08.632 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.629+0000 7f76e6ffd640 1 -- 172.21.15.3:0/2772920974 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f76e8100af0 msgr2=0x7f76e8101600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:28:08.632 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.629+0000 7f76e6ffd640 1 --2- 172.21.15.3:0/2772920974 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f76e8100af0 0x7f76e8101600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:08.632 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.629+0000 7f76e6ffd640 1 -- 172.21.15.3:0/2772920974 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76e8101b40 con 0x7f76e8100140 2024-09-21T12:28:08.632 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.629+0000 7f76e6ffd640 1 --2- 172.21.15.3:0/2772920974 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f76e8100140 0x7f76e81010c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f76d8031460 tx=0x7f76d80045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:28:08.632 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.629+0000 7f76ec845640 1 -- 172.21.15.3:0/2772920974 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f76d803f070 con 0x7f76e8100140 2024-09-21T12:28:08.632 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.629+0000 7f76ec845640 1 -- 172.21.15.3:0/2772920974 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f76d80035f0 con 0x7f76e8100140 2024-09-21T12:28:08.632 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.629+0000 7f76ed847640 1 -- 172.21.15.3:0/2772920974 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76e8101dd0 con 0x7f76e8100140 2024-09-21T12:28:08.633 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.629+0000 7f76ec845640 1 -- 172.21.15.3:0/2772920974 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f76d8035030 con 0x7f76e8100140 2024-09-21T12:28:08.633 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.629+0000 7f76ed847640 1 -- 172.21.15.3:0/2772920974 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76e81a3db0 con 0x7f76e8100140 2024-09-21T12:28:08.633 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.630+0000 7f76ed847640 1 -- 172.21.15.3:0/2772920974 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76e8103200 con 0x7f76e8100140 2024-09-21T12:28:08.633 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.631+0000 7f76ec845640 1 -- 172.21.15.3:0/2772920974 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f76d8042070 con 0x7f76e8100140 2024-09-21T12:28:08.633 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.632+0000 7f76ec845640 1 --2- 172.21.15.3:0/2772920974 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f76d407af80 0x7f76d407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:28:08.634 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.632+0000 7f76ec845640 1 -- 172.21.15.3:0/2772920974 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6156+0+0 (secure 0 0 0) 0x7f76d80be860 con 0x7f76e8100140 2024-09-21T12:28:08.634 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.632+0000 7f76dffff640 1 --2- 172.21.15.3:0/2772920974 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f76d407af80 0x7f76d407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:28:08.634 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.632+0000 7f76dffff640 1 --2- 172.21.15.3:0/2772920974 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f76d407af80 0x7f76d407d440 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f76e8102b50 tx=0x7f76d000b390 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:28:08.637 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.636+0000 7f76ec845640 1 -- 172.21.15.3:0/2772920974 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f76d8089ee0 con 0x7f76e8100140 2024-09-21T12:28:08.900 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.898+0000 7f76ed847640 1 -- 172.21.15.3:0/2772920974 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f76e8109ed0 con 0x7f76e8100140 2024-09-21T12:28:08.900 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.899+0000 7f76ec845640 1 -- 172.21.15.3:0/2772920974 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+836 (secure 0 0 0) 0x7f76d808c400 con 0x7f76e8100140 2024-09-21T12:28:08.901 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-21T12:28:08.901 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": { 2024-09-21T12:28:08.901 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:28:08.901 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:28:08.901 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": { 2024-09-21T12:28:08.901 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:28:08.901 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:28:08.901 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": { 2024-09-21T12:28:08.901 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 2, 2024-09-21T12:28:08.901 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 4 2024-09-21T12:28:08.901 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:28:08.901 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": { 2024-09-21T12:28:08.902 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 4 2024-09-21T12:28:08.902 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:28:08.902 INFO:teuthology.orchestra.run.smithi003.stdout: "overall": { 2024-09-21T12:28:08.902 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 6, 2024-09-21T12:28:08.902 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 8 2024-09-21T12:28:08.902 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-21T12:28:08.902 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-21T12:28:08.903 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.901+0000 7f76ed847640 1 -- 172.21.15.3:0/2772920974 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f76d407af80 msgr2=0x7f76d407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:28:08.903 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.901+0000 7f76ed847640 1 --2- 172.21.15.3:0/2772920974 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f76d407af80 0x7f76d407d440 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f76e8102b50 tx=0x7f76d000b390 comp rx=0 tx=0).stop 2024-09-21T12:28:08.903 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.901+0000 7f76ed847640 1 -- 172.21.15.3:0/2772920974 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f76e8100140 msgr2=0x7f76e81010c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:28:08.903 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.901+0000 7f76ed847640 1 --2- 172.21.15.3:0/2772920974 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f76e8100140 0x7f76e81010c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f76d8031460 tx=0x7f76d80045e0 comp rx=0 tx=0).stop 2024-09-21T12:28:08.903 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.901+0000 7f76ed847640 1 -- 172.21.15.3:0/2772920974 shutdown_connections 2024-09-21T12:28:08.903 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.901+0000 7f76ed847640 1 --2- 172.21.15.3:0/2772920974 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f76d407af80 0x7f76d407d440 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:08.903 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.901+0000 7f76ed847640 1 --2- 172.21.15.3:0/2772920974 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f76e8100af0 0x7f76e8101600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:08.903 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.901+0000 7f76ed847640 1 --2- 172.21.15.3:0/2772920974 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f76e8100140 0x7f76e81010c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:08.903 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.901+0000 7f76ed847640 1 -- 172.21.15.3:0/2772920974 >> 172.21.15.3:0/2772920974 conn(0x7f76e80fbc90 msgr2=0x7f76e8105810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:28:08.903 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.901+0000 7f76ed847640 1 -- 172.21.15.3:0/2772920974 shutdown_connections 2024-09-21T12:28:08.903 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.901+0000 7f76ed847640 1 -- 172.21.15.3:0/2772920974 wait complete. 2024-09-21T12:28:08.989 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.986+0000 7f86fb160640 1 -- 172.21.15.3:0/2219485070 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f86f4101900 msgr2=0x7f86f4101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:28:08.989 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.986+0000 7f86fb160640 1 --2- 172.21.15.3:0/2219485070 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f86f4101900 0x7f86f4101d60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f86dc009c20 tx=0x7f86dc02a970 comp rx=0 tx=0).stop 2024-09-21T12:28:08.989 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.986+0000 7f86fb160640 1 -- 172.21.15.3:0/2219485070 shutdown_connections 2024-09-21T12:28:08.989 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.986+0000 7f86fb160640 1 --2- 172.21.15.3:0/2219485070 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f86f4101900 0x7f86f4101d60 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:08.989 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.986+0000 7f86fb160640 1 --2- 172.21.15.3:0/2219485070 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86f4107900 0x7f86f4107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:08.989 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.986+0000 7f86fb160640 1 -- 172.21.15.3:0/2219485070 >> 172.21.15.3:0/2219485070 conn(0x7f86f40fd600 msgr2=0x7f86f40ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:28:08.989 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.986+0000 7f86fb160640 1 -- 172.21.15.3:0/2219485070 shutdown_connections 2024-09-21T12:28:08.989 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.986+0000 7f86fb160640 1 -- 172.21.15.3:0/2219485070 wait complete. 2024-09-21T12:28:08.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.987+0000 7f86fb160640 1 Processor -- start 2024-09-21T12:28:08.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.987+0000 7f86fb160640 1 -- start start 2024-09-21T12:28:08.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.987+0000 7f86fb160640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f86f4101900 0x7f86f419d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:28:08.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.987+0000 7f86fb160640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86f4107900 0x7f86f419dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:28:08.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.987+0000 7f86fb160640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f86f410edb0 con 0x7f86f4101900 2024-09-21T12:28:08.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.987+0000 7f86fb160640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f86f410ec30 con 0x7f86f4107900 2024-09-21T12:28:08.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.987+0000 7f86f8efc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f86f4101900 0x7f86f419d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:28:08.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.987+0000 7f86f8efc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f86f4101900 0x7f86f419d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41750/0 (socket says 172.21.15.3:41750) 2024-09-21T12:28:08.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.987+0000 7f86f8efc640 1 -- 172.21.15.3:0/1637915199 learned_addr learned my addr 172.21.15.3:0/1637915199 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:28:08.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.988+0000 7f86f8efc640 1 -- 172.21.15.3:0/1637915199 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86f4107900 msgr2=0x7f86f419dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:28:08.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.988+0000 7f86f8efc640 1 --2- 172.21.15.3:0/1637915199 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86f4107900 0x7f86f419dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:08.990 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.988+0000 7f86f8efc640 1 -- 172.21.15.3:0/1637915199 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86f4197800 con 0x7f86f4101900 2024-09-21T12:28:08.992 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.988+0000 7f86f8efc640 1 --2- 172.21.15.3:0/1637915199 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f86f4101900 0x7f86f419d680 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f86e400e970 tx=0x7f86e400ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:28:08.992 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.988+0000 7f86f1ffb640 1 -- 172.21.15.3:0/1637915199 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f86e400cac0 con 0x7f86f4101900 2024-09-21T12:28:08.992 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.988+0000 7f86f1ffb640 1 -- 172.21.15.3:0/1637915199 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f86e400cc60 con 0x7f86f4101900 2024-09-21T12:28:08.992 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.988+0000 7f86f1ffb640 1 -- 172.21.15.3:0/1637915199 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f86e4018720 con 0x7f86f4101900 2024-09-21T12:28:08.992 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.988+0000 7f86fb160640 1 -- 172.21.15.3:0/1637915199 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86f4197af0 con 0x7f86f4101900 2024-09-21T12:28:08.992 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.988+0000 7f86fb160640 1 -- 172.21.15.3:0/1637915199 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86f4198080 con 0x7f86f4101900 2024-09-21T12:28:08.992 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.989+0000 7f86fb160640 1 -- 172.21.15.3:0/1637915199 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86f4103040 con 0x7f86f4101900 2024-09-21T12:28:08.993 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.990+0000 7f86f1ffb640 1 -- 172.21.15.3:0/1637915199 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f86e4010430 con 0x7f86f4101900 2024-09-21T12:28:08.993 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.990+0000 7f86f1ffb640 1 --2- 172.21.15.3:0/1637915199 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f86e007af80 0x7f86e007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:28:08.994 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.990+0000 7f86f1ffb640 1 -- 172.21.15.3:0/1637915199 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6156+0+0 (secure 0 0 0) 0x7f86e409e600 con 0x7f86f4101900 2024-09-21T12:28:08.994 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.991+0000 7f86f3fff640 1 --2- 172.21.15.3:0/1637915199 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f86e007af80 0x7f86e007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:28:08.994 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.991+0000 7f86f3fff640 1 --2- 172.21.15.3:0/1637915199 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f86e007af80 0x7f86e007d440 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f86dc009430 tx=0x7f86dc0093a0 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:28:08.996 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:08.995+0000 7f86f1ffb640 1 -- 172.21.15.3:0/1637915199 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f86e4069c80 con 0x7f86f4101900 2024-09-21T12:28:09.124 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:08 smithi192 ceph-mon[80326]: from='client.34254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:28:09.124 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:08 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-21T12:28:09.124 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:08 smithi192 ceph-mon[80326]: from='client.? 172.21.15.3:0/2772920974' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:28:09.225 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.223+0000 7f86fb160640 1 -- 172.21.15.3:0/1637915199 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f86f4109e90 con 0x7f86f4101900 2024-09-21T12:28:09.226 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:08 smithi003 ceph-mon[108723]: from='client.34254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:28:09.226 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:08 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16} : dispatch 2024-09-21T12:28:09.226 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:08 smithi003 ceph-mon[108723]: from='client.? 172.21.15.3:0/2772920974' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:28:09.226 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.224+0000 7f86f1ffb640 1 -- 172.21.15.3:0/1637915199 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) ==== 76+0+2010 (secure 0 0 0) 0x7f86e406eb30 con 0x7f86f4101900 2024-09-21T12:28:09.226 INFO:teuthology.orchestra.run.smithi003.stdout:e14 2024-09-21T12:28:09.226 INFO:teuthology.orchestra.run.smithi003.stdout:btime 2024-09-21T12:17:55:592931+0000 2024-09-21T12:28:09.226 INFO:teuthology.orchestra.run.smithi003.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T12:28:09.227 INFO:teuthology.orchestra.run.smithi003.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:28:09.227 INFO:teuthology.orchestra.run.smithi003.stdout:legacy client fscid: 1 2024-09-21T12:28:09.227 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:28:09.227 INFO:teuthology.orchestra.run.smithi003.stdout:Filesystem 'cephfs' (1) 2024-09-21T12:28:09.227 INFO:teuthology.orchestra.run.smithi003.stdout:fs_name cephfs 2024-09-21T12:28:09.227 INFO:teuthology.orchestra.run.smithi003.stdout:epoch 14 2024-09-21T12:28:09.227 INFO:teuthology.orchestra.run.smithi003.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T12:28:09.227 INFO:teuthology.orchestra.run.smithi003.stdout:created 2024-09-21T12:17:38.260099+0000 2024-09-21T12:28:09.227 INFO:teuthology.orchestra.run.smithi003.stdout:modified 2024-09-21T12:17:55.592927+0000 2024-09-21T12:28:09.227 INFO:teuthology.orchestra.run.smithi003.stdout:tableserver 0 2024-09-21T12:28:09.227 INFO:teuthology.orchestra.run.smithi003.stdout:root 0 2024-09-21T12:28:09.227 INFO:teuthology.orchestra.run.smithi003.stdout:session_timeout 60 2024-09-21T12:28:09.227 INFO:teuthology.orchestra.run.smithi003.stdout:session_autoclose 300 2024-09-21T12:28:09.228 INFO:teuthology.orchestra.run.smithi003.stdout:max_file_size 1099511627776 2024-09-21T12:28:09.228 INFO:teuthology.orchestra.run.smithi003.stdout:max_xattr_size 65536 2024-09-21T12:28:09.228 INFO:teuthology.orchestra.run.smithi003.stdout:required_client_features {} 2024-09-21T12:28:09.228 INFO:teuthology.orchestra.run.smithi003.stdout:last_failure 0 2024-09-21T12:28:09.228 INFO:teuthology.orchestra.run.smithi003.stdout:last_failure_osd_epoch 46 2024-09-21T12:28:09.228 INFO:teuthology.orchestra.run.smithi003.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:28:09.228 INFO:teuthology.orchestra.run.smithi003.stdout:max_mds 1 2024-09-21T12:28:09.228 INFO:teuthology.orchestra.run.smithi003.stdout:in 0 2024-09-21T12:28:09.228 INFO:teuthology.orchestra.run.smithi003.stdout:up {0=14564} 2024-09-21T12:28:09.228 INFO:teuthology.orchestra.run.smithi003.stdout:failed 2024-09-21T12:28:09.228 INFO:teuthology.orchestra.run.smithi003.stdout:damaged 2024-09-21T12:28:09.228 INFO:teuthology.orchestra.run.smithi003.stdout:stopped 2024-09-21T12:28:09.228 INFO:teuthology.orchestra.run.smithi003.stdout:data_pools [3] 2024-09-21T12:28:09.228 INFO:teuthology.orchestra.run.smithi003.stdout:metadata_pool 2 2024-09-21T12:28:09.228 INFO:teuthology.orchestra.run.smithi003.stdout:inline_data enabled 2024-09-21T12:28:09.229 INFO:teuthology.orchestra.run.smithi003.stdout:balancer 2024-09-21T12:28:09.229 INFO:teuthology.orchestra.run.smithi003.stdout:bal_rank_mask -1 2024-09-21T12:28:09.229 INFO:teuthology.orchestra.run.smithi003.stdout:standby_count_wanted 1 2024-09-21T12:28:09.229 INFO:teuthology.orchestra.run.smithi003.stdout:qdb_cluster leader: 14564 members: 14564 2024-09-21T12:28:09.229 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.cephfs.smithi003.gfkngj{0:14564} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.3:6828/3710817325,v1:172.21.15.3:6829/3710817325] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:28:09.229 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:28:09.229 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:28:09.229 INFO:teuthology.orchestra.run.smithi003.stdout:Standby daemons: 2024-09-21T12:28:09.229 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:28:09.229 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.cephfs.smithi192.ywqqxe{-1:24319} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.192:6824/4055220871,v1:172.21.15.192:6825/4055220871] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:28:09.229 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.cephfs.smithi192.ktdqns{-1:24337} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.192:6826/318800854,v1:172.21.15.192:6827/318800854] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:28:09.229 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.cephfs.smithi003.ebjgyl{-1:24345} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.3:6826/55902996,v1:172.21.15.3:6827/55902996] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:28:09.230 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 14 2024-09-21T12:28:09.230 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.226+0000 7f86fb160640 1 -- 172.21.15.3:0/1637915199 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f86e007af80 msgr2=0x7f86e007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:28:09.230 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.226+0000 7f86fb160640 1 --2- 172.21.15.3:0/1637915199 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f86e007af80 0x7f86e007d440 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f86dc009430 tx=0x7f86dc0093a0 comp rx=0 tx=0).stop 2024-09-21T12:28:09.230 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.226+0000 7f86fb160640 1 -- 172.21.15.3:0/1637915199 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f86f4101900 msgr2=0x7f86f419d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:28:09.230 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.226+0000 7f86fb160640 1 --2- 172.21.15.3:0/1637915199 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f86f4101900 0x7f86f419d680 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f86e400e970 tx=0x7f86e400ee30 comp rx=0 tx=0).stop 2024-09-21T12:28:09.230 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.226+0000 7f86fb160640 1 -- 172.21.15.3:0/1637915199 shutdown_connections 2024-09-21T12:28:09.230 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.226+0000 7f86fb160640 1 --2- 172.21.15.3:0/1637915199 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f86e007af80 0x7f86e007d440 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:09.231 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.226+0000 7f86fb160640 1 --2- 172.21.15.3:0/1637915199 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f86f4107900 0x7f86f419dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:09.231 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.226+0000 7f86fb160640 1 --2- 172.21.15.3:0/1637915199 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f86f4101900 0x7f86f419d680 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:09.231 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.226+0000 7f86fb160640 1 -- 172.21.15.3:0/1637915199 >> 172.21.15.3:0/1637915199 conn(0x7f86f40fd600 msgr2=0x7f86f40fdf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:28:09.231 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.226+0000 7f86fb160640 1 -- 172.21.15.3:0/1637915199 shutdown_connections 2024-09-21T12:28:09.231 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.226+0000 7f86fb160640 1 -- 172.21.15.3:0/1637915199 wait complete. 2024-09-21T12:28:09.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.312+0000 7feeae04d640 1 -- 172.21.15.3:0/1833547129 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feea8100800 msgr2=0x7feea8100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:28:09.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.312+0000 7feeae04d640 1 --2- 172.21.15.3:0/1833547129 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feea8100800 0x7feea8100c60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fee9c009880 tx=0x7fee9c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:28:09.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.312+0000 7feeae04d640 1 -- 172.21.15.3:0/1833547129 shutdown_connections 2024-09-21T12:28:09.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.312+0000 7feeae04d640 1 --2- 172.21.15.3:0/1833547129 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feea8100800 0x7feea8100c60 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:09.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.312+0000 7feeae04d640 1 --2- 172.21.15.3:0/1833547129 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feea8106800 0x7feea8106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:09.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.312+0000 7feeae04d640 1 -- 172.21.15.3:0/1833547129 >> 172.21.15.3:0/1833547129 conn(0x7feea80fc520 msgr2=0x7feea80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:28:09.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.312+0000 7feeae04d640 1 -- 172.21.15.3:0/1833547129 shutdown_connections 2024-09-21T12:28:09.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.312+0000 7feeae04d640 1 -- 172.21.15.3:0/1833547129 wait complete. 2024-09-21T12:28:09.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.313+0000 7feeae04d640 1 Processor -- start 2024-09-21T12:28:09.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.313+0000 7feeae04d640 1 -- start start 2024-09-21T12:28:09.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.313+0000 7feeae04d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feea8100800 0x7feea819d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:28:09.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.313+0000 7feeae04d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feea8106800 0x7feea819dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:28:09.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.313+0000 7feeae04d640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7feea810dd30 con 0x7feea8100800 2024-09-21T12:28:09.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.313+0000 7feeae04d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7feea810dbb0 con 0x7feea8106800 2024-09-21T12:28:09.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.313+0000 7feea77fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feea8100800 0x7feea819d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:28:09.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.313+0000 7feea77fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feea8100800 0x7feea819d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41764/0 (socket says 172.21.15.3:41764) 2024-09-21T12:28:09.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.313+0000 7feea77fe640 1 -- 172.21.15.3:0/2113215298 learned_addr learned my addr 172.21.15.3:0/2113215298 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:28:09.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.313+0000 7feea6ffd640 1 --2- 172.21.15.3:0/2113215298 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feea8106800 0x7feea819dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:28:09.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.313+0000 7feea77fe640 1 -- 172.21.15.3:0/2113215298 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feea8106800 msgr2=0x7feea819dbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:28:09.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.313+0000 7feea77fe640 1 --2- 172.21.15.3:0/2113215298 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feea8106800 0x7feea819dbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:09.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.313+0000 7feea77fe640 1 -- 172.21.15.3:0/2113215298 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feea8197810 con 0x7feea8100800 2024-09-21T12:28:09.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.314+0000 7feea77fe640 1 --2- 172.21.15.3:0/2113215298 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feea8100800 0x7feea819d690 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fee9800b420 tx=0x7fee9800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:28:09.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.314+0000 7feea4ff9640 1 -- 172.21.15.3:0/2113215298 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fee98011630 con 0x7feea8100800 2024-09-21T12:28:09.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.314+0000 7feea4ff9640 1 -- 172.21.15.3:0/2113215298 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fee98016070 con 0x7feea8100800 2024-09-21T12:28:09.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.314+0000 7feeae04d640 1 -- 172.21.15.3:0/2113215298 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feea8197b00 con 0x7feea8100800 2024-09-21T12:28:09.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.314+0000 7feea4ff9640 1 -- 172.21.15.3:0/2113215298 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fee98010d40 con 0x7feea8100800 2024-09-21T12:28:09.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.314+0000 7feeae04d640 1 -- 172.21.15.3:0/2113215298 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feea8198060 con 0x7feea8100800 2024-09-21T12:28:09.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.315+0000 7feeae04d640 1 -- 172.21.15.3:0/2113215298 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feea8101f40 con 0x7feea8100800 2024-09-21T12:28:09.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.316+0000 7feea4ff9640 1 -- 172.21.15.3:0/2113215298 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7fee9801b460 con 0x7feea8100800 2024-09-21T12:28:09.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.316+0000 7feea4ff9640 1 --2- 172.21.15.3:0/2113215298 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fee9007af30 0x7fee9007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:28:09.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.316+0000 7feea4ff9640 1 -- 172.21.15.3:0/2113215298 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6156+0+0 (secure 0 0 0) 0x7fee9809d690 con 0x7feea8100800 2024-09-21T12:28:09.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.316+0000 7feea6ffd640 1 --2- 172.21.15.3:0/2113215298 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fee9007af30 0x7fee9007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:28:09.319 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.317+0000 7feea6ffd640 1 --2- 172.21.15.3:0/2113215298 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fee9007af30 0x7fee9007d3f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7feea8198b60 tx=0x7fee9c031400 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:28:09.322 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.321+0000 7feea4ff9640 1 -- 172.21.15.3:0/2113215298 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fee98068c90 con 0x7feea8100800 2024-09-21T12:28:09.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.526+0000 7feeae04d640 1 -- 172.21.15.3:0/2113215298 --> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7feea8198370 con 0x7fee9007af30 2024-09-21T12:28:09.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.528+0000 7feea4ff9640 1 -- 172.21.15.3:0/2113215298 <== mgr.14756 v2:172.21.15.3:6800/1284098095 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7feea8198370 con 0x7fee9007af30 2024-09-21T12:28:09.529 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-21T12:28:09.530 INFO:teuthology.orchestra.run.smithi003.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T12:28:09.530 INFO:teuthology.orchestra.run.smithi003.stdout: "in_progress": true, 2024-09-21T12:28:09.530 INFO:teuthology.orchestra.run.smithi003.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T12:28:09.530 INFO:teuthology.orchestra.run.smithi003.stdout: "services_complete": [ 2024-09-21T12:28:09.530 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr", 2024-09-21T12:28:09.530 INFO:teuthology.orchestra.run.smithi003.stdout: "mon", 2024-09-21T12:28:09.530 INFO:teuthology.orchestra.run.smithi003.stdout: "crash" 2024-09-21T12:28:09.530 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-21T12:28:09.530 INFO:teuthology.orchestra.run.smithi003.stdout: "progress": "10/23 daemons upgraded", 2024-09-21T12:28:09.530 INFO:teuthology.orchestra.run.smithi003.stdout: "message": "Currently upgrading osd daemons", 2024-09-21T12:28:09.530 INFO:teuthology.orchestra.run.smithi003.stdout: "is_paused": false 2024-09-21T12:28:09.530 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-21T12:28:09.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.530+0000 7feeae04d640 1 -- 172.21.15.3:0/2113215298 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fee9007af30 msgr2=0x7fee9007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:28:09.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.530+0000 7feeae04d640 1 --2- 172.21.15.3:0/2113215298 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fee9007af30 0x7fee9007d3f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7feea8198b60 tx=0x7fee9c031400 comp rx=0 tx=0).stop 2024-09-21T12:28:09.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.530+0000 7feeae04d640 1 -- 172.21.15.3:0/2113215298 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feea8100800 msgr2=0x7feea819d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:28:09.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.530+0000 7feeae04d640 1 --2- 172.21.15.3:0/2113215298 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feea8100800 0x7feea819d690 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fee9800b420 tx=0x7fee9800b8e0 comp rx=0 tx=0).stop 2024-09-21T12:28:09.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.530+0000 7feeae04d640 1 -- 172.21.15.3:0/2113215298 shutdown_connections 2024-09-21T12:28:09.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.530+0000 7feeae04d640 1 --2- 172.21.15.3:0/2113215298 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fee9007af30 0x7fee9007d3f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:09.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.530+0000 7feeae04d640 1 --2- 172.21.15.3:0/2113215298 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7feea8106800 0x7feea819dbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:09.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.530+0000 7feeae04d640 1 --2- 172.21.15.3:0/2113215298 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7feea8100800 0x7feea819d690 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:09.532 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.530+0000 7feeae04d640 1 -- 172.21.15.3:0/2113215298 >> 172.21.15.3:0/2113215298 conn(0x7feea80fc520 msgr2=0x7feea806a4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:28:09.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.530+0000 7feeae04d640 1 -- 172.21.15.3:0/2113215298 shutdown_connections 2024-09-21T12:28:09.533 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.530+0000 7feeae04d640 1 -- 172.21.15.3:0/2113215298 wait complete. 2024-09-21T12:28:09.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.616+0000 7fdf67685640 1 -- 172.21.15.3:0/2990590104 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf60100800 msgr2=0x7fdf60100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:28:09.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.616+0000 7fdf67685640 1 --2- 172.21.15.3:0/2990590104 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf60100800 0x7fdf60100c60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fdf54009880 tx=0x7fdf5402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:28:09.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.616+0000 7fdf67685640 1 -- 172.21.15.3:0/2990590104 shutdown_connections 2024-09-21T12:28:09.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.616+0000 7fdf67685640 1 --2- 172.21.15.3:0/2990590104 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf60100800 0x7fdf60100c60 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:09.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.616+0000 7fdf67685640 1 --2- 172.21.15.3:0/2990590104 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf60106800 0x7fdf60106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:09.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.616+0000 7fdf67685640 1 -- 172.21.15.3:0/2990590104 >> 172.21.15.3:0/2990590104 conn(0x7fdf600fc520 msgr2=0x7fdf600fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:28:09.619 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.616+0000 7fdf67685640 1 -- 172.21.15.3:0/2990590104 shutdown_connections 2024-09-21T12:28:09.619 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.616+0000 7fdf67685640 1 -- 172.21.15.3:0/2990590104 wait complete. 2024-09-21T12:28:09.619 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.617+0000 7fdf67685640 1 Processor -- start 2024-09-21T12:28:09.619 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.617+0000 7fdf67685640 1 -- start start 2024-09-21T12:28:09.620 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.617+0000 7fdf67685640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf60100800 0x7fdf6019d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:28:09.620 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.617+0000 7fdf67685640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf60106800 0x7fdf6019dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:28:09.620 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.617+0000 7fdf67685640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fdf6010dd30 con 0x7fdf60106800 2024-09-21T12:28:09.620 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.617+0000 7fdf67685640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fdf6010dbb0 con 0x7fdf60100800 2024-09-21T12:28:09.621 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.617+0000 7fdf64c20640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf60106800 0x7fdf6019dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:28:09.621 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.617+0000 7fdf64c20640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf60106800 0x7fdf6019dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41788/0 (socket says 172.21.15.3:41788) 2024-09-21T12:28:09.621 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.617+0000 7fdf64c20640 1 -- 172.21.15.3:0/1663310673 learned_addr learned my addr 172.21.15.3:0/1663310673 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:28:09.621 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.617+0000 7fdf65421640 1 --2- 172.21.15.3:0/1663310673 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf60100800 0x7fdf6019d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:28:09.621 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.617+0000 7fdf64c20640 1 -- 172.21.15.3:0/1663310673 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf60100800 msgr2=0x7fdf6019d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:28:09.621 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.617+0000 7fdf64c20640 1 --2- 172.21.15.3:0/1663310673 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf60100800 0x7fdf6019d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:09.621 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.617+0000 7fdf64c20640 1 -- 172.21.15.3:0/1663310673 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf601977f0 con 0x7fdf60106800 2024-09-21T12:28:09.621 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.618+0000 7fdf64c20640 1 --2- 172.21.15.3:0/1663310673 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf60106800 0x7fdf6019dbb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fdf54031460 tx=0x7fdf540048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:28:09.621 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.618+0000 7fdf527fc640 1 -- 172.21.15.3:0/1663310673 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdf5403f070 con 0x7fdf60106800 2024-09-21T12:28:09.621 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.618+0000 7fdf527fc640 1 -- 172.21.15.3:0/1663310673 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdf54004cf0 con 0x7fdf60106800 2024-09-21T12:28:09.622 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.618+0000 7fdf67685640 1 -- 172.21.15.3:0/1663310673 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf60197a80 con 0x7fdf60106800 2024-09-21T12:28:09.622 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.618+0000 7fdf527fc640 1 -- 172.21.15.3:0/1663310673 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdf54035030 con 0x7fdf60106800 2024-09-21T12:28:09.622 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.618+0000 7fdf67685640 1 -- 172.21.15.3:0/1663310673 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf60197fb0 con 0x7fdf60106800 2024-09-21T12:28:09.622 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.619+0000 7fdf67685640 1 -- 172.21.15.3:0/1663310673 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf60101f40 con 0x7fdf60106800 2024-09-21T12:28:09.623 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.620+0000 7fdf527fc640 1 -- 172.21.15.3:0/1663310673 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7fdf54042070 con 0x7fdf60106800 2024-09-21T12:28:09.623 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.620+0000 7fdf527fc640 1 --2- 172.21.15.3:0/1663310673 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fdf4c07af30 0x7fdf4c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:28:09.623 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.620+0000 7fdf527fc640 1 -- 172.21.15.3:0/1663310673 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6156+0+0 (secure 0 0 0) 0x7fdf540bea90 con 0x7fdf60106800 2024-09-21T12:28:09.623 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.620+0000 7fdf65421640 1 --2- 172.21.15.3:0/1663310673 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fdf4c07af30 0x7fdf4c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:28:09.623 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.621+0000 7fdf65421640 1 --2- 172.21.15.3:0/1663310673 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fdf4c07af30 0x7fdf4c07d3f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c009990 tx=0x7fdf5c009110 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:28:09.626 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.625+0000 7fdf527fc640 1 -- 172.21.15.3:0/1663310673 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdf5408a090 con 0x7fdf60106800 2024-09-21T12:28:09.900 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.898+0000 7fdf67685640 1 -- 172.21.15.3:0/1663310673 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fdf60198260 con 0x7fdf60106800 2024-09-21T12:28:09.900 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.899+0000 7fdf527fc640 1 -- 172.21.15.3:0/1663310673 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7fdf5408ef40 con 0x7fdf60106800 2024-09-21T12:28:09.901 INFO:teuthology.orchestra.run.smithi003.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-21T12:28:09.901 INFO:teuthology.orchestra.run.smithi003.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:28:09.901 INFO:teuthology.orchestra.run.smithi003.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:28:09.902 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.901+0000 7fdf67685640 1 -- 172.21.15.3:0/1663310673 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fdf4c07af30 msgr2=0x7fdf4c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:28:09.903 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.901+0000 7fdf67685640 1 --2- 172.21.15.3:0/1663310673 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fdf4c07af30 0x7fdf4c07d3f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c009990 tx=0x7fdf5c009110 comp rx=0 tx=0).stop 2024-09-21T12:28:09.903 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.901+0000 7fdf67685640 1 -- 172.21.15.3:0/1663310673 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf60106800 msgr2=0x7fdf6019dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:28:09.903 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.901+0000 7fdf67685640 1 --2- 172.21.15.3:0/1663310673 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf60106800 0x7fdf6019dbb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fdf54031460 tx=0x7fdf540048f0 comp rx=0 tx=0).stop 2024-09-21T12:28:09.903 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.901+0000 7fdf67685640 1 -- 172.21.15.3:0/1663310673 shutdown_connections 2024-09-21T12:28:09.903 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.901+0000 7fdf67685640 1 --2- 172.21.15.3:0/1663310673 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fdf4c07af30 0x7fdf4c07d3f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:09.903 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.901+0000 7fdf67685640 1 --2- 172.21.15.3:0/1663310673 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdf60106800 0x7fdf6019dbb0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:09.903 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.901+0000 7fdf67685640 1 --2- 172.21.15.3:0/1663310673 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdf60100800 0x7fdf6019d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:09.903 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.901+0000 7fdf67685640 1 -- 172.21.15.3:0/1663310673 >> 172.21.15.3:0/1663310673 conn(0x7fdf600fc520 msgr2=0x7fdf601045b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:28:09.903 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.901+0000 7fdf67685640 1 -- 172.21.15.3:0/1663310673 shutdown_connections 2024-09-21T12:28:09.903 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:09.901+0000 7fdf67685640 1 -- 172.21.15.3:0/1663310673 wait complete. 2024-09-21T12:28:10.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:09 smithi192 ceph-mon[80326]: from='client.34258 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:28:10.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:09 smithi192 ceph-mon[80326]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-21T12:28:10.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:09 smithi192 ceph-mon[80326]: Upgrade: osd.4 is safe to restart 2024-09-21T12:28:10.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:09 smithi192 ceph-mon[80326]: from='client.34262 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:28:10.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:09 smithi192 ceph-mon[80326]: pgmap v208: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:28:10.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:09 smithi192 ceph-mon[80326]: from='client.? 172.21.15.3:0/1637915199' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:28:10.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:09 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:28:10.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:09 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:28:10.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:09 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T12:28:10.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:09 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:28:10.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:09 smithi192 ceph-mon[80326]: from='client.? 172.21.15.3:0/1663310673' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:28:10.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:09 smithi003 ceph-mon[108723]: from='client.34258 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:28:10.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:09 smithi003 ceph-mon[108723]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-21T12:28:10.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:09 smithi003 ceph-mon[108723]: Upgrade: osd.4 is safe to restart 2024-09-21T12:28:10.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:09 smithi003 ceph-mon[108723]: from='client.34262 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:28:10.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:09 smithi003 ceph-mon[108723]: pgmap v208: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:28:10.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:09 smithi003 ceph-mon[108723]: from='client.? 172.21.15.3:0/1637915199' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:28:10.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:09 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:28:10.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:09 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:28:10.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:09 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "auth get", "entity": "osd.4"} : dispatch 2024-09-21T12:28:10.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:09 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:28:10.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:09 smithi003 ceph-mon[108723]: from='client.? 172.21.15.3:0/1663310673' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:28:11.165 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:10 smithi192 ceph-mon[80326]: from='client.34274 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:28:11.165 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:10 smithi192 ceph-mon[80326]: Upgrade: Updating osd.4 2024-09-21T12:28:11.165 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:10 smithi192 ceph-mon[80326]: Deploying daemon osd.4 on smithi192 2024-09-21T12:28:11.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:10 smithi003 ceph-mon[108723]: from='client.34274 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:28:11.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:10 smithi003 ceph-mon[108723]: Upgrade: Updating osd.4 2024-09-21T12:28:11.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:10 smithi003 ceph-mon[108723]: Deploying daemon osd.4 on smithi192 2024-09-21T12:28:12.148 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:11 smithi192 ceph-mon[80326]: pgmap v209: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:28:12.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:11 smithi003 ceph-mon[108723]: pgmap v209: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:28:13.103 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:28:12 smithi192 systemd[1]: Stopping Ceph osd.4 for 641beec0-7812-11ef-baf6-efdc52797490... 2024-09-21T12:28:13.507 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:28:13 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-4[48348]: 2024-09-21T12:28:13.101+0000 7f40cc8d7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T12:28:13.508 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:28:13 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-4[48348]: 2024-09-21T12:28:13.101+0000 7f40cc8d7640 -1 osd.4 68 *** Got signal Terminated *** 2024-09-21T12:28:13.508 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:28:13 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-4[48348]: 2024-09-21T12:28:13.101+0000 7f40cc8d7640 -1 osd.4 68 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T12:28:14.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:13 smithi192 ceph-mon[80326]: pgmap v210: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:28:14.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:13 smithi192 ceph-mon[80326]: osd.4 marked itself down and dead 2024-09-21T12:28:14.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:13 smithi003 ceph-mon[108723]: pgmap v210: 65 pgs: 65 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:28:14.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:13 smithi003 ceph-mon[108723]: osd.4 marked itself down and dead 2024-09-21T12:28:14.711 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:28:14 smithi192 podman[92458]: 2024-09-21 12:28:14.450725633 +0000 UTC m=+1.485093896 container died f33bf453cb3ed43096505d692c84f693a3fb133120a83c39af9cd283b346ed2c (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-4, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-4e45e6b, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-21T12:28:14.966 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:28:14 smithi192 podman[92458]: 2024-09-21 12:28:14.809455832 +0000 UTC m=+1.843824085 container cleanup f33bf453cb3ed43096505d692c84f693a3fb133120a83c39af9cd283b346ed2c (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=squid-4e45e6b, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-21T12:28:14.966 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:28:14 smithi192 bash[92458]: ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-4 2024-09-21T12:28:15.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:14 smithi003 ceph-mon[108723]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T12:28:15.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:14 smithi003 ceph-mon[108723]: osdmap e69: 6 total, 5 up, 6 in 2024-09-21T12:28:15.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:14 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:28:15.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:14 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:28:15.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:14 smithi003 ceph-mon[108723]: osdmap e70: 6 total, 5 up, 6 in 2024-09-21T12:28:15.257 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:28:15 smithi192 podman[92473]: 2024-09-21 12:28:15.086235499 +0000 UTC m=+0.630034367 container remove f33bf453cb3ed43096505d692c84f693a3fb133120a83c39af9cd283b346ed2c (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-4, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=squid-4e45e6b, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-21T12:28:15.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:14 smithi192 ceph-mon[80326]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T12:28:15.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:14 smithi192 ceph-mon[80326]: osdmap e69: 6 total, 5 up, 6 in 2024-09-21T12:28:15.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:14 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:28:15.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:14 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:28:15.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:14 smithi192 ceph-mon[80326]: osdmap e70: 6 total, 5 up, 6 in 2024-09-21T12:28:15.749 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:28:15 smithi192 podman[92563]: 2024-09-21 12:28:15.333237788 +0000 UTC m=+0.016165221 image pull 8f4d013db793795fef09ff5edf96e6b42ba8cd2c9158b2f0b7a5d7c1e657c063 quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 2024-09-21T12:28:15.749 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:28:15 smithi192 podman[92563]: 2024-09-21 12:28:15.445563438 +0000 UTC m=+0.128490908 container create 3acddc8e0953ae9de97ce5feb416bbf368d4fd5d7ad436750802f03eb96d6f13 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-4-deactivate, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T12:28:15.750 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:28:15 smithi192 podman[92563]: 2024-09-21 12:28:15.65627181 +0000 UTC m=+0.339199245 container init 3acddc8e0953ae9de97ce5feb416bbf368d4fd5d7ad436750802f03eb96d6f13 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-4-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-21T12:28:15.750 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:28:15 smithi192 podman[92563]: 2024-09-21 12:28:15.659538726 +0000 UTC m=+0.342466153 container start 3acddc8e0953ae9de97ce5feb416bbf368d4fd5d7ad436750802f03eb96d6f13 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-4-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3) 2024-09-21T12:28:15.750 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:28:15 smithi192 podman[92563]: 2024-09-21 12:28:15.748399925 +0000 UTC m=+0.431327368 container attach 3acddc8e0953ae9de97ce5feb416bbf368d4fd5d7ad436750802f03eb96d6f13 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-4-deactivate, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-21T12:28:16.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:15 smithi192 ceph-mon[80326]: pgmap v212: 65 pgs: 5 peering, 5 stale+active+clean, 55 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:28:16.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:15 smithi192 ceph-mon[80326]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-21T12:28:16.008 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:28:15 smithi192 podman[92563]: 2024-09-21 12:28:15.845379605 +0000 UTC m=+0.528307034 container died 3acddc8e0953ae9de97ce5feb416bbf368d4fd5d7ad436750802f03eb96d6f13 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-4-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3) 2024-09-21T12:28:16.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:15 smithi003 ceph-mon[108723]: pgmap v212: 65 pgs: 5 peering, 5 stale+active+clean, 55 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:28:16.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:15 smithi003 ceph-mon[108723]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-09-21T12:28:16.947 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:28:16 smithi192 podman[92585]: 2024-09-21 12:28:16.510895905 +0000 UTC m=+0.659222044 container remove 3acddc8e0953ae9de97ce5feb416bbf368d4fd5d7ad436750802f03eb96d6f13 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-4-deactivate, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-09-21T12:28:16.947 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:28:16 smithi192 systemd[1]: ceph-641beec0-7812-11ef-baf6-efdc52797490@osd.4.service: Deactivated successfully. 2024-09-21T12:28:16.947 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:28:16 smithi192 systemd[1]: Stopped Ceph osd.4 for 641beec0-7812-11ef-baf6-efdc52797490. 2024-09-21T12:28:16.947 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:28:16 smithi192 systemd[1]: ceph-641beec0-7812-11ef-baf6-efdc52797490@osd.4.service: Consumed 50.162s CPU time. 2024-09-21T12:28:16.947 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:28:16 smithi192 systemd[1]: Starting Ceph osd.4 for 641beec0-7812-11ef-baf6-efdc52797490... 2024-09-21T12:28:17.216 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:16 smithi192 ceph-mon[80326]: pgmap v214: 65 pgs: 6 active+undersized, 11 activating+undersized, 13 peering, 4 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 33/279 objects degraded (11.828%) 2024-09-21T12:28:17.216 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:28:16 smithi192 podman[92683]: 2024-09-21 12:28:16.848718272 +0000 UTC m=+0.016221501 image pull 8f4d013db793795fef09ff5edf96e6b42ba8cd2c9158b2f0b7a5d7c1e657c063 quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 2024-09-21T12:28:17.216 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:28:16 smithi192 podman[92683]: 2024-09-21 12:28:16.978989376 +0000 UTC m=+0.146492651 container create 0c28803cdf9d1988b99a1187324c6d2c9c55cb1306e6874d5f96cd9bcf89cba7 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-4-activate, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T12:28:17.216 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:28:17 smithi192 podman[92683]: 2024-09-21 12:28:17.215237504 +0000 UTC m=+0.382740734 container init 0c28803cdf9d1988b99a1187324c6d2c9c55cb1306e6874d5f96cd9bcf89cba7 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-4-activate, ceph=True, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-21T12:28:17.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:16 smithi003 ceph-mon[108723]: pgmap v214: 65 pgs: 6 active+undersized, 11 activating+undersized, 13 peering, 4 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 33/279 objects degraded (11.828%) 2024-09-21T12:28:17.508 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:28:17 smithi192 podman[92683]: 2024-09-21 12:28:17.218626471 +0000 UTC m=+0.386129701 container start 0c28803cdf9d1988b99a1187324c6d2c9c55cb1306e6874d5f96cd9bcf89cba7 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-4-activate, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-21T12:28:17.508 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:28:17 smithi192 podman[92683]: 2024-09-21 12:28:17.306671533 +0000 UTC m=+0.474174772 container attach 0c28803cdf9d1988b99a1187324c6d2c9c55cb1306e6874d5f96cd9bcf89cba7 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-4-activate, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-21T12:28:17.508 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:28:17 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-4-activate[92698]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:28:17.508 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:28:17 smithi192 bash[92683]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:28:17.508 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:28:17 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-4-activate[92698]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:28:17.508 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:28:17 smithi192 bash[92683]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:28:18.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:17 smithi192 ceph-mon[80326]: Health check failed: Degraded data redundancy: 33/279 objects degraded (11.828%), 4 pgs degraded (PG_DEGRADED) 2024-09-21T12:28:18.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:17 smithi003 ceph-mon[108723]: Health check failed: Degraded data redundancy: 33/279 objects degraded (11.828%), 4 pgs degraded (PG_DEGRADED) 2024-09-21T12:28:19.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:18 smithi192 ceph-mon[80326]: pgmap v215: 65 pgs: 6 active+undersized, 11 activating+undersized, 13 peering, 4 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 33/279 objects degraded (11.828%) 2024-09-21T12:28:19.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:18 smithi003 ceph-mon[108723]: pgmap v215: 65 pgs: 6 active+undersized, 11 activating+undersized, 13 peering, 4 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 33/279 objects degraded (11.828%) 2024-09-21T12:28:20.508 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:28:20 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-4-activate[92698]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-09-21T12:28:20.508 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:28:20 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-4-activate[92698]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:28:20.508 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:28:20 smithi192 bash[92683]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-09-21T12:28:20.508 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:28:20 smithi192 bash[92683]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:28:20.508 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:28:20 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-4-activate[92698]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:28:20.508 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:28:20 smithi192 bash[92683]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:28:20.508 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:28:20 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-4-activate[92698]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-21T12:28:20.508 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:28:20 smithi192 bash[92683]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-21T12:28:20.508 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:28:20 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-4-activate[92698]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-4 --no-mon-config 2024-09-21T12:28:20.509 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:28:20 smithi192 bash[92683]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_3 --path /var/lib/ceph/osd/ceph-4 --no-mon-config 2024-09-21T12:28:20.986 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:28:20 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-4-activate[92698]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-4/block 2024-09-21T12:28:20.986 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:28:20 smithi192 bash[92683]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-4/block 2024-09-21T12:28:20.986 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:28:20 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-4-activate[92698]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-4/block 2024-09-21T12:28:20.986 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:28:20 smithi192 bash[92683]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-4/block 2024-09-21T12:28:20.986 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:28:20 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-4-activate[92698]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-21T12:28:20.986 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:28:20 smithi192 bash[92683]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-21T12:28:20.986 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:28:20 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-4-activate[92698]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-21T12:28:20.986 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:28:20 smithi192 bash[92683]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-21T12:28:20.986 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:28:20 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-4-activate[92698]: --> ceph-volume lvm activate successful for osd ID: 4 2024-09-21T12:28:20.986 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:28:20 smithi192 bash[92683]: --> ceph-volume lvm activate successful for osd ID: 4 2024-09-21T12:28:20.986 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:28:20 smithi192 podman[92683]: 2024-09-21 12:28:20.642694945 +0000 UTC m=+3.810198177 container died 0c28803cdf9d1988b99a1187324c6d2c9c55cb1306e6874d5f96cd9bcf89cba7 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-4-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-21T12:28:21.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:20 smithi192 ceph-mon[80326]: pgmap v216: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 47/279 objects degraded (16.846%) 2024-09-21T12:28:21.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:20 smithi192 ceph-mon[80326]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-09-21T12:28:21.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:20 smithi003 ceph-mon[108723]: pgmap v216: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 47/279 objects degraded (16.846%) 2024-09-21T12:28:21.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:20 smithi003 ceph-mon[108723]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-09-21T12:28:21.646 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:28:21 smithi192 podman[92906]: 2024-09-21 12:28:21.341872928 +0000 UTC m=+0.688659550 container remove 0c28803cdf9d1988b99a1187324c6d2c9c55cb1306e6874d5f96cd9bcf89cba7 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-4-activate, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-21T12:28:21.646 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:28:21 smithi192 podman[92964]: 2024-09-21 12:28:21.544806627 +0000 UTC m=+0.109080689 container create 5b1bd4bec479fd230f88b04a4e822dc0c3d24796ea8bf288e37c05de8d63a564 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-4, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, io.buildah.version=1.37.2) 2024-09-21T12:28:21.647 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:28:21 smithi192 podman[92964]: 2024-09-21 12:28:21.451593818 +0000 UTC m=+0.015867892 image pull 8f4d013db793795fef09ff5edf96e6b42ba8cd2c9158b2f0b7a5d7c1e657c063 quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 2024-09-21T12:28:22.257 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:28:21 smithi192 podman[92964]: 2024-09-21 12:28:21.7638631 +0000 UTC m=+0.328137171 container init 5b1bd4bec479fd230f88b04a4e822dc0c3d24796ea8bf288e37c05de8d63a564 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-4, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T12:28:22.258 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:28:21 smithi192 podman[92964]: 2024-09-21 12:28:21.767203073 +0000 UTC m=+0.331477137 container start 5b1bd4bec479fd230f88b04a4e822dc0c3d24796ea8bf288e37c05de8d63a564 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-4, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-21T12:28:22.258 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:28:21 smithi192 ceph-osd[92983]: -- 172.21.15.192:0/1331930429 <== mon.1 v2:172.21.15.192:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55836299a1e0 con 0x55836292a000 2024-09-21T12:28:22.258 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:28:21 smithi192 bash[92964]: 5b1bd4bec479fd230f88b04a4e822dc0c3d24796ea8bf288e37c05de8d63a564 2024-09-21T12:28:22.258 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:28:21 smithi192 systemd[1]: Started Ceph osd.4 for 641beec0-7812-11ef-baf6-efdc52797490. 2024-09-21T12:28:23.107 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:22 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:28:23.107 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:22 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:28:23.107 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:22 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:28:23.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:22 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:28:23.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:22 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:28:23.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:22 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:28:23.758 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:28:23 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-4[92979]: 2024-09-21T12:28:23.435+0000 7fe04fd9d640 -1 Falling back to public interface 2024-09-21T12:28:24.244 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:23 smithi192 ceph-mon[80326]: pgmap v217: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 47/279 objects degraded (16.846%) 2024-09-21T12:28:24.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:23 smithi003 ceph-mon[108723]: pgmap v217: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 47/279 objects degraded (16.846%) 2024-09-21T12:28:26.112 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:25 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:28:26.112 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:25 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:28:26.112 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:25 smithi192 ceph-mon[80326]: pgmap v218: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 47/279 objects degraded (16.846%) 2024-09-21T12:28:26.112 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:25 smithi192 ceph-mon[80326]: Health check update: Degraded data redundancy: 47/279 objects degraded (16.846%), 15 pgs degraded (PG_DEGRADED) 2024-09-21T12:28:26.112 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:25 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:28:26.113 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:25 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:28:26.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:25 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:28:26.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:25 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:28:26.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:25 smithi003 ceph-mon[108723]: pgmap v218: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 47/279 objects degraded (16.846%) 2024-09-21T12:28:26.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:25 smithi003 ceph-mon[108723]: Health check update: Degraded data redundancy: 47/279 objects degraded (16.846%), 15 pgs degraded (PG_DEGRADED) 2024-09-21T12:28:26.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:25 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:28:26.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:25 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:28:28.139 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:27 smithi192 ceph-mon[80326]: pgmap v219: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 47/279 objects degraded (16.846%) 2024-09-21T12:28:28.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:27 smithi003 ceph-mon[108723]: pgmap v219: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 47/279 objects degraded (16.846%) 2024-09-21T12:28:29.507 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:28:29 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-4[92979]: 2024-09-21T12:28:29.076+0000 7fe04fd9d640 -1 osd.4 68 log_to_monitors true 2024-09-21T12:28:29.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:29 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:28:29.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:29 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:28:29.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:29 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:28:29.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:29 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:28:29.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:29 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:28:29.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:29 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:28:29.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:29 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:28:29.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:29 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:28:29.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:29 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:28:29.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:29 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-21T12:28:29.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:29 smithi003 ceph-mon[108723]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-21T12:28:29.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:29 smithi003 ceph-mon[108723]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-21T12:28:29.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:29 smithi003 ceph-mon[108723]: pgmap v220: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 47/279 objects degraded (16.846%) 2024-09-21T12:28:29.831 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:29 smithi003 ceph-mon[108723]: from='osd.4 [v2:172.21.15.192:6808/2556168062,v1:172.21.15.192:6809/2556168062]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T12:28:29.831 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:29 smithi003 ceph-mon[108723]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T12:28:30.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:29 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:28:30.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:29 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:28:30.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:29 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:28:30.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:29 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:28:30.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:29 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:28:30.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:29 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:28:30.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:29 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:28:30.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:29 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:28:30.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:29 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:28:30.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:29 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-21T12:28:30.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:29 smithi192 ceph-mon[80326]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-21T12:28:30.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:29 smithi192 ceph-mon[80326]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-21T12:28:30.009 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:29 smithi192 ceph-mon[80326]: pgmap v220: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 47/279 objects degraded (16.846%) 2024-09-21T12:28:30.009 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:29 smithi192 ceph-mon[80326]: from='osd.4 [v2:172.21.15.192:6808/2556168062,v1:172.21.15.192:6809/2556168062]' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T12:28:30.009 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:29 smithi192 ceph-mon[80326]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]} : dispatch 2024-09-21T12:28:30.757 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:28:30 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-4[92979]: 2024-09-21T12:28:30.462+0000 7fe043b3f640 -1 osd.4 68 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T12:28:30.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:30 smithi192 ceph-mon[80326]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T12:28:30.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:30 smithi192 ceph-mon[80326]: osdmap e71: 6 total, 5 up, 6 in 2024-09-21T12:28:30.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:30 smithi192 ceph-mon[80326]: from='osd.4 [v2:172.21.15.192:6808/2556168062,v1:172.21.15.192:6809/2556168062]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi192", "root=default"]} : dispatch 2024-09-21T12:28:30.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:30 smithi192 ceph-mon[80326]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi192", "root=default"]} : dispatch 2024-09-21T12:28:30.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:30 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:28:30.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:30 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:28:30.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:30 smithi192 ceph-mon[80326]: from='osd.4 ' entity='osd.4' 2024-09-21T12:28:30.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:30 smithi003 ceph-mon[108723]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-21T12:28:30.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:30 smithi003 ceph-mon[108723]: osdmap e71: 6 total, 5 up, 6 in 2024-09-21T12:28:30.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:30 smithi003 ceph-mon[108723]: from='osd.4 [v2:172.21.15.192:6808/2556168062,v1:172.21.15.192:6809/2556168062]' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi192", "root=default"]} : dispatch 2024-09-21T12:28:30.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:30 smithi003 ceph-mon[108723]: from='osd.4 ' entity='osd.4' cmd={"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi192", "root=default"]} : dispatch 2024-09-21T12:28:30.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:30 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:28:30.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:30 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:28:30.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:30 smithi003 ceph-mon[108723]: from='osd.4 ' entity='osd.4' 2024-09-21T12:28:31.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:31 smithi003 ceph-mon[108723]: pgmap v222: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 47/279 objects degraded (16.846%) 2024-09-21T12:28:31.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:31 smithi003 ceph-mon[108723]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T12:28:31.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:31 smithi003 ceph-mon[108723]: osd.4 [v2:172.21.15.192:6808/2556168062,v1:172.21.15.192:6809/2556168062] boot 2024-09-21T12:28:31.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:31 smithi003 ceph-mon[108723]: osdmap e72: 6 total, 6 up, 6 in 2024-09-21T12:28:31.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:31 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T12:28:32.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:31 smithi192 ceph-mon[80326]: pgmap v222: 65 pgs: 19 active+undersized, 15 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 47/279 objects degraded (16.846%) 2024-09-21T12:28:32.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:31 smithi192 ceph-mon[80326]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T12:28:32.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:31 smithi192 ceph-mon[80326]: osd.4 [v2:172.21.15.192:6808/2556168062,v1:172.21.15.192:6809/2556168062] boot 2024-09-21T12:28:32.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:31 smithi192 ceph-mon[80326]: osdmap e72: 6 total, 6 up, 6 in 2024-09-21T12:28:32.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:31 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd metadata", "id": 4} : dispatch 2024-09-21T12:28:33.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:33 smithi192 ceph-mon[80326]: osdmap e73: 6 total, 6 up, 6 in 2024-09-21T12:28:33.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:33 smithi192 ceph-mon[80326]: pgmap v225: 65 pgs: 1 peering, 18 active+undersized, 15 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 47/279 objects degraded (16.846%) 2024-09-21T12:28:33.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:33 smithi003 ceph-mon[108723]: osdmap e73: 6 total, 6 up, 6 in 2024-09-21T12:28:33.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:33 smithi003 ceph-mon[108723]: pgmap v225: 65 pgs: 1 peering, 18 active+undersized, 15 active+undersized+degraded, 31 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 47/279 objects degraded (16.846%) 2024-09-21T12:28:36.211 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:35 smithi192 ceph-mon[80326]: pgmap v226: 65 pgs: 1 peering, 11 active+undersized, 12 active+undersized+degraded, 41 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 37/279 objects degraded (13.262%) 2024-09-21T12:28:36.211 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:35 smithi192 ceph-mon[80326]: Health check update: Degraded data redundancy: 37/279 objects degraded (13.262%), 12 pgs degraded (PG_DEGRADED) 2024-09-21T12:28:36.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:35 smithi003 ceph-mon[108723]: pgmap v226: 65 pgs: 1 peering, 11 active+undersized, 12 active+undersized+degraded, 41 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 37/279 objects degraded (13.262%) 2024-09-21T12:28:36.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:35 smithi003 ceph-mon[108723]: Health check update: Degraded data redundancy: 37/279 objects degraded (13.262%), 12 pgs degraded (PG_DEGRADED) 2024-09-21T12:28:37.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:36 smithi192 ceph-mon[80326]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 37/279 objects degraded (13.262%), 12 pgs degraded) 2024-09-21T12:28:37.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:36 smithi003 ceph-mon[108723]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 37/279 objects degraded (13.262%), 12 pgs degraded) 2024-09-21T12:28:38.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:37 smithi192 ceph-mon[80326]: pgmap v227: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:28:38.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:37 smithi003 ceph-mon[108723]: pgmap v227: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:28:40.000 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:39.999+0000 7f5aede53640 1 -- 172.21.15.3:0/2430645999 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5ae8102ac0 msgr2=0x7f5ae8102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:28:40.001 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:39.999+0000 7f5aede53640 1 --2- 172.21.15.3:0/2430645999 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5ae8102ac0 0x7f5ae8102ea0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5ad8009880 tx=0x7f5ad802a540 comp rx=0 tx=0).stop 2024-09-21T12:28:40.001 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:39.999+0000 7f5aede53640 1 -- 172.21.15.3:0/2430645999 shutdown_connections 2024-09-21T12:28:40.001 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:39.999+0000 7f5aede53640 1 --2- 172.21.15.3:0/2430645999 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ae81033e0 0x7f5ae810b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:40.001 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:39.999+0000 7f5aede53640 1 --2- 172.21.15.3:0/2430645999 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5ae8102ac0 0x7f5ae8102ea0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:40.001 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:39.999+0000 7f5aede53640 1 -- 172.21.15.3:0/2430645999 >> 172.21.15.3:0/2430645999 conn(0x7f5ae80fc520 msgr2=0x7f5ae80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:28:40.001 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:39.999+0000 7f5aede53640 1 -- 172.21.15.3:0/2430645999 shutdown_connections 2024-09-21T12:28:40.001 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:39.999+0000 7f5aede53640 1 -- 172.21.15.3:0/2430645999 wait complete. 2024-09-21T12:28:40.003 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.000+0000 7f5aede53640 1 Processor -- start 2024-09-21T12:28:40.003 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.000+0000 7f5aede53640 1 -- start start 2024-09-21T12:28:40.003 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.000+0000 7f5aede53640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5ae8102ac0 0x7f5ae819d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:28:40.003 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.000+0000 7f5aede53640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ae81033e0 0x7f5ae819dc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:28:40.003 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.000+0000 7f5aede53640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f5ae810edd0 con 0x7f5ae8102ac0 2024-09-21T12:28:40.003 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.000+0000 7f5aede53640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5ae810ec50 con 0x7f5ae81033e0 2024-09-21T12:28:40.003 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.000+0000 7f5ae77fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5ae8102ac0 0x7f5ae819d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:28:40.003 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.000+0000 7f5ae77fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5ae8102ac0 0x7f5ae819d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56182/0 (socket says 172.21.15.3:56182) 2024-09-21T12:28:40.003 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.000+0000 7f5ae77fe640 1 -- 172.21.15.3:0/3040558794 learned_addr learned my addr 172.21.15.3:0/3040558794 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:28:40.003 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.001+0000 7f5ae6ffd640 1 --2- 172.21.15.3:0/3040558794 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ae81033e0 0x7f5ae819dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:28:40.003 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.001+0000 7f5ae77fe640 1 -- 172.21.15.3:0/3040558794 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ae81033e0 msgr2=0x7f5ae819dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:28:40.004 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.001+0000 7f5ae77fe640 1 --2- 172.21.15.3:0/3040558794 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ae81033e0 0x7f5ae819dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:40.004 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.001+0000 7f5ae77fe640 1 -- 172.21.15.3:0/3040558794 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ae819e310 con 0x7f5ae8102ac0 2024-09-21T12:28:40.004 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.001+0000 7f5ae77fe640 1 --2- 172.21.15.3:0/3040558794 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5ae8102ac0 0x7f5ae819d720 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5ad8031460 tx=0x7f5ad80048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:28:40.004 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.001+0000 7f5ae4ff9640 1 -- 172.21.15.3:0/3040558794 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5ad803f070 con 0x7f5ae8102ac0 2024-09-21T12:28:40.004 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.001+0000 7f5ae4ff9640 1 -- 172.21.15.3:0/3040558794 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5ad8004cf0 con 0x7f5ae8102ac0 2024-09-21T12:28:40.004 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.001+0000 7f5aede53640 1 -- 172.21.15.3:0/3040558794 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ae81979a0 con 0x7f5ae8102ac0 2024-09-21T12:28:40.004 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.001+0000 7f5ae4ff9640 1 -- 172.21.15.3:0/3040558794 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5ad8035030 con 0x7f5ae8102ac0 2024-09-21T12:28:40.004 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.001+0000 7f5aede53640 1 -- 172.21.15.3:0/3040558794 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ae8197ea0 con 0x7f5ae8102ac0 2024-09-21T12:28:40.005 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.002+0000 7f5aede53640 1 -- 172.21.15.3:0/3040558794 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ae806aa90 con 0x7f5ae8102ac0 2024-09-21T12:28:40.005 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.003+0000 7f5ae4ff9640 1 -- 172.21.15.3:0/3040558794 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f5ad8042070 con 0x7f5ae8102ac0 2024-09-21T12:28:40.005 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.004+0000 7f5ae4ff9640 1 --2- 172.21.15.3:0/3040558794 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f5ad407af80 0x7f5ad407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:28:40.005 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.004+0000 7f5ae4ff9640 1 -- 172.21.15.3:0/3040558794 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 6156+0+0 (secure 0 0 0) 0x7f5ad80bead0 con 0x7f5ae8102ac0 2024-09-21T12:28:40.005 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.004+0000 7f5ae6ffd640 1 --2- 172.21.15.3:0/3040558794 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f5ad407af80 0x7f5ad407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:28:40.006 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.004+0000 7f5ae6ffd640 1 --2- 172.21.15.3:0/3040558794 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f5ad407af80 0x7f5ad407d440 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5ad0005fd0 tx=0x7f5ad0005f60 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:28:40.009 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.008+0000 7f5ae4ff9640 1 -- 172.21.15.3:0/3040558794 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5ad808a0b0 con 0x7f5ae8102ac0 2024-09-21T12:28:40.217 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.216+0000 7f5aede53640 1 -- 172.21.15.3:0/3040558794 --> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f5ae8198e80 con 0x7f5ad407af80 2024-09-21T12:28:40.218 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:39 smithi003 ceph-mon[108723]: pgmap v228: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:28:40.219 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.217+0000 7f5ae4ff9640 1 -- 172.21.15.3:0/3040558794 <== mgr.14756 v2:172.21.15.3:6800/1284098095 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7f5ae8198e80 con 0x7f5ad407af80 2024-09-21T12:28:40.221 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.219+0000 7f5aede53640 1 -- 172.21.15.3:0/3040558794 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f5ad407af80 msgr2=0x7f5ad407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:28:40.221 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.219+0000 7f5aede53640 1 --2- 172.21.15.3:0/3040558794 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f5ad407af80 0x7f5ad407d440 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5ad0005fd0 tx=0x7f5ad0005f60 comp rx=0 tx=0).stop 2024-09-21T12:28:40.221 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.219+0000 7f5aede53640 1 -- 172.21.15.3:0/3040558794 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5ae8102ac0 msgr2=0x7f5ae819d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:28:40.221 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.219+0000 7f5aede53640 1 --2- 172.21.15.3:0/3040558794 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5ae8102ac0 0x7f5ae819d720 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5ad8031460 tx=0x7f5ad80048f0 comp rx=0 tx=0).stop 2024-09-21T12:28:40.221 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.220+0000 7f5aede53640 1 -- 172.21.15.3:0/3040558794 shutdown_connections 2024-09-21T12:28:40.222 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.220+0000 7f5aede53640 1 --2- 172.21.15.3:0/3040558794 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f5ad407af80 0x7f5ad407d440 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:40.222 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.220+0000 7f5aede53640 1 --2- 172.21.15.3:0/3040558794 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5ae81033e0 0x7f5ae819dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:40.222 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.220+0000 7f5aede53640 1 --2- 172.21.15.3:0/3040558794 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5ae8102ac0 0x7f5ae819d720 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:40.222 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.220+0000 7f5aede53640 1 -- 172.21.15.3:0/3040558794 >> 172.21.15.3:0/3040558794 conn(0x7f5ae80fc520 msgr2=0x7f5ae8108ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:28:40.222 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.220+0000 7f5aede53640 1 -- 172.21.15.3:0/3040558794 shutdown_connections 2024-09-21T12:28:40.222 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.220+0000 7f5aede53640 1 -- 172.21.15.3:0/3040558794 wait complete. 2024-09-21T12:28:40.230 INFO:teuthology.orchestra.run.smithi003.stdout:true 2024-09-21T12:28:40.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:39 smithi192 ceph-mon[80326]: pgmap v228: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:28:40.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.308+0000 7f6cfc8bf640 1 -- 172.21.15.3:0/3304979549 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6cf8101900 msgr2=0x7f6cf8101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:28:40.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.308+0000 7f6cfc8bf640 1 --2- 172.21.15.3:0/3304979549 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6cf8101900 0x7f6cf8101d60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6cec009880 tx=0x7f6cec02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:28:40.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.308+0000 7f6cfc8bf640 1 -- 172.21.15.3:0/3304979549 shutdown_connections 2024-09-21T12:28:40.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.308+0000 7f6cfc8bf640 1 --2- 172.21.15.3:0/3304979549 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6cf8101900 0x7f6cf8101d60 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:40.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.308+0000 7f6cfc8bf640 1 --2- 172.21.15.3:0/3304979549 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6cf8107900 0x7f6cf8107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:40.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.308+0000 7f6cfc8bf640 1 -- 172.21.15.3:0/3304979549 >> 172.21.15.3:0/3304979549 conn(0x7f6cf80fd600 msgr2=0x7f6cf80ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:28:40.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.308+0000 7f6cfc8bf640 1 -- 172.21.15.3:0/3304979549 shutdown_connections 2024-09-21T12:28:40.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.308+0000 7f6cfc8bf640 1 -- 172.21.15.3:0/3304979549 wait complete. 2024-09-21T12:28:40.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.309+0000 7f6cfc8bf640 1 Processor -- start 2024-09-21T12:28:40.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.309+0000 7f6cfc8bf640 1 -- start start 2024-09-21T12:28:40.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.309+0000 7f6cfc8bf640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6cf8101900 0x7f6cf819f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:28:40.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.309+0000 7f6cfc8bf640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6cf8107900 0x7f6cf819fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:28:40.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.309+0000 7f6cfc8bf640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf810ee30 con 0x7f6cf8101900 2024-09-21T12:28:40.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.309+0000 7f6cfc8bf640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6cf810ecb0 con 0x7f6cf8107900 2024-09-21T12:28:40.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.309+0000 7f6cf659c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6cf8101900 0x7f6cf819f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:28:40.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.309+0000 7f6cf659c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6cf8101900 0x7f6cf819f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56188/0 (socket says 172.21.15.3:56188) 2024-09-21T12:28:40.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.309+0000 7f6cf659c640 1 -- 172.21.15.3:0/3561563116 learned_addr learned my addr 172.21.15.3:0/3561563116 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:28:40.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.310+0000 7f6cf5d9b640 1 --2- 172.21.15.3:0/3561563116 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6cf8107900 0x7f6cf819fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:28:40.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.310+0000 7f6cf659c640 1 -- 172.21.15.3:0/3561563116 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6cf8107900 msgr2=0x7f6cf819fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:28:40.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.310+0000 7f6cf659c640 1 --2- 172.21.15.3:0/3561563116 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6cf8107900 0x7f6cf819fdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:40.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.310+0000 7f6cf659c640 1 -- 172.21.15.3:0/3561563116 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cf8199a50 con 0x7f6cf8101900 2024-09-21T12:28:40.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.310+0000 7f6cf659c640 1 --2- 172.21.15.3:0/3561563116 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6cf8101900 0x7f6cf819f890 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6ce800b420 tx=0x7f6ce800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:28:40.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.310+0000 7f6ce77fe640 1 -- 172.21.15.3:0/3561563116 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6ce8011630 con 0x7f6cf8101900 2024-09-21T12:28:40.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.310+0000 7f6ce77fe640 1 -- 172.21.15.3:0/3561563116 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6ce8016070 con 0x7f6cf8101900 2024-09-21T12:28:40.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.310+0000 7f6cfc8bf640 1 -- 172.21.15.3:0/3561563116 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cf8199d40 con 0x7f6cf8101900 2024-09-21T12:28:40.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.310+0000 7f6ce77fe640 1 -- 172.21.15.3:0/3561563116 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6ce8010d40 con 0x7f6cf8101900 2024-09-21T12:28:40.313 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.310+0000 7f6cfc8bf640 1 -- 172.21.15.3:0/3561563116 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cf819a2d0 con 0x7f6cf8101900 2024-09-21T12:28:40.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.311+0000 7f6cfc8bf640 1 -- 172.21.15.3:0/3561563116 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cf8103040 con 0x7f6cf8101900 2024-09-21T12:28:40.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.312+0000 7f6ce77fe640 1 -- 172.21.15.3:0/3561563116 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f6ce801b460 con 0x7f6cf8101900 2024-09-21T12:28:40.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.312+0000 7f6ce77fe640 1 --2- 172.21.15.3:0/3561563116 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f6ce007af30 0x7f6ce007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:28:40.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.312+0000 7f6ce77fe640 1 -- 172.21.15.3:0/3561563116 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 6156+0+0 (secure 0 0 0) 0x7f6ce809d7b0 con 0x7f6cf8101900 2024-09-21T12:28:40.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.312+0000 7f6cf5d9b640 1 --2- 172.21.15.3:0/3561563116 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f6ce007af30 0x7f6ce007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:28:40.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.313+0000 7f6cf5d9b640 1 --2- 172.21.15.3:0/3561563116 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f6ce007af30 0x7f6ce007d3f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6cec031460 tx=0x7f6cec009560 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:28:40.318 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.317+0000 7f6ce77fe640 1 -- 172.21.15.3:0/3561563116 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6ce8021250 con 0x7f6cf8101900 2024-09-21T12:28:40.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.524+0000 7f6cfc8bf640 1 -- 172.21.15.3:0/3561563116 --> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f6cf819a640 con 0x7f6ce007af30 2024-09-21T12:28:40.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.525+0000 7f6ce77fe640 1 -- 172.21.15.3:0/3561563116 <== mgr.14756 v2:172.21.15.3:6800/1284098095 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7f6cf819a640 con 0x7f6ce007af30 2024-09-21T12:28:40.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.527+0000 7f6cfc8bf640 1 -- 172.21.15.3:0/3561563116 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f6ce007af30 msgr2=0x7f6ce007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:28:40.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.527+0000 7f6cfc8bf640 1 --2- 172.21.15.3:0/3561563116 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f6ce007af30 0x7f6ce007d3f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6cec031460 tx=0x7f6cec009560 comp rx=0 tx=0).stop 2024-09-21T12:28:40.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.527+0000 7f6cfc8bf640 1 -- 172.21.15.3:0/3561563116 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6cf8101900 msgr2=0x7f6cf819f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:28:40.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.527+0000 7f6cfc8bf640 1 --2- 172.21.15.3:0/3561563116 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6cf8101900 0x7f6cf819f890 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6ce800b420 tx=0x7f6ce800b8e0 comp rx=0 tx=0).stop 2024-09-21T12:28:40.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.527+0000 7f6cfc8bf640 1 -- 172.21.15.3:0/3561563116 shutdown_connections 2024-09-21T12:28:40.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.527+0000 7f6cfc8bf640 1 --2- 172.21.15.3:0/3561563116 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f6ce007af30 0x7f6ce007d3f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:40.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.527+0000 7f6cfc8bf640 1 --2- 172.21.15.3:0/3561563116 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6cf8107900 0x7f6cf819fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:40.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.527+0000 7f6cfc8bf640 1 --2- 172.21.15.3:0/3561563116 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6cf8101900 0x7f6cf819f890 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:40.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.527+0000 7f6cfc8bf640 1 -- 172.21.15.3:0/3561563116 >> 172.21.15.3:0/3561563116 conn(0x7f6cf80fd600 msgr2=0x7f6cf80744d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:28:40.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.527+0000 7f6cfc8bf640 1 -- 172.21.15.3:0/3561563116 shutdown_connections 2024-09-21T12:28:40.529 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.527+0000 7f6cfc8bf640 1 -- 172.21.15.3:0/3561563116 wait complete. 2024-09-21T12:28:40.613 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.612+0000 7f7a33b21640 1 -- 172.21.15.3:0/1966547518 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7a2c102b10 msgr2=0x7f7a2c102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:28:40.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.612+0000 7f7a33b21640 1 --2- 172.21.15.3:0/1966547518 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7a2c102b10 0x7f7a2c102ef0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f7a280098b0 tx=0x7f7a2802a560 comp rx=0 tx=0).stop 2024-09-21T12:28:40.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.612+0000 7f7a33b21640 1 -- 172.21.15.3:0/1966547518 shutdown_connections 2024-09-21T12:28:40.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.612+0000 7f7a33b21640 1 --2- 172.21.15.3:0/1966547518 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7a2c103430 0x7f7a2c10b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:40.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.612+0000 7f7a33b21640 1 --2- 172.21.15.3:0/1966547518 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7a2c102b10 0x7f7a2c102ef0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:40.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.612+0000 7f7a33b21640 1 -- 172.21.15.3:0/1966547518 >> 172.21.15.3:0/1966547518 conn(0x7f7a2c0fc550 msgr2=0x7f7a2c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:28:40.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.612+0000 7f7a33b21640 1 -- 172.21.15.3:0/1966547518 shutdown_connections 2024-09-21T12:28:40.614 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.612+0000 7f7a33b21640 1 -- 172.21.15.3:0/1966547518 wait complete. 2024-09-21T12:28:40.615 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.613+0000 7f7a33b21640 1 Processor -- start 2024-09-21T12:28:40.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.613+0000 7f7a33b21640 1 -- start start 2024-09-21T12:28:40.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.613+0000 7f7a33b21640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7a2c102b10 0x7f7a2c19d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:28:40.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.613+0000 7f7a33b21640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7a2c103430 0x7f7a2c19db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:28:40.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.613+0000 7f7a33b21640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f7a2c10edc0 con 0x7f7a2c102b10 2024-09-21T12:28:40.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.613+0000 7f7a33b21640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f7a2c10ec40 con 0x7f7a2c103430 2024-09-21T12:28:40.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.613+0000 7f7a318bd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7a2c102b10 0x7f7a2c19d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:28:40.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.613+0000 7f7a318bd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7a2c102b10 0x7f7a2c19d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35196/0 (socket says 172.21.15.3:35196) 2024-09-21T12:28:40.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.613+0000 7f7a318bd640 1 -- 172.21.15.3:0/3090276783 learned_addr learned my addr 172.21.15.3:0/3090276783 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:28:40.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.613+0000 7f7a310bc640 1 --2- 172.21.15.3:0/3090276783 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7a2c103430 0x7f7a2c19db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:28:40.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.613+0000 7f7a318bd640 1 -- 172.21.15.3:0/3090276783 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7a2c103430 msgr2=0x7f7a2c19db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:28:40.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.613+0000 7f7a318bd640 1 --2- 172.21.15.3:0/3090276783 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7a2c103430 0x7f7a2c19db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:40.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.613+0000 7f7a318bd640 1 -- 172.21.15.3:0/3090276783 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a2c1977d0 con 0x7f7a2c102b10 2024-09-21T12:28:40.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.614+0000 7f7a318bd640 1 --2- 172.21.15.3:0/3090276783 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7a2c102b10 0x7f7a2c19d650 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7a280099d0 tx=0x7f7a280045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:28:40.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.614+0000 7f7a22ffd640 1 -- 172.21.15.3:0/3090276783 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7a2803f070 con 0x7f7a2c102b10 2024-09-21T12:28:40.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.614+0000 7f7a22ffd640 1 -- 172.21.15.3:0/3090276783 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f7a280035f0 con 0x7f7a2c102b10 2024-09-21T12:28:40.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.614+0000 7f7a33b21640 1 -- 172.21.15.3:0/3090276783 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a2c197a60 con 0x7f7a2c102b10 2024-09-21T12:28:40.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.614+0000 7f7a22ffd640 1 -- 172.21.15.3:0/3090276783 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f7a28035030 con 0x7f7a2c102b10 2024-09-21T12:28:40.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.614+0000 7f7a33b21640 1 -- 172.21.15.3:0/3090276783 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a2c197f90 con 0x7f7a2c102b10 2024-09-21T12:28:40.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.615+0000 7f7a33b21640 1 -- 172.21.15.3:0/3090276783 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a2c06a520 con 0x7f7a2c102b10 2024-09-21T12:28:40.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.616+0000 7f7a22ffd640 1 -- 172.21.15.3:0/3090276783 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f7a28042070 con 0x7f7a2c102b10 2024-09-21T12:28:40.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.616+0000 7f7a22ffd640 1 --2- 172.21.15.3:0/3090276783 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f7a1807af90 0x7f7a1807d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:28:40.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.616+0000 7f7a22ffd640 1 -- 172.21.15.3:0/3090276783 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 6156+0+0 (secure 0 0 0) 0x7f7a280be8d0 con 0x7f7a2c102b10 2024-09-21T12:28:40.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.616+0000 7f7a310bc640 1 --2- 172.21.15.3:0/3090276783 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f7a1807af90 0x7f7a1807d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:28:40.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.617+0000 7f7a310bc640 1 --2- 172.21.15.3:0/3090276783 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f7a1807af90 0x7f7a1807d450 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c108970 tx=0x7f7a1c00b390 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:28:40.622 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.621+0000 7f7a22ffd640 1 -- 172.21.15.3:0/3090276783 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f7a28089f50 con 0x7f7a2c102b10 2024-09-21T12:28:40.821 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.819+0000 7f7a33b21640 1 -- 172.21.15.3:0/3090276783 --> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f7a2c198240 con 0x7f7a1807af90 2024-09-21T12:28:40.830 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.829+0000 7f7a22ffd640 1 -- 172.21.15.3:0/3090276783 <== mgr.14756 v2:172.21.15.3:6800/1284098095 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f7a2c198240 con 0x7f7a1807af90 2024-09-21T12:28:40.831 INFO:teuthology.orchestra.run.smithi003.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:28:40.831 INFO:teuthology.orchestra.run.smithi003.stdout:alertmanager.smithi003 smithi003 *:9093,9094 running (5m) 85s ago 16m 19.0M - 0.27.0 11f11916f8cd 14880018dfd3 2024-09-21T12:28:40.831 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-exporter.smithi003 smithi003 running (7m) 85s ago 16m 8820k - 19.1.1-373-g4e45e6b4 164465d2334a 0c9ad60a4f5a 2024-09-21T12:28:40.831 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-exporter.smithi192 smithi192 running (7m) 16s ago 15m 8572k - 19.1.1-373-g4e45e6b4 164465d2334a d5be8a6e120f 2024-09-21T12:28:40.831 INFO:teuthology.orchestra.run.smithi003.stdout:crash.smithi003 smithi003 running (3m) 85s ago 16m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 0ada67250dba 2024-09-21T12:28:40.831 INFO:teuthology.orchestra.run.smithi003.stdout:crash.smithi192 smithi192 running (3m) 16s ago 15m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 52e279085b2e 2024-09-21T12:28:40.831 INFO:teuthology.orchestra.run.smithi003.stdout:grafana.smithi003 smithi003 *:3000 running (4m) 85s ago 16m 78.8M - 10.4.8 5aad1d7cf004 19e26b3cb585 2024-09-21T12:28:40.831 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi003.ebjgyl smithi003 running (10m) 85s ago 10m 17.2M - 19.1.1-373-g4e45e6b4 164465d2334a 16e0b2cac16a 2024-09-21T12:28:40.831 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi003.gfkngj smithi003 running (10m) 85s ago 10m 143M - 19.1.1-373-g4e45e6b4 164465d2334a 109c04f87fbd 2024-09-21T12:28:40.831 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi192.ktdqns smithi192 running (10m) 15s ago 10m 19.3M - 19.1.1-373-g4e45e6b4 164465d2334a 495c73fb3bb0 2024-09-21T12:28:40.831 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi192.ywqqxe smithi192 running (10m) 15s ago 10m 19.4M - 19.1.1-373-g4e45e6b4 164465d2334a 270a01030cbe 2024-09-21T12:28:40.831 INFO:teuthology.orchestra.run.smithi003.stdout:mgr.smithi003.wztftl smithi003 *:8443,9283,8765 running (7m) 85s ago 17m 525M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 8ce0e66fd369 2024-09-21T12:28:40.832 INFO:teuthology.orchestra.run.smithi003.stdout:mgr.smithi192.qsaprd smithi192 *:8443,9283,8765 running (6m) 15s ago 15m 458M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 002a6171dd47 2024-09-21T12:28:40.832 INFO:teuthology.orchestra.run.smithi003.stdout:mon.smithi003 smithi003 running (3m) 85s ago 17m 41.7M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 4f2b2b2daf19 2024-09-21T12:28:40.832 INFO:teuthology.orchestra.run.smithi003.stdout:mon.smithi192 smithi192 running (3m) 15s ago 15m 38.1M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 11edc5c1baba 2024-09-21T12:28:40.832 INFO:teuthology.orchestra.run.smithi003.stdout:node-exporter.smithi003 smithi003 *:9100 running (5m) 85s ago 16m 9353k - 1.7.0 72c9c2088986 d9cb7ede9060 2024-09-21T12:28:40.832 INFO:teuthology.orchestra.run.smithi003.stdout:node-exporter.smithi192 smithi192 *:9100 running (5m) 15s ago 15m 11.9M - 1.7.0 72c9c2088986 d8ec0acfce7e 2024-09-21T12:28:40.832 INFO:teuthology.orchestra.run.smithi003.stdout:osd.0 smithi003 running (2m) 85s ago 14m 82.1M 1217M 19.3.0-5103-g5c1cdc3c 8f4d013db793 0f2234f333ec 2024-09-21T12:28:40.832 INFO:teuthology.orchestra.run.smithi003.stdout:osd.1 smithi003 running (2m) 85s ago 13m 85.4M 1217M 19.3.0-5103-g5c1cdc3c 8f4d013db793 198ba21d0518 2024-09-21T12:28:40.832 INFO:teuthology.orchestra.run.smithi003.stdout:osd.2 smithi003 running (91s) 85s ago 13m 11.1M 1217M 19.3.0-5103-g5c1cdc3c 8f4d013db793 e630341e13d4 2024-09-21T12:28:40.832 INFO:teuthology.orchestra.run.smithi003.stdout:osd.3 smithi192 running (54s) 15s ago 12m 100M 2240M 19.3.0-5103-g5c1cdc3c 8f4d013db793 1b5fae2f2dd9 2024-09-21T12:28:40.832 INFO:teuthology.orchestra.run.smithi003.stdout:osd.4 smithi192 running (19s) 15s ago 12m 12.2M 2240M 19.3.0-5103-g5c1cdc3c 8f4d013db793 5b1bd4bec479 2024-09-21T12:28:40.832 INFO:teuthology.orchestra.run.smithi003.stdout:osd.5 smithi192 running (12m) 15s ago 12m 182M 2240M 19.1.1-373-g4e45e6b4 164465d2334a 12d7b7c8e985 2024-09-21T12:28:40.832 INFO:teuthology.orchestra.run.smithi003.stdout:prometheus.smithi003 smithi003 *:9095 running (5m) 85s ago 16m 54.6M - 2.51.0 1d3b7f56885b 64997a33fbbb 2024-09-21T12:28:40.833 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.831+0000 7f7a33b21640 1 -- 172.21.15.3:0/3090276783 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f7a1807af90 msgr2=0x7f7a1807d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:28:40.833 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.831+0000 7f7a33b21640 1 --2- 172.21.15.3:0/3090276783 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f7a1807af90 0x7f7a1807d450 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c108970 tx=0x7f7a1c00b390 comp rx=0 tx=0).stop 2024-09-21T12:28:40.833 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.831+0000 7f7a33b21640 1 -- 172.21.15.3:0/3090276783 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7a2c102b10 msgr2=0x7f7a2c19d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:28:40.833 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.831+0000 7f7a33b21640 1 --2- 172.21.15.3:0/3090276783 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7a2c102b10 0x7f7a2c19d650 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7a280099d0 tx=0x7f7a280045e0 comp rx=0 tx=0).stop 2024-09-21T12:28:40.833 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.831+0000 7f7a33b21640 1 -- 172.21.15.3:0/3090276783 shutdown_connections 2024-09-21T12:28:40.833 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.831+0000 7f7a33b21640 1 --2- 172.21.15.3:0/3090276783 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f7a1807af90 0x7f7a1807d450 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:40.833 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.831+0000 7f7a33b21640 1 --2- 172.21.15.3:0/3090276783 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f7a2c103430 0x7f7a2c19db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:40.834 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.831+0000 7f7a33b21640 1 --2- 172.21.15.3:0/3090276783 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f7a2c102b10 0x7f7a2c19d650 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:40.834 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.831+0000 7f7a33b21640 1 -- 172.21.15.3:0/3090276783 >> 172.21.15.3:0/3090276783 conn(0x7f7a2c0fc550 msgr2=0x7f7a2c107e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:28:40.834 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.832+0000 7f7a33b21640 1 -- 172.21.15.3:0/3090276783 shutdown_connections 2024-09-21T12:28:40.834 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.832+0000 7f7a33b21640 1 -- 172.21.15.3:0/3090276783 wait complete. 2024-09-21T12:28:40.917 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.915+0000 7fbec965a640 1 -- 172.21.15.3:0/3570230652 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbec4107910 msgr2=0x7fbec4107cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:28:40.917 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.915+0000 7fbec965a640 1 --2- 172.21.15.3:0/3570230652 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbec4107910 0x7fbec4107cf0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbeb4009880 tx=0x7fbeb402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:28:40.917 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.915+0000 7fbec965a640 1 -- 172.21.15.3:0/3570230652 shutdown_connections 2024-09-21T12:28:40.917 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.915+0000 7fbec965a640 1 --2- 172.21.15.3:0/3570230652 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbec4101910 0x7fbec4101d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:40.917 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.915+0000 7fbec965a640 1 --2- 172.21.15.3:0/3570230652 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbec4107910 0x7fbec4107cf0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:40.917 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.915+0000 7fbec965a640 1 -- 172.21.15.3:0/3570230652 >> 172.21.15.3:0/3570230652 conn(0x7fbec40fd630 msgr2=0x7fbec40ffa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:28:40.917 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.915+0000 7fbec965a640 1 -- 172.21.15.3:0/3570230652 shutdown_connections 2024-09-21T12:28:40.917 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.915+0000 7fbec965a640 1 -- 172.21.15.3:0/3570230652 wait complete. 2024-09-21T12:28:40.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.916+0000 7fbec965a640 1 Processor -- start 2024-09-21T12:28:40.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.916+0000 7fbec965a640 1 -- start start 2024-09-21T12:28:40.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.916+0000 7fbec965a640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbec4101910 0x7fbec40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:28:40.920 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.916+0000 7fbec965a640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbec4107910 0x7fbec4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:28:40.920 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.916+0000 7fbec965a640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fbec410ede0 con 0x7fbec4107910 2024-09-21T12:28:40.920 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.916+0000 7fbec965a640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fbec410ec60 con 0x7fbec4101910 2024-09-21T12:28:40.920 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.917+0000 7fbeba7fc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbec4107910 0x7fbec4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:28:40.920 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.917+0000 7fbeba7fc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbec4107910 0x7fbec4074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35224/0 (socket says 172.21.15.3:35224) 2024-09-21T12:28:40.920 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.917+0000 7fbeba7fc640 1 -- 172.21.15.3:0/3920889170 learned_addr learned my addr 172.21.15.3:0/3920889170 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:28:40.920 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.917+0000 7fbec2ffd640 1 --2- 172.21.15.3:0/3920889170 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbec4101910 0x7fbec40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:28:40.920 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.917+0000 7fbeba7fc640 1 -- 172.21.15.3:0/3920889170 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbec4101910 msgr2=0x7fbec40744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:28:40.920 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.917+0000 7fbeba7fc640 1 --2- 172.21.15.3:0/3920889170 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbec4101910 0x7fbec40744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:40.920 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.917+0000 7fbeba7fc640 1 -- 172.21.15.3:0/3920889170 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbec4074f70 con 0x7fbec4107910 2024-09-21T12:28:40.920 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.917+0000 7fbec2ffd640 1 --2- 172.21.15.3:0/3920889170 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbec4101910 0x7fbec40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T12:28:40.920 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.917+0000 7fbeba7fc640 1 --2- 172.21.15.3:0/3920889170 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbec4107910 0x7fbec4074a30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fbeac00e970 tx=0x7fbeac00ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:28:40.920 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.917+0000 7fbec0ff9640 1 -- 172.21.15.3:0/3920889170 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbeac00cac0 con 0x7fbec4107910 2024-09-21T12:28:40.921 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.917+0000 7fbec965a640 1 -- 172.21.15.3:0/3920889170 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbec4075260 con 0x7fbec4107910 2024-09-21T12:28:40.921 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.917+0000 7fbec0ff9640 1 -- 172.21.15.3:0/3920889170 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fbeac0054e0 con 0x7fbec4107910 2024-09-21T12:28:40.921 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.917+0000 7fbec0ff9640 1 -- 172.21.15.3:0/3920889170 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fbeac010430 con 0x7fbec4107910 2024-09-21T12:28:40.921 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.917+0000 7fbec965a640 1 -- 172.21.15.3:0/3920889170 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbec41a3e00 con 0x7fbec4107910 2024-09-21T12:28:40.922 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.918+0000 7fbec965a640 1 -- 172.21.15.3:0/3920889170 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbec4103050 con 0x7fbec4107910 2024-09-21T12:28:40.922 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.919+0000 7fbec0ff9640 1 -- 172.21.15.3:0/3920889170 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7fbeac004e80 con 0x7fbec4107910 2024-09-21T12:28:40.922 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.919+0000 7fbec0ff9640 1 --2- 172.21.15.3:0/3920889170 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fbeb007af30 0x7fbeb007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:28:40.922 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.920+0000 7fbec0ff9640 1 -- 172.21.15.3:0/3920889170 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 6156+0+0 (secure 0 0 0) 0x7fbeac09e740 con 0x7fbec4107910 2024-09-21T12:28:40.922 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.920+0000 7fbec2ffd640 1 --2- 172.21.15.3:0/3920889170 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fbeb007af30 0x7fbeb007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:28:40.922 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.920+0000 7fbec2ffd640 1 --2- 172.21.15.3:0/3920889170 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fbeb007af30 0x7fbeb007d3f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbeb4006010 tx=0x7fbeb40095f0 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:28:40.925 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:40.924+0000 7fbec0ff9640 1 -- 172.21.15.3:0/3920889170 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fbeac069d40 con 0x7fbec4107910 2024-09-21T12:28:41.192 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.191+0000 7fbec965a640 1 -- 172.21.15.3:0/3920889170 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fbec4109e80 con 0x7fbec4107910 2024-09-21T12:28:41.193 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.192+0000 7fbec0ff9640 1 -- 172.21.15.3:0/3920889170 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+836 (secure 0 0 0) 0x7fbeac06ebf0 con 0x7fbec4107910 2024-09-21T12:28:41.193 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-21T12:28:41.193 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": { 2024-09-21T12:28:41.193 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:28:41.194 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:28:41.194 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": { 2024-09-21T12:28:41.194 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:28:41.194 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:28:41.194 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": { 2024-09-21T12:28:41.194 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T12:28:41.194 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 5 2024-09-21T12:28:41.194 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:28:41.194 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": { 2024-09-21T12:28:41.194 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 4 2024-09-21T12:28:41.194 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:28:41.194 INFO:teuthology.orchestra.run.smithi003.stdout: "overall": { 2024-09-21T12:28:41.194 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 5, 2024-09-21T12:28:41.194 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 9 2024-09-21T12:28:41.194 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-21T12:28:41.195 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-21T12:28:41.196 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.194+0000 7fbec965a640 1 -- 172.21.15.3:0/3920889170 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fbeb007af30 msgr2=0x7fbeb007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:28:41.196 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.194+0000 7fbec965a640 1 --2- 172.21.15.3:0/3920889170 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fbeb007af30 0x7fbeb007d3f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbeb4006010 tx=0x7fbeb40095f0 comp rx=0 tx=0).stop 2024-09-21T12:28:41.196 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.194+0000 7fbec965a640 1 -- 172.21.15.3:0/3920889170 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbec4107910 msgr2=0x7fbec4074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:28:41.196 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.194+0000 7fbec965a640 1 --2- 172.21.15.3:0/3920889170 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbec4107910 0x7fbec4074a30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fbeac00e970 tx=0x7fbeac00ed70 comp rx=0 tx=0).stop 2024-09-21T12:28:41.196 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.194+0000 7fbec965a640 1 -- 172.21.15.3:0/3920889170 shutdown_connections 2024-09-21T12:28:41.196 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.194+0000 7fbec965a640 1 --2- 172.21.15.3:0/3920889170 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fbeb007af30 0x7fbeb007d3f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:41.196 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.194+0000 7fbec965a640 1 --2- 172.21.15.3:0/3920889170 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fbec4107910 0x7fbec4074a30 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:41.196 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.194+0000 7fbec965a640 1 --2- 172.21.15.3:0/3920889170 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fbec4101910 0x7fbec40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:41.197 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.194+0000 7fbec965a640 1 -- 172.21.15.3:0/3920889170 >> 172.21.15.3:0/3920889170 conn(0x7fbec40fd630 msgr2=0x7fbec40fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:28:41.197 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.194+0000 7fbec965a640 1 -- 172.21.15.3:0/3920889170 shutdown_connections 2024-09-21T12:28:41.197 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.195+0000 7fbec965a640 1 -- 172.21.15.3:0/3920889170 wait complete. 2024-09-21T12:28:41.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.278+0000 7f9f0043d640 1 -- 172.21.15.3:0/1134115814 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ef8107900 msgr2=0x7f9ef8107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:28:41.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.278+0000 7f9f0043d640 1 --2- 172.21.15.3:0/1134115814 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ef8107900 0x7f9ef8107ce0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9ef4009880 tx=0x7f9ef402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:28:41.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.278+0000 7f9f0043d640 1 -- 172.21.15.3:0/1134115814 shutdown_connections 2024-09-21T12:28:41.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.278+0000 7f9f0043d640 1 --2- 172.21.15.3:0/1134115814 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ef8101900 0x7f9ef8101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:41.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.278+0000 7f9f0043d640 1 --2- 172.21.15.3:0/1134115814 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ef8107900 0x7f9ef8107ce0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:41.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.278+0000 7f9f0043d640 1 -- 172.21.15.3:0/1134115814 >> 172.21.15.3:0/1134115814 conn(0x7f9ef80fd600 msgr2=0x7f9ef80ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:28:41.280 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.278+0000 7f9f0043d640 1 -- 172.21.15.3:0/1134115814 shutdown_connections 2024-09-21T12:28:41.281 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.278+0000 7f9f0043d640 1 -- 172.21.15.3:0/1134115814 wait complete. 2024-09-21T12:28:41.282 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.279+0000 7f9f0043d640 1 Processor -- start 2024-09-21T12:28:41.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.279+0000 7f9f0043d640 1 -- start start 2024-09-21T12:28:41.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.279+0000 7f9f0043d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ef8101900 0x7f9ef819d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:28:41.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.279+0000 7f9f0043d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ef8107900 0x7f9ef819db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:28:41.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.279+0000 7f9f0043d640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f9ef810edb0 con 0x7f9ef8107900 2024-09-21T12:28:41.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.279+0000 7f9f0043d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9ef810ec30 con 0x7f9ef8101900 2024-09-21T12:28:41.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.279+0000 7f9efd9d8640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ef8107900 0x7f9ef819db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:28:41.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.280+0000 7f9efd9d8640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ef8107900 0x7f9ef819db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35238/0 (socket says 172.21.15.3:35238) 2024-09-21T12:28:41.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.280+0000 7f9efd9d8640 1 -- 172.21.15.3:0/2670405536 learned_addr learned my addr 172.21.15.3:0/2670405536 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:28:41.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.280+0000 7f9efe1d9640 1 --2- 172.21.15.3:0/2670405536 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ef8101900 0x7f9ef819d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:28:41.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.280+0000 7f9efd9d8640 1 -- 172.21.15.3:0/2670405536 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ef8101900 msgr2=0x7f9ef819d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:28:41.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.280+0000 7f9efd9d8640 1 --2- 172.21.15.3:0/2670405536 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ef8101900 0x7f9ef819d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:41.283 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.280+0000 7f9efd9d8640 1 -- 172.21.15.3:0/2670405536 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ef81977c0 con 0x7f9ef8107900 2024-09-21T12:28:41.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.280+0000 7f9efe1d9640 1 --2- 172.21.15.3:0/2670405536 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ef8101900 0x7f9ef819d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:28:41.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.280+0000 7f9efd9d8640 1 --2- 172.21.15.3:0/2670405536 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ef8107900 0x7f9ef819db80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9ee800c810 tx=0x7f9ee800ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:28:41.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.280+0000 7f9eef7fe640 1 -- 172.21.15.3:0/2670405536 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9ee8004020 con 0x7f9ef8107900 2024-09-21T12:28:41.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.280+0000 7f9f0043d640 1 -- 172.21.15.3:0/2670405536 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ef8197ab0 con 0x7f9ef8107900 2024-09-21T12:28:41.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.280+0000 7f9eef7fe640 1 -- 172.21.15.3:0/2670405536 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9ee80041c0 con 0x7f9ef8107900 2024-09-21T12:28:41.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.280+0000 7f9eef7fe640 1 -- 172.21.15.3:0/2670405536 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9ee80047a0 con 0x7f9ef8107900 2024-09-21T12:28:41.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.280+0000 7f9f0043d640 1 -- 172.21.15.3:0/2670405536 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ef8198040 con 0x7f9ef8107900 2024-09-21T12:28:41.284 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.281+0000 7f9f0043d640 1 -- 172.21.15.3:0/2670405536 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ef8103040 con 0x7f9ef8107900 2024-09-21T12:28:41.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.282+0000 7f9eef7fe640 1 -- 172.21.15.3:0/2670405536 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f9ee80079b0 con 0x7f9ef8107900 2024-09-21T12:28:41.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.282+0000 7f9eef7fe640 1 --2- 172.21.15.3:0/2670405536 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f9ee407af30 0x7f9ee407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:28:41.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.283+0000 7f9eef7fe640 1 -- 172.21.15.3:0/2670405536 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 6156+0+0 (secure 0 0 0) 0x7f9ee809df20 con 0x7f9ef8107900 2024-09-21T12:28:41.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.283+0000 7f9efe1d9640 1 --2- 172.21.15.3:0/2670405536 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f9ee407af30 0x7f9ee407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:28:41.285 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.283+0000 7f9efe1d9640 1 --2- 172.21.15.3:0/2670405536 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f9ee407af30 0x7f9ee407d3f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9ef4031460 tx=0x7f9ef4009560 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:28:41.288 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.287+0000 7f9eef7fe640 1 -- 172.21.15.3:0/2670405536 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9ee8014030 con 0x7f9ef8107900 2024-09-21T12:28:41.515 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.514+0000 7f9f0043d640 1 -- 172.21.15.3:0/2670405536 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f9ef8104b10 con 0x7f9ef8107900 2024-09-21T12:28:41.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.514+0000 7f9eef7fe640 1 -- 172.21.15.3:0/2670405536 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) ==== 76+0+2010 (secure 0 0 0) 0x7f9ee8069520 con 0x7f9ef8107900 2024-09-21T12:28:41.516 INFO:teuthology.orchestra.run.smithi003.stdout:e14 2024-09-21T12:28:41.516 INFO:teuthology.orchestra.run.smithi003.stdout:btime 2024-09-21T12:17:55:592931+0000 2024-09-21T12:28:41.516 INFO:teuthology.orchestra.run.smithi003.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T12:28:41.516 INFO:teuthology.orchestra.run.smithi003.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:28:41.517 INFO:teuthology.orchestra.run.smithi003.stdout:legacy client fscid: 1 2024-09-21T12:28:41.517 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:28:41.517 INFO:teuthology.orchestra.run.smithi003.stdout:Filesystem 'cephfs' (1) 2024-09-21T12:28:41.517 INFO:teuthology.orchestra.run.smithi003.stdout:fs_name cephfs 2024-09-21T12:28:41.517 INFO:teuthology.orchestra.run.smithi003.stdout:epoch 14 2024-09-21T12:28:41.517 INFO:teuthology.orchestra.run.smithi003.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T12:28:41.517 INFO:teuthology.orchestra.run.smithi003.stdout:created 2024-09-21T12:17:38.260099+0000 2024-09-21T12:28:41.517 INFO:teuthology.orchestra.run.smithi003.stdout:modified 2024-09-21T12:17:55.592927+0000 2024-09-21T12:28:41.517 INFO:teuthology.orchestra.run.smithi003.stdout:tableserver 0 2024-09-21T12:28:41.517 INFO:teuthology.orchestra.run.smithi003.stdout:root 0 2024-09-21T12:28:41.517 INFO:teuthology.orchestra.run.smithi003.stdout:session_timeout 60 2024-09-21T12:28:41.517 INFO:teuthology.orchestra.run.smithi003.stdout:session_autoclose 300 2024-09-21T12:28:41.517 INFO:teuthology.orchestra.run.smithi003.stdout:max_file_size 1099511627776 2024-09-21T12:28:41.518 INFO:teuthology.orchestra.run.smithi003.stdout:max_xattr_size 65536 2024-09-21T12:28:41.518 INFO:teuthology.orchestra.run.smithi003.stdout:required_client_features {} 2024-09-21T12:28:41.518 INFO:teuthology.orchestra.run.smithi003.stdout:last_failure 0 2024-09-21T12:28:41.518 INFO:teuthology.orchestra.run.smithi003.stdout:last_failure_osd_epoch 46 2024-09-21T12:28:41.518 INFO:teuthology.orchestra.run.smithi003.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:28:41.518 INFO:teuthology.orchestra.run.smithi003.stdout:max_mds 1 2024-09-21T12:28:41.518 INFO:teuthology.orchestra.run.smithi003.stdout:in 0 2024-09-21T12:28:41.518 INFO:teuthology.orchestra.run.smithi003.stdout:up {0=14564} 2024-09-21T12:28:41.518 INFO:teuthology.orchestra.run.smithi003.stdout:failed 2024-09-21T12:28:41.518 INFO:teuthology.orchestra.run.smithi003.stdout:damaged 2024-09-21T12:28:41.518 INFO:teuthology.orchestra.run.smithi003.stdout:stopped 2024-09-21T12:28:41.519 INFO:teuthology.orchestra.run.smithi003.stdout:data_pools [3] 2024-09-21T12:28:41.519 INFO:teuthology.orchestra.run.smithi003.stdout:metadata_pool 2 2024-09-21T12:28:41.519 INFO:teuthology.orchestra.run.smithi003.stdout:inline_data enabled 2024-09-21T12:28:41.519 INFO:teuthology.orchestra.run.smithi003.stdout:balancer 2024-09-21T12:28:41.519 INFO:teuthology.orchestra.run.smithi003.stdout:bal_rank_mask -1 2024-09-21T12:28:41.519 INFO:teuthology.orchestra.run.smithi003.stdout:standby_count_wanted 1 2024-09-21T12:28:41.519 INFO:teuthology.orchestra.run.smithi003.stdout:qdb_cluster leader: 14564 members: 14564 2024-09-21T12:28:41.519 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.cephfs.smithi003.gfkngj{0:14564} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.3:6828/3710817325,v1:172.21.15.3:6829/3710817325] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:28:41.519 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:28:41.519 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:28:41.519 INFO:teuthology.orchestra.run.smithi003.stdout:Standby daemons: 2024-09-21T12:28:41.519 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:28:41.519 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.cephfs.smithi192.ywqqxe{-1:24319} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.192:6824/4055220871,v1:172.21.15.192:6825/4055220871] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:28:41.520 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.cephfs.smithi192.ktdqns{-1:24337} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.192:6826/318800854,v1:172.21.15.192:6827/318800854] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:28:41.520 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.cephfs.smithi003.ebjgyl{-1:24345} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.3:6826/55902996,v1:172.21.15.3:6827/55902996] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:28:41.520 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 14 2024-09-21T12:28:41.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.516+0000 7f9f0043d640 1 -- 172.21.15.3:0/2670405536 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f9ee407af30 msgr2=0x7f9ee407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:28:41.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.516+0000 7f9f0043d640 1 --2- 172.21.15.3:0/2670405536 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f9ee407af30 0x7f9ee407d3f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9ef4031460 tx=0x7f9ef4009560 comp rx=0 tx=0).stop 2024-09-21T12:28:41.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.516+0000 7f9f0043d640 1 -- 172.21.15.3:0/2670405536 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ef8107900 msgr2=0x7f9ef819db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:28:41.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.516+0000 7f9f0043d640 1 --2- 172.21.15.3:0/2670405536 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ef8107900 0x7f9ef819db80 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9ee800c810 tx=0x7f9ee800ccd0 comp rx=0 tx=0).stop 2024-09-21T12:28:41.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.517+0000 7f9f0043d640 1 -- 172.21.15.3:0/2670405536 shutdown_connections 2024-09-21T12:28:41.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.517+0000 7f9f0043d640 1 --2- 172.21.15.3:0/2670405536 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f9ee407af30 0x7f9ee407d3f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:41.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.517+0000 7f9f0043d640 1 --2- 172.21.15.3:0/2670405536 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9ef8107900 0x7f9ef819db80 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:41.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.517+0000 7f9f0043d640 1 --2- 172.21.15.3:0/2670405536 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9ef8101900 0x7f9ef819d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:41.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.517+0000 7f9f0043d640 1 -- 172.21.15.3:0/2670405536 >> 172.21.15.3:0/2670405536 conn(0x7f9ef80fd600 msgr2=0x7f9ef80ff030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:28:41.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.517+0000 7f9f0043d640 1 -- 172.21.15.3:0/2670405536 shutdown_connections 2024-09-21T12:28:41.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.517+0000 7f9f0043d640 1 -- 172.21.15.3:0/2670405536 wait complete. 2024-09-21T12:28:41.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.602+0000 7f08368ff640 1 -- 172.21.15.3:0/1579599107 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0830106800 msgr2=0x7f0830106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:28:41.604 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.602+0000 7f08368ff640 1 --2- 172.21.15.3:0/1579599107 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0830106800 0x7f0830106be0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0820009880 tx=0x7f082002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:28:41.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.602+0000 7f08368ff640 1 -- 172.21.15.3:0/1579599107 shutdown_connections 2024-09-21T12:28:41.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.602+0000 7f08368ff640 1 --2- 172.21.15.3:0/1579599107 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0830100800 0x7f0830100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:41.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.602+0000 7f08368ff640 1 --2- 172.21.15.3:0/1579599107 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0830106800 0x7f0830106be0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:41.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.602+0000 7f08368ff640 1 -- 172.21.15.3:0/1579599107 >> 172.21.15.3:0/1579599107 conn(0x7f08300fc520 msgr2=0x7f08300fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:28:41.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.602+0000 7f08368ff640 1 -- 172.21.15.3:0/1579599107 shutdown_connections 2024-09-21T12:28:41.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.602+0000 7f08368ff640 1 -- 172.21.15.3:0/1579599107 wait complete. 2024-09-21T12:28:41.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.603+0000 7f08368ff640 1 Processor -- start 2024-09-21T12:28:41.605 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.603+0000 7f08368ff640 1 -- start start 2024-09-21T12:28:41.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.603+0000 7f08368ff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0830100800 0x7f0830107730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:28:41.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.603+0000 7f08368ff640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0830106800 0x7f0830107c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:28:41.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.603+0000 7f08368ff640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f083010dcb0 con 0x7f0830100800 2024-09-21T12:28:41.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.603+0000 7f08368ff640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f083010db30 con 0x7f0830106800 2024-09-21T12:28:41.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.603+0000 7f082ffff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0830100800 0x7f0830107730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:28:41.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.603+0000 7f082ffff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0830100800 0x7f0830107730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35256/0 (socket says 172.21.15.3:35256) 2024-09-21T12:28:41.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.603+0000 7f082ffff640 1 -- 172.21.15.3:0/919373063 learned_addr learned my addr 172.21.15.3:0/919373063 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:28:41.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.604+0000 7f082f7fe640 1 --2- 172.21.15.3:0/919373063 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0830106800 0x7f0830107c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:28:41.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.604+0000 7f082ffff640 1 -- 172.21.15.3:0/919373063 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0830106800 msgr2=0x7f0830107c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:28:41.607 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.604+0000 7f082ffff640 1 --2- 172.21.15.3:0/919373063 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0830106800 0x7f0830107c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:41.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.604+0000 7f082ffff640 1 -- 172.21.15.3:0/919373063 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08301081b0 con 0x7f0830100800 2024-09-21T12:28:41.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.604+0000 7f082f7fe640 1 --2- 172.21.15.3:0/919373063 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0830106800 0x7f0830107c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:28:41.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.604+0000 7f082ffff640 1 --2- 172.21.15.3:0/919373063 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0830100800 0x7f0830107730 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0820031460 tx=0x7f08200045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:28:41.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.604+0000 7f082d7fa640 1 -- 172.21.15.3:0/919373063 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f082003f070 con 0x7f0830100800 2024-09-21T12:28:41.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.604+0000 7f082d7fa640 1 -- 172.21.15.3:0/919373063 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f08200035f0 con 0x7f0830100800 2024-09-21T12:28:41.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.604+0000 7f08368ff640 1 -- 172.21.15.3:0/919373063 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0830108440 con 0x7f0830100800 2024-09-21T12:28:41.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.604+0000 7f082d7fa640 1 -- 172.21.15.3:0/919373063 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0820035030 con 0x7f0830100800 2024-09-21T12:28:41.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.604+0000 7f08368ff640 1 -- 172.21.15.3:0/919373063 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08301a3d50 con 0x7f0830100800 2024-09-21T12:28:41.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.605+0000 7f08368ff640 1 -- 172.21.15.3:0/919373063 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0830101f40 con 0x7f0830100800 2024-09-21T12:28:41.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.606+0000 7f082d7fa640 1 -- 172.21.15.3:0/919373063 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f0820042070 con 0x7f0830100800 2024-09-21T12:28:41.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.606+0000 7f082d7fa640 1 --2- 172.21.15.3:0/919373063 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f081807af30 0x7f081807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:28:41.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.607+0000 7f082d7fa640 1 -- 172.21.15.3:0/919373063 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 6156+0+0 (secure 0 0 0) 0x7f08200bea20 con 0x7f0830100800 2024-09-21T12:28:41.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.607+0000 7f082f7fe640 1 --2- 172.21.15.3:0/919373063 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f081807af30 0x7f081807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:28:41.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.607+0000 7f082f7fe640 1 --2- 172.21.15.3:0/919373063 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f081807af30 0x7f081807d3f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f08240058c0 tx=0x7f0824005850 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:28:41.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.611+0000 7f082d7fa640 1 -- 172.21.15.3:0/919373063 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f082008a020 con 0x7f0830100800 2024-09-21T12:28:41.816 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.815+0000 7f08368ff640 1 -- 172.21.15.3:0/919373063 --> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f083006a9c0 con 0x7f081807af30 2024-09-21T12:28:41.818 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.817+0000 7f082d7fa640 1 -- 172.21.15.3:0/919373063 <== mgr.14756 v2:172.21.15.3:6800/1284098095 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+401 (secure 0 0 0) 0x7f083006a9c0 con 0x7f081807af30 2024-09-21T12:28:41.818 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-21T12:28:41.818 INFO:teuthology.orchestra.run.smithi003.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T12:28:41.819 INFO:teuthology.orchestra.run.smithi003.stdout: "in_progress": true, 2024-09-21T12:28:41.819 INFO:teuthology.orchestra.run.smithi003.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T12:28:41.819 INFO:teuthology.orchestra.run.smithi003.stdout: "services_complete": [ 2024-09-21T12:28:41.819 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr", 2024-09-21T12:28:41.819 INFO:teuthology.orchestra.run.smithi003.stdout: "mon", 2024-09-21T12:28:41.819 INFO:teuthology.orchestra.run.smithi003.stdout: "crash" 2024-09-21T12:28:41.819 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-21T12:28:41.819 INFO:teuthology.orchestra.run.smithi003.stdout: "progress": "11/23 daemons upgraded", 2024-09-21T12:28:41.819 INFO:teuthology.orchestra.run.smithi003.stdout: "message": "Currently upgrading osd daemons", 2024-09-21T12:28:41.819 INFO:teuthology.orchestra.run.smithi003.stdout: "is_paused": false 2024-09-21T12:28:41.819 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-21T12:28:41.821 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.819+0000 7f08368ff640 1 -- 172.21.15.3:0/919373063 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f081807af30 msgr2=0x7f081807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:28:41.821 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.819+0000 7f08368ff640 1 --2- 172.21.15.3:0/919373063 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f081807af30 0x7f081807d3f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f08240058c0 tx=0x7f0824005850 comp rx=0 tx=0).stop 2024-09-21T12:28:41.821 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.819+0000 7f08368ff640 1 -- 172.21.15.3:0/919373063 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0830100800 msgr2=0x7f0830107730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:28:41.821 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.819+0000 7f08368ff640 1 --2- 172.21.15.3:0/919373063 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0830100800 0x7f0830107730 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0820031460 tx=0x7f08200045e0 comp rx=0 tx=0).stop 2024-09-21T12:28:41.821 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.819+0000 7f08368ff640 1 -- 172.21.15.3:0/919373063 shutdown_connections 2024-09-21T12:28:41.822 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.819+0000 7f08368ff640 1 --2- 172.21.15.3:0/919373063 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f081807af30 0x7f081807d3f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:41.822 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.819+0000 7f08368ff640 1 --2- 172.21.15.3:0/919373063 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0830106800 0x7f0830107c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:41.822 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.819+0000 7f08368ff640 1 --2- 172.21.15.3:0/919373063 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0830100800 0x7f0830107730 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:41.822 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.819+0000 7f08368ff640 1 -- 172.21.15.3:0/919373063 >> 172.21.15.3:0/919373063 conn(0x7f08300fc520 msgr2=0x7f083006a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:28:41.822 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.819+0000 7f08368ff640 1 -- 172.21.15.3:0/919373063 shutdown_connections 2024-09-21T12:28:41.822 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.819+0000 7f08368ff640 1 -- 172.21.15.3:0/919373063 wait complete. 2024-09-21T12:28:41.906 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.904+0000 7f1d38564640 1 -- 172.21.15.3:0/2738871063 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1d30107900 msgr2=0x7f1d30107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:28:41.906 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.904+0000 7f1d38564640 1 --2- 172.21.15.3:0/2738871063 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1d30107900 0x7f1d30107ce0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c009880 tx=0x7f1d2c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:28:41.906 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.904+0000 7f1d38564640 1 -- 172.21.15.3:0/2738871063 shutdown_connections 2024-09-21T12:28:41.906 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.904+0000 7f1d38564640 1 --2- 172.21.15.3:0/2738871063 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d30101900 0x7f1d30101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:41.907 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.904+0000 7f1d38564640 1 --2- 172.21.15.3:0/2738871063 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1d30107900 0x7f1d30107ce0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:41.907 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.904+0000 7f1d38564640 1 -- 172.21.15.3:0/2738871063 >> 172.21.15.3:0/2738871063 conn(0x7f1d300fd5e0 msgr2=0x7f1d300ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:28:41.907 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.904+0000 7f1d38564640 1 -- 172.21.15.3:0/2738871063 shutdown_connections 2024-09-21T12:28:41.907 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.904+0000 7f1d38564640 1 -- 172.21.15.3:0/2738871063 wait complete. 2024-09-21T12:28:41.907 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.905+0000 7f1d38564640 1 Processor -- start 2024-09-21T12:28:41.907 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.905+0000 7f1d38564640 1 -- start start 2024-09-21T12:28:41.908 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.905+0000 7f1d38564640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1d30101900 0x7f1d3019d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:28:41.908 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.905+0000 7f1d38564640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d30107900 0x7f1d3019dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:28:41.908 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.905+0000 7f1d38564640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f1d3010edb0 con 0x7f1d30101900 2024-09-21T12:28:41.908 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.905+0000 7f1d38564640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f1d3010ec30 con 0x7f1d30107900 2024-09-21T12:28:41.908 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.905+0000 7f1d36300640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1d30101900 0x7f1d3019d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:28:41.908 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.905+0000 7f1d36300640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1d30101900 0x7f1d3019d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:35266/0 (socket says 172.21.15.3:35266) 2024-09-21T12:28:41.909 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.905+0000 7f1d36300640 1 -- 172.21.15.3:0/1020347262 learned_addr learned my addr 172.21.15.3:0/1020347262 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:28:41.909 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.906+0000 7f1d35aff640 1 --2- 172.21.15.3:0/1020347262 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d30107900 0x7f1d3019dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:28:41.909 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.906+0000 7f1d36300640 1 -- 172.21.15.3:0/1020347262 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d30107900 msgr2=0x7f1d3019dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:28:41.909 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.906+0000 7f1d36300640 1 --2- 172.21.15.3:0/1020347262 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d30107900 0x7f1d3019dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:41.909 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.906+0000 7f1d36300640 1 -- 172.21.15.3:0/1020347262 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d30197770 con 0x7f1d30101900 2024-09-21T12:28:41.909 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.906+0000 7f1d36300640 1 --2- 172.21.15.3:0/1020347262 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1d30101900 0x7f1d3019d6a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c031460 tx=0x7f1d2c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:28:41.909 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.906+0000 7f1d277fe640 1 -- 172.21.15.3:0/1020347262 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1d2c03f070 con 0x7f1d30101900 2024-09-21T12:28:41.909 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.906+0000 7f1d277fe640 1 -- 172.21.15.3:0/1020347262 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1d2c004cf0 con 0x7f1d30101900 2024-09-21T12:28:41.909 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.906+0000 7f1d38564640 1 -- 172.21.15.3:0/1020347262 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d30197a00 con 0x7f1d30101900 2024-09-21T12:28:41.909 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.906+0000 7f1d277fe640 1 -- 172.21.15.3:0/1020347262 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1d2c035030 con 0x7f1d30101900 2024-09-21T12:28:41.909 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.906+0000 7f1d38564640 1 -- 172.21.15.3:0/1020347262 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d30197f00 con 0x7f1d30101900 2024-09-21T12:28:41.910 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.907+0000 7f1d38564640 1 -- 172.21.15.3:0/1020347262 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d30103040 con 0x7f1d30101900 2024-09-21T12:28:41.910 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.908+0000 7f1d277fe640 1 -- 172.21.15.3:0/1020347262 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f1d2c042070 con 0x7f1d30101900 2024-09-21T12:28:41.910 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.908+0000 7f1d277fe640 1 --2- 172.21.15.3:0/1020347262 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f1d1c07af30 0x7f1d1c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:28:41.910 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.908+0000 7f1d277fe640 1 -- 172.21.15.3:0/1020347262 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 6156+0+0 (secure 0 0 0) 0x7f1d2c0beac0 con 0x7f1d30101900 2024-09-21T12:28:41.910 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.908+0000 7f1d35aff640 1 --2- 172.21.15.3:0/1020347262 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f1d1c07af30 0x7f1d1c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:28:41.910 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.909+0000 7f1d35aff640 1 --2- 172.21.15.3:0/1020347262 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f1d1c07af30 0x7f1d1c07d3f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1d30198fc0 tx=0x7f1d20005c60 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:28:41.914 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:41.913+0000 7f1d277fe640 1 -- 172.21.15.3:0/1020347262 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1d2c08a0c0 con 0x7f1d30101900 2024-09-21T12:28:42.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:41 smithi003 ceph-mon[108723]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:28:42.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:41 smithi003 ceph-mon[108723]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:28:42.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:41 smithi003 ceph-mon[108723]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:28:42.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:41 smithi003 ceph-mon[108723]: pgmap v229: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:28:42.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:41 smithi003 ceph-mon[108723]: from='client.? 172.21.15.3:0/3920889170' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:28:42.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:41 smithi003 ceph-mon[108723]: from='client.? 172.21.15.3:0/2670405536' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:28:42.175 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:42.174+0000 7f1d38564640 1 -- 172.21.15.3:0/1020347262 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f1d30104b10 con 0x7f1d30101900 2024-09-21T12:28:42.176 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:42.175+0000 7f1d277fe640 1 -- 172.21.15.3:0/1020347262 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7f1d2c08ef70 con 0x7f1d30101900 2024-09-21T12:28:42.176 INFO:teuthology.orchestra.run.smithi003.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-21T12:28:42.176 INFO:teuthology.orchestra.run.smithi003.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:28:42.176 INFO:teuthology.orchestra.run.smithi003.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:28:42.178 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:42.177+0000 7f1d38564640 1 -- 172.21.15.3:0/1020347262 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f1d1c07af30 msgr2=0x7f1d1c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:28:42.179 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:42.177+0000 7f1d38564640 1 --2- 172.21.15.3:0/1020347262 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f1d1c07af30 0x7f1d1c07d3f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f1d30198fc0 tx=0x7f1d20005c60 comp rx=0 tx=0).stop 2024-09-21T12:28:42.179 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:42.177+0000 7f1d38564640 1 -- 172.21.15.3:0/1020347262 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1d30101900 msgr2=0x7f1d3019d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:28:42.179 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:42.177+0000 7f1d38564640 1 --2- 172.21.15.3:0/1020347262 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1d30101900 0x7f1d3019d6a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c031460 tx=0x7f1d2c0048f0 comp rx=0 tx=0).stop 2024-09-21T12:28:42.179 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:42.177+0000 7f1d38564640 1 -- 172.21.15.3:0/1020347262 shutdown_connections 2024-09-21T12:28:42.179 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:42.177+0000 7f1d38564640 1 --2- 172.21.15.3:0/1020347262 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f1d1c07af30 0x7f1d1c07d3f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:42.179 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:42.177+0000 7f1d38564640 1 --2- 172.21.15.3:0/1020347262 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1d30107900 0x7f1d3019dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:42.179 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:42.177+0000 7f1d38564640 1 --2- 172.21.15.3:0/1020347262 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1d30101900 0x7f1d3019d6a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:28:42.179 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:42.177+0000 7f1d38564640 1 -- 172.21.15.3:0/1020347262 >> 172.21.15.3:0/1020347262 conn(0x7f1d300fd5e0 msgr2=0x7f1d300fefe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:28:42.179 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:42.177+0000 7f1d38564640 1 -- 172.21.15.3:0/1020347262 shutdown_connections 2024-09-21T12:28:42.179 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:28:42.177+0000 7f1d38564640 1 -- 172.21.15.3:0/1020347262 wait complete. 2024-09-21T12:28:42.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:41 smithi192 ceph-mon[80326]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:28:42.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:41 smithi192 ceph-mon[80326]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:28:42.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:41 smithi192 ceph-mon[80326]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:28:42.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:41 smithi192 ceph-mon[80326]: pgmap v229: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:28:42.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:41 smithi192 ceph-mon[80326]: from='client.? 172.21.15.3:0/3920889170' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:28:42.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:41 smithi192 ceph-mon[80326]: from='client.? 172.21.15.3:0/2670405536' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:28:43.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:42 smithi192 ceph-mon[80326]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:28:43.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:42 smithi192 ceph-mon[80326]: from='client.? 172.21.15.3:0/1020347262' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:28:43.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:42 smithi003 ceph-mon[108723]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:28:43.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:42 smithi003 ceph-mon[108723]: from='client.? 172.21.15.3:0/1020347262' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:28:44.243 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:43 smithi192 ceph-mon[80326]: pgmap v230: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:28:44.243 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:43 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-21T12:28:44.243 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:43 smithi192 ceph-mon[80326]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-21T12:28:44.243 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:43 smithi192 ceph-mon[80326]: Upgrade: osd.5 is safe to restart 2024-09-21T12:28:44.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:43 smithi003 ceph-mon[108723]: pgmap v230: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:28:44.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:43 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16} : dispatch 2024-09-21T12:28:44.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:43 smithi003 ceph-mon[108723]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-21T12:28:44.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:43 smithi003 ceph-mon[108723]: Upgrade: osd.5 is safe to restart 2024-09-21T12:28:46.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:45 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:28:46.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:45 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:28:46.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:45 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:28:46.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:45 smithi192 ceph-mon[80326]: pgmap v231: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:28:46.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:45 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:28:46.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:45 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T12:28:46.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:45 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:28:46.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:45 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:28:46.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:45 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:28:46.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:45 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:28:46.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:45 smithi003 ceph-mon[108723]: pgmap v231: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:28:46.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:45 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:28:46.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:45 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "auth get", "entity": "osd.5"} : dispatch 2024-09-21T12:28:46.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:45 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:28:46.915 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:46 smithi192 ceph-mon[80326]: Upgrade: Updating osd.5 2024-09-21T12:28:46.915 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:46 smithi192 ceph-mon[80326]: Deploying daemon osd.5 on smithi192 2024-09-21T12:28:47.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:46 smithi003 ceph-mon[108723]: Upgrade: Updating osd.5 2024-09-21T12:28:47.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:46 smithi003 ceph-mon[108723]: Deploying daemon osd.5 on smithi192 2024-09-21T12:28:48.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:47 smithi003 ceph-mon[108723]: pgmap v232: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:28:48.165 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:47 smithi192 ceph-mon[80326]: pgmap v232: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:28:48.165 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:28:47 smithi192 systemd[1]: Stopping Ceph osd.5 for 641beec0-7812-11ef-baf6-efdc52797490... 2024-09-21T12:28:48.475 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:28:48 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-5[55064]: 2024-09-21T12:28:48.163+0000 7fe231282640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T12:28:48.475 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:28:48 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-5[55064]: 2024-09-21T12:28:48.163+0000 7fe231282640 -1 osd.5 73 *** Got signal Terminated *** 2024-09-21T12:28:48.475 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:28:48 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-5[55064]: 2024-09-21T12:28:48.163+0000 7fe231282640 -1 osd.5 73 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T12:28:49.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:48 smithi192 ceph-mon[80326]: osd.5 marked itself down and dead 2024-09-21T12:28:49.151 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:48 smithi003 ceph-mon[108723]: osd.5 marked itself down and dead 2024-09-21T12:28:49.415 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:28:49 smithi192 podman[97197]: 2024-09-21 12:28:49.131604593 +0000 UTC m=+1.094629703 container died 12d7b7c8e9859003d21196997447666eb174f0e3ba417b295173d4e844b0b187 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=squid-4e45e6b) 2024-09-21T12:28:49.757 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:28:49 smithi192 podman[97197]: 2024-09-21 12:28:49.51313774 +0000 UTC m=+1.476162838 container cleanup 12d7b7c8e9859003d21196997447666eb174f0e3ba417b295173d4e844b0b187 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-5, RELEASE=squid-4e45e6b, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-21T12:28:49.757 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:28:49 smithi192 bash[97197]: ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-5 2024-09-21T12:28:50.007 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:28:49 smithi192 podman[97216]: 2024-09-21 12:28:49.756055608 +0000 UTC m=+0.623347323 container remove 12d7b7c8e9859003d21196997447666eb174f0e3ba417b295173d4e844b0b187 (image=quay.ceph.io/ceph-ci/ceph@sha256:f3429f9fdc6da1a3bba9b3b7353043861d7430d80bfe651414b12f783f35cd64, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-5, org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-4e45e6b, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-21T12:28:50.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:49 smithi192 ceph-mon[80326]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T12:28:50.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:49 smithi192 ceph-mon[80326]: osdmap e74: 6 total, 5 up, 6 in 2024-09-21T12:28:50.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:49 smithi192 ceph-mon[80326]: pgmap v234: 65 pgs: 13 stale+active+clean, 52 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:28:50.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:49 smithi003 ceph-mon[108723]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-21T12:28:50.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:49 smithi003 ceph-mon[108723]: osdmap e74: 6 total, 5 up, 6 in 2024-09-21T12:28:50.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:49 smithi003 ceph-mon[108723]: pgmap v234: 65 pgs: 13 stale+active+clean, 52 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:28:50.385 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:28:50 smithi192 podman[97304]: 2024-09-21 12:28:49.985979344 +0000 UTC m=+0.015672767 image pull 8f4d013db793795fef09ff5edf96e6b42ba8cd2c9158b2f0b7a5d7c1e657c063 quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 2024-09-21T12:28:50.386 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:28:50 smithi192 podman[97304]: 2024-09-21 12:28:50.098945482 +0000 UTC m=+0.128638938 container create 58f23a321f1a118553afbc8dc13044195739d87adddc0eb936a168754a749004 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-5-deactivate, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=) 2024-09-21T12:28:50.386 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:28:50 smithi192 podman[97304]: 2024-09-21 12:28:50.293144171 +0000 UTC m=+0.322837591 container init 58f23a321f1a118553afbc8dc13044195739d87adddc0eb936a168754a749004 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-5-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-21T12:28:50.386 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:28:50 smithi192 podman[97304]: 2024-09-21 12:28:50.296604221 +0000 UTC m=+0.326297645 container start 58f23a321f1a118553afbc8dc13044195739d87adddc0eb936a168754a749004 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-5-deactivate, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T12:28:50.386 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:28:50 smithi192 podman[97304]: 2024-09-21 12:28:50.38476052 +0000 UTC m=+0.414453960 container attach 58f23a321f1a118553afbc8dc13044195739d87adddc0eb936a168754a749004 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-5-deactivate, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-21T12:28:50.757 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:28:50 smithi192 podman[97304]: 2024-09-21 12:28:50.485354704 +0000 UTC m=+0.515048119 container died 58f23a321f1a118553afbc8dc13044195739d87adddc0eb936a168754a749004 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-5-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-21T12:28:51.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:50 smithi003 ceph-mon[108723]: osdmap e75: 6 total, 5 up, 6 in 2024-09-21T12:28:51.106 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:50 smithi192 ceph-mon[80326]: osdmap e75: 6 total, 5 up, 6 in 2024-09-21T12:28:51.508 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:28:51 smithi192 podman[97328]: 2024-09-21 12:28:51.105012846 +0000 UTC m=+0.613451116 container remove 58f23a321f1a118553afbc8dc13044195739d87adddc0eb936a168754a749004 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-5-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T12:28:51.508 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:28:51 smithi192 systemd[1]: ceph-641beec0-7812-11ef-baf6-efdc52797490@osd.5.service: Deactivated successfully. 2024-09-21T12:28:51.508 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:28:51 smithi192 systemd[1]: Stopped Ceph osd.5 for 641beec0-7812-11ef-baf6-efdc52797490. 2024-09-21T12:28:51.509 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:28:51 smithi192 systemd[1]: ceph-641beec0-7812-11ef-baf6-efdc52797490@osd.5.service: Consumed 49.815s CPU time. 2024-09-21T12:28:51.509 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:28:51 smithi192 systemd[1]: Starting Ceph osd.5 for 641beec0-7812-11ef-baf6-efdc52797490... 2024-09-21T12:28:51.826 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:51 smithi192 ceph-mon[80326]: pgmap v236: 65 pgs: 8 active+undersized, 7 peering, 3 stale+active+clean, 8 active+undersized+degraded, 39 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 29/279 objects degraded (10.394%) 2024-09-21T12:28:51.827 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:28:51 smithi192 podman[97425]: 2024-09-21 12:28:51.449897189 +0000 UTC m=+0.015835302 image pull 8f4d013db793795fef09ff5edf96e6b42ba8cd2c9158b2f0b7a5d7c1e657c063 quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 2024-09-21T12:28:51.827 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:28:51 smithi192 podman[97425]: 2024-09-21 12:28:51.590027448 +0000 UTC m=+0.155965545 container create 5ae4ebbf7f938f82e2439ece071875a553d4268aa600049c523e81b0414a33bb (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-5-activate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-21T12:28:51.827 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:28:51 smithi192 podman[97425]: 2024-09-21 12:28:51.825823398 +0000 UTC m=+0.391761503 container init 5ae4ebbf7f938f82e2439ece071875a553d4268aa600049c523e81b0414a33bb (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-5-activate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.license=GPLv2) 2024-09-21T12:28:52.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:51 smithi003 ceph-mon[108723]: pgmap v236: 65 pgs: 8 active+undersized, 7 peering, 3 stale+active+clean, 8 active+undersized+degraded, 39 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 29/279 objects degraded (10.394%) 2024-09-21T12:28:52.257 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:28:51 smithi192 podman[97425]: 2024-09-21 12:28:51.829474433 +0000 UTC m=+0.395412536 container start 5ae4ebbf7f938f82e2439ece071875a553d4268aa600049c523e81b0414a33bb (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-5-activate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T12:28:52.258 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:28:51 smithi192 podman[97425]: 2024-09-21 12:28:51.9342818 +0000 UTC m=+0.500219908 container attach 5ae4ebbf7f938f82e2439ece071875a553d4268aa600049c523e81b0414a33bb (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-5-activate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3) 2024-09-21T12:28:52.258 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:28:51 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-5-activate[97440]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:28:52.258 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:28:51 smithi192 bash[97425]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:28:52.258 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:28:51 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-5-activate[97440]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:28:52.258 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:28:51 smithi192 bash[97425]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:28:53.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:52 smithi003 ceph-mon[108723]: Health check failed: Reduced data availability: 4 pgs peering (PG_AVAILABILITY) 2024-09-21T12:28:53.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:52 smithi003 ceph-mon[108723]: Health check failed: Degraded data redundancy: 29/279 objects degraded (10.394%), 8 pgs degraded (PG_DEGRADED) 2024-09-21T12:28:53.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:52 smithi192 ceph-mon[80326]: Health check failed: Reduced data availability: 4 pgs peering (PG_AVAILABILITY) 2024-09-21T12:28:53.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:52 smithi192 ceph-mon[80326]: Health check failed: Degraded data redundancy: 29/279 objects degraded (10.394%), 8 pgs degraded (PG_DEGRADED) 2024-09-21T12:28:54.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:53 smithi192 ceph-mon[80326]: pgmap v237: 65 pgs: 11 active+undersized, 7 peering, 10 active+undersized+degraded, 37 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 33/279 objects degraded (11.828%) 2024-09-21T12:28:54.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:53 smithi003 ceph-mon[108723]: pgmap v237: 65 pgs: 11 active+undersized, 7 peering, 10 active+undersized+degraded, 37 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 33/279 objects degraded (11.828%) 2024-09-21T12:28:55.230 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:54 smithi192 ceph-mon[80326]: pgmap v238: 65 pgs: 15 active+undersized, 13 active+undersized+degraded, 37 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 43/279 objects degraded (15.412%) 2024-09-21T12:28:55.230 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:54 smithi192 ceph-mon[80326]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs peering) 2024-09-21T12:28:55.230 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:28:54 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-5-activate[97440]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-09-21T12:28:55.230 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:28:54 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-5-activate[97440]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:28:55.231 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:28:54 smithi192 bash[97425]: --> Failed to activate via raw: did not find any matching OSD to activate 2024-09-21T12:28:55.231 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:28:54 smithi192 bash[97425]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:28:55.231 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:28:54 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-5-activate[97440]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:28:55.231 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:28:54 smithi192 bash[97425]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-21T12:28:55.231 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:28:54 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-5-activate[97440]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-21T12:28:55.231 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:28:54 smithi192 bash[97425]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-21T12:28:55.231 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:28:54 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-5-activate[97440]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-5 --no-mon-config 2024-09-21T12:28:55.231 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:28:54 smithi192 bash[97425]: Running command: /usr/bin/ceph-bluestore-tool --cluster=ceph prime-osd-dir --dev /dev/vg_nvme/lv_2 --path /var/lib/ceph/osd/ceph-5 --no-mon-config 2024-09-21T12:28:55.231 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:28:55 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-5-activate[97440]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5/block 2024-09-21T12:28:55.231 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:28:55 smithi192 bash[97425]: Running command: /usr/bin/ln -snf /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5/block 2024-09-21T12:28:55.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:54 smithi003 ceph-mon[108723]: pgmap v238: 65 pgs: 15 active+undersized, 13 active+undersized+degraded, 37 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 43/279 objects degraded (15.412%) 2024-09-21T12:28:55.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:54 smithi003 ceph-mon[108723]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs peering) 2024-09-21T12:28:55.508 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:28:55 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-5-activate[97440]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-5/block 2024-09-21T12:28:55.508 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:28:55 smithi192 bash[97425]: Running command: /usr/bin/chown -h ceph:ceph /var/lib/ceph/osd/ceph-5/block 2024-09-21T12:28:55.508 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:28:55 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-5-activate[97440]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-21T12:28:55.508 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:28:55 smithi192 bash[97425]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-21T12:28:55.508 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:28:55 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-5-activate[97440]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-21T12:28:55.508 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:28:55 smithi192 bash[97425]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-21T12:28:55.508 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:28:55 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-5-activate[97440]: --> ceph-volume lvm activate successful for osd ID: 5 2024-09-21T12:28:55.508 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:28:55 smithi192 bash[97425]: --> ceph-volume lvm activate successful for osd ID: 5 2024-09-21T12:28:55.508 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:28:55 smithi192 podman[97425]: 2024-09-21 12:28:55.258182459 +0000 UTC m=+3.824120565 container died 5ae4ebbf7f938f82e2439ece071875a553d4268aa600049c523e81b0414a33bb (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-5-activate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T12:28:56.221 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:28:55 smithi192 podman[97653]: 2024-09-21 12:28:55.887898123 +0000 UTC m=+0.623715743 container remove 5ae4ebbf7f938f82e2439ece071875a553d4268aa600049c523e81b0414a33bb (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-5-activate, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=) 2024-09-21T12:28:56.222 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:28:56 smithi192 podman[97712]: 2024-09-21 12:28:55.996305732 +0000 UTC m=+0.015770135 image pull 8f4d013db793795fef09ff5edf96e6b42ba8cd2c9158b2f0b7a5d7c1e657c063 quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 2024-09-21T12:28:56.222 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:28:56 smithi192 podman[97712]: 2024-09-21 12:28:56.113617187 +0000 UTC m=+0.133081590 container create 584f3f6124835b81677284187402f627c212bee436047c023f99a9fa2d56d60f (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-5, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-21T12:28:56.492 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:28:56 smithi192 podman[97712]: 2024-09-21 12:28:56.373330427 +0000 UTC m=+0.392794830 container init 584f3f6124835b81677284187402f627c212bee436047c023f99a9fa2d56d60f (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-5, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T12:28:56.492 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:28:56 smithi192 podman[97712]: 2024-09-21 12:28:56.376567634 +0000 UTC m=+0.396032037 container start 584f3f6124835b81677284187402f627c212bee436047c023f99a9fa2d56d60f (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-5, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=) 2024-09-21T12:28:56.492 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:28:56 smithi192 ceph-osd[97731]: -- 172.21.15.192:0/1285581394 <== mon.1 v2:172.21.15.192:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564b52d6c1e0 con 0x564b51f0bc00 2024-09-21T12:28:56.757 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:28:56 smithi192 bash[97712]: 584f3f6124835b81677284187402f627c212bee436047c023f99a9fa2d56d60f 2024-09-21T12:28:56.757 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:28:56 smithi192 systemd[1]: Started Ceph osd.5 for 641beec0-7812-11ef-baf6-efdc52797490. 2024-09-21T12:28:57.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:57 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:28:57.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:57 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:28:57.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:57 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:28:57.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:57 smithi192 ceph-mon[80326]: pgmap v239: 65 pgs: 15 active+undersized, 13 active+undersized+degraded, 37 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 43/279 objects degraded (15.412%) 2024-09-21T12:28:57.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:57 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:28:57.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:57 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:28:57.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:57 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:28:57.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:57 smithi003 ceph-mon[108723]: pgmap v239: 65 pgs: 15 active+undersized, 13 active+undersized+degraded, 37 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 43/279 objects degraded (15.412%) 2024-09-21T12:28:58.257 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:28:58 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-5[97727]: 2024-09-21T12:28:58.028+0000 7f4b68d67640 -1 Falling back to public interface 2024-09-21T12:29:00.223 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:59 smithi192 ceph-mon[80326]: pgmap v240: 65 pgs: 15 active+undersized, 13 active+undersized+degraded, 37 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 43/279 objects degraded (15.412%) 2024-09-21T12:29:00.223 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:59 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:29:00.223 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:59 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:29:00.223 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:59 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:29:00.223 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:59 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:29:00.223 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:59 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:29:00.223 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:59 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:29:00.223 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:28:59 smithi192 ceph-mon[80326]: Health check update: Degraded data redundancy: 43/279 objects degraded (15.412%), 13 pgs degraded (PG_DEGRADED) 2024-09-21T12:29:00.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:59 smithi003 ceph-mon[108723]: pgmap v240: 65 pgs: 15 active+undersized, 13 active+undersized+degraded, 37 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 43/279 objects degraded (15.412%) 2024-09-21T12:29:00.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:59 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:29:00.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:59 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:29:00.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:59 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:29:00.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:59 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:29:00.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:59 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:29:00.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:59 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:29:00.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:28:59 smithi003 ceph-mon[108723]: Health check update: Degraded data redundancy: 43/279 objects degraded (15.412%), 13 pgs degraded (PG_DEGRADED) 2024-09-21T12:29:02.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:01 smithi192 ceph-mon[80326]: pgmap v241: 65 pgs: 15 active+undersized, 13 active+undersized+degraded, 37 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 43/279 objects degraded (15.412%) 2024-09-21T12:29:02.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:01 smithi003 ceph-mon[108723]: pgmap v241: 65 pgs: 15 active+undersized, 13 active+undersized+degraded, 37 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 43/279 objects degraded (15.412%) 2024-09-21T12:29:03.507 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:29:03 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-5[97727]: 2024-09-21T12:29:03.243+0000 7f4b68d67640 -1 osd.5 73 log_to_monitors true 2024-09-21T12:29:04.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:03 smithi192 ceph-mon[80326]: pgmap v242: 65 pgs: 15 active+undersized, 13 active+undersized+degraded, 37 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 43/279 objects degraded (15.412%) 2024-09-21T12:29:04.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:03 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:29:04.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:03 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:29:04.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:03 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:29:04.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:03 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:29:04.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:03 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:29:04.259 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:03 smithi192 ceph-mon[80326]: from='osd.5 [v2:172.21.15.192:6816/3577073477,v1:172.21.15.192:6817/3577073477]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T12:29:04.259 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:03 smithi192 ceph-mon[80326]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T12:29:04.259 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:03 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:29:04.259 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:03 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:29:04.259 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:03 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:29:04.259 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:03 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:29:04.259 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:03 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:29:04.259 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:03 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:29:04.259 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:03 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.0"} : dispatch 2024-09-21T12:29:04.259 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:03 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-21T12:29:04.259 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:03 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.1"} : dispatch 2024-09-21T12:29:04.259 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:03 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-21T12:29:04.259 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:03 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.2"} : dispatch 2024-09-21T12:29:04.260 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:03 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-21T12:29:04.260 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:03 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.3"} : dispatch 2024-09-21T12:29:04.260 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:03 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-21T12:29:04.260 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:03 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.4"} : dispatch 2024-09-21T12:29:04.260 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:03 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-21T12:29:04.260 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:03 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.5"} : dispatch 2024-09-21T12:29:04.260 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:03 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-21T12:29:04.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:03 smithi003 ceph-mon[108723]: pgmap v242: 65 pgs: 15 active+undersized, 13 active+undersized+degraded, 37 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 43/279 objects degraded (15.412%) 2024-09-21T12:29:04.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:03 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:29:04.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:03 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:29:04.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:03 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:29:04.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:03 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:29:04.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:03 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:29:04.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:03 smithi003 ceph-mon[108723]: from='osd.5 [v2:172.21.15.192:6816/3577073477,v1:172.21.15.192:6817/3577073477]' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T12:29:04.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:03 smithi003 ceph-mon[108723]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]} : dispatch 2024-09-21T12:29:04.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:03 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:29:04.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:03 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:29:04.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:03 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:29:04.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:03 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:29:04.331 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:03 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:29:04.331 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:03 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:29:04.331 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:03 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.0"} : dispatch 2024-09-21T12:29:04.331 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:03 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-21T12:29:04.331 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:03 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.1"} : dispatch 2024-09-21T12:29:04.331 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:03 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-21T12:29:04.331 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:03 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.2"} : dispatch 2024-09-21T12:29:04.331 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:03 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-21T12:29:04.331 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:03 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.3"} : dispatch 2024-09-21T12:29:04.331 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:03 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-21T12:29:04.331 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:03 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.4"} : dispatch 2024-09-21T12:29:04.331 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:03 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-21T12:29:04.331 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:03 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config rm", "name": "container_image", "who": "osd.5"} : dispatch 2024-09-21T12:29:04.332 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:03 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-21T12:29:05.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:04 smithi003 ceph-mon[108723]: Upgrade: Setting container_image for all osd 2024-09-21T12:29:05.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:04 smithi003 ceph-mon[108723]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T12:29:05.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:04 smithi003 ceph-mon[108723]: osdmap e76: 6 total, 5 up, 6 in 2024-09-21T12:29:05.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:04 smithi003 ceph-mon[108723]: from='osd.5 [v2:172.21.15.192:6816/3577073477,v1:172.21.15.192:6817/3577073477]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi192", "root=default"]} : dispatch 2024-09-21T12:29:05.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:04 smithi003 ceph-mon[108723]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi192", "root=default"]} : dispatch 2024-09-21T12:29:05.257 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:29:05 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-5[97727]: 2024-09-21T12:29:05.122+0000 7f4b5cb09640 -1 osd.5 73 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-21T12:29:05.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:04 smithi192 ceph-mon[80326]: Upgrade: Setting container_image for all osd 2024-09-21T12:29:05.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:04 smithi192 ceph-mon[80326]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-21T12:29:05.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:04 smithi192 ceph-mon[80326]: osdmap e76: 6 total, 5 up, 6 in 2024-09-21T12:29:05.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:04 smithi192 ceph-mon[80326]: from='osd.5 [v2:172.21.15.192:6816/3577073477,v1:172.21.15.192:6817/3577073477]' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi192", "root=default"]} : dispatch 2024-09-21T12:29:05.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:04 smithi192 ceph-mon[80326]: from='osd.5 ' entity='osd.5' cmd={"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi192", "root=default"]} : dispatch 2024-09-21T12:29:06.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:05 smithi192 ceph-mon[80326]: pgmap v244: 65 pgs: 15 active+undersized, 13 active+undersized+degraded, 37 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 43/279 objects degraded (15.412%) 2024-09-21T12:29:06.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:05 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:29:06.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:05 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi003.ebjgyl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T12:29:06.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:05 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:29:06.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:05 smithi192 ceph-mon[80326]: from='osd.5 ' entity='osd.5' 2024-09-21T12:29:06.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:05 smithi003 ceph-mon[108723]: pgmap v244: 65 pgs: 15 active+undersized, 13 active+undersized+degraded, 37 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 43/279 objects degraded (15.412%) 2024-09-21T12:29:06.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:05 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:29:06.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:05 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi003.ebjgyl", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T12:29:06.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:05 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:29:06.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:05 smithi003 ceph-mon[108723]: from='osd.5 ' entity='osd.5' 2024-09-21T12:29:07.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:06 smithi003 ceph-mon[108723]: Upgrade: Updating mds.cephfs.smithi003.ebjgyl 2024-09-21T12:29:07.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:06 smithi003 ceph-mon[108723]: Deploying daemon mds.cephfs.smithi003.ebjgyl on smithi003 2024-09-21T12:29:07.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:06 smithi003 ceph-mon[108723]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T12:29:07.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:06 smithi003 ceph-mon[108723]: osd.5 [v2:172.21.15.192:6816/3577073477,v1:172.21.15.192:6817/3577073477] boot 2024-09-21T12:29:07.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:06 smithi003 ceph-mon[108723]: osdmap e77: 6 total, 6 up, 6 in 2024-09-21T12:29:07.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:06 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T12:29:07.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:06 smithi192 ceph-mon[80326]: Upgrade: Updating mds.cephfs.smithi003.ebjgyl 2024-09-21T12:29:07.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:06 smithi192 ceph-mon[80326]: Deploying daemon mds.cephfs.smithi003.ebjgyl on smithi003 2024-09-21T12:29:07.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:06 smithi192 ceph-mon[80326]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-21T12:29:07.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:06 smithi192 ceph-mon[80326]: osd.5 [v2:172.21.15.192:6816/3577073477,v1:172.21.15.192:6817/3577073477] boot 2024-09-21T12:29:07.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:06 smithi192 ceph-mon[80326]: osdmap e77: 6 total, 6 up, 6 in 2024-09-21T12:29:07.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:06 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd metadata", "id": 5} : dispatch 2024-09-21T12:29:08.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:07 smithi192 ceph-mon[80326]: pgmap v246: 65 pgs: 2 peering, 14 active+undersized, 12 active+undersized+degraded, 37 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 40/279 objects degraded (14.337%) 2024-09-21T12:29:08.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:07 smithi192 ceph-mon[80326]: Health check update: Degraded data redundancy: 40/279 objects degraded (14.337%), 12 pgs degraded (PG_DEGRADED) 2024-09-21T12:29:08.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:07 smithi192 ceph-mon[80326]: osdmap e78: 6 total, 6 up, 6 in 2024-09-21T12:29:08.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:07 smithi003 ceph-mon[108723]: pgmap v246: 65 pgs: 2 peering, 14 active+undersized, 12 active+undersized+degraded, 37 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 40/279 objects degraded (14.337%) 2024-09-21T12:29:08.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:07 smithi003 ceph-mon[108723]: Health check update: Degraded data redundancy: 40/279 objects degraded (14.337%), 12 pgs degraded (PG_DEGRADED) 2024-09-21T12:29:08.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:07 smithi003 ceph-mon[108723]: osdmap e78: 6 total, 6 up, 6 in 2024-09-21T12:29:09.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:08 smithi192 ceph-mon[80326]: fsmap cephfs:1 {0=cephfs.smithi003.gfkngj=up:active} 2 up:standby 2024-09-21T12:29:09.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:08 smithi003 ceph-mon[108723]: fsmap cephfs:1 {0=cephfs.smithi003.gfkngj=up:active} 2 up:standby 2024-09-21T12:29:10.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:09 smithi192 ceph-mon[80326]: pgmap v248: 65 pgs: 2 peering, 14 active+undersized, 12 active+undersized+degraded, 37 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 40/279 objects degraded (14.337%) 2024-09-21T12:29:10.282 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:09 smithi003 ceph-mon[108723]: pgmap v248: 65 pgs: 2 peering, 14 active+undersized, 12 active+undersized+degraded, 37 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 40/279 objects degraded (14.337%) 2024-09-21T12:29:11.821 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:11 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:29:11.821 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:11 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:29:11.821 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:11 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:29:11.821 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:11 smithi003 ceph-mon[108723]: pgmap v249: 65 pgs: 2 peering, 63 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:29:11.821 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:11 smithi003 ceph-mon[108723]: mds.? [v2:172.21.15.3:6826/1616995236,v1:172.21.15.3:6827/1616995236] up:boot 2024-09-21T12:29:11.821 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:11 smithi003 ceph-mon[108723]: fsmap cephfs:1 {0=cephfs.smithi003.gfkngj=up:active} 3 up:standby 2024-09-21T12:29:11.821 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:11 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "mds metadata", "who": "cephfs.smithi003.ebjgyl"} : dispatch 2024-09-21T12:29:12.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:11 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:29:12.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:11 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:29:12.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:11 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:29:12.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:11 smithi192 ceph-mon[80326]: pgmap v249: 65 pgs: 2 peering, 63 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:29:12.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:11 smithi192 ceph-mon[80326]: mds.? [v2:172.21.15.3:6826/1616995236,v1:172.21.15.3:6827/1616995236] up:boot 2024-09-21T12:29:12.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:11 smithi192 ceph-mon[80326]: fsmap cephfs:1 {0=cephfs.smithi003.gfkngj=up:active} 3 up:standby 2024-09-21T12:29:12.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:11 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "mds metadata", "who": "cephfs.smithi003.ebjgyl"} : dispatch 2024-09-21T12:29:12.269 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.265+0000 7fce83b5d640 1 -- 172.21.15.3:0/798386782 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fce7c100ff0 msgr2=0x7fce7c10dcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:29:12.269 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.265+0000 7fce83b5d640 1 --2- 172.21.15.3:0/798386782 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fce7c100ff0 0x7fce7c10dcb0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fce6c009880 tx=0x7fce6c02a490 comp rx=0 tx=0).stop 2024-09-21T12:29:12.269 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.266+0000 7fce83b5d640 1 -- 172.21.15.3:0/798386782 shutdown_connections 2024-09-21T12:29:12.269 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.266+0000 7fce83b5d640 1 --2- 172.21.15.3:0/798386782 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fce7c100ff0 0x7fce7c10dcb0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:12.269 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.266+0000 7fce83b5d640 1 --2- 172.21.15.3:0/798386782 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce7c100640 0x7fce7c100a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:12.269 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.266+0000 7fce83b5d640 1 -- 172.21.15.3:0/798386782 >> 172.21.15.3:0/798386782 conn(0x7fce7c0fc550 msgr2=0x7fce7c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:29:12.269 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.266+0000 7fce83b5d640 1 -- 172.21.15.3:0/798386782 shutdown_connections 2024-09-21T12:29:12.269 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.266+0000 7fce83b5d640 1 -- 172.21.15.3:0/798386782 wait complete. 2024-09-21T12:29:12.269 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.266+0000 7fce83b5d640 1 Processor -- start 2024-09-21T12:29:12.270 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.266+0000 7fce83b5d640 1 -- start start 2024-09-21T12:29:12.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.267+0000 7fce83b5d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fce7c100640 0x7fce7c19f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:29:12.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.267+0000 7fce83b5d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce7c100ff0 0x7fce7c19fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:29:12.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.267+0000 7fce83b5d640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fce7c110f70 con 0x7fce7c100640 2024-09-21T12:29:12.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.267+0000 7fce83b5d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fce7c110df0 con 0x7fce7c100ff0 2024-09-21T12:29:12.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.267+0000 7fce818f9640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fce7c100640 0x7fce7c19f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:29:12.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.267+0000 7fce818f9640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fce7c100640 0x7fce7c19f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:58050/0 (socket says 172.21.15.3:58050) 2024-09-21T12:29:12.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.267+0000 7fce818f9640 1 -- 172.21.15.3:0/4066819568 learned_addr learned my addr 172.21.15.3:0/4066819568 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:29:12.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.267+0000 7fce810f8640 1 --2- 172.21.15.3:0/4066819568 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce7c100ff0 0x7fce7c19fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:29:12.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.267+0000 7fce818f9640 1 -- 172.21.15.3:0/4066819568 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce7c100ff0 msgr2=0x7fce7c19fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:29:12.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.267+0000 7fce818f9640 1 --2- 172.21.15.3:0/4066819568 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce7c100ff0 0x7fce7c19fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:12.272 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.267+0000 7fce818f9640 1 -- 172.21.15.3:0/4066819568 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce7c1999a0 con 0x7fce7c100640 2024-09-21T12:29:12.272 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.267+0000 7fce810f8640 1 --2- 172.21.15.3:0/4066819568 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce7c100ff0 0x7fce7c19fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:29:12.272 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.268+0000 7fce818f9640 1 --2- 172.21.15.3:0/4066819568 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fce7c100640 0x7fce7c19f7e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fce7800c810 tx=0x7fce7800ccd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:29:12.272 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.268+0000 7fce72ffd640 1 -- 172.21.15.3:0/4066819568 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fce78004020 con 0x7fce7c100640 2024-09-21T12:29:12.272 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.268+0000 7fce72ffd640 1 -- 172.21.15.3:0/4066819568 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fce780041c0 con 0x7fce7c100640 2024-09-21T12:29:12.272 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.268+0000 7fce72ffd640 1 -- 172.21.15.3:0/4066819568 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fce780047a0 con 0x7fce7c100640 2024-09-21T12:29:12.272 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.268+0000 7fce83b5d640 1 -- 172.21.15.3:0/4066819568 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce7c199c90 con 0x7fce7c100640 2024-09-21T12:29:12.273 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.268+0000 7fce83b5d640 1 -- 172.21.15.3:0/4066819568 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce7c19a1f0 con 0x7fce7c100640 2024-09-21T12:29:12.273 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.270+0000 7fce72ffd640 1 -- 172.21.15.3:0/4066819568 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7fce780079b0 con 0x7fce7c100640 2024-09-21T12:29:12.273 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.270+0000 7fce83b5d640 1 -- 172.21.15.3:0/4066819568 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce7c06a580 con 0x7fce7c100640 2024-09-21T12:29:12.273 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.270+0000 7fce72ffd640 1 --2- 172.21.15.3:0/4066819568 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fce6807af80 0x7fce6807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:29:12.273 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.271+0000 7fce72ffd640 1 -- 172.21.15.3:0/4066819568 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 6156+0+0 (secure 0 0 0) 0x7fce7809df20 con 0x7fce7c100640 2024-09-21T12:29:12.273 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.271+0000 7fce810f8640 1 --2- 172.21.15.3:0/4066819568 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fce6807af80 0x7fce6807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:29:12.274 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.271+0000 7fce810f8640 1 --2- 172.21.15.3:0/4066819568 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fce6807af80 0x7fce6807d440 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fce7c19b190 tx=0x7fce6c009560 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:29:12.278 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.276+0000 7fce72ffd640 1 -- 172.21.15.3:0/4066819568 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fce78014030 con 0x7fce7c100640 2024-09-21T12:29:12.504 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.501+0000 7fce83b5d640 1 -- 172.21.15.3:0/4066819568 --> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fce7c19aed0 con 0x7fce6807af80 2024-09-21T12:29:12.505 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.503+0000 7fce72ffd640 1 -- 172.21.15.3:0/4066819568 <== mgr.14756 v2:172.21.15.3:6800/1284098095 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7fce7c19aed0 con 0x7fce6807af80 2024-09-21T12:29:12.508 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.505+0000 7fce83b5d640 1 -- 172.21.15.3:0/4066819568 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fce6807af80 msgr2=0x7fce6807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:29:12.508 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.505+0000 7fce83b5d640 1 --2- 172.21.15.3:0/4066819568 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fce6807af80 0x7fce6807d440 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fce7c19b190 tx=0x7fce6c009560 comp rx=0 tx=0).stop 2024-09-21T12:29:12.508 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.505+0000 7fce83b5d640 1 -- 172.21.15.3:0/4066819568 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fce7c100640 msgr2=0x7fce7c19f7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:29:12.508 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.505+0000 7fce83b5d640 1 --2- 172.21.15.3:0/4066819568 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fce7c100640 0x7fce7c19f7e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fce7800c810 tx=0x7fce7800ccd0 comp rx=0 tx=0).stop 2024-09-21T12:29:12.508 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.505+0000 7fce83b5d640 1 -- 172.21.15.3:0/4066819568 shutdown_connections 2024-09-21T12:29:12.508 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.505+0000 7fce83b5d640 1 --2- 172.21.15.3:0/4066819568 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fce6807af80 0x7fce6807d440 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:12.508 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.505+0000 7fce83b5d640 1 --2- 172.21.15.3:0/4066819568 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce7c100ff0 0x7fce7c19fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:12.508 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.505+0000 7fce83b5d640 1 --2- 172.21.15.3:0/4066819568 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fce7c100640 0x7fce7c19f7e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:12.508 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.505+0000 7fce83b5d640 1 -- 172.21.15.3:0/4066819568 >> 172.21.15.3:0/4066819568 conn(0x7fce7c0fc550 msgr2=0x7fce7c0fd990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:29:12.509 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.505+0000 7fce83b5d640 1 -- 172.21.15.3:0/4066819568 shutdown_connections 2024-09-21T12:29:12.509 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.505+0000 7fce83b5d640 1 -- 172.21.15.3:0/4066819568 wait complete. 2024-09-21T12:29:12.517 INFO:teuthology.orchestra.run.smithi003.stdout:true 2024-09-21T12:29:12.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.591+0000 7f2b72fbf640 1 -- 172.21.15.3:0/2581762232 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2b6c102ab0 msgr2=0x7f2b6c102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:29:12.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.591+0000 7f2b72fbf640 1 --2- 172.21.15.3:0/2581762232 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2b6c102ab0 0x7f2b6c102e90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2b60009880 tx=0x7f2b6002a530 comp rx=0 tx=0).stop 2024-09-21T12:29:12.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.591+0000 7f2b72fbf640 1 -- 172.21.15.3:0/2581762232 shutdown_connections 2024-09-21T12:29:12.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.591+0000 7f2b72fbf640 1 --2- 172.21.15.3:0/2581762232 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b6c1033d0 0x7f2b6c10b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:12.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.591+0000 7f2b72fbf640 1 --2- 172.21.15.3:0/2581762232 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2b6c102ab0 0x7f2b6c102e90 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:12.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.591+0000 7f2b72fbf640 1 -- 172.21.15.3:0/2581762232 >> 172.21.15.3:0/2581762232 conn(0x7f2b6c0fc550 msgr2=0x7f2b6c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:29:12.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.592+0000 7f2b72fbf640 1 -- 172.21.15.3:0/2581762232 shutdown_connections 2024-09-21T12:29:12.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.592+0000 7f2b72fbf640 1 -- 172.21.15.3:0/2581762232 wait complete. 2024-09-21T12:29:12.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.592+0000 7f2b72fbf640 1 Processor -- start 2024-09-21T12:29:12.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.592+0000 7f2b72fbf640 1 -- start start 2024-09-21T12:29:12.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.593+0000 7f2b72fbf640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b6c102ab0 0x7f2b6c19d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:29:12.596 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.593+0000 7f2b72fbf640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2b6c1033d0 0x7f2b6c19db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:29:12.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.593+0000 7f2b72fbf640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f2b6c10ede0 con 0x7f2b6c1033d0 2024-09-21T12:29:12.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.593+0000 7f2b72fbf640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2b6c10ec60 con 0x7f2b6c102ab0 2024-09-21T12:29:12.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.593+0000 7f2b6bfff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2b6c1033d0 0x7f2b6c19db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:29:12.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.593+0000 7f2b6bfff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2b6c1033d0 0x7f2b6c19db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:58064/0 (socket says 172.21.15.3:58064) 2024-09-21T12:29:12.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.593+0000 7f2b6bfff640 1 -- 172.21.15.3:0/3445656979 learned_addr learned my addr 172.21.15.3:0/3445656979 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:29:12.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.593+0000 7f2b70d5b640 1 --2- 172.21.15.3:0/3445656979 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b6c102ab0 0x7f2b6c19d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:29:12.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.593+0000 7f2b6bfff640 1 -- 172.21.15.3:0/3445656979 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b6c102ab0 msgr2=0x7f2b6c19d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:29:12.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.593+0000 7f2b6bfff640 1 --2- 172.21.15.3:0/3445656979 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b6c102ab0 0x7f2b6c19d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:12.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.593+0000 7f2b6bfff640 1 -- 172.21.15.3:0/3445656979 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b6c1977b0 con 0x7f2b6c1033d0 2024-09-21T12:29:12.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.593+0000 7f2b6bfff640 1 --2- 172.21.15.3:0/3445656979 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2b6c1033d0 0x7f2b6c19db70 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2b5800c8f0 tx=0x7f2b5800cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:29:12.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.593+0000 7f2b69ffb640 1 -- 172.21.15.3:0/3445656979 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2b5800ae50 con 0x7f2b6c1033d0 2024-09-21T12:29:12.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.593+0000 7f2b69ffb640 1 -- 172.21.15.3:0/3445656979 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2b5800f450 con 0x7f2b6c1033d0 2024-09-21T12:29:12.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.593+0000 7f2b72fbf640 1 -- 172.21.15.3:0/3445656979 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b6c197aa0 con 0x7f2b6c1033d0 2024-09-21T12:29:12.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.594+0000 7f2b69ffb640 1 -- 172.21.15.3:0/3445656979 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2b58018630 con 0x7f2b6c1033d0 2024-09-21T12:29:12.597 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.594+0000 7f2b72fbf640 1 -- 172.21.15.3:0/3445656979 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b6c198030 con 0x7f2b6c1033d0 2024-09-21T12:29:12.598 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.595+0000 7f2b72fbf640 1 -- 172.21.15.3:0/3445656979 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b6c06a580 con 0x7f2b6c1033d0 2024-09-21T12:29:12.598 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.595+0000 7f2b69ffb640 1 -- 172.21.15.3:0/3445656979 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f2b5800f600 con 0x7f2b6c1033d0 2024-09-21T12:29:12.598 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.596+0000 7f2b69ffb640 1 --2- 172.21.15.3:0/3445656979 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f2b5c07b0e0 0x7f2b5c07d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:29:12.598 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.596+0000 7f2b69ffb640 1 -- 172.21.15.3:0/3445656979 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 6156+0+0 (secure 0 0 0) 0x7f2b5809e170 con 0x7f2b6c1033d0 2024-09-21T12:29:12.599 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.596+0000 7f2b70d5b640 1 --2- 172.21.15.3:0/3445656979 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f2b5c07b0e0 0x7f2b5c07d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:29:12.599 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.597+0000 7f2b70d5b640 1 --2- 172.21.15.3:0/3445656979 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f2b5c07b0e0 0x7f2b5c07d5a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2b60000c00 tx=0x7f2b60031400 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:29:12.603 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.600+0000 7f2b69ffb640 1 -- 172.21.15.3:0/3445656979 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2b58014030 con 0x7f2b6c1033d0 2024-09-21T12:29:12.759 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:12 smithi003 ceph-mon[108723]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 40/279 objects degraded (14.337%), 12 pgs degraded) 2024-09-21T12:29:12.817 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.815+0000 7f2b72fbf640 1 -- 172.21.15.3:0/3445656979 --> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f2b6c198340 con 0x7f2b5c07b0e0 2024-09-21T12:29:12.819 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.816+0000 7f2b69ffb640 1 -- 172.21.15.3:0/3445656979 <== mgr.14756 v2:172.21.15.3:6800/1284098095 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f2b6c198340 con 0x7f2b5c07b0e0 2024-09-21T12:29:12.821 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.818+0000 7f2b72fbf640 1 -- 172.21.15.3:0/3445656979 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f2b5c07b0e0 msgr2=0x7f2b5c07d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:29:12.821 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.818+0000 7f2b72fbf640 1 --2- 172.21.15.3:0/3445656979 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f2b5c07b0e0 0x7f2b5c07d5a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2b60000c00 tx=0x7f2b60031400 comp rx=0 tx=0).stop 2024-09-21T12:29:12.821 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.818+0000 7f2b72fbf640 1 -- 172.21.15.3:0/3445656979 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2b6c1033d0 msgr2=0x7f2b6c19db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:29:12.821 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.818+0000 7f2b72fbf640 1 --2- 172.21.15.3:0/3445656979 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2b6c1033d0 0x7f2b6c19db70 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f2b5800c8f0 tx=0x7f2b5800cdb0 comp rx=0 tx=0).stop 2024-09-21T12:29:12.821 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.818+0000 7f2b72fbf640 1 -- 172.21.15.3:0/3445656979 shutdown_connections 2024-09-21T12:29:12.821 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.818+0000 7f2b72fbf640 1 --2- 172.21.15.3:0/3445656979 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f2b5c07b0e0 0x7f2b5c07d5a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:12.821 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.818+0000 7f2b72fbf640 1 --2- 172.21.15.3:0/3445656979 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2b6c1033d0 0x7f2b6c19db70 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:12.821 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.818+0000 7f2b72fbf640 1 --2- 172.21.15.3:0/3445656979 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2b6c102ab0 0x7f2b6c19d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:12.821 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.818+0000 7f2b72fbf640 1 -- 172.21.15.3:0/3445656979 >> 172.21.15.3:0/3445656979 conn(0x7f2b6c0fc550 msgr2=0x7f2b6c10aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:29:12.821 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.819+0000 7f2b72fbf640 1 -- 172.21.15.3:0/3445656979 shutdown_connections 2024-09-21T12:29:12.821 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.819+0000 7f2b72fbf640 1 -- 172.21.15.3:0/3445656979 wait complete. 2024-09-21T12:29:12.907 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.904+0000 7f45a838e640 1 -- 172.21.15.3:0/265064294 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f45a0101900 msgr2=0x7f45a0101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:29:12.907 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.904+0000 7f45a838e640 1 --2- 172.21.15.3:0/265064294 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f45a0101900 0x7f45a0101d60 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f4590009880 tx=0x7f459002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:29:12.907 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.904+0000 7f45a838e640 1 -- 172.21.15.3:0/265064294 shutdown_connections 2024-09-21T12:29:12.907 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.904+0000 7f45a838e640 1 --2- 172.21.15.3:0/265064294 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f45a0101900 0x7f45a0101d60 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:12.907 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.904+0000 7f45a838e640 1 --2- 172.21.15.3:0/265064294 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f45a0107900 0x7f45a0107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:12.908 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.904+0000 7f45a838e640 1 -- 172.21.15.3:0/265064294 >> 172.21.15.3:0/265064294 conn(0x7f45a00fd600 msgr2=0x7f45a00ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:29:12.908 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.904+0000 7f45a838e640 1 -- 172.21.15.3:0/265064294 shutdown_connections 2024-09-21T12:29:12.908 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.904+0000 7f45a838e640 1 -- 172.21.15.3:0/265064294 wait complete. 2024-09-21T12:29:12.909 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.905+0000 7f45a838e640 1 Processor -- start 2024-09-21T12:29:12.909 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.905+0000 7f45a838e640 1 -- start start 2024-09-21T12:29:12.910 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.905+0000 7f45a838e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f45a0101900 0x7f45a019f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:29:12.910 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.905+0000 7f45a838e640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f45a0107900 0x7f45a019fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:29:12.910 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.905+0000 7f45a838e640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f45a010edb0 con 0x7f45a0101900 2024-09-21T12:29:12.910 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.905+0000 7f45a838e640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f45a010ec30 con 0x7f45a0107900 2024-09-21T12:29:12.910 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.905+0000 7f45a612a640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f45a0101900 0x7f45a019f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:29:12.910 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.905+0000 7f45a612a640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f45a0101900 0x7f45a019f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:58076/0 (socket says 172.21.15.3:58076) 2024-09-21T12:29:12.910 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.905+0000 7f45a612a640 1 -- 172.21.15.3:0/3681250390 learned_addr learned my addr 172.21.15.3:0/3681250390 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:29:12.910 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.906+0000 7f45a5929640 1 --2- 172.21.15.3:0/3681250390 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f45a0107900 0x7f45a019fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:29:12.910 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.906+0000 7f45a612a640 1 -- 172.21.15.3:0/3681250390 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f45a0107900 msgr2=0x7f45a019fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:29:12.910 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.906+0000 7f45a612a640 1 --2- 172.21.15.3:0/3681250390 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f45a0107900 0x7f45a019fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:12.910 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.906+0000 7f45a612a640 1 -- 172.21.15.3:0/3681250390 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45a01a03e0 con 0x7f45a0101900 2024-09-21T12:29:12.910 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.906+0000 7f45a612a640 1 --2- 172.21.15.3:0/3681250390 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f45a0101900 0x7f45a019f7f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f459c00c8a0 tx=0x7f459c00cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:29:12.910 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.906+0000 7f45977fe640 1 -- 172.21.15.3:0/3681250390 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f459c0079b0 con 0x7f45a0101900 2024-09-21T12:29:12.911 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.906+0000 7f45977fe640 1 -- 172.21.15.3:0/3681250390 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f459c007b50 con 0x7f45a0101900 2024-09-21T12:29:12.911 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.906+0000 7f45a838e640 1 -- 172.21.15.3:0/3681250390 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45a0199ad0 con 0x7f45a0101900 2024-09-21T12:29:12.911 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.906+0000 7f45977fe640 1 -- 172.21.15.3:0/3681250390 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f459c018700 con 0x7f45a0101900 2024-09-21T12:29:12.911 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.906+0000 7f45a838e640 1 -- 172.21.15.3:0/3681250390 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45a019a030 con 0x7f45a0101900 2024-09-21T12:29:12.911 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.907+0000 7f45a838e640 1 -- 172.21.15.3:0/3681250390 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45a0103040 con 0x7f45a0101900 2024-09-21T12:29:12.912 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.908+0000 7f45977fe640 1 -- 172.21.15.3:0/3681250390 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f459c007d00 con 0x7f45a0101900 2024-09-21T12:29:12.912 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.908+0000 7f45977fe640 1 --2- 172.21.15.3:0/3681250390 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f458c07af40 0x7f458c07d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:29:12.912 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.908+0000 7f45977fe640 1 -- 172.21.15.3:0/3681250390 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 6156+0+0 (secure 0 0 0) 0x7f459c09e310 con 0x7f45a0101900 2024-09-21T12:29:12.912 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.908+0000 7f45a5929640 1 --2- 172.21.15.3:0/3681250390 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f458c07af40 0x7f458c07d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:29:12.912 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.909+0000 7f45a5929640 1 --2- 172.21.15.3:0/3681250390 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f458c07af40 0x7f458c07d400 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f45a019b1a0 tx=0x7f4590009560 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:29:12.915 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:12.913+0000 7f45977fe640 1 -- 172.21.15.3:0/3681250390 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f459c014030 con 0x7f45a0101900 2024-09-21T12:29:13.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:12 smithi192 ceph-mon[80326]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 40/279 objects degraded (14.337%), 12 pgs degraded) 2024-09-21T12:29:13.122 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.120+0000 7f45a838e640 1 -- 172.21.15.3:0/3681250390 --> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f45a019a380 con 0x7f458c07af40 2024-09-21T12:29:13.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.134+0000 7f45977fe640 1 -- 172.21.15.3:0/3681250390 <== mgr.14756 v2:172.21.15.3:6800/1284098095 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7f45a019a380 con 0x7f458c07af40 2024-09-21T12:29:13.136 INFO:teuthology.orchestra.run.smithi003.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:29:13.136 INFO:teuthology.orchestra.run.smithi003.stdout:alertmanager.smithi003 smithi003 *:9093,9094 running (5m) 118s ago 16m 19.0M - 0.27.0 11f11916f8cd 14880018dfd3 2024-09-21T12:29:13.137 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-exporter.smithi003 smithi003 running (8m) 118s ago 17m 8820k - 19.1.1-373-g4e45e6b4 164465d2334a 0c9ad60a4f5a 2024-09-21T12:29:13.137 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-exporter.smithi192 smithi192 running (7m) 13s ago 16m 8627k - 19.1.1-373-g4e45e6b4 164465d2334a d5be8a6e120f 2024-09-21T12:29:13.137 INFO:teuthology.orchestra.run.smithi003.stdout:crash.smithi003 smithi003 running (3m) 118s ago 17m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 0ada67250dba 2024-09-21T12:29:13.137 INFO:teuthology.orchestra.run.smithi003.stdout:crash.smithi192 smithi192 running (3m) 13s ago 16m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 52e279085b2e 2024-09-21T12:29:13.137 INFO:teuthology.orchestra.run.smithi003.stdout:grafana.smithi003 smithi003 *:3000 running (5m) 118s ago 16m 78.8M - 10.4.8 5aad1d7cf004 19e26b3cb585 2024-09-21T12:29:13.137 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi003.ebjgyl smithi003 starting - - - - 2024-09-21T12:29:13.137 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi003.gfkngj smithi003 running (11m) 118s ago 11m 143M - 19.1.1-373-g4e45e6b4 164465d2334a 109c04f87fbd 2024-09-21T12:29:13.137 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi192.ktdqns smithi192 running (11m) 13s ago 11m 19.6M - 19.1.1-373-g4e45e6b4 164465d2334a 495c73fb3bb0 2024-09-21T12:29:13.137 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi192.ywqqxe smithi192 running (11m) 13s ago 11m 19.6M - 19.1.1-373-g4e45e6b4 164465d2334a 270a01030cbe 2024-09-21T12:29:13.137 INFO:teuthology.orchestra.run.smithi003.stdout:mgr.smithi003.wztftl smithi003 *:8443,9283,8765 running (7m) 118s ago 18m 525M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 8ce0e66fd369 2024-09-21T12:29:13.137 INFO:teuthology.orchestra.run.smithi003.stdout:mgr.smithi192.qsaprd smithi192 *:8443,9283,8765 running (6m) 13s ago 16m 458M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 002a6171dd47 2024-09-21T12:29:13.137 INFO:teuthology.orchestra.run.smithi003.stdout:mon.smithi003 smithi003 running (4m) 118s ago 18m 41.7M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 4f2b2b2daf19 2024-09-21T12:29:13.137 INFO:teuthology.orchestra.run.smithi003.stdout:mon.smithi192 smithi192 running (3m) 13s ago 16m 38.9M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 11edc5c1baba 2024-09-21T12:29:13.137 INFO:teuthology.orchestra.run.smithi003.stdout:node-exporter.smithi003 smithi003 *:9100 running (6m) 118s ago 16m 9353k - 1.7.0 72c9c2088986 d9cb7ede9060 2024-09-21T12:29:13.138 INFO:teuthology.orchestra.run.smithi003.stdout:node-exporter.smithi192 smithi192 *:9100 running (6m) 13s ago 16m 11.0M - 1.7.0 72c9c2088986 d8ec0acfce7e 2024-09-21T12:29:13.138 INFO:teuthology.orchestra.run.smithi003.stdout:osd.0 smithi003 running (3m) 118s ago 14m 82.1M 1217M 19.3.0-5103-g5c1cdc3c 8f4d013db793 0f2234f333ec 2024-09-21T12:29:13.138 INFO:teuthology.orchestra.run.smithi003.stdout:osd.1 smithi003 running (2m) 118s ago 14m 85.4M 1217M 19.3.0-5103-g5c1cdc3c 8f4d013db793 198ba21d0518 2024-09-21T12:29:13.138 INFO:teuthology.orchestra.run.smithi003.stdout:osd.2 smithi003 running (2m) 118s ago 13m 11.1M 1217M 19.3.0-5103-g5c1cdc3c 8f4d013db793 e630341e13d4 2024-09-21T12:29:13.138 INFO:teuthology.orchestra.run.smithi003.stdout:osd.3 smithi192 running (86s) 13s ago 13m 101M 2240M 19.3.0-5103-g5c1cdc3c 8f4d013db793 1b5fae2f2dd9 2024-09-21T12:29:13.138 INFO:teuthology.orchestra.run.smithi003.stdout:osd.4 smithi192 running (51s) 13s ago 13m 92.0M 2240M 19.3.0-5103-g5c1cdc3c 8f4d013db793 5b1bd4bec479 2024-09-21T12:29:13.138 INFO:teuthology.orchestra.run.smithi003.stdout:osd.5 smithi192 running (17s) 13s ago 12m 12.2M 2240M 19.3.0-5103-g5c1cdc3c 8f4d013db793 584f3f612483 2024-09-21T12:29:13.138 INFO:teuthology.orchestra.run.smithi003.stdout:prometheus.smithi003 smithi003 *:9095 running (5m) 118s ago 16m 54.6M - 2.51.0 1d3b7f56885b 64997a33fbbb 2024-09-21T12:29:13.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.136+0000 7f45a838e640 1 -- 172.21.15.3:0/3681250390 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f458c07af40 msgr2=0x7f458c07d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:29:13.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.136+0000 7f45a838e640 1 --2- 172.21.15.3:0/3681250390 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f458c07af40 0x7f458c07d400 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f45a019b1a0 tx=0x7f4590009560 comp rx=0 tx=0).stop 2024-09-21T12:29:13.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.136+0000 7f45a838e640 1 -- 172.21.15.3:0/3681250390 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f45a0101900 msgr2=0x7f45a019f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:29:13.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.136+0000 7f45a838e640 1 --2- 172.21.15.3:0/3681250390 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f45a0101900 0x7f45a019f7f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f459c00c8a0 tx=0x7f459c00cd60 comp rx=0 tx=0).stop 2024-09-21T12:29:13.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.136+0000 7f45a838e640 1 -- 172.21.15.3:0/3681250390 shutdown_connections 2024-09-21T12:29:13.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.136+0000 7f45a838e640 1 --2- 172.21.15.3:0/3681250390 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f458c07af40 0x7f458c07d400 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:13.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.136+0000 7f45a838e640 1 --2- 172.21.15.3:0/3681250390 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f45a0107900 0x7f45a019fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:13.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.136+0000 7f45a838e640 1 --2- 172.21.15.3:0/3681250390 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f45a0101900 0x7f45a019f7f0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:13.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.136+0000 7f45a838e640 1 -- 172.21.15.3:0/3681250390 >> 172.21.15.3:0/3681250390 conn(0x7f45a00fd600 msgr2=0x7f45a0074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:29:13.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.136+0000 7f45a838e640 1 -- 172.21.15.3:0/3681250390 shutdown_connections 2024-09-21T12:29:13.139 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.136+0000 7f45a838e640 1 -- 172.21.15.3:0/3681250390 wait complete. 2024-09-21T12:29:13.227 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.224+0000 7f09b0100640 1 -- 172.21.15.3:0/255977261 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f09a8074f40 msgr2=0x7f09a810dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:29:13.227 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.224+0000 7f09b0100640 1 --2- 172.21.15.3:0/255977261 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f09a8074f40 0x7f09a810dc00 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0998009880 tx=0x7f099802a530 comp rx=0 tx=0).stop 2024-09-21T12:29:13.227 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.224+0000 7f09b0100640 1 -- 172.21.15.3:0/255977261 shutdown_connections 2024-09-21T12:29:13.227 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.224+0000 7f09b0100640 1 --2- 172.21.15.3:0/255977261 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f09a8074f40 0x7f09a810dc00 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:13.227 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.224+0000 7f09b0100640 1 --2- 172.21.15.3:0/255977261 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f09a8074620 0x7f09a8074a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:13.227 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.224+0000 7f09b0100640 1 -- 172.21.15.3:0/255977261 >> 172.21.15.3:0/255977261 conn(0x7f09a80fd600 msgr2=0x7f09a80ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:29:13.227 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.224+0000 7f09b0100640 1 -- 172.21.15.3:0/255977261 shutdown_connections 2024-09-21T12:29:13.227 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.225+0000 7f09b0100640 1 -- 172.21.15.3:0/255977261 wait complete. 2024-09-21T12:29:13.229 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.225+0000 7f09b0100640 1 Processor -- start 2024-09-21T12:29:13.229 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.225+0000 7f09b0100640 1 -- start start 2024-09-21T12:29:13.229 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.225+0000 7f09b0100640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f09a8074620 0x7f09a819f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:29:13.229 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.225+0000 7f09b0100640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f09a8074f40 0x7f09a819fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:29:13.229 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.225+0000 7f09b0100640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f09a8110ff0 con 0x7f09a8074620 2024-09-21T12:29:13.229 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.225+0000 7f09b0100640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f09a8110e70 con 0x7f09a8074f40 2024-09-21T12:29:13.229 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.225+0000 7f09ade9c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f09a8074620 0x7f09a819f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:29:13.229 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.225+0000 7f09ade9c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f09a8074620 0x7f09a819f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:58086/0 (socket says 172.21.15.3:58086) 2024-09-21T12:29:13.230 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.225+0000 7f09ade9c640 1 -- 172.21.15.3:0/4266406594 learned_addr learned my addr 172.21.15.3:0/4266406594 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:29:13.230 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.226+0000 7f09ade9c640 1 -- 172.21.15.3:0/4266406594 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f09a8074f40 msgr2=0x7f09a819fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:29:13.230 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.226+0000 7f09ad69b640 1 --2- 172.21.15.3:0/4266406594 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f09a8074f40 0x7f09a819fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:29:13.230 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.226+0000 7f09ade9c640 1 --2- 172.21.15.3:0/4266406594 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f09a8074f40 0x7f09a819fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:13.230 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.226+0000 7f09ade9c640 1 -- 172.21.15.3:0/4266406594 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09a8199a20 con 0x7f09a8074620 2024-09-21T12:29:13.230 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.226+0000 7f09ad69b640 1 --2- 172.21.15.3:0/4266406594 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f09a8074f40 0x7f09a819fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T12:29:13.230 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.226+0000 7f09ade9c640 1 --2- 172.21.15.3:0/4266406594 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f09a8074620 0x7f09a819f860 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f09a400d6f0 tx=0x7f09a400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:29:13.230 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.226+0000 7f099effd640 1 -- 172.21.15.3:0/4266406594 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f09a4017070 con 0x7f09a8074620 2024-09-21T12:29:13.230 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.226+0000 7f09b0100640 1 -- 172.21.15.3:0/4266406594 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09a8199d10 con 0x7f09a8074620 2024-09-21T12:29:13.230 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.226+0000 7f099effd640 1 -- 172.21.15.3:0/4266406594 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f09a400de00 con 0x7f09a8074620 2024-09-21T12:29:13.230 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.226+0000 7f099effd640 1 -- 172.21.15.3:0/4266406594 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f09a4004bb0 con 0x7f09a8074620 2024-09-21T12:29:13.230 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.226+0000 7f09b0100640 1 -- 172.21.15.3:0/4266406594 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09a819a2a0 con 0x7f09a8074620 2024-09-21T12:29:13.231 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.227+0000 7f09b0100640 1 -- 172.21.15.3:0/4266406594 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09a8075cd0 con 0x7f09a8074620 2024-09-21T12:29:13.231 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.228+0000 7f099effd640 1 -- 172.21.15.3:0/4266406594 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f09a4004e60 con 0x7f09a8074620 2024-09-21T12:29:13.231 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.229+0000 7f099effd640 1 --2- 172.21.15.3:0/4266406594 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f099407af30 0x7f099407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:29:13.231 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.229+0000 7f099effd640 1 -- 172.21.15.3:0/4266406594 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 6156+0+0 (secure 0 0 0) 0x7f09a409dfd0 con 0x7f09a8074620 2024-09-21T12:29:13.232 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.229+0000 7f09ad69b640 1 --2- 172.21.15.3:0/4266406594 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f099407af30 0x7f099407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:29:13.232 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.229+0000 7f09ad69b640 1 --2- 172.21.15.3:0/4266406594 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f099407af30 0x7f099407d3f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0998031460 tx=0x7f09980095f0 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:29:13.235 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.232+0000 7f099effd640 1 -- 172.21.15.3:0/4266406594 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f09a40696f0 con 0x7f09a8074620 2024-09-21T12:29:13.503 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.501+0000 7f09b0100640 1 -- 172.21.15.3:0/4266406594 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f09a819af50 con 0x7f09a8074620 2024-09-21T12:29:13.504 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.501+0000 7f099effd640 1 -- 172.21.15.3:0/4266406594 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+835 (secure 0 0 0) 0x7f09a406e5a0 con 0x7f09a8074620 2024-09-21T12:29:13.504 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-21T12:29:13.504 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": { 2024-09-21T12:29:13.504 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:29:13.504 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:29:13.504 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": { 2024-09-21T12:29:13.504 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:29:13.504 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:29:13.504 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": { 2024-09-21T12:29:13.504 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 6 2024-09-21T12:29:13.504 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:29:13.504 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": { 2024-09-21T12:29:13.505 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 3, 2024-09-21T12:29:13.505 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 1 2024-09-21T12:29:13.505 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:29:13.505 INFO:teuthology.orchestra.run.smithi003.stdout: "overall": { 2024-09-21T12:29:13.505 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 3, 2024-09-21T12:29:13.505 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 11 2024-09-21T12:29:13.505 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-21T12:29:13.505 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-21T12:29:13.506 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.503+0000 7f09b0100640 1 -- 172.21.15.3:0/4266406594 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f099407af30 msgr2=0x7f099407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:29:13.506 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.503+0000 7f09b0100640 1 --2- 172.21.15.3:0/4266406594 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f099407af30 0x7f099407d3f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0998031460 tx=0x7f09980095f0 comp rx=0 tx=0).stop 2024-09-21T12:29:13.506 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.503+0000 7f09b0100640 1 -- 172.21.15.3:0/4266406594 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f09a8074620 msgr2=0x7f09a819f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:29:13.506 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.503+0000 7f09b0100640 1 --2- 172.21.15.3:0/4266406594 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f09a8074620 0x7f09a819f860 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f09a400d6f0 tx=0x7f09a400dbb0 comp rx=0 tx=0).stop 2024-09-21T12:29:13.506 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.503+0000 7f09b0100640 1 -- 172.21.15.3:0/4266406594 shutdown_connections 2024-09-21T12:29:13.506 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.503+0000 7f09b0100640 1 --2- 172.21.15.3:0/4266406594 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f099407af30 0x7f099407d3f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:13.506 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.503+0000 7f09b0100640 1 --2- 172.21.15.3:0/4266406594 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f09a8074f40 0x7f09a819fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:13.506 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.503+0000 7f09b0100640 1 --2- 172.21.15.3:0/4266406594 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f09a8074620 0x7f09a819f860 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:13.506 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.503+0000 7f09b0100640 1 -- 172.21.15.3:0/4266406594 >> 172.21.15.3:0/4266406594 conn(0x7f09a80fd600 msgr2=0x7f09a810b250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:29:13.506 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.503+0000 7f09b0100640 1 -- 172.21.15.3:0/4266406594 shutdown_connections 2024-09-21T12:29:13.506 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.503+0000 7f09b0100640 1 -- 172.21.15.3:0/4266406594 wait complete. 2024-09-21T12:29:13.591 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.588+0000 7f0438115640 1 -- 172.21.15.3:0/4250399010 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f04301007f0 msgr2=0x7f0430100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:29:13.591 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.588+0000 7f0438115640 1 --2- 172.21.15.3:0/4250399010 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f04301007f0 0x7f0430100c50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0420009880 tx=0x7f042002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:29:13.591 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.588+0000 7f0438115640 1 -- 172.21.15.3:0/4250399010 shutdown_connections 2024-09-21T12:29:13.591 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.588+0000 7f0438115640 1 --2- 172.21.15.3:0/4250399010 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f04301007f0 0x7f0430100c50 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:13.591 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.588+0000 7f0438115640 1 --2- 172.21.15.3:0/4250399010 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04301067f0 0x7f0430106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:13.591 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.588+0000 7f0438115640 1 -- 172.21.15.3:0/4250399010 >> 172.21.15.3:0/4250399010 conn(0x7f04300fc550 msgr2=0x7f04300fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:29:13.591 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.588+0000 7f0438115640 1 -- 172.21.15.3:0/4250399010 shutdown_connections 2024-09-21T12:29:13.591 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.588+0000 7f0438115640 1 -- 172.21.15.3:0/4250399010 wait complete. 2024-09-21T12:29:13.593 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.589+0000 7f0438115640 1 Processor -- start 2024-09-21T12:29:13.593 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.589+0000 7f0438115640 1 -- start start 2024-09-21T12:29:13.593 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.589+0000 7f0438115640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f04301007f0 0x7f043019f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:29:13.593 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.589+0000 7f0438115640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04301067f0 0x7f043019fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:29:13.593 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.589+0000 7f0438115640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f043010dcc0 con 0x7f04301007f0 2024-09-21T12:29:13.593 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.589+0000 7f0438115640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f043010db40 con 0x7f04301067f0 2024-09-21T12:29:13.593 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.589+0000 7f0435eb1640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f04301007f0 0x7f043019f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:29:13.593 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.589+0000 7f0435eb1640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f04301007f0 0x7f043019f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:58106/0 (socket says 172.21.15.3:58106) 2024-09-21T12:29:13.593 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.589+0000 7f0435eb1640 1 -- 172.21.15.3:0/418718763 learned_addr learned my addr 172.21.15.3:0/418718763 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:29:13.593 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.589+0000 7f04356b0640 1 --2- 172.21.15.3:0/418718763 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04301067f0 0x7f043019fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:29:13.593 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.590+0000 7f0435eb1640 1 -- 172.21.15.3:0/418718763 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04301067f0 msgr2=0x7f043019fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:29:13.593 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.590+0000 7f0435eb1640 1 --2- 172.21.15.3:0/418718763 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04301067f0 0x7f043019fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:13.593 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.590+0000 7f0435eb1640 1 -- 172.21.15.3:0/418718763 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04301999b0 con 0x7f04301007f0 2024-09-21T12:29:13.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.590+0000 7f04356b0640 1 --2- 172.21.15.3:0/418718763 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04301067f0 0x7f043019fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:29:13.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.590+0000 7f0435eb1640 1 --2- 172.21.15.3:0/418718763 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f04301007f0 0x7f043019f7f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f042c00d6f0 tx=0x7f042c00dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:29:13.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.590+0000 7f0426ffd640 1 -- 172.21.15.3:0/418718763 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f042c017070 con 0x7f04301007f0 2024-09-21T12:29:13.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.590+0000 7f0426ffd640 1 -- 172.21.15.3:0/418718763 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f042c00de00 con 0x7f04301007f0 2024-09-21T12:29:13.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.590+0000 7f0438115640 1 -- 172.21.15.3:0/418718763 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0430199ca0 con 0x7f04301007f0 2024-09-21T12:29:13.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.590+0000 7f0426ffd640 1 -- 172.21.15.3:0/418718763 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f042c004bb0 con 0x7f04301007f0 2024-09-21T12:29:13.594 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.590+0000 7f0438115640 1 -- 172.21.15.3:0/418718763 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f043019a200 con 0x7f04301007f0 2024-09-21T12:29:13.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.591+0000 7f0438115640 1 -- 172.21.15.3:0/418718763 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0430101f30 con 0x7f04301007f0 2024-09-21T12:29:13.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.592+0000 7f0426ffd640 1 -- 172.21.15.3:0/418718763 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f042c004e60 con 0x7f04301007f0 2024-09-21T12:29:13.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.592+0000 7f0426ffd640 1 --2- 172.21.15.3:0/418718763 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f041c07af30 0x7f041c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:29:13.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.592+0000 7f04356b0640 1 --2- 172.21.15.3:0/418718763 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f041c07af30 0x7f041c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:29:13.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.592+0000 7f0426ffd640 1 -- 172.21.15.3:0/418718763 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 6156+0+0 (secure 0 0 0) 0x7f042c09dcf0 con 0x7f04301007f0 2024-09-21T12:29:13.595 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.593+0000 7f04356b0640 1 --2- 172.21.15.3:0/418718763 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f041c07af30 0x7f041c07d3f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f043019b1a0 tx=0x7f0420031400 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:29:13.599 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.597+0000 7f0426ffd640 1 -- 172.21.15.3:0/418718763 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f042c069250 con 0x7f04301007f0 2024-09-21T12:29:13.828 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:13 smithi192 ceph-mon[80326]: from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:29:13.828 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:13 smithi192 ceph-mon[80326]: from='client.34322 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:29:13.828 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:13 smithi192 ceph-mon[80326]: pgmap v250: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:29:13.828 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:13 smithi192 ceph-mon[80326]: from='client.? 172.21.15.3:0/4266406594' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:29:13.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:13 smithi003 ceph-mon[108723]: from='client.34318 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:29:13.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:13 smithi003 ceph-mon[108723]: from='client.34322 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:29:13.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:13 smithi003 ceph-mon[108723]: pgmap v250: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:29:13.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:13 smithi003 ceph-mon[108723]: from='client.? 172.21.15.3:0/4266406594' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:29:13.830 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.827+0000 7f0438115640 1 -- 172.21.15.3:0/418718763 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f043019a4b0 con 0x7f04301007f0 2024-09-21T12:29:13.830 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.828+0000 7f0426ffd640 1 -- 172.21.15.3:0/418718763 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) ==== 76+0+2014 (secure 0 0 0) 0x7f042c06e100 con 0x7f04301007f0 2024-09-21T12:29:13.831 INFO:teuthology.orchestra.run.smithi003.stdout:e16 2024-09-21T12:29:13.831 INFO:teuthology.orchestra.run.smithi003.stdout:btime 2024-09-21T12:29:10:968359+0000 2024-09-21T12:29:13.831 INFO:teuthology.orchestra.run.smithi003.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T12:29:13.831 INFO:teuthology.orchestra.run.smithi003.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:29:13.831 INFO:teuthology.orchestra.run.smithi003.stdout:legacy client fscid: 1 2024-09-21T12:29:13.831 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:29:13.831 INFO:teuthology.orchestra.run.smithi003.stdout:Filesystem 'cephfs' (1) 2024-09-21T12:29:13.831 INFO:teuthology.orchestra.run.smithi003.stdout:fs_name cephfs 2024-09-21T12:29:13.831 INFO:teuthology.orchestra.run.smithi003.stdout:epoch 14 2024-09-21T12:29:13.831 INFO:teuthology.orchestra.run.smithi003.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T12:29:13.831 INFO:teuthology.orchestra.run.smithi003.stdout:created 2024-09-21T12:17:38.260099+0000 2024-09-21T12:29:13.831 INFO:teuthology.orchestra.run.smithi003.stdout:modified 2024-09-21T12:17:55.592927+0000 2024-09-21T12:29:13.831 INFO:teuthology.orchestra.run.smithi003.stdout:tableserver 0 2024-09-21T12:29:13.831 INFO:teuthology.orchestra.run.smithi003.stdout:root 0 2024-09-21T12:29:13.832 INFO:teuthology.orchestra.run.smithi003.stdout:session_timeout 60 2024-09-21T12:29:13.832 INFO:teuthology.orchestra.run.smithi003.stdout:session_autoclose 300 2024-09-21T12:29:13.832 INFO:teuthology.orchestra.run.smithi003.stdout:max_file_size 1099511627776 2024-09-21T12:29:13.832 INFO:teuthology.orchestra.run.smithi003.stdout:max_xattr_size 65536 2024-09-21T12:29:13.832 INFO:teuthology.orchestra.run.smithi003.stdout:required_client_features {} 2024-09-21T12:29:13.832 INFO:teuthology.orchestra.run.smithi003.stdout:last_failure 0 2024-09-21T12:29:13.832 INFO:teuthology.orchestra.run.smithi003.stdout:last_failure_osd_epoch 46 2024-09-21T12:29:13.832 INFO:teuthology.orchestra.run.smithi003.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:29:13.832 INFO:teuthology.orchestra.run.smithi003.stdout:max_mds 1 2024-09-21T12:29:13.832 INFO:teuthology.orchestra.run.smithi003.stdout:in 0 2024-09-21T12:29:13.832 INFO:teuthology.orchestra.run.smithi003.stdout:up {0=14564} 2024-09-21T12:29:13.832 INFO:teuthology.orchestra.run.smithi003.stdout:failed 2024-09-21T12:29:13.832 INFO:teuthology.orchestra.run.smithi003.stdout:damaged 2024-09-21T12:29:13.832 INFO:teuthology.orchestra.run.smithi003.stdout:stopped 2024-09-21T12:29:13.832 INFO:teuthology.orchestra.run.smithi003.stdout:data_pools [3] 2024-09-21T12:29:13.833 INFO:teuthology.orchestra.run.smithi003.stdout:metadata_pool 2 2024-09-21T12:29:13.833 INFO:teuthology.orchestra.run.smithi003.stdout:inline_data enabled 2024-09-21T12:29:13.833 INFO:teuthology.orchestra.run.smithi003.stdout:balancer 2024-09-21T12:29:13.833 INFO:teuthology.orchestra.run.smithi003.stdout:bal_rank_mask -1 2024-09-21T12:29:13.833 INFO:teuthology.orchestra.run.smithi003.stdout:standby_count_wanted 1 2024-09-21T12:29:13.833 INFO:teuthology.orchestra.run.smithi003.stdout:qdb_cluster leader: 14564 members: 14564 2024-09-21T12:29:13.833 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.cephfs.smithi003.gfkngj{0:14564} state up:active seq 5 join_fscid=1 addr [v2:172.21.15.3:6828/3710817325,v1:172.21.15.3:6829/3710817325] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:29:13.833 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:29:13.833 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:29:13.833 INFO:teuthology.orchestra.run.smithi003.stdout:Standby daemons: 2024-09-21T12:29:13.833 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:29:13.833 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.cephfs.smithi192.ywqqxe{-1:24319} state up:standby seq 3 join_fscid=1 addr [v2:172.21.15.192:6824/4055220871,v1:172.21.15.192:6825/4055220871] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:29:13.833 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.cephfs.smithi192.ktdqns{-1:24337} state up:standby seq 2 join_fscid=1 addr [v2:172.21.15.192:6826/318800854,v1:172.21.15.192:6827/318800854] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:29:13.833 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.cephfs.smithi003.ebjgyl{-1:34314} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.3:6826/1616995236,v1:172.21.15.3:6827/1616995236] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:29:13.834 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 16 2024-09-21T12:29:13.834 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.830+0000 7f0438115640 1 -- 172.21.15.3:0/418718763 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f041c07af30 msgr2=0x7f041c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:29:13.834 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.830+0000 7f0438115640 1 --2- 172.21.15.3:0/418718763 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f041c07af30 0x7f041c07d3f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f043019b1a0 tx=0x7f0420031400 comp rx=0 tx=0).stop 2024-09-21T12:29:13.834 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.830+0000 7f0438115640 1 -- 172.21.15.3:0/418718763 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f04301007f0 msgr2=0x7f043019f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:29:13.834 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.830+0000 7f0438115640 1 --2- 172.21.15.3:0/418718763 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f04301007f0 0x7f043019f7f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f042c00d6f0 tx=0x7f042c00dbb0 comp rx=0 tx=0).stop 2024-09-21T12:29:13.834 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.831+0000 7f0438115640 1 -- 172.21.15.3:0/418718763 shutdown_connections 2024-09-21T12:29:13.834 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.831+0000 7f0438115640 1 --2- 172.21.15.3:0/418718763 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f041c07af30 0x7f041c07d3f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:13.834 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.831+0000 7f0438115640 1 --2- 172.21.15.3:0/418718763 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f04301067f0 0x7f043019fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:13.834 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.831+0000 7f0438115640 1 --2- 172.21.15.3:0/418718763 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f04301007f0 0x7f043019f7f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:13.834 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.831+0000 7f0438115640 1 -- 172.21.15.3:0/418718763 >> 172.21.15.3:0/418718763 conn(0x7f04300fc550 msgr2=0x7f0430069ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:29:13.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.831+0000 7f0438115640 1 -- 172.21.15.3:0/418718763 shutdown_connections 2024-09-21T12:29:13.835 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.831+0000 7f0438115640 1 -- 172.21.15.3:0/418718763 wait complete. 2024-09-21T12:29:13.926 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.922+0000 7f4773af1640 1 -- 172.21.15.3:0/568213552 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f476c1033e0 msgr2=0x7f476c10b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:29:13.926 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.922+0000 7f4773af1640 1 --2- 172.21.15.3:0/568213552 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f476c1033e0 0x7f476c10b8d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4760009880 tx=0x7f476002a530 comp rx=0 tx=0).stop 2024-09-21T12:29:13.926 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.923+0000 7f4773af1640 1 -- 172.21.15.3:0/568213552 shutdown_connections 2024-09-21T12:29:13.927 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.923+0000 7f4773af1640 1 --2- 172.21.15.3:0/568213552 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f476c1033e0 0x7f476c10b8d0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:13.927 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.923+0000 7f4773af1640 1 --2- 172.21.15.3:0/568213552 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f476c102ac0 0x7f476c102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:13.927 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.923+0000 7f4773af1640 1 -- 172.21.15.3:0/568213552 >> 172.21.15.3:0/568213552 conn(0x7f476c0fc520 msgr2=0x7f476c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:29:13.927 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.923+0000 7f4773af1640 1 -- 172.21.15.3:0/568213552 shutdown_connections 2024-09-21T12:29:13.927 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.923+0000 7f4773af1640 1 -- 172.21.15.3:0/568213552 wait complete. 2024-09-21T12:29:13.927 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.923+0000 7f4773af1640 1 Processor -- start 2024-09-21T12:29:13.927 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.923+0000 7f4773af1640 1 -- start start 2024-09-21T12:29:13.927 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.924+0000 7f4773af1640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f476c102ac0 0x7f476c100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:29:13.927 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.924+0000 7f4773af1640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f476c1033e0 0x7f476c100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:29:13.927 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.924+0000 7f4773af1640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f476c10edd0 con 0x7f476c1033e0 2024-09-21T12:29:13.927 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.924+0000 7f4773af1640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f476c10ec50 con 0x7f476c102ac0 2024-09-21T12:29:13.927 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.924+0000 7f477108c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f476c1033e0 0x7f476c100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:29:13.927 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.924+0000 7f477108c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f476c1033e0 0x7f476c100c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:58124/0 (socket says 172.21.15.3:58124) 2024-09-21T12:29:13.927 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.924+0000 7f477108c640 1 -- 172.21.15.3:0/502718134 learned_addr learned my addr 172.21.15.3:0/502718134 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:29:13.927 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.924+0000 7f477188d640 1 --2- 172.21.15.3:0/502718134 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f476c102ac0 0x7f476c100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:29:13.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.924+0000 7f477108c640 1 -- 172.21.15.3:0/502718134 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f476c102ac0 msgr2=0x7f476c100720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:29:13.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.924+0000 7f477108c640 1 --2- 172.21.15.3:0/502718134 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f476c102ac0 0x7f476c100720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:13.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.924+0000 7f477108c640 1 -- 172.21.15.3:0/502718134 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f476c1011a0 con 0x7f476c1033e0 2024-09-21T12:29:13.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.924+0000 7f477108c640 1 --2- 172.21.15.3:0/502718134 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f476c1033e0 0x7f476c100c60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4760031460 tx=0x7f47600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:29:13.929 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.924+0000 7f475effd640 1 -- 172.21.15.3:0/502718134 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f476003f070 con 0x7f476c1033e0 2024-09-21T12:29:13.929 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.924+0000 7f4773af1640 1 -- 172.21.15.3:0/502718134 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f476c101430 con 0x7f476c1033e0 2024-09-21T12:29:13.929 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.924+0000 7f475effd640 1 -- 172.21.15.3:0/502718134 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4760004ac0 con 0x7f476c1033e0 2024-09-21T12:29:13.929 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.924+0000 7f475effd640 1 -- 172.21.15.3:0/502718134 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4760035030 con 0x7f476c1033e0 2024-09-21T12:29:13.929 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.924+0000 7f4773af1640 1 -- 172.21.15.3:0/502718134 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f476c1a3d50 con 0x7f476c1033e0 2024-09-21T12:29:13.929 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.925+0000 7f4773af1640 1 -- 172.21.15.3:0/502718134 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f476c06aa90 con 0x7f476c1033e0 2024-09-21T12:29:13.929 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.926+0000 7f475effd640 1 -- 172.21.15.3:0/502718134 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f4760042070 con 0x7f476c1033e0 2024-09-21T12:29:13.930 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.927+0000 7f475effd640 1 --2- 172.21.15.3:0/502718134 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f475807af30 0x7f475807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:29:13.930 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.927+0000 7f475effd640 1 -- 172.21.15.3:0/502718134 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 6156+0+0 (secure 0 0 0) 0x7f47600bea30 con 0x7f476c1033e0 2024-09-21T12:29:13.930 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.927+0000 7f477188d640 1 --2- 172.21.15.3:0/502718134 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f475807af30 0x7f475807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:29:13.930 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.927+0000 7f477188d640 1 --2- 172.21.15.3:0/502718134 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f475807af30 0x7f475807d3f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4768005e10 tx=0x7f4768005da0 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:29:13.933 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:13.931+0000 7f475effd640 1 -- 172.21.15.3:0/502718134 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f476008a030 con 0x7f476c1033e0 2024-09-21T12:29:14.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:14.141+0000 7f4773af1640 1 -- 172.21.15.3:0/502718134 --> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f476c062630 con 0x7f475807af30 2024-09-21T12:29:14.145 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:14.142+0000 7f475effd640 1 -- 172.21.15.3:0/502718134 <== mgr.14756 v2:172.21.15.3:6800/1284098095 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f476c062630 con 0x7f475807af30 2024-09-21T12:29:14.145 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-21T12:29:14.145 INFO:teuthology.orchestra.run.smithi003.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T12:29:14.145 INFO:teuthology.orchestra.run.smithi003.stdout: "in_progress": true, 2024-09-21T12:29:14.145 INFO:teuthology.orchestra.run.smithi003.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T12:29:14.145 INFO:teuthology.orchestra.run.smithi003.stdout: "services_complete": [ 2024-09-21T12:29:14.145 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr", 2024-09-21T12:29:14.145 INFO:teuthology.orchestra.run.smithi003.stdout: "mon", 2024-09-21T12:29:14.145 INFO:teuthology.orchestra.run.smithi003.stdout: "crash", 2024-09-21T12:29:14.145 INFO:teuthology.orchestra.run.smithi003.stdout: "osd" 2024-09-21T12:29:14.146 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-21T12:29:14.146 INFO:teuthology.orchestra.run.smithi003.stdout: "progress": "12/23 daemons upgraded", 2024-09-21T12:29:14.146 INFO:teuthology.orchestra.run.smithi003.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T12:29:14.146 INFO:teuthology.orchestra.run.smithi003.stdout: "is_paused": false 2024-09-21T12:29:14.146 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-21T12:29:14.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:14.145+0000 7f4773af1640 1 -- 172.21.15.3:0/502718134 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f475807af30 msgr2=0x7f475807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:29:14.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:14.145+0000 7f4773af1640 1 --2- 172.21.15.3:0/502718134 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f475807af30 0x7f475807d3f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4768005e10 tx=0x7f4768005da0 comp rx=0 tx=0).stop 2024-09-21T12:29:14.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:14.145+0000 7f4773af1640 1 -- 172.21.15.3:0/502718134 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f476c1033e0 msgr2=0x7f476c100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:29:14.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:14.145+0000 7f4773af1640 1 --2- 172.21.15.3:0/502718134 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f476c1033e0 0x7f476c100c60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4760031460 tx=0x7f47600046c0 comp rx=0 tx=0).stop 2024-09-21T12:29:14.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:14.145+0000 7f4773af1640 1 -- 172.21.15.3:0/502718134 shutdown_connections 2024-09-21T12:29:14.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:14.145+0000 7f4773af1640 1 --2- 172.21.15.3:0/502718134 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f475807af30 0x7f475807d3f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:14.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:14.145+0000 7f4773af1640 1 --2- 172.21.15.3:0/502718134 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f476c1033e0 0x7f476c100c60 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:14.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:14.145+0000 7f4773af1640 1 --2- 172.21.15.3:0/502718134 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f476c102ac0 0x7f476c100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:14.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:14.145+0000 7f4773af1640 1 -- 172.21.15.3:0/502718134 >> 172.21.15.3:0/502718134 conn(0x7f476c0fc520 msgr2=0x7f476c108f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:29:14.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:14.145+0000 7f4773af1640 1 -- 172.21.15.3:0/502718134 shutdown_connections 2024-09-21T12:29:14.148 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:14.145+0000 7f4773af1640 1 -- 172.21.15.3:0/502718134 wait complete. 2024-09-21T12:29:14.236 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:14.234+0000 7fe5d9951640 1 -- 172.21.15.3:0/3585537324 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe5d40ffb60 msgr2=0x7fe5d40fff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:29:14.236 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:14.234+0000 7fe5d9951640 1 --2- 172.21.15.3:0/3585537324 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe5d40ffb60 0x7fe5d40fff40 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe5c4009880 tx=0x7fe5c402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:29:14.237 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:14.234+0000 7fe5d9951640 1 -- 172.21.15.3:0/3585537324 shutdown_connections 2024-09-21T12:29:14.237 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:14.234+0000 7fe5d9951640 1 --2- 172.21.15.3:0/3585537324 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5d4100510 0x7fe5d4106570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:14.237 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:14.234+0000 7fe5d9951640 1 --2- 172.21.15.3:0/3585537324 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe5d40ffb60 0x7fe5d40fff40 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:14.237 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:14.234+0000 7fe5d9951640 1 -- 172.21.15.3:0/3585537324 >> 172.21.15.3:0/3585537324 conn(0x7fe5d40fb870 msgr2=0x7fe5d40fdc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:29:14.237 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:14.234+0000 7fe5d9951640 1 -- 172.21.15.3:0/3585537324 shutdown_connections 2024-09-21T12:29:14.237 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:14.234+0000 7fe5d9951640 1 -- 172.21.15.3:0/3585537324 wait complete. 2024-09-21T12:29:14.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:14.235+0000 7fe5d9951640 1 Processor -- start 2024-09-21T12:29:14.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:14.235+0000 7fe5d9951640 1 -- start start 2024-09-21T12:29:14.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:14.235+0000 7fe5d9951640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5d40ffb60 0x7fe5d419d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:29:14.238 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:14.235+0000 7fe5d9951640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe5d4100510 0x7fe5d419dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:29:14.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:14.235+0000 7fe5d9951640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d410edc0 con 0x7fe5d4100510 2024-09-21T12:29:14.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:14.235+0000 7fe5d9951640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe5d410ec40 con 0x7fe5d40ffb60 2024-09-21T12:29:14.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:14.235+0000 7fe5d27fc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe5d4100510 0x7fe5d419dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:29:14.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:14.235+0000 7fe5d27fc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe5d4100510 0x7fe5d419dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:58138/0 (socket says 172.21.15.3:58138) 2024-09-21T12:29:14.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:14.235+0000 7fe5d27fc640 1 -- 172.21.15.3:0/2464023176 learned_addr learned my addr 172.21.15.3:0/2464023176 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:29:14.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:14.235+0000 7fe5d2ffd640 1 --2- 172.21.15.3:0/2464023176 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5d40ffb60 0x7fe5d419d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:29:14.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:14.235+0000 7fe5d27fc640 1 -- 172.21.15.3:0/2464023176 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5d40ffb60 msgr2=0x7fe5d419d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:29:14.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:14.235+0000 7fe5d27fc640 1 --2- 172.21.15.3:0/2464023176 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5d40ffb60 0x7fe5d419d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:14.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:14.235+0000 7fe5d27fc640 1 -- 172.21.15.3:0/2464023176 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5d41977f0 con 0x7fe5d4100510 2024-09-21T12:29:14.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:14.236+0000 7fe5d27fc640 1 --2- 172.21.15.3:0/2464023176 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe5d4100510 0x7fe5d419dbb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe5c800d6c0 tx=0x7fe5c800db80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:29:14.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:14.236+0000 7fe5d894f640 1 -- 172.21.15.3:0/2464023176 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe5c8017070 con 0x7fe5d4100510 2024-09-21T12:29:14.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:14.236+0000 7fe5d894f640 1 -- 172.21.15.3:0/2464023176 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe5c80054e0 con 0x7fe5d4100510 2024-09-21T12:29:14.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:14.236+0000 7fe5d894f640 1 -- 172.21.15.3:0/2464023176 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe5c8004b70 con 0x7fe5d4100510 2024-09-21T12:29:14.239 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:14.236+0000 7fe5d9951640 1 -- 172.21.15.3:0/2464023176 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5d4197ae0 con 0x7fe5d4100510 2024-09-21T12:29:14.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:14.236+0000 7fe5d9951640 1 -- 172.21.15.3:0/2464023176 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5d4197fb0 con 0x7fe5d4100510 2024-09-21T12:29:14.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:14.237+0000 7fe5d9951640 1 -- 172.21.15.3:0/2464023176 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5d4100e10 con 0x7fe5d4100510 2024-09-21T12:29:14.240 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:14.238+0000 7fe5d894f640 1 -- 172.21.15.3:0/2464023176 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7fe5c8009820 con 0x7fe5d4100510 2024-09-21T12:29:14.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:14.238+0000 7fe5d894f640 1 --2- 172.21.15.3:0/2464023176 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fe5bc07af80 0x7fe5bc07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:29:14.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:14.239+0000 7fe5d2ffd640 1 --2- 172.21.15.3:0/2464023176 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fe5bc07af80 0x7fe5bc07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:29:14.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:14.239+0000 7fe5d894f640 1 -- 172.21.15.3:0/2464023176 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 6156+0+0 (secure 0 0 0) 0x7fe5c809db20 con 0x7fe5d4100510 2024-09-21T12:29:14.241 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:14.239+0000 7fe5d2ffd640 1 --2- 172.21.15.3:0/2464023176 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fe5bc07af80 0x7fe5bc07d440 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe5c40096c0 tx=0x7fe5c4031400 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:29:14.246 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:14.243+0000 7fe5d894f640 1 -- 172.21.15.3:0/2464023176 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe5c8069100 con 0x7fe5d4100510 2024-09-21T12:29:14.510 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:14.507+0000 7fe5d9951640 1 -- 172.21.15.3:0/2464023176 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fe5d4109e50 con 0x7fe5d4100510 2024-09-21T12:29:14.510 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:14.507+0000 7fe5d894f640 1 -- 172.21.15.3:0/2464023176 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7fe5c806dfb0 con 0x7fe5d4100510 2024-09-21T12:29:14.510 INFO:teuthology.orchestra.run.smithi003.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-21T12:29:14.510 INFO:teuthology.orchestra.run.smithi003.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:29:14.510 INFO:teuthology.orchestra.run.smithi003.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:29:14.512 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:14.509+0000 7fe5d9951640 1 -- 172.21.15.3:0/2464023176 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fe5bc07af80 msgr2=0x7fe5bc07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:29:14.512 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:14.509+0000 7fe5d9951640 1 --2- 172.21.15.3:0/2464023176 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fe5bc07af80 0x7fe5bc07d440 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fe5c40096c0 tx=0x7fe5c4031400 comp rx=0 tx=0).stop 2024-09-21T12:29:14.512 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:14.509+0000 7fe5d9951640 1 -- 172.21.15.3:0/2464023176 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe5d4100510 msgr2=0x7fe5d419dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:29:14.512 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:14.509+0000 7fe5d9951640 1 --2- 172.21.15.3:0/2464023176 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe5d4100510 0x7fe5d419dbb0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe5c800d6c0 tx=0x7fe5c800db80 comp rx=0 tx=0).stop 2024-09-21T12:29:14.512 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:14.510+0000 7fe5d9951640 1 -- 172.21.15.3:0/2464023176 shutdown_connections 2024-09-21T12:29:14.512 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:14.510+0000 7fe5d9951640 1 --2- 172.21.15.3:0/2464023176 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fe5bc07af80 0x7fe5bc07d440 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:14.512 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:14.510+0000 7fe5d9951640 1 --2- 172.21.15.3:0/2464023176 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe5d4100510 0x7fe5d419dbb0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:14.512 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:14.510+0000 7fe5d9951640 1 --2- 172.21.15.3:0/2464023176 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe5d40ffb60 0x7fe5d419d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:14.513 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:14.510+0000 7fe5d9951640 1 -- 172.21.15.3:0/2464023176 >> 172.21.15.3:0/2464023176 conn(0x7fe5d40fb870 msgr2=0x7fe5d40fc7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:29:14.513 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:14.510+0000 7fe5d9951640 1 -- 172.21.15.3:0/2464023176 shutdown_connections 2024-09-21T12:29:14.513 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:14.510+0000 7fe5d9951640 1 -- 172.21.15.3:0/2464023176 wait complete. 2024-09-21T12:29:14.819 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:14 smithi003 ceph-mon[108723]: from='client.34326 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:29:14.819 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:14 smithi003 ceph-mon[108723]: from='client.? 172.21.15.3:0/418718763' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:29:14.820 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:14 smithi003 ceph-mon[108723]: from='client.? 172.21.15.3:0/2464023176' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:29:15.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:14 smithi192 ceph-mon[80326]: from='client.34326 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:29:15.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:14 smithi192 ceph-mon[80326]: from='client.? 172.21.15.3:0/418718763' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:29:15.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:14 smithi192 ceph-mon[80326]: from='client.? 172.21.15.3:0/2464023176' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:29:16.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:15 smithi192 ceph-mon[80326]: from='client.34338 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:29:16.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:15 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:29:16.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:15 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:29:16.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:15 smithi192 ceph-mon[80326]: pgmap v251: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:29:16.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:15 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:29:16.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:15 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:29:16.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:15 smithi003 ceph-mon[108723]: from='client.34338 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:29:16.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:15 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:29:16.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:15 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:29:16.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:15 smithi003 ceph-mon[108723]: pgmap v251: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:29:16.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:15 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:29:16.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:15 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:29:17.457 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:17 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:29:17.457 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:17 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:29:17.457 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:17 smithi192 ceph-mon[80326]: pgmap v252: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:29:17.512 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:17 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:29:17.512 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:17 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:29:17.512 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:17 smithi003 ceph-mon[108723]: pgmap v252: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:29:20.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:19 smithi003 ceph-mon[108723]: pgmap v253: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:29:20.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:19 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:29:20.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:19 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:29:20.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:19 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:29:20.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:19 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:29:20.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:19 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:29:20.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:19 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:29:20.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:19 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:29:20.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:19 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:29:20.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:19 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:29:20.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:19 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:29:20.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:19 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:29:20.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:19 smithi192 ceph-mon[80326]: pgmap v253: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:29:20.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:19 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:29:20.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:19 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:29:20.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:19 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:29:20.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:19 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:29:20.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:19 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:29:20.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:19 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:29:20.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:19 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:29:20.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:19 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:29:20.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:19 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:29:20.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:19 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:29:20.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:19 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:29:22.051 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:21 smithi003 ceph-mon[108723]: Upgrade: Updating mds.cephfs.smithi003.gfkngj 2024-09-21T12:29:22.051 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:21 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:29:22.051 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:21 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi003.gfkngj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T12:29:22.051 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:21 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:29:22.051 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:21 smithi003 ceph-mon[108723]: Deploying daemon mds.cephfs.smithi003.gfkngj on smithi003 2024-09-21T12:29:22.051 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:21 smithi003 ceph-mon[108723]: pgmap v254: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:29:22.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:21 smithi192 ceph-mon[80326]: Upgrade: Updating mds.cephfs.smithi003.gfkngj 2024-09-21T12:29:22.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:21 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:29:22.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:21 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi003.gfkngj", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T12:29:22.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:21 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:29:22.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:21 smithi192 ceph-mon[80326]: Deploying daemon mds.cephfs.smithi003.gfkngj on smithi003 2024-09-21T12:29:22.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:21 smithi192 ceph-mon[80326]: pgmap v254: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:29:22.947 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:22 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-mon-smithi003[108719]: 2024-09-21T12:29:22.611+0000 7f7947e01640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T12:29:22.947 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:22 smithi003 ceph-mon[108723]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T12:29:22.947 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:22 smithi003 ceph-mon[108723]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T12:29:22.947 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:22 smithi003 ceph-mon[108723]: osdmap e79: 6 total, 6 up, 6 in 2024-09-21T12:29:22.947 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:22 smithi003 ceph-mon[108723]: Standby daemon mds.cephfs.smithi192.ywqqxe assigned to filesystem cephfs as rank 0 2024-09-21T12:29:22.947 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:22 smithi003 ceph-mon[108723]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T12:29:22.947 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:22 smithi003 ceph-mon[108723]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-21T12:29:22.948 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:22 smithi003 ceph-mon[108723]: fsmap cephfs:1/1 {0=cephfs.smithi192.ywqqxe=up:replay} 2 up:standby 2024-09-21T12:29:23.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:22 smithi192 ceph-mon[80326]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T12:29:23.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:22 smithi192 ceph-mon[80326]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T12:29:23.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:22 smithi192 ceph-mon[80326]: osdmap e79: 6 total, 6 up, 6 in 2024-09-21T12:29:23.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:22 smithi192 ceph-mon[80326]: Standby daemon mds.cephfs.smithi192.ywqqxe assigned to filesystem cephfs as rank 0 2024-09-21T12:29:23.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:22 smithi192 ceph-mon[80326]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T12:29:23.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:22 smithi192 ceph-mon[80326]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-21T12:29:23.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:22 smithi192 ceph-mon[80326]: fsmap cephfs:1/1 {0=cephfs.smithi192.ywqqxe=up:replay} 2 up:standby 2024-09-21T12:29:24.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:23 smithi003 ceph-mon[108723]: pgmap v256: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:29:24.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:23 smithi192 ceph-mon[80326]: pgmap v256: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:29:25.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:24 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "mds metadata", "who": "cephfs.smithi003.gfkngj"} : dispatch 2024-09-21T12:29:25.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:24 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "mds metadata", "who": "cephfs.smithi003.gfkngj"} : dispatch 2024-09-21T12:29:26.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:25 smithi192 ceph-mon[80326]: pgmap v257: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.8 MiB/s rd, 0 op/s 2024-09-21T12:29:26.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:25 smithi003 ceph-mon[108723]: pgmap v257: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.8 MiB/s rd, 0 op/s 2024-09-21T12:29:28.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:27 smithi192 ceph-mon[80326]: pgmap v258: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 14 MiB/s rd, 4 op/s 2024-09-21T12:29:28.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:27 smithi003 ceph-mon[108723]: pgmap v258: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 14 MiB/s rd, 4 op/s 2024-09-21T12:29:30.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:29 smithi192 ceph-mon[80326]: pgmap v259: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 14 MiB/s rd, 4 op/s 2024-09-21T12:29:30.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:29 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:29:30.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:29 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:29:30.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:29 smithi003 ceph-mon[108723]: pgmap v259: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 14 MiB/s rd, 4 op/s 2024-09-21T12:29:30.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:29 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:29:30.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:29 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:29:32.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:31 smithi003 ceph-mon[108723]: pgmap v260: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 25 MiB/s rd, 7 op/s 2024-09-21T12:29:32.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:31 smithi192 ceph-mon[80326]: pgmap v260: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 25 MiB/s rd, 7 op/s 2024-09-21T12:29:33.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:32 smithi192 ceph-mon[80326]: reconnect by client.24361 192.168.0.1:0/3487024347 after 0.000999981 2024-09-21T12:29:33.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:32 smithi192 ceph-mon[80326]: reconnect by client.14600 192.168.0.1:0/1734926769 after 0.00199996 2024-09-21T12:29:33.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:32 smithi192 ceph-mon[80326]: mds.? [v2:172.21.15.192:6824/4055220871,v1:172.21.15.192:6825/4055220871] up:reconnect 2024-09-21T12:29:33.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:32 smithi192 ceph-mon[80326]: fsmap cephfs:1/1 {0=cephfs.smithi192.ywqqxe=up:reconnect} 2 up:standby 2024-09-21T12:29:33.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:32 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:29:33.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:32 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:29:33.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:32 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:29:33.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:32 smithi003 ceph-mon[108723]: reconnect by client.24361 192.168.0.1:0/3487024347 after 0.000999981 2024-09-21T12:29:33.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:32 smithi003 ceph-mon[108723]: reconnect by client.14600 192.168.0.1:0/1734926769 after 0.00199996 2024-09-21T12:29:33.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:32 smithi003 ceph-mon[108723]: mds.? [v2:172.21.15.192:6824/4055220871,v1:172.21.15.192:6825/4055220871] up:reconnect 2024-09-21T12:29:33.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:32 smithi003 ceph-mon[108723]: fsmap cephfs:1/1 {0=cephfs.smithi192.ywqqxe=up:reconnect} 2 up:standby 2024-09-21T12:29:33.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:32 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:29:33.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:32 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:29:33.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:32 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:29:34.197 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:33 smithi192 ceph-mon[80326]: pgmap v261: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 26 MiB/s rd, 7 op/s 2024-09-21T12:29:34.197 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:33 smithi192 ceph-mon[80326]: mds.? [v2:172.21.15.192:6824/4055220871,v1:172.21.15.192:6825/4055220871] up:rejoin 2024-09-21T12:29:34.197 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:33 smithi192 ceph-mon[80326]: mds.? [v2:172.21.15.3:6828/1282732153,v1:172.21.15.3:6829/1282732153] up:boot 2024-09-21T12:29:34.197 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:33 smithi192 ceph-mon[80326]: fsmap cephfs:1/1 {0=cephfs.smithi192.ywqqxe=up:rejoin} 3 up:standby 2024-09-21T12:29:34.197 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:33 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "mds metadata", "who": "cephfs.smithi003.gfkngj"} : dispatch 2024-09-21T12:29:34.197 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:33 smithi192 ceph-mon[80326]: daemon mds.cephfs.smithi192.ywqqxe is now active in filesystem cephfs as rank 0 2024-09-21T12:29:34.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:33 smithi003 ceph-mon[108723]: pgmap v261: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 26 MiB/s rd, 7 op/s 2024-09-21T12:29:34.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:33 smithi003 ceph-mon[108723]: mds.? [v2:172.21.15.192:6824/4055220871,v1:172.21.15.192:6825/4055220871] up:rejoin 2024-09-21T12:29:34.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:33 smithi003 ceph-mon[108723]: mds.? [v2:172.21.15.3:6828/1282732153,v1:172.21.15.3:6829/1282732153] up:boot 2024-09-21T12:29:34.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:33 smithi003 ceph-mon[108723]: fsmap cephfs:1/1 {0=cephfs.smithi192.ywqqxe=up:rejoin} 3 up:standby 2024-09-21T12:29:34.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:33 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "mds metadata", "who": "cephfs.smithi003.gfkngj"} : dispatch 2024-09-21T12:29:34.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:33 smithi003 ceph-mon[108723]: daemon mds.cephfs.smithi192.ywqqxe is now active in filesystem cephfs as rank 0 2024-09-21T12:29:35.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:34 smithi192 ceph-mon[80326]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T12:29:35.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:34 smithi192 ceph-mon[80326]: mds.? [v2:172.21.15.192:6824/4055220871,v1:172.21.15.192:6825/4055220871] up:active 2024-09-21T12:29:35.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:34 smithi192 ceph-mon[80326]: fsmap cephfs:1 {0=cephfs.smithi192.ywqqxe=up:active} 3 up:standby 2024-09-21T12:29:35.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:34 smithi003 ceph-mon[108723]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T12:29:35.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:34 smithi003 ceph-mon[108723]: mds.? [v2:172.21.15.192:6824/4055220871,v1:172.21.15.192:6825/4055220871] up:active 2024-09-21T12:29:35.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:34 smithi003 ceph-mon[108723]: fsmap cephfs:1 {0=cephfs.smithi192.ywqqxe=up:active} 3 up:standby 2024-09-21T12:29:36.211 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:35 smithi192 ceph-mon[80326]: pgmap v262: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 7 op/s 2024-09-21T12:29:36.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:35 smithi003 ceph-mon[108723]: pgmap v262: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 7 op/s 2024-09-21T12:29:38.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:37 smithi192 ceph-mon[80326]: pgmap v263: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 4.2 KiB/s wr, 11 op/s 2024-09-21T12:29:38.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:37 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:29:38.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:37 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:29:38.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:37 smithi003 ceph-mon[108723]: pgmap v263: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 4.2 KiB/s wr, 11 op/s 2024-09-21T12:29:38.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:37 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:29:38.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:37 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:29:39.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:38 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:29:39.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:38 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:29:39.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:38 smithi192 ceph-mon[80326]: pgmap v264: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 11 MiB/s rd, 4.2 KiB/s wr, 8 op/s 2024-09-21T12:29:39.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:38 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:29:39.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:38 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:29:39.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:38 smithi003 ceph-mon[108723]: pgmap v264: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 11 MiB/s rd, 4.2 KiB/s wr, 8 op/s 2024-09-21T12:29:42.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:41 smithi192 ceph-mon[80326]: pgmap v265: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 11 MiB/s rd, 4.2 KiB/s wr, 8 op/s 2024-09-21T12:29:42.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:41 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:29:42.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:41 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:29:42.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:41 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:29:42.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:41 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:29:42.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:41 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:29:42.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:41 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:29:42.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:41 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:29:42.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:41 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:29:42.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:41 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:29:42.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:41 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:29:42.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:41 smithi003 ceph-mon[108723]: pgmap v265: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 11 MiB/s rd, 4.2 KiB/s wr, 8 op/s 2024-09-21T12:29:42.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:41 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:29:42.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:41 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:29:42.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:41 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:29:42.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:41 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:29:42.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:41 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:29:42.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:41 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:29:42.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:41 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:29:42.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:41 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:29:42.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:41 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:29:42.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:41 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:29:43.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:43 smithi003 ceph-mon[108723]: Upgrade: Updating mds.cephfs.smithi192.ywqqxe 2024-09-21T12:29:43.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:43 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:29:43.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:43 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi192.ywqqxe", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T12:29:43.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:43 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:29:43.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:43 smithi003 ceph-mon[108723]: Deploying daemon mds.cephfs.smithi192.ywqqxe on smithi192 2024-09-21T12:29:43.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:43 smithi003 ceph-mon[108723]: pgmap v266: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-09-21T12:29:43.912 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:43 smithi192 ceph-mon[80326]: Upgrade: Updating mds.cephfs.smithi192.ywqqxe 2024-09-21T12:29:43.912 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:43 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:29:43.913 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:43 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi192.ywqqxe", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T12:29:43.913 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:43 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:29:43.913 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:43 smithi192 ceph-mon[80326]: Deploying daemon mds.cephfs.smithi192.ywqqxe on smithi192 2024-09-21T12:29:43.913 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:43 smithi192 ceph-mon[80326]: pgmap v266: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.0 MiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-09-21T12:29:44.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.606+0000 7f5165953640 1 -- 172.21.15.3:0/2161141372 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5160107900 msgr2=0x7f5160107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:29:44.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.606+0000 7f5165953640 1 --2- 172.21.15.3:0/2161141372 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5160107900 0x7f5160107ce0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5150009880 tx=0x7f515002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:29:44.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.606+0000 7f5165953640 1 -- 172.21.15.3:0/2161141372 shutdown_connections 2024-09-21T12:29:44.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.606+0000 7f5165953640 1 --2- 172.21.15.3:0/2161141372 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5160101900 0x7f5160101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:44.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.606+0000 7f5165953640 1 --2- 172.21.15.3:0/2161141372 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5160107900 0x7f5160107ce0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:44.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.606+0000 7f5165953640 1 -- 172.21.15.3:0/2161141372 >> 172.21.15.3:0/2161141372 conn(0x7f51600fd600 msgr2=0x7f51600ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:29:44.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.606+0000 7f5165953640 1 -- 172.21.15.3:0/2161141372 shutdown_connections 2024-09-21T12:29:44.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.606+0000 7f5165953640 1 -- 172.21.15.3:0/2161141372 wait complete. 2024-09-21T12:29:44.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.606+0000 7f5165953640 1 Processor -- start 2024-09-21T12:29:44.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.607+0000 7f5165953640 1 -- start start 2024-09-21T12:29:44.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.607+0000 7f5165953640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5160101900 0x7f51600744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:29:44.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.607+0000 7f5165953640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5160107900 0x7f5160074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:29:44.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.607+0000 7f5165953640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f516010edb0 con 0x7f5160107900 2024-09-21T12:29:44.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.607+0000 7f5165953640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f516010ec30 con 0x7f5160101900 2024-09-21T12:29:44.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.607+0000 7f5157fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5160107900 0x7f5160074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:29:44.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.607+0000 7f5157fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5160107900 0x7f5160074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:43826/0 (socket says 172.21.15.3:43826) 2024-09-21T12:29:44.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.607+0000 7f5157fff640 1 -- 172.21.15.3:0/258990083 learned_addr learned my addr 172.21.15.3:0/258990083 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:29:44.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.607+0000 7f515effd640 1 --2- 172.21.15.3:0/258990083 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5160101900 0x7f51600744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:29:44.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.607+0000 7f5157fff640 1 -- 172.21.15.3:0/258990083 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5160101900 msgr2=0x7f51600744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:29:44.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.607+0000 7f5157fff640 1 --2- 172.21.15.3:0/258990083 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5160101900 0x7f51600744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:44.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.607+0000 7f5157fff640 1 -- 172.21.15.3:0/258990083 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5160074f70 con 0x7f5160107900 2024-09-21T12:29:44.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.607+0000 7f5157fff640 1 --2- 172.21.15.3:0/258990083 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5160107900 0x7f5160074a30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f514800d8d0 tx=0x7f514800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:29:44.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.608+0000 7f5164951640 1 -- 172.21.15.3:0/258990083 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5148017030 con 0x7f5160107900 2024-09-21T12:29:44.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.608+0000 7f5164951640 1 -- 172.21.15.3:0/258990083 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5148004020 con 0x7f5160107900 2024-09-21T12:29:44.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.608+0000 7f5165953640 1 -- 172.21.15.3:0/258990083 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5160075260 con 0x7f5160107900 2024-09-21T12:29:44.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.608+0000 7f5164951640 1 -- 172.21.15.3:0/258990083 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f51480047a0 con 0x7f5160107900 2024-09-21T12:29:44.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.608+0000 7f5165953640 1 -- 172.21.15.3:0/258990083 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51601a3e60 con 0x7f5160107900 2024-09-21T12:29:44.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.609+0000 7f5165953640 1 -- 172.21.15.3:0/258990083 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5160103040 con 0x7f5160107900 2024-09-21T12:29:44.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.610+0000 7f5164951640 1 -- 172.21.15.3:0/258990083 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f51480041d0 con 0x7f5160107900 2024-09-21T12:29:44.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.610+0000 7f5164951640 1 --2- 172.21.15.3:0/258990083 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f514c07af80 0x7f514c07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:29:44.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.610+0000 7f5164951640 1 -- 172.21.15.3:0/258990083 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6328+0+0 (secure 0 0 0) 0x7f5148018070 con 0x7f5160107900 2024-09-21T12:29:44.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.610+0000 7f515effd640 1 --2- 172.21.15.3:0/258990083 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f514c07af80 0x7f514c07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:29:44.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.611+0000 7f515effd640 1 --2- 172.21.15.3:0/258990083 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f514c07af80 0x7f514c07d440 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f51500096c0 tx=0x7f5150031400 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:29:44.616 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.614+0000 7f5164951640 1 -- 172.21.15.3:0/258990083 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5148069340 con 0x7f5160107900 2024-09-21T12:29:44.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:44 smithi192 ceph-mon[80326]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T12:29:44.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:44 smithi192 ceph-mon[80326]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T12:29:44.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:44 smithi192 ceph-mon[80326]: osdmap e80: 6 total, 6 up, 6 in 2024-09-21T12:29:44.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:44 smithi192 ceph-mon[80326]: Standby daemon mds.cephfs.smithi192.ktdqns assigned to filesystem cephfs as rank 0 2024-09-21T12:29:44.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:44 smithi192 ceph-mon[80326]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T12:29:44.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:44 smithi192 ceph-mon[80326]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-21T12:29:44.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:44 smithi192 ceph-mon[80326]: fsmap cephfs:1/1 {0=cephfs.smithi192.ktdqns=up:replay} 2 up:standby 2024-09-21T12:29:44.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.823+0000 7f5165953640 1 -- 172.21.15.3:0/258990083 --> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f5160062630 con 0x7f514c07af80 2024-09-21T12:29:44.825 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:44 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-mon-smithi003[108719]: 2024-09-21T12:29:44.450+0000 7f7947e01640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T12:29:44.825 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:44 smithi003 ceph-mon[108723]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T12:29:44.825 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:44 smithi003 ceph-mon[108723]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T12:29:44.825 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:44 smithi003 ceph-mon[108723]: osdmap e80: 6 total, 6 up, 6 in 2024-09-21T12:29:44.825 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:44 smithi003 ceph-mon[108723]: Standby daemon mds.cephfs.smithi192.ktdqns assigned to filesystem cephfs as rank 0 2024-09-21T12:29:44.825 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:44 smithi003 ceph-mon[108723]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T12:29:44.825 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:44 smithi003 ceph-mon[108723]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-21T12:29:44.825 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:44 smithi003 ceph-mon[108723]: fsmap cephfs:1/1 {0=cephfs.smithi192.ktdqns=up:replay} 2 up:standby 2024-09-21T12:29:44.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.824+0000 7f5164951640 1 -- 172.21.15.3:0/258990083 <== mgr.14756 v2:172.21.15.3:6800/1284098095 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f5160062630 con 0x7f514c07af80 2024-09-21T12:29:44.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.827+0000 7f5165953640 1 -- 172.21.15.3:0/258990083 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f514c07af80 msgr2=0x7f514c07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:29:44.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.827+0000 7f5165953640 1 --2- 172.21.15.3:0/258990083 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f514c07af80 0x7f514c07d440 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f51500096c0 tx=0x7f5150031400 comp rx=0 tx=0).stop 2024-09-21T12:29:44.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.827+0000 7f5165953640 1 -- 172.21.15.3:0/258990083 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5160107900 msgr2=0x7f5160074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:29:44.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.827+0000 7f5165953640 1 --2- 172.21.15.3:0/258990083 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5160107900 0x7f5160074a30 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f514800d8d0 tx=0x7f514800dd90 comp rx=0 tx=0).stop 2024-09-21T12:29:44.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.827+0000 7f5165953640 1 -- 172.21.15.3:0/258990083 shutdown_connections 2024-09-21T12:29:44.830 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.827+0000 7f5165953640 1 --2- 172.21.15.3:0/258990083 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f514c07af80 0x7f514c07d440 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:44.830 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.827+0000 7f5165953640 1 --2- 172.21.15.3:0/258990083 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5160107900 0x7f5160074a30 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:44.830 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.827+0000 7f5165953640 1 --2- 172.21.15.3:0/258990083 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5160101900 0x7f51600744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:44.830 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.827+0000 7f5165953640 1 -- 172.21.15.3:0/258990083 >> 172.21.15.3:0/258990083 conn(0x7f51600fd600 msgr2=0x7f51600fef20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:29:44.830 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.828+0000 7f5165953640 1 -- 172.21.15.3:0/258990083 shutdown_connections 2024-09-21T12:29:44.830 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.828+0000 7f5165953640 1 -- 172.21.15.3:0/258990083 wait complete. 2024-09-21T12:29:44.838 INFO:teuthology.orchestra.run.smithi003.stdout:true 2024-09-21T12:29:44.915 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.913+0000 7f4f7086b640 1 -- 172.21.15.3:0/4082208302 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4f6c102ac0 msgr2=0x7f4f6c102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:29:44.915 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.913+0000 7f4f7086b640 1 --2- 172.21.15.3:0/4082208302 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4f6c102ac0 0x7f4f6c102ea0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c009880 tx=0x7f4f5c02a530 comp rx=0 tx=0).stop 2024-09-21T12:29:44.915 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.913+0000 7f4f7086b640 1 -- 172.21.15.3:0/4082208302 shutdown_connections 2024-09-21T12:29:44.915 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.913+0000 7f4f7086b640 1 --2- 172.21.15.3:0/4082208302 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f6c1033e0 0x7f4f6c10b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:44.916 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.913+0000 7f4f7086b640 1 --2- 172.21.15.3:0/4082208302 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4f6c102ac0 0x7f4f6c102ea0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:44.916 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.913+0000 7f4f7086b640 1 -- 172.21.15.3:0/4082208302 >> 172.21.15.3:0/4082208302 conn(0x7f4f6c0fc520 msgr2=0x7f4f6c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:29:44.916 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.913+0000 7f4f7086b640 1 -- 172.21.15.3:0/4082208302 shutdown_connections 2024-09-21T12:29:44.916 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.913+0000 7f4f7086b640 1 -- 172.21.15.3:0/4082208302 wait complete. 2024-09-21T12:29:44.918 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.914+0000 7f4f7086b640 1 Processor -- start 2024-09-21T12:29:44.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.914+0000 7f4f7086b640 1 -- start start 2024-09-21T12:29:44.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.915+0000 7f4f7086b640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4f6c102ac0 0x7f4f6c19d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:29:44.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.915+0000 7f4f7086b640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f6c1033e0 0x7f4f6c19db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:29:44.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.915+0000 7f4f7086b640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f4f6c10edf0 con 0x7f4f6c102ac0 2024-09-21T12:29:44.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.915+0000 7f4f7086b640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f4f6c10ec70 con 0x7f4f6c1033e0 2024-09-21T12:29:44.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.915+0000 7f4f6a59c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4f6c102ac0 0x7f4f6c19d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:29:44.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.915+0000 7f4f6a59c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4f6c102ac0 0x7f4f6c19d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:43844/0 (socket says 172.21.15.3:43844) 2024-09-21T12:29:44.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.915+0000 7f4f63fff640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f6c1033e0 0x7f4f6c19db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:29:44.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.915+0000 7f4f6a59c640 1 -- 172.21.15.3:0/23004382 learned_addr learned my addr 172.21.15.3:0/23004382 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:29:44.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.915+0000 7f4f6a59c640 1 -- 172.21.15.3:0/23004382 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f6c1033e0 msgr2=0x7f4f6c19db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:29:44.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.915+0000 7f4f6a59c640 1 --2- 172.21.15.3:0/23004382 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f6c1033e0 0x7f4f6c19db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:44.920 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.915+0000 7f4f6a59c640 1 -- 172.21.15.3:0/23004382 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f6c1977c0 con 0x7f4f6c102ac0 2024-09-21T12:29:44.920 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.915+0000 7f4f6a59c640 1 --2- 172.21.15.3:0/23004382 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4f6c102ac0 0x7f4f6c19d640 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c031460 tx=0x7f4f5c0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:29:44.920 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.915+0000 7f4f637fe640 1 -- 172.21.15.3:0/23004382 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4f5c03f070 con 0x7f4f6c102ac0 2024-09-21T12:29:44.920 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.916+0000 7f4f7086b640 1 -- 172.21.15.3:0/23004382 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f6c197a50 con 0x7f4f6c102ac0 2024-09-21T12:29:44.920 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.916+0000 7f4f637fe640 1 -- 172.21.15.3:0/23004382 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4f5c0035f0 con 0x7f4f6c102ac0 2024-09-21T12:29:44.920 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.916+0000 7f4f637fe640 1 -- 172.21.15.3:0/23004382 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4f5c035030 con 0x7f4f6c102ac0 2024-09-21T12:29:44.920 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.916+0000 7f4f7086b640 1 -- 172.21.15.3:0/23004382 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f6c197f80 con 0x7f4f6c102ac0 2024-09-21T12:29:44.920 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.917+0000 7f4f7086b640 1 -- 172.21.15.3:0/23004382 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f6c06aa90 con 0x7f4f6c102ac0 2024-09-21T12:29:44.920 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.917+0000 7f4f637fe640 1 -- 172.21.15.3:0/23004382 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f4f5c042070 con 0x7f4f6c102ac0 2024-09-21T12:29:44.921 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.918+0000 7f4f637fe640 1 --2- 172.21.15.3:0/23004382 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f4f5807af30 0x7f4f5807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:29:44.921 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.918+0000 7f4f637fe640 1 -- 172.21.15.3:0/23004382 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6328+0+0 (secure 0 0 0) 0x7f4f5c0bea00 con 0x7f4f6c102ac0 2024-09-21T12:29:44.921 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.918+0000 7f4f63fff640 1 --2- 172.21.15.3:0/23004382 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f4f5807af30 0x7f4f5807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:29:44.921 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.918+0000 7f4f63fff640 1 --2- 172.21.15.3:0/23004382 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f4f5807af30 0x7f4f5807d3f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c108900 tx=0x7f4f5400b2e0 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:29:44.923 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:44.922+0000 7f4f637fe640 1 -- 172.21.15.3:0/23004382 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4f5c089f50 con 0x7f4f6c102ac0 2024-09-21T12:29:45.131 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.130+0000 7f4f7086b640 1 -- 172.21.15.3:0/23004382 --> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f4f6c198230 con 0x7f4f5807af30 2024-09-21T12:29:45.132 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.131+0000 7f4f637fe640 1 -- 172.21.15.3:0/23004382 <== mgr.14756 v2:172.21.15.3:6800/1284098095 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f4f6c198230 con 0x7f4f5807af30 2024-09-21T12:29:45.135 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.133+0000 7f4f7086b640 1 -- 172.21.15.3:0/23004382 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f4f5807af30 msgr2=0x7f4f5807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:29:45.135 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.133+0000 7f4f7086b640 1 --2- 172.21.15.3:0/23004382 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f4f5807af30 0x7f4f5807d3f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c108900 tx=0x7f4f5400b2e0 comp rx=0 tx=0).stop 2024-09-21T12:29:45.135 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.133+0000 7f4f7086b640 1 -- 172.21.15.3:0/23004382 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4f6c102ac0 msgr2=0x7f4f6c19d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:29:45.135 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.133+0000 7f4f7086b640 1 --2- 172.21.15.3:0/23004382 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4f6c102ac0 0x7f4f6c19d640 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c031460 tx=0x7f4f5c0045e0 comp rx=0 tx=0).stop 2024-09-21T12:29:45.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.133+0000 7f4f7086b640 1 -- 172.21.15.3:0/23004382 shutdown_connections 2024-09-21T12:29:45.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.133+0000 7f4f7086b640 1 --2- 172.21.15.3:0/23004382 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f4f5807af30 0x7f4f5807d3f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:45.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.133+0000 7f4f7086b640 1 --2- 172.21.15.3:0/23004382 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4f6c1033e0 0x7f4f6c19db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:45.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.133+0000 7f4f7086b640 1 --2- 172.21.15.3:0/23004382 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4f6c102ac0 0x7f4f6c19d640 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:45.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.133+0000 7f4f7086b640 1 -- 172.21.15.3:0/23004382 >> 172.21.15.3:0/23004382 conn(0x7f4f6c0fc520 msgr2=0x7f4f6c10af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:29:45.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.134+0000 7f4f7086b640 1 -- 172.21.15.3:0/23004382 shutdown_connections 2024-09-21T12:29:45.136 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.134+0000 7f4f7086b640 1 -- 172.21.15.3:0/23004382 wait complete. 2024-09-21T12:29:45.220 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.218+0000 7f39ce396640 1 -- 172.21.15.3:0/1335681055 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f39c81033e0 msgr2=0x7f39c810b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:29:45.220 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.218+0000 7f39ce396640 1 --2- 172.21.15.3:0/1335681055 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f39c81033e0 0x7f39c810b8d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f39bc009880 tx=0x7f39bc02a530 comp rx=0 tx=0).stop 2024-09-21T12:29:45.221 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.218+0000 7f39ce396640 1 -- 172.21.15.3:0/1335681055 shutdown_connections 2024-09-21T12:29:45.221 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.218+0000 7f39ce396640 1 --2- 172.21.15.3:0/1335681055 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f39c81033e0 0x7f39c810b8d0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:45.221 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.218+0000 7f39ce396640 1 --2- 172.21.15.3:0/1335681055 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39c8102ac0 0x7f39c8102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:45.221 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.218+0000 7f39ce396640 1 -- 172.21.15.3:0/1335681055 >> 172.21.15.3:0/1335681055 conn(0x7f39c80fc520 msgr2=0x7f39c80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:29:45.221 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.218+0000 7f39ce396640 1 -- 172.21.15.3:0/1335681055 shutdown_connections 2024-09-21T12:29:45.221 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.218+0000 7f39ce396640 1 -- 172.21.15.3:0/1335681055 wait complete. 2024-09-21T12:29:45.221 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.219+0000 7f39ce396640 1 Processor -- start 2024-09-21T12:29:45.221 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.219+0000 7f39ce396640 1 -- start start 2024-09-21T12:29:45.222 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.219+0000 7f39ce396640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f39c8102ac0 0x7f39c819d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:29:45.222 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.219+0000 7f39ce396640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39c81033e0 0x7f39c819dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:29:45.222 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.219+0000 7f39ce396640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f39c810edd0 con 0x7f39c8102ac0 2024-09-21T12:29:45.223 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.219+0000 7f39ce396640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f39c810ec50 con 0x7f39c81033e0 2024-09-21T12:29:45.223 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.220+0000 7f39c7fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f39c8102ac0 0x7f39c819d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:29:45.223 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.220+0000 7f39c7fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f39c8102ac0 0x7f39c819d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:43854/0 (socket says 172.21.15.3:43854) 2024-09-21T12:29:45.223 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.220+0000 7f39c7fff640 1 -- 172.21.15.3:0/338167641 learned_addr learned my addr 172.21.15.3:0/338167641 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:29:45.223 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.220+0000 7f39c77fe640 1 --2- 172.21.15.3:0/338167641 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39c81033e0 0x7f39c819dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:29:45.223 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.220+0000 7f39c7fff640 1 -- 172.21.15.3:0/338167641 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39c81033e0 msgr2=0x7f39c819dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:29:45.223 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.220+0000 7f39c7fff640 1 --2- 172.21.15.3:0/338167641 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39c81033e0 0x7f39c819dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:45.223 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.220+0000 7f39c7fff640 1 -- 172.21.15.3:0/338167641 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39c81977e0 con 0x7f39c8102ac0 2024-09-21T12:29:45.223 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.220+0000 7f39c7fff640 1 --2- 172.21.15.3:0/338167641 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f39c8102ac0 0x7f39c819d660 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f39b800d8d0 tx=0x7f39b800dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:29:45.223 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.220+0000 7f39c57fa640 1 -- 172.21.15.3:0/338167641 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f39b8017030 con 0x7f39c8102ac0 2024-09-21T12:29:45.223 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.220+0000 7f39ce396640 1 -- 172.21.15.3:0/338167641 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39c8197ad0 con 0x7f39c8102ac0 2024-09-21T12:29:45.223 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.220+0000 7f39c57fa640 1 -- 172.21.15.3:0/338167641 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f39b8004020 con 0x7f39c8102ac0 2024-09-21T12:29:45.223 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.220+0000 7f39c57fa640 1 -- 172.21.15.3:0/338167641 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f39b80047a0 con 0x7f39c8102ac0 2024-09-21T12:29:45.224 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.220+0000 7f39ce396640 1 -- 172.21.15.3:0/338167641 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39c8198030 con 0x7f39c8102ac0 2024-09-21T12:29:45.224 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.221+0000 7f39ce396640 1 -- 172.21.15.3:0/338167641 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39c806aa90 con 0x7f39c8102ac0 2024-09-21T12:29:45.225 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.222+0000 7f39c57fa640 1 -- 172.21.15.3:0/338167641 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f39b80041d0 con 0x7f39c8102ac0 2024-09-21T12:29:45.225 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.223+0000 7f39c57fa640 1 --2- 172.21.15.3:0/338167641 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f39b007af30 0x7f39b007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:29:45.225 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.223+0000 7f39c57fa640 1 -- 172.21.15.3:0/338167641 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6328+0+0 (secure 0 0 0) 0x7f39b8018070 con 0x7f39c8102ac0 2024-09-21T12:29:45.225 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.223+0000 7f39c77fe640 1 --2- 172.21.15.3:0/338167641 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f39b007af30 0x7f39b007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:29:45.225 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.223+0000 7f39c77fe640 1 --2- 172.21.15.3:0/338167641 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f39b007af30 0x7f39b007d3f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f39c8198b30 tx=0x7f39bc031400 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:29:45.228 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.227+0000 7f39c57fa640 1 -- 172.21.15.3:0/338167641 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f39b80a3020 con 0x7f39c8102ac0 2024-09-21T12:29:45.425 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.423+0000 7f39ce396640 1 -- 172.21.15.3:0/338167641 --> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f39c8198340 con 0x7f39b007af30 2024-09-21T12:29:45.434 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.433+0000 7f39c57fa640 1 -- 172.21.15.3:0/338167641 <== mgr.14756 v2:172.21.15.3:6800/1284098095 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f39c8198340 con 0x7f39b007af30 2024-09-21T12:29:45.435 INFO:teuthology.orchestra.run.smithi003.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:29:45.435 INFO:teuthology.orchestra.run.smithi003.stdout:alertmanager.smithi003 smithi003 *:9093,9094 running (6m) 8s ago 17m 19.0M - 0.27.0 11f11916f8cd 14880018dfd3 2024-09-21T12:29:45.435 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-exporter.smithi003 smithi003 running (8m) 8s ago 17m 9101k - 19.1.1-373-g4e45e6b4 164465d2334a 0c9ad60a4f5a 2024-09-21T12:29:45.435 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-exporter.smithi192 smithi192 running (8m) 46s ago 16m 8627k - 19.1.1-373-g4e45e6b4 164465d2334a d5be8a6e120f 2024-09-21T12:29:45.435 INFO:teuthology.orchestra.run.smithi003.stdout:crash.smithi003 smithi003 running (4m) 8s ago 17m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 0ada67250dba 2024-09-21T12:29:45.435 INFO:teuthology.orchestra.run.smithi003.stdout:crash.smithi192 smithi192 running (4m) 46s ago 16m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 52e279085b2e 2024-09-21T12:29:45.435 INFO:teuthology.orchestra.run.smithi003.stdout:grafana.smithi003 smithi003 *:3000 running (5m) 8s ago 17m 80.4M - 10.4.8 5aad1d7cf004 19e26b3cb585 2024-09-21T12:29:45.435 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi003.ebjgyl smithi003 running (35s) 8s ago 12m 13.1M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 8579e4fc4f05 2024-09-21T12:29:45.435 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi003.gfkngj smithi003 running (13s) 8s ago 11m 13.3M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 7b3dec4f76e2 2024-09-21T12:29:45.435 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi192.ktdqns smithi192 running (11m) 46s ago 11m 19.6M - 19.1.1-373-g4e45e6b4 164465d2334a 495c73fb3bb0 2024-09-21T12:29:45.435 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi192.ywqqxe smithi192 running (12m) 46s ago 12m 19.6M - 19.1.1-373-g4e45e6b4 164465d2334a 270a01030cbe 2024-09-21T12:29:45.435 INFO:teuthology.orchestra.run.smithi003.stdout:mgr.smithi003.wztftl smithi003 *:8443,9283,8765 running (8m) 8s ago 18m 529M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 8ce0e66fd369 2024-09-21T12:29:45.435 INFO:teuthology.orchestra.run.smithi003.stdout:mgr.smithi192.qsaprd smithi192 *:8443,9283,8765 running (7m) 46s ago 16m 458M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 002a6171dd47 2024-09-21T12:29:45.436 INFO:teuthology.orchestra.run.smithi003.stdout:mon.smithi003 smithi003 running (4m) 8s ago 18m 49.0M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 4f2b2b2daf19 2024-09-21T12:29:45.436 INFO:teuthology.orchestra.run.smithi003.stdout:mon.smithi192 smithi192 running (4m) 46s ago 16m 38.9M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 11edc5c1baba 2024-09-21T12:29:45.436 INFO:teuthology.orchestra.run.smithi003.stdout:node-exporter.smithi003 smithi003 *:9100 running (7m) 8s ago 17m 9.78M - 1.7.0 72c9c2088986 d9cb7ede9060 2024-09-21T12:29:45.436 INFO:teuthology.orchestra.run.smithi003.stdout:node-exporter.smithi192 smithi192 *:9100 running (6m) 46s ago 16m 11.0M - 1.7.0 72c9c2088986 d8ec0acfce7e 2024-09-21T12:29:45.436 INFO:teuthology.orchestra.run.smithi003.stdout:osd.0 smithi003 running (3m) 8s ago 15m 91.2M 1217M 19.3.0-5103-g5c1cdc3c 8f4d013db793 0f2234f333ec 2024-09-21T12:29:45.436 INFO:teuthology.orchestra.run.smithi003.stdout:osd.1 smithi003 running (3m) 8s ago 14m 96.1M 1217M 19.3.0-5103-g5c1cdc3c 8f4d013db793 198ba21d0518 2024-09-21T12:29:45.436 INFO:teuthology.orchestra.run.smithi003.stdout:osd.2 smithi003 running (2m) 8s ago 14m 83.6M 1217M 19.3.0-5103-g5c1cdc3c 8f4d013db793 e630341e13d4 2024-09-21T12:29:45.436 INFO:teuthology.orchestra.run.smithi003.stdout:osd.3 smithi192 running (118s) 46s ago 14m 101M 2240M 19.3.0-5103-g5c1cdc3c 8f4d013db793 1b5fae2f2dd9 2024-09-21T12:29:45.436 INFO:teuthology.orchestra.run.smithi003.stdout:osd.4 smithi192 running (83s) 46s ago 13m 92.0M 2240M 19.3.0-5103-g5c1cdc3c 8f4d013db793 5b1bd4bec479 2024-09-21T12:29:45.436 INFO:teuthology.orchestra.run.smithi003.stdout:osd.5 smithi192 running (49s) 46s ago 13m 12.2M 2240M 19.3.0-5103-g5c1cdc3c 8f4d013db793 584f3f612483 2024-09-21T12:29:45.436 INFO:teuthology.orchestra.run.smithi003.stdout:prometheus.smithi003 smithi003 *:9095 running (6m) 8s ago 17m 56.7M - 2.51.0 1d3b7f56885b 64997a33fbbb 2024-09-21T12:29:45.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.435+0000 7f39ce396640 1 -- 172.21.15.3:0/338167641 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f39b007af30 msgr2=0x7f39b007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:29:45.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.435+0000 7f39ce396640 1 --2- 172.21.15.3:0/338167641 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f39b007af30 0x7f39b007d3f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f39c8198b30 tx=0x7f39bc031400 comp rx=0 tx=0).stop 2024-09-21T12:29:45.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.435+0000 7f39ce396640 1 -- 172.21.15.3:0/338167641 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f39c8102ac0 msgr2=0x7f39c819d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:29:45.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.435+0000 7f39ce396640 1 --2- 172.21.15.3:0/338167641 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f39c8102ac0 0x7f39c819d660 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f39b800d8d0 tx=0x7f39b800dd90 comp rx=0 tx=0).stop 2024-09-21T12:29:45.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.435+0000 7f39ce396640 1 -- 172.21.15.3:0/338167641 shutdown_connections 2024-09-21T12:29:45.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.435+0000 7f39ce396640 1 --2- 172.21.15.3:0/338167641 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f39b007af30 0x7f39b007d3f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:45.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.435+0000 7f39ce396640 1 --2- 172.21.15.3:0/338167641 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f39c81033e0 0x7f39c819dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:45.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.435+0000 7f39ce396640 1 --2- 172.21.15.3:0/338167641 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f39c8102ac0 0x7f39c819d660 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:45.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.435+0000 7f39ce396640 1 -- 172.21.15.3:0/338167641 >> 172.21.15.3:0/338167641 conn(0x7f39c80fc520 msgr2=0x7f39c8108f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:29:45.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.435+0000 7f39ce396640 1 -- 172.21.15.3:0/338167641 shutdown_connections 2024-09-21T12:29:45.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.435+0000 7f39ce396640 1 -- 172.21.15.3:0/338167641 wait complete. 2024-09-21T12:29:45.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.518+0000 7f4d7dc13640 1 -- 172.21.15.3:0/23976110 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4d78102ac0 msgr2=0x7f4d78102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:29:45.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.518+0000 7f4d7dc13640 1 --2- 172.21.15.3:0/23976110 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4d78102ac0 0x7f4d78102ea0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4d68009880 tx=0x7f4d6802a530 comp rx=0 tx=0).stop 2024-09-21T12:29:45.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.518+0000 7f4d7dc13640 1 -- 172.21.15.3:0/23976110 shutdown_connections 2024-09-21T12:29:45.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.518+0000 7f4d7dc13640 1 --2- 172.21.15.3:0/23976110 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4d781033e0 0x7f4d7810b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:45.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.518+0000 7f4d7dc13640 1 --2- 172.21.15.3:0/23976110 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4d78102ac0 0x7f4d78102ea0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:45.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.518+0000 7f4d7dc13640 1 -- 172.21.15.3:0/23976110 >> 172.21.15.3:0/23976110 conn(0x7f4d780fc520 msgr2=0x7f4d780fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:29:45.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.518+0000 7f4d7dc13640 1 -- 172.21.15.3:0/23976110 shutdown_connections 2024-09-21T12:29:45.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.518+0000 7f4d7dc13640 1 -- 172.21.15.3:0/23976110 wait complete. 2024-09-21T12:29:45.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.519+0000 7f4d7dc13640 1 Processor -- start 2024-09-21T12:29:45.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.519+0000 7f4d7dc13640 1 -- start start 2024-09-21T12:29:45.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.519+0000 7f4d7dc13640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4d78102ac0 0x7f4d7819d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:29:45.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.519+0000 7f4d7dc13640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4d781033e0 0x7f4d7819dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:29:45.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.519+0000 7f4d7dc13640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f4d7810edf0 con 0x7f4d78102ac0 2024-09-21T12:29:45.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.519+0000 7f4d7dc13640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f4d7810ec70 con 0x7f4d781033e0 2024-09-21T12:29:45.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.519+0000 7f4d777fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4d78102ac0 0x7f4d7819d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:29:45.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.519+0000 7f4d777fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4d78102ac0 0x7f4d7819d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:43864/0 (socket says 172.21.15.3:43864) 2024-09-21T12:29:45.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.519+0000 7f4d777fe640 1 -- 172.21.15.3:0/1643856511 learned_addr learned my addr 172.21.15.3:0/1643856511 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:29:45.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.519+0000 7f4d76ffd640 1 --2- 172.21.15.3:0/1643856511 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4d781033e0 0x7f4d7819dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:29:45.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.520+0000 7f4d777fe640 1 -- 172.21.15.3:0/1643856511 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4d781033e0 msgr2=0x7f4d7819dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:29:45.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.520+0000 7f4d777fe640 1 --2- 172.21.15.3:0/1643856511 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4d781033e0 0x7f4d7819dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:45.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.520+0000 7f4d777fe640 1 -- 172.21.15.3:0/1643856511 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d781977e0 con 0x7f4d78102ac0 2024-09-21T12:29:45.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.520+0000 7f4d76ffd640 1 --2- 172.21.15.3:0/1643856511 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4d781033e0 0x7f4d7819dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:29:45.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.520+0000 7f4d777fe640 1 --2- 172.21.15.3:0/1643856511 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4d78102ac0 0x7f4d7819d660 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4d68031460 tx=0x7f4d680045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:29:45.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.520+0000 7f4d74ff9640 1 -- 172.21.15.3:0/1643856511 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4d6803f070 con 0x7f4d78102ac0 2024-09-21T12:29:45.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.520+0000 7f4d7dc13640 1 -- 172.21.15.3:0/1643856511 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d78197a70 con 0x7f4d78102ac0 2024-09-21T12:29:45.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.520+0000 7f4d74ff9640 1 -- 172.21.15.3:0/1643856511 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f4d680035f0 con 0x7f4d78102ac0 2024-09-21T12:29:45.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.520+0000 7f4d74ff9640 1 -- 172.21.15.3:0/1643856511 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f4d68035030 con 0x7f4d78102ac0 2024-09-21T12:29:45.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.520+0000 7f4d7dc13640 1 -- 172.21.15.3:0/1643856511 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d78197fa0 con 0x7f4d78102ac0 2024-09-21T12:29:45.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.521+0000 7f4d7dc13640 1 -- 172.21.15.3:0/1643856511 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d7806aa90 con 0x7f4d78102ac0 2024-09-21T12:29:45.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.522+0000 7f4d74ff9640 1 -- 172.21.15.3:0/1643856511 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f4d68042070 con 0x7f4d78102ac0 2024-09-21T12:29:45.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.522+0000 7f4d74ff9640 1 --2- 172.21.15.3:0/1643856511 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f4d6007af30 0x7f4d6007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:29:45.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.522+0000 7f4d74ff9640 1 -- 172.21.15.3:0/1643856511 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6328+0+0 (secure 0 0 0) 0x7f4d680bead0 con 0x7f4d78102ac0 2024-09-21T12:29:45.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.522+0000 7f4d76ffd640 1 --2- 172.21.15.3:0/1643856511 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f4d6007af30 0x7f4d6007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:29:45.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.523+0000 7f4d76ffd640 1 --2- 172.21.15.3:0/1643856511 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f4d6007af30 0x7f4d6007d3f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c005fd0 tx=0x7f4d6c005850 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:29:45.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.527+0000 7f4d74ff9640 1 -- 172.21.15.3:0/1643856511 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f4d6808a020 con 0x7f4d78102ac0 2024-09-21T12:29:45.791 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.789+0000 7f4d7dc13640 1 -- 172.21.15.3:0/1643856511 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f4d78105f90 con 0x7f4d78102ac0 2024-09-21T12:29:45.791 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:45 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:29:45.791 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:45 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "mds metadata", "who": "cephfs.smithi192.ywqqxe"} : dispatch 2024-09-21T12:29:45.792 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:45 smithi003 ceph-mon[108723]: from='client.34350 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:29:45.792 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:45 smithi003 ceph-mon[108723]: pgmap v268: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 3.9 KiB/s rd, 5.1 KiB/s wr, 6 op/s 2024-09-21T12:29:45.792 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.790+0000 7f4d74ff9640 1 -- 172.21.15.3:0/1643856511 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+835 (secure 0 0 0) 0x7f4d6808c070 con 0x7f4d78102ac0 2024-09-21T12:29:45.792 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-21T12:29:45.792 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": { 2024-09-21T12:29:45.792 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:29:45.792 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:29:45.792 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": { 2024-09-21T12:29:45.792 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:29:45.793 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:29:45.793 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": { 2024-09-21T12:29:45.793 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 6 2024-09-21T12:29:45.793 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:29:45.793 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": { 2024-09-21T12:29:45.793 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T12:29:45.793 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:29:45.793 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:29:45.793 INFO:teuthology.orchestra.run.smithi003.stdout: "overall": { 2024-09-21T12:29:45.793 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.1.1-373-g4e45e6b4 (4e45e6b490e6cbe082cdf155fea780438ec53fc7) squid (stable)": 1, 2024-09-21T12:29:45.793 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 12 2024-09-21T12:29:45.793 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-21T12:29:45.793 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-21T12:29:45.794 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.792+0000 7f4d7dc13640 1 -- 172.21.15.3:0/1643856511 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f4d6007af30 msgr2=0x7f4d6007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:29:45.794 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.792+0000 7f4d7dc13640 1 --2- 172.21.15.3:0/1643856511 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f4d6007af30 0x7f4d6007d3f0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4d6c005fd0 tx=0x7f4d6c005850 comp rx=0 tx=0).stop 2024-09-21T12:29:45.794 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.792+0000 7f4d7dc13640 1 -- 172.21.15.3:0/1643856511 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4d78102ac0 msgr2=0x7f4d7819d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:29:45.794 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.792+0000 7f4d7dc13640 1 --2- 172.21.15.3:0/1643856511 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4d78102ac0 0x7f4d7819d660 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f4d68031460 tx=0x7f4d680045e0 comp rx=0 tx=0).stop 2024-09-21T12:29:45.794 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.792+0000 7f4d7dc13640 1 -- 172.21.15.3:0/1643856511 shutdown_connections 2024-09-21T12:29:45.794 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.792+0000 7f4d7dc13640 1 --2- 172.21.15.3:0/1643856511 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f4d6007af30 0x7f4d6007d3f0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:45.795 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.792+0000 7f4d7dc13640 1 --2- 172.21.15.3:0/1643856511 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f4d781033e0 0x7f4d7819dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:45.795 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.792+0000 7f4d7dc13640 1 --2- 172.21.15.3:0/1643856511 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f4d78102ac0 0x7f4d7819d660 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:45.795 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.792+0000 7f4d7dc13640 1 -- 172.21.15.3:0/1643856511 >> 172.21.15.3:0/1643856511 conn(0x7f4d780fc520 msgr2=0x7f4d78108ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:29:45.795 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.792+0000 7f4d7dc13640 1 -- 172.21.15.3:0/1643856511 shutdown_connections 2024-09-21T12:29:45.795 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.793+0000 7f4d7dc13640 1 -- 172.21.15.3:0/1643856511 wait complete. 2024-09-21T12:29:45.879 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.877+0000 7fce2d29a640 1 -- 172.21.15.3:0/1301454831 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fce28100250 msgr2=0x7fce28100630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:29:45.879 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.877+0000 7fce2d29a640 1 --2- 172.21.15.3:0/1301454831 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fce28100250 0x7fce28100630 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fce1800a990 tx=0x7fce1802b7d0 comp rx=0 tx=0).stop 2024-09-21T12:29:45.879 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.877+0000 7fce2d29a640 1 -- 172.21.15.3:0/1301454831 shutdown_connections 2024-09-21T12:29:45.879 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.877+0000 7fce2d29a640 1 --2- 172.21.15.3:0/1301454831 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce28100c00 0x7fce28104c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:45.879 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.877+0000 7fce2d29a640 1 --2- 172.21.15.3:0/1301454831 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fce28100250 0x7fce28100630 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:45.879 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.877+0000 7fce2d29a640 1 -- 172.21.15.3:0/1301454831 >> 172.21.15.3:0/1301454831 conn(0x7fce280fbc90 msgr2=0x7fce280fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:29:45.879 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.877+0000 7fce2d29a640 1 -- 172.21.15.3:0/1301454831 shutdown_connections 2024-09-21T12:29:45.879 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.877+0000 7fce2d29a640 1 -- 172.21.15.3:0/1301454831 wait complete. 2024-09-21T12:29:45.881 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.878+0000 7fce2d29a640 1 Processor -- start 2024-09-21T12:29:45.881 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.878+0000 7fce2d29a640 1 -- start start 2024-09-21T12:29:45.881 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.878+0000 7fce2d29a640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fce28100250 0x7fce28101cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:29:45.881 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.878+0000 7fce2d29a640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce28100c00 0x7fce28102230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:29:45.881 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.878+0000 7fce2d29a640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fce2810cbd0 con 0x7fce28100250 2024-09-21T12:29:45.881 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.878+0000 7fce2d29a640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fce2810ca50 con 0x7fce28100c00 2024-09-21T12:29:45.881 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.878+0000 7fce26ffd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fce28100250 0x7fce28101cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:29:45.881 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.878+0000 7fce26ffd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fce28100250 0x7fce28101cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:43888/0 (socket says 172.21.15.3:43888) 2024-09-21T12:29:45.881 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.878+0000 7fce26ffd640 1 -- 172.21.15.3:0/2838034956 learned_addr learned my addr 172.21.15.3:0/2838034956 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:29:45.881 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.878+0000 7fce1ffff640 1 --2- 172.21.15.3:0/2838034956 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce28100c00 0x7fce28102230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:29:45.882 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.879+0000 7fce26ffd640 1 -- 172.21.15.3:0/2838034956 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce28100c00 msgr2=0x7fce28102230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:29:45.882 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.879+0000 7fce26ffd640 1 --2- 172.21.15.3:0/2838034956 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce28100c00 0x7fce28102230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:45.882 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.879+0000 7fce26ffd640 1 -- 172.21.15.3:0/2838034956 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce28102770 con 0x7fce28100250 2024-09-21T12:29:45.882 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.879+0000 7fce26ffd640 1 --2- 172.21.15.3:0/2838034956 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fce28100250 0x7fce28101cf0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fce18006010 tx=0x7fce18004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:29:45.882 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.879+0000 7fce24ff9640 1 -- 172.21.15.3:0/2838034956 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fce18008e90 con 0x7fce28100250 2024-09-21T12:29:45.882 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.879+0000 7fce2d29a640 1 -- 172.21.15.3:0/2838034956 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce28102a00 con 0x7fce28100250 2024-09-21T12:29:45.882 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.879+0000 7fce24ff9640 1 -- 172.21.15.3:0/2838034956 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fce18045070 con 0x7fce28100250 2024-09-21T12:29:45.882 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.879+0000 7fce24ff9640 1 -- 172.21.15.3:0/2838034956 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fce180035f0 con 0x7fce28100250 2024-09-21T12:29:45.882 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.879+0000 7fce2d29a640 1 -- 172.21.15.3:0/2838034956 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce281a3dd0 con 0x7fce28100250 2024-09-21T12:29:45.883 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.880+0000 7fce2d29a640 1 -- 172.21.15.3:0/2838034956 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce28101730 con 0x7fce28100250 2024-09-21T12:29:45.883 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.881+0000 7fce24ff9640 1 -- 172.21.15.3:0/2838034956 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7fce18032070 con 0x7fce28100250 2024-09-21T12:29:45.883 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.882+0000 7fce24ff9640 1 --2- 172.21.15.3:0/2838034956 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fce1407af30 0x7fce1407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:29:45.883 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.882+0000 7fce24ff9640 1 -- 172.21.15.3:0/2838034956 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6328+0+0 (secure 0 0 0) 0x7fce18008030 con 0x7fce28100250 2024-09-21T12:29:45.884 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.882+0000 7fce1ffff640 1 --2- 172.21.15.3:0/2838034956 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fce1407af30 0x7fce1407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:29:45.884 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.882+0000 7fce1ffff640 1 --2- 172.21.15.3:0/2838034956 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fce1407af30 0x7fce1407d3f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fce28103780 tx=0x7fce1000b390 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:29:45.890 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:45.888+0000 7fce24ff9640 1 -- 172.21.15.3:0/2838034956 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fce1808a4b0 con 0x7fce28100250 2024-09-21T12:29:46.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:45 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:29:46.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:45 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "mds metadata", "who": "cephfs.smithi192.ywqqxe"} : dispatch 2024-09-21T12:29:46.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:45 smithi192 ceph-mon[80326]: from='client.34350 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:29:46.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:45 smithi192 ceph-mon[80326]: pgmap v268: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 3.9 KiB/s rd, 5.1 KiB/s wr, 6 op/s 2024-09-21T12:29:46.121 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.120+0000 7fce2d29a640 1 -- 172.21.15.3:0/2838034956 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fce2802d7c0 con 0x7fce28100250 2024-09-21T12:29:46.122 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.120+0000 7fce24ff9640 1 -- 172.21.15.3:0/2838034956 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 23 v23) ==== 76+0+1826 (secure 0 0 0) 0x7fce1808f360 con 0x7fce28100250 2024-09-21T12:29:46.122 INFO:teuthology.orchestra.run.smithi003.stdout:e23 2024-09-21T12:29:46.122 INFO:teuthology.orchestra.run.smithi003.stdout:btime 2024-09-21T12:29:44:458172+0000 2024-09-21T12:29:46.122 INFO:teuthology.orchestra.run.smithi003.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T12:29:46.122 INFO:teuthology.orchestra.run.smithi003.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:29:46.122 INFO:teuthology.orchestra.run.smithi003.stdout:legacy client fscid: 1 2024-09-21T12:29:46.122 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:29:46.122 INFO:teuthology.orchestra.run.smithi003.stdout:Filesystem 'cephfs' (1) 2024-09-21T12:29:46.122 INFO:teuthology.orchestra.run.smithi003.stdout:fs_name cephfs 2024-09-21T12:29:46.122 INFO:teuthology.orchestra.run.smithi003.stdout:epoch 23 2024-09-21T12:29:46.123 INFO:teuthology.orchestra.run.smithi003.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T12:29:46.123 INFO:teuthology.orchestra.run.smithi003.stdout:created 2024-09-21T12:17:38.260099+0000 2024-09-21T12:29:46.123 INFO:teuthology.orchestra.run.smithi003.stdout:modified 2024-09-21T12:29:44.458157+0000 2024-09-21T12:29:46.123 INFO:teuthology.orchestra.run.smithi003.stdout:tableserver 0 2024-09-21T12:29:46.123 INFO:teuthology.orchestra.run.smithi003.stdout:root 0 2024-09-21T12:29:46.123 INFO:teuthology.orchestra.run.smithi003.stdout:session_timeout 60 2024-09-21T12:29:46.123 INFO:teuthology.orchestra.run.smithi003.stdout:session_autoclose 300 2024-09-21T12:29:46.123 INFO:teuthology.orchestra.run.smithi003.stdout:max_file_size 1099511627776 2024-09-21T12:29:46.123 INFO:teuthology.orchestra.run.smithi003.stdout:max_xattr_size 65536 2024-09-21T12:29:46.123 INFO:teuthology.orchestra.run.smithi003.stdout:required_client_features {} 2024-09-21T12:29:46.123 INFO:teuthology.orchestra.run.smithi003.stdout:last_failure 0 2024-09-21T12:29:46.123 INFO:teuthology.orchestra.run.smithi003.stdout:last_failure_osd_epoch 80 2024-09-21T12:29:46.123 INFO:teuthology.orchestra.run.smithi003.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:29:46.124 INFO:teuthology.orchestra.run.smithi003.stdout:max_mds 1 2024-09-21T12:29:46.124 INFO:teuthology.orchestra.run.smithi003.stdout:in 0 2024-09-21T12:29:46.124 INFO:teuthology.orchestra.run.smithi003.stdout:up {0=24337} 2024-09-21T12:29:46.124 INFO:teuthology.orchestra.run.smithi003.stdout:failed 2024-09-21T12:29:46.124 INFO:teuthology.orchestra.run.smithi003.stdout:damaged 2024-09-21T12:29:46.124 INFO:teuthology.orchestra.run.smithi003.stdout:stopped 2024-09-21T12:29:46.124 INFO:teuthology.orchestra.run.smithi003.stdout:data_pools [3] 2024-09-21T12:29:46.124 INFO:teuthology.orchestra.run.smithi003.stdout:metadata_pool 2 2024-09-21T12:29:46.124 INFO:teuthology.orchestra.run.smithi003.stdout:inline_data enabled 2024-09-21T12:29:46.124 INFO:teuthology.orchestra.run.smithi003.stdout:balancer 2024-09-21T12:29:46.124 INFO:teuthology.orchestra.run.smithi003.stdout:bal_rank_mask -1 2024-09-21T12:29:46.125 INFO:teuthology.orchestra.run.smithi003.stdout:standby_count_wanted 1 2024-09-21T12:29:46.125 INFO:teuthology.orchestra.run.smithi003.stdout:qdb_cluster leader: 0 members: 2024-09-21T12:29:46.125 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.cephfs.smithi192.ktdqns{0:24337} state up:replay seq 2 join_fscid=1 addr [v2:172.21.15.192:6826/318800854,v1:172.21.15.192:6827/318800854] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:29:46.125 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:29:46.125 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:29:46.125 INFO:teuthology.orchestra.run.smithi003.stdout:Standby daemons: 2024-09-21T12:29:46.125 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:29:46.125 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.cephfs.smithi003.ebjgyl{-1:34314} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.3:6826/1616995236,v1:172.21.15.3:6827/1616995236] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:29:46.125 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.cephfs.smithi003.gfkngj{-1:34346} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.3:6828/1282732153,v1:172.21.15.3:6829/1282732153] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:29:46.126 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 23 2024-09-21T12:29:46.126 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.122+0000 7fce2d29a640 1 -- 172.21.15.3:0/2838034956 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fce1407af30 msgr2=0x7fce1407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:29:46.126 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.122+0000 7fce2d29a640 1 --2- 172.21.15.3:0/2838034956 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fce1407af30 0x7fce1407d3f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fce28103780 tx=0x7fce1000b390 comp rx=0 tx=0).stop 2024-09-21T12:29:46.126 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.122+0000 7fce2d29a640 1 -- 172.21.15.3:0/2838034956 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fce28100250 msgr2=0x7fce28101cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:29:46.126 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.122+0000 7fce2d29a640 1 --2- 172.21.15.3:0/2838034956 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fce28100250 0x7fce28101cf0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fce18006010 tx=0x7fce18004270 comp rx=0 tx=0).stop 2024-09-21T12:29:46.126 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.122+0000 7fce2d29a640 1 -- 172.21.15.3:0/2838034956 shutdown_connections 2024-09-21T12:29:46.126 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.122+0000 7fce2d29a640 1 --2- 172.21.15.3:0/2838034956 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fce1407af30 0x7fce1407d3f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:46.126 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.122+0000 7fce2d29a640 1 --2- 172.21.15.3:0/2838034956 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fce28100c00 0x7fce28102230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:46.126 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.122+0000 7fce2d29a640 1 --2- 172.21.15.3:0/2838034956 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fce28100250 0x7fce28101cf0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:46.127 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.122+0000 7fce2d29a640 1 -- 172.21.15.3:0/2838034956 >> 172.21.15.3:0/2838034956 conn(0x7fce280fbc90 msgr2=0x7fce280fd620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:29:46.127 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.123+0000 7fce2d29a640 1 -- 172.21.15.3:0/2838034956 shutdown_connections 2024-09-21T12:29:46.127 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.123+0000 7fce2d29a640 1 -- 172.21.15.3:0/2838034956 wait complete. 2024-09-21T12:29:46.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.209+0000 7f8cab243640 1 -- 172.21.15.3:0/2464105898 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8ca4107900 msgr2=0x7f8ca4107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:29:46.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.209+0000 7f8cab243640 1 --2- 172.21.15.3:0/2464105898 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8ca4107900 0x7f8ca4107ce0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c009880 tx=0x7f8c8c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:29:46.211 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.209+0000 7f8cab243640 1 -- 172.21.15.3:0/2464105898 shutdown_connections 2024-09-21T12:29:46.212 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.209+0000 7f8cab243640 1 --2- 172.21.15.3:0/2464105898 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ca4101900 0x7f8ca4101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:46.212 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.209+0000 7f8cab243640 1 --2- 172.21.15.3:0/2464105898 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8ca4107900 0x7f8ca4107ce0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:46.212 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.209+0000 7f8cab243640 1 -- 172.21.15.3:0/2464105898 >> 172.21.15.3:0/2464105898 conn(0x7f8ca40fd600 msgr2=0x7f8ca40ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:29:46.212 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.209+0000 7f8cab243640 1 -- 172.21.15.3:0/2464105898 shutdown_connections 2024-09-21T12:29:46.212 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.209+0000 7f8cab243640 1 -- 172.21.15.3:0/2464105898 wait complete. 2024-09-21T12:29:46.212 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.210+0000 7f8cab243640 1 Processor -- start 2024-09-21T12:29:46.212 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.210+0000 7f8cab243640 1 -- start start 2024-09-21T12:29:46.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.210+0000 7f8cab243640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ca4101900 0x7f8ca40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:29:46.213 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.210+0000 7f8cab243640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8ca4107900 0x7f8ca4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:29:46.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.210+0000 7f8cab243640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca410edd0 con 0x7f8ca4107900 2024-09-21T12:29:46.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.210+0000 7f8cab243640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f8ca410ec50 con 0x7f8ca4101900 2024-09-21T12:29:46.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.210+0000 7f8ca3fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8ca4107900 0x7f8ca4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:29:46.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.210+0000 7f8ca3fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8ca4107900 0x7f8ca4074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:43908/0 (socket says 172.21.15.3:43908) 2024-09-21T12:29:46.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.210+0000 7f8ca3fff640 1 -- 172.21.15.3:0/1437339031 learned_addr learned my addr 172.21.15.3:0/1437339031 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:29:46.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.210+0000 7f8ca8fdf640 1 --2- 172.21.15.3:0/1437339031 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ca4101900 0x7f8ca40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:29:46.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.211+0000 7f8ca3fff640 1 -- 172.21.15.3:0/1437339031 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ca4101900 msgr2=0x7f8ca40744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:29:46.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.211+0000 7f8ca3fff640 1 --2- 172.21.15.3:0/1437339031 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ca4101900 0x7f8ca40744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:46.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.211+0000 7f8ca3fff640 1 -- 172.21.15.3:0/1437339031 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ca4074f70 con 0x7f8ca4107900 2024-09-21T12:29:46.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.211+0000 7f8ca3fff640 1 --2- 172.21.15.3:0/1437339031 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8ca4107900 0x7f8ca4074a30 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8c9400ea00 tx=0x7f8c9400eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:29:46.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.211+0000 7f8ca1ffb640 1 -- 172.21.15.3:0/1437339031 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8c9400cb80 con 0x7f8ca4107900 2024-09-21T12:29:46.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.211+0000 7f8ca1ffb640 1 -- 172.21.15.3:0/1437339031 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8c9400cd20 con 0x7f8ca4107900 2024-09-21T12:29:46.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.211+0000 7f8cab243640 1 -- 172.21.15.3:0/1437339031 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ca4075260 con 0x7f8ca4107900 2024-09-21T12:29:46.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.211+0000 7f8ca1ffb640 1 -- 172.21.15.3:0/1437339031 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8c94011470 con 0x7f8ca4107900 2024-09-21T12:29:46.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.211+0000 7f8cab243640 1 -- 172.21.15.3:0/1437339031 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ca41a3e40 con 0x7f8ca4107900 2024-09-21T12:29:46.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.212+0000 7f8cab243640 1 -- 172.21.15.3:0/1437339031 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ca4103040 con 0x7f8ca4107900 2024-09-21T12:29:46.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.213+0000 7f8ca1ffb640 1 -- 172.21.15.3:0/1437339031 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f8c94005020 con 0x7f8ca4107900 2024-09-21T12:29:46.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.213+0000 7f8ca1ffb640 1 --2- 172.21.15.3:0/1437339031 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f8c9007af30 0x7f8c9007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:29:46.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.214+0000 7f8ca1ffb640 1 -- 172.21.15.3:0/1437339031 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6328+0+0 (secure 0 0 0) 0x7f8c9409e4c0 con 0x7f8ca4107900 2024-09-21T12:29:46.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.214+0000 7f8ca8fdf640 1 --2- 172.21.15.3:0/1437339031 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f8c9007af30 0x7f8c9007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:29:46.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.214+0000 7f8ca8fdf640 1 --2- 172.21.15.3:0/1437339031 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f8c9007af30 0x7f8c9007d3f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c0096c0 tx=0x7f8c8c031400 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:29:46.219 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.218+0000 7f8ca1ffb640 1 -- 172.21.15.3:0/1437339031 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f8c94016030 con 0x7f8ca4107900 2024-09-21T12:29:46.425 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.424+0000 7f8cab243640 1 -- 172.21.15.3:0/1437339031 --> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f8ca4062630 con 0x7f8c9007af30 2024-09-21T12:29:46.427 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.425+0000 7f8ca1ffb640 1 -- 172.21.15.3:0/1437339031 <== mgr.14756 v2:172.21.15.3:6800/1284098095 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f8ca4062630 con 0x7f8c9007af30 2024-09-21T12:29:46.427 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-21T12:29:46.427 INFO:teuthology.orchestra.run.smithi003.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T12:29:46.427 INFO:teuthology.orchestra.run.smithi003.stdout: "in_progress": true, 2024-09-21T12:29:46.427 INFO:teuthology.orchestra.run.smithi003.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T12:29:46.427 INFO:teuthology.orchestra.run.smithi003.stdout: "services_complete": [ 2024-09-21T12:29:46.427 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr", 2024-09-21T12:29:46.427 INFO:teuthology.orchestra.run.smithi003.stdout: "mon", 2024-09-21T12:29:46.427 INFO:teuthology.orchestra.run.smithi003.stdout: "crash", 2024-09-21T12:29:46.427 INFO:teuthology.orchestra.run.smithi003.stdout: "osd" 2024-09-21T12:29:46.428 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-21T12:29:46.428 INFO:teuthology.orchestra.run.smithi003.stdout: "progress": "14/23 daemons upgraded", 2024-09-21T12:29:46.428 INFO:teuthology.orchestra.run.smithi003.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T12:29:46.428 INFO:teuthology.orchestra.run.smithi003.stdout: "is_paused": false 2024-09-21T12:29:46.428 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-21T12:29:46.429 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.428+0000 7f8cab243640 1 -- 172.21.15.3:0/1437339031 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f8c9007af30 msgr2=0x7f8c9007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:29:46.430 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.428+0000 7f8cab243640 1 --2- 172.21.15.3:0/1437339031 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f8c9007af30 0x7f8c9007d3f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8c8c0096c0 tx=0x7f8c8c031400 comp rx=0 tx=0).stop 2024-09-21T12:29:46.430 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.428+0000 7f8cab243640 1 -- 172.21.15.3:0/1437339031 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8ca4107900 msgr2=0x7f8ca4074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:29:46.430 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.428+0000 7f8cab243640 1 --2- 172.21.15.3:0/1437339031 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8ca4107900 0x7f8ca4074a30 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f8c9400ea00 tx=0x7f8c9400eec0 comp rx=0 tx=0).stop 2024-09-21T12:29:46.430 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.428+0000 7f8cab243640 1 -- 172.21.15.3:0/1437339031 shutdown_connections 2024-09-21T12:29:46.430 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.428+0000 7f8cab243640 1 --2- 172.21.15.3:0/1437339031 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f8c9007af30 0x7f8c9007d3f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:46.430 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.428+0000 7f8cab243640 1 --2- 172.21.15.3:0/1437339031 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f8ca4107900 0x7f8ca4074a30 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:46.430 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.428+0000 7f8cab243640 1 --2- 172.21.15.3:0/1437339031 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f8ca4101900 0x7f8ca40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:46.430 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.428+0000 7f8cab243640 1 -- 172.21.15.3:0/1437339031 >> 172.21.15.3:0/1437339031 conn(0x7f8ca40fd600 msgr2=0x7f8ca40fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:29:46.430 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.428+0000 7f8cab243640 1 -- 172.21.15.3:0/1437339031 shutdown_connections 2024-09-21T12:29:46.430 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.428+0000 7f8cab243640 1 -- 172.21.15.3:0/1437339031 wait complete. 2024-09-21T12:29:46.514 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.512+0000 7fa3df773640 1 -- 172.21.15.3:0/2175764203 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa3d8102ac0 msgr2=0x7fa3d8102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:29:46.514 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.512+0000 7fa3df773640 1 --2- 172.21.15.3:0/2175764203 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa3d8102ac0 0x7fa3d8102ea0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa3c8009880 tx=0x7fa3c802a530 comp rx=0 tx=0).stop 2024-09-21T12:29:46.514 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.512+0000 7fa3df773640 1 -- 172.21.15.3:0/2175764203 shutdown_connections 2024-09-21T12:29:46.514 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.512+0000 7fa3df773640 1 --2- 172.21.15.3:0/2175764203 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3d81033e0 0x7fa3d810b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:46.514 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.512+0000 7fa3df773640 1 --2- 172.21.15.3:0/2175764203 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa3d8102ac0 0x7fa3d8102ea0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:46.514 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.512+0000 7fa3df773640 1 -- 172.21.15.3:0/2175764203 >> 172.21.15.3:0/2175764203 conn(0x7fa3d80fc520 msgr2=0x7fa3d80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:29:46.514 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.513+0000 7fa3df773640 1 -- 172.21.15.3:0/2175764203 shutdown_connections 2024-09-21T12:29:46.515 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.513+0000 7fa3df773640 1 -- 172.21.15.3:0/2175764203 wait complete. 2024-09-21T12:29:46.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.513+0000 7fa3df773640 1 Processor -- start 2024-09-21T12:29:46.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.513+0000 7fa3df773640 1 -- start start 2024-09-21T12:29:46.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.513+0000 7fa3df773640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3d8102ac0 0x7fa3d819d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:29:46.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.513+0000 7fa3df773640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa3d81033e0 0x7fa3d819dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:29:46.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.513+0000 7fa3df773640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d810edf0 con 0x7fa3d81033e0 2024-09-21T12:29:46.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.513+0000 7fa3df773640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d810ec70 con 0x7fa3d8102ac0 2024-09-21T12:29:46.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.514+0000 7fa3dcd0e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa3d81033e0 0x7fa3d819dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:29:46.516 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.514+0000 7fa3dcd0e640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa3d81033e0 0x7fa3d819dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:43928/0 (socket says 172.21.15.3:43928) 2024-09-21T12:29:46.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.514+0000 7fa3dcd0e640 1 -- 172.21.15.3:0/155008503 learned_addr learned my addr 172.21.15.3:0/155008503 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:29:46.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.514+0000 7fa3dd50f640 1 --2- 172.21.15.3:0/155008503 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3d8102ac0 0x7fa3d819d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:29:46.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.514+0000 7fa3dcd0e640 1 -- 172.21.15.3:0/155008503 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3d8102ac0 msgr2=0x7fa3d819d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:29:46.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.514+0000 7fa3dcd0e640 1 --2- 172.21.15.3:0/155008503 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3d8102ac0 0x7fa3d819d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:46.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.514+0000 7fa3dcd0e640 1 -- 172.21.15.3:0/155008503 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3d81977e0 con 0x7fa3d81033e0 2024-09-21T12:29:46.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.514+0000 7fa3dcd0e640 1 --2- 172.21.15.3:0/155008503 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa3d81033e0 0x7fa3d819dba0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa3d400d6d0 tx=0x7fa3d400db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:29:46.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.514+0000 7fa3ce7fc640 1 -- 172.21.15.3:0/155008503 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa3d4017070 con 0x7fa3d81033e0 2024-09-21T12:29:46.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.514+0000 7fa3ce7fc640 1 -- 172.21.15.3:0/155008503 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa3d40054e0 con 0x7fa3d81033e0 2024-09-21T12:29:46.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.514+0000 7fa3df773640 1 -- 172.21.15.3:0/155008503 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3d8197ad0 con 0x7fa3d81033e0 2024-09-21T12:29:46.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.514+0000 7fa3ce7fc640 1 -- 172.21.15.3:0/155008503 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa3d4004ae0 con 0x7fa3d81033e0 2024-09-21T12:29:46.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.514+0000 7fa3df773640 1 -- 172.21.15.3:0/155008503 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3d8198060 con 0x7fa3d81033e0 2024-09-21T12:29:46.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.515+0000 7fa3df773640 1 -- 172.21.15.3:0/155008503 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3d806aa90 con 0x7fa3d81033e0 2024-09-21T12:29:46.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.516+0000 7fa3ce7fc640 1 -- 172.21.15.3:0/155008503 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7fa3d4004d90 con 0x7fa3d81033e0 2024-09-21T12:29:46.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.517+0000 7fa3ce7fc640 1 --2- 172.21.15.3:0/155008503 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fa3c407af80 0x7fa3c407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:29:46.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.517+0000 7fa3ce7fc640 1 -- 172.21.15.3:0/155008503 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 6328+0+0 (secure 0 0 0) 0x7fa3d409db50 con 0x7fa3d81033e0 2024-09-21T12:29:46.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.517+0000 7fa3dd50f640 1 --2- 172.21.15.3:0/155008503 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fa3c407af80 0x7fa3c407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:29:46.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.517+0000 7fa3dd50f640 1 --2- 172.21.15.3:0/155008503 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fa3c407af80 0x7fa3c407d440 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa3c80096c0 tx=0x7fa3c8031400 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:29:46.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.521+0000 7fa3ce7fc640 1 -- 172.21.15.3:0/155008503 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa3d4069120 con 0x7fa3d81033e0 2024-09-21T12:29:46.783 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.782+0000 7fa3df773640 1 -- 172.21.15.3:0/155008503 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7fa3d8105f90 con 0x7fa3d81033e0 2024-09-21T12:29:46.784 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:46 smithi003 ceph-mon[108723]: from='client.34354 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:29:46.784 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:46 smithi003 ceph-mon[108723]: from='client.34358 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:29:46.784 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:46 smithi003 ceph-mon[108723]: from='client.? 172.21.15.3:0/1643856511' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:29:46.784 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:46 smithi003 ceph-mon[108723]: from='client.? 172.21.15.3:0/2838034956' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:29:46.784 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.782+0000 7fa3ce7fc640 1 -- 172.21.15.3:0/155008503 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+297 (secure 0 0 0) 0x7fa3d406dfd0 con 0x7fa3d81033e0 2024-09-21T12:29:46.785 INFO:teuthology.orchestra.run.smithi003.stdout:HEALTH_WARN 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data 2024-09-21T12:29:46.785 INFO:teuthology.orchestra.run.smithi003.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T12:29:46.785 INFO:teuthology.orchestra.run.smithi003.stdout: fs cephfs is degraded 2024-09-21T12:29:46.785 INFO:teuthology.orchestra.run.smithi003.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:29:46.785 INFO:teuthology.orchestra.run.smithi003.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:29:46.786 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.784+0000 7fa3df773640 1 -- 172.21.15.3:0/155008503 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fa3c407af80 msgr2=0x7fa3c407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:29:46.786 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.784+0000 7fa3df773640 1 --2- 172.21.15.3:0/155008503 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fa3c407af80 0x7fa3c407d440 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fa3c80096c0 tx=0x7fa3c8031400 comp rx=0 tx=0).stop 2024-09-21T12:29:46.786 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.784+0000 7fa3df773640 1 -- 172.21.15.3:0/155008503 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa3d81033e0 msgr2=0x7fa3d819dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:29:46.786 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.784+0000 7fa3df773640 1 --2- 172.21.15.3:0/155008503 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa3d81033e0 0x7fa3d819dba0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fa3d400d6d0 tx=0x7fa3d400db90 comp rx=0 tx=0).stop 2024-09-21T12:29:46.786 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.785+0000 7fa3df773640 1 -- 172.21.15.3:0/155008503 shutdown_connections 2024-09-21T12:29:46.786 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.785+0000 7fa3df773640 1 --2- 172.21.15.3:0/155008503 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fa3c407af80 0x7fa3c407d440 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:46.787 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.785+0000 7fa3df773640 1 --2- 172.21.15.3:0/155008503 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa3d81033e0 0x7fa3d819dba0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:46.787 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.785+0000 7fa3df773640 1 --2- 172.21.15.3:0/155008503 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3d8102ac0 0x7fa3d819d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:29:46.787 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.785+0000 7fa3df773640 1 -- 172.21.15.3:0/155008503 >> 172.21.15.3:0/155008503 conn(0x7fa3d80fc520 msgr2=0x7fa3d8108ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:29:46.787 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.785+0000 7fa3df773640 1 -- 172.21.15.3:0/155008503 shutdown_connections 2024-09-21T12:29:46.787 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:29:46.785+0000 7fa3df773640 1 -- 172.21.15.3:0/155008503 wait complete. 2024-09-21T12:29:47.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:46 smithi192 ceph-mon[80326]: from='client.34354 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:29:47.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:46 smithi192 ceph-mon[80326]: from='client.34358 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:29:47.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:46 smithi192 ceph-mon[80326]: from='client.? 172.21.15.3:0/1643856511' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:29:47.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:46 smithi192 ceph-mon[80326]: from='client.? 172.21.15.3:0/2838034956' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:29:48.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:47 smithi192 ceph-mon[80326]: from='client.34370 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:29:48.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:47 smithi192 ceph-mon[80326]: from='client.? 172.21.15.3:0/155008503' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:29:48.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:47 smithi192 ceph-mon[80326]: pgmap v269: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 4.6 MiB/s rd, 2 op/s 2024-09-21T12:29:48.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:47 smithi003 ceph-mon[108723]: from='client.34370 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:29:48.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:47 smithi003 ceph-mon[108723]: from='client.? 172.21.15.3:0/155008503' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:29:48.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:47 smithi003 ceph-mon[108723]: pgmap v269: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 4.6 MiB/s rd, 2 op/s 2024-09-21T12:29:50.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:49 smithi192 ceph-mon[80326]: pgmap v270: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 4.6 MiB/s rd, 2 op/s 2024-09-21T12:29:50.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:49 smithi003 ceph-mon[108723]: pgmap v270: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 4.6 MiB/s rd, 2 op/s 2024-09-21T12:29:52.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:51 smithi192 ceph-mon[80326]: pgmap v271: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 6 op/s 2024-09-21T12:29:52.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:51 smithi003 ceph-mon[108723]: pgmap v271: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 21 MiB/s rd, 6 op/s 2024-09-21T12:29:54.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:53 smithi192 ceph-mon[80326]: pgmap v272: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 24 MiB/s rd, 7 op/s 2024-09-21T12:29:54.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:53 smithi192 ceph-mon[80326]: reconnect by client.24361 192.168.0.1:0/3487024347 after 0.00099998 2024-09-21T12:29:54.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:53 smithi192 ceph-mon[80326]: reconnect by client.14600 192.168.0.1:0/1734926769 after 0.00099998 2024-09-21T12:29:54.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:53 smithi192 ceph-mon[80326]: mds.? [v2:172.21.15.192:6826/318800854,v1:172.21.15.192:6827/318800854] up:reconnect 2024-09-21T12:29:54.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:53 smithi192 ceph-mon[80326]: fsmap cephfs:1/1 {0=cephfs.smithi192.ktdqns=up:reconnect} 2 up:standby 2024-09-21T12:29:54.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:53 smithi003 ceph-mon[108723]: pgmap v272: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 24 MiB/s rd, 7 op/s 2024-09-21T12:29:54.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:53 smithi003 ceph-mon[108723]: reconnect by client.24361 192.168.0.1:0/3487024347 after 0.00099998 2024-09-21T12:29:54.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:53 smithi003 ceph-mon[108723]: reconnect by client.14600 192.168.0.1:0/1734926769 after 0.00099998 2024-09-21T12:29:54.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:53 smithi003 ceph-mon[108723]: mds.? [v2:172.21.15.192:6826/318800854,v1:172.21.15.192:6827/318800854] up:reconnect 2024-09-21T12:29:54.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:53 smithi003 ceph-mon[108723]: fsmap cephfs:1/1 {0=cephfs.smithi192.ktdqns=up:reconnect} 2 up:standby 2024-09-21T12:29:55.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:54 smithi192 ceph-mon[80326]: mds.? [v2:172.21.15.192:6826/318800854,v1:172.21.15.192:6827/318800854] up:rejoin 2024-09-21T12:29:55.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:54 smithi192 ceph-mon[80326]: fsmap cephfs:1/1 {0=cephfs.smithi192.ktdqns=up:rejoin} 2 up:standby 2024-09-21T12:29:55.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:54 smithi192 ceph-mon[80326]: daemon mds.cephfs.smithi192.ktdqns is now active in filesystem cephfs as rank 0 2024-09-21T12:29:55.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:54 smithi003 ceph-mon[108723]: mds.? [v2:172.21.15.192:6826/318800854,v1:172.21.15.192:6827/318800854] up:rejoin 2024-09-21T12:29:55.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:54 smithi003 ceph-mon[108723]: fsmap cephfs:1/1 {0=cephfs.smithi192.ktdqns=up:rejoin} 2 up:standby 2024-09-21T12:29:55.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:54 smithi003 ceph-mon[108723]: daemon mds.cephfs.smithi192.ktdqns is now active in filesystem cephfs as rank 0 2024-09-21T12:29:56.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:55 smithi192 ceph-mon[80326]: pgmap v273: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 24 MiB/s rd, 7 op/s 2024-09-21T12:29:56.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:55 smithi192 ceph-mon[80326]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T12:29:56.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:55 smithi192 ceph-mon[80326]: mds.? [v2:172.21.15.192:6826/318800854,v1:172.21.15.192:6827/318800854] up:active 2024-09-21T12:29:56.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:55 smithi192 ceph-mon[80326]: fsmap cephfs:1 {0=cephfs.smithi192.ktdqns=up:active} 2 up:standby 2024-09-21T12:29:56.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:55 smithi003 ceph-mon[108723]: pgmap v273: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 24 MiB/s rd, 7 op/s 2024-09-21T12:29:56.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:55 smithi003 ceph-mon[108723]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T12:29:56.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:55 smithi003 ceph-mon[108723]: mds.? [v2:172.21.15.192:6826/318800854,v1:172.21.15.192:6827/318800854] up:active 2024-09-21T12:29:56.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:55 smithi003 ceph-mon[108723]: fsmap cephfs:1 {0=cephfs.smithi192.ktdqns=up:active} 2 up:standby 2024-09-21T12:29:57.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:56 smithi192 ceph-mon[80326]: pgmap v274: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 170 B/s wr, 8 op/s 2024-09-21T12:29:57.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:56 smithi003 ceph-mon[108723]: pgmap v274: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 170 B/s wr, 8 op/s 2024-09-21T12:29:59.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:59 smithi192 ceph-mon[80326]: mds.? [v2:172.21.15.192:6824/3113020545,v1:172.21.15.192:6825/3113020545] up:boot 2024-09-21T12:29:59.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:59 smithi192 ceph-mon[80326]: fsmap cephfs:1 {0=cephfs.smithi192.ktdqns=up:active} 3 up:standby 2024-09-21T12:29:59.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:59 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "mds metadata", "who": "cephfs.smithi192.ywqqxe"} : dispatch 2024-09-21T12:29:59.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:59 smithi192 ceph-mon[80326]: pgmap v275: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 19 MiB/s rd, 170 B/s wr, 6 op/s 2024-09-21T12:29:59.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:59 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:29:59.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:59 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:29:59.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:29:59 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:29:59.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:59 smithi003 ceph-mon[108723]: mds.? [v2:172.21.15.192:6824/3113020545,v1:172.21.15.192:6825/3113020545] up:boot 2024-09-21T12:29:59.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:59 smithi003 ceph-mon[108723]: fsmap cephfs:1 {0=cephfs.smithi192.ktdqns=up:active} 3 up:standby 2024-09-21T12:29:59.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:59 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "mds metadata", "who": "cephfs.smithi192.ywqqxe"} : dispatch 2024-09-21T12:29:59.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:59 smithi003 ceph-mon[108723]: pgmap v275: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 19 MiB/s rd, 170 B/s wr, 6 op/s 2024-09-21T12:29:59.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:59 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:29:59.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:59 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:29:59.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:29:59 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:30:00.957 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:00 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:00.957 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:00 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:30:00.957 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:00 smithi192 ceph-mon[80326]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-21T12:30:01.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:00 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:01.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:00 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:30:01.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:00 smithi003 ceph-mon[108723]: overall HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-21T12:30:01.819 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:01 smithi192 ceph-mon[80326]: pgmap v276: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 19 MiB/s rd, 4.2 KiB/s wr, 10 op/s 2024-09-21T12:30:02.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:01 smithi003 ceph-mon[108723]: pgmap v276: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 19 MiB/s rd, 4.2 KiB/s wr, 10 op/s 2024-09-21T12:30:04.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:03 smithi192 ceph-mon[80326]: pgmap v277: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 5.4 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-09-21T12:30:04.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:03 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:04.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:03 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:04.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:03 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:04.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:03 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:04.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:03 smithi003 ceph-mon[108723]: pgmap v277: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 5.4 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-09-21T12:30:04.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:03 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:04.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:03 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:04.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:03 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:04.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:03 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:06.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:05 smithi192 ceph-mon[80326]: pgmap v278: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.7 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-09-21T12:30:06.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:05 smithi003 ceph-mon[108723]: pgmap v278: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.7 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-09-21T12:30:07.952 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:07 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:07.953 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:07 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:07.953 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:07 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:30:07.953 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:07 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:30:07.953 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:07 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:07.953 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:07 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:30:07.953 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:07 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:30:07.953 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:07 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:30:07.953 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:07 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:30:07.953 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:07 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:30:07.953 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:07 smithi192 ceph-mon[80326]: pgmap v279: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-09-21T12:30:08.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:07 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:08.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:07 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:08.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:07 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:30:08.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:07 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:30:08.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:07 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:08.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:07 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:30:08.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:07 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:30:08.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:07 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:30:08.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:07 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:30:08.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:07 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:30:08.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:07 smithi003 ceph-mon[108723]: pgmap v279: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 MiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-09-21T12:30:09.228 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:08 smithi192 ceph-mon[80326]: Upgrade: Updating mds.cephfs.smithi192.ktdqns 2024-09-21T12:30:09.228 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:08 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:09.228 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:08 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi192.ktdqns", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T12:30:09.228 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:08 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:30:09.228 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:08 smithi192 ceph-mon[80326]: Deploying daemon mds.cephfs.smithi192.ktdqns on smithi192 2024-09-21T12:30:09.228 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:08 smithi192 ceph-mon[80326]: pgmap v280: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 4.1 KiB/s wr, 3 op/s 2024-09-21T12:30:09.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:08 smithi003 ceph-mon[108723]: Upgrade: Updating mds.cephfs.smithi192.ktdqns 2024-09-21T12:30:09.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:08 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:09.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:08 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi192.ktdqns", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]} : dispatch 2024-09-21T12:30:09.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:08 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:30:09.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:08 smithi003 ceph-mon[108723]: Deploying daemon mds.cephfs.smithi192.ktdqns on smithi192 2024-09-21T12:30:09.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:08 smithi003 ceph-mon[108723]: pgmap v280: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 4.1 KiB/s wr, 3 op/s 2024-09-21T12:30:10.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:09 smithi192 ceph-mon[80326]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T12:30:10.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:09 smithi192 ceph-mon[80326]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T12:30:10.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:09 smithi192 ceph-mon[80326]: osdmap e81: 6 total, 6 up, 6 in 2024-09-21T12:30:10.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:09 smithi192 ceph-mon[80326]: Standby daemon mds.cephfs.smithi003.ebjgyl assigned to filesystem cephfs as rank 0 2024-09-21T12:30:10.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:09 smithi192 ceph-mon[80326]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T12:30:10.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:09 smithi192 ceph-mon[80326]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-21T12:30:10.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:09 smithi192 ceph-mon[80326]: fsmap cephfs:1/1 {0=cephfs.smithi003.ebjgyl=up:replay} 2 up:standby 2024-09-21T12:30:10.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:09 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-mon-smithi003[108719]: 2024-09-21T12:30:09.930+0000 7f7947e01640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T12:30:10.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:09 smithi003 ceph-mon[108723]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-21T12:30:10.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:09 smithi003 ceph-mon[108723]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-21T12:30:10.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:09 smithi003 ceph-mon[108723]: osdmap e81: 6 total, 6 up, 6 in 2024-09-21T12:30:10.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:09 smithi003 ceph-mon[108723]: Standby daemon mds.cephfs.smithi003.ebjgyl assigned to filesystem cephfs as rank 0 2024-09-21T12:30:10.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:09 smithi003 ceph-mon[108723]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-21T12:30:10.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:09 smithi003 ceph-mon[108723]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-21T12:30:10.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:09 smithi003 ceph-mon[108723]: fsmap cephfs:1/1 {0=cephfs.smithi003.ebjgyl=up:replay} 2 up:standby 2024-09-21T12:30:11.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:11 smithi192 ceph-mon[80326]: pgmap v282: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.6 MiB/s rd, 1 op/s 2024-09-21T12:30:11.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:11 smithi003 ceph-mon[108723]: pgmap v282: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.6 MiB/s rd, 1 op/s 2024-09-21T12:30:14.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:13 smithi192 ceph-mon[80326]: pgmap v283: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 3.8 MiB/s rd, 2 op/s 2024-09-21T12:30:14.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:13 smithi003 ceph-mon[108723]: pgmap v283: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 3.8 MiB/s rd, 2 op/s 2024-09-21T12:30:16.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:15 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:16.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:15 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:30:16.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:15 smithi192 ceph-mon[80326]: pgmap v284: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 9.0 MiB/s rd, 3 op/s 2024-09-21T12:30:16.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:15 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:16.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:15 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:30:16.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:15 smithi003 ceph-mon[108723]: pgmap v284: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 9.0 MiB/s rd, 3 op/s 2024-09-21T12:30:16.901 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:16.897+0000 7fa3f72b2640 1 -- 172.21.15.3:0/1731375639 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa3f0102ab0 msgr2=0x7fa3f0102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:30:16.901 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:16.897+0000 7fa3f72b2640 1 --2- 172.21.15.3:0/1731375639 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa3f0102ab0 0x7fa3f0102e90 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa3ec009880 tx=0x7fa3ec02a530 comp rx=0 tx=0).stop 2024-09-21T12:30:16.901 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:16.897+0000 7fa3f72b2640 1 -- 172.21.15.3:0/1731375639 shutdown_connections 2024-09-21T12:30:16.901 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:16.897+0000 7fa3f72b2640 1 --2- 172.21.15.3:0/1731375639 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3f01033d0 0x7fa3f010b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:30:16.901 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:16.897+0000 7fa3f72b2640 1 --2- 172.21.15.3:0/1731375639 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa3f0102ab0 0x7fa3f0102e90 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:30:16.901 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:16.897+0000 7fa3f72b2640 1 -- 172.21.15.3:0/1731375639 >> 172.21.15.3:0/1731375639 conn(0x7fa3f00fc550 msgr2=0x7fa3f00fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:30:16.901 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:16.897+0000 7fa3f72b2640 1 -- 172.21.15.3:0/1731375639 shutdown_connections 2024-09-21T12:30:16.901 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:16.897+0000 7fa3f72b2640 1 -- 172.21.15.3:0/1731375639 wait complete. 2024-09-21T12:30:16.901 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:16.898+0000 7fa3f72b2640 1 Processor -- start 2024-09-21T12:30:16.902 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:16.898+0000 7fa3f72b2640 1 -- start start 2024-09-21T12:30:16.902 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:16.899+0000 7fa3f72b2640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3f0102ab0 0x7fa3f019f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:30:16.902 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:16.899+0000 7fa3f72b2640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa3f01033d0 0x7fa3f019fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:30:16.902 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:16.899+0000 7fa3f72b2640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f010ede0 con 0x7fa3f01033d0 2024-09-21T12:30:16.902 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:16.899+0000 7fa3f72b2640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa3f010ec60 con 0x7fa3f0102ab0 2024-09-21T12:30:16.902 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:16.899+0000 7fa3f484d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa3f01033d0 0x7fa3f019fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:30:16.902 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:16.899+0000 7fa3f484d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa3f01033d0 0x7fa3f019fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60832/0 (socket says 172.21.15.3:60832) 2024-09-21T12:30:16.902 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:16.899+0000 7fa3f484d640 1 -- 172.21.15.3:0/2176677837 learned_addr learned my addr 172.21.15.3:0/2176677837 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:30:16.902 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:16.899+0000 7fa3f504e640 1 --2- 172.21.15.3:0/2176677837 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3f0102ab0 0x7fa3f019f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:30:16.902 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:16.899+0000 7fa3f484d640 1 -- 172.21.15.3:0/2176677837 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3f0102ab0 msgr2=0x7fa3f019f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:30:16.902 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:16.899+0000 7fa3f484d640 1 --2- 172.21.15.3:0/2176677837 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3f0102ab0 0x7fa3f019f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:30:16.902 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:16.899+0000 7fa3f484d640 1 -- 172.21.15.3:0/2176677837 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3f01999f0 con 0x7fa3f01033d0 2024-09-21T12:30:16.902 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:16.899+0000 7fa3f484d640 1 --2- 172.21.15.3:0/2176677837 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa3f01033d0 0x7fa3f019fd70 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa3e000d6d0 tx=0x7fa3e000db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:30:16.903 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:16.900+0000 7fa3e67fc640 1 -- 172.21.15.3:0/2176677837 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa3e0017070 con 0x7fa3f01033d0 2024-09-21T12:30:16.903 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:16.900+0000 7fa3e67fc640 1 -- 172.21.15.3:0/2176677837 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa3e00054e0 con 0x7fa3f01033d0 2024-09-21T12:30:16.904 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:16.900+0000 7fa3f72b2640 1 -- 172.21.15.3:0/2176677837 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3f0199ce0 con 0x7fa3f01033d0 2024-09-21T12:30:16.904 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:16.900+0000 7fa3e67fc640 1 -- 172.21.15.3:0/2176677837 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa3e0004ae0 con 0x7fa3f01033d0 2024-09-21T12:30:16.904 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:16.900+0000 7fa3f72b2640 1 -- 172.21.15.3:0/2176677837 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3f019a270 con 0x7fa3f01033d0 2024-09-21T12:30:16.904 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:16.901+0000 7fa3f72b2640 1 -- 172.21.15.3:0/2176677837 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3f006a580 con 0x7fa3f01033d0 2024-09-21T12:30:16.904 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:16.902+0000 7fa3e67fc640 1 -- 172.21.15.3:0/2176677837 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7fa3e0004d90 con 0x7fa3f01033d0 2024-09-21T12:30:16.904 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:16.902+0000 7fa3e67fc640 1 --2- 172.21.15.3:0/2176677837 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fa3dc07af80 0x7fa3dc07d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:30:16.904 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:16.903+0000 7fa3e67fc640 1 -- 172.21.15.3:0/2176677837 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6414+0+0 (secure 0 0 0) 0x7fa3e009dc50 con 0x7fa3f01033d0 2024-09-21T12:30:16.905 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:16.903+0000 7fa3f504e640 1 --2- 172.21.15.3:0/2176677837 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fa3dc07af80 0x7fa3dc07d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:30:16.905 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:16.904+0000 7fa3f504e640 1 --2- 172.21.15.3:0/2176677837 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fa3dc07af80 0x7fa3dc07d440 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa3ec000c00 tx=0x7fa3ec031400 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:30:16.909 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:16.908+0000 7fa3e67fc640 1 -- 172.21.15.3:0/2176677837 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa3e00691d0 con 0x7fa3f01033d0 2024-09-21T12:30:17.129 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.127+0000 7fa3f72b2640 1 -- 172.21.15.3:0/2176677837 --> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fa3f010b400 con 0x7fa3dc07af80 2024-09-21T12:30:17.130 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.128+0000 7fa3e67fc640 1 -- 172.21.15.3:0/2176677837 <== mgr.14756 v2:172.21.15.3:6800/1284098095 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7fa3ec004360 con 0x7fa3dc07af80 2024-09-21T12:30:17.132 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.130+0000 7fa3f72b2640 1 -- 172.21.15.3:0/2176677837 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fa3dc07af80 msgr2=0x7fa3dc07d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:30:17.132 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.130+0000 7fa3f72b2640 1 --2- 172.21.15.3:0/2176677837 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fa3dc07af80 0x7fa3dc07d440 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa3ec000c00 tx=0x7fa3ec031400 comp rx=0 tx=0).stop 2024-09-21T12:30:17.132 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.130+0000 7fa3f72b2640 1 -- 172.21.15.3:0/2176677837 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa3f01033d0 msgr2=0x7fa3f019fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:30:17.132 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.130+0000 7fa3f72b2640 1 --2- 172.21.15.3:0/2176677837 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa3f01033d0 0x7fa3f019fd70 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa3e000d6d0 tx=0x7fa3e000db90 comp rx=0 tx=0).stop 2024-09-21T12:30:17.132 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.130+0000 7fa3f72b2640 1 -- 172.21.15.3:0/2176677837 shutdown_connections 2024-09-21T12:30:17.132 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.130+0000 7fa3f72b2640 1 --2- 172.21.15.3:0/2176677837 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fa3dc07af80 0x7fa3dc07d440 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:30:17.132 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.130+0000 7fa3f72b2640 1 --2- 172.21.15.3:0/2176677837 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa3f01033d0 0x7fa3f019fd70 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:30:17.133 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.130+0000 7fa3f72b2640 1 --2- 172.21.15.3:0/2176677837 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa3f0102ab0 0x7fa3f019f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:30:17.133 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.131+0000 7fa3f72b2640 1 -- 172.21.15.3:0/2176677837 >> 172.21.15.3:0/2176677837 conn(0x7fa3f00fc550 msgr2=0x7fa3f01009e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:30:17.133 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.131+0000 7fa3f72b2640 1 -- 172.21.15.3:0/2176677837 shutdown_connections 2024-09-21T12:30:17.133 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.131+0000 7fa3f72b2640 1 -- 172.21.15.3:0/2176677837 wait complete. 2024-09-21T12:30:17.141 INFO:teuthology.orchestra.run.smithi003.stdout:true 2024-09-21T12:30:17.219 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.217+0000 7f0e21568640 1 -- 172.21.15.3:0/3224774409 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e1c1067f0 msgr2=0x7f0e1c106bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:30:17.219 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.217+0000 7f0e21568640 1 --2- 172.21.15.3:0/3224774409 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e1c1067f0 0x7f0e1c106bd0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c009880 tx=0x7f0e0c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:30:17.219 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.217+0000 7f0e21568640 1 -- 172.21.15.3:0/3224774409 shutdown_connections 2024-09-21T12:30:17.219 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.217+0000 7f0e21568640 1 --2- 172.21.15.3:0/3224774409 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0e1c1007f0 0x7f0e1c100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:30:17.219 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.217+0000 7f0e21568640 1 --2- 172.21.15.3:0/3224774409 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e1c1067f0 0x7f0e1c106bd0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:30:17.219 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.217+0000 7f0e21568640 1 -- 172.21.15.3:0/3224774409 >> 172.21.15.3:0/3224774409 conn(0x7f0e1c0fc550 msgr2=0x7f0e1c0fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:30:17.219 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.217+0000 7f0e21568640 1 -- 172.21.15.3:0/3224774409 shutdown_connections 2024-09-21T12:30:17.219 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.217+0000 7f0e21568640 1 -- 172.21.15.3:0/3224774409 wait complete. 2024-09-21T12:30:17.219 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.218+0000 7f0e21568640 1 Processor -- start 2024-09-21T12:30:17.220 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.218+0000 7f0e21568640 1 -- start start 2024-09-21T12:30:17.221 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.218+0000 7f0e21568640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0e1c1007f0 0x7f0e1c19f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:30:17.221 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.218+0000 7f0e21568640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e1c1067f0 0x7f0e1c19fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:30:17.221 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.218+0000 7f0e21568640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f0e1c10dcc0 con 0x7f0e1c1067f0 2024-09-21T12:30:17.221 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.218+0000 7f0e21568640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0e1c10db40 con 0x7f0e1c1007f0 2024-09-21T12:30:17.221 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.218+0000 7f0e1a7fc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e1c1067f0 0x7f0e1c19fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:30:17.221 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.218+0000 7f0e1a7fc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e1c1067f0 0x7f0e1c19fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60852/0 (socket says 172.21.15.3:60852) 2024-09-21T12:30:17.221 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.218+0000 7f0e1a7fc640 1 -- 172.21.15.3:0/15213458 learned_addr learned my addr 172.21.15.3:0/15213458 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:30:17.221 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.218+0000 7f0e1affd640 1 --2- 172.21.15.3:0/15213458 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0e1c1007f0 0x7f0e1c19f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:30:17.221 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.219+0000 7f0e1a7fc640 1 -- 172.21.15.3:0/15213458 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0e1c1007f0 msgr2=0x7f0e1c19f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:30:17.221 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.219+0000 7f0e1a7fc640 1 --2- 172.21.15.3:0/15213458 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0e1c1007f0 0x7f0e1c19f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:30:17.221 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.219+0000 7f0e1a7fc640 1 -- 172.21.15.3:0/15213458 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e1c199a20 con 0x7f0e1c1067f0 2024-09-21T12:30:17.221 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.219+0000 7f0e1a7fc640 1 --2- 172.21.15.3:0/15213458 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e1c1067f0 0x7f0e1c19fda0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0e1000d6f0 tx=0x7f0e1000dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:30:17.221 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.219+0000 7f0e03fff640 1 -- 172.21.15.3:0/15213458 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0e10017070 con 0x7f0e1c1067f0 2024-09-21T12:30:17.222 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.219+0000 7f0e03fff640 1 -- 172.21.15.3:0/15213458 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0e1000de00 con 0x7f0e1c1067f0 2024-09-21T12:30:17.222 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.219+0000 7f0e21568640 1 -- 172.21.15.3:0/15213458 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e1c199d10 con 0x7f0e1c1067f0 2024-09-21T12:30:17.222 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.219+0000 7f0e03fff640 1 -- 172.21.15.3:0/15213458 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0e10004bb0 con 0x7f0e1c1067f0 2024-09-21T12:30:17.222 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.219+0000 7f0e21568640 1 -- 172.21.15.3:0/15213458 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e1c19a2a0 con 0x7f0e1c1067f0 2024-09-21T12:30:17.222 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.220+0000 7f0e21568640 1 -- 172.21.15.3:0/15213458 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e1c101f30 con 0x7f0e1c1067f0 2024-09-21T12:30:17.222 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.221+0000 7f0e03fff640 1 -- 172.21.15.3:0/15213458 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f0e10004e60 con 0x7f0e1c1067f0 2024-09-21T12:30:17.223 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.221+0000 7f0e03fff640 1 --2- 172.21.15.3:0/15213458 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f0e0407af30 0x7f0e0407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:30:17.223 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.221+0000 7f0e03fff640 1 -- 172.21.15.3:0/15213458 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6414+0+0 (secure 0 0 0) 0x7f0e1009dca0 con 0x7f0e1c1067f0 2024-09-21T12:30:17.223 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.222+0000 7f0e1affd640 1 --2- 172.21.15.3:0/15213458 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f0e0407af30 0x7f0e0407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:30:17.223 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.222+0000 7f0e1affd640 1 --2- 172.21.15.3:0/15213458 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f0e0407af30 0x7f0e0407d3f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c000c00 tx=0x7f0e0c031400 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:30:17.227 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.226+0000 7f0e03fff640 1 -- 172.21.15.3:0/15213458 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0e100a2070 con 0x7f0e1c1067f0 2024-09-21T12:30:17.431 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.430+0000 7f0e21568640 1 -- 172.21.15.3:0/15213458 --> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f0e1c19b060 con 0x7f0e0407af30 2024-09-21T12:30:17.433 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.431+0000 7f0e03fff640 1 -- 172.21.15.3:0/15213458 <== mgr.14756 v2:172.21.15.3:6800/1284098095 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f0e1c19b060 con 0x7f0e0407af30 2024-09-21T12:30:17.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.433+0000 7f0e21568640 1 -- 172.21.15.3:0/15213458 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f0e0407af30 msgr2=0x7f0e0407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:30:17.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.433+0000 7f0e21568640 1 --2- 172.21.15.3:0/15213458 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f0e0407af30 0x7f0e0407d3f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f0e0c000c00 tx=0x7f0e0c031400 comp rx=0 tx=0).stop 2024-09-21T12:30:17.435 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.433+0000 7f0e21568640 1 -- 172.21.15.3:0/15213458 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e1c1067f0 msgr2=0x7f0e1c19fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:30:17.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.433+0000 7f0e21568640 1 --2- 172.21.15.3:0/15213458 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e1c1067f0 0x7f0e1c19fda0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f0e1000d6f0 tx=0x7f0e1000dbb0 comp rx=0 tx=0).stop 2024-09-21T12:30:17.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.434+0000 7f0e21568640 1 -- 172.21.15.3:0/15213458 shutdown_connections 2024-09-21T12:30:17.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.434+0000 7f0e21568640 1 --2- 172.21.15.3:0/15213458 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f0e0407af30 0x7f0e0407d3f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:30:17.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.434+0000 7f0e21568640 1 --2- 172.21.15.3:0/15213458 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0e1c1067f0 0x7f0e1c19fda0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:30:17.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.434+0000 7f0e21568640 1 --2- 172.21.15.3:0/15213458 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0e1c1007f0 0x7f0e1c19f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:30:17.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.434+0000 7f0e21568640 1 -- 172.21.15.3:0/15213458 >> 172.21.15.3:0/15213458 conn(0x7f0e1c0fc550 msgr2=0x7f0e1c069e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:30:17.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.434+0000 7f0e21568640 1 -- 172.21.15.3:0/15213458 shutdown_connections 2024-09-21T12:30:17.436 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.434+0000 7f0e21568640 1 -- 172.21.15.3:0/15213458 wait complete. 2024-09-21T12:30:17.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.519+0000 7f6bd0749640 1 -- 172.21.15.3:0/1960971777 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6bc8102ab0 msgr2=0x7f6bc8102e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:30:17.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.519+0000 7f6bd0749640 1 --2- 172.21.15.3:0/1960971777 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6bc8102ab0 0x7f6bc8102e90 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6bc4009880 tx=0x7f6bc402a530 comp rx=0 tx=0).stop 2024-09-21T12:30:17.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.519+0000 7f6bd0749640 1 -- 172.21.15.3:0/1960971777 shutdown_connections 2024-09-21T12:30:17.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.519+0000 7f6bd0749640 1 --2- 172.21.15.3:0/1960971777 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6bc81033d0 0x7f6bc810b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:30:17.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.519+0000 7f6bd0749640 1 --2- 172.21.15.3:0/1960971777 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6bc8102ab0 0x7f6bc8102e90 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:30:17.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.519+0000 7f6bd0749640 1 -- 172.21.15.3:0/1960971777 >> 172.21.15.3:0/1960971777 conn(0x7f6bc80fc550 msgr2=0x7f6bc80fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:30:17.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.519+0000 7f6bd0749640 1 -- 172.21.15.3:0/1960971777 shutdown_connections 2024-09-21T12:30:17.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.519+0000 7f6bd0749640 1 -- 172.21.15.3:0/1960971777 wait complete. 2024-09-21T12:30:17.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.519+0000 7f6bd0749640 1 Processor -- start 2024-09-21T12:30:17.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.519+0000 7f6bd0749640 1 -- start start 2024-09-21T12:30:17.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.520+0000 7f6bd0749640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6bc8102ab0 0x7f6bc819d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:30:17.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.520+0000 7f6bd0749640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6bc81033d0 0x7f6bc819db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:30:17.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.520+0000 7f6bd0749640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc810ede0 con 0x7f6bc81033d0 2024-09-21T12:30:17.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.520+0000 7f6bd0749640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc810ec60 con 0x7f6bc8102ab0 2024-09-21T12:30:17.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.520+0000 7f6bcdce4640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6bc81033d0 0x7f6bc819db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:30:17.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.520+0000 7f6bcdce4640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6bc81033d0 0x7f6bc819db70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60860/0 (socket says 172.21.15.3:60860) 2024-09-21T12:30:17.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.520+0000 7f6bcdce4640 1 -- 172.21.15.3:0/185144442 learned_addr learned my addr 172.21.15.3:0/185144442 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:30:17.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.520+0000 7f6bce4e5640 1 --2- 172.21.15.3:0/185144442 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6bc8102ab0 0x7f6bc819d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:30:17.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.520+0000 7f6bcdce4640 1 -- 172.21.15.3:0/185144442 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6bc8102ab0 msgr2=0x7f6bc819d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:30:17.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.520+0000 7f6bcdce4640 1 --2- 172.21.15.3:0/185144442 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6bc8102ab0 0x7f6bc819d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:30:17.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.520+0000 7f6bcdce4640 1 -- 172.21.15.3:0/185144442 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bc81977b0 con 0x7f6bc81033d0 2024-09-21T12:30:17.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.520+0000 7f6bce4e5640 1 --2- 172.21.15.3:0/185144442 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6bc8102ab0 0x7f6bc819d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:30:17.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.520+0000 7f6bcdce4640 1 --2- 172.21.15.3:0/185144442 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6bc81033d0 0x7f6bc819db70 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6bb800d6d0 tx=0x7f6bb800db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:30:17.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.521+0000 7f6bbf7fe640 1 -- 172.21.15.3:0/185144442 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6bb8017070 con 0x7f6bc81033d0 2024-09-21T12:30:17.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.521+0000 7f6bd0749640 1 -- 172.21.15.3:0/185144442 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bc8197aa0 con 0x7f6bc81033d0 2024-09-21T12:30:17.523 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.521+0000 7f6bd0749640 1 -- 172.21.15.3:0/185144442 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bc8198030 con 0x7f6bc81033d0 2024-09-21T12:30:17.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.521+0000 7f6bbf7fe640 1 -- 172.21.15.3:0/185144442 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6bb80054e0 con 0x7f6bc81033d0 2024-09-21T12:30:17.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.521+0000 7f6bbf7fe640 1 -- 172.21.15.3:0/185144442 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6bb8004ae0 con 0x7f6bc81033d0 2024-09-21T12:30:17.524 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.522+0000 7f6bd0749640 1 -- 172.21.15.3:0/185144442 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bac005290 con 0x7f6bc81033d0 2024-09-21T12:30:17.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.523+0000 7f6bbf7fe640 1 -- 172.21.15.3:0/185144442 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f6bb8009820 con 0x7f6bc81033d0 2024-09-21T12:30:17.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.524+0000 7f6bbf7fe640 1 --2- 172.21.15.3:0/185144442 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f6bb407af80 0x7f6bb407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:30:17.525 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.524+0000 7f6bbf7fe640 1 -- 172.21.15.3:0/185144442 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6414+0+0 (secure 0 0 0) 0x7f6bb809db10 con 0x7f6bc81033d0 2024-09-21T12:30:17.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.524+0000 7f6bce4e5640 1 --2- 172.21.15.3:0/185144442 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f6bb407af80 0x7f6bb407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:30:17.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.524+0000 7f6bce4e5640 1 --2- 172.21.15.3:0/185144442 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f6bb407af80 0x7f6bb407d440 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6bc4000c00 tx=0x7f6bc4031400 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:30:17.530 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.529+0000 7f6bbf7fe640 1 -- 172.21.15.3:0/185144442 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6bb8069090 con 0x7f6bc81033d0 2024-09-21T12:30:17.727 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.725+0000 7f6bd0749640 1 -- 172.21.15.3:0/185144442 --> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f6bac000bc0 con 0x7f6bb407af80 2024-09-21T12:30:17.737 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.735+0000 7f6bbf7fe640 1 -- 172.21.15.3:0/185144442 <== mgr.14756 v2:172.21.15.3:6800/1284098095 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f6bac000bc0 con 0x7f6bb407af80 2024-09-21T12:30:17.737 INFO:teuthology.orchestra.run.smithi003.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:30:17.737 INFO:teuthology.orchestra.run.smithi003.stdout:alertmanager.smithi003 smithi003 *:9093,9094 running (6m) 40s ago 17m 19.0M - 0.27.0 11f11916f8cd 14880018dfd3 2024-09-21T12:30:17.737 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-exporter.smithi003 smithi003 running (9m) 40s ago 18m 9101k - 19.1.1-373-g4e45e6b4 164465d2334a 0c9ad60a4f5a 2024-09-21T12:30:17.737 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-exporter.smithi192 smithi192 running (9m) 14s ago 17m 9059k - 19.1.1-373-g4e45e6b4 164465d2334a d5be8a6e120f 2024-09-21T12:30:17.737 INFO:teuthology.orchestra.run.smithi003.stdout:crash.smithi003 smithi003 running (4m) 40s ago 18m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 0ada67250dba 2024-09-21T12:30:17.737 INFO:teuthology.orchestra.run.smithi003.stdout:crash.smithi192 smithi192 running (4m) 14s ago 17m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 52e279085b2e 2024-09-21T12:30:17.738 INFO:teuthology.orchestra.run.smithi003.stdout:grafana.smithi003 smithi003 *:3000 running (6m) 40s ago 17m 80.4M - 10.4.8 5aad1d7cf004 19e26b3cb585 2024-09-21T12:30:17.738 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi003.ebjgyl smithi003 running (67s) 40s ago 12m 13.1M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 8579e4fc4f05 2024-09-21T12:30:17.738 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi003.gfkngj smithi003 running (45s) 40s ago 12m 13.3M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 7b3dec4f76e2 2024-09-21T12:30:17.738 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi192.ktdqns smithi192 running (12m) 14s ago 12m 87.6M - 19.1.1-373-g4e45e6b4 164465d2334a 495c73fb3bb0 2024-09-21T12:30:17.738 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi192.ywqqxe smithi192 running (22s) 14s ago 12m 13.0M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 b8882783ef02 2024-09-21T12:30:17.738 INFO:teuthology.orchestra.run.smithi003.stdout:mgr.smithi003.wztftl smithi003 *:8443,9283,8765 running (8m) 40s ago 19m 529M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 8ce0e66fd369 2024-09-21T12:30:17.738 INFO:teuthology.orchestra.run.smithi003.stdout:mgr.smithi192.qsaprd smithi192 *:8443,9283,8765 running (7m) 14s ago 17m 459M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 002a6171dd47 2024-09-21T12:30:17.738 INFO:teuthology.orchestra.run.smithi003.stdout:mon.smithi003 smithi003 running (5m) 40s ago 19m 49.0M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 4f2b2b2daf19 2024-09-21T12:30:17.738 INFO:teuthology.orchestra.run.smithi003.stdout:mon.smithi192 smithi192 running (5m) 14s ago 17m 42.6M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 11edc5c1baba 2024-09-21T12:30:17.738 INFO:teuthology.orchestra.run.smithi003.stdout:node-exporter.smithi003 smithi003 *:9100 running (7m) 40s ago 18m 9.78M - 1.7.0 72c9c2088986 d9cb7ede9060 2024-09-21T12:30:17.738 INFO:teuthology.orchestra.run.smithi003.stdout:node-exporter.smithi192 smithi192 *:9100 running (7m) 14s ago 17m 12.6M - 1.7.0 72c9c2088986 d8ec0acfce7e 2024-09-21T12:30:17.738 INFO:teuthology.orchestra.run.smithi003.stdout:osd.0 smithi003 running (4m) 40s ago 16m 91.2M 1217M 19.3.0-5103-g5c1cdc3c 8f4d013db793 0f2234f333ec 2024-09-21T12:30:17.738 INFO:teuthology.orchestra.run.smithi003.stdout:osd.1 smithi003 running (3m) 40s ago 15m 96.1M 1217M 19.3.0-5103-g5c1cdc3c 8f4d013db793 198ba21d0518 2024-09-21T12:30:17.738 INFO:teuthology.orchestra.run.smithi003.stdout:osd.2 smithi003 running (3m) 40s ago 14m 83.6M 1217M 19.3.0-5103-g5c1cdc3c 8f4d013db793 e630341e13d4 2024-09-21T12:30:17.739 INFO:teuthology.orchestra.run.smithi003.stdout:osd.3 smithi192 running (2m) 14s ago 14m 112M 2240M 19.3.0-5103-g5c1cdc3c 8f4d013db793 1b5fae2f2dd9 2024-09-21T12:30:17.739 INFO:teuthology.orchestra.run.smithi003.stdout:osd.4 smithi192 running (116s) 14s ago 14m 97.1M 2240M 19.3.0-5103-g5c1cdc3c 8f4d013db793 5b1bd4bec479 2024-09-21T12:30:17.739 INFO:teuthology.orchestra.run.smithi003.stdout:osd.5 smithi192 running (81s) 14s ago 13m 92.4M 2240M 19.3.0-5103-g5c1cdc3c 8f4d013db793 584f3f612483 2024-09-21T12:30:17.739 INFO:teuthology.orchestra.run.smithi003.stdout:prometheus.smithi003 smithi003 *:9095 running (7m) 40s ago 17m 56.7M - 2.51.0 1d3b7f56885b 64997a33fbbb 2024-09-21T12:30:17.739 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.738+0000 7f6bd0749640 1 -- 172.21.15.3:0/185144442 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f6bb407af80 msgr2=0x7f6bb407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:30:17.740 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.738+0000 7f6bd0749640 1 --2- 172.21.15.3:0/185144442 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f6bb407af80 0x7f6bb407d440 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6bc4000c00 tx=0x7f6bc4031400 comp rx=0 tx=0).stop 2024-09-21T12:30:17.740 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.738+0000 7f6bd0749640 1 -- 172.21.15.3:0/185144442 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6bc81033d0 msgr2=0x7f6bc819db70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:30:17.740 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.738+0000 7f6bd0749640 1 --2- 172.21.15.3:0/185144442 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6bc81033d0 0x7f6bc819db70 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6bb800d6d0 tx=0x7f6bb800db90 comp rx=0 tx=0).stop 2024-09-21T12:30:17.740 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.738+0000 7f6bd0749640 1 -- 172.21.15.3:0/185144442 shutdown_connections 2024-09-21T12:30:17.740 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.738+0000 7f6bd0749640 1 --2- 172.21.15.3:0/185144442 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f6bb407af80 0x7f6bb407d440 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:30:17.740 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.738+0000 7f6bd0749640 1 --2- 172.21.15.3:0/185144442 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6bc81033d0 0x7f6bc819db70 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:30:17.740 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.738+0000 7f6bd0749640 1 --2- 172.21.15.3:0/185144442 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6bc8102ab0 0x7f6bc819d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:30:17.740 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.738+0000 7f6bd0749640 1 -- 172.21.15.3:0/185144442 >> 172.21.15.3:0/185144442 conn(0x7f6bc80fc550 msgr2=0x7f6bc810aec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:30:17.740 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.738+0000 7f6bd0749640 1 -- 172.21.15.3:0/185144442 shutdown_connections 2024-09-21T12:30:17.740 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.738+0000 7f6bd0749640 1 -- 172.21.15.3:0/185144442 wait complete. 2024-09-21T12:30:17.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.822+0000 7fb4f5130640 1 -- 172.21.15.3:0/3025532860 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb4f01033d0 msgr2=0x7fb4f010b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:30:17.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.822+0000 7fb4f5130640 1 --2- 172.21.15.3:0/3025532860 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb4f01033d0 0x7fb4f010b8c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb4e4009880 tx=0x7fb4e402a530 comp rx=0 tx=0).stop 2024-09-21T12:30:17.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.822+0000 7fb4f5130640 1 -- 172.21.15.3:0/3025532860 shutdown_connections 2024-09-21T12:30:17.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.822+0000 7fb4f5130640 1 --2- 172.21.15.3:0/3025532860 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb4f01033d0 0x7fb4f010b8c0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:30:17.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.822+0000 7fb4f5130640 1 --2- 172.21.15.3:0/3025532860 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb4f0102ab0 0x7fb4f0102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:30:17.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.822+0000 7fb4f5130640 1 -- 172.21.15.3:0/3025532860 >> 172.21.15.3:0/3025532860 conn(0x7fb4f00fc550 msgr2=0x7fb4f00fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:30:17.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.822+0000 7fb4f5130640 1 -- 172.21.15.3:0/3025532860 shutdown_connections 2024-09-21T12:30:17.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.822+0000 7fb4f5130640 1 -- 172.21.15.3:0/3025532860 wait complete. 2024-09-21T12:30:17.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.823+0000 7fb4f5130640 1 Processor -- start 2024-09-21T12:30:17.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.823+0000 7fb4f5130640 1 -- start start 2024-09-21T12:30:17.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.823+0000 7fb4f5130640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb4f0102ab0 0x7fb4f0100710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:30:17.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.823+0000 7fb4f5130640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb4f01033d0 0x7fb4f0100c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:30:17.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.823+0000 7fb4f5130640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fb4f010edc0 con 0x7fb4f0102ab0 2024-09-21T12:30:17.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.823+0000 7fb4f5130640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb4f010ec40 con 0x7fb4f01033d0 2024-09-21T12:30:17.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.824+0000 7fb4eed9d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb4f0102ab0 0x7fb4f0100710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:30:17.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.824+0000 7fb4eed9d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb4f0102ab0 0x7fb4f0100710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60892/0 (socket says 172.21.15.3:60892) 2024-09-21T12:30:17.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.824+0000 7fb4eed9d640 1 -- 172.21.15.3:0/435344562 learned_addr learned my addr 172.21.15.3:0/435344562 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:30:17.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.824+0000 7fb4ee59c640 1 --2- 172.21.15.3:0/435344562 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb4f01033d0 0x7fb4f0100c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:30:17.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.824+0000 7fb4eed9d640 1 -- 172.21.15.3:0/435344562 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb4f01033d0 msgr2=0x7fb4f0100c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:30:17.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.824+0000 7fb4eed9d640 1 --2- 172.21.15.3:0/435344562 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb4f01033d0 0x7fb4f0100c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:30:17.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.824+0000 7fb4eed9d640 1 -- 172.21.15.3:0/435344562 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4f0101190 con 0x7fb4f0102ab0 2024-09-21T12:30:17.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.824+0000 7fb4ee59c640 1 --2- 172.21.15.3:0/435344562 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb4f01033d0 0x7fb4f0100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:30:17.826 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.824+0000 7fb4eed9d640 1 --2- 172.21.15.3:0/435344562 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb4f0102ab0 0x7fb4f0100710 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb4e000d8d0 tx=0x7fb4e000dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:30:17.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.824+0000 7fb4d7fff640 1 -- 172.21.15.3:0/435344562 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb4e0017030 con 0x7fb4f0102ab0 2024-09-21T12:30:17.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.824+0000 7fb4d7fff640 1 -- 172.21.15.3:0/435344562 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb4e0004020 con 0x7fb4f0102ab0 2024-09-21T12:30:17.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.824+0000 7fb4f5130640 1 -- 172.21.15.3:0/435344562 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4f0101480 con 0x7fb4f0102ab0 2024-09-21T12:30:17.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.824+0000 7fb4d7fff640 1 -- 172.21.15.3:0/435344562 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb4e00047a0 con 0x7fb4f0102ab0 2024-09-21T12:30:17.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.825+0000 7fb4f5130640 1 -- 172.21.15.3:0/435344562 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4f01a3e10 con 0x7fb4f0102ab0 2024-09-21T12:30:17.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.826+0000 7fb4f5130640 1 -- 172.21.15.3:0/435344562 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4f006a580 con 0x7fb4f0102ab0 2024-09-21T12:30:17.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.827+0000 7fb4d7fff640 1 -- 172.21.15.3:0/435344562 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7fb4e00041d0 con 0x7fb4f0102ab0 2024-09-21T12:30:17.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.827+0000 7fb4d7fff640 1 --2- 172.21.15.3:0/435344562 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fb4d807af80 0x7fb4d807d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:30:17.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.828+0000 7fb4d7fff640 1 -- 172.21.15.3:0/435344562 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6414+0+0 (secure 0 0 0) 0x7fb4e0018070 con 0x7fb4f0102ab0 2024-09-21T12:30:17.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.828+0000 7fb4ee59c640 1 --2- 172.21.15.3:0/435344562 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fb4d807af80 0x7fb4d807d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:30:17.829 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.828+0000 7fb4ee59c640 1 --2- 172.21.15.3:0/435344562 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fb4d807af80 0x7fb4d807d440 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb4f01021a0 tx=0x7fb4e4031400 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:30:17.833 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:17.832+0000 7fb4d7fff640 1 -- 172.21.15.3:0/435344562 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb4e0069430 con 0x7fb4f0102ab0 2024-09-21T12:30:18.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:17 smithi003 ceph-mon[108723]: pgmap v285: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 7 op/s 2024-09-21T12:30:18.099 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.098+0000 7fb4f5130640 1 -- 172.21.15.3:0/435344562 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fb4f01a4130 con 0x7fb4f0102ab0 2024-09-21T12:30:18.100 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.098+0000 7fb4d7fff640 1 -- 172.21.15.3:0/435344562 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7fb4e006e2e0 con 0x7fb4f0102ab0 2024-09-21T12:30:18.100 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-21T12:30:18.100 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": { 2024-09-21T12:30:18.100 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:30:18.100 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:30:18.100 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": { 2024-09-21T12:30:18.100 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:30:18.100 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:30:18.100 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": { 2024-09-21T12:30:18.100 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 6 2024-09-21T12:30:18.100 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:30:18.100 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": { 2024-09-21T12:30:18.101 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 3 2024-09-21T12:30:18.101 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:30:18.101 INFO:teuthology.orchestra.run.smithi003.stdout: "overall": { 2024-09-21T12:30:18.101 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 13 2024-09-21T12:30:18.101 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-21T12:30:18.101 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-21T12:30:18.103 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.101+0000 7fb4f5130640 1 -- 172.21.15.3:0/435344562 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fb4d807af80 msgr2=0x7fb4d807d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:30:18.103 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.101+0000 7fb4f5130640 1 --2- 172.21.15.3:0/435344562 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fb4d807af80 0x7fb4d807d440 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fb4f01021a0 tx=0x7fb4e4031400 comp rx=0 tx=0).stop 2024-09-21T12:30:18.103 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.101+0000 7fb4f5130640 1 -- 172.21.15.3:0/435344562 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb4f0102ab0 msgr2=0x7fb4f0100710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:30:18.103 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.101+0000 7fb4f5130640 1 --2- 172.21.15.3:0/435344562 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb4f0102ab0 0x7fb4f0100710 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fb4e000d8d0 tx=0x7fb4e000dd90 comp rx=0 tx=0).stop 2024-09-21T12:30:18.103 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.101+0000 7fb4f5130640 1 -- 172.21.15.3:0/435344562 shutdown_connections 2024-09-21T12:30:18.103 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.101+0000 7fb4f5130640 1 --2- 172.21.15.3:0/435344562 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fb4d807af80 0x7fb4d807d440 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:30:18.103 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.101+0000 7fb4f5130640 1 --2- 172.21.15.3:0/435344562 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb4f01033d0 0x7fb4f0100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:30:18.103 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.101+0000 7fb4f5130640 1 --2- 172.21.15.3:0/435344562 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb4f0102ab0 0x7fb4f0100710 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:30:18.104 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.101+0000 7fb4f5130640 1 -- 172.21.15.3:0/435344562 >> 172.21.15.3:0/435344562 conn(0x7fb4f00fc550 msgr2=0x7fb4f010aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:30:18.104 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.101+0000 7fb4f5130640 1 -- 172.21.15.3:0/435344562 shutdown_connections 2024-09-21T12:30:18.104 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.101+0000 7fb4f5130640 1 -- 172.21.15.3:0/435344562 wait complete. 2024-09-21T12:30:18.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.185+0000 7f64b6cfd640 1 -- 172.21.15.3:0/1662775856 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f64b01033d0 msgr2=0x7f64b010b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:30:18.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.185+0000 7f64b6cfd640 1 --2- 172.21.15.3:0/1662775856 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f64b01033d0 0x7f64b010b8c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f649c009880 tx=0x7f649c02a530 comp rx=0 tx=0).stop 2024-09-21T12:30:18.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.185+0000 7f64b6cfd640 1 -- 172.21.15.3:0/1662775856 shutdown_connections 2024-09-21T12:30:18.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.185+0000 7f64b6cfd640 1 --2- 172.21.15.3:0/1662775856 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f64b01033d0 0x7f64b010b8c0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:30:18.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.185+0000 7f64b6cfd640 1 --2- 172.21.15.3:0/1662775856 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f64b0102ab0 0x7f64b0102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:30:18.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.185+0000 7f64b6cfd640 1 -- 172.21.15.3:0/1662775856 >> 172.21.15.3:0/1662775856 conn(0x7f64b00fc550 msgr2=0x7f64b00fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:30:18.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.185+0000 7f64b6cfd640 1 -- 172.21.15.3:0/1662775856 shutdown_connections 2024-09-21T12:30:18.187 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.185+0000 7f64b6cfd640 1 -- 172.21.15.3:0/1662775856 wait complete. 2024-09-21T12:30:18.188 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.186+0000 7f64b6cfd640 1 Processor -- start 2024-09-21T12:30:18.188 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.186+0000 7f64b6cfd640 1 -- start start 2024-09-21T12:30:18.189 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.186+0000 7f64b6cfd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f64b0102ab0 0x7f64b0100710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:30:18.189 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.186+0000 7f64b6cfd640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f64b01033d0 0x7f64b0100c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:30:18.189 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.186+0000 7f64b6cfd640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f64b010edc0 con 0x7f64b0102ab0 2024-09-21T12:30:18.189 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.186+0000 7f64b6cfd640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f64b010ec40 con 0x7f64b01033d0 2024-09-21T12:30:18.189 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.186+0000 7f64b4a99640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f64b0102ab0 0x7f64b0100710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:30:18.189 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.186+0000 7f64b4a99640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f64b0102ab0 0x7f64b0100710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60920/0 (socket says 172.21.15.3:60920) 2024-09-21T12:30:18.189 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.186+0000 7f64b4a99640 1 -- 172.21.15.3:0/309637532 learned_addr learned my addr 172.21.15.3:0/309637532 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:30:18.189 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.187+0000 7f64affff640 1 --2- 172.21.15.3:0/309637532 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f64b01033d0 0x7f64b0100c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:30:18.189 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.187+0000 7f64b4a99640 1 -- 172.21.15.3:0/309637532 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f64b01033d0 msgr2=0x7f64b0100c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:30:18.189 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.187+0000 7f64b4a99640 1 --2- 172.21.15.3:0/309637532 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f64b01033d0 0x7f64b0100c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:30:18.189 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.187+0000 7f64b4a99640 1 -- 172.21.15.3:0/309637532 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64b0101190 con 0x7f64b0102ab0 2024-09-21T12:30:18.189 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.187+0000 7f64b4a99640 1 --2- 172.21.15.3:0/309637532 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f64b0102ab0 0x7f64b0100710 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f64a400d8d0 tx=0x7f64a400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:30:18.189 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.187+0000 7f64adffb640 1 -- 172.21.15.3:0/309637532 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f64a4017070 con 0x7f64b0102ab0 2024-09-21T12:30:18.190 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.187+0000 7f64adffb640 1 -- 172.21.15.3:0/309637532 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f64a4010460 con 0x7f64b0102ab0 2024-09-21T12:30:18.190 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.187+0000 7f64b6cfd640 1 -- 172.21.15.3:0/309637532 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64b0101480 con 0x7f64b0102ab0 2024-09-21T12:30:18.190 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.187+0000 7f64adffb640 1 -- 172.21.15.3:0/309637532 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f64a400f5f0 con 0x7f64b0102ab0 2024-09-21T12:30:18.190 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.188+0000 7f64b6cfd640 1 -- 172.21.15.3:0/309637532 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64b01a3e10 con 0x7f64b0102ab0 2024-09-21T12:30:18.191 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.189+0000 7f64b6cfd640 1 -- 172.21.15.3:0/309637532 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64b006a580 con 0x7f64b0102ab0 2024-09-21T12:30:18.191 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.189+0000 7f64adffb640 1 -- 172.21.15.3:0/309637532 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f64a4009a30 con 0x7f64b0102ab0 2024-09-21T12:30:18.191 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.190+0000 7f64adffb640 1 --2- 172.21.15.3:0/309637532 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f64a007af40 0x7f64a007d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:30:18.191 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.190+0000 7f64adffb640 1 -- 172.21.15.3:0/309637532 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6414+0+0 (secure 0 0 0) 0x7f64a409df10 con 0x7f64b0102ab0 2024-09-21T12:30:18.191 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.190+0000 7f64affff640 1 --2- 172.21.15.3:0/309637532 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f64a007af40 0x7f64a007d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:30:18.192 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.191+0000 7f64affff640 1 --2- 172.21.15.3:0/309637532 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f64a007af40 0x7f64a007d400 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f64b01021a0 tx=0x7f649c031400 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:30:18.196 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.194+0000 7f64adffb640 1 -- 172.21.15.3:0/309637532 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f64a4069410 con 0x7f64b0102ab0 2024-09-21T12:30:18.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:17 smithi192 ceph-mon[80326]: pgmap v285: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 7 op/s 2024-09-21T12:30:18.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.444+0000 7f64b6cfd640 1 -- 172.21.15.3:0/309637532 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f64b01a4100 con 0x7f64b0102ab0 2024-09-21T12:30:18.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.445+0000 7f64adffb640 1 -- 172.21.15.3:0/309637532 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 29 v29) ==== 76+0+1828 (secure 0 0 0) 0x7f64a406e2c0 con 0x7f64b0102ab0 2024-09-21T12:30:18.446 INFO:teuthology.orchestra.run.smithi003.stdout:e29 2024-09-21T12:30:18.447 INFO:teuthology.orchestra.run.smithi003.stdout:btime 2024-09-21T12:30:09:936710+0000 2024-09-21T12:30:18.447 INFO:teuthology.orchestra.run.smithi003.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T12:30:18.447 INFO:teuthology.orchestra.run.smithi003.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:30:18.447 INFO:teuthology.orchestra.run.smithi003.stdout:legacy client fscid: 1 2024-09-21T12:30:18.447 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:30:18.447 INFO:teuthology.orchestra.run.smithi003.stdout:Filesystem 'cephfs' (1) 2024-09-21T12:30:18.447 INFO:teuthology.orchestra.run.smithi003.stdout:fs_name cephfs 2024-09-21T12:30:18.447 INFO:teuthology.orchestra.run.smithi003.stdout:epoch 29 2024-09-21T12:30:18.447 INFO:teuthology.orchestra.run.smithi003.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T12:30:18.447 INFO:teuthology.orchestra.run.smithi003.stdout:created 2024-09-21T12:17:38.260099+0000 2024-09-21T12:30:18.447 INFO:teuthology.orchestra.run.smithi003.stdout:modified 2024-09-21T12:30:09.936694+0000 2024-09-21T12:30:18.447 INFO:teuthology.orchestra.run.smithi003.stdout:tableserver 0 2024-09-21T12:30:18.447 INFO:teuthology.orchestra.run.smithi003.stdout:root 0 2024-09-21T12:30:18.447 INFO:teuthology.orchestra.run.smithi003.stdout:session_timeout 60 2024-09-21T12:30:18.448 INFO:teuthology.orchestra.run.smithi003.stdout:session_autoclose 300 2024-09-21T12:30:18.448 INFO:teuthology.orchestra.run.smithi003.stdout:max_file_size 1099511627776 2024-09-21T12:30:18.448 INFO:teuthology.orchestra.run.smithi003.stdout:max_xattr_size 65536 2024-09-21T12:30:18.448 INFO:teuthology.orchestra.run.smithi003.stdout:required_client_features {} 2024-09-21T12:30:18.448 INFO:teuthology.orchestra.run.smithi003.stdout:last_failure 0 2024-09-21T12:30:18.448 INFO:teuthology.orchestra.run.smithi003.stdout:last_failure_osd_epoch 81 2024-09-21T12:30:18.448 INFO:teuthology.orchestra.run.smithi003.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:30:18.448 INFO:teuthology.orchestra.run.smithi003.stdout:max_mds 1 2024-09-21T12:30:18.448 INFO:teuthology.orchestra.run.smithi003.stdout:in 0 2024-09-21T12:30:18.448 INFO:teuthology.orchestra.run.smithi003.stdout:up {0=34314} 2024-09-21T12:30:18.448 INFO:teuthology.orchestra.run.smithi003.stdout:failed 2024-09-21T12:30:18.448 INFO:teuthology.orchestra.run.smithi003.stdout:damaged 2024-09-21T12:30:18.448 INFO:teuthology.orchestra.run.smithi003.stdout:stopped 2024-09-21T12:30:18.448 INFO:teuthology.orchestra.run.smithi003.stdout:data_pools [3] 2024-09-21T12:30:18.448 INFO:teuthology.orchestra.run.smithi003.stdout:metadata_pool 2 2024-09-21T12:30:18.449 INFO:teuthology.orchestra.run.smithi003.stdout:inline_data enabled 2024-09-21T12:30:18.449 INFO:teuthology.orchestra.run.smithi003.stdout:balancer 2024-09-21T12:30:18.449 INFO:teuthology.orchestra.run.smithi003.stdout:bal_rank_mask -1 2024-09-21T12:30:18.449 INFO:teuthology.orchestra.run.smithi003.stdout:standby_count_wanted 1 2024-09-21T12:30:18.449 INFO:teuthology.orchestra.run.smithi003.stdout:qdb_cluster leader: 0 members: 2024-09-21T12:30:18.449 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.cephfs.smithi003.ebjgyl{0:34314} state up:replay seq 1 join_fscid=1 addr [v2:172.21.15.3:6826/1616995236,v1:172.21.15.3:6827/1616995236] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:30:18.449 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:30:18.449 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:30:18.449 INFO:teuthology.orchestra.run.smithi003.stdout:Standby daemons: 2024-09-21T12:30:18.449 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:30:18.449 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.cephfs.smithi003.gfkngj{-1:34346} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.3:6828/1282732153,v1:172.21.15.3:6829/1282732153] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:30:18.449 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.cephfs.smithi192.ywqqxe{-1:44321} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.192:6824/3113020545,v1:172.21.15.192:6825/3113020545] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:30:18.450 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 29 2024-09-21T12:30:18.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.447+0000 7f64b6cfd640 1 -- 172.21.15.3:0/309637532 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f64a007af40 msgr2=0x7f64a007d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:30:18.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.447+0000 7f64b6cfd640 1 --2- 172.21.15.3:0/309637532 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f64a007af40 0x7f64a007d400 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f64b01021a0 tx=0x7f649c031400 comp rx=0 tx=0).stop 2024-09-21T12:30:18.450 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.447+0000 7f64b6cfd640 1 -- 172.21.15.3:0/309637532 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f64b0102ab0 msgr2=0x7f64b0100710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:30:18.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.447+0000 7f64b6cfd640 1 --2- 172.21.15.3:0/309637532 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f64b0102ab0 0x7f64b0100710 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f64a400d8d0 tx=0x7f64a400dd90 comp rx=0 tx=0).stop 2024-09-21T12:30:18.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.447+0000 7f64b6cfd640 1 -- 172.21.15.3:0/309637532 shutdown_connections 2024-09-21T12:30:18.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.448+0000 7f64b6cfd640 1 --2- 172.21.15.3:0/309637532 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f64a007af40 0x7f64a007d400 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:30:18.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.448+0000 7f64b6cfd640 1 --2- 172.21.15.3:0/309637532 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f64b01033d0 0x7f64b0100c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:30:18.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.448+0000 7f64b6cfd640 1 --2- 172.21.15.3:0/309637532 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f64b0102ab0 0x7f64b0100710 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:30:18.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.448+0000 7f64b6cfd640 1 -- 172.21.15.3:0/309637532 >> 172.21.15.3:0/309637532 conn(0x7f64b00fc550 msgr2=0x7f64b010aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:30:18.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.448+0000 7f64b6cfd640 1 -- 172.21.15.3:0/309637532 shutdown_connections 2024-09-21T12:30:18.451 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.448+0000 7f64b6cfd640 1 -- 172.21.15.3:0/309637532 wait complete. 2024-09-21T12:30:18.536 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.534+0000 7f2f0e68d640 1 -- 172.21.15.3:0/2510253315 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2f081033d0 msgr2=0x7f2f0810b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:30:18.536 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.534+0000 7f2f0e68d640 1 --2- 172.21.15.3:0/2510253315 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2f081033d0 0x7f2f0810b8c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f2efc009880 tx=0x7f2efc02a530 comp rx=0 tx=0).stop 2024-09-21T12:30:18.536 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.534+0000 7f2f0e68d640 1 -- 172.21.15.3:0/2510253315 shutdown_connections 2024-09-21T12:30:18.536 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.534+0000 7f2f0e68d640 1 --2- 172.21.15.3:0/2510253315 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2f081033d0 0x7f2f0810b8c0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:30:18.536 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.534+0000 7f2f0e68d640 1 --2- 172.21.15.3:0/2510253315 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f08102ab0 0x7f2f08102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:30:18.536 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.534+0000 7f2f0e68d640 1 -- 172.21.15.3:0/2510253315 >> 172.21.15.3:0/2510253315 conn(0x7f2f080fc550 msgr2=0x7f2f080fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:30:18.536 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.534+0000 7f2f0e68d640 1 -- 172.21.15.3:0/2510253315 shutdown_connections 2024-09-21T12:30:18.536 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.534+0000 7f2f0e68d640 1 -- 172.21.15.3:0/2510253315 wait complete. 2024-09-21T12:30:18.536 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.535+0000 7f2f0e68d640 1 Processor -- start 2024-09-21T12:30:18.537 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.535+0000 7f2f0e68d640 1 -- start start 2024-09-21T12:30:18.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.535+0000 7f2f0e68d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f08102ab0 0x7f2f08100710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:30:18.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.535+0000 7f2f0e68d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2f081033d0 0x7f2f08100c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:30:18.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.535+0000 7f2f0e68d640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f2f0810edc0 con 0x7f2f081033d0 2024-09-21T12:30:18.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.535+0000 7f2f0e68d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2f0810ec40 con 0x7f2f08102ab0 2024-09-21T12:30:18.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.535+0000 7f2f077fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2f081033d0 0x7f2f08100c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:30:18.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.535+0000 7f2f077fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2f081033d0 0x7f2f08100c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60936/0 (socket says 172.21.15.3:60936) 2024-09-21T12:30:18.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.535+0000 7f2f077fe640 1 -- 172.21.15.3:0/1250883417 learned_addr learned my addr 172.21.15.3:0/1250883417 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:30:18.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.535+0000 7f2f07fff640 1 --2- 172.21.15.3:0/1250883417 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f08102ab0 0x7f2f08100710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:30:18.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.535+0000 7f2f077fe640 1 -- 172.21.15.3:0/1250883417 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f08102ab0 msgr2=0x7f2f08100710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:30:18.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.535+0000 7f2f077fe640 1 --2- 172.21.15.3:0/1250883417 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f08102ab0 0x7f2f08100710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:30:18.538 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.535+0000 7f2f077fe640 1 -- 172.21.15.3:0/1250883417 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f08101190 con 0x7f2f081033d0 2024-09-21T12:30:18.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.536+0000 7f2f077fe640 1 --2- 172.21.15.3:0/1250883417 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2f081033d0 0x7f2f08100c50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2efc031460 tx=0x7f2efc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:30:18.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.536+0000 7f2f057fa640 1 -- 172.21.15.3:0/1250883417 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2efc03f070 con 0x7f2f081033d0 2024-09-21T12:30:18.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.536+0000 7f2f057fa640 1 -- 172.21.15.3:0/1250883417 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2efc004ac0 con 0x7f2f081033d0 2024-09-21T12:30:18.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.536+0000 7f2f0e68d640 1 -- 172.21.15.3:0/1250883417 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f08101420 con 0x7f2f081033d0 2024-09-21T12:30:18.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.536+0000 7f2f057fa640 1 -- 172.21.15.3:0/1250883417 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2efc035030 con 0x7f2f081033d0 2024-09-21T12:30:18.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.536+0000 7f2f0e68d640 1 -- 172.21.15.3:0/1250883417 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f081a3d00 con 0x7f2f081033d0 2024-09-21T12:30:18.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.537+0000 7f2f0e68d640 1 -- 172.21.15.3:0/1250883417 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f0806a580 con 0x7f2f081033d0 2024-09-21T12:30:18.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.538+0000 7f2f057fa640 1 -- 172.21.15.3:0/1250883417 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f2efc042070 con 0x7f2f081033d0 2024-09-21T12:30:18.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.538+0000 7f2f057fa640 1 --2- 172.21.15.3:0/1250883417 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f2ef007af80 0x7f2ef007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:30:18.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.538+0000 7f2f057fa640 1 -- 172.21.15.3:0/1250883417 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6414+0+0 (secure 0 0 0) 0x7f2efc0bea30 con 0x7f2f081033d0 2024-09-21T12:30:18.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.538+0000 7f2f07fff640 1 --2- 172.21.15.3:0/1250883417 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f2ef007af80 0x7f2ef007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:30:18.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.539+0000 7f2f07fff640 1 --2- 172.21.15.3:0/1250883417 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f2ef007af80 0x7f2ef007d440 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2ef8005e10 tx=0x7f2ef8005da0 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:30:18.544 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.543+0000 7f2f057fa640 1 -- 172.21.15.3:0/1250883417 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2efc089fb0 con 0x7f2f081033d0 2024-09-21T12:30:18.750 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.748+0000 7f2f0e68d640 1 -- 172.21.15.3:0/1250883417 --> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7f2f0810b5c0 con 0x7f2ef007af80 2024-09-21T12:30:18.751 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.750+0000 7f2f057fa640 1 -- 172.21.15.3:0/1250883417 <== mgr.14756 v2:172.21.15.3:6800/1284098095 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+416 (secure 0 0 0) 0x7f2f0810b5c0 con 0x7f2ef007af80 2024-09-21T12:30:18.751 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-21T12:30:18.752 INFO:teuthology.orchestra.run.smithi003.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472", 2024-09-21T12:30:18.752 INFO:teuthology.orchestra.run.smithi003.stdout: "in_progress": true, 2024-09-21T12:30:18.752 INFO:teuthology.orchestra.run.smithi003.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-21T12:30:18.752 INFO:teuthology.orchestra.run.smithi003.stdout: "services_complete": [ 2024-09-21T12:30:18.752 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr", 2024-09-21T12:30:18.752 INFO:teuthology.orchestra.run.smithi003.stdout: "mon", 2024-09-21T12:30:18.752 INFO:teuthology.orchestra.run.smithi003.stdout: "crash", 2024-09-21T12:30:18.752 INFO:teuthology.orchestra.run.smithi003.stdout: "osd" 2024-09-21T12:30:18.752 INFO:teuthology.orchestra.run.smithi003.stdout: ], 2024-09-21T12:30:18.752 INFO:teuthology.orchestra.run.smithi003.stdout: "progress": "15/23 daemons upgraded", 2024-09-21T12:30:18.752 INFO:teuthology.orchestra.run.smithi003.stdout: "message": "Currently upgrading mds daemons", 2024-09-21T12:30:18.752 INFO:teuthology.orchestra.run.smithi003.stdout: "is_paused": false 2024-09-21T12:30:18.752 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-21T12:30:18.754 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.752+0000 7f2f0e68d640 1 -- 172.21.15.3:0/1250883417 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f2ef007af80 msgr2=0x7f2ef007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:30:18.754 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.752+0000 7f2f0e68d640 1 --2- 172.21.15.3:0/1250883417 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f2ef007af80 0x7f2ef007d440 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f2ef8005e10 tx=0x7f2ef8005da0 comp rx=0 tx=0).stop 2024-09-21T12:30:18.754 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.752+0000 7f2f0e68d640 1 -- 172.21.15.3:0/1250883417 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2f081033d0 msgr2=0x7f2f08100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:30:18.754 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.752+0000 7f2f0e68d640 1 --2- 172.21.15.3:0/1250883417 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2f081033d0 0x7f2f08100c50 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2efc031460 tx=0x7f2efc0046c0 comp rx=0 tx=0).stop 2024-09-21T12:30:18.754 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.752+0000 7f2f0e68d640 1 -- 172.21.15.3:0/1250883417 shutdown_connections 2024-09-21T12:30:18.755 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.752+0000 7f2f0e68d640 1 --2- 172.21.15.3:0/1250883417 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f2ef007af80 0x7f2ef007d440 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:30:18.755 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.752+0000 7f2f0e68d640 1 --2- 172.21.15.3:0/1250883417 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2f081033d0 0x7f2f08100c50 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:30:18.755 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.752+0000 7f2f0e68d640 1 --2- 172.21.15.3:0/1250883417 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2f08102ab0 0x7f2f08100710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:30:18.755 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.752+0000 7f2f0e68d640 1 -- 172.21.15.3:0/1250883417 >> 172.21.15.3:0/1250883417 conn(0x7f2f080fc550 msgr2=0x7f2f0810aeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:30:18.755 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.752+0000 7f2f0e68d640 1 -- 172.21.15.3:0/1250883417 shutdown_connections 2024-09-21T12:30:18.755 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.752+0000 7f2f0e68d640 1 -- 172.21.15.3:0/1250883417 wait complete. 2024-09-21T12:30:18.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.836+0000 7f1feec69640 1 -- 172.21.15.3:0/1778073973 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1fe8100800 msgr2=0x7f1fe8100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:30:18.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.836+0000 7f1feec69640 1 --2- 172.21.15.3:0/1778073973 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1fe8100800 0x7f1fe8100c60 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f1fd4009880 tx=0x7f1fd402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:30:18.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.836+0000 7f1feec69640 1 -- 172.21.15.3:0/1778073973 shutdown_connections 2024-09-21T12:30:18.837 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.836+0000 7f1feec69640 1 --2- 172.21.15.3:0/1778073973 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1fe8100800 0x7f1fe8100c60 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:30:18.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.836+0000 7f1feec69640 1 --2- 172.21.15.3:0/1778073973 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fe8106800 0x7f1fe8106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:30:18.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.836+0000 7f1feec69640 1 -- 172.21.15.3:0/1778073973 >> 172.21.15.3:0/1778073973 conn(0x7f1fe80fc520 msgr2=0x7f1fe80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:30:18.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.836+0000 7f1feec69640 1 -- 172.21.15.3:0/1778073973 shutdown_connections 2024-09-21T12:30:18.838 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.836+0000 7f1feec69640 1 -- 172.21.15.3:0/1778073973 wait complete. 2024-09-21T12:30:18.839 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.836+0000 7f1feec69640 1 Processor -- start 2024-09-21T12:30:18.839 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.836+0000 7f1feec69640 1 -- start start 2024-09-21T12:30:18.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.837+0000 7f1feec69640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fe8100800 0x7f1fe819d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:30:18.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.837+0000 7f1feec69640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1fe8106800 0x7f1fe819dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:30:18.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.837+0000 7f1feec69640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f1fe810dcb0 con 0x7f1fe8106800 2024-09-21T12:30:18.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.837+0000 7f1feec69640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f1fe810db30 con 0x7f1fe8100800 2024-09-21T12:30:18.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.837+0000 7f1fe7fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1fe8106800 0x7f1fe819dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:30:18.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.837+0000 7f1fe7fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1fe8106800 0x7f1fe819dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:60946/0 (socket says 172.21.15.3:60946) 2024-09-21T12:30:18.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.837+0000 7f1fe7fff640 1 -- 172.21.15.3:0/3649035549 learned_addr learned my addr 172.21.15.3:0/3649035549 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:30:18.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.837+0000 7f1feca05640 1 --2- 172.21.15.3:0/3649035549 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fe8100800 0x7f1fe819d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:30:18.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.837+0000 7f1fe7fff640 1 -- 172.21.15.3:0/3649035549 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fe8100800 msgr2=0x7f1fe819d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:30:18.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.837+0000 7f1fe7fff640 1 --2- 172.21.15.3:0/3649035549 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fe8100800 0x7f1fe819d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:30:18.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.837+0000 7f1fe7fff640 1 -- 172.21.15.3:0/3649035549 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fe81977f0 con 0x7f1fe8106800 2024-09-21T12:30:18.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.837+0000 7f1feca05640 1 --2- 172.21.15.3:0/3649035549 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fe8100800 0x7f1fe819d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:30:18.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.837+0000 7f1fe7fff640 1 --2- 172.21.15.3:0/3649035549 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1fe8106800 0x7f1fe819dbb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1fd4031460 tx=0x7f1fd40048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:30:18.840 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.837+0000 7f1fe5ffb640 1 -- 172.21.15.3:0/3649035549 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1fd403f070 con 0x7f1fe8106800 2024-09-21T12:30:18.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.837+0000 7f1feec69640 1 -- 172.21.15.3:0/3649035549 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fe8197a80 con 0x7f1fe8106800 2024-09-21T12:30:18.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.837+0000 7f1fe5ffb640 1 -- 172.21.15.3:0/3649035549 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1fd4004cf0 con 0x7f1fe8106800 2024-09-21T12:30:18.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.837+0000 7f1fe5ffb640 1 -- 172.21.15.3:0/3649035549 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1fd4035030 con 0x7f1fe8106800 2024-09-21T12:30:18.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.838+0000 7f1feec69640 1 -- 172.21.15.3:0/3649035549 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fe8197fb0 con 0x7f1fe8106800 2024-09-21T12:30:18.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.839+0000 7f1feec69640 1 -- 172.21.15.3:0/3649035549 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fe8101f40 con 0x7f1fe8106800 2024-09-21T12:30:18.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.839+0000 7f1fe5ffb640 1 -- 172.21.15.3:0/3649035549 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f1fd4042070 con 0x7f1fe8106800 2024-09-21T12:30:18.841 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.840+0000 7f1fe5ffb640 1 --2- 172.21.15.3:0/3649035549 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f1fd807af30 0x7f1fd807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:30:18.842 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.840+0000 7f1fe5ffb640 1 -- 172.21.15.3:0/3649035549 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6414+0+0 (secure 0 0 0) 0x7f1fd40bec20 con 0x7f1fe8106800 2024-09-21T12:30:18.842 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.840+0000 7f1feca05640 1 --2- 172.21.15.3:0/3649035549 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f1fd807af30 0x7f1fd807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:30:18.842 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.840+0000 7f1feca05640 1 --2- 172.21.15.3:0/3649035549 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f1fd807af30 0x7f1fd807d3f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc0058c0 tx=0x7f1fdc005ec0 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:30:18.846 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:18.844+0000 7f1fe5ffb640 1 -- 172.21.15.3:0/3649035549 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1fd408a0c0 con 0x7f1fe8106800 2024-09-21T12:30:19.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:18 smithi003 ceph-mon[108723]: from='client.34380 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:30:19.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:18 smithi003 ceph-mon[108723]: from='client.34384 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:30:19.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:18 smithi003 ceph-mon[108723]: from='client.34388 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:30:19.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:18 smithi003 ceph-mon[108723]: from='client.? 172.21.15.3:0/435344562' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:30:19.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:18 smithi003 ceph-mon[108723]: from='client.? 172.21.15.3:0/309637532' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:30:19.111 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:19.109+0000 7f1feec69640 1 -- 172.21.15.3:0/3649035549 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f1fe8109da0 con 0x7f1fe8106800 2024-09-21T12:30:19.111 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:19.110+0000 7f1fe5ffb640 1 -- 172.21.15.3:0/3649035549 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+297 (secure 0 0 0) 0x7f1fd408ef70 con 0x7f1fe8106800 2024-09-21T12:30:19.111 INFO:teuthology.orchestra.run.smithi003.stdout:HEALTH_WARN 1 filesystem is degraded; 1 filesystem with deprecated feature inline_data 2024-09-21T12:30:19.111 INFO:teuthology.orchestra.run.smithi003.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-21T12:30:19.111 INFO:teuthology.orchestra.run.smithi003.stdout: fs cephfs is degraded 2024-09-21T12:30:19.111 INFO:teuthology.orchestra.run.smithi003.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:30:19.111 INFO:teuthology.orchestra.run.smithi003.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:30:19.114 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:19.112+0000 7f1feec69640 1 -- 172.21.15.3:0/3649035549 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f1fd807af30 msgr2=0x7f1fd807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:30:19.114 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:19.112+0000 7f1feec69640 1 --2- 172.21.15.3:0/3649035549 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f1fd807af30 0x7f1fd807d3f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f1fdc0058c0 tx=0x7f1fdc005ec0 comp rx=0 tx=0).stop 2024-09-21T12:30:19.114 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:19.112+0000 7f1feec69640 1 -- 172.21.15.3:0/3649035549 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1fe8106800 msgr2=0x7f1fe819dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:30:19.114 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:19.112+0000 7f1feec69640 1 --2- 172.21.15.3:0/3649035549 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1fe8106800 0x7f1fe819dbb0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1fd4031460 tx=0x7f1fd40048f0 comp rx=0 tx=0).stop 2024-09-21T12:30:19.114 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:19.112+0000 7f1feec69640 1 -- 172.21.15.3:0/3649035549 shutdown_connections 2024-09-21T12:30:19.114 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:19.112+0000 7f1feec69640 1 --2- 172.21.15.3:0/3649035549 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f1fd807af30 0x7f1fd807d3f0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:30:19.114 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:19.112+0000 7f1feec69640 1 --2- 172.21.15.3:0/3649035549 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1fe8106800 0x7f1fe819dbb0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:30:19.114 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:19.112+0000 7f1feec69640 1 --2- 172.21.15.3:0/3649035549 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1fe8100800 0x7f1fe819d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:30:19.114 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:19.112+0000 7f1feec69640 1 -- 172.21.15.3:0/3649035549 >> 172.21.15.3:0/3649035549 conn(0x7f1fe80fc520 msgr2=0x7f1fe806a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:30:19.114 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:19.112+0000 7f1feec69640 1 -- 172.21.15.3:0/3649035549 shutdown_connections 2024-09-21T12:30:19.114 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:19.112+0000 7f1feec69640 1 -- 172.21.15.3:0/3649035549 wait complete. 2024-09-21T12:30:19.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:18 smithi192 ceph-mon[80326]: from='client.34380 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:30:19.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:18 smithi192 ceph-mon[80326]: from='client.34384 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:30:19.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:18 smithi192 ceph-mon[80326]: from='client.34388 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:30:19.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:18 smithi192 ceph-mon[80326]: from='client.? 172.21.15.3:0/435344562' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:30:19.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:18 smithi192 ceph-mon[80326]: from='client.? 172.21.15.3:0/309637532' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:30:20.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:19 smithi192 ceph-mon[80326]: from='client.34400 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:30:20.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:19 smithi192 ceph-mon[80326]: pgmap v286: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 7 op/s 2024-09-21T12:30:20.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:19 smithi192 ceph-mon[80326]: reconnect by client.14600 192.168.0.1:0/1734926769 after 0.000999987 2024-09-21T12:30:20.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:19 smithi192 ceph-mon[80326]: reconnect by client.24361 192.168.0.1:0/3487024347 after 0.000999987 2024-09-21T12:30:20.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:19 smithi192 ceph-mon[80326]: mds.? [v2:172.21.15.3:6826/1616995236,v1:172.21.15.3:6827/1616995236] up:reconnect 2024-09-21T12:30:20.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:19 smithi192 ceph-mon[80326]: fsmap cephfs:1/1 {0=cephfs.smithi003.ebjgyl=up:reconnect} 2 up:standby 2024-09-21T12:30:20.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:19 smithi192 ceph-mon[80326]: from='client.? 172.21.15.3:0/3649035549' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:30:20.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:19 smithi003 ceph-mon[108723]: from='client.34400 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:30:20.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:19 smithi003 ceph-mon[108723]: pgmap v286: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 7 op/s 2024-09-21T12:30:20.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:19 smithi003 ceph-mon[108723]: reconnect by client.14600 192.168.0.1:0/1734926769 after 0.000999987 2024-09-21T12:30:20.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:19 smithi003 ceph-mon[108723]: reconnect by client.24361 192.168.0.1:0/3487024347 after 0.000999987 2024-09-21T12:30:20.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:19 smithi003 ceph-mon[108723]: mds.? [v2:172.21.15.3:6826/1616995236,v1:172.21.15.3:6827/1616995236] up:reconnect 2024-09-21T12:30:20.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:19 smithi003 ceph-mon[108723]: fsmap cephfs:1/1 {0=cephfs.smithi003.ebjgyl=up:reconnect} 2 up:standby 2024-09-21T12:30:20.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:19 smithi003 ceph-mon[108723]: from='client.? 172.21.15.3:0/3649035549' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:30:21.219 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:20 smithi192 ceph-mon[80326]: mds.? [v2:172.21.15.3:6826/1616995236,v1:172.21.15.3:6827/1616995236] up:rejoin 2024-09-21T12:30:21.219 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:20 smithi192 ceph-mon[80326]: fsmap cephfs:1/1 {0=cephfs.smithi003.ebjgyl=up:rejoin} 2 up:standby 2024-09-21T12:30:21.219 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:20 smithi192 ceph-mon[80326]: daemon mds.cephfs.smithi003.ebjgyl is now active in filesystem cephfs as rank 0 2024-09-21T12:30:21.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:20 smithi003 ceph-mon[108723]: mds.? [v2:172.21.15.3:6826/1616995236,v1:172.21.15.3:6827/1616995236] up:rejoin 2024-09-21T12:30:21.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:20 smithi003 ceph-mon[108723]: fsmap cephfs:1/1 {0=cephfs.smithi003.ebjgyl=up:rejoin} 2 up:standby 2024-09-21T12:30:21.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:20 smithi003 ceph-mon[108723]: daemon mds.cephfs.smithi003.ebjgyl is now active in filesystem cephfs as rank 0 2024-09-21T12:30:22.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:21 smithi192 ceph-mon[80326]: pgmap v287: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 25 MiB/s rd, 7 op/s 2024-09-21T12:30:22.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:21 smithi192 ceph-mon[80326]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T12:30:22.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:21 smithi192 ceph-mon[80326]: mds.? [v2:172.21.15.3:6826/1616995236,v1:172.21.15.3:6827/1616995236] up:active 2024-09-21T12:30:22.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:21 smithi192 ceph-mon[80326]: fsmap cephfs:1 {0=cephfs.smithi003.ebjgyl=up:active} 2 up:standby 2024-09-21T12:30:22.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:21 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:22.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:21 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:22.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:21 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:30:22.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:21 smithi003 ceph-mon[108723]: pgmap v287: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 25 MiB/s rd, 7 op/s 2024-09-21T12:30:22.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:21 smithi003 ceph-mon[108723]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-21T12:30:22.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:21 smithi003 ceph-mon[108723]: mds.? [v2:172.21.15.3:6826/1616995236,v1:172.21.15.3:6827/1616995236] up:active 2024-09-21T12:30:22.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:21 smithi003 ceph-mon[108723]: fsmap cephfs:1 {0=cephfs.smithi003.ebjgyl=up:active} 2 up:standby 2024-09-21T12:30:22.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:21 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:22.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:21 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:22.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:21 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:30:23.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:22 smithi192 ceph-mon[80326]: mds.? [v2:172.21.15.192:6826/3169061902,v1:172.21.15.192:6827/3169061902] up:boot 2024-09-21T12:30:23.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:22 smithi192 ceph-mon[80326]: fsmap cephfs:1 {0=cephfs.smithi003.ebjgyl=up:active} 3 up:standby 2024-09-21T12:30:23.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:22 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "mds metadata", "who": "cephfs.smithi192.ktdqns"} : dispatch 2024-09-21T12:30:23.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:22 smithi192 ceph-mon[80326]: pgmap v288: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 6 op/s 2024-09-21T12:30:23.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:22 smithi003 ceph-mon[108723]: mds.? [v2:172.21.15.192:6826/3169061902,v1:172.21.15.192:6827/3169061902] up:boot 2024-09-21T12:30:23.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:22 smithi003 ceph-mon[108723]: fsmap cephfs:1 {0=cephfs.smithi003.ebjgyl=up:active} 3 up:standby 2024-09-21T12:30:23.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:22 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "mds metadata", "who": "cephfs.smithi192.ktdqns"} : dispatch 2024-09-21T12:30:23.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:22 smithi003 ceph-mon[108723]: pgmap v288: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 6 op/s 2024-09-21T12:30:25.932 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:25 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:25.932 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:25 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:25.932 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:25 smithi192 ceph-mon[80326]: pgmap v289: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 19 MiB/s rd, 6 op/s 2024-09-21T12:30:25.933 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:25 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:25.933 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:25 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:25.979 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:25 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:25.979 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:25 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:25.979 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:25 smithi003 ceph-mon[108723]: pgmap v289: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 19 MiB/s rd, 6 op/s 2024-09-21T12:30:25.979 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:25 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:25.979 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:25 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:28.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:27 smithi192 ceph-mon[80326]: pgmap v290: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 15 MiB/s rd, 170 B/s wr, 7 op/s 2024-09-21T12:30:28.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:27 smithi003 ceph-mon[108723]: pgmap v290: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 15 MiB/s rd, 170 B/s wr, 7 op/s 2024-09-21T12:30:29.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:29 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:29.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:29 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:29.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:29 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:30:29.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:29 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:30:29.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:29 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:29.759 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:29 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:30:29.759 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:29 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:30:29.759 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:29 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:30:29.759 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:29 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:30:29.759 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:29 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:30:29.759 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:29 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:30:29.759 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:29 smithi192 ceph-mon[80326]: Upgrade: Setting container_image for all mds 2024-09-21T12:30:29.759 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:29 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:29.759 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:29 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi003.ebjgyl"} : dispatch 2024-09-21T12:30:29.759 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:29 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi003.ebjgyl"}]': finished 2024-09-21T12:30:29.759 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:29 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi003.gfkngj"} : dispatch 2024-09-21T12:30:29.759 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:29 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi003.gfkngj"}]': finished 2024-09-21T12:30:29.759 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:29 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi192.ktdqns"} : dispatch 2024-09-21T12:30:29.759 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:29 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi192.ktdqns"}]': finished 2024-09-21T12:30:29.760 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:29 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi192.ywqqxe"} : dispatch 2024-09-21T12:30:29.760 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:29 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi192.ywqqxe"}]': finished 2024-09-21T12:30:29.760 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:29 smithi192 ceph-mon[80326]: Upgrade: Setting filesystem cephfs Joinable 2024-09-21T12:30:29.760 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:29 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} : dispatch 2024-09-21T12:30:29.760 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:29 smithi192 ceph-mon[80326]: pgmap v291: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 3.4 MiB/s rd, 170 B/s wr, 4 op/s 2024-09-21T12:30:29.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:29 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:29.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:29 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:29.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:29 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:30:29.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:29 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:30:29.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:29 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:29.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:29 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:30:29.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:29 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:30:29.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:29 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:30:29.831 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:29 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:30:29.831 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:29 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:30:29.831 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:29 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:30:29.831 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:29 smithi003 ceph-mon[108723]: Upgrade: Setting container_image for all mds 2024-09-21T12:30:29.831 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:29 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:29.831 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:29 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi003.ebjgyl"} : dispatch 2024-09-21T12:30:29.831 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:29 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi003.ebjgyl"}]': finished 2024-09-21T12:30:29.831 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:29 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi003.gfkngj"} : dispatch 2024-09-21T12:30:29.831 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:29 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi003.gfkngj"}]': finished 2024-09-21T12:30:29.831 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:29 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi192.ktdqns"} : dispatch 2024-09-21T12:30:29.831 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:29 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi192.ktdqns"}]': finished 2024-09-21T12:30:29.831 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:29 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi192.ywqqxe"} : dispatch 2024-09-21T12:30:29.831 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:29 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi192.ywqqxe"}]': finished 2024-09-21T12:30:29.831 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:29 smithi003 ceph-mon[108723]: Upgrade: Setting filesystem cephfs Joinable 2024-09-21T12:30:29.832 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:29 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} : dispatch 2024-09-21T12:30:29.832 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:29 smithi003 ceph-mon[108723]: pgmap v291: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 3.4 MiB/s rd, 170 B/s wr, 4 op/s 2024-09-21T12:30:30.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:30 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-21T12:30:30.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:30 smithi003 ceph-mon[108723]: fsmap cephfs:1 {0=cephfs.smithi003.ebjgyl=up:active} 3 up:standby 2024-09-21T12:30:30.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:30 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:30:30.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:30 smithi003 ceph-mon[108723]: Upgrade: Setting container_image for all rgw 2024-09-21T12:30:30.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:30 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:30.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:30 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:30:30.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:30 smithi003 ceph-mon[108723]: Upgrade: Setting container_image for all rbd-mirror 2024-09-21T12:30:30.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:30 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:30.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:30 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:30:30.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:30 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:30.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:30 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:30:31.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:30 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-21T12:30:31.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:30 smithi192 ceph-mon[80326]: fsmap cephfs:1 {0=cephfs.smithi003.ebjgyl=up:active} 3 up:standby 2024-09-21T12:30:31.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:30 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:30:31.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:30 smithi192 ceph-mon[80326]: Upgrade: Setting container_image for all rgw 2024-09-21T12:30:31.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:30 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:31.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:30 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:30:31.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:30 smithi192 ceph-mon[80326]: Upgrade: Setting container_image for all rbd-mirror 2024-09-21T12:30:31.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:30 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:31.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:30 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:30:31.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:30 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:31.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:30 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:30:31.593 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:31 smithi003 ceph-mon[108723]: pgmap v292: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 3.4 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-09-21T12:30:31.593 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:31 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:31.593 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:31 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi003", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-21T12:30:31.593 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:31 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:30:32.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:31 smithi192 ceph-mon[80326]: pgmap v292: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 3.4 MiB/s rd, 4.2 KiB/s wr, 6 op/s 2024-09-21T12:30:32.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:31 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:32.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:31 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi003", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-21T12:30:32.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:31 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:30:32.651 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:32 smithi003 ceph-mon[108723]: Upgrade: Updating ceph-exporter.smithi003 (1/2) 2024-09-21T12:30:32.651 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:32 smithi003 ceph-mon[108723]: Deploying daemon ceph-exporter.smithi003 on smithi003 2024-09-21T12:30:33.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:32 smithi192 ceph-mon[80326]: Upgrade: Updating ceph-exporter.smithi003 (1/2) 2024-09-21T12:30:33.008 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:32 smithi192 ceph-mon[80326]: Deploying daemon ceph-exporter.smithi003 on smithi003 2024-09-21T12:30:33.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:33 smithi003 ceph-mon[108723]: pgmap v293: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 3.3 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-09-21T12:30:34.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:33 smithi192 ceph-mon[80326]: pgmap v293: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 3.3 KiB/s rd, 4.2 KiB/s wr, 5 op/s 2024-09-21T12:30:35.730 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:35 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:35.730 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:35 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:35.730 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:35 smithi003 ceph-mon[108723]: pgmap v294: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4.2 KiB/s wr, 4 op/s 2024-09-21T12:30:35.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:35 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:35.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:35 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:35.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:35 smithi192 ceph-mon[80326]: pgmap v294: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s rd, 4.2 KiB/s wr, 4 op/s 2024-09-21T12:30:37.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:36 smithi003 ceph-mon[108723]: Upgrade: Updating ceph-exporter.smithi192 (2/2) 2024-09-21T12:30:37.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:36 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:37.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:36 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi192", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-21T12:30:37.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:36 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:30:37.080 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:36 smithi003 ceph-mon[108723]: Deploying daemon ceph-exporter.smithi192 on smithi192 2024-09-21T12:30:37.255 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:36 smithi192 ceph-mon[80326]: Upgrade: Updating ceph-exporter.smithi192 (2/2) 2024-09-21T12:30:37.255 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:36 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:37.255 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:36 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "auth get-or-create", "entity": "client.ceph-exporter.smithi192", "caps": ["mon", "profile ceph-exporter", "mon", "allow r", "mgr", "allow r", "osd", "allow r"]} : dispatch 2024-09-21T12:30:37.255 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:36 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:30:37.255 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:36 smithi192 ceph-mon[80326]: Deploying daemon ceph-exporter.smithi192 on smithi192 2024-09-21T12:30:38.101 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:37 smithi192 ceph-mon[80326]: pgmap v295: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 4.2 KiB/s wr, 3 op/s 2024-09-21T12:30:38.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:37 smithi003 ceph-mon[108723]: pgmap v295: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 4.2 KiB/s wr, 3 op/s 2024-09-21T12:30:40.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:39 smithi192 ceph-mon[80326]: pgmap v296: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 4.1 KiB/s wr, 1 op/s 2024-09-21T12:30:40.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:39 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:40.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:39 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:40.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:39 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:30:40.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:39 smithi003 ceph-mon[108723]: pgmap v296: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 4.1 KiB/s wr, 1 op/s 2024-09-21T12:30:40.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:39 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:40.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:39 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:40.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:39 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:30:42.255 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:41 smithi003 ceph-mon[108723]: pgmap v297: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 4.1 KiB/s wr, 1 op/s 2024-09-21T12:30:42.256 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:41 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:42.256 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:41 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:42.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:41 smithi192 ceph-mon[80326]: pgmap v297: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 4.1 KiB/s wr, 1 op/s 2024-09-21T12:30:42.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:41 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:42.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:41 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:43.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:43 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:43.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:43 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:43.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:43 smithi192 ceph-mon[80326]: pgmap v298: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:30:43.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:43 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:43.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:43 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:43.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:43 smithi003 ceph-mon[108723]: pgmap v298: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:30:45.349 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:45 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:45.350 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:45 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:45.350 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:45 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:30:45.350 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:45 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:45.350 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:45 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:45.350 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:45 smithi192 ceph-mon[80326]: pgmap v299: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:30:45.563 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:45 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:45.564 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:45 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:45.564 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:45 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:30:45.564 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:45 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:45.564 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:45 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:45.564 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:45 smithi003 ceph-mon[108723]: pgmap v299: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:30:46.634 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:46 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:46.635 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:46 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:46.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:46 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:46.758 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:46 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:47.684 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:47 smithi003 ceph-mon[108723]: pgmap v300: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:30:47.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:47 smithi192 ceph-mon[80326]: pgmap v300: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:30:49.214 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:49.212+0000 7fc491904640 1 -- 172.21.15.3:0/1638621105 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc48c101900 msgr2=0x7fc48c101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:30:49.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:49.212+0000 7fc491904640 1 --2- 172.21.15.3:0/1638621105 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc48c101900 0x7fc48c101d60 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc480009880 tx=0x7fc48002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:30:49.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:49.212+0000 7fc491904640 1 -- 172.21.15.3:0/1638621105 shutdown_connections 2024-09-21T12:30:49.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:49.212+0000 7fc491904640 1 --2- 172.21.15.3:0/1638621105 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc48c101900 0x7fc48c101d60 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:30:49.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:49.212+0000 7fc491904640 1 --2- 172.21.15.3:0/1638621105 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc48c107900 0x7fc48c107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:30:49.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:49.212+0000 7fc491904640 1 -- 172.21.15.3:0/1638621105 >> 172.21.15.3:0/1638621105 conn(0x7fc48c0fd600 msgr2=0x7fc48c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:30:49.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:49.212+0000 7fc491904640 1 -- 172.21.15.3:0/1638621105 shutdown_connections 2024-09-21T12:30:49.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:49.213+0000 7fc491904640 1 -- 172.21.15.3:0/1638621105 wait complete. 2024-09-21T12:30:49.215 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:49.213+0000 7fc491904640 1 Processor -- start 2024-09-21T12:30:49.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:49.213+0000 7fc491904640 1 -- start start 2024-09-21T12:30:49.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:49.214+0000 7fc491904640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc48c101900 0x7fc48c19f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:30:49.216 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:49.214+0000 7fc491904640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc48c107900 0x7fc48c19fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:30:49.217 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:49.214+0000 7fc491904640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fc48c10edb0 con 0x7fc48c101900 2024-09-21T12:30:49.217 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:49.214+0000 7fc491904640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc48c10ec30 con 0x7fc48c107900 2024-09-21T12:30:49.217 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:49.214+0000 7fc48affd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc48c101900 0x7fc48c19f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:30:49.217 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:49.214+0000 7fc48a7fc640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc48c107900 0x7fc48c19fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:30:49.217 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:49.214+0000 7fc48a7fc640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc48c107900 0x7fc48c19fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.192:3300/0 says I am v2:172.21.15.3:39770/0 (socket says 172.21.15.3:39770) 2024-09-21T12:30:49.217 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:49.214+0000 7fc48a7fc640 1 -- 172.21.15.3:0/1957630935 learned_addr learned my addr 172.21.15.3:0/1957630935 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:30:49.217 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:49.214+0000 7fc48affd640 1 -- 172.21.15.3:0/1957630935 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc48c107900 msgr2=0x7fc48c19fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:30:49.217 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:49.214+0000 7fc48affd640 1 --2- 172.21.15.3:0/1957630935 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc48c107900 0x7fc48c19fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:30:49.217 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:49.214+0000 7fc48affd640 1 -- 172.21.15.3:0/1957630935 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc48c199a30 con 0x7fc48c101900 2024-09-21T12:30:49.217 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:49.214+0000 7fc48a7fc640 1 --2- 172.21.15.3:0/1957630935 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc48c107900 0x7fc48c19fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-21T12:30:49.217 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:49.215+0000 7fc48affd640 1 --2- 172.21.15.3:0/1957630935 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc48c101900 0x7fc48c19f870 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc47c00e970 tx=0x7fc47c00ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:30:49.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:49.216+0000 7fc490902640 1 -- 172.21.15.3:0/1957630935 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc47c00cac0 con 0x7fc48c101900 2024-09-21T12:30:49.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:49.216+0000 7fc490902640 1 -- 172.21.15.3:0/1957630935 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc47c00cc60 con 0x7fc48c101900 2024-09-21T12:30:49.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:49.216+0000 7fc491904640 1 -- 172.21.15.3:0/1957630935 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc48c199d20 con 0x7fc48c101900 2024-09-21T12:30:49.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:49.216+0000 7fc490902640 1 -- 172.21.15.3:0/1957630935 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc47c018720 con 0x7fc48c101900 2024-09-21T12:30:49.218 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:49.216+0000 7fc491904640 1 -- 172.21.15.3:0/1957630935 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc48c19a280 con 0x7fc48c101900 2024-09-21T12:30:49.219 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:49.217+0000 7fc491904640 1 -- 172.21.15.3:0/1957630935 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc48c103040 con 0x7fc48c101900 2024-09-21T12:30:49.220 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:49.219+0000 7fc490902640 1 -- 172.21.15.3:0/1957630935 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7fc47c010430 con 0x7fc48c101900 2024-09-21T12:30:49.220 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:49.219+0000 7fc490902640 1 --2- 172.21.15.3:0/1957630935 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fc47407af80 0x7fc47407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:30:49.221 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:49.219+0000 7fc490902640 1 -- 172.21.15.3:0/1957630935 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6414+0+0 (secure 0 0 0) 0x7fc47c09ea00 con 0x7fc48c101900 2024-09-21T12:30:49.221 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:49.219+0000 7fc48a7fc640 1 --2- 172.21.15.3:0/1957630935 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fc47407af80 0x7fc47407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:30:49.221 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:49.220+0000 7fc48a7fc640 1 --2- 172.21.15.3:0/1957630935 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fc47407af80 0x7fc47407d440 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc48c19b220 tx=0x7fc4800058d0 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:30:49.227 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:49.226+0000 7fc490902640 1 -- 172.21.15.3:0/1957630935 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc47c06a020 con 0x7fc48c101900 2024-09-21T12:30:49.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:49.437+0000 7fc491904640 1 -- 172.21.15.3:0/1957630935 --> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7fc48c19b040 con 0x7fc47407af80 2024-09-21T12:30:49.439 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:49 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:49.440 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:49 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:49.440 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:49 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:30:49.440 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:49 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:30:49.440 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:49 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:49.440 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:49 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:30:49.440 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:49 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:30:49.440 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:49 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:30:49.440 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:49 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:30:49.441 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:49 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:30:49.441 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:49 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:30:49.441 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:49 smithi003 ceph-mon[108723]: Upgrade: Setting filesystem cephfs Joinable 2024-09-21T12:30:49.441 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:49 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} : dispatch 2024-09-21T12:30:49.441 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:49 smithi003 ceph-mon[108723]: pgmap v301: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:30:49.441 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:49.438+0000 7fc490902640 1 -- 172.21.15.3:0/1957630935 <== mgr.14756 v2:172.21.15.3:6800/1284098095 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+175 (secure 0 0 0) 0x7fc48c19b040 con 0x7fc47407af80 2024-09-21T12:30:49.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:49.440+0000 7fc491904640 1 -- 172.21.15.3:0/1957630935 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fc47407af80 msgr2=0x7fc47407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:30:49.442 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:49.440+0000 7fc491904640 1 --2- 172.21.15.3:0/1957630935 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fc47407af80 0x7fc47407d440 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc48c19b220 tx=0x7fc4800058d0 comp rx=0 tx=0).stop 2024-09-21T12:30:49.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:49.440+0000 7fc491904640 1 -- 172.21.15.3:0/1957630935 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc48c101900 msgr2=0x7fc48c19f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:30:49.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:49.440+0000 7fc491904640 1 --2- 172.21.15.3:0/1957630935 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc48c101900 0x7fc48c19f870 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc47c00e970 tx=0x7fc47c00ee30 comp rx=0 tx=0).stop 2024-09-21T12:30:49.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:49.441+0000 7fc491904640 1 -- 172.21.15.3:0/1957630935 shutdown_connections 2024-09-21T12:30:49.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:49.441+0000 7fc491904640 1 --2- 172.21.15.3:0/1957630935 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fc47407af80 0x7fc47407d440 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:30:49.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:49.441+0000 7fc491904640 1 --2- 172.21.15.3:0/1957630935 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc48c107900 0x7fc48c19fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:30:49.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:49.441+0000 7fc491904640 1 --2- 172.21.15.3:0/1957630935 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc48c101900 0x7fc48c19f870 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:30:49.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:49.441+0000 7fc491904640 1 -- 172.21.15.3:0/1957630935 >> 172.21.15.3:0/1957630935 conn(0x7fc48c0fd600 msgr2=0x7fc48c074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:30:49.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:49.441+0000 7fc491904640 1 -- 172.21.15.3:0/1957630935 shutdown_connections 2024-09-21T12:30:49.443 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:49.441+0000 7fc491904640 1 -- 172.21.15.3:0/1957630935 wait complete. 2024-09-21T12:30:49.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:49 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:49.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:49 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:49.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:49 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:30:49.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:49 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:30:49.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:49 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:49.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:49 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:30:49.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:49 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:30:49.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:49 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:30:49.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:49 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:30:49.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:49 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:30:49.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:49 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:30:49.509 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:49 smithi192 ceph-mon[80326]: Upgrade: Setting filesystem cephfs Joinable 2024-09-21T12:30:49.509 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:49 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"} : dispatch 2024-09-21T12:30:49.509 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:49 smithi192 ceph-mon[80326]: pgmap v301: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:30:50.134 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -e sha1=5c1cdc3c470dae78e91a0ed2bcf13509a046d301 -- bash -c 'ceph orch ps' 2024-09-21T12:30:50.438 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:30:50.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:50 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-21T12:30:50.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:50 smithi192 ceph-mon[80326]: fsmap cephfs:1 {0=cephfs.smithi003.ebjgyl=up:active} 3 up:standby 2024-09-21T12:30:50.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:50 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:30:50.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:50 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:30:50.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:50 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:30:50.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:50 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:30:50.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:50 smithi192 ceph-mon[80326]: Upgrade: Setting container_image for all ceph-exporter 2024-09-21T12:30:50.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:50 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:50.509 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:50 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi003"} : dispatch 2024-09-21T12:30:50.509 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:50 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi003"}]': finished 2024-09-21T12:30:50.509 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:50 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi192"} : dispatch 2024-09-21T12:30:50.509 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:50 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi192"}]': finished 2024-09-21T12:30:50.509 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:50 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:30:50.509 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:50 smithi192 ceph-mon[80326]: Upgrade: Setting container_image for all iscsi 2024-09-21T12:30:50.509 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:50 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:50.509 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:50 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:30:50.509 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:50 smithi192 ceph-mon[80326]: Upgrade: Setting container_image for all nfs 2024-09-21T12:30:50.509 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:50 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:50.509 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:50 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:30:50.509 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:50 smithi192 ceph-mon[80326]: Upgrade: Setting container_image for all nvmeof 2024-09-21T12:30:50.509 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:50 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:50.509 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:50 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:30:50.509 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:50 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:30:50.510 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:50 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:30:50.510 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:50 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:30:50.510 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:50 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:30:50.510 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:50 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:30:50.510 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:50 smithi192 ceph-mon[80326]: Upgrade: Finalizing container_image settings 2024-09-21T12:30:50.510 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:50 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-21T12:30:50.510 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:50 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-21T12:30:50.510 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:50 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T12:30:50.511 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:50 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-21T12:30:50.511 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:50 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-21T12:30:50.511 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:50 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-21T12:30:50.511 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:50 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-21T12:30:50.511 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:50 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-21T12:30:50.511 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:50 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-21T12:30:50.511 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:50 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-21T12:30:50.511 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:50 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-21T12:30:50.511 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:50 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-21T12:30:50.511 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:50 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-21T12:30:50.511 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:50 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-21T12:30:50.511 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:50 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T12:30:50.511 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:50 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-21T12:30:50.512 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:50 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-21T12:30:50.512 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:50 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-21T12:30:50.512 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:50 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-21T12:30:50.512 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:50 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-21T12:30:50.512 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:50 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-21T12:30:50.512 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:50 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-21T12:30:50.512 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:50 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-21T12:30:50.512 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:50 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T12:30:50.512 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:50 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T12:30:50.512 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:50 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T12:30:50.512 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:50 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T12:30:50.512 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:50 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T12:30:50.512 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:50 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T12:30:50.512 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:50 smithi192 ceph-mon[80326]: Upgrade: Complete! 2024-09-21T12:30:50.513 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:50 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-21T12:30:50.513 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:50 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-21T12:30:50.513 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:50 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:30:50.513 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:50 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:30:50.513 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:50 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:30:50.513 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:50 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:50.513 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:50 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:30:50.513 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:50 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:30:50.513 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:50 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:30:50.513 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:50 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:50.513 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:50 smithi192 ceph-mon[80326]: from='client.34412 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:30:50.513 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:50 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:50.560 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:50 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-09-21T12:30:50.560 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:50 smithi003 ceph-mon[108723]: fsmap cephfs:1 {0=cephfs.smithi003.ebjgyl=up:active} 3 up:standby 2024-09-21T12:30:50.560 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:50 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:30:50.560 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:50 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:30:50.560 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:50 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:30:50.560 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:50 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:30:50.560 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:50 smithi003 ceph-mon[108723]: Upgrade: Setting container_image for all ceph-exporter 2024-09-21T12:30:50.561 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:50 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:50.561 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:50 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi003"} : dispatch 2024-09-21T12:30:50.561 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:50 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi003"}]': finished 2024-09-21T12:30:50.561 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:50 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi192"} : dispatch 2024-09-21T12:30:50.561 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:50 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter.smithi192"}]': finished 2024-09-21T12:30:50.561 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:50 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:30:50.561 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:50 smithi003 ceph-mon[108723]: Upgrade: Setting container_image for all iscsi 2024-09-21T12:30:50.561 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:50 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:50.561 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:50 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:30:50.561 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:50 smithi003 ceph-mon[108723]: Upgrade: Setting container_image for all nfs 2024-09-21T12:30:50.561 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:50 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:50.561 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:50 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:30:50.561 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:50 smithi003 ceph-mon[108723]: Upgrade: Setting container_image for all nvmeof 2024-09-21T12:30:50.561 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:50 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:50.561 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:50 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:30:50.562 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:50 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:30:50.562 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:50 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:30:50.562 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:50 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:30:50.562 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:50 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:30:50.562 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:50 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:30:50.562 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:50 smithi003 ceph-mon[108723]: Upgrade: Finalizing container_image settings 2024-09-21T12:30:50.562 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:50 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config rm", "name": "container_image", "who": "mgr"} : dispatch 2024-09-21T12:30:50.562 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:50 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-21T12:30:50.563 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:50 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T12:30:50.563 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:50 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-21T12:30:50.563 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:50 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config rm", "name": "container_image", "who": "client.crash"} : dispatch 2024-09-21T12:30:50.563 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:50 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-21T12:30:50.563 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:50 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config rm", "name": "container_image", "who": "osd"} : dispatch 2024-09-21T12:30:50.563 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:50 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-21T12:30:50.563 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:50 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config rm", "name": "container_image", "who": "mds"} : dispatch 2024-09-21T12:30:50.563 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:50 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-21T12:30:50.563 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:50 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rgw"} : dispatch 2024-09-21T12:30:50.563 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:50 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-21T12:30:50.563 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:50 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"} : dispatch 2024-09-21T12:30:50.563 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:50 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-21T12:30:50.563 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:50 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T12:30:50.563 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:50 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"} : dispatch 2024-09-21T12:30:50.564 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:50 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-21T12:30:50.564 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:50 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config rm", "name": "container_image", "who": "client.iscsi"} : dispatch 2024-09-21T12:30:50.564 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:50 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-21T12:30:50.564 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:50 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nfs"} : dispatch 2024-09-21T12:30:50.564 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:50 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-21T12:30:50.564 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:50 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"} : dispatch 2024-09-21T12:30:50.564 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:50 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-21T12:30:50.564 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:50 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T12:30:50.564 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:50 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T12:30:50.564 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:50 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T12:30:50.564 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:50 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T12:30:50.564 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:50 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T12:30:50.564 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:50 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config rm", "name": "container_image", "who": "mon"} : dispatch 2024-09-21T12:30:50.564 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:50 smithi003 ceph-mon[108723]: Upgrade: Complete! 2024-09-21T12:30:50.565 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:50 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"} : dispatch 2024-09-21T12:30:50.565 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:50 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-21T12:30:50.565 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:50 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:30:50.565 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:50 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:30:50.565 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:50 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:30:50.565 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:50 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:50.565 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:50 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:30:50.565 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:50 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:30:50.565 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:50 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:30:50.565 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:50 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:50.565 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:50 smithi003 ceph-mon[108723]: from='client.34412 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:30:50.565 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:50 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:30:50.927 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:50.926+0000 7f8317027640 1 -- 172.21.15.3:0/2024866527 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f83101007f0 msgr2=0x7f8310100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:30:50.927 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:50.926+0000 7f8317027640 1 --2- 172.21.15.3:0/2024866527 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f83101007f0 0x7f8310100c50 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f82fc009880 tx=0x7f82fc02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:30:50.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:50.926+0000 7f8317027640 1 -- 172.21.15.3:0/2024866527 shutdown_connections 2024-09-21T12:30:50.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:50.926+0000 7f8317027640 1 --2- 172.21.15.3:0/2024866527 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f83101007f0 0x7f8310100c50 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:30:50.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:50.926+0000 7f8317027640 1 --2- 172.21.15.3:0/2024866527 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83101067f0 0x7f8310106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:30:50.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:50.926+0000 7f8317027640 1 -- 172.21.15.3:0/2024866527 >> 172.21.15.3:0/2024866527 conn(0x7f83100fc550 msgr2=0x7f83100fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:30:50.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:50.926+0000 7f8317027640 1 -- 172.21.15.3:0/2024866527 shutdown_connections 2024-09-21T12:30:50.928 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:50.926+0000 7f8317027640 1 -- 172.21.15.3:0/2024866527 wait complete. 2024-09-21T12:30:50.929 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:50.926+0000 7f8317027640 1 Processor -- start 2024-09-21T12:30:50.929 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:50.927+0000 7f8317027640 1 -- start start 2024-09-21T12:30:50.929 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:50.927+0000 7f8317027640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f83101007f0 0x7f831019d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:30:50.930 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:50.927+0000 7f8317027640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83101067f0 0x7f831019db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:30:50.930 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:50.927+0000 7f8317027640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f831010dca0 con 0x7f83101007f0 2024-09-21T12:30:50.930 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:50.927+0000 7f8317027640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f831010db20 con 0x7f83101067f0 2024-09-21T12:30:50.930 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:50.927+0000 7f8314dc3640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f83101007f0 0x7f831019d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:30:50.930 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:50.927+0000 7f8314dc3640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f83101007f0 0x7f831019d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:52112/0 (socket says 172.21.15.3:52112) 2024-09-21T12:30:50.930 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:50.927+0000 7f8314dc3640 1 -- 172.21.15.3:0/2628765677 learned_addr learned my addr 172.21.15.3:0/2628765677 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:30:50.930 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:50.927+0000 7f830ffff640 1 --2- 172.21.15.3:0/2628765677 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83101067f0 0x7f831019db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:30:50.930 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:50.927+0000 7f8314dc3640 1 -- 172.21.15.3:0/2628765677 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83101067f0 msgr2=0x7f831019db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:30:50.930 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:50.927+0000 7f8314dc3640 1 --2- 172.21.15.3:0/2628765677 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83101067f0 0x7f831019db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:30:50.930 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:50.927+0000 7f8314dc3640 1 -- 172.21.15.3:0/2628765677 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8310197780 con 0x7f83101007f0 2024-09-21T12:30:50.930 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:50.927+0000 7f8314dc3640 1 --2- 172.21.15.3:0/2628765677 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f83101007f0 0x7f831019d600 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f830400d8d0 tx=0x7f830400dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:30:50.930 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:50.928+0000 7f830dffb640 1 -- 172.21.15.3:0/2628765677 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f8304017070 con 0x7f83101007f0 2024-09-21T12:30:50.930 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:50.928+0000 7f830dffb640 1 -- 172.21.15.3:0/2628765677 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f8304010460 con 0x7f83101007f0 2024-09-21T12:30:50.930 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:50.928+0000 7f8317027640 1 -- 172.21.15.3:0/2628765677 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8310197a70 con 0x7f83101007f0 2024-09-21T12:30:50.931 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:50.928+0000 7f830dffb640 1 -- 172.21.15.3:0/2628765677 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f830400f5f0 con 0x7f83101007f0 2024-09-21T12:30:50.931 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:50.928+0000 7f8317027640 1 -- 172.21.15.3:0/2628765677 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8310197fd0 con 0x7f83101007f0 2024-09-21T12:30:50.931 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:50.929+0000 7f8317027640 1 -- 172.21.15.3:0/2628765677 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8310101f30 con 0x7f83101007f0 2024-09-21T12:30:50.931 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:50.930+0000 7f830dffb640 1 -- 172.21.15.3:0/2628765677 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f8304009a30 con 0x7f83101007f0 2024-09-21T12:30:50.931 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:50.930+0000 7f830dffb640 1 --2- 172.21.15.3:0/2628765677 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f830007af40 0x7f830007d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:30:50.932 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:50.930+0000 7f830dffb640 1 -- 172.21.15.3:0/2628765677 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6414+0+0 (secure 0 0 0) 0x7f830409dfa0 con 0x7f83101007f0 2024-09-21T12:30:50.932 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:50.930+0000 7f830ffff640 1 --2- 172.21.15.3:0/2628765677 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f830007af40 0x7f830007d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:30:50.932 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:50.931+0000 7f830ffff640 1 --2- 172.21.15.3:0/2628765677 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f830007af40 0x7f830007d400 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8310198ad0 tx=0x7f82fc0095c0 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:30:50.936 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:50.935+0000 7f830dffb640 1 -- 172.21.15.3:0/2628765677 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f83040694a0 con 0x7f83101007f0 2024-09-21T12:30:51.130 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:51.129+0000 7f8317027640 1 -- 172.21.15.3:0/2628765677 --> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f8310198280 con 0x7f830007af40 2024-09-21T12:30:51.140 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:51.138+0000 7f830dffb640 1 -- 172.21.15.3:0/2628765677 <== mgr.14756 v2:172.21.15.3:6800/1284098095 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3840 (secure 0 0 0) 0x7f8310198280 con 0x7f830007af40 2024-09-21T12:30:51.140 INFO:teuthology.orchestra.run.smithi003.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:30:51.140 INFO:teuthology.orchestra.run.smithi003.stdout:alertmanager.smithi003 smithi003 *:9093,9094 running (7m) 6s ago 18m 19.1M - 0.27.0 11f11916f8cd 14880018dfd3 2024-09-21T12:30:51.140 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-exporter.smithi003 smithi003 running (17s) 6s ago 18m 7768k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 c7b4bd7c2ae1 2024-09-21T12:30:51.140 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-exporter.smithi192 smithi192 running (12s) 9s ago 17m 7335k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 dcb2f77d3cf2 2024-09-21T12:30:51.140 INFO:teuthology.orchestra.run.smithi003.stdout:crash.smithi003 smithi003 running (5m) 6s ago 18m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 0ada67250dba 2024-09-21T12:30:51.140 INFO:teuthology.orchestra.run.smithi003.stdout:crash.smithi192 smithi192 running (5m) 9s ago 17m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 52e279085b2e 2024-09-21T12:30:51.140 INFO:teuthology.orchestra.run.smithi003.stdout:grafana.smithi003 smithi003 *:3000 running (6m) 6s ago 18m 81.1M - 10.4.8 5aad1d7cf004 19e26b3cb585 2024-09-21T12:30:51.141 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi003.ebjgyl smithi003 running (101s) 6s ago 13m 85.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 8579e4fc4f05 2024-09-21T12:30:51.141 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi003.gfkngj smithi003 running (79s) 6s ago 13m 15.7M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 7b3dec4f76e2 2024-09-21T12:30:51.141 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi192.ktdqns smithi192 running (29s) 9s ago 13m 13.8M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 a893899a58c0 2024-09-21T12:30:51.141 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi192.ywqqxe smithi192 running (56s) 9s ago 13m 13.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 b8882783ef02 2024-09-21T12:30:51.141 INFO:teuthology.orchestra.run.smithi003.stdout:mgr.smithi003.wztftl smithi003 *:8443,9283,8765 running (9m) 6s ago 19m 530M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 8ce0e66fd369 2024-09-21T12:30:51.141 INFO:teuthology.orchestra.run.smithi003.stdout:mgr.smithi192.qsaprd smithi192 *:8443,9283,8765 running (8m) 9s ago 17m 459M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 002a6171dd47 2024-09-21T12:30:51.141 INFO:teuthology.orchestra.run.smithi003.stdout:mon.smithi003 smithi003 running (5m) 6s ago 20m 52.6M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 4f2b2b2daf19 2024-09-21T12:30:51.141 INFO:teuthology.orchestra.run.smithi003.stdout:mon.smithi192 smithi192 running (5m) 9s ago 17m 44.2M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 11edc5c1baba 2024-09-21T12:30:51.141 INFO:teuthology.orchestra.run.smithi003.stdout:node-exporter.smithi003 smithi003 *:9100 running (8m) 6s ago 18m 9.85M - 1.7.0 72c9c2088986 d9cb7ede9060 2024-09-21T12:30:51.141 INFO:teuthology.orchestra.run.smithi003.stdout:node-exporter.smithi192 smithi192 *:9100 running (8m) 9s ago 17m 11.9M - 1.7.0 72c9c2088986 d8ec0acfce7e 2024-09-21T12:30:51.141 INFO:teuthology.orchestra.run.smithi003.stdout:osd.0 smithi003 running (4m) 6s ago 16m 93.4M 1217M 19.3.0-5103-g5c1cdc3c 8f4d013db793 0f2234f333ec 2024-09-21T12:30:51.141 INFO:teuthology.orchestra.run.smithi003.stdout:osd.1 smithi003 running (4m) 6s ago 16m 98.2M 1217M 19.3.0-5103-g5c1cdc3c 8f4d013db793 198ba21d0518 2024-09-21T12:30:51.141 INFO:teuthology.orchestra.run.smithi003.stdout:osd.2 smithi003 running (3m) 6s ago 15m 86.0M 1217M 19.3.0-5103-g5c1cdc3c 8f4d013db793 e630341e13d4 2024-09-21T12:30:51.141 INFO:teuthology.orchestra.run.smithi003.stdout:osd.3 smithi192 running (3m) 9s ago 15m 114M 2240M 19.3.0-5103-g5c1cdc3c 8f4d013db793 1b5fae2f2dd9 2024-09-21T12:30:51.141 INFO:teuthology.orchestra.run.smithi003.stdout:osd.4 smithi192 running (2m) 9s ago 14m 99.8M 2240M 19.3.0-5103-g5c1cdc3c 8f4d013db793 5b1bd4bec479 2024-09-21T12:30:51.142 INFO:teuthology.orchestra.run.smithi003.stdout:osd.5 smithi192 running (115s) 9s ago 14m 93.1M 2240M 19.3.0-5103-g5c1cdc3c 8f4d013db793 584f3f612483 2024-09-21T12:30:51.142 INFO:teuthology.orchestra.run.smithi003.stdout:prometheus.smithi003 smithi003 *:9095 running (7m) 6s ago 18m 56.7M - 2.51.0 1d3b7f56885b 64997a33fbbb 2024-09-21T12:30:51.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:51.141+0000 7f8317027640 1 -- 172.21.15.3:0/2628765677 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f830007af40 msgr2=0x7f830007d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:30:51.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:51.141+0000 7f8317027640 1 --2- 172.21.15.3:0/2628765677 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f830007af40 0x7f830007d400 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8310198ad0 tx=0x7f82fc0095c0 comp rx=0 tx=0).stop 2024-09-21T12:30:51.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:51.141+0000 7f8317027640 1 -- 172.21.15.3:0/2628765677 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f83101007f0 msgr2=0x7f831019d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:30:51.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:51.141+0000 7f8317027640 1 --2- 172.21.15.3:0/2628765677 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f83101007f0 0x7f831019d600 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f830400d8d0 tx=0x7f830400dd90 comp rx=0 tx=0).stop 2024-09-21T12:30:51.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:51.141+0000 7f8317027640 1 -- 172.21.15.3:0/2628765677 shutdown_connections 2024-09-21T12:30:51.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:51.141+0000 7f8317027640 1 --2- 172.21.15.3:0/2628765677 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f830007af40 0x7f830007d400 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:30:51.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:51.141+0000 7f8317027640 1 --2- 172.21.15.3:0/2628765677 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f83101067f0 0x7f831019db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:30:51.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:51.141+0000 7f8317027640 1 --2- 172.21.15.3:0/2628765677 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f83101007f0 0x7f831019d600 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:30:51.144 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:51.141+0000 7f8317027640 1 -- 172.21.15.3:0/2628765677 >> 172.21.15.3:0/2628765677 conn(0x7f83100fc550 msgr2=0x7f8310069e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:30:51.144 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:51.141+0000 7f8317027640 1 -- 172.21.15.3:0/2628765677 shutdown_connections 2024-09-21T12:30:51.144 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:51.142+0000 7f8317027640 1 -- 172.21.15.3:0/2628765677 wait complete. 2024-09-21T12:30:51.464 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:51 smithi003 ceph-mon[108723]: pgmap v302: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:30:51.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:51 smithi192 ceph-mon[80326]: pgmap v302: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:30:51.796 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -e sha1=5c1cdc3c470dae78e91a0ed2bcf13509a046d301 -- bash -c 'ceph orch upgrade status' 2024-09-21T12:30:52.062 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:30:52.417 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:52 smithi003 ceph-mon[108723]: from='client.34416 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:30:52.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:52 smithi192 ceph-mon[80326]: from='client.34416 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:30:52.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:52.501+0000 7faaf4290640 1 -- 172.21.15.3:0/927640115 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faaec107900 msgr2=0x7faaec107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:30:52.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:52.501+0000 7faaf4290640 1 --2- 172.21.15.3:0/927640115 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faaec107900 0x7faaec107ce0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7faadc009c20 tx=0x7faadc02a970 comp rx=0 tx=0).stop 2024-09-21T12:30:52.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:52.501+0000 7faaf4290640 1 -- 172.21.15.3:0/927640115 shutdown_connections 2024-09-21T12:30:52.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:52.501+0000 7faaf4290640 1 --2- 172.21.15.3:0/927640115 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faaec101900 0x7faaec101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:30:52.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:52.501+0000 7faaf4290640 1 --2- 172.21.15.3:0/927640115 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faaec107900 0x7faaec107ce0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:30:52.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:52.501+0000 7faaf4290640 1 -- 172.21.15.3:0/927640115 >> 172.21.15.3:0/927640115 conn(0x7faaec0fd620 msgr2=0x7faaec0ffa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:30:52.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:52.501+0000 7faaf4290640 1 -- 172.21.15.3:0/927640115 shutdown_connections 2024-09-21T12:30:52.526 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:52.501+0000 7faaf4290640 1 -- 172.21.15.3:0/927640115 wait complete. 2024-09-21T12:30:52.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:52.501+0000 7faaf4290640 1 Processor -- start 2024-09-21T12:30:52.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:52.502+0000 7faaf4290640 1 -- start start 2024-09-21T12:30:52.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:52.502+0000 7faaf4290640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faaec101900 0x7faaec19f850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:30:52.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:52.502+0000 7faaf4290640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faaec107900 0x7faaec19fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:30:52.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:52.502+0000 7faaf4290640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7faaec10edd0 con 0x7faaec101900 2024-09-21T12:30:52.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:52.502+0000 7faaf4290640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7faaec10ec50 con 0x7faaec107900 2024-09-21T12:30:52.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:52.502+0000 7faaf202c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faaec101900 0x7faaec19f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:30:52.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:52.502+0000 7faaf202c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faaec101900 0x7faaec19f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:52130/0 (socket says 172.21.15.3:52130) 2024-09-21T12:30:52.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:52.502+0000 7faaf202c640 1 -- 172.21.15.3:0/1981087250 learned_addr learned my addr 172.21.15.3:0/1981087250 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:30:52.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:52.502+0000 7faaf182b640 1 --2- 172.21.15.3:0/1981087250 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faaec107900 0x7faaec19fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:30:52.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:52.502+0000 7faaf202c640 1 -- 172.21.15.3:0/1981087250 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faaec107900 msgr2=0x7faaec19fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:30:52.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:52.502+0000 7faaf202c640 1 --2- 172.21.15.3:0/1981087250 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faaec107900 0x7faaec19fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:30:52.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:52.502+0000 7faaf202c640 1 -- 172.21.15.3:0/1981087250 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaec199a10 con 0x7faaec101900 2024-09-21T12:30:52.527 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:52.502+0000 7faaf182b640 1 --2- 172.21.15.3:0/1981087250 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faaec107900 0x7faaec19fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:30:52.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:52.502+0000 7faaf202c640 1 --2- 172.21.15.3:0/1981087250 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faaec101900 0x7faaec19f850 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7faadc02ae90 tx=0x7faadc02f5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:30:52.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:52.503+0000 7faaeb7fe640 1 -- 172.21.15.3:0/1981087250 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faadc047070 con 0x7faaec101900 2024-09-21T12:30:52.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:52.503+0000 7faaf4290640 1 -- 172.21.15.3:0/1981087250 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faaec199ca0 con 0x7faaec101900 2024-09-21T12:30:52.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:52.503+0000 7faaeb7fe640 1 -- 172.21.15.3:0/1981087250 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7faadc02f7e0 con 0x7faaec101900 2024-09-21T12:30:52.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:52.503+0000 7faaeb7fe640 1 -- 172.21.15.3:0/1981087250 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7faadc034070 con 0x7faaec101900 2024-09-21T12:30:52.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:52.503+0000 7faaf4290640 1 -- 172.21.15.3:0/1981087250 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faaec19a1d0 con 0x7faaec101900 2024-09-21T12:30:52.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:52.504+0000 7faaf4290640 1 -- 172.21.15.3:0/1981087250 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faaec103040 con 0x7faaec101900 2024-09-21T12:30:52.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:52.504+0000 7faaeb7fe640 1 -- 172.21.15.3:0/1981087250 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7faadc04a070 con 0x7faaec101900 2024-09-21T12:30:52.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:52.505+0000 7faaeb7fe640 1 --2- 172.21.15.3:0/1981087250 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7faad407af30 0x7faad407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:30:52.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:52.505+0000 7faaeb7fe640 1 -- 172.21.15.3:0/1981087250 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6414+0+0 (secure 0 0 0) 0x7faadc0bef40 con 0x7faaec101900 2024-09-21T12:30:52.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:52.505+0000 7faaf182b640 1 --2- 172.21.15.3:0/1981087250 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7faad407af30 0x7faad407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:30:52.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:52.505+0000 7faaf182b640 1 --2- 172.21.15.3:0/1981087250 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7faad407af30 0x7faad407d3f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7faae00058c0 tx=0x7faae0005850 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:30:52.528 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:52.509+0000 7faaeb7fe640 1 -- 172.21.15.3:0/1981087250 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7faadc03f070 con 0x7faaec101900 2024-09-21T12:30:52.715 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:52.714+0000 7faaf4290640 1 -- 172.21.15.3:0/1981087250 --> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) -- 0x7faaec19a480 con 0x7faad407af30 2024-09-21T12:30:52.716 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:52.715+0000 7faaeb7fe640 1 -- 172.21.15.3:0/1981087250 <== mgr.14756 v2:172.21.15.3:6800/1284098095 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+175 (secure 0 0 0) 0x7faaec19a480 con 0x7faad407af30 2024-09-21T12:30:52.716 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-21T12:30:52.716 INFO:teuthology.orchestra.run.smithi003.stdout: "target_image": null, 2024-09-21T12:30:52.717 INFO:teuthology.orchestra.run.smithi003.stdout: "in_progress": false, 2024-09-21T12:30:52.717 INFO:teuthology.orchestra.run.smithi003.stdout: "which": "", 2024-09-21T12:30:52.717 INFO:teuthology.orchestra.run.smithi003.stdout: "services_complete": [], 2024-09-21T12:30:52.717 INFO:teuthology.orchestra.run.smithi003.stdout: "progress": null, 2024-09-21T12:30:52.717 INFO:teuthology.orchestra.run.smithi003.stdout: "message": "", 2024-09-21T12:30:52.717 INFO:teuthology.orchestra.run.smithi003.stdout: "is_paused": false 2024-09-21T12:30:52.717 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-21T12:30:52.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:52.717+0000 7faaf4290640 1 -- 172.21.15.3:0/1981087250 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7faad407af30 msgr2=0x7faad407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:30:52.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:52.717+0000 7faaf4290640 1 --2- 172.21.15.3:0/1981087250 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7faad407af30 0x7faad407d3f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7faae00058c0 tx=0x7faae0005850 comp rx=0 tx=0).stop 2024-09-21T12:30:52.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:52.717+0000 7faaf4290640 1 -- 172.21.15.3:0/1981087250 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faaec101900 msgr2=0x7faaec19f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:30:52.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:52.717+0000 7faaf4290640 1 --2- 172.21.15.3:0/1981087250 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faaec101900 0x7faaec19f850 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7faadc02ae90 tx=0x7faadc02f5f0 comp rx=0 tx=0).stop 2024-09-21T12:30:52.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:52.717+0000 7faaf4290640 1 -- 172.21.15.3:0/1981087250 shutdown_connections 2024-09-21T12:30:52.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:52.717+0000 7faaf4290640 1 --2- 172.21.15.3:0/1981087250 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7faad407af30 0x7faad407d3f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:30:52.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:52.717+0000 7faaf4290640 1 --2- 172.21.15.3:0/1981087250 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7faaec107900 0x7faaec19fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:30:52.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:52.717+0000 7faaf4290640 1 --2- 172.21.15.3:0/1981087250 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7faaec101900 0x7faaec19f850 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:30:52.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:52.717+0000 7faaf4290640 1 -- 172.21.15.3:0/1981087250 >> 172.21.15.3:0/1981087250 conn(0x7faaec0fd620 msgr2=0x7faaec074420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:30:52.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:52.717+0000 7faaf4290640 1 -- 172.21.15.3:0/1981087250 shutdown_connections 2024-09-21T12:30:52.719 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:52.717+0000 7faaf4290640 1 -- 172.21.15.3:0/1981087250 wait complete. 2024-09-21T12:30:53.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:53 smithi003 ceph-mon[108723]: from='client.34420 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:30:53.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:53 smithi003 ceph-mon[108723]: pgmap v303: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:30:53.489 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -e sha1=5c1cdc3c470dae78e91a0ed2bcf13509a046d301 -- bash -c 'ceph health detail' 2024-09-21T12:30:53.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:53 smithi192 ceph-mon[80326]: from='client.34420 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:30:53.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:53 smithi192 ceph-mon[80326]: pgmap v303: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:30:53.756 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:30:54.193 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:54.191+0000 7f6787bd8640 1 -- 172.21.15.3:0/1841290874 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6780107900 msgr2=0x7f6780107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:30:54.193 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:54.191+0000 7f6787bd8640 1 --2- 172.21.15.3:0/1841290874 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6780107900 0x7f6780107ce0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f677c009880 tx=0x7f677c02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:30:54.194 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:54.191+0000 7f6787bd8640 1 -- 172.21.15.3:0/1841290874 shutdown_connections 2024-09-21T12:30:54.194 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:54.191+0000 7f6787bd8640 1 --2- 172.21.15.3:0/1841290874 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6780101900 0x7f6780101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:30:54.194 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:54.191+0000 7f6787bd8640 1 --2- 172.21.15.3:0/1841290874 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6780107900 0x7f6780107ce0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:30:54.194 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:54.191+0000 7f6787bd8640 1 -- 172.21.15.3:0/1841290874 >> 172.21.15.3:0/1841290874 conn(0x7f67800fd600 msgr2=0x7f67800ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:30:54.194 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:54.191+0000 7f6787bd8640 1 -- 172.21.15.3:0/1841290874 shutdown_connections 2024-09-21T12:30:54.194 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:54.191+0000 7f6787bd8640 1 -- 172.21.15.3:0/1841290874 wait complete. 2024-09-21T12:30:54.194 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:54.192+0000 7f6787bd8640 1 Processor -- start 2024-09-21T12:30:54.194 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:54.192+0000 7f6787bd8640 1 -- start start 2024-09-21T12:30:54.196 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:54.192+0000 7f6787bd8640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6780101900 0x7f678019d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:30:54.196 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:54.192+0000 7f6787bd8640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6780107900 0x7f678019dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:30:54.196 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:54.192+0000 7f6787bd8640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f678010ee30 con 0x7f6780101900 2024-09-21T12:30:54.196 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:54.192+0000 7f6787bd8640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f678010ecb0 con 0x7f6780107900 2024-09-21T12:30:54.196 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:54.192+0000 7f6785974640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6780101900 0x7f678019d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:30:54.196 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:54.192+0000 7f6785974640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6780101900 0x7f678019d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:52146/0 (socket says 172.21.15.3:52146) 2024-09-21T12:30:54.196 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:54.192+0000 7f6785974640 1 -- 172.21.15.3:0/3419510560 learned_addr learned my addr 172.21.15.3:0/3419510560 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:30:54.196 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:54.193+0000 7f6785173640 1 --2- 172.21.15.3:0/3419510560 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6780107900 0x7f678019dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:30:54.196 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:54.193+0000 7f6785974640 1 -- 172.21.15.3:0/3419510560 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6780107900 msgr2=0x7f678019dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:30:54.196 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:54.193+0000 7f6785974640 1 --2- 172.21.15.3:0/3419510560 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6780107900 0x7f678019dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:30:54.196 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:54.193+0000 7f6785974640 1 -- 172.21.15.3:0/3419510560 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6780197860 con 0x7f6780101900 2024-09-21T12:30:54.196 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:54.193+0000 7f6785173640 1 --2- 172.21.15.3:0/3419510560 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6780107900 0x7f678019dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T12:30:54.196 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:54.193+0000 7f6785974640 1 --2- 172.21.15.3:0/3419510560 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6780101900 0x7f678019d6a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f677c031460 tx=0x7f677c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:30:54.197 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:54.193+0000 7f6776ffd640 1 -- 172.21.15.3:0/3419510560 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f677c03f070 con 0x7f6780101900 2024-09-21T12:30:54.197 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:54.193+0000 7f6787bd8640 1 -- 172.21.15.3:0/3419510560 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6780197af0 con 0x7f6780101900 2024-09-21T12:30:54.197 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:54.193+0000 7f6776ffd640 1 -- 172.21.15.3:0/3419510560 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f677c004cf0 con 0x7f6780101900 2024-09-21T12:30:54.197 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:54.193+0000 7f6776ffd640 1 -- 172.21.15.3:0/3419510560 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f677c035030 con 0x7f6780101900 2024-09-21T12:30:54.197 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:54.193+0000 7f6787bd8640 1 -- 172.21.15.3:0/3419510560 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6780198020 con 0x7f6780101900 2024-09-21T12:30:54.197 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:54.194+0000 7f6787bd8640 1 -- 172.21.15.3:0/3419510560 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6780103040 con 0x7f6780101900 2024-09-21T12:30:54.198 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:54.195+0000 7f6776ffd640 1 -- 172.21.15.3:0/3419510560 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f677c042070 con 0x7f6780101900 2024-09-21T12:30:54.198 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:54.195+0000 7f6776ffd640 1 --2- 172.21.15.3:0/3419510560 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f676c07af30 0x7f676c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:30:54.198 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:54.196+0000 7f6776ffd640 1 -- 172.21.15.3:0/3419510560 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6414+0+0 (secure 0 0 0) 0x7f677c0beca0 con 0x7f6780101900 2024-09-21T12:30:54.198 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:54.196+0000 7f6785173640 1 --2- 172.21.15.3:0/3419510560 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f676c07af30 0x7f676c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:30:54.198 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:54.196+0000 7f6785173640 1 --2- 172.21.15.3:0/3419510560 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f676c07af30 0x7f676c07d3f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6770006fd0 tx=0x7f6770008040 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:30:54.201 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:54.200+0000 7f6776ffd640 1 -- 172.21.15.3:0/3419510560 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f677c08a100 con 0x7f6780101900 2024-09-21T12:30:54.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:54.461+0000 7f6787bd8640 1 -- 172.21.15.3:0/3419510560 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f6780198d90 con 0x7f6780101900 2024-09-21T12:30:54.463 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:54.462+0000 7f6776ffd640 1 -- 172.21.15.3:0/3419510560 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+201 (secure 0 0 0) 0x7f677c08efb0 con 0x7f6780101900 2024-09-21T12:30:54.464 INFO:teuthology.orchestra.run.smithi003.stdout:HEALTH_WARN 1 filesystem with deprecated feature inline_data 2024-09-21T12:30:54.464 INFO:teuthology.orchestra.run.smithi003.stdout:[WRN] FS_INLINE_DATA_DEPRECATED: 1 filesystem with deprecated feature inline_data 2024-09-21T12:30:54.464 INFO:teuthology.orchestra.run.smithi003.stdout: fs cephfs has deprecated feature inline_data enabled. 2024-09-21T12:30:54.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:54.465+0000 7f6787bd8640 1 -- 172.21.15.3:0/3419510560 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f676c07af30 msgr2=0x7f676c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:30:54.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:54.465+0000 7f6787bd8640 1 --2- 172.21.15.3:0/3419510560 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f676c07af30 0x7f676c07d3f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6770006fd0 tx=0x7f6770008040 comp rx=0 tx=0).stop 2024-09-21T12:30:54.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:54.465+0000 7f6787bd8640 1 -- 172.21.15.3:0/3419510560 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6780101900 msgr2=0x7f678019d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:30:54.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:54.465+0000 7f6787bd8640 1 --2- 172.21.15.3:0/3419510560 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6780101900 0x7f678019d6a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f677c031460 tx=0x7f677c0048f0 comp rx=0 tx=0).stop 2024-09-21T12:30:54.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:54.465+0000 7f6787bd8640 1 -- 172.21.15.3:0/3419510560 shutdown_connections 2024-09-21T12:30:54.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:54.465+0000 7f6787bd8640 1 --2- 172.21.15.3:0/3419510560 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f676c07af30 0x7f676c07d3f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:30:54.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:54.465+0000 7f6787bd8640 1 --2- 172.21.15.3:0/3419510560 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6780107900 0x7f678019dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:30:54.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:54.465+0000 7f6787bd8640 1 --2- 172.21.15.3:0/3419510560 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6780101900 0x7f678019d6a0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:30:54.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:54.465+0000 7f6787bd8640 1 -- 172.21.15.3:0/3419510560 >> 172.21.15.3:0/3419510560 conn(0x7f67800fd600 msgr2=0x7f67800fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:30:54.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:54.465+0000 7f6787bd8640 1 -- 172.21.15.3:0/3419510560 shutdown_connections 2024-09-21T12:30:54.467 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:54.465+0000 7f6787bd8640 1 -- 172.21.15.3:0/3419510560 wait complete. 2024-09-21T12:30:54.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:54 smithi003 ceph-mon[108723]: from='client.? 172.21.15.3:0/3419510560' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:30:55.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:54 smithi192 ceph-mon[80326]: from='client.? 172.21.15.3:0/3419510560' entity='client.admin' cmd={"prefix": "health", "detail": "detail"} : dispatch 2024-09-21T12:30:55.100 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -e sha1=5c1cdc3c470dae78e91a0ed2bcf13509a046d301 -- bash -c 'ceph versions' 2024-09-21T12:30:55.361 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:30:55.867 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:55.848+0000 7f0a7e8aa640 1 -- 172.21.15.3:0/3604322178 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0a78107900 msgr2=0x7f0a78107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:30:55.867 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:55.848+0000 7f0a7e8aa640 1 --2- 172.21.15.3:0/3604322178 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0a78107900 0x7f0a78107ce0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f0a68009880 tx=0x7f0a6802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:30:55.867 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:55.848+0000 7f0a7e8aa640 1 -- 172.21.15.3:0/3604322178 shutdown_connections 2024-09-21T12:30:55.867 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:55.848+0000 7f0a7e8aa640 1 --2- 172.21.15.3:0/3604322178 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a78101900 0x7f0a78101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:30:55.867 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:55.848+0000 7f0a7e8aa640 1 --2- 172.21.15.3:0/3604322178 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0a78107900 0x7f0a78107ce0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:30:55.867 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:55.848+0000 7f0a7e8aa640 1 -- 172.21.15.3:0/3604322178 >> 172.21.15.3:0/3604322178 conn(0x7f0a780fd600 msgr2=0x7f0a780ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:30:55.867 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:55.848+0000 7f0a7e8aa640 1 -- 172.21.15.3:0/3604322178 shutdown_connections 2024-09-21T12:30:55.867 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:55.848+0000 7f0a7e8aa640 1 -- 172.21.15.3:0/3604322178 wait complete. 2024-09-21T12:30:55.867 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:55.849+0000 7f0a7e8aa640 1 Processor -- start 2024-09-21T12:30:55.868 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:55.849+0000 7f0a7e8aa640 1 -- start start 2024-09-21T12:30:55.868 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:55.849+0000 7f0a7e8aa640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a78101900 0x7f0a780744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:30:55.868 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:55.849+0000 7f0a7e8aa640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0a78107900 0x7f0a78074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:30:55.868 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:55.849+0000 7f0a7e8aa640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f0a7810ee30 con 0x7f0a78107900 2024-09-21T12:30:55.868 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:55.849+0000 7f0a7e8aa640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f0a7810ecb0 con 0x7f0a78101900 2024-09-21T12:30:55.868 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:55.850+0000 7f0a777fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0a78107900 0x7f0a78074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:30:55.868 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:55.850+0000 7f0a777fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0a78107900 0x7f0a78074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:52168/0 (socket says 172.21.15.3:52168) 2024-09-21T12:30:55.868 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:55.850+0000 7f0a777fe640 1 -- 172.21.15.3:0/576200082 learned_addr learned my addr 172.21.15.3:0/576200082 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:30:55.868 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:55.850+0000 7f0a77fff640 1 --2- 172.21.15.3:0/576200082 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a78101900 0x7f0a780744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:30:55.868 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:55.850+0000 7f0a777fe640 1 -- 172.21.15.3:0/576200082 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a78101900 msgr2=0x7f0a780744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:30:55.868 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:55.850+0000 7f0a777fe640 1 --2- 172.21.15.3:0/576200082 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a78101900 0x7f0a780744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:30:55.868 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:55.850+0000 7f0a777fe640 1 -- 172.21.15.3:0/576200082 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a78074f70 con 0x7f0a78107900 2024-09-21T12:30:55.868 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:55.850+0000 7f0a777fe640 1 --2- 172.21.15.3:0/576200082 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0a78107900 0x7f0a78074a30 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c00b420 tx=0x7f0a6c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:30:55.868 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:55.850+0000 7f0a757fa640 1 -- 172.21.15.3:0/576200082 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0a6c011630 con 0x7f0a78107900 2024-09-21T12:30:55.869 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:55.850+0000 7f0a757fa640 1 -- 172.21.15.3:0/576200082 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f0a6c016070 con 0x7f0a78107900 2024-09-21T12:30:55.869 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:55.850+0000 7f0a7e8aa640 1 -- 172.21.15.3:0/576200082 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a78075260 con 0x7f0a78107900 2024-09-21T12:30:55.869 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:55.850+0000 7f0a757fa640 1 -- 172.21.15.3:0/576200082 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f0a6c010d40 con 0x7f0a78107900 2024-09-21T12:30:55.869 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:55.850+0000 7f0a7e8aa640 1 -- 172.21.15.3:0/576200082 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a781a3ee0 con 0x7f0a78107900 2024-09-21T12:30:55.869 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:55.852+0000 7f0a7e8aa640 1 -- 172.21.15.3:0/576200082 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a78103040 con 0x7f0a78107900 2024-09-21T12:30:55.869 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:55.852+0000 7f0a757fa640 1 -- 172.21.15.3:0/576200082 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f0a6c01b460 con 0x7f0a78107900 2024-09-21T12:30:55.869 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:55.853+0000 7f0a757fa640 1 --2- 172.21.15.3:0/576200082 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f0a6007af80 0x7f0a6007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:30:55.869 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:55.853+0000 7f0a757fa640 1 -- 172.21.15.3:0/576200082 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6414+0+0 (secure 0 0 0) 0x7f0a6c09d7a0 con 0x7f0a78107900 2024-09-21T12:30:55.869 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:55.853+0000 7f0a77fff640 1 --2- 172.21.15.3:0/576200082 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f0a6007af80 0x7f0a6007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:30:55.869 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:55.853+0000 7f0a77fff640 1 --2- 172.21.15.3:0/576200082 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f0a6007af80 0x7f0a6007d440 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0a680096c0 tx=0x7f0a68031400 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:30:55.869 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:55.857+0000 7f0a757fa640 1 -- 172.21.15.3:0/576200082 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f0a6c021250 con 0x7f0a78107900 2024-09-21T12:30:56.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:55 smithi003 ceph-mon[108723]: pgmap v304: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:30:56.123 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:56.122+0000 7f0a7e8aa640 1 -- 172.21.15.3:0/576200082 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7f0a78109e70 con 0x7f0a78107900 2024-09-21T12:30:56.124 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:56.122+0000 7f0a757fa640 1 -- 172.21.15.3:0/576200082 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7f0a6c068d20 con 0x7f0a78107900 2024-09-21T12:30:56.124 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-21T12:30:56.124 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": { 2024-09-21T12:30:56.124 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:30:56.124 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:30:56.124 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": { 2024-09-21T12:30:56.124 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:30:56.124 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:30:56.124 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": { 2024-09-21T12:30:56.124 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 6 2024-09-21T12:30:56.125 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:30:56.125 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": { 2024-09-21T12:30:56.125 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 4 2024-09-21T12:30:56.125 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:30:56.125 INFO:teuthology.orchestra.run.smithi003.stdout: "overall": { 2024-09-21T12:30:56.125 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 14 2024-09-21T12:30:56.125 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-21T12:30:56.125 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-21T12:30:56.126 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:56.124+0000 7f0a7e8aa640 1 -- 172.21.15.3:0/576200082 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f0a6007af80 msgr2=0x7f0a6007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:30:56.126 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:56.124+0000 7f0a7e8aa640 1 --2- 172.21.15.3:0/576200082 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f0a6007af80 0x7f0a6007d440 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f0a680096c0 tx=0x7f0a68031400 comp rx=0 tx=0).stop 2024-09-21T12:30:56.126 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:56.124+0000 7f0a7e8aa640 1 -- 172.21.15.3:0/576200082 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0a78107900 msgr2=0x7f0a78074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:30:56.126 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:56.124+0000 7f0a7e8aa640 1 --2- 172.21.15.3:0/576200082 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0a78107900 0x7f0a78074a30 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c00b420 tx=0x7f0a6c00b8e0 comp rx=0 tx=0).stop 2024-09-21T12:30:56.127 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:56.124+0000 7f0a7e8aa640 1 -- 172.21.15.3:0/576200082 shutdown_connections 2024-09-21T12:30:56.127 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:56.124+0000 7f0a7e8aa640 1 --2- 172.21.15.3:0/576200082 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f0a6007af80 0x7f0a6007d440 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:30:56.127 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:56.124+0000 7f0a7e8aa640 1 --2- 172.21.15.3:0/576200082 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f0a78107900 0x7f0a78074a30 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:30:56.127 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:56.124+0000 7f0a7e8aa640 1 --2- 172.21.15.3:0/576200082 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f0a78101900 0x7f0a780744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:30:56.127 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:56.125+0000 7f0a7e8aa640 1 -- 172.21.15.3:0/576200082 >> 172.21.15.3:0/576200082 conn(0x7f0a780fd600 msgr2=0x7f0a780fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:30:56.127 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:56.125+0000 7f0a7e8aa640 1 -- 172.21.15.3:0/576200082 shutdown_connections 2024-09-21T12:30:56.127 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:30:56.125+0000 7f0a7e8aa640 1 -- 172.21.15.3:0/576200082 wait complete. 2024-09-21T12:30:56.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:55 smithi192 ceph-mon[80326]: pgmap v304: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:30:56.772 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -e sha1=5c1cdc3c470dae78e91a0ed2bcf13509a046d301 -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-09-21T12:30:57.038 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:30:57.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:56 smithi003 ceph-mon[108723]: from='client.? 172.21.15.3:0/576200082' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:30:57.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:56 smithi192 ceph-mon[80326]: from='client.? 172.21.15.3:0/576200082' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:30:57.574 INFO:teuthology.orchestra.run.smithi003.stdout:wait for servicemap items w/ changing names to refresh 2024-09-21T12:30:58.137 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:57 smithi003 ceph-mon[108723]: pgmap v305: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:30:58.168 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -e sha1=5c1cdc3c470dae78e91a0ed2bcf13509a046d301 -- bash -c 'sleep 60' 2024-09-21T12:30:58.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:57 smithi192 ceph-mon[80326]: pgmap v305: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:30:58.433 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:31:00.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:59 smithi003 ceph-mon[108723]: pgmap v306: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:31:00.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:30:59 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:31:00.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:59 smithi192 ceph-mon[80326]: pgmap v306: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:31:00.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:30:59 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:31:02.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:31:01 smithi192 ceph-mon[80326]: pgmap v307: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:31:02.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:31:01 smithi003 ceph-mon[108723]: pgmap v307: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:31:04.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:31:03 smithi192 ceph-mon[80326]: pgmap v308: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:31:04.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:31:03 smithi003 ceph-mon[108723]: pgmap v308: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:31:06.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:31:05 smithi192 ceph-mon[80326]: pgmap v309: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:31:06.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:31:05 smithi003 ceph-mon[108723]: pgmap v309: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:31:08.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:31:07 smithi192 ceph-mon[80326]: pgmap v310: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:31:08.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:31:07 smithi003 ceph-mon[108723]: pgmap v310: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:31:10.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:31:09 smithi192 ceph-mon[80326]: pgmap v311: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:31:10.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:31:09 smithi003 ceph-mon[108723]: pgmap v311: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:31:12.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:31:11 smithi192 ceph-mon[80326]: pgmap v312: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:31:12.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:31:11 smithi003 ceph-mon[108723]: pgmap v312: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:31:14.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:31:13 smithi192 ceph-mon[80326]: pgmap v313: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:31:14.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:31:13 smithi003 ceph-mon[108723]: pgmap v313: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:31:15.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:31:14 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:31:15.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:31:14 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:31:16.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:31:15 smithi192 ceph-mon[80326]: pgmap v314: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:31:16.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:31:15 smithi003 ceph-mon[108723]: pgmap v314: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:31:18.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:31:17 smithi192 ceph-mon[80326]: pgmap v315: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:31:18.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:31:17 smithi003 ceph-mon[108723]: pgmap v315: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:31:20.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:31:19 smithi192 ceph-mon[80326]: pgmap v316: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:31:20.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:31:19 smithi003 ceph-mon[108723]: pgmap v316: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:31:22.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:31:21 smithi192 ceph-mon[80326]: pgmap v317: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:31:22.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:31:21 smithi003 ceph-mon[108723]: pgmap v317: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:31:24.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:31:23 smithi192 ceph-mon[80326]: pgmap v318: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:31:24.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:31:23 smithi003 ceph-mon[108723]: pgmap v318: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:31:26.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:31:25 smithi192 ceph-mon[80326]: pgmap v319: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:31:26.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:31:25 smithi003 ceph-mon[108723]: pgmap v319: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:31:28.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:31:27 smithi192 ceph-mon[80326]: pgmap v320: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:31:28.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:31:27 smithi003 ceph-mon[108723]: pgmap v320: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:31:30.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:31:29 smithi192 ceph-mon[80326]: pgmap v321: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:31:30.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:31:29 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:31:30.301 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:31:29 smithi003 ceph-mon[108723]: pgmap v321: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:31:30.301 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:31:29 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:31:32.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:31:31 smithi003 ceph-mon[108723]: pgmap v322: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:31:32.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:31:31 smithi192 ceph-mon[80326]: pgmap v322: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:31:34.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:31:33 smithi192 ceph-mon[80326]: pgmap v323: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:31:34.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:31:33 smithi003 ceph-mon[108723]: pgmap v323: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:31:35.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:31:35 smithi192 ceph-mon[80326]: pgmap v324: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:31:35.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:31:34 smithi003 ceph-mon[108723]: pgmap v324: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:31:38.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:31:37 smithi192 ceph-mon[80326]: pgmap v325: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:31:38.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:31:37 smithi003 ceph-mon[108723]: pgmap v325: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:31:40.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:31:39 smithi192 ceph-mon[80326]: pgmap v326: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:31:40.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:31:39 smithi003 ceph-mon[108723]: pgmap v326: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:31:42.256 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:31:41 smithi003 ceph-mon[108723]: pgmap v327: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:31:42.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:31:41 smithi192 ceph-mon[80326]: pgmap v327: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:31:44.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:31:43 smithi192 ceph-mon[80326]: pgmap v328: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:31:44.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:31:43 smithi003 ceph-mon[108723]: pgmap v328: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:31:45.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:31:44 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:31:45.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:31:44 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:31:46.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:31:46 smithi192 ceph-mon[80326]: pgmap v329: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:31:46.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:31:45 smithi003 ceph-mon[108723]: pgmap v329: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:31:47.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:31:47 smithi192 ceph-mon[80326]: pgmap v330: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:31:47.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:31:47 smithi003 ceph-mon[108723]: pgmap v330: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:31:50.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:31:49 smithi192 ceph-mon[80326]: pgmap v331: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:31:50.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:31:49 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:31:50.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:31:49 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:31:50.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:31:49 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:31:50.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:31:49 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:31:50.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:31:49 smithi003 ceph-mon[108723]: pgmap v331: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:31:50.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:31:49 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:31:50.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:31:49 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:31:50.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:31:49 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:31:50.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:31:49 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:31:52.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:31:51 smithi192 ceph-mon[80326]: pgmap v332: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:31:52.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:31:51 smithi003 ceph-mon[108723]: pgmap v332: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:31:54.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:31:53 smithi192 ceph-mon[80326]: pgmap v333: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:31:54.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:31:53 smithi003 ceph-mon[108723]: pgmap v333: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:31:56.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:31:55 smithi192 ceph-mon[80326]: pgmap v334: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:31:56.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:31:55 smithi003 ceph-mon[108723]: pgmap v334: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:31:57.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:31:57 smithi192 ceph-mon[80326]: pgmap v335: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:31:57.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:31:57 smithi003 ceph-mon[108723]: pgmap v335: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:31:59.584 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -e sha1=5c1cdc3c470dae78e91a0ed2bcf13509a046d301 -- bash -c 'ceph orch ps' 2024-09-21T12:31:59.851 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:32:00.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:31:59 smithi192 ceph-mon[80326]: pgmap v336: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:32:00.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:31:59 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:32:00.299 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:31:59 smithi003 ceph-mon[108723]: pgmap v336: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:32:00.299 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:31:59 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:32:00.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:00.296+0000 7fc8fe4fb640 1 -- 172.21.15.3:0/3949355179 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc8f81033d0 msgr2=0x7fc8f810b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:00.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:00.296+0000 7fc8fe4fb640 1 --2- 172.21.15.3:0/3949355179 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc8f81033d0 0x7fc8f810b8c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec009880 tx=0x7fc8ec02a530 comp rx=0 tx=0).stop 2024-09-21T12:32:00.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:00.296+0000 7fc8fe4fb640 1 -- 172.21.15.3:0/3949355179 shutdown_connections 2024-09-21T12:32:00.413 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:00.296+0000 7fc8fe4fb640 1 --2- 172.21.15.3:0/3949355179 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc8f81033d0 0x7fc8f810b8c0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:00.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:00.296+0000 7fc8fe4fb640 1 --2- 172.21.15.3:0/3949355179 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8f8102ab0 0x7fc8f8102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:00.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:00.296+0000 7fc8fe4fb640 1 -- 172.21.15.3:0/3949355179 >> 172.21.15.3:0/3949355179 conn(0x7fc8f80fc550 msgr2=0x7fc8f80fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:32:00.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:00.296+0000 7fc8fe4fb640 1 -- 172.21.15.3:0/3949355179 shutdown_connections 2024-09-21T12:32:00.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:00.296+0000 7fc8fe4fb640 1 -- 172.21.15.3:0/3949355179 wait complete. 2024-09-21T12:32:00.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:00.297+0000 7fc8fe4fb640 1 Processor -- start 2024-09-21T12:32:00.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:00.297+0000 7fc8fe4fb640 1 -- start start 2024-09-21T12:32:00.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:00.297+0000 7fc8fe4fb640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8f8102ab0 0x7fc8f819d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:00.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:00.297+0000 7fc8fe4fb640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc8f81033d0 0x7fc8f819dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:00.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:00.297+0000 7fc8fe4fb640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fc8f810ede0 con 0x7fc8f81033d0 2024-09-21T12:32:00.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:00.297+0000 7fc8fe4fb640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc8f810ec60 con 0x7fc8f8102ab0 2024-09-21T12:32:00.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:00.298+0000 7fc8f77fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc8f81033d0 0x7fc8f819dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:00.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:00.298+0000 7fc8f77fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc8f81033d0 0x7fc8f819dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:48060/0 (socket says 172.21.15.3:48060) 2024-09-21T12:32:00.414 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:00.298+0000 7fc8f77fe640 1 -- 172.21.15.3:0/2756863294 learned_addr learned my addr 172.21.15.3:0/2756863294 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:32:00.415 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:00.298+0000 7fc8f7fff640 1 --2- 172.21.15.3:0/2756863294 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8f8102ab0 0x7fc8f819d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:00.415 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:00.298+0000 7fc8f77fe640 1 -- 172.21.15.3:0/2756863294 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8f8102ab0 msgr2=0x7fc8f819d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:00.415 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:00.298+0000 7fc8f77fe640 1 --2- 172.21.15.3:0/2756863294 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8f8102ab0 0x7fc8f819d690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:00.415 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:00.298+0000 7fc8f77fe640 1 -- 172.21.15.3:0/2756863294 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8f8197810 con 0x7fc8f81033d0 2024-09-21T12:32:00.415 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:00.298+0000 7fc8f77fe640 1 --2- 172.21.15.3:0/2756863294 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc8f81033d0 0x7fc8f819dbd0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec031460 tx=0x7fc8ec004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:32:00.415 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:00.298+0000 7fc8f57fa640 1 -- 172.21.15.3:0/2756863294 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc8ec03f070 con 0x7fc8f81033d0 2024-09-21T12:32:00.415 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:00.298+0000 7fc8fe4fb640 1 -- 172.21.15.3:0/2756863294 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8f8197aa0 con 0x7fc8f81033d0 2024-09-21T12:32:00.415 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:00.298+0000 7fc8f57fa640 1 -- 172.21.15.3:0/2756863294 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc8ec0035f0 con 0x7fc8f81033d0 2024-09-21T12:32:00.415 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:00.298+0000 7fc8f57fa640 1 -- 172.21.15.3:0/2756863294 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc8ec035030 con 0x7fc8f81033d0 2024-09-21T12:32:00.415 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:00.299+0000 7fc8fe4fb640 1 -- 172.21.15.3:0/2756863294 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8f8197fd0 con 0x7fc8f81033d0 2024-09-21T12:32:00.415 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:00.299+0000 7fc8fe4fb640 1 -- 172.21.15.3:0/2756863294 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8f806a580 con 0x7fc8f81033d0 2024-09-21T12:32:00.415 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:00.300+0000 7fc8f57fa640 1 -- 172.21.15.3:0/2756863294 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7fc8ec042070 con 0x7fc8f81033d0 2024-09-21T12:32:00.415 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:00.301+0000 7fc8f57fa640 1 --2- 172.21.15.3:0/2756863294 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fc8e007af30 0x7fc8e007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:00.415 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:00.301+0000 7fc8f57fa640 1 -- 172.21.15.3:0/2756863294 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6414+0+0 (secure 0 0 0) 0x7fc8ec0bea60 con 0x7fc8f81033d0 2024-09-21T12:32:00.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:00.301+0000 7fc8f7fff640 1 --2- 172.21.15.3:0/2756863294 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fc8e007af30 0x7fc8e007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:00.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:00.301+0000 7fc8f7fff640 1 --2- 172.21.15.3:0/2756863294 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fc8e007af30 0x7fc8e007d3f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc8e8005fd0 tx=0x7fc8e800b390 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:32:00.416 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:00.305+0000 7fc8f57fa640 1 -- 172.21.15.3:0/2756863294 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc8ec089f00 con 0x7fc8f81033d0 2024-09-21T12:32:00.507 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:00.504+0000 7fc8fe4fb640 1 -- 172.21.15.3:0/2756863294 --> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fc8f8198340 con 0x7fc8e007af30 2024-09-21T12:32:00.517 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:00.515+0000 7fc8f57fa640 1 -- 172.21.15.3:0/2756863294 <== mgr.14756 v2:172.21.15.3:6800/1284098095 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3816 (secure 0 0 0) 0x7fc8f8198340 con 0x7fc8e007af30 2024-09-21T12:32:00.517 INFO:teuthology.orchestra.run.smithi003.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-21T12:32:00.517 INFO:teuthology.orchestra.run.smithi003.stdout:alertmanager.smithi003 smithi003 *:9093,9094 running (8m) 76s ago 19m 19.1M - 0.27.0 11f11916f8cd 14880018dfd3 2024-09-21T12:32:00.518 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-exporter.smithi003 smithi003 running (86s) 76s ago 19m 7768k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 c7b4bd7c2ae1 2024-09-21T12:32:00.518 INFO:teuthology.orchestra.run.smithi003.stdout:ceph-exporter.smithi192 smithi192 running (81s) 78s ago 19m 7335k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 dcb2f77d3cf2 2024-09-21T12:32:00.518 INFO:teuthology.orchestra.run.smithi003.stdout:crash.smithi003 smithi003 running (6m) 76s ago 19m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 0ada67250dba 2024-09-21T12:32:00.518 INFO:teuthology.orchestra.run.smithi003.stdout:crash.smithi192 smithi192 running (6m) 78s ago 19m 6895k - 19.3.0-5103-g5c1cdc3c 8f4d013db793 52e279085b2e 2024-09-21T12:32:00.518 INFO:teuthology.orchestra.run.smithi003.stdout:grafana.smithi003 smithi003 *:3000 running (8m) 76s ago 19m 81.1M - 10.4.8 5aad1d7cf004 19e26b3cb585 2024-09-21T12:32:00.518 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi003.ebjgyl smithi003 running (2m) 76s ago 14m 85.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 8579e4fc4f05 2024-09-21T12:32:00.518 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi003.gfkngj smithi003 running (2m) 76s ago 14m 15.7M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 7b3dec4f76e2 2024-09-21T12:32:00.518 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi192.ktdqns smithi192 running (99s) 78s ago 14m 13.8M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 a893899a58c0 2024-09-21T12:32:00.518 INFO:teuthology.orchestra.run.smithi003.stdout:mds.cephfs.smithi192.ywqqxe smithi192 running (2m) 78s ago 14m 13.9M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 b8882783ef02 2024-09-21T12:32:00.518 INFO:teuthology.orchestra.run.smithi003.stdout:mgr.smithi003.wztftl smithi003 *:8443,9283,8765 running (10m) 76s ago 20m 530M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 8ce0e66fd369 2024-09-21T12:32:00.518 INFO:teuthology.orchestra.run.smithi003.stdout:mgr.smithi192.qsaprd smithi192 *:8443,9283,8765 running (9m) 78s ago 18m 459M - 19.3.0-5103-g5c1cdc3c 8f4d013db793 002a6171dd47 2024-09-21T12:32:00.518 INFO:teuthology.orchestra.run.smithi003.stdout:mon.smithi003 smithi003 running (7m) 76s ago 21m 52.6M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 4f2b2b2daf19 2024-09-21T12:32:00.519 INFO:teuthology.orchestra.run.smithi003.stdout:mon.smithi192 smithi192 running (6m) 78s ago 18m 44.2M 2048M 19.3.0-5103-g5c1cdc3c 8f4d013db793 11edc5c1baba 2024-09-21T12:32:00.519 INFO:teuthology.orchestra.run.smithi003.stdout:node-exporter.smithi003 smithi003 *:9100 running (9m) 76s ago 19m 9.85M - 1.7.0 72c9c2088986 d9cb7ede9060 2024-09-21T12:32:00.519 INFO:teuthology.orchestra.run.smithi003.stdout:node-exporter.smithi192 smithi192 *:9100 running (9m) 78s ago 18m 11.9M - 1.7.0 72c9c2088986 d8ec0acfce7e 2024-09-21T12:32:00.519 INFO:teuthology.orchestra.run.smithi003.stdout:osd.0 smithi003 running (6m) 76s ago 17m 93.4M 1217M 19.3.0-5103-g5c1cdc3c 8f4d013db793 0f2234f333ec 2024-09-21T12:32:00.519 INFO:teuthology.orchestra.run.smithi003.stdout:osd.1 smithi003 running (5m) 76s ago 17m 98.2M 1217M 19.3.0-5103-g5c1cdc3c 8f4d013db793 198ba21d0518 2024-09-21T12:32:00.519 INFO:teuthology.orchestra.run.smithi003.stdout:osd.2 smithi003 running (4m) 76s ago 16m 86.0M 1217M 19.3.0-5103-g5c1cdc3c 8f4d013db793 e630341e13d4 2024-09-21T12:32:00.519 INFO:teuthology.orchestra.run.smithi003.stdout:osd.3 smithi192 running (4m) 78s ago 16m 114M 2240M 19.3.0-5103-g5c1cdc3c 8f4d013db793 1b5fae2f2dd9 2024-09-21T12:32:00.519 INFO:teuthology.orchestra.run.smithi003.stdout:osd.4 smithi192 running (3m) 78s ago 15m 99.8M 2240M 19.3.0-5103-g5c1cdc3c 8f4d013db793 5b1bd4bec479 2024-09-21T12:32:00.519 INFO:teuthology.orchestra.run.smithi003.stdout:osd.5 smithi192 running (3m) 78s ago 15m 93.1M 2240M 19.3.0-5103-g5c1cdc3c 8f4d013db793 584f3f612483 2024-09-21T12:32:00.519 INFO:teuthology.orchestra.run.smithi003.stdout:prometheus.smithi003 smithi003 *:9095 running (8m) 76s ago 19m 56.7M - 2.51.0 1d3b7f56885b 64997a33fbbb 2024-09-21T12:32:00.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:00.517+0000 7fc8fe4fb640 1 -- 172.21.15.3:0/2756863294 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fc8e007af30 msgr2=0x7fc8e007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:00.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:00.517+0000 7fc8fe4fb640 1 --2- 172.21.15.3:0/2756863294 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fc8e007af30 0x7fc8e007d3f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc8e8005fd0 tx=0x7fc8e800b390 comp rx=0 tx=0).stop 2024-09-21T12:32:00.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:00.517+0000 7fc8fe4fb640 1 -- 172.21.15.3:0/2756863294 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc8f81033d0 msgr2=0x7fc8f819dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:00.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:00.517+0000 7fc8fe4fb640 1 --2- 172.21.15.3:0/2756863294 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc8f81033d0 0x7fc8f819dbd0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec031460 tx=0x7fc8ec004530 comp rx=0 tx=0).stop 2024-09-21T12:32:00.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:00.517+0000 7fc8fe4fb640 1 -- 172.21.15.3:0/2756863294 shutdown_connections 2024-09-21T12:32:00.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:00.517+0000 7fc8fe4fb640 1 --2- 172.21.15.3:0/2756863294 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fc8e007af30 0x7fc8e007d3f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:00.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:00.517+0000 7fc8fe4fb640 1 --2- 172.21.15.3:0/2756863294 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc8f81033d0 0x7fc8f819dbd0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:00.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:00.517+0000 7fc8fe4fb640 1 --2- 172.21.15.3:0/2756863294 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc8f8102ab0 0x7fc8f819d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:00.520 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:00.517+0000 7fc8fe4fb640 1 -- 172.21.15.3:0/2756863294 >> 172.21.15.3:0/2756863294 conn(0x7fc8f80fc550 msgr2=0x7fc8f8108ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:32:00.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:00.517+0000 7fc8fe4fb640 1 -- 172.21.15.3:0/2756863294 shutdown_connections 2024-09-21T12:32:00.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:00.517+0000 7fc8fe4fb640 1 -- 172.21.15.3:0/2756863294 wait complete. 2024-09-21T12:32:01.289 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -e sha1=5c1cdc3c470dae78e91a0ed2bcf13509a046d301 -- bash -c 'ceph versions' 2024-09-21T12:32:01.558 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:32:02.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:02.054+0000 7fe6c52a7640 1 -- 172.21.15.3:0/3405752957 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe6c01033d0 msgr2=0x7fe6c010b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:02.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:02.054+0000 7fe6c52a7640 1 --2- 172.21.15.3:0/3405752957 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe6c01033d0 0x7fe6c010b8c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe6a8009880 tx=0x7fe6a802a530 comp rx=0 tx=0).stop 2024-09-21T12:32:02.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:02.054+0000 7fe6c52a7640 1 -- 172.21.15.3:0/3405752957 shutdown_connections 2024-09-21T12:32:02.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:02.054+0000 7fe6c52a7640 1 --2- 172.21.15.3:0/3405752957 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe6c01033d0 0x7fe6c010b8c0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:02.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:02.054+0000 7fe6c52a7640 1 --2- 172.21.15.3:0/3405752957 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6c0102ab0 0x7fe6c0102e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:02.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:02.054+0000 7fe6c52a7640 1 -- 172.21.15.3:0/3405752957 >> 172.21.15.3:0/3405752957 conn(0x7fe6c00fc4d0 msgr2=0x7fe6c00fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:32:02.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:02.054+0000 7fe6c52a7640 1 -- 172.21.15.3:0/3405752957 shutdown_connections 2024-09-21T12:32:02.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:02.054+0000 7fe6c52a7640 1 -- 172.21.15.3:0/3405752957 wait complete. 2024-09-21T12:32:02.080 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:02.054+0000 7fe6c52a7640 1 Processor -- start 2024-09-21T12:32:02.081 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:02.055+0000 7fe6c52a7640 1 -- start start 2024-09-21T12:32:02.081 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:02.055+0000 7fe6c52a7640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6c0102ab0 0x7fe6c019d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:02.081 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:02.055+0000 7fe6c52a7640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe6c01033d0 0x7fe6c019dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:02.081 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:02.055+0000 7fe6c52a7640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fe6c010ede0 con 0x7fe6c01033d0 2024-09-21T12:32:02.081 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:02.055+0000 7fe6c52a7640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fe6c010ec60 con 0x7fe6c0102ab0 2024-09-21T12:32:02.081 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:02.055+0000 7fe6be7fc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe6c01033d0 0x7fe6c019dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:02.081 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:02.055+0000 7fe6be7fc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe6c01033d0 0x7fe6c019dbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33810/0 (socket says 172.21.15.3:33810) 2024-09-21T12:32:02.081 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:02.055+0000 7fe6be7fc640 1 -- 172.21.15.3:0/2317164064 learned_addr learned my addr 172.21.15.3:0/2317164064 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:32:02.081 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:02.055+0000 7fe6be7fc640 1 -- 172.21.15.3:0/2317164064 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6c0102ab0 msgr2=0x7fe6c019d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:02.081 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:02.055+0000 7fe6be7fc640 1 --2- 172.21.15.3:0/2317164064 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6c0102ab0 0x7fe6c019d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:02.081 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:02.055+0000 7fe6be7fc640 1 -- 172.21.15.3:0/2317164064 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6c0197830 con 0x7fe6c01033d0 2024-09-21T12:32:02.081 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:02.056+0000 7fe6be7fc640 1 --2- 172.21.15.3:0/2317164064 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe6c01033d0 0x7fe6c019dbf0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe6a8031460 tx=0x7fe6a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:32:02.081 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:02.056+0000 7fe6b7fff640 1 -- 172.21.15.3:0/2317164064 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe6a803f070 con 0x7fe6c01033d0 2024-09-21T12:32:02.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:02.056+0000 7fe6b7fff640 1 -- 172.21.15.3:0/2317164064 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fe6a8004ac0 con 0x7fe6c01033d0 2024-09-21T12:32:02.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:02.056+0000 7fe6c52a7640 1 -- 172.21.15.3:0/2317164064 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6c0197ac0 con 0x7fe6c01033d0 2024-09-21T12:32:02.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:02.056+0000 7fe6b7fff640 1 -- 172.21.15.3:0/2317164064 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fe6a8035030 con 0x7fe6c01033d0 2024-09-21T12:32:02.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:02.056+0000 7fe6c52a7640 1 -- 172.21.15.3:0/2317164064 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6c0197ff0 con 0x7fe6c01033d0 2024-09-21T12:32:02.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:02.057+0000 7fe6c52a7640 1 -- 172.21.15.3:0/2317164064 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6c006ada0 con 0x7fe6c01033d0 2024-09-21T12:32:02.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:02.058+0000 7fe6b7fff640 1 -- 172.21.15.3:0/2317164064 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7fe6a8042070 con 0x7fe6c01033d0 2024-09-21T12:32:02.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:02.058+0000 7fe6b7fff640 1 --2- 172.21.15.3:0/2317164064 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fe6ac07af90 0x7fe6ac07d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:02.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:02.058+0000 7fe6b7fff640 1 -- 172.21.15.3:0/2317164064 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6414+0+0 (secure 0 0 0) 0x7fe6a80bead0 con 0x7fe6c01033d0 2024-09-21T12:32:02.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:02.058+0000 7fe6beffd640 1 --2- 172.21.15.3:0/2317164064 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fe6ac07af90 0x7fe6ac07d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:02.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:02.059+0000 7fe6beffd640 1 --2- 172.21.15.3:0/2317164064 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fe6ac07af90 0x7fe6ac07d450 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe6b800a8f0 tx=0x7fe6b8005bf0 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:32:02.082 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:02.063+0000 7fe6b7fff640 1 -- 172.21.15.3:0/2317164064 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fe6a808a050 con 0x7fe6c01033d0 2024-09-21T12:32:02.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:32:01 smithi192 ceph-mon[80326]: from='client.34432 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:32:02.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:32:01 smithi192 ceph-mon[80326]: pgmap v337: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:32:02.328 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:02.326+0000 7fe6c52a7640 1 -- 172.21.15.3:0/2317164064 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fe6c0105f50 con 0x7fe6c01033d0 2024-09-21T12:32:02.328 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:32:01 smithi003 ceph-mon[108723]: from='client.34432 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-21T12:32:02.328 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:32:01 smithi003 ceph-mon[108723]: pgmap v337: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:32:02.329 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:02.326+0000 7fe6b7fff640 1 -- 172.21.15.3:0/2317164064 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7fe6a808ef00 con 0x7fe6c01033d0 2024-09-21T12:32:02.329 INFO:teuthology.orchestra.run.smithi003.stdout:{ 2024-09-21T12:32:02.329 INFO:teuthology.orchestra.run.smithi003.stdout: "mon": { 2024-09-21T12:32:02.329 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:32:02.329 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:32:02.329 INFO:teuthology.orchestra.run.smithi003.stdout: "mgr": { 2024-09-21T12:32:02.329 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 2 2024-09-21T12:32:02.330 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:32:02.330 INFO:teuthology.orchestra.run.smithi003.stdout: "osd": { 2024-09-21T12:32:02.330 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 6 2024-09-21T12:32:02.330 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:32:02.330 INFO:teuthology.orchestra.run.smithi003.stdout: "mds": { 2024-09-21T12:32:02.330 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 4 2024-09-21T12:32:02.330 INFO:teuthology.orchestra.run.smithi003.stdout: }, 2024-09-21T12:32:02.330 INFO:teuthology.orchestra.run.smithi003.stdout: "overall": { 2024-09-21T12:32:02.330 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)": 14 2024-09-21T12:32:02.330 INFO:teuthology.orchestra.run.smithi003.stdout: } 2024-09-21T12:32:02.330 INFO:teuthology.orchestra.run.smithi003.stdout:} 2024-09-21T12:32:02.331 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:02.328+0000 7fe6c52a7640 1 -- 172.21.15.3:0/2317164064 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fe6ac07af90 msgr2=0x7fe6ac07d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:02.331 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:02.328+0000 7fe6c52a7640 1 --2- 172.21.15.3:0/2317164064 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fe6ac07af90 0x7fe6ac07d450 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fe6b800a8f0 tx=0x7fe6b8005bf0 comp rx=0 tx=0).stop 2024-09-21T12:32:02.331 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:02.328+0000 7fe6c52a7640 1 -- 172.21.15.3:0/2317164064 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe6c01033d0 msgr2=0x7fe6c019dbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:02.331 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:02.328+0000 7fe6c52a7640 1 --2- 172.21.15.3:0/2317164064 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe6c01033d0 0x7fe6c019dbf0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fe6a8031460 tx=0x7fe6a80046c0 comp rx=0 tx=0).stop 2024-09-21T12:32:02.331 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:02.328+0000 7fe6c52a7640 1 -- 172.21.15.3:0/2317164064 shutdown_connections 2024-09-21T12:32:02.331 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:02.328+0000 7fe6c52a7640 1 --2- 172.21.15.3:0/2317164064 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fe6ac07af90 0x7fe6ac07d450 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:02.331 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:02.328+0000 7fe6c52a7640 1 --2- 172.21.15.3:0/2317164064 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fe6c01033d0 0x7fe6c019dbf0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:02.331 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:02.328+0000 7fe6c52a7640 1 --2- 172.21.15.3:0/2317164064 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fe6c0102ab0 0x7fe6c019d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:02.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:02.328+0000 7fe6c52a7640 1 -- 172.21.15.3:0/2317164064 >> 172.21.15.3:0/2317164064 conn(0x7fe6c00fc4d0 msgr2=0x7fe6c0108f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:32:02.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:02.329+0000 7fe6c52a7640 1 -- 172.21.15.3:0/2317164064 shutdown_connections 2024-09-21T12:32:02.332 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:02.329+0000 7fe6c52a7640 1 -- 172.21.15.3:0/2317164064 wait complete. 2024-09-21T12:32:03.015 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -e sha1=5c1cdc3c470dae78e91a0ed2bcf13509a046d301 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-09-21T12:32:03.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:32:02 smithi192 ceph-mon[80326]: from='client.? 172.21.15.3:0/2317164064' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:32:03.277 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:32:03.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:32:02 smithi003 ceph-mon[108723]: from='client.? 172.21.15.3:0/2317164064' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:32:03.746 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:03.725+0000 7fa753139640 1 -- 172.21.15.3:0/1930637734 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa74c101900 msgr2=0x7fa74c101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:03.746 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:03.725+0000 7fa753139640 1 --2- 172.21.15.3:0/1930637734 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa74c101900 0x7fa74c101d60 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa738009880 tx=0x7fa73802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:32:03.746 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:03.725+0000 7fa753139640 1 -- 172.21.15.3:0/1930637734 shutdown_connections 2024-09-21T12:32:03.746 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:03.725+0000 7fa753139640 1 --2- 172.21.15.3:0/1930637734 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa74c101900 0x7fa74c101d60 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:03.746 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:03.725+0000 7fa753139640 1 --2- 172.21.15.3:0/1930637734 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa74c107900 0x7fa74c107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:03.746 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:03.725+0000 7fa753139640 1 -- 172.21.15.3:0/1930637734 >> 172.21.15.3:0/1930637734 conn(0x7fa74c0fd600 msgr2=0x7fa74c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:32:03.746 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:03.725+0000 7fa753139640 1 -- 172.21.15.3:0/1930637734 shutdown_connections 2024-09-21T12:32:03.746 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:03.725+0000 7fa753139640 1 -- 172.21.15.3:0/1930637734 wait complete. 2024-09-21T12:32:03.747 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:03.726+0000 7fa753139640 1 Processor -- start 2024-09-21T12:32:03.747 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:03.726+0000 7fa753139640 1 -- start start 2024-09-21T12:32:03.747 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:03.726+0000 7fa753139640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa74c101900 0x7fa74c19d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:03.747 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:03.726+0000 7fa753139640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa74c107900 0x7fa74c19dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:03.747 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:03.726+0000 7fa753139640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fa74c10edd0 con 0x7fa74c107900 2024-09-21T12:32:03.747 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:03.726+0000 7fa753139640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fa74c10ec50 con 0x7fa74c101900 2024-09-21T12:32:03.747 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:03.726+0000 7fa74bfff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa74c107900 0x7fa74c19dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:03.747 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:03.726+0000 7fa74bfff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa74c107900 0x7fa74c19dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33818/0 (socket says 172.21.15.3:33818) 2024-09-21T12:32:03.747 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:03.726+0000 7fa74bfff640 1 -- 172.21.15.3:0/3285109275 learned_addr learned my addr 172.21.15.3:0/3285109275 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:32:03.747 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:03.726+0000 7fa750ed5640 1 --2- 172.21.15.3:0/3285109275 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa74c101900 0x7fa74c19d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:03.747 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:03.727+0000 7fa74bfff640 1 -- 172.21.15.3:0/3285109275 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa74c101900 msgr2=0x7fa74c19d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:03.747 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:03.727+0000 7fa74bfff640 1 --2- 172.21.15.3:0/3285109275 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa74c101900 0x7fa74c19d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:03.747 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:03.727+0000 7fa74bfff640 1 -- 172.21.15.3:0/3285109275 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa74c197800 con 0x7fa74c107900 2024-09-21T12:32:03.747 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:03.727+0000 7fa74bfff640 1 --2- 172.21.15.3:0/3285109275 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa74c107900 0x7fa74c19dbc0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa738031460 tx=0x7fa7380045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:32:03.748 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:03.727+0000 7fa749ffb640 1 -- 172.21.15.3:0/3285109275 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa73803f070 con 0x7fa74c107900 2024-09-21T12:32:03.748 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:03.727+0000 7fa749ffb640 1 -- 172.21.15.3:0/3285109275 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fa7380035f0 con 0x7fa74c107900 2024-09-21T12:32:03.748 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:03.727+0000 7fa753139640 1 -- 172.21.15.3:0/3285109275 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa74c197a90 con 0x7fa74c107900 2024-09-21T12:32:03.748 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:03.727+0000 7fa749ffb640 1 -- 172.21.15.3:0/3285109275 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fa738035030 con 0x7fa74c107900 2024-09-21T12:32:03.748 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:03.727+0000 7fa753139640 1 -- 172.21.15.3:0/3285109275 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa74c197fc0 con 0x7fa74c107900 2024-09-21T12:32:03.748 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:03.728+0000 7fa753139640 1 -- 172.21.15.3:0/3285109275 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa74c103040 con 0x7fa74c107900 2024-09-21T12:32:03.748 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:03.729+0000 7fa749ffb640 1 -- 172.21.15.3:0/3285109275 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7fa738042070 con 0x7fa74c107900 2024-09-21T12:32:03.748 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:03.730+0000 7fa749ffb640 1 --2- 172.21.15.3:0/3285109275 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fa73c07af30 0x7fa73c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:03.748 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:03.730+0000 7fa750ed5640 1 --2- 172.21.15.3:0/3285109275 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fa73c07af30 0x7fa73c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:03.748 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:03.730+0000 7fa749ffb640 1 -- 172.21.15.3:0/3285109275 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6414+0+0 (secure 0 0 0) 0x7fa7380bea70 con 0x7fa74c107900 2024-09-21T12:32:03.748 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:03.730+0000 7fa750ed5640 1 --2- 172.21.15.3:0/3285109275 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fa73c07af30 0x7fa73c07d3f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa740005fd0 tx=0x7fa74000b390 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:32:03.748 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:03.734+0000 7fa749ffb640 1 -- 172.21.15.3:0/3285109275 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fa738089f70 con 0x7fa74c107900 2024-09-21T12:32:04.007 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:04.004+0000 7fa753139640 1 -- 172.21.15.3:0/3285109275 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fa74c109e70 con 0x7fa74c107900 2024-09-21T12:32:04.007 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:04.004+0000 7fa749ffb640 1 -- 172.21.15.3:0/3285109275 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7fa73808ee20 con 0x7fa74c107900 2024-09-21T12:32:04.009 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:04.006+0000 7fa753139640 1 -- 172.21.15.3:0/3285109275 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fa73c07af30 msgr2=0x7fa73c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:04.009 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:04.006+0000 7fa753139640 1 --2- 172.21.15.3:0/3285109275 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fa73c07af30 0x7fa73c07d3f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa740005fd0 tx=0x7fa74000b390 comp rx=0 tx=0).stop 2024-09-21T12:32:04.009 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:04.006+0000 7fa753139640 1 -- 172.21.15.3:0/3285109275 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa74c107900 msgr2=0x7fa74c19dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:04.009 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:04.006+0000 7fa753139640 1 --2- 172.21.15.3:0/3285109275 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa74c107900 0x7fa74c19dbc0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa738031460 tx=0x7fa7380045e0 comp rx=0 tx=0).stop 2024-09-21T12:32:04.009 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:04.006+0000 7fa753139640 1 -- 172.21.15.3:0/3285109275 shutdown_connections 2024-09-21T12:32:04.009 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:04.006+0000 7fa753139640 1 --2- 172.21.15.3:0/3285109275 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fa73c07af30 0x7fa73c07d3f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:04.009 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:04.006+0000 7fa753139640 1 --2- 172.21.15.3:0/3285109275 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fa74c107900 0x7fa74c19dbc0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:04.010 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:04.007+0000 7fa753139640 1 --2- 172.21.15.3:0/3285109275 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fa74c101900 0x7fa74c19d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:04.010 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:04.007+0000 7fa753139640 1 -- 172.21.15.3:0/3285109275 >> 172.21.15.3:0/3285109275 conn(0x7fa74c0fd600 msgr2=0x7fa74c0fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:32:04.010 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:04.007+0000 7fa753139640 1 -- 172.21.15.3:0/3285109275 shutdown_connections 2024-09-21T12:32:04.010 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:04.007+0000 7fa753139640 1 -- 172.21.15.3:0/3285109275 wait complete. 2024-09-21T12:32:04.018 INFO:teuthology.orchestra.run.smithi003.stdout:true 2024-09-21T12:32:04.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:32:03 smithi192 ceph-mon[80326]: pgmap v338: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:32:04.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:32:03 smithi003 ceph-mon[108723]: pgmap v338: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:32:04.731 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -e sha1=5c1cdc3c470dae78e91a0ed2bcf13509a046d301 -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-09-21T12:32:04.992 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:32:05.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:32:05 smithi192 ceph-mon[80326]: from='client.? 172.21.15.3:0/3285109275' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:32:05.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:32:05 smithi003 ceph-mon[108723]: from='client.? 172.21.15.3:0/3285109275' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:32:05.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:05.430+0000 7fcacdfac640 1 -- 172.21.15.3:0/4153547611 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcac8101900 msgr2=0x7fcac8101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:05.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:05.430+0000 7fcacdfac640 1 --2- 172.21.15.3:0/4153547611 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcac8101900 0x7fcac8101d60 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fcab0009880 tx=0x7fcab002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:32:05.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:05.430+0000 7fcacdfac640 1 -- 172.21.15.3:0/4153547611 shutdown_connections 2024-09-21T12:32:05.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:05.430+0000 7fcacdfac640 1 --2- 172.21.15.3:0/4153547611 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcac8101900 0x7fcac8101d60 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:05.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:05.430+0000 7fcacdfac640 1 --2- 172.21.15.3:0/4153547611 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcac8107900 0x7fcac8107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:05.437 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:05.430+0000 7fcacdfac640 1 -- 172.21.15.3:0/4153547611 >> 172.21.15.3:0/4153547611 conn(0x7fcac80fd600 msgr2=0x7fcac80ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:32:05.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:05.430+0000 7fcacdfac640 1 -- 172.21.15.3:0/4153547611 shutdown_connections 2024-09-21T12:32:05.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:05.430+0000 7fcacdfac640 1 -- 172.21.15.3:0/4153547611 wait complete. 2024-09-21T12:32:05.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:05.431+0000 7fcacdfac640 1 Processor -- start 2024-09-21T12:32:05.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:05.431+0000 7fcacdfac640 1 -- start start 2024-09-21T12:32:05.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:05.431+0000 7fcacdfac640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcac8101900 0x7fcac819d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:05.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:05.431+0000 7fcacdfac640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcac8107900 0x7fcac819dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:05.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:05.431+0000 7fcacdfac640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fcac810edd0 con 0x7fcac8101900 2024-09-21T12:32:05.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:05.431+0000 7fcacdfac640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fcac810ec50 con 0x7fcac8107900 2024-09-21T12:32:05.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:05.431+0000 7fcac77fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcac8101900 0x7fcac819d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:05.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:05.431+0000 7fcac77fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcac8101900 0x7fcac819d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33848/0 (socket says 172.21.15.3:33848) 2024-09-21T12:32:05.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:05.431+0000 7fcac77fe640 1 -- 172.21.15.3:0/3425772381 learned_addr learned my addr 172.21.15.3:0/3425772381 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:32:05.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:05.432+0000 7fcac77fe640 1 -- 172.21.15.3:0/3425772381 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcac8107900 msgr2=0x7fcac819dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:05.438 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:05.432+0000 7fcabffff640 1 --2- 172.21.15.3:0/3425772381 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcac8107900 0x7fcac819dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:05.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:05.432+0000 7fcac77fe640 1 --2- 172.21.15.3:0/3425772381 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcac8107900 0x7fcac819dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:05.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:05.432+0000 7fcac77fe640 1 -- 172.21.15.3:0/3425772381 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcac8197800 con 0x7fcac8101900 2024-09-21T12:32:05.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:05.432+0000 7fcac77fe640 1 --2- 172.21.15.3:0/3425772381 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcac8101900 0x7fcac819d680 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcab800d6f0 tx=0x7fcab800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:32:05.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:05.432+0000 7fcac57fa640 1 -- 172.21.15.3:0/3425772381 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcab8017070 con 0x7fcac8101900 2024-09-21T12:32:05.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:05.432+0000 7fcacdfac640 1 -- 172.21.15.3:0/3425772381 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcac8197af0 con 0x7fcac8101900 2024-09-21T12:32:05.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:05.432+0000 7fcac57fa640 1 -- 172.21.15.3:0/3425772381 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcab800de00 con 0x7fcac8101900 2024-09-21T12:32:05.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:05.432+0000 7fcac57fa640 1 -- 172.21.15.3:0/3425772381 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcab8004bb0 con 0x7fcac8101900 2024-09-21T12:32:05.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:05.432+0000 7fcacdfac640 1 -- 172.21.15.3:0/3425772381 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcac8198080 con 0x7fcac8101900 2024-09-21T12:32:05.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:05.434+0000 7fcacdfac640 1 -- 172.21.15.3:0/3425772381 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcac8103040 con 0x7fcac8101900 2024-09-21T12:32:05.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:05.434+0000 7fcac57fa640 1 -- 172.21.15.3:0/3425772381 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7fcab8004e60 con 0x7fcac8101900 2024-09-21T12:32:05.439 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:05.434+0000 7fcac57fa640 1 --2- 172.21.15.3:0/3425772381 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fcab407f340 0x7fcab4081800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:05.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:05.434+0000 7fcabffff640 1 --2- 172.21.15.3:0/3425772381 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fcab407f340 0x7fcab4081800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:05.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:05.434+0000 7fcac57fa640 1 -- 172.21.15.3:0/3425772381 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6414+0+0 (secure 0 0 0) 0x7fcab809dd50 con 0x7fcac8101900 2024-09-21T12:32:05.440 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:05.436+0000 7fcabffff640 1 --2- 172.21.15.3:0/3425772381 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fcab407f340 0x7fcab4081800 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fcab0031460 tx=0x7fcab0009560 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:32:05.441 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:05.439+0000 7fcac57fa640 1 -- 172.21.15.3:0/3425772381 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcab8069250 con 0x7fcac8101900 2024-09-21T12:32:05.704 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:05.702+0000 7fcacdfac640 1 -- 172.21.15.3:0/3425772381 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "versions"} v 0) -- 0x7fcac8109e70 con 0x7fcac8101900 2024-09-21T12:32:05.704 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:05.703+0000 7fcac57fa640 1 -- 172.21.15.3:0/3425772381 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) ==== 56+0+623 (secure 0 0 0) 0x7fcab806e100 con 0x7fcac8101900 2024-09-21T12:32:05.707 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:05.705+0000 7fcacdfac640 1 -- 172.21.15.3:0/3425772381 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fcab407f340 msgr2=0x7fcab4081800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:05.707 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:05.705+0000 7fcacdfac640 1 --2- 172.21.15.3:0/3425772381 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fcab407f340 0x7fcab4081800 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fcab0031460 tx=0x7fcab0009560 comp rx=0 tx=0).stop 2024-09-21T12:32:05.707 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:05.705+0000 7fcacdfac640 1 -- 172.21.15.3:0/3425772381 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcac8101900 msgr2=0x7fcac819d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:05.707 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:05.705+0000 7fcacdfac640 1 --2- 172.21.15.3:0/3425772381 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcac8101900 0x7fcac819d680 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fcab800d6f0 tx=0x7fcab800dbb0 comp rx=0 tx=0).stop 2024-09-21T12:32:05.707 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:05.705+0000 7fcacdfac640 1 -- 172.21.15.3:0/3425772381 shutdown_connections 2024-09-21T12:32:05.707 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:05.705+0000 7fcacdfac640 1 --2- 172.21.15.3:0/3425772381 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fcab407f340 0x7fcab4081800 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:05.707 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:05.705+0000 7fcacdfac640 1 --2- 172.21.15.3:0/3425772381 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcac8107900 0x7fcac819dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:05.708 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:05.705+0000 7fcacdfac640 1 --2- 172.21.15.3:0/3425772381 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcac8101900 0x7fcac819d680 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:05.708 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:05.705+0000 7fcacdfac640 1 -- 172.21.15.3:0/3425772381 >> 172.21.15.3:0/3425772381 conn(0x7fcac80fd600 msgr2=0x7fcac80fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:32:05.708 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:05.705+0000 7fcacdfac640 1 -- 172.21.15.3:0/3425772381 shutdown_connections 2024-09-21T12:32:05.708 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:05.705+0000 7fcacdfac640 1 -- 172.21.15.3:0/3425772381 wait complete. 2024-09-21T12:32:05.716 INFO:teuthology.orchestra.run.smithi003.stdout: "ceph version 19.3.0-5103-g5c1cdc3c (5c1cdc3c470dae78e91a0ed2bcf13509a046d301) squid (dev)" 2024-09-21T12:32:06.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:32:06 smithi192 ceph-mon[80326]: pgmap v339: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:32:06.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:32:06 smithi192 ceph-mon[80326]: from='client.? 172.21.15.3:0/3425772381' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:32:06.274 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:32:06 smithi003 ceph-mon[108723]: pgmap v339: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:32:06.274 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:32:06 smithi003 ceph-mon[108723]: from='client.? 172.21.15.3:0/3425772381' entity='client.admin' cmd={"prefix": "versions"} : dispatch 2024-09-21T12:32:06.302 DEBUG:teuthology.parallel:result is None 2024-09-21T12:32:06.302 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-21T12:32:06.317 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi003.front.sepia.ceph.com 2024-09-21T12:32:06.318 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- bash -c 'ceph fs dump' 2024-09-21T12:32:06.578 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:32:07.087 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:07.074+0000 7f06ae510640 1 -- 172.21.15.3:0/2245617616 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f06a81011c0 msgr2=0x7f06a8105690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:07.087 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:07.074+0000 7f06ae510640 1 --2- 172.21.15.3:0/2245617616 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f06a81011c0 0x7f06a8105690 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f069c009880 tx=0x7f069c02a530 comp rx=0 tx=0).stop 2024-09-21T12:32:07.087 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:07.074+0000 7f06ae510640 1 -- 172.21.15.3:0/2245617616 shutdown_connections 2024-09-21T12:32:07.087 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:07.074+0000 7f06ae510640 1 --2- 172.21.15.3:0/2245617616 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f06a81011c0 0x7f06a8105690 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:07.087 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:07.074+0000 7f06ae510640 1 --2- 172.21.15.3:0/2245617616 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06a81008a0 0x7f06a8100c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:07.087 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:07.074+0000 7f06ae510640 1 -- 172.21.15.3:0/2245617616 >> 172.21.15.3:0/2245617616 conn(0x7f06a80fc550 msgr2=0x7f06a80fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:32:07.088 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:07.074+0000 7f06ae510640 1 -- 172.21.15.3:0/2245617616 shutdown_connections 2024-09-21T12:32:07.088 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:07.074+0000 7f06ae510640 1 -- 172.21.15.3:0/2245617616 wait complete. 2024-09-21T12:32:07.088 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:07.074+0000 7f06ae510640 1 Processor -- start 2024-09-21T12:32:07.088 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:07.074+0000 7f06ae510640 1 -- start start 2024-09-21T12:32:07.088 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:07.075+0000 7f06ae510640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06a81008a0 0x7f06a819e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:07.088 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:07.075+0000 7f06ae510640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f06a81011c0 0x7f06a819e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:07.088 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:07.075+0000 7f06ae510640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f06a8115440 con 0x7f06a81011c0 2024-09-21T12:32:07.088 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:07.075+0000 7f06ae510640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f06a81152c0 con 0x7f06a81008a0 2024-09-21T12:32:07.088 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:07.075+0000 7f06a77fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f06a81011c0 0x7f06a819e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:07.088 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:07.075+0000 7f06a77fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f06a81011c0 0x7f06a819e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33866/0 (socket says 172.21.15.3:33866) 2024-09-21T12:32:07.088 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:07.075+0000 7f06a77fe640 1 -- 172.21.15.3:0/3717058984 learned_addr learned my addr 172.21.15.3:0/3717058984 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:32:07.088 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:07.075+0000 7f06a7fff640 1 --2- 172.21.15.3:0/3717058984 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06a81008a0 0x7f06a819e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:07.088 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:07.075+0000 7f06a77fe640 1 -- 172.21.15.3:0/3717058984 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06a81008a0 msgr2=0x7f06a819e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:07.089 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:07.075+0000 7f06a77fe640 1 --2- 172.21.15.3:0/3717058984 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06a81008a0 0x7f06a819e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:07.089 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:07.075+0000 7f06a77fe640 1 -- 172.21.15.3:0/3717058984 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06a81a28d0 con 0x7f06a81011c0 2024-09-21T12:32:07.089 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:07.075+0000 7f06a77fe640 1 --2- 172.21.15.3:0/3717058984 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f06a81011c0 0x7f06a819e540 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f069c031460 tx=0x7f069c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:32:07.089 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:07.076+0000 7f06a57fa640 1 -- 172.21.15.3:0/3717058984 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f069c03f070 con 0x7f06a81011c0 2024-09-21T12:32:07.089 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:07.076+0000 7f06a57fa640 1 -- 172.21.15.3:0/3717058984 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f069c004ac0 con 0x7f06a81011c0 2024-09-21T12:32:07.089 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:07.076+0000 7f06ae510640 1 -- 172.21.15.3:0/3717058984 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06a81a2b60 con 0x7f06a81011c0 2024-09-21T12:32:07.089 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:07.076+0000 7f06a57fa640 1 -- 172.21.15.3:0/3717058984 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f069c035030 con 0x7f06a81011c0 2024-09-21T12:32:07.089 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:07.076+0000 7f06ae510640 1 -- 172.21.15.3:0/3717058984 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06a81a3090 con 0x7f06a81011c0 2024-09-21T12:32:07.089 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:07.077+0000 7f06ae510640 1 -- 172.21.15.3:0/3717058984 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06a806a580 con 0x7f06a81011c0 2024-09-21T12:32:07.089 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:07.077+0000 7f06a57fa640 1 -- 172.21.15.3:0/3717058984 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f069c042070 con 0x7f06a81011c0 2024-09-21T12:32:07.089 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:07.078+0000 7f06a57fa640 1 --2- 172.21.15.3:0/3717058984 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f069007af80 0x7f069007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:07.089 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:07.078+0000 7f06a57fa640 1 -- 172.21.15.3:0/3717058984 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6414+0+0 (secure 0 0 0) 0x7f069c0bea50 con 0x7f06a81011c0 2024-09-21T12:32:07.089 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:07.078+0000 7f06a7fff640 1 --2- 172.21.15.3:0/3717058984 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f069007af80 0x7f069007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:07.089 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:07.078+0000 7f06a7fff640 1 --2- 172.21.15.3:0/3717058984 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f069007af80 0x7f069007d440 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0698009990 tx=0x7f0698009110 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:32:07.089 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:07.082+0000 7f06a57fa640 1 -- 172.21.15.3:0/3717058984 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f069c089fd0 con 0x7f06a81011c0 2024-09-21T12:32:07.309 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:07.307+0000 7f06ae510640 1 -- 172.21.15.3:0/3717058984 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f06a8100c80 con 0x7f06a81011c0 2024-09-21T12:32:07.309 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:32:07 smithi003 ceph-mon[108723]: pgmap v340: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:32:07.309 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:07.308+0000 7f06a57fa640 1 -- 172.21.15.3:0/3717058984 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 35 v35) ==== 76+0+2017 (secure 0 0 0) 0x7f069c08ee80 con 0x7f06a81011c0 2024-09-21T12:32:07.310 INFO:teuthology.orchestra.run.smithi003.stdout:e35 2024-09-21T12:32:07.310 INFO:teuthology.orchestra.run.smithi003.stdout:btime 2024-09-21T12:30:49:141299+0000 2024-09-21T12:32:07.310 INFO:teuthology.orchestra.run.smithi003.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-21T12:32:07.310 INFO:teuthology.orchestra.run.smithi003.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:32:07.310 INFO:teuthology.orchestra.run.smithi003.stdout:legacy client fscid: 1 2024-09-21T12:32:07.310 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:32:07.310 INFO:teuthology.orchestra.run.smithi003.stdout:Filesystem 'cephfs' (1) 2024-09-21T12:32:07.310 INFO:teuthology.orchestra.run.smithi003.stdout:fs_name cephfs 2024-09-21T12:32:07.310 INFO:teuthology.orchestra.run.smithi003.stdout:epoch 35 2024-09-21T12:32:07.310 INFO:teuthology.orchestra.run.smithi003.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-21T12:32:07.310 INFO:teuthology.orchestra.run.smithi003.stdout:created 2024-09-21T12:17:38.260099+0000 2024-09-21T12:32:07.311 INFO:teuthology.orchestra.run.smithi003.stdout:modified 2024-09-21T12:30:48.234734+0000 2024-09-21T12:32:07.311 INFO:teuthology.orchestra.run.smithi003.stdout:tableserver 0 2024-09-21T12:32:07.311 INFO:teuthology.orchestra.run.smithi003.stdout:root 0 2024-09-21T12:32:07.311 INFO:teuthology.orchestra.run.smithi003.stdout:session_timeout 60 2024-09-21T12:32:07.311 INFO:teuthology.orchestra.run.smithi003.stdout:session_autoclose 300 2024-09-21T12:32:07.311 INFO:teuthology.orchestra.run.smithi003.stdout:max_file_size 1099511627776 2024-09-21T12:32:07.311 INFO:teuthology.orchestra.run.smithi003.stdout:max_xattr_size 65536 2024-09-21T12:32:07.311 INFO:teuthology.orchestra.run.smithi003.stdout:required_client_features {} 2024-09-21T12:32:07.311 INFO:teuthology.orchestra.run.smithi003.stdout:last_failure 0 2024-09-21T12:32:07.311 INFO:teuthology.orchestra.run.smithi003.stdout:last_failure_osd_epoch 81 2024-09-21T12:32:07.311 INFO:teuthology.orchestra.run.smithi003.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-21T12:32:07.311 INFO:teuthology.orchestra.run.smithi003.stdout:max_mds 1 2024-09-21T12:32:07.311 INFO:teuthology.orchestra.run.smithi003.stdout:in 0 2024-09-21T12:32:07.311 INFO:teuthology.orchestra.run.smithi003.stdout:up {0=34314} 2024-09-21T12:32:07.312 INFO:teuthology.orchestra.run.smithi003.stdout:failed 2024-09-21T12:32:07.312 INFO:teuthology.orchestra.run.smithi003.stdout:damaged 2024-09-21T12:32:07.312 INFO:teuthology.orchestra.run.smithi003.stdout:stopped 2024-09-21T12:32:07.312 INFO:teuthology.orchestra.run.smithi003.stdout:data_pools [3] 2024-09-21T12:32:07.312 INFO:teuthology.orchestra.run.smithi003.stdout:metadata_pool 2 2024-09-21T12:32:07.312 INFO:teuthology.orchestra.run.smithi003.stdout:inline_data enabled 2024-09-21T12:32:07.312 INFO:teuthology.orchestra.run.smithi003.stdout:balancer 2024-09-21T12:32:07.312 INFO:teuthology.orchestra.run.smithi003.stdout:bal_rank_mask -1 2024-09-21T12:32:07.312 INFO:teuthology.orchestra.run.smithi003.stdout:standby_count_wanted 1 2024-09-21T12:32:07.312 INFO:teuthology.orchestra.run.smithi003.stdout:qdb_cluster leader: 34314 members: 34314 2024-09-21T12:32:07.312 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.cephfs.smithi003.ebjgyl{0:34314} state up:active seq 21 join_fscid=1 addr [v2:172.21.15.3:6826/1616995236,v1:172.21.15.3:6827/1616995236] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:32:07.312 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:32:07.312 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:32:07.312 INFO:teuthology.orchestra.run.smithi003.stdout:Standby daemons: 2024-09-21T12:32:07.313 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:32:07.313 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.cephfs.smithi003.gfkngj{-1:34346} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.3:6828/1282732153,v1:172.21.15.3:6829/1282732153] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:32:07.313 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.cephfs.smithi192.ywqqxe{-1:44321} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.192:6824/3113020545,v1:172.21.15.192:6825/3113020545] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:32:07.313 INFO:teuthology.orchestra.run.smithi003.stdout:[mds.cephfs.smithi192.ktdqns{-1:44349} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.192:6826/3169061902,v1:172.21.15.192:6827/3169061902] compat {c=[1],r=[1],i=[1fff]}] 2024-09-21T12:32:07.313 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 35 2024-09-21T12:32:07.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:07.310+0000 7f06ae510640 1 -- 172.21.15.3:0/3717058984 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f069007af80 msgr2=0x7f069007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:07.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:07.310+0000 7f06ae510640 1 --2- 172.21.15.3:0/3717058984 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f069007af80 0x7f069007d440 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0698009990 tx=0x7f0698009110 comp rx=0 tx=0).stop 2024-09-21T12:32:07.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:07.310+0000 7f06ae510640 1 -- 172.21.15.3:0/3717058984 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f06a81011c0 msgr2=0x7f06a819e540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:07.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:07.310+0000 7f06ae510640 1 --2- 172.21.15.3:0/3717058984 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f06a81011c0 0x7f06a819e540 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f069c031460 tx=0x7f069c0046c0 comp rx=0 tx=0).stop 2024-09-21T12:32:07.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:07.310+0000 7f06ae510640 1 -- 172.21.15.3:0/3717058984 shutdown_connections 2024-09-21T12:32:07.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:07.310+0000 7f06ae510640 1 --2- 172.21.15.3:0/3717058984 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f069007af80 0x7f069007d440 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:07.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:07.310+0000 7f06ae510640 1 --2- 172.21.15.3:0/3717058984 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f06a81011c0 0x7f06a819e540 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:07.314 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:07.310+0000 7f06ae510640 1 --2- 172.21.15.3:0/3717058984 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f06a81008a0 0x7f06a819e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:07.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:07.310+0000 7f06ae510640 1 -- 172.21.15.3:0/3717058984 >> 172.21.15.3:0/3717058984 conn(0x7f06a80fc550 msgr2=0x7f06a8112b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:32:07.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:07.310+0000 7f06ae510640 1 -- 172.21.15.3:0/3717058984 shutdown_connections 2024-09-21T12:32:07.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:07.310+0000 7f06ae510640 1 -- 172.21.15.3:0/3717058984 wait complete. 2024-09-21T12:32:07.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:32:07 smithi192 ceph-mon[80326]: pgmap v340: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:32:07.887 INFO:teuthology.run_tasks:Running task fs.post_upgrade_checks... 2024-09-21T12:32:07.904 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 2024-09-21T12:32:08.167 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:32:08.288 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:32:08 smithi003 ceph-mon[108723]: from='client.? 172.21.15.3:0/3717058984' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:32:08.408 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:32:08 smithi192 ceph-mon[80326]: from='client.? 172.21.15.3:0/3717058984' entity='client.admin' cmd={"prefix": "fs dump"} : dispatch 2024-09-21T12:32:08.669 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:08.658+0000 7f60ba2cc640 1 -- 172.21.15.3:0/1705308507 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f60b41068b0 msgr2=0x7f60b4106c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:08.669 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:08.658+0000 7f60ba2cc640 1 --2- 172.21.15.3:0/1705308507 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f60b41068b0 0x7f60b4106c90 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f60a4009880 tx=0x7f60a402a530 comp rx=0 tx=0).stop 2024-09-21T12:32:08.669 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:08.659+0000 7f60ba2cc640 1 -- 172.21.15.3:0/1705308507 shutdown_connections 2024-09-21T12:32:08.669 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:08.659+0000 7f60ba2cc640 1 --2- 172.21.15.3:0/1705308507 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f60b4100f70 0x7f60b41013d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:08.669 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:08.659+0000 7f60ba2cc640 1 --2- 172.21.15.3:0/1705308507 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f60b41068b0 0x7f60b4106c90 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:08.669 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:08.659+0000 7f60ba2cc640 1 -- 172.21.15.3:0/1705308507 >> 172.21.15.3:0/1705308507 conn(0x7f60b40fbc90 msgr2=0x7f60b40fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:32:08.670 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:08.659+0000 7f60ba2cc640 1 -- 172.21.15.3:0/1705308507 shutdown_connections 2024-09-21T12:32:08.670 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:08.659+0000 7f60ba2cc640 1 -- 172.21.15.3:0/1705308507 wait complete. 2024-09-21T12:32:08.670 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:08.659+0000 7f60ba2cc640 1 Processor -- start 2024-09-21T12:32:08.670 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:08.659+0000 7f60ba2cc640 1 -- start start 2024-09-21T12:32:08.670 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:08.660+0000 7f60ba2cc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f60b4100f70 0x7f60b4198810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:08.670 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:08.660+0000 7f60ba2cc640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f60b41068b0 0x7f60b4198d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:08.670 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:08.660+0000 7f60ba2cc640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f60b410dd70 con 0x7f60b4100f70 2024-09-21T12:32:08.670 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:08.660+0000 7f60ba2cc640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f60b410dbf0 con 0x7f60b41068b0 2024-09-21T12:32:08.670 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:08.660+0000 7f60b3fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f60b4100f70 0x7f60b4198810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:08.670 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:08.660+0000 7f60b3fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f60b4100f70 0x7f60b4198810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33886/0 (socket says 172.21.15.3:33886) 2024-09-21T12:32:08.670 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:08.660+0000 7f60b3fff640 1 -- 172.21.15.3:0/3450684339 learned_addr learned my addr 172.21.15.3:0/3450684339 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:32:08.671 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:08.660+0000 7f60b37fe640 1 --2- 172.21.15.3:0/3450684339 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f60b41068b0 0x7f60b4198d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:08.671 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:08.660+0000 7f60b3fff640 1 -- 172.21.15.3:0/3450684339 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f60b41068b0 msgr2=0x7f60b4198d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:08.671 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:08.660+0000 7f60b3fff640 1 --2- 172.21.15.3:0/3450684339 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f60b41068b0 0x7f60b4198d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:08.671 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:08.660+0000 7f60b3fff640 1 -- 172.21.15.3:0/3450684339 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60b41993a0 con 0x7f60b4100f70 2024-09-21T12:32:08.671 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:08.660+0000 7f60b3fff640 1 --2- 172.21.15.3:0/3450684339 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f60b4100f70 0x7f60b4198810 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f60a4031460 tx=0x7f60a40045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:32:08.671 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:08.660+0000 7f60b17fa640 1 -- 172.21.15.3:0/3450684339 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f60a403f070 con 0x7f60b4100f70 2024-09-21T12:32:08.671 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:08.661+0000 7f60b17fa640 1 -- 172.21.15.3:0/3450684339 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f60a4004b10 con 0x7f60b4100f70 2024-09-21T12:32:08.671 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:08.661+0000 7f60b17fa640 1 -- 172.21.15.3:0/3450684339 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f60a4035030 con 0x7f60b4100f70 2024-09-21T12:32:08.671 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:08.661+0000 7f60ba2cc640 1 -- 172.21.15.3:0/3450684339 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60b4199630 con 0x7f60b4100f70 2024-09-21T12:32:08.671 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:08.661+0000 7f60ba2cc640 1 -- 172.21.15.3:0/3450684339 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60b41a1be0 con 0x7f60b4100f70 2024-09-21T12:32:08.671 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:08.662+0000 7f60ba2cc640 1 -- 172.21.15.3:0/3450684339 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60b4102190 con 0x7f60b4100f70 2024-09-21T12:32:08.671 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:08.662+0000 7f60b17fa640 1 -- 172.21.15.3:0/3450684339 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f60a4042070 con 0x7f60b4100f70 2024-09-21T12:32:08.671 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:08.663+0000 7f60b17fa640 1 --2- 172.21.15.3:0/3450684339 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f609c07af40 0x7f609c07d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:08.671 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:08.663+0000 7f60b17fa640 1 -- 172.21.15.3:0/3450684339 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6414+0+0 (secure 0 0 0) 0x7f60a40beba0 con 0x7f60b4100f70 2024-09-21T12:32:08.672 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:08.663+0000 7f60b37fe640 1 --2- 172.21.15.3:0/3450684339 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f609c07af40 0x7f609c07d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:08.672 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:08.663+0000 7f60b37fe640 1 --2- 172.21.15.3:0/3450684339 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f609c07af40 0x7f609c07d400 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f60b41009f0 tx=0x7f60a800b390 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:32:08.672 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:08.667+0000 7f60b17fa640 1 -- 172.21.15.3:0/3450684339 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f60a408a0a0 con 0x7f60b4100f70 2024-09-21T12:32:08.895 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:08.894+0000 7f60ba2cc640 1 -- 172.21.15.3:0/3450684339 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f60b4108d60 con 0x7f60b4100f70 2024-09-21T12:32:08.896 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:08.894+0000 7f60b17fa640 1 -- 172.21.15.3:0/3450684339 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+5317 (secure 0 0 0) 0x7f60a408ef50 con 0x7f60b4100f70 2024-09-21T12:32:08.896 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:32:08.896 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":35,"btime":"2024-09-21T12:30:49:141299+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34346,"name":"cephfs.smithi003.gfkngj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6829/1282732153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":1282732153},{"type":"v1","addr":"172.21.15.3:6829","nonce":1282732153}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":44321,"name":"cephfs.smithi192.ywqqxe","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6825/3113020545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3113020545},{"type":"v1","addr":"172.21.15.192:6825","nonce":3113020545}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":44349,"name":"cephfs.smithi192.ktdqns","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6827/3169061902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":3169061902},{"type":"v1","addr":"172.21.15.192:6827","nonce":3169061902}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T12:17:38.260099+0000","modified":"2024-09-21T12:30:48.234734+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34314},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34314":{"gid":34314,"name":"cephfs.smithi003.ebjgyl","rank":0,"incarnation":29,"state":"up:active","state_seq":21,"addr":"172.21.15.3:6827/1616995236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":1616995236},{"type":"v1","addr":"172.21.15.3:6827","nonce":1616995236}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34314,"qdb_cluster":[34314]},"id":1}]} 2024-09-21T12:32:08.896 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 35 2024-09-21T12:32:08.898 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:08.897+0000 7f60ba2cc640 1 -- 172.21.15.3:0/3450684339 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f609c07af40 msgr2=0x7f609c07d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:08.898 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:08.897+0000 7f60ba2cc640 1 --2- 172.21.15.3:0/3450684339 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f609c07af40 0x7f609c07d400 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f60b41009f0 tx=0x7f60a800b390 comp rx=0 tx=0).stop 2024-09-21T12:32:08.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:08.897+0000 7f60ba2cc640 1 -- 172.21.15.3:0/3450684339 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f60b4100f70 msgr2=0x7f60b4198810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:08.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:08.897+0000 7f60ba2cc640 1 --2- 172.21.15.3:0/3450684339 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f60b4100f70 0x7f60b4198810 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f60a4031460 tx=0x7f60a40045e0 comp rx=0 tx=0).stop 2024-09-21T12:32:08.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:08.897+0000 7f60ba2cc640 1 -- 172.21.15.3:0/3450684339 shutdown_connections 2024-09-21T12:32:08.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:08.897+0000 7f60ba2cc640 1 --2- 172.21.15.3:0/3450684339 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f609c07af40 0x7f609c07d400 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:08.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:08.897+0000 7f60ba2cc640 1 --2- 172.21.15.3:0/3450684339 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f60b41068b0 0x7f60b4198d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:08.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:08.897+0000 7f60ba2cc640 1 --2- 172.21.15.3:0/3450684339 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f60b4100f70 0x7f60b4198810 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:08.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:08.897+0000 7f60ba2cc640 1 -- 172.21.15.3:0/3450684339 >> 172.21.15.3:0/3450684339 conn(0x7f60b40fbc90 msgr2=0x7f60b40fd6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:32:08.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:08.897+0000 7f60ba2cc640 1 -- 172.21.15.3:0/3450684339 shutdown_connections 2024-09-21T12:32:08.899 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:08.897+0000 7f60ba2cc640 1 -- 172.21.15.3:0/3450684339 wait complete. 2024-09-21T12:32:09.327 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:32:09 smithi003 ceph-mon[108723]: from='client.? 172.21.15.3:0/3450684339' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T12:32:09.328 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:32:09 smithi003 ceph-mon[108723]: pgmap v341: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:32:09.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:32:09 smithi192 ceph-mon[80326]: from='client.? 172.21.15.3:0/3450684339' entity='client.admin' cmd={"prefix": "fs dump", "format": "json"} : dispatch 2024-09-21T12:32:09.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:32:09 smithi192 ceph-mon[80326]: pgmap v341: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:32:09.664 DEBUG:tasks.fs:checking fs fscid=1,name=cephfs state = {'epoch': 14, 'max_mds': 1, 'flags': 18} 2024-09-21T12:32:09.664 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 15 2024-09-21T12:32:09.927 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:32:10.393 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:10.384+0000 7f5d91c65640 1 -- 172.21.15.3:0/1195505931 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5d8c1033e0 msgr2=0x7f5d8c10b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:10.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:10.384+0000 7f5d91c65640 1 --2- 172.21.15.3:0/1195505931 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5d8c1033e0 0x7f5d8c10b8d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f5d80009880 tx=0x7f5d8002a530 comp rx=0 tx=0).stop 2024-09-21T12:32:10.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:10.384+0000 7f5d91c65640 1 -- 172.21.15.3:0/1195505931 shutdown_connections 2024-09-21T12:32:10.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:10.384+0000 7f5d91c65640 1 --2- 172.21.15.3:0/1195505931 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5d8c1033e0 0x7f5d8c10b8d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:10.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:10.384+0000 7f5d91c65640 1 --2- 172.21.15.3:0/1195505931 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5d8c102ac0 0x7f5d8c102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:10.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:10.384+0000 7f5d91c65640 1 -- 172.21.15.3:0/1195505931 >> 172.21.15.3:0/1195505931 conn(0x7f5d8c0fc520 msgr2=0x7f5d8c0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:32:10.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:10.384+0000 7f5d91c65640 1 -- 172.21.15.3:0/1195505931 shutdown_connections 2024-09-21T12:32:10.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:10.384+0000 7f5d91c65640 1 -- 172.21.15.3:0/1195505931 wait complete. 2024-09-21T12:32:10.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:10.385+0000 7f5d91c65640 1 Processor -- start 2024-09-21T12:32:10.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:10.385+0000 7f5d91c65640 1 -- start start 2024-09-21T12:32:10.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:10.385+0000 7f5d91c65640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5d8c102ac0 0x7f5d8c19d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:10.394 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:10.385+0000 7f5d91c65640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5d8c1033e0 0x7f5d8c19dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:10.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:10.385+0000 7f5d91c65640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f5d8c10ee50 con 0x7f5d8c1033e0 2024-09-21T12:32:10.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:10.385+0000 7f5d91c65640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f5d8c10ecd0 con 0x7f5d8c102ac0 2024-09-21T12:32:10.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:10.385+0000 7f5d8affd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5d8c1033e0 0x7f5d8c19dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:10.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:10.385+0000 7f5d8affd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5d8c1033e0 0x7f5d8c19dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:33898/0 (socket says 172.21.15.3:33898) 2024-09-21T12:32:10.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:10.385+0000 7f5d8affd640 1 -- 172.21.15.3:0/3534105754 learned_addr learned my addr 172.21.15.3:0/3534105754 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:32:10.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:10.386+0000 7f5d8b7fe640 1 --2- 172.21.15.3:0/3534105754 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5d8c102ac0 0x7f5d8c19d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:10.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:10.386+0000 7f5d8affd640 1 -- 172.21.15.3:0/3534105754 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5d8c102ac0 msgr2=0x7f5d8c19d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:10.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:10.386+0000 7f5d8affd640 1 --2- 172.21.15.3:0/3534105754 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5d8c102ac0 0x7f5d8c19d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:10.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:10.386+0000 7f5d8affd640 1 -- 172.21.15.3:0/3534105754 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d8c197860 con 0x7f5d8c1033e0 2024-09-21T12:32:10.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:10.386+0000 7f5d8affd640 1 --2- 172.21.15.3:0/3534105754 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5d8c1033e0 0x7f5d8c19dbe0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5d80031460 tx=0x7f5d800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:32:10.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:10.386+0000 7f5d88ff9640 1 -- 172.21.15.3:0/3534105754 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5d8003f070 con 0x7f5d8c1033e0 2024-09-21T12:32:10.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:10.386+0000 7f5d88ff9640 1 -- 172.21.15.3:0/3534105754 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f5d80004ac0 con 0x7f5d8c1033e0 2024-09-21T12:32:10.395 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:10.386+0000 7f5d91c65640 1 -- 172.21.15.3:0/3534105754 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d8c197af0 con 0x7f5d8c1033e0 2024-09-21T12:32:10.396 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:10.386+0000 7f5d88ff9640 1 -- 172.21.15.3:0/3534105754 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f5d80035030 con 0x7f5d8c1033e0 2024-09-21T12:32:10.396 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:10.386+0000 7f5d91c65640 1 -- 172.21.15.3:0/3534105754 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d8c198020 con 0x7f5d8c1033e0 2024-09-21T12:32:10.396 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:10.387+0000 7f5d91c65640 1 -- 172.21.15.3:0/3534105754 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d8c06aa90 con 0x7f5d8c1033e0 2024-09-21T12:32:10.396 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:10.388+0000 7f5d88ff9640 1 -- 172.21.15.3:0/3534105754 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f5d80042070 con 0x7f5d8c1033e0 2024-09-21T12:32:10.396 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:10.388+0000 7f5d88ff9640 1 --2- 172.21.15.3:0/3534105754 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f5d7407af80 0x7f5d7407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:10.396 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:10.388+0000 7f5d88ff9640 1 -- 172.21.15.3:0/3534105754 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6414+0+0 (secure 0 0 0) 0x7f5d800bebc0 con 0x7f5d8c1033e0 2024-09-21T12:32:10.396 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:10.389+0000 7f5d8b7fe640 1 --2- 172.21.15.3:0/3534105754 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f5d7407af80 0x7f5d7407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:10.396 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:10.389+0000 7f5d8b7fe640 1 --2- 172.21.15.3:0/3534105754 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f5d7407af80 0x7f5d7407d440 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c1989a0 tx=0x7f5d7c008040 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:32:10.396 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:10.393+0000 7f5d88ff9640 1 -- 172.21.15.3:0/3534105754 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f5d8008a0a0 con 0x7f5d8c1033e0 2024-09-21T12:32:10.620 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:10.618+0000 7f5d91c65640 1 -- 172.21.15.3:0/3534105754 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 15, "format": "json"} v 0) -- 0x7f5d8c198d90 con 0x7f5d8c1033e0 2024-09-21T12:32:10.620 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:10.619+0000 7f5d88ff9640 1 -- 172.21.15.3:0/3534105754 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 15, "format": "json"}]=0 dumped fsmap epoch 15 v35) ==== 107+0+4469 (secure 0 0 0) 0x7f5d800be090 con 0x7f5d8c1033e0 2024-09-21T12:32:10.621 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:32:10.621 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":15,"btime":"2024-09-21T12:29:07:954255+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24319,"name":"cephfs.smithi192.ywqqxe","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.192:6825/4055220871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":4055220871},{"type":"v1","addr":"172.21.15.192:6825","nonce":4055220871}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24337,"name":"cephfs.smithi192.ktdqns","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.192:6827/318800854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":318800854},{"type":"v1","addr":"172.21.15.192:6827","nonce":318800854}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T12:17:38.260099+0000","modified":"2024-09-21T12:17:55.592927+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":46,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":14564},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14564":{"gid":14564,"name":"cephfs.smithi003.gfkngj","rank":0,"incarnation":11,"state":"up:active","state_seq":5,"addr":"172.21.15.3:6829/3710817325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":3710817325},{"type":"v1","addr":"172.21.15.3:6829","nonce":3710817325}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14564,"qdb_cluster":[14564]},"id":1}]} 2024-09-21T12:32:10.621 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 15 2024-09-21T12:32:10.623 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:10.621+0000 7f5d91c65640 1 -- 172.21.15.3:0/3534105754 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f5d7407af80 msgr2=0x7f5d7407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:10.623 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:10.621+0000 7f5d91c65640 1 --2- 172.21.15.3:0/3534105754 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f5d7407af80 0x7f5d7407d440 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c1989a0 tx=0x7f5d7c008040 comp rx=0 tx=0).stop 2024-09-21T12:32:10.623 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:10.621+0000 7f5d91c65640 1 -- 172.21.15.3:0/3534105754 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5d8c1033e0 msgr2=0x7f5d8c19dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:10.623 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:10.621+0000 7f5d91c65640 1 --2- 172.21.15.3:0/3534105754 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5d8c1033e0 0x7f5d8c19dbe0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5d80031460 tx=0x7f5d800046c0 comp rx=0 tx=0).stop 2024-09-21T12:32:10.623 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:10.621+0000 7f5d91c65640 1 -- 172.21.15.3:0/3534105754 shutdown_connections 2024-09-21T12:32:10.623 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:10.621+0000 7f5d91c65640 1 --2- 172.21.15.3:0/3534105754 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f5d7407af80 0x7f5d7407d440 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:10.623 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:10.621+0000 7f5d91c65640 1 --2- 172.21.15.3:0/3534105754 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5d8c1033e0 0x7f5d8c19dbe0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:10.623 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:10.621+0000 7f5d91c65640 1 --2- 172.21.15.3:0/3534105754 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f5d8c102ac0 0x7f5d8c19d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:10.623 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:10.621+0000 7f5d91c65640 1 -- 172.21.15.3:0/3534105754 >> 172.21.15.3:0/3534105754 conn(0x7f5d8c0fc520 msgr2=0x7f5d8c108ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:32:10.623 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:10.621+0000 7f5d91c65640 1 -- 172.21.15.3:0/3534105754 shutdown_connections 2024-09-21T12:32:10.624 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:10.621+0000 7f5d91c65640 1 -- 172.21.15.3:0/3534105754 wait complete. 2024-09-21T12:32:10.989 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:32:10 smithi003 ceph-mon[108723]: from='client.? 172.21.15.3:0/3534105754' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 15, "format": "json"} : dispatch 2024-09-21T12:32:11.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:32:10 smithi192 ceph-mon[80326]: from='client.? 172.21.15.3:0/3534105754' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 15, "format": "json"} : dispatch 2024-09-21T12:32:11.293 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 16 2024-09-21T12:32:11.552 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:32:11.943 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:32:11 smithi003 ceph-mon[108723]: pgmap v342: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:32:12.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:32:11 smithi192 ceph-mon[80326]: pgmap v342: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:32:12.073 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:12.025+0000 7f90c5b2d640 1 -- 172.21.15.3:0/3622131141 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f90c0106800 msgr2=0x7f90c0106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:12.073 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:12.025+0000 7f90c5b2d640 1 --2- 172.21.15.3:0/3622131141 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f90c0106800 0x7f90c0106be0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f90b0009880 tx=0x7f90b002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:32:12.073 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:12.025+0000 7f90c5b2d640 1 -- 172.21.15.3:0/3622131141 shutdown_connections 2024-09-21T12:32:12.073 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:12.025+0000 7f90c5b2d640 1 --2- 172.21.15.3:0/3622131141 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90c0100800 0x7f90c0100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:12.073 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:12.025+0000 7f90c5b2d640 1 --2- 172.21.15.3:0/3622131141 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f90c0106800 0x7f90c0106be0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:12.073 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:12.025+0000 7f90c5b2d640 1 -- 172.21.15.3:0/3622131141 >> 172.21.15.3:0/3622131141 conn(0x7f90c00fc520 msgr2=0x7f90c00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:32:12.073 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:12.025+0000 7f90c5b2d640 1 -- 172.21.15.3:0/3622131141 shutdown_connections 2024-09-21T12:32:12.073 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:12.025+0000 7f90c5b2d640 1 -- 172.21.15.3:0/3622131141 wait complete. 2024-09-21T12:32:12.074 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:12.026+0000 7f90c5b2d640 1 Processor -- start 2024-09-21T12:32:12.074 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:12.026+0000 7f90c5b2d640 1 -- start start 2024-09-21T12:32:12.074 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:12.026+0000 7f90c5b2d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f90c0100800 0x7f90c019d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:12.074 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:12.026+0000 7f90c5b2d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90c0106800 0x7f90c019dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:12.074 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:12.026+0000 7f90c5b2d640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f90c010dcb0 con 0x7f90c0100800 2024-09-21T12:32:12.074 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:12.026+0000 7f90c5b2d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f90c010db30 con 0x7f90c0106800 2024-09-21T12:32:12.074 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:12.026+0000 7f90bf7fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f90c0100800 0x7f90c019d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:12.074 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:12.026+0000 7f90bf7fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f90c0100800 0x7f90c019d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:52162/0 (socket says 172.21.15.3:52162) 2024-09-21T12:32:12.074 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:12.026+0000 7f90bf7fe640 1 -- 172.21.15.3:0/1205065521 learned_addr learned my addr 172.21.15.3:0/1205065521 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:32:12.074 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:12.026+0000 7f90beffd640 1 --2- 172.21.15.3:0/1205065521 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90c0106800 0x7f90c019dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:12.074 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:12.026+0000 7f90bf7fe640 1 -- 172.21.15.3:0/1205065521 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90c0106800 msgr2=0x7f90c019dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:12.074 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:12.026+0000 7f90bf7fe640 1 --2- 172.21.15.3:0/1205065521 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90c0106800 0x7f90c019dbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:12.074 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:12.027+0000 7f90bf7fe640 1 -- 172.21.15.3:0/1205065521 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90c0197820 con 0x7f90c0100800 2024-09-21T12:32:12.075 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:12.027+0000 7f90bf7fe640 1 --2- 172.21.15.3:0/1205065521 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f90c0100800 0x7f90c019d6a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f90b0031460 tx=0x7f90b00048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:32:12.075 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:12.027+0000 7f90bcff9640 1 -- 172.21.15.3:0/1205065521 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f90b003f070 con 0x7f90c0100800 2024-09-21T12:32:12.075 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:12.027+0000 7f90bcff9640 1 -- 172.21.15.3:0/1205065521 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f90b00044d0 con 0x7f90c0100800 2024-09-21T12:32:12.075 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:12.027+0000 7f90c5b2d640 1 -- 172.21.15.3:0/1205065521 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90c0197ab0 con 0x7f90c0100800 2024-09-21T12:32:12.075 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:12.027+0000 7f90bcff9640 1 -- 172.21.15.3:0/1205065521 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f90b0035030 con 0x7f90c0100800 2024-09-21T12:32:12.075 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:12.027+0000 7f90c5b2d640 1 -- 172.21.15.3:0/1205065521 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90c0197fe0 con 0x7f90c0100800 2024-09-21T12:32:12.075 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:12.028+0000 7f90c5b2d640 1 -- 172.21.15.3:0/1205065521 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90c0101f40 con 0x7f90c0100800 2024-09-21T12:32:12.075 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:12.029+0000 7f90bcff9640 1 -- 172.21.15.3:0/1205065521 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f90b0042070 con 0x7f90c0100800 2024-09-21T12:32:12.075 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:12.029+0000 7f90bcff9640 1 --2- 172.21.15.3:0/1205065521 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f90a807af40 0x7f90a807d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:12.075 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:12.029+0000 7f90bcff9640 1 -- 172.21.15.3:0/1205065521 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6414+0+0 (secure 0 0 0) 0x7f90b00bec60 con 0x7f90c0100800 2024-09-21T12:32:12.075 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:12.029+0000 7f90beffd640 1 --2- 172.21.15.3:0/1205065521 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f90a807af40 0x7f90a807d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:12.075 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:12.030+0000 7f90beffd640 1 --2- 172.21.15.3:0/1205065521 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f90a807af40 0x7f90a807d400 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f90c00ffb10 tx=0x7f90b400a4c0 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:32:12.075 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:12.033+0000 7f90bcff9640 1 -- 172.21.15.3:0/1205065521 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f90b0004cf0 con 0x7f90c0100800 2024-09-21T12:32:12.259 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:12.258+0000 7f90c5b2d640 1 -- 172.21.15.3:0/1205065521 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 16, "format": "json"} v 0) -- 0x7f90c0198d80 con 0x7f90c0100800 2024-09-21T12:32:12.260 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:12.259+0000 7f90bcff9640 1 -- 172.21.15.3:0/1205065521 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 16, "format": "json"}]=0 dumped fsmap epoch 16 v35) ==== 107+0+5313 (secure 0 0 0) 0x7f90c0198d80 con 0x7f90c0100800 2024-09-21T12:32:12.260 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:32:12.260 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":16,"btime":"2024-09-21T12:29:10:968359+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24319,"name":"cephfs.smithi192.ywqqxe","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.192:6825/4055220871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":4055220871},{"type":"v1","addr":"172.21.15.192:6825","nonce":4055220871}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24337,"name":"cephfs.smithi192.ktdqns","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.192:6827/318800854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":318800854},{"type":"v1","addr":"172.21.15.192:6827","nonce":318800854}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":34314,"name":"cephfs.smithi003.ebjgyl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6827/1616995236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":1616995236},{"type":"v1","addr":"172.21.15.3:6827","nonce":1616995236}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T12:17:38.260099+0000","modified":"2024-09-21T12:17:55.592927+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":46,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":14564},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14564":{"gid":14564,"name":"cephfs.smithi003.gfkngj","rank":0,"incarnation":11,"state":"up:active","state_seq":5,"addr":"172.21.15.3:6829/3710817325","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":3710817325},{"type":"v1","addr":"172.21.15.3:6829","nonce":3710817325}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14564,"qdb_cluster":[14564]},"id":1}]} 2024-09-21T12:32:12.261 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 16 2024-09-21T12:32:12.264 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:12.262+0000 7f90c5b2d640 1 -- 172.21.15.3:0/1205065521 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f90a807af40 msgr2=0x7f90a807d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:12.264 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:12.262+0000 7f90c5b2d640 1 --2- 172.21.15.3:0/1205065521 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f90a807af40 0x7f90a807d400 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f90c00ffb10 tx=0x7f90b400a4c0 comp rx=0 tx=0).stop 2024-09-21T12:32:12.264 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:12.262+0000 7f90c5b2d640 1 -- 172.21.15.3:0/1205065521 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f90c0100800 msgr2=0x7f90c019d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:12.264 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:12.262+0000 7f90c5b2d640 1 --2- 172.21.15.3:0/1205065521 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f90c0100800 0x7f90c019d6a0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f90b0031460 tx=0x7f90b00048f0 comp rx=0 tx=0).stop 2024-09-21T12:32:12.264 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:12.262+0000 7f90c5b2d640 1 -- 172.21.15.3:0/1205065521 shutdown_connections 2024-09-21T12:32:12.264 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:12.262+0000 7f90c5b2d640 1 --2- 172.21.15.3:0/1205065521 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f90a807af40 0x7f90a807d400 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:12.264 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:12.262+0000 7f90c5b2d640 1 --2- 172.21.15.3:0/1205065521 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f90c0106800 0x7f90c019dbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:12.264 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:12.262+0000 7f90c5b2d640 1 --2- 172.21.15.3:0/1205065521 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f90c0100800 0x7f90c019d6a0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:12.264 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:12.262+0000 7f90c5b2d640 1 -- 172.21.15.3:0/1205065521 >> 172.21.15.3:0/1205065521 conn(0x7f90c00fc520 msgr2=0x7f90c006a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:32:12.264 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:12.262+0000 7f90c5b2d640 1 -- 172.21.15.3:0/1205065521 shutdown_connections 2024-09-21T12:32:12.264 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:12.262+0000 7f90c5b2d640 1 -- 172.21.15.3:0/1205065521 wait complete. 2024-09-21T12:32:12.856 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:32:12 smithi003 ceph-mon[108723]: from='client.? 172.21.15.3:0/1205065521' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 16, "format": "json"} : dispatch 2024-09-21T12:32:12.888 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 17 2024-09-21T12:32:13.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:32:12 smithi192 ceph-mon[80326]: from='client.? 172.21.15.3:0/1205065521' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 16, "format": "json"} : dispatch 2024-09-21T12:32:13.154 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:32:13.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:13.583+0000 7fb1f2618640 1 -- 172.21.15.3:0/3818597389 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb1ec106800 msgr2=0x7fb1ec106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:13.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:13.583+0000 7fb1f2618640 1 --2- 172.21.15.3:0/3818597389 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb1ec106800 0x7fb1ec106be0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc009880 tx=0x7fb1dc02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:32:13.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:13.583+0000 7fb1f2618640 1 -- 172.21.15.3:0/3818597389 shutdown_connections 2024-09-21T12:32:13.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:13.583+0000 7fb1f2618640 1 --2- 172.21.15.3:0/3818597389 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1ec100800 0x7fb1ec100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:13.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:13.583+0000 7fb1f2618640 1 --2- 172.21.15.3:0/3818597389 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb1ec106800 0x7fb1ec106be0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:13.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:13.583+0000 7fb1f2618640 1 -- 172.21.15.3:0/3818597389 >> 172.21.15.3:0/3818597389 conn(0x7fb1ec0fc520 msgr2=0x7fb1ec0fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:32:13.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:13.583+0000 7fb1f2618640 1 -- 172.21.15.3:0/3818597389 shutdown_connections 2024-09-21T12:32:13.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:13.583+0000 7fb1f2618640 1 -- 172.21.15.3:0/3818597389 wait complete. 2024-09-21T12:32:13.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:13.584+0000 7fb1f2618640 1 Processor -- start 2024-09-21T12:32:13.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:13.584+0000 7fb1f2618640 1 -- start start 2024-09-21T12:32:13.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:13.584+0000 7fb1f2618640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1ec100800 0x7fb1ec19c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:13.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:13.584+0000 7fb1f2618640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb1ec106800 0x7fb1ec19cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:13.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:13.584+0000 7fb1f2618640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fb1ec10dd30 con 0x7fb1ec106800 2024-09-21T12:32:13.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:13.584+0000 7fb1f2618640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb1ec10dbb0 con 0x7fb1ec100800 2024-09-21T12:32:13.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:13.584+0000 7fb1eb7fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb1ec106800 0x7fb1ec19cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:13.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:13.584+0000 7fb1ebfff640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1ec100800 0x7fb1ec19c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:13.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:13.584+0000 7fb1eb7fe640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb1ec106800 0x7fb1ec19cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:52186/0 (socket says 172.21.15.3:52186) 2024-09-21T12:32:13.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:13.584+0000 7fb1eb7fe640 1 -- 172.21.15.3:0/390072508 learned_addr learned my addr 172.21.15.3:0/390072508 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:32:13.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:13.585+0000 7fb1eb7fe640 1 -- 172.21.15.3:0/390072508 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1ec100800 msgr2=0x7fb1ec19c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:13.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:13.585+0000 7fb1eb7fe640 1 --2- 172.21.15.3:0/390072508 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1ec100800 0x7fb1ec19c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:13.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:13.585+0000 7fb1eb7fe640 1 -- 172.21.15.3:0/390072508 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1ec196730 con 0x7fb1ec106800 2024-09-21T12:32:13.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:13.585+0000 7fb1eb7fe640 1 --2- 172.21.15.3:0/390072508 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb1ec106800 0x7fb1ec19cba0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb1e000b420 tx=0x7fb1e000b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:32:13.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:13.585+0000 7fb1e97fa640 1 -- 172.21.15.3:0/390072508 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb1e0011630 con 0x7fb1ec106800 2024-09-21T12:32:13.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:13.585+0000 7fb1e97fa640 1 -- 172.21.15.3:0/390072508 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb1e0016070 con 0x7fb1ec106800 2024-09-21T12:32:13.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:13.585+0000 7fb1e97fa640 1 -- 172.21.15.3:0/390072508 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb1e0010d40 con 0x7fb1ec106800 2024-09-21T12:32:13.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:13.585+0000 7fb1f2618640 1 -- 172.21.15.3:0/390072508 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1ec196a20 con 0x7fb1ec106800 2024-09-21T12:32:13.611 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:13.585+0000 7fb1f2618640 1 -- 172.21.15.3:0/390072508 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1ec196f80 con 0x7fb1ec106800 2024-09-21T12:32:13.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:13.586+0000 7fb1f2618640 1 -- 172.21.15.3:0/390072508 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1ec101f40 con 0x7fb1ec106800 2024-09-21T12:32:13.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:13.587+0000 7fb1e97fa640 1 -- 172.21.15.3:0/390072508 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7fb1e001b460 con 0x7fb1ec106800 2024-09-21T12:32:13.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:13.587+0000 7fb1e97fa640 1 --2- 172.21.15.3:0/390072508 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fb1d407af90 0x7fb1d407d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:13.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:13.587+0000 7fb1e97fa640 1 -- 172.21.15.3:0/390072508 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6414+0+0 (secure 0 0 0) 0x7fb1e009d790 con 0x7fb1ec106800 2024-09-21T12:32:13.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:13.587+0000 7fb1ebfff640 1 --2- 172.21.15.3:0/390072508 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fb1d407af90 0x7fb1d407d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:13.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:13.588+0000 7fb1ebfff640 1 --2- 172.21.15.3:0/390072508 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fb1d407af90 0x7fb1d407d450 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc0096c0 tx=0x7fb1dc031400 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:32:13.612 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:13.592+0000 7fb1e97fa640 1 -- 172.21.15.3:0/390072508 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb1e0068c70 con 0x7fb1ec106800 2024-09-21T12:32:13.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:13.823+0000 7fb1f2618640 1 -- 172.21.15.3:0/390072508 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 17, "format": "json"} v 0) -- 0x7fb1ec108d70 con 0x7fb1ec106800 2024-09-21T12:32:13.825 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:13.823+0000 7fb1e97fa640 1 -- 172.21.15.3:0/390072508 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 17, "format": "json"}]=0 dumped fsmap epoch 17 v35) ==== 107+0+4449 (secure 0 0 0) 0x7fb1e006db20 con 0x7fb1ec106800 2024-09-21T12:32:13.825 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:32:13.825 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":17,"btime":"2024-09-21T12:29:22:613593+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24319,"name":"cephfs.smithi192.ywqqxe","rank":-1,"incarnation":0,"state":"up:standby","state_seq":3,"addr":"172.21.15.192:6825/4055220871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":4055220871},{"type":"v1","addr":"172.21.15.192:6825","nonce":4055220871}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24337,"name":"cephfs.smithi192.ktdqns","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.192:6827/318800854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":318800854},{"type":"v1","addr":"172.21.15.192:6827","nonce":318800854}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":34314,"name":"cephfs.smithi003.ebjgyl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6827/1616995236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":1616995236},{"type":"v1","addr":"172.21.15.3:6827","nonce":1616995236}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T12:17:38.260099+0000","modified":"2024-09-21T12:29:22.613589+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":79,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T12:32:13.825 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 17 2024-09-21T12:32:13.827 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:13.826+0000 7fb1f2618640 1 -- 172.21.15.3:0/390072508 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fb1d407af90 msgr2=0x7fb1d407d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:13.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:13.826+0000 7fb1f2618640 1 --2- 172.21.15.3:0/390072508 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fb1d407af90 0x7fb1d407d450 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc0096c0 tx=0x7fb1dc031400 comp rx=0 tx=0).stop 2024-09-21T12:32:13.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:13.826+0000 7fb1f2618640 1 -- 172.21.15.3:0/390072508 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb1ec106800 msgr2=0x7fb1ec19cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:13.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:13.826+0000 7fb1f2618640 1 --2- 172.21.15.3:0/390072508 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb1ec106800 0x7fb1ec19cba0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb1e000b420 tx=0x7fb1e000b8e0 comp rx=0 tx=0).stop 2024-09-21T12:32:13.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:13.826+0000 7fb1f2618640 1 -- 172.21.15.3:0/390072508 shutdown_connections 2024-09-21T12:32:13.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:13.826+0000 7fb1f2618640 1 --2- 172.21.15.3:0/390072508 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fb1d407af90 0x7fb1d407d450 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:13.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:13.826+0000 7fb1f2618640 1 --2- 172.21.15.3:0/390072508 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb1ec106800 0x7fb1ec19cba0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:13.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:13.826+0000 7fb1f2618640 1 --2- 172.21.15.3:0/390072508 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1ec100800 0x7fb1ec19c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:13.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:13.826+0000 7fb1f2618640 1 -- 172.21.15.3:0/390072508 >> 172.21.15.3:0/390072508 conn(0x7fb1ec0fc520 msgr2=0x7fb1ec0fce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:32:13.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:13.826+0000 7fb1f2618640 1 -- 172.21.15.3:0/390072508 shutdown_connections 2024-09-21T12:32:13.828 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:13.826+0000 7fb1f2618640 1 -- 172.21.15.3:0/390072508 wait complete. 2024-09-21T12:32:13.837 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:32:13 smithi003 ceph-mon[108723]: pgmap v343: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:32:14.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:32:13 smithi192 ceph-mon[80326]: pgmap v343: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:32:14.548 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 18 2024-09-21T12:32:14.816 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:32:14.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:32:14 smithi003 ceph-mon[108723]: from='client.? 172.21.15.3:0/390072508' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 17, "format": "json"} : dispatch 2024-09-21T12:32:15.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:32:14 smithi192 ceph-mon[80326]: from='client.? 172.21.15.3:0/390072508' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 17, "format": "json"} : dispatch 2024-09-21T12:32:15.309 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:15.292+0000 7fcb4da3a640 1 -- 172.21.15.3:0/2484001559 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcb48101900 msgr2=0x7fcb48101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:15.309 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:15.292+0000 7fcb4da3a640 1 --2- 172.21.15.3:0/2484001559 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcb48101900 0x7fcb48101d60 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fcb30009880 tx=0x7fcb3002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:32:15.309 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:15.292+0000 7fcb4da3a640 1 -- 172.21.15.3:0/2484001559 shutdown_connections 2024-09-21T12:32:15.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:15.292+0000 7fcb4da3a640 1 --2- 172.21.15.3:0/2484001559 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcb48101900 0x7fcb48101d60 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:15.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:15.292+0000 7fcb4da3a640 1 --2- 172.21.15.3:0/2484001559 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcb48107900 0x7fcb48107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:15.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:15.292+0000 7fcb4da3a640 1 -- 172.21.15.3:0/2484001559 >> 172.21.15.3:0/2484001559 conn(0x7fcb480fd600 msgr2=0x7fcb480ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:32:15.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:15.292+0000 7fcb4da3a640 1 -- 172.21.15.3:0/2484001559 shutdown_connections 2024-09-21T12:32:15.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:15.292+0000 7fcb4da3a640 1 -- 172.21.15.3:0/2484001559 wait complete. 2024-09-21T12:32:15.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:15.293+0000 7fcb4da3a640 1 Processor -- start 2024-09-21T12:32:15.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:15.293+0000 7fcb4da3a640 1 -- start start 2024-09-21T12:32:15.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:15.293+0000 7fcb4da3a640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcb48101900 0x7fcb480744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:15.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:15.294+0000 7fcb4da3a640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcb48107900 0x7fcb48074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:15.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:15.294+0000 7fcb4da3a640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fcb4810edd0 con 0x7fcb48107900 2024-09-21T12:32:15.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:15.294+0000 7fcb4da3a640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fcb4810ec50 con 0x7fcb48101900 2024-09-21T12:32:15.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:15.294+0000 7fcb3ffff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcb48107900 0x7fcb48074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:15.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:15.294+0000 7fcb3ffff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcb48107900 0x7fcb48074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:52204/0 (socket says 172.21.15.3:52204) 2024-09-21T12:32:15.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:15.294+0000 7fcb3ffff640 1 -- 172.21.15.3:0/2403781634 learned_addr learned my addr 172.21.15.3:0/2403781634 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:32:15.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:15.294+0000 7fcb46ffd640 1 --2- 172.21.15.3:0/2403781634 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcb48101900 0x7fcb480744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:15.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:15.294+0000 7fcb3ffff640 1 -- 172.21.15.3:0/2403781634 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcb48101900 msgr2=0x7fcb480744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:15.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:15.294+0000 7fcb3ffff640 1 --2- 172.21.15.3:0/2403781634 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcb48101900 0x7fcb480744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:15.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:15.294+0000 7fcb3ffff640 1 -- 172.21.15.3:0/2403781634 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb48074f70 con 0x7fcb48107900 2024-09-21T12:32:15.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:15.294+0000 7fcb3ffff640 1 --2- 172.21.15.3:0/2403781634 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcb48107900 0x7fcb48074a30 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fcb30031460 tx=0x7fcb300045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:32:15.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:15.294+0000 7fcb4ca38640 1 -- 172.21.15.3:0/2403781634 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcb3003f070 con 0x7fcb48107900 2024-09-21T12:32:15.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:15.294+0000 7fcb4da3a640 1 -- 172.21.15.3:0/2403781634 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb48075200 con 0x7fcb48107900 2024-09-21T12:32:15.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:15.294+0000 7fcb4ca38640 1 -- 172.21.15.3:0/2403781634 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fcb300035f0 con 0x7fcb48107900 2024-09-21T12:32:15.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:15.294+0000 7fcb4ca38640 1 -- 172.21.15.3:0/2403781634 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fcb30035030 con 0x7fcb48107900 2024-09-21T12:32:15.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:15.294+0000 7fcb4da3a640 1 -- 172.21.15.3:0/2403781634 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb481a3d60 con 0x7fcb48107900 2024-09-21T12:32:15.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:15.296+0000 7fcb4da3a640 1 -- 172.21.15.3:0/2403781634 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb48103040 con 0x7fcb48107900 2024-09-21T12:32:15.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:15.296+0000 7fcb4ca38640 1 -- 172.21.15.3:0/2403781634 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7fcb30042070 con 0x7fcb48107900 2024-09-21T12:32:15.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:15.297+0000 7fcb4ca38640 1 --2- 172.21.15.3:0/2403781634 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fcb3407af30 0x7fcb3407d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:15.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:15.297+0000 7fcb4ca38640 1 -- 172.21.15.3:0/2403781634 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6414+0+0 (secure 0 0 0) 0x7fcb300beb10 con 0x7fcb48107900 2024-09-21T12:32:15.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:15.297+0000 7fcb46ffd640 1 --2- 172.21.15.3:0/2403781634 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fcb3407af30 0x7fcb3407d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:15.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:15.297+0000 7fcb46ffd640 1 --2- 172.21.15.3:0/2403781634 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fcb3407af30 0x7fcb3407d3f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fcb38005fd0 tx=0x7fcb3800b390 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:32:15.312 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:15.301+0000 7fcb4ca38640 1 -- 172.21.15.3:0/2403781634 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fcb30089f70 con 0x7fcb48107900 2024-09-21T12:32:15.535 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:15.534+0000 7fcb4da3a640 1 -- 172.21.15.3:0/2403781634 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 18, "format": "json"} v 0) -- 0x7fcb48109e70 con 0x7fcb48107900 2024-09-21T12:32:15.536 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:15.535+0000 7fcb4ca38640 1 -- 172.21.15.3:0/2403781634 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 18, "format": "json"}]=0 dumped fsmap epoch 18 v35) ==== 107+0+4460 (secure 0 0 0) 0x7fcb3008ee20 con 0x7fcb48107900 2024-09-21T12:32:15.536 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:32:15.536 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":18,"btime":"2024-09-21T12:29:22:618631+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24337,"name":"cephfs.smithi192.ktdqns","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.192:6827/318800854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":318800854},{"type":"v1","addr":"172.21.15.192:6827","nonce":318800854}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":34314,"name":"cephfs.smithi003.ebjgyl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6827/1616995236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":1616995236},{"type":"v1","addr":"172.21.15.3:6827","nonce":1616995236}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T12:17:38.260099+0000","modified":"2024-09-21T12:29:22.618614+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":79,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24319},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24319":{"gid":24319,"name":"cephfs.smithi192.ywqqxe","rank":0,"incarnation":18,"state":"up:replay","state_seq":3,"addr":"172.21.15.192:6825/4055220871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":4055220871},{"type":"v1","addr":"172.21.15.192:6825","nonce":4055220871}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T12:32:15.537 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 18 2024-09-21T12:32:15.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:15.537+0000 7fcb4da3a640 1 -- 172.21.15.3:0/2403781634 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fcb3407af30 msgr2=0x7fcb3407d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:15.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:15.537+0000 7fcb4da3a640 1 --2- 172.21.15.3:0/2403781634 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fcb3407af30 0x7fcb3407d3f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fcb38005fd0 tx=0x7fcb3800b390 comp rx=0 tx=0).stop 2024-09-21T12:32:15.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:15.537+0000 7fcb4da3a640 1 -- 172.21.15.3:0/2403781634 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcb48107900 msgr2=0x7fcb48074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:15.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:15.537+0000 7fcb4da3a640 1 --2- 172.21.15.3:0/2403781634 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcb48107900 0x7fcb48074a30 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fcb30031460 tx=0x7fcb300045e0 comp rx=0 tx=0).stop 2024-09-21T12:32:15.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:15.537+0000 7fcb4da3a640 1 -- 172.21.15.3:0/2403781634 shutdown_connections 2024-09-21T12:32:15.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:15.537+0000 7fcb4da3a640 1 --2- 172.21.15.3:0/2403781634 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fcb3407af30 0x7fcb3407d3f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:15.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:15.537+0000 7fcb4da3a640 1 --2- 172.21.15.3:0/2403781634 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fcb48107900 0x7fcb48074a30 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:15.539 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:15.537+0000 7fcb4da3a640 1 --2- 172.21.15.3:0/2403781634 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fcb48101900 0x7fcb480744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:15.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:15.537+0000 7fcb4da3a640 1 -- 172.21.15.3:0/2403781634 >> 172.21.15.3:0/2403781634 conn(0x7fcb480fd600 msgr2=0x7fcb480fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:32:15.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:15.537+0000 7fcb4da3a640 1 -- 172.21.15.3:0/2403781634 shutdown_connections 2024-09-21T12:32:15.540 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:15.537+0000 7fcb4da3a640 1 -- 172.21.15.3:0/2403781634 wait complete. 2024-09-21T12:32:15.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:32:15 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:32:15.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:32:15 smithi003 ceph-mon[108723]: pgmap v344: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:32:15.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:32:15 smithi003 ceph-mon[108723]: from='client.? 172.21.15.3:0/2403781634' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 18, "format": "json"} : dispatch 2024-09-21T12:32:15.965 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:32:15 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:32:15.965 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:32:15 smithi192 ceph-mon[80326]: pgmap v344: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:32:15.965 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:32:15 smithi192 ceph-mon[80326]: from='client.? 172.21.15.3:0/2403781634' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 18, "format": "json"} : dispatch 2024-09-21T12:32:16.169 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 19 2024-09-21T12:32:16.428 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:32:16.885 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:16.881+0000 7fd5f2af7640 1 -- 172.21.15.3:0/3034038974 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd5ec107900 msgr2=0x7fd5ec107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:16.885 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:16.881+0000 7fd5f2af7640 1 --2- 172.21.15.3:0/3034038974 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd5ec107900 0x7fd5ec107ce0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd5e0009880 tx=0x7fd5e002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:32:16.885 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:16.881+0000 7fd5f2af7640 1 -- 172.21.15.3:0/3034038974 shutdown_connections 2024-09-21T12:32:16.885 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:16.881+0000 7fd5f2af7640 1 --2- 172.21.15.3:0/3034038974 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5ec101900 0x7fd5ec101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:16.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:16.881+0000 7fd5f2af7640 1 --2- 172.21.15.3:0/3034038974 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd5ec107900 0x7fd5ec107ce0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:16.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:16.881+0000 7fd5f2af7640 1 -- 172.21.15.3:0/3034038974 >> 172.21.15.3:0/3034038974 conn(0x7fd5ec0fd600 msgr2=0x7fd5ec0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:32:16.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:16.882+0000 7fd5f2af7640 1 -- 172.21.15.3:0/3034038974 shutdown_connections 2024-09-21T12:32:16.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:16.882+0000 7fd5f2af7640 1 -- 172.21.15.3:0/3034038974 wait complete. 2024-09-21T12:32:16.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:16.882+0000 7fd5f2af7640 1 Processor -- start 2024-09-21T12:32:16.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:16.882+0000 7fd5f2af7640 1 -- start start 2024-09-21T12:32:16.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:16.883+0000 7fd5f2af7640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5ec101900 0x7fd5ec0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:16.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:16.883+0000 7fd5f2af7640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd5ec107900 0x7fd5ec074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:16.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:16.883+0000 7fd5f2af7640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fd5ec10edd0 con 0x7fd5ec107900 2024-09-21T12:32:16.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:16.883+0000 7fd5f2af7640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd5ec10ec50 con 0x7fd5ec101900 2024-09-21T12:32:16.886 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:16.883+0000 7fd5ebfff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd5ec107900 0x7fd5ec074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:16.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:16.883+0000 7fd5ebfff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd5ec107900 0x7fd5ec074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:52236/0 (socket says 172.21.15.3:52236) 2024-09-21T12:32:16.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:16.883+0000 7fd5f0893640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5ec101900 0x7fd5ec0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:16.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:16.883+0000 7fd5ebfff640 1 -- 172.21.15.3:0/2603439067 learned_addr learned my addr 172.21.15.3:0/2603439067 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:32:16.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:16.883+0000 7fd5ebfff640 1 -- 172.21.15.3:0/2603439067 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5ec101900 msgr2=0x7fd5ec0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:16.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:16.883+0000 7fd5ebfff640 1 --2- 172.21.15.3:0/2603439067 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5ec101900 0x7fd5ec0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:16.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:16.883+0000 7fd5ebfff640 1 -- 172.21.15.3:0/2603439067 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5ec074f70 con 0x7fd5ec107900 2024-09-21T12:32:16.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:16.883+0000 7fd5ebfff640 1 --2- 172.21.15.3:0/2603439067 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd5ec107900 0x7fd5ec074a30 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd5d800d6f0 tx=0x7fd5d800dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:32:16.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:16.883+0000 7fd5e9ffb640 1 -- 172.21.15.3:0/2603439067 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd5d8017070 con 0x7fd5ec107900 2024-09-21T12:32:16.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:16.883+0000 7fd5e9ffb640 1 -- 172.21.15.3:0/2603439067 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd5d800de00 con 0x7fd5ec107900 2024-09-21T12:32:16.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:16.883+0000 7fd5f2af7640 1 -- 172.21.15.3:0/2603439067 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5ec075260 con 0x7fd5ec107900 2024-09-21T12:32:16.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:16.883+0000 7fd5e9ffb640 1 -- 172.21.15.3:0/2603439067 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd5d8004bb0 con 0x7fd5ec107900 2024-09-21T12:32:16.887 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:16.884+0000 7fd5f2af7640 1 -- 172.21.15.3:0/2603439067 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5ec1a3e40 con 0x7fd5ec107900 2024-09-21T12:32:16.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:16.885+0000 7fd5f2af7640 1 -- 172.21.15.3:0/2603439067 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5ec103040 con 0x7fd5ec107900 2024-09-21T12:32:16.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:16.885+0000 7fd5e9ffb640 1 -- 172.21.15.3:0/2603439067 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7fd5d8004e60 con 0x7fd5ec107900 2024-09-21T12:32:16.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:16.886+0000 7fd5e9ffb640 1 --2- 172.21.15.3:0/2603439067 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fd5dc07af30 0x7fd5dc07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:16.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:16.886+0000 7fd5e9ffb640 1 -- 172.21.15.3:0/2603439067 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6414+0+0 (secure 0 0 0) 0x7fd5d809dc80 con 0x7fd5ec107900 2024-09-21T12:32:16.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:16.886+0000 7fd5f0893640 1 --2- 172.21.15.3:0/2603439067 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fd5dc07af30 0x7fd5dc07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:16.888 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:16.886+0000 7fd5f0893640 1 --2- 172.21.15.3:0/2603439067 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fd5dc07af30 0x7fd5dc07d3f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd5e00096c0 tx=0x7fd5e0031400 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:32:16.892 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:16.890+0000 7fd5e9ffb640 1 -- 172.21.15.3:0/2603439067 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd5d8069180 con 0x7fd5ec107900 2024-09-21T12:32:17.120 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:17.118+0000 7fd5f2af7640 1 -- 172.21.15.3:0/2603439067 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 19, "format": "json"} v 0) -- 0x7fd5ec101d60 con 0x7fd5ec107900 2024-09-21T12:32:17.120 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:17.119+0000 7fd5e9ffb640 1 -- 172.21.15.3:0/2603439067 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 19, "format": "json"}]=0 dumped fsmap epoch 19 v35) ==== 107+0+4465 (secure 0 0 0) 0x7fd5d806e030 con 0x7fd5ec107900 2024-09-21T12:32:17.121 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:32:17.121 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":19,"btime":"2024-09-21T12:29:31:927617+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24337,"name":"cephfs.smithi192.ktdqns","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.192:6827/318800854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":318800854},{"type":"v1","addr":"172.21.15.192:6827","nonce":318800854}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":34314,"name":"cephfs.smithi003.ebjgyl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6827/1616995236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":1616995236},{"type":"v1","addr":"172.21.15.3:6827","nonce":1616995236}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T12:17:38.260099+0000","modified":"2024-09-21T12:29:31.234015+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":79,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24319},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24319":{"gid":24319,"name":"cephfs.smithi192.ywqqxe","rank":0,"incarnation":18,"state":"up:reconnect","state_seq":178,"addr":"172.21.15.192:6825/4055220871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":4055220871},{"type":"v1","addr":"172.21.15.192:6825","nonce":4055220871}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T12:32:17.121 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 19 2024-09-21T12:32:17.123 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:17.121+0000 7fd5f2af7640 1 -- 172.21.15.3:0/2603439067 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fd5dc07af30 msgr2=0x7fd5dc07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:17.123 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:17.121+0000 7fd5f2af7640 1 --2- 172.21.15.3:0/2603439067 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fd5dc07af30 0x7fd5dc07d3f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd5e00096c0 tx=0x7fd5e0031400 comp rx=0 tx=0).stop 2024-09-21T12:32:17.123 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:17.121+0000 7fd5f2af7640 1 -- 172.21.15.3:0/2603439067 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd5ec107900 msgr2=0x7fd5ec074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:17.123 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:17.121+0000 7fd5f2af7640 1 --2- 172.21.15.3:0/2603439067 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd5ec107900 0x7fd5ec074a30 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd5d800d6f0 tx=0x7fd5d800dbb0 comp rx=0 tx=0).stop 2024-09-21T12:32:17.123 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:17.121+0000 7fd5f2af7640 1 -- 172.21.15.3:0/2603439067 shutdown_connections 2024-09-21T12:32:17.123 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:17.121+0000 7fd5f2af7640 1 --2- 172.21.15.3:0/2603439067 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fd5dc07af30 0x7fd5dc07d3f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:17.124 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:17.121+0000 7fd5f2af7640 1 --2- 172.21.15.3:0/2603439067 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd5ec107900 0x7fd5ec074a30 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:17.124 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:17.121+0000 7fd5f2af7640 1 --2- 172.21.15.3:0/2603439067 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd5ec101900 0x7fd5ec0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:17.124 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:17.121+0000 7fd5f2af7640 1 -- 172.21.15.3:0/2603439067 >> 172.21.15.3:0/2603439067 conn(0x7fd5ec0fd600 msgr2=0x7fd5ec0fde90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:32:17.124 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:17.122+0000 7fd5f2af7640 1 -- 172.21.15.3:0/2603439067 shutdown_connections 2024-09-21T12:32:17.124 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:17.122+0000 7fd5f2af7640 1 -- 172.21.15.3:0/2603439067 wait complete. 2024-09-21T12:32:17.847 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 20 2024-09-21T12:32:18.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:32:17 smithi003 ceph-mon[108723]: pgmap v345: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:32:18.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:32:17 smithi003 ceph-mon[108723]: from='client.? 172.21.15.3:0/2603439067' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 19, "format": "json"} : dispatch 2024-09-21T12:32:18.114 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:32:18.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:32:17 smithi192 ceph-mon[80326]: pgmap v345: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:32:18.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:32:17 smithi192 ceph-mon[80326]: from='client.? 172.21.15.3:0/2603439067' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 19, "format": "json"} : dispatch 2024-09-21T12:32:18.600 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:18.582+0000 7fdc9a651640 1 -- 172.21.15.3:0/3707296132 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdc94106800 msgr2=0x7fdc94106be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:18.600 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:18.582+0000 7fdc9a651640 1 --2- 172.21.15.3:0/3707296132 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdc94106800 0x7fdc94106be0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fdc84009880 tx=0x7fdc8402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:32:18.600 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:18.582+0000 7fdc9a651640 1 -- 172.21.15.3:0/3707296132 shutdown_connections 2024-09-21T12:32:18.600 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:18.582+0000 7fdc9a651640 1 --2- 172.21.15.3:0/3707296132 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdc94100800 0x7fdc94100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:18.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:18.582+0000 7fdc9a651640 1 --2- 172.21.15.3:0/3707296132 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdc94106800 0x7fdc94106be0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:18.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:18.582+0000 7fdc9a651640 1 -- 172.21.15.3:0/3707296132 >> 172.21.15.3:0/3707296132 conn(0x7fdc940fc520 msgr2=0x7fdc940fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:32:18.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:18.582+0000 7fdc9a651640 1 -- 172.21.15.3:0/3707296132 shutdown_connections 2024-09-21T12:32:18.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:18.582+0000 7fdc9a651640 1 -- 172.21.15.3:0/3707296132 wait complete. 2024-09-21T12:32:18.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:18.583+0000 7fdc9a651640 1 Processor -- start 2024-09-21T12:32:18.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:18.583+0000 7fdc9a651640 1 -- start start 2024-09-21T12:32:18.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:18.583+0000 7fdc9a651640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdc94100800 0x7fdc941023d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:18.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:18.583+0000 7fdc9a651640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdc94106800 0x7fdc94102910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:18.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:18.583+0000 7fdc9a651640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fdc9410dcd0 con 0x7fdc94100800 2024-09-21T12:32:18.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:18.583+0000 7fdc9a651640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fdc9410db50 con 0x7fdc94106800 2024-09-21T12:32:18.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:18.583+0000 7fdc93fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdc94100800 0x7fdc941023d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:18.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:18.583+0000 7fdc93fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdc94100800 0x7fdc941023d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:52248/0 (socket says 172.21.15.3:52248) 2024-09-21T12:32:18.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:18.583+0000 7fdc93fff640 1 -- 172.21.15.3:0/579475151 learned_addr learned my addr 172.21.15.3:0/579475151 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:32:18.601 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:18.584+0000 7fdc93fff640 1 -- 172.21.15.3:0/579475151 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdc94106800 msgr2=0x7fdc94102910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:18.602 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:18.584+0000 7fdc93fff640 1 --2- 172.21.15.3:0/579475151 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdc94106800 0x7fdc94102910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:18.602 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:18.584+0000 7fdc93fff640 1 -- 172.21.15.3:0/579475151 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc94102e50 con 0x7fdc94100800 2024-09-21T12:32:18.602 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:18.584+0000 7fdc93fff640 1 --2- 172.21.15.3:0/579475151 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdc94100800 0x7fdc941023d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fdc84031460 tx=0x7fdc840045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:32:18.602 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:18.584+0000 7fdc917fa640 1 -- 172.21.15.3:0/579475151 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdc8403f070 con 0x7fdc94100800 2024-09-21T12:32:18.602 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:18.584+0000 7fdc9a651640 1 -- 172.21.15.3:0/579475151 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc941030e0 con 0x7fdc94100800 2024-09-21T12:32:18.602 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:18.584+0000 7fdc917fa640 1 -- 172.21.15.3:0/579475151 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fdc840035f0 con 0x7fdc94100800 2024-09-21T12:32:18.602 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:18.584+0000 7fdc917fa640 1 -- 172.21.15.3:0/579475151 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fdc84035030 con 0x7fdc94100800 2024-09-21T12:32:18.602 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:18.584+0000 7fdc9a651640 1 -- 172.21.15.3:0/579475151 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc941a3d40 con 0x7fdc94100800 2024-09-21T12:32:18.602 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:18.585+0000 7fdc9a651640 1 -- 172.21.15.3:0/579475151 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc94101f40 con 0x7fdc94100800 2024-09-21T12:32:18.602 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:18.586+0000 7fdc917fa640 1 -- 172.21.15.3:0/579475151 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7fdc84042070 con 0x7fdc94100800 2024-09-21T12:32:18.602 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:18.586+0000 7fdc917fa640 1 --2- 172.21.15.3:0/579475151 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fdc7c07af30 0x7fdc7c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:18.602 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:18.586+0000 7fdc917fa640 1 -- 172.21.15.3:0/579475151 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6414+0+0 (secure 0 0 0) 0x7fdc840beb20 con 0x7fdc94100800 2024-09-21T12:32:18.602 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:18.586+0000 7fdc937fe640 1 --2- 172.21.15.3:0/579475151 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fdc7c07af30 0x7fdc7c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:18.602 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:18.587+0000 7fdc937fe640 1 --2- 172.21.15.3:0/579475151 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fdc7c07af30 0x7fdc7c07d3f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fdc88005fd0 tx=0x7fdc88005850 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:32:18.602 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:18.590+0000 7fdc917fa640 1 -- 172.21.15.3:0/579475151 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fdc8408a020 con 0x7fdc94100800 2024-09-21T12:32:18.820 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:18.818+0000 7fdc9a651640 1 -- 172.21.15.3:0/579475151 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 20, "format": "json"} v 0) -- 0x7fdc941a3ff0 con 0x7fdc94100800 2024-09-21T12:32:18.820 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:18.819+0000 7fdc917fa640 1 -- 172.21.15.3:0/579475151 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 20, "format": "json"}]=0 dumped fsmap epoch 20 v35) ==== 107+0+5306 (secure 0 0 0) 0x7fdc8408c020 con 0x7fdc94100800 2024-09-21T12:32:18.821 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:32:18.821 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":20,"btime":"2024-09-21T12:29:32:933490+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24337,"name":"cephfs.smithi192.ktdqns","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.192:6827/318800854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":318800854},{"type":"v1","addr":"172.21.15.192:6827","nonce":318800854}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":34314,"name":"cephfs.smithi003.ebjgyl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6827/1616995236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":1616995236},{"type":"v1","addr":"172.21.15.3:6827","nonce":1616995236}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16},{"gid":34346,"name":"cephfs.smithi003.gfkngj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6829/1282732153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":1282732153},{"type":"v1","addr":"172.21.15.3:6829","nonce":1282732153}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T12:17:38.260099+0000","modified":"2024-09-21T12:29:31.935496+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":79,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24319},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24319":{"gid":24319,"name":"cephfs.smithi192.ywqqxe","rank":0,"incarnation":18,"state":"up:rejoin","state_seq":179,"addr":"172.21.15.192:6825/4055220871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":4055220871},{"type":"v1","addr":"172.21.15.192:6825","nonce":4055220871}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T12:32:18.821 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 20 2024-09-21T12:32:18.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:18.821+0000 7fdc9a651640 1 -- 172.21.15.3:0/579475151 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fdc7c07af30 msgr2=0x7fdc7c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:18.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:18.821+0000 7fdc9a651640 1 --2- 172.21.15.3:0/579475151 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fdc7c07af30 0x7fdc7c07d3f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fdc88005fd0 tx=0x7fdc88005850 comp rx=0 tx=0).stop 2024-09-21T12:32:18.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:18.821+0000 7fdc9a651640 1 -- 172.21.15.3:0/579475151 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdc94100800 msgr2=0x7fdc941023d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:18.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:18.821+0000 7fdc9a651640 1 --2- 172.21.15.3:0/579475151 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdc94100800 0x7fdc941023d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fdc84031460 tx=0x7fdc840045e0 comp rx=0 tx=0).stop 2024-09-21T12:32:18.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:18.822+0000 7fdc9a651640 1 -- 172.21.15.3:0/579475151 shutdown_connections 2024-09-21T12:32:18.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:18.822+0000 7fdc9a651640 1 --2- 172.21.15.3:0/579475151 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fdc7c07af30 0x7fdc7c07d3f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:18.823 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:18.822+0000 7fdc9a651640 1 --2- 172.21.15.3:0/579475151 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fdc94106800 0x7fdc94102910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:18.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:18.822+0000 7fdc9a651640 1 --2- 172.21.15.3:0/579475151 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fdc94100800 0x7fdc941023d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:18.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:18.822+0000 7fdc9a651640 1 -- 172.21.15.3:0/579475151 >> 172.21.15.3:0/579475151 conn(0x7fdc940fc520 msgr2=0x7fdc941045b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:32:18.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:18.822+0000 7fdc9a651640 1 -- 172.21.15.3:0/579475151 shutdown_connections 2024-09-21T12:32:18.824 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:18.822+0000 7fdc9a651640 1 -- 172.21.15.3:0/579475151 wait complete. 2024-09-21T12:32:19.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:32:18 smithi003 ceph-mon[108723]: from='client.? 172.21.15.3:0/579475151' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 20, "format": "json"} : dispatch 2024-09-21T12:32:19.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:32:18 smithi192 ceph-mon[80326]: from='client.? 172.21.15.3:0/579475151' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 20, "format": "json"} : dispatch 2024-09-21T12:32:19.588 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 21 2024-09-21T12:32:19.853 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:32:20.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:32:19 smithi192 ceph-mon[80326]: pgmap v346: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:32:20.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:32:19 smithi003 ceph-mon[108723]: pgmap v346: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:32:20.550 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:20.533+0000 7f9a9c300640 1 -- 172.21.15.3:0/2179050632 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9a94100800 msgr2=0x7f9a94100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:20.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:20.533+0000 7f9a9c300640 1 --2- 172.21.15.3:0/2179050632 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9a94100800 0x7f9a94100c60 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f9a84009880 tx=0x7f9a8402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:32:20.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:20.534+0000 7f9a9c300640 1 -- 172.21.15.3:0/2179050632 shutdown_connections 2024-09-21T12:32:20.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:20.534+0000 7f9a9c300640 1 --2- 172.21.15.3:0/2179050632 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9a94100800 0x7f9a94100c60 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:20.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:20.534+0000 7f9a9c300640 1 --2- 172.21.15.3:0/2179050632 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a94106800 0x7f9a94106be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:20.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:20.534+0000 7f9a9c300640 1 -- 172.21.15.3:0/2179050632 >> 172.21.15.3:0/2179050632 conn(0x7f9a940fc520 msgr2=0x7f9a940fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:32:20.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:20.534+0000 7f9a9c300640 1 -- 172.21.15.3:0/2179050632 shutdown_connections 2024-09-21T12:32:20.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:20.534+0000 7f9a9c300640 1 -- 172.21.15.3:0/2179050632 wait complete. 2024-09-21T12:32:20.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:20.534+0000 7f9a9c300640 1 Processor -- start 2024-09-21T12:32:20.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:20.534+0000 7f9a9c300640 1 -- start start 2024-09-21T12:32:20.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:20.535+0000 7f9a9c300640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a94100800 0x7f9a9419d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:20.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:20.535+0000 7f9a9c300640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9a94106800 0x7f9a9419db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:20.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:20.535+0000 7f9a9c300640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f9a9410edd0 con 0x7f9a94106800 2024-09-21T12:32:20.551 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:20.535+0000 7f9a9c300640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f9a9410ec50 con 0x7f9a94100800 2024-09-21T12:32:20.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:20.535+0000 7f9a9989b640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9a94106800 0x7f9a9419db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:20.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:20.535+0000 7f9a9989b640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9a94106800 0x7f9a9419db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:43838/0 (socket says 172.21.15.3:43838) 2024-09-21T12:32:20.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:20.535+0000 7f9a9989b640 1 -- 172.21.15.3:0/3007277745 learned_addr learned my addr 172.21.15.3:0/3007277745 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:32:20.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:20.535+0000 7f9a9a09c640 1 --2- 172.21.15.3:0/3007277745 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a94100800 0x7f9a9419d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:20.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:20.535+0000 7f9a9989b640 1 -- 172.21.15.3:0/3007277745 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a94100800 msgr2=0x7f9a9419d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:20.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:20.535+0000 7f9a9989b640 1 --2- 172.21.15.3:0/3007277745 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a94100800 0x7f9a9419d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:20.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:20.535+0000 7f9a9989b640 1 -- 172.21.15.3:0/3007277745 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a941977a0 con 0x7f9a94106800 2024-09-21T12:32:20.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:20.535+0000 7f9a9a09c640 1 --2- 172.21.15.3:0/3007277745 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a94100800 0x7f9a9419d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:32:20.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:20.535+0000 7f9a9989b640 1 --2- 172.21.15.3:0/3007277745 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9a94106800 0x7f9a9419db60 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9a84031460 tx=0x7f9a840045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:32:20.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:20.536+0000 7f9a8b7fe640 1 -- 172.21.15.3:0/3007277745 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9a8403f070 con 0x7f9a94106800 2024-09-21T12:32:20.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:20.536+0000 7f9a8b7fe640 1 -- 172.21.15.3:0/3007277745 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f9a840035f0 con 0x7f9a94106800 2024-09-21T12:32:20.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:20.536+0000 7f9a9c300640 1 -- 172.21.15.3:0/3007277745 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a94197a30 con 0x7f9a94106800 2024-09-21T12:32:20.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:20.536+0000 7f9a8b7fe640 1 -- 172.21.15.3:0/3007277745 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f9a84035030 con 0x7f9a94106800 2024-09-21T12:32:20.552 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:20.536+0000 7f9a9c300640 1 -- 172.21.15.3:0/3007277745 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a94197f60 con 0x7f9a94106800 2024-09-21T12:32:20.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:20.537+0000 7f9a9c300640 1 -- 172.21.15.3:0/3007277745 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a94101f40 con 0x7f9a94106800 2024-09-21T12:32:20.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:20.537+0000 7f9a8b7fe640 1 -- 172.21.15.3:0/3007277745 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f9a84042070 con 0x7f9a94106800 2024-09-21T12:32:20.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:20.538+0000 7f9a8b7fe640 1 --2- 172.21.15.3:0/3007277745 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f9a8007af30 0x7f9a8007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:20.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:20.538+0000 7f9a8b7fe640 1 -- 172.21.15.3:0/3007277745 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6414+0+0 (secure 0 0 0) 0x7f9a840beb20 con 0x7f9a94106800 2024-09-21T12:32:20.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:20.538+0000 7f9a9a09c640 1 --2- 172.21.15.3:0/3007277745 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f9a8007af30 0x7f9a8007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:20.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:20.538+0000 7f9a9a09c640 1 --2- 172.21.15.3:0/3007277745 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f9a8007af30 0x7f9a8007d3f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9a900058c0 tx=0x7f9a90005850 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:32:20.553 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:20.542+0000 7f9a8b7fe640 1 -- 172.21.15.3:0/3007277745 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f9a8408a020 con 0x7f9a94106800 2024-09-21T12:32:20.770 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:20.768+0000 7f9a9c300640 1 -- 172.21.15.3:0/3007277745 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 21, "format": "json"} v 0) -- 0x7f9a94108d70 con 0x7f9a94106800 2024-09-21T12:32:20.770 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:20.769+0000 7f9a8b7fe640 1 -- 172.21.15.3:0/3007277745 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 21, "format": "json"}]=0 dumped fsmap epoch 21 v35) ==== 107+0+5315 (secure 0 0 0) 0x7f9a8408c020 con 0x7f9a94106800 2024-09-21T12:32:20.771 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:32:20.771 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":21,"btime":"2024-09-21T12:29:33:939130+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24337,"name":"cephfs.smithi192.ktdqns","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.192:6827/318800854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":318800854},{"type":"v1","addr":"172.21.15.192:6827","nonce":318800854}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":34314,"name":"cephfs.smithi003.ebjgyl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6827/1616995236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":1616995236},{"type":"v1","addr":"172.21.15.3:6827","nonce":1616995236}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16},{"gid":34346,"name":"cephfs.smithi003.gfkngj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6829/1282732153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":1282732153},{"type":"v1","addr":"172.21.15.3:6829","nonce":1282732153}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":21,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T12:17:38.260099+0000","modified":"2024-09-21T12:29:33.939123+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":79,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24319},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24319":{"gid":24319,"name":"cephfs.smithi192.ywqqxe","rank":0,"incarnation":18,"state":"up:active","state_seq":180,"addr":"172.21.15.192:6825/4055220871","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":4055220871},{"type":"v1","addr":"172.21.15.192:6825","nonce":4055220871}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24319,"qdb_cluster":[24319]},"id":1}]} 2024-09-21T12:32:20.771 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 21 2024-09-21T12:32:20.773 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:20.771+0000 7f9a9c300640 1 -- 172.21.15.3:0/3007277745 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f9a8007af30 msgr2=0x7f9a8007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:20.773 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:20.771+0000 7f9a9c300640 1 --2- 172.21.15.3:0/3007277745 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f9a8007af30 0x7f9a8007d3f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9a900058c0 tx=0x7f9a90005850 comp rx=0 tx=0).stop 2024-09-21T12:32:20.773 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:20.771+0000 7f9a9c300640 1 -- 172.21.15.3:0/3007277745 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9a94106800 msgr2=0x7f9a9419db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:20.773 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:20.771+0000 7f9a9c300640 1 --2- 172.21.15.3:0/3007277745 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9a94106800 0x7f9a9419db60 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9a84031460 tx=0x7f9a840045e0 comp rx=0 tx=0).stop 2024-09-21T12:32:20.773 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:20.771+0000 7f9a9c300640 1 -- 172.21.15.3:0/3007277745 shutdown_connections 2024-09-21T12:32:20.773 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:20.771+0000 7f9a9c300640 1 --2- 172.21.15.3:0/3007277745 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f9a8007af30 0x7f9a8007d3f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:20.773 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:20.771+0000 7f9a9c300640 1 --2- 172.21.15.3:0/3007277745 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f9a94106800 0x7f9a9419db60 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:20.773 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:20.771+0000 7f9a9c300640 1 --2- 172.21.15.3:0/3007277745 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f9a94100800 0x7f9a9419d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:20.773 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:20.771+0000 7f9a9c300640 1 -- 172.21.15.3:0/3007277745 >> 172.21.15.3:0/3007277745 conn(0x7f9a940fc520 msgr2=0x7f9a940fcd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:32:20.773 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:20.772+0000 7f9a9c300640 1 -- 172.21.15.3:0/3007277745 shutdown_connections 2024-09-21T12:32:20.774 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:20.772+0000 7f9a9c300640 1 -- 172.21.15.3:0/3007277745 wait complete. 2024-09-21T12:32:21.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:32:21 smithi003 ceph-mon[108723]: from='client.? 172.21.15.3:0/3007277745' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 21, "format": "json"} : dispatch 2024-09-21T12:32:21.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:32:21 smithi192 ceph-mon[80326]: from='client.? 172.21.15.3:0/3007277745' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 21, "format": "json"} : dispatch 2024-09-21T12:32:21.400 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 22 2024-09-21T12:32:21.657 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:32:22.050 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:32:22 smithi003 ceph-mon[108723]: pgmap v347: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:32:22.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:22.132+0000 7f72fcbc0640 1 -- 172.21.15.3:0/1206562527 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f72f81033e0 msgr2=0x7f72f810b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:22.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:22.132+0000 7f72fcbc0640 1 --2- 172.21.15.3:0/1206562527 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f72f81033e0 0x7f72f810b8d0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f72ec009880 tx=0x7f72ec02a530 comp rx=0 tx=0).stop 2024-09-21T12:32:22.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:22.132+0000 7f72fcbc0640 1 -- 172.21.15.3:0/1206562527 shutdown_connections 2024-09-21T12:32:22.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:22.132+0000 7f72fcbc0640 1 --2- 172.21.15.3:0/1206562527 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f72f81033e0 0x7f72f810b8d0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:22.142 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:22.132+0000 7f72fcbc0640 1 --2- 172.21.15.3:0/1206562527 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f72f8102ac0 0x7f72f8102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:22.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:22.132+0000 7f72fcbc0640 1 -- 172.21.15.3:0/1206562527 >> 172.21.15.3:0/1206562527 conn(0x7f72f80fc520 msgr2=0x7f72f80fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:32:22.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:22.132+0000 7f72fcbc0640 1 -- 172.21.15.3:0/1206562527 shutdown_connections 2024-09-21T12:32:22.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:22.132+0000 7f72fcbc0640 1 -- 172.21.15.3:0/1206562527 wait complete. 2024-09-21T12:32:22.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:22.133+0000 7f72fcbc0640 1 Processor -- start 2024-09-21T12:32:22.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:22.133+0000 7f72fcbc0640 1 -- start start 2024-09-21T12:32:22.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:22.134+0000 7f72fcbc0640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f72f8102ac0 0x7f72f819f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:22.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:22.134+0000 7f72fcbc0640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f72f81033e0 0x7f72f819fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:22.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:22.134+0000 7f72fcbc0640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f72f810ee50 con 0x7f72f8102ac0 2024-09-21T12:32:22.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:22.134+0000 7f72fcbc0640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f72f810ecd0 con 0x7f72f81033e0 2024-09-21T12:32:22.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:22.134+0000 7f72f659c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f72f8102ac0 0x7f72f819f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:22.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:22.134+0000 7f72f659c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f72f8102ac0 0x7f72f819f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:43854/0 (socket says 172.21.15.3:43854) 2024-09-21T12:32:22.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:22.134+0000 7f72f659c640 1 -- 172.21.15.3:0/3019867227 learned_addr learned my addr 172.21.15.3:0/3019867227 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:32:22.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:22.134+0000 7f72f5d9b640 1 --2- 172.21.15.3:0/3019867227 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f72f81033e0 0x7f72f819fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:22.143 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:22.134+0000 7f72f659c640 1 -- 172.21.15.3:0/3019867227 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f72f81033e0 msgr2=0x7f72f819fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:22.144 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:22.134+0000 7f72f659c640 1 --2- 172.21.15.3:0/3019867227 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f72f81033e0 0x7f72f819fdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:22.144 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:22.134+0000 7f72f659c640 1 -- 172.21.15.3:0/3019867227 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72f8199a50 con 0x7f72f8102ac0 2024-09-21T12:32:22.144 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:22.134+0000 7f72f659c640 1 --2- 172.21.15.3:0/3019867227 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f72f8102ac0 0x7f72f819f890 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f72e800ba50 tx=0x7f72e800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:32:22.144 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:22.134+0000 7f72e77fe640 1 -- 172.21.15.3:0/3019867227 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f72e8019070 con 0x7f72f8102ac0 2024-09-21T12:32:22.144 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:22.134+0000 7f72e77fe640 1 -- 172.21.15.3:0/3019867227 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f72e800ce20 con 0x7f72f8102ac0 2024-09-21T12:32:22.144 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:22.134+0000 7f72fcbc0640 1 -- 172.21.15.3:0/3019867227 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72f8199d40 con 0x7f72f8102ac0 2024-09-21T12:32:22.144 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:22.134+0000 7f72e77fe640 1 -- 172.21.15.3:0/3019867227 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f72e80075a0 con 0x7f72f8102ac0 2024-09-21T12:32:22.144 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:22.134+0000 7f72fcbc0640 1 -- 172.21.15.3:0/3019867227 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72f819a2a0 con 0x7f72f8102ac0 2024-09-21T12:32:22.144 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:22.135+0000 7f72fcbc0640 1 -- 172.21.15.3:0/3019867227 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72f806aa90 con 0x7f72f8102ac0 2024-09-21T12:32:22.144 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:22.136+0000 7f72e77fe640 1 -- 172.21.15.3:0/3019867227 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f72e801c070 con 0x7f72f8102ac0 2024-09-21T12:32:22.145 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:22.136+0000 7f72e77fe640 1 --2- 172.21.15.3:0/3019867227 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f72e007af40 0x7f72e007d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:22.145 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:22.137+0000 7f72e77fe640 1 -- 172.21.15.3:0/3019867227 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6414+0+0 (secure 0 0 0) 0x7f72e809d9f0 con 0x7f72f8102ac0 2024-09-21T12:32:22.145 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:22.137+0000 7f72f5d9b640 1 --2- 172.21.15.3:0/3019867227 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f72e007af40 0x7f72e007d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:22.145 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:22.137+0000 7f72f5d9b640 1 --2- 172.21.15.3:0/3019867227 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f72e007af40 0x7f72e007d400 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f72f819b240 tx=0x7f72ec0095c0 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:32:22.146 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:22.141+0000 7f72e77fe640 1 -- 172.21.15.3:0/3019867227 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f72e8068ef0 con 0x7f72f8102ac0 2024-09-21T12:32:22.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:32:22 smithi192 ceph-mon[80326]: pgmap v347: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:32:22.367 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:22.365+0000 7f72fcbc0640 1 -- 172.21.15.3:0/3019867227 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 22, "format": "json"} v 0) -- 0x7f72f810b3a0 con 0x7f72f8102ac0 2024-09-21T12:32:22.367 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:22.366+0000 7f72e77fe640 1 -- 172.21.15.3:0/3019867227 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 22, "format": "json"}]=0 dumped fsmap epoch 22 v35) ==== 107+0+4443 (secure 0 0 0) 0x7f72e806dda0 con 0x7f72f8102ac0 2024-09-21T12:32:22.368 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:32:22.368 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":22,"btime":"2024-09-21T12:29:44:450919+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24337,"name":"cephfs.smithi192.ktdqns","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.192:6827/318800854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":318800854},{"type":"v1","addr":"172.21.15.192:6827","nonce":318800854}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13},{"gid":34314,"name":"cephfs.smithi003.ebjgyl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6827/1616995236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":1616995236},{"type":"v1","addr":"172.21.15.3:6827","nonce":1616995236}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16},{"gid":34346,"name":"cephfs.smithi003.gfkngj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6829/1282732153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":1282732153},{"type":"v1","addr":"172.21.15.3:6829","nonce":1282732153}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T12:17:38.260099+0000","modified":"2024-09-21T12:29:44.450914+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T12:32:22.368 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 22 2024-09-21T12:32:22.369 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:22.368+0000 7f72fcbc0640 1 -- 172.21.15.3:0/3019867227 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f72e007af40 msgr2=0x7f72e007d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:22.369 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:22.368+0000 7f72fcbc0640 1 --2- 172.21.15.3:0/3019867227 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f72e007af40 0x7f72e007d400 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f72f819b240 tx=0x7f72ec0095c0 comp rx=0 tx=0).stop 2024-09-21T12:32:22.370 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:22.368+0000 7f72fcbc0640 1 -- 172.21.15.3:0/3019867227 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f72f8102ac0 msgr2=0x7f72f819f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:22.370 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:22.368+0000 7f72fcbc0640 1 --2- 172.21.15.3:0/3019867227 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f72f8102ac0 0x7f72f819f890 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f72e800ba50 tx=0x7f72e800bf10 comp rx=0 tx=0).stop 2024-09-21T12:32:22.370 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:22.368+0000 7f72fcbc0640 1 -- 172.21.15.3:0/3019867227 shutdown_connections 2024-09-21T12:32:22.370 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:22.368+0000 7f72fcbc0640 1 --2- 172.21.15.3:0/3019867227 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f72e007af40 0x7f72e007d400 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:22.370 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:22.368+0000 7f72fcbc0640 1 --2- 172.21.15.3:0/3019867227 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f72f81033e0 0x7f72f819fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:22.370 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:22.368+0000 7f72fcbc0640 1 --2- 172.21.15.3:0/3019867227 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f72f8102ac0 0x7f72f819f890 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:22.370 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:22.368+0000 7f72fcbc0640 1 -- 172.21.15.3:0/3019867227 >> 172.21.15.3:0/3019867227 conn(0x7f72f80fc520 msgr2=0x7f72f8100b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:32:22.370 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:22.368+0000 7f72fcbc0640 1 -- 172.21.15.3:0/3019867227 shutdown_connections 2024-09-21T12:32:22.370 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:22.368+0000 7f72fcbc0640 1 -- 172.21.15.3:0/3019867227 wait complete. 2024-09-21T12:32:22.995 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 23 2024-09-21T12:32:23.258 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:32:23.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:32:23 smithi003 ceph-mon[108723]: from='client.? 172.21.15.3:0/3019867227' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 22, "format": "json"} : dispatch 2024-09-21T12:32:23.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:32:23 smithi003 ceph-mon[108723]: pgmap v348: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:32:23.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:32:23 smithi192 ceph-mon[80326]: from='client.? 172.21.15.3:0/3019867227' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 22, "format": "json"} : dispatch 2024-09-21T12:32:23.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:32:23 smithi192 ceph-mon[80326]: pgmap v348: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:32:23.736 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:23.734+0000 7fc5eaee6640 1 -- 172.21.15.3:0/1917917210 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc5e4105860 msgr2=0x7fc5e4105c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:23.736 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:23.734+0000 7fc5eaee6640 1 --2- 172.21.15.3:0/1917917210 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc5e4105860 0x7fc5e4105c40 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc009880 tx=0x7fc5cc02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:32:23.736 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:23.734+0000 7fc5eaee6640 1 -- 172.21.15.3:0/1917917210 shutdown_connections 2024-09-21T12:32:23.736 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:23.734+0000 7fc5eaee6640 1 --2- 172.21.15.3:0/1917917210 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc5e4101010 0x7fc5e4101450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:23.736 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:23.734+0000 7fc5eaee6640 1 --2- 172.21.15.3:0/1917917210 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc5e4105860 0x7fc5e4105c40 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:23.736 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:23.734+0000 7fc5eaee6640 1 -- 172.21.15.3:0/1917917210 >> 172.21.15.3:0/1917917210 conn(0x7fc5e40fbc90 msgr2=0x7fc5e40fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:32:23.736 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:23.734+0000 7fc5eaee6640 1 -- 172.21.15.3:0/1917917210 shutdown_connections 2024-09-21T12:32:23.737 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:23.734+0000 7fc5eaee6640 1 -- 172.21.15.3:0/1917917210 wait complete. 2024-09-21T12:32:23.737 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:23.735+0000 7fc5eaee6640 1 Processor -- start 2024-09-21T12:32:23.737 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:23.735+0000 7fc5eaee6640 1 -- start start 2024-09-21T12:32:23.738 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:23.735+0000 7fc5eaee6640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc5e4101010 0x7fc5e40fc440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:23.738 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:23.735+0000 7fc5eaee6640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc5e4105860 0x7fc5e40fc980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:23.738 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:23.735+0000 7fc5eaee6640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fc5e410de20 con 0x7fc5e4101010 2024-09-21T12:32:23.738 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:23.735+0000 7fc5eaee6640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fc5e410dca0 con 0x7fc5e4105860 2024-09-21T12:32:23.738 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:23.735+0000 7fc5e8c82640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc5e4101010 0x7fc5e40fc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:23.739 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:23.735+0000 7fc5e8c82640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc5e4101010 0x7fc5e40fc440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:43876/0 (socket says 172.21.15.3:43876) 2024-09-21T12:32:23.739 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:23.735+0000 7fc5e8c82640 1 -- 172.21.15.3:0/297712617 learned_addr learned my addr 172.21.15.3:0/297712617 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:32:23.739 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:23.735+0000 7fc5e3fff640 1 --2- 172.21.15.3:0/297712617 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc5e4105860 0x7fc5e40fc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:23.739 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:23.736+0000 7fc5e8c82640 1 -- 172.21.15.3:0/297712617 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc5e4105860 msgr2=0x7fc5e40fc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:23.739 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:23.736+0000 7fc5e8c82640 1 --2- 172.21.15.3:0/297712617 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc5e4105860 0x7fc5e40fc980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:23.739 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:23.736+0000 7fc5e8c82640 1 -- 172.21.15.3:0/297712617 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5e40fcec0 con 0x7fc5e4101010 2024-09-21T12:32:23.739 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:23.736+0000 7fc5e8c82640 1 --2- 172.21.15.3:0/297712617 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc5e4101010 0x7fc5e40fc440 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc031460 tx=0x7fc5cc0045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:32:23.739 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:23.736+0000 7fc5e1ffb640 1 -- 172.21.15.3:0/297712617 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc5cc03f070 con 0x7fc5e4101010 2024-09-21T12:32:23.739 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:23.736+0000 7fc5e1ffb640 1 -- 172.21.15.3:0/297712617 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fc5cc0035f0 con 0x7fc5e4101010 2024-09-21T12:32:23.739 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:23.736+0000 7fc5eaee6640 1 -- 172.21.15.3:0/297712617 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5e40fd150 con 0x7fc5e4101010 2024-09-21T12:32:23.739 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:23.736+0000 7fc5e1ffb640 1 -- 172.21.15.3:0/297712617 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fc5cc035030 con 0x7fc5e4101010 2024-09-21T12:32:23.739 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:23.736+0000 7fc5eaee6640 1 -- 172.21.15.3:0/297712617 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5e41a3ed0 con 0x7fc5e4101010 2024-09-21T12:32:23.740 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:23.737+0000 7fc5eaee6640 1 -- 172.21.15.3:0/297712617 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5e4102020 con 0x7fc5e4101010 2024-09-21T12:32:23.740 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:23.738+0000 7fc5e1ffb640 1 -- 172.21.15.3:0/297712617 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7fc5cc042070 con 0x7fc5e4101010 2024-09-21T12:32:23.740 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:23.739+0000 7fc5e1ffb640 1 --2- 172.21.15.3:0/297712617 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fc5d007af80 0x7fc5d007d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:23.740 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:23.739+0000 7fc5e3fff640 1 --2- 172.21.15.3:0/297712617 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fc5d007af80 0x7fc5d007d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:23.740 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:23.739+0000 7fc5e1ffb640 1 -- 172.21.15.3:0/297712617 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6414+0+0 (secure 0 0 0) 0x7fc5cc0bea00 con 0x7fc5e4101010 2024-09-21T12:32:23.741 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:23.739+0000 7fc5e3fff640 1 --2- 172.21.15.3:0/297712617 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fc5d007af80 0x7fc5d007d440 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc5e40fded0 tx=0x7fc5d4009760 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:32:23.744 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:23.743+0000 7fc5e1ffb640 1 -- 172.21.15.3:0/297712617 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fc5cc089ee0 con 0x7fc5e4101010 2024-09-21T12:32:23.972 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:23.970+0000 7fc5eaee6640 1 -- 172.21.15.3:0/297712617 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 23, "format": "json"} v 0) -- 0x7fc5e4109de0 con 0x7fc5e4101010 2024-09-21T12:32:23.972 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:23.971+0000 7fc5e1ffb640 1 -- 172.21.15.3:0/297712617 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 23, "format": "json"}]=0 dumped fsmap epoch 23 v35) ==== 107+0+4454 (secure 0 0 0) 0x7fc5e4109de0 con 0x7fc5e4101010 2024-09-21T12:32:23.972 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:32:23.972 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":23,"btime":"2024-09-21T12:29:44:458172+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34314,"name":"cephfs.smithi003.ebjgyl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6827/1616995236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":1616995236},{"type":"v1","addr":"172.21.15.3:6827","nonce":1616995236}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16},{"gid":34346,"name":"cephfs.smithi003.gfkngj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6829/1282732153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":1282732153},{"type":"v1","addr":"172.21.15.3:6829","nonce":1282732153}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":23,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T12:17:38.260099+0000","modified":"2024-09-21T12:29:44.458157+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24337},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24337":{"gid":24337,"name":"cephfs.smithi192.ktdqns","rank":0,"incarnation":23,"state":"up:replay","state_seq":2,"addr":"172.21.15.192:6827/318800854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":318800854},{"type":"v1","addr":"172.21.15.192:6827","nonce":318800854}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T12:32:23.973 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 23 2024-09-21T12:32:23.976 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:23.974+0000 7fc5eaee6640 1 -- 172.21.15.3:0/297712617 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fc5d007af80 msgr2=0x7fc5d007d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:23.976 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:23.974+0000 7fc5eaee6640 1 --2- 172.21.15.3:0/297712617 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fc5d007af80 0x7fc5d007d440 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc5e40fded0 tx=0x7fc5d4009760 comp rx=0 tx=0).stop 2024-09-21T12:32:23.976 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:23.974+0000 7fc5eaee6640 1 -- 172.21.15.3:0/297712617 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc5e4101010 msgr2=0x7fc5e40fc440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:23.976 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:23.974+0000 7fc5eaee6640 1 --2- 172.21.15.3:0/297712617 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc5e4101010 0x7fc5e40fc440 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fc5cc031460 tx=0x7fc5cc0045e0 comp rx=0 tx=0).stop 2024-09-21T12:32:23.976 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:23.974+0000 7fc5eaee6640 1 -- 172.21.15.3:0/297712617 shutdown_connections 2024-09-21T12:32:23.976 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:23.974+0000 7fc5eaee6640 1 --2- 172.21.15.3:0/297712617 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fc5d007af80 0x7fc5d007d440 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:23.977 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:23.974+0000 7fc5eaee6640 1 --2- 172.21.15.3:0/297712617 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fc5e4105860 0x7fc5e40fc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:23.977 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:23.974+0000 7fc5eaee6640 1 --2- 172.21.15.3:0/297712617 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fc5e4101010 0x7fc5e40fc440 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:23.977 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:23.974+0000 7fc5eaee6640 1 -- 172.21.15.3:0/297712617 >> 172.21.15.3:0/297712617 conn(0x7fc5e40fbc90 msgr2=0x7fc5e4100180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:32:23.977 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:23.975+0000 7fc5eaee6640 1 -- 172.21.15.3:0/297712617 shutdown_connections 2024-09-21T12:32:23.977 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:23.975+0000 7fc5eaee6640 1 -- 172.21.15.3:0/297712617 wait complete. 2024-09-21T12:32:24.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:32:24 smithi003 ceph-mon[108723]: from='client.? 172.21.15.3:0/297712617' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 23, "format": "json"} : dispatch 2024-09-21T12:32:24.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:32:24 smithi192 ceph-mon[80326]: from='client.? 172.21.15.3:0/297712617' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 23, "format": "json"} : dispatch 2024-09-21T12:32:24.661 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 24 2024-09-21T12:32:24.923 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:32:25.300 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:32:25 smithi003 ceph-mon[108723]: pgmap v349: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:32:25.384 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:25.382+0000 7f16a975f640 1 -- 172.21.15.3:0/3234314412 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f16a4107900 msgr2=0x7f16a4107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:25.384 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:25.382+0000 7f16a975f640 1 --2- 172.21.15.3:0/3234314412 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f16a4107900 0x7f16a4107ce0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f1694009880 tx=0x7f169402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:32:25.384 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:25.382+0000 7f16a975f640 1 -- 172.21.15.3:0/3234314412 shutdown_connections 2024-09-21T12:32:25.384 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:25.382+0000 7f16a975f640 1 --2- 172.21.15.3:0/3234314412 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16a4101900 0x7f16a4101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:25.385 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:25.382+0000 7f16a975f640 1 --2- 172.21.15.3:0/3234314412 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f16a4107900 0x7f16a4107ce0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:25.385 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:25.382+0000 7f16a975f640 1 -- 172.21.15.3:0/3234314412 >> 172.21.15.3:0/3234314412 conn(0x7f16a40fd600 msgr2=0x7f16a40ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:32:25.385 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:25.383+0000 7f16a975f640 1 -- 172.21.15.3:0/3234314412 shutdown_connections 2024-09-21T12:32:25.385 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:25.383+0000 7f16a975f640 1 -- 172.21.15.3:0/3234314412 wait complete. 2024-09-21T12:32:25.386 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:25.383+0000 7f16a975f640 1 Processor -- start 2024-09-21T12:32:25.386 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:25.383+0000 7f16a975f640 1 -- start start 2024-09-21T12:32:25.386 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:25.383+0000 7f16a975f640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16a4101900 0x7f16a419d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:25.386 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:25.383+0000 7f16a975f640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f16a4107900 0x7f16a419dbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:25.387 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:25.383+0000 7f16a975f640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f16a410ee30 con 0x7f16a4107900 2024-09-21T12:32:25.387 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:25.383+0000 7f16a975f640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f16a410ecb0 con 0x7f16a4101900 2024-09-21T12:32:25.387 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:25.384+0000 7f169bfff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f16a4107900 0x7f16a419dbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:25.387 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:25.384+0000 7f169bfff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f16a4107900 0x7f16a419dbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:43892/0 (socket says 172.21.15.3:43892) 2024-09-21T12:32:25.387 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:25.384+0000 7f169bfff640 1 -- 172.21.15.3:0/54158698 learned_addr learned my addr 172.21.15.3:0/54158698 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:32:25.387 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:25.384+0000 7f16a2ffd640 1 --2- 172.21.15.3:0/54158698 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16a4101900 0x7f16a419d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:25.387 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:25.384+0000 7f169bfff640 1 -- 172.21.15.3:0/54158698 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16a4101900 msgr2=0x7f16a419d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:25.387 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:25.384+0000 7f169bfff640 1 --2- 172.21.15.3:0/54158698 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16a4101900 0x7f16a419d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:25.387 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:25.384+0000 7f169bfff640 1 -- 172.21.15.3:0/54158698 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16a4197810 con 0x7f16a4107900 2024-09-21T12:32:25.387 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:25.384+0000 7f169bfff640 1 --2- 172.21.15.3:0/54158698 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f16a4107900 0x7f16a419dbd0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f168c00b420 tx=0x7f168c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:32:25.387 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:25.384+0000 7f16a0ff9640 1 -- 172.21.15.3:0/54158698 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f168c011630 con 0x7f16a4107900 2024-09-21T12:32:25.388 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:25.384+0000 7f16a0ff9640 1 -- 172.21.15.3:0/54158698 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f168c016070 con 0x7f16a4107900 2024-09-21T12:32:25.388 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:25.384+0000 7f16a975f640 1 -- 172.21.15.3:0/54158698 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16a4197b00 con 0x7f16a4107900 2024-09-21T12:32:25.388 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:25.384+0000 7f16a0ff9640 1 -- 172.21.15.3:0/54158698 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f168c010d40 con 0x7f16a4107900 2024-09-21T12:32:25.388 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:25.384+0000 7f16a975f640 1 -- 172.21.15.3:0/54158698 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16a4198090 con 0x7f16a4107900 2024-09-21T12:32:25.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:25.385+0000 7f16a975f640 1 -- 172.21.15.3:0/54158698 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16a4103040 con 0x7f16a4107900 2024-09-21T12:32:25.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:25.386+0000 7f16a0ff9640 1 -- 172.21.15.3:0/54158698 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f168c01b460 con 0x7f16a4107900 2024-09-21T12:32:25.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:25.386+0000 7f16a0ff9640 1 --2- 172.21.15.3:0/54158698 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f169007af30 0x7f169007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:25.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:25.387+0000 7f16a0ff9640 1 -- 172.21.15.3:0/54158698 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6414+0+0 (secure 0 0 0) 0x7f168c09d930 con 0x7f16a4107900 2024-09-21T12:32:25.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:25.387+0000 7f16a2ffd640 1 --2- 172.21.15.3:0/54158698 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f169007af30 0x7f169007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:25.389 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:25.387+0000 7f16a2ffd640 1 --2- 172.21.15.3:0/54158698 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f169007af30 0x7f169007d3f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1694031460 tx=0x7f1694009560 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:32:25.392 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:25.391+0000 7f16a0ff9640 1 -- 172.21.15.3:0/54158698 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f168c021250 con 0x7f16a4107900 2024-09-21T12:32:25.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:32:25 smithi192 ceph-mon[80326]: pgmap v349: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:32:25.617 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:25.616+0000 7f16a975f640 1 -- 172.21.15.3:0/54158698 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 24, "format": "json"} v 0) -- 0x7f16a4109e70 con 0x7f16a4107900 2024-09-21T12:32:25.618 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:25.616+0000 7f16a0ff9640 1 -- 172.21.15.3:0/54158698 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 24, "format": "json"}]=0 dumped fsmap epoch 24 v35) ==== 107+0+4459 (secure 0 0 0) 0x7f168c068d90 con 0x7f16a4107900 2024-09-21T12:32:25.618 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:32:25.618 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":24,"btime":"2024-09-21T12:29:52:959435+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34314,"name":"cephfs.smithi003.ebjgyl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6827/1616995236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":1616995236},{"type":"v1","addr":"172.21.15.3:6827","nonce":1616995236}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16},{"gid":34346,"name":"cephfs.smithi003.gfkngj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6829/1282732153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":1282732153},{"type":"v1","addr":"172.21.15.3:6829","nonce":1282732153}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T12:17:38.260099+0000","modified":"2024-09-21T12:29:52.784144+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24337},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24337":{"gid":24337,"name":"cephfs.smithi192.ktdqns","rank":0,"incarnation":23,"state":"up:reconnect","state_seq":182,"addr":"172.21.15.192:6827/318800854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":318800854},{"type":"v1","addr":"172.21.15.192:6827","nonce":318800854}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T12:32:25.618 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 24 2024-09-21T12:32:25.620 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:25.618+0000 7f16a975f640 1 -- 172.21.15.3:0/54158698 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f169007af30 msgr2=0x7f169007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:25.620 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:25.618+0000 7f16a975f640 1 --2- 172.21.15.3:0/54158698 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f169007af30 0x7f169007d3f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1694031460 tx=0x7f1694009560 comp rx=0 tx=0).stop 2024-09-21T12:32:25.620 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:25.618+0000 7f16a975f640 1 -- 172.21.15.3:0/54158698 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f16a4107900 msgr2=0x7f16a419dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:25.620 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:25.618+0000 7f16a975f640 1 --2- 172.21.15.3:0/54158698 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f16a4107900 0x7f16a419dbd0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f168c00b420 tx=0x7f168c00b8e0 comp rx=0 tx=0).stop 2024-09-21T12:32:25.620 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:25.619+0000 7f16a975f640 1 -- 172.21.15.3:0/54158698 shutdown_connections 2024-09-21T12:32:25.621 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:25.619+0000 7f16a975f640 1 --2- 172.21.15.3:0/54158698 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f169007af30 0x7f169007d3f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:25.621 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:25.619+0000 7f16a975f640 1 --2- 172.21.15.3:0/54158698 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f16a4107900 0x7f16a419dbd0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:25.621 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:25.619+0000 7f16a975f640 1 --2- 172.21.15.3:0/54158698 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f16a4101900 0x7f16a419d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:25.621 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:25.619+0000 7f16a975f640 1 -- 172.21.15.3:0/54158698 >> 172.21.15.3:0/54158698 conn(0x7f16a40fd600 msgr2=0x7f16a40fdf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:32:25.621 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:25.619+0000 7f16a975f640 1 -- 172.21.15.3:0/54158698 shutdown_connections 2024-09-21T12:32:25.621 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:25.619+0000 7f16a975f640 1 -- 172.21.15.3:0/54158698 wait complete. 2024-09-21T12:32:26.283 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:32:26 smithi003 ceph-mon[108723]: from='client.? 172.21.15.3:0/54158698' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 24, "format": "json"} : dispatch 2024-09-21T12:32:26.324 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 25 2024-09-21T12:32:26.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:32:26 smithi192 ceph-mon[80326]: from='client.? 172.21.15.3:0/54158698' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 24, "format": "json"} : dispatch 2024-09-21T12:32:26.591 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:32:27.075 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:27.031+0000 7fb3bb210640 1 -- 172.21.15.3:0/2787521911 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb3b4101900 msgr2=0x7fb3b4101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:27.075 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:27.031+0000 7fb3bb210640 1 --2- 172.21.15.3:0/2787521911 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb3b4101900 0x7fb3b4101d60 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb3a0009880 tx=0x7fb3a002a4a0 comp rx=0 tx=0).stop 2024-09-21T12:32:27.076 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:27.031+0000 7fb3bb210640 1 -- 172.21.15.3:0/2787521911 shutdown_connections 2024-09-21T12:32:27.076 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:27.031+0000 7fb3bb210640 1 --2- 172.21.15.3:0/2787521911 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb3b4101900 0x7fb3b4101d60 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:27.076 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:27.031+0000 7fb3bb210640 1 --2- 172.21.15.3:0/2787521911 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb3b4107900 0x7fb3b4107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:27.076 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:27.031+0000 7fb3bb210640 1 -- 172.21.15.3:0/2787521911 >> 172.21.15.3:0/2787521911 conn(0x7fb3b40fd600 msgr2=0x7fb3b40ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:32:27.076 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:27.031+0000 7fb3bb210640 1 -- 172.21.15.3:0/2787521911 shutdown_connections 2024-09-21T12:32:27.076 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:27.031+0000 7fb3bb210640 1 -- 172.21.15.3:0/2787521911 wait complete. 2024-09-21T12:32:27.076 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:27.032+0000 7fb3bb210640 1 Processor -- start 2024-09-21T12:32:27.076 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:27.032+0000 7fb3bb210640 1 -- start start 2024-09-21T12:32:27.076 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:27.032+0000 7fb3bb210640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb3b4101900 0x7fb3b40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:27.076 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:27.032+0000 7fb3bb210640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb3b4107900 0x7fb3b4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:27.076 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:27.032+0000 7fb3bb210640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b410edb0 con 0x7fb3b4107900 2024-09-21T12:32:27.076 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:27.032+0000 7fb3bb210640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b410ec30 con 0x7fb3b4101900 2024-09-21T12:32:27.076 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:27.032+0000 7fb3b3fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb3b4107900 0x7fb3b4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:27.076 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:27.032+0000 7fb3b3fff640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb3b4107900 0x7fb3b4074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:43912/0 (socket says 172.21.15.3:43912) 2024-09-21T12:32:27.077 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:27.032+0000 7fb3b3fff640 1 -- 172.21.15.3:0/2380260627 learned_addr learned my addr 172.21.15.3:0/2380260627 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:32:27.077 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:27.033+0000 7fb3b8fac640 1 --2- 172.21.15.3:0/2380260627 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb3b4101900 0x7fb3b40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:27.077 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:27.033+0000 7fb3b3fff640 1 -- 172.21.15.3:0/2380260627 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb3b4101900 msgr2=0x7fb3b40744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:27.077 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:27.033+0000 7fb3b3fff640 1 --2- 172.21.15.3:0/2380260627 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb3b4101900 0x7fb3b40744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:27.077 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:27.033+0000 7fb3b3fff640 1 -- 172.21.15.3:0/2380260627 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3b4074f70 con 0x7fb3b4107900 2024-09-21T12:32:27.077 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:27.033+0000 7fb3b3fff640 1 --2- 172.21.15.3:0/2380260627 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb3b4107900 0x7fb3b4074a30 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb3a0031460 tx=0x7fb3a00045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:32:27.077 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:27.033+0000 7fb3b1ffb640 1 -- 172.21.15.3:0/2380260627 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb3a003f070 con 0x7fb3b4107900 2024-09-21T12:32:27.077 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:27.033+0000 7fb3b1ffb640 1 -- 172.21.15.3:0/2380260627 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb3a0004b10 con 0x7fb3b4107900 2024-09-21T12:32:27.077 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:27.033+0000 7fb3bb210640 1 -- 172.21.15.3:0/2380260627 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3b4075200 con 0x7fb3b4107900 2024-09-21T12:32:27.077 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:27.033+0000 7fb3b1ffb640 1 -- 172.21.15.3:0/2380260627 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb3a0035030 con 0x7fb3b4107900 2024-09-21T12:32:27.077 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:27.033+0000 7fb3bb210640 1 -- 172.21.15.3:0/2380260627 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3b41a3d90 con 0x7fb3b4107900 2024-09-21T12:32:27.077 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:27.034+0000 7fb3bb210640 1 -- 172.21.15.3:0/2380260627 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3b4103040 con 0x7fb3b4107900 2024-09-21T12:32:27.077 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:27.035+0000 7fb3b1ffb640 1 -- 172.21.15.3:0/2380260627 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7fb3a0042070 con 0x7fb3b4107900 2024-09-21T12:32:27.077 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:27.036+0000 7fb3b1ffb640 1 --2- 172.21.15.3:0/2380260627 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fb3a407af40 0x7fb3a407d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:27.077 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:27.036+0000 7fb3b1ffb640 1 -- 172.21.15.3:0/2380260627 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6414+0+0 (secure 0 0 0) 0x7fb3a00bec40 con 0x7fb3b4107900 2024-09-21T12:32:27.077 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:27.036+0000 7fb3b8fac640 1 --2- 172.21.15.3:0/2380260627 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fb3a407af40 0x7fb3a407d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:27.078 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:27.036+0000 7fb3b8fac640 1 --2- 172.21.15.3:0/2380260627 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fb3a407af40 0x7fb3a407d400 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb3a800bbe0 tx=0x7fb3a800b390 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:32:27.078 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:27.040+0000 7fb3b1ffb640 1 -- 172.21.15.3:0/2380260627 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb3a008a0a0 con 0x7fb3b4107900 2024-09-21T12:32:27.268 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:27.267+0000 7fb3bb210640 1 -- 172.21.15.3:0/2380260627 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 25, "format": "json"} v 0) -- 0x7fb3b4101d60 con 0x7fb3b4107900 2024-09-21T12:32:27.269 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:27.268+0000 7fb3b1ffb640 1 -- 172.21.15.3:0/2380260627 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 25, "format": "json"}]=0 dumped fsmap epoch 25 v35) ==== 107+0+4456 (secure 0 0 0) 0x7fb3a008ef50 con 0x7fb3b4107900 2024-09-21T12:32:27.269 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:32:27.269 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":25,"btime":"2024-09-21T12:29:53:964097+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34314,"name":"cephfs.smithi003.ebjgyl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6827/1616995236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":1616995236},{"type":"v1","addr":"172.21.15.3:6827","nonce":1616995236}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16},{"gid":34346,"name":"cephfs.smithi003.gfkngj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6829/1282732153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":1282732153},{"type":"v1","addr":"172.21.15.3:6829","nonce":1282732153}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T12:17:38.260099+0000","modified":"2024-09-21T12:29:52.966167+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24337},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24337":{"gid":24337,"name":"cephfs.smithi192.ktdqns","rank":0,"incarnation":23,"state":"up:rejoin","state_seq":183,"addr":"172.21.15.192:6827/318800854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":318800854},{"type":"v1","addr":"172.21.15.192:6827","nonce":318800854}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T12:32:27.270 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 25 2024-09-21T12:32:27.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:27.270+0000 7fb3bb210640 1 -- 172.21.15.3:0/2380260627 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fb3a407af40 msgr2=0x7fb3a407d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:27.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:27.270+0000 7fb3bb210640 1 --2- 172.21.15.3:0/2380260627 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fb3a407af40 0x7fb3a407d400 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb3a800bbe0 tx=0x7fb3a800b390 comp rx=0 tx=0).stop 2024-09-21T12:32:27.271 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:27.270+0000 7fb3bb210640 1 -- 172.21.15.3:0/2380260627 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb3b4107900 msgr2=0x7fb3b4074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:27.272 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:27.270+0000 7fb3bb210640 1 --2- 172.21.15.3:0/2380260627 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb3b4107900 0x7fb3b4074a30 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb3a0031460 tx=0x7fb3a00045e0 comp rx=0 tx=0).stop 2024-09-21T12:32:27.272 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:27.270+0000 7fb3bb210640 1 -- 172.21.15.3:0/2380260627 shutdown_connections 2024-09-21T12:32:27.272 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:27.270+0000 7fb3bb210640 1 --2- 172.21.15.3:0/2380260627 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fb3a407af40 0x7fb3a407d400 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:27.272 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:27.270+0000 7fb3bb210640 1 --2- 172.21.15.3:0/2380260627 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb3b4107900 0x7fb3b4074a30 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:27.272 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:27.270+0000 7fb3bb210640 1 --2- 172.21.15.3:0/2380260627 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb3b4101900 0x7fb3b40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:27.272 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:27.270+0000 7fb3bb210640 1 -- 172.21.15.3:0/2380260627 >> 172.21.15.3:0/2380260627 conn(0x7fb3b40fd600 msgr2=0x7fb3b40fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:32:27.272 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:27.270+0000 7fb3bb210640 1 -- 172.21.15.3:0/2380260627 shutdown_connections 2024-09-21T12:32:27.272 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:27.270+0000 7fb3bb210640 1 -- 172.21.15.3:0/2380260627 wait complete. 2024-09-21T12:32:27.281 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:32:27 smithi003 ceph-mon[108723]: pgmap v350: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:32:27.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:32:27 smithi192 ceph-mon[80326]: pgmap v350: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:32:27.945 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 26 2024-09-21T12:32:28.217 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:32:28.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:32:28 smithi003 ceph-mon[108723]: from='client.? 172.21.15.3:0/2380260627' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 25, "format": "json"} : dispatch 2024-09-21T12:32:28.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:32:28 smithi192 ceph-mon[80326]: from='client.? 172.21.15.3:0/2380260627' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 25, "format": "json"} : dispatch 2024-09-21T12:32:28.690 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:28.681+0000 7fb1c7fae640 1 -- 172.21.15.3:0/4156140237 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb1c01007f0 msgr2=0x7fb1c0100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:28.690 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:28.681+0000 7fb1c7fae640 1 --2- 172.21.15.3:0/4156140237 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb1c01007f0 0x7fb1c0100c50 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fb1b4009880 tx=0x7fb1b402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:32:28.690 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:28.681+0000 7fb1c7fae640 1 -- 172.21.15.3:0/4156140237 shutdown_connections 2024-09-21T12:32:28.690 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:28.681+0000 7fb1c7fae640 1 --2- 172.21.15.3:0/4156140237 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb1c01007f0 0x7fb1c0100c50 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:28.690 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:28.681+0000 7fb1c7fae640 1 --2- 172.21.15.3:0/4156140237 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1c01067f0 0x7fb1c0106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:28.690 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:28.681+0000 7fb1c7fae640 1 -- 172.21.15.3:0/4156140237 >> 172.21.15.3:0/4156140237 conn(0x7fb1c00fc550 msgr2=0x7fb1c00fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:32:28.690 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:28.681+0000 7fb1c7fae640 1 -- 172.21.15.3:0/4156140237 shutdown_connections 2024-09-21T12:32:28.690 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:28.681+0000 7fb1c7fae640 1 -- 172.21.15.3:0/4156140237 wait complete. 2024-09-21T12:32:28.690 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:28.681+0000 7fb1c7fae640 1 Processor -- start 2024-09-21T12:32:28.691 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:28.682+0000 7fb1c7fae640 1 -- start start 2024-09-21T12:32:28.691 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:28.682+0000 7fb1c7fae640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb1c01007f0 0x7fb1c019d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:28.691 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:28.682+0000 7fb1c7fae640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1c01067f0 0x7fb1c019db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:28.691 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:28.682+0000 7fb1c7fae640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fb1c010dca0 con 0x7fb1c01007f0 2024-09-21T12:32:28.691 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:28.682+0000 7fb1c7fae640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb1c010db20 con 0x7fb1c01067f0 2024-09-21T12:32:28.691 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:28.682+0000 7fb1c5d4a640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb1c01007f0 0x7fb1c019d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:28.691 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:28.682+0000 7fb1c5d4a640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb1c01007f0 0x7fb1c019d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:43940/0 (socket says 172.21.15.3:43940) 2024-09-21T12:32:28.691 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:28.682+0000 7fb1c5d4a640 1 -- 172.21.15.3:0/1287010132 learned_addr learned my addr 172.21.15.3:0/1287010132 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:32:28.691 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:28.682+0000 7fb1c5d4a640 1 -- 172.21.15.3:0/1287010132 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1c01067f0 msgr2=0x7fb1c019db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:28.691 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:28.682+0000 7fb1c5549640 1 --2- 172.21.15.3:0/1287010132 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1c01067f0 0x7fb1c019db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:28.691 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:28.682+0000 7fb1c5d4a640 1 --2- 172.21.15.3:0/1287010132 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1c01067f0 0x7fb1c019db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:28.691 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:28.682+0000 7fb1c5d4a640 1 -- 172.21.15.3:0/1287010132 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1c0197780 con 0x7fb1c01007f0 2024-09-21T12:32:28.691 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:28.682+0000 7fb1c5549640 1 --2- 172.21.15.3:0/1287010132 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1c01067f0 0x7fb1c019db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-21T12:32:28.692 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:28.682+0000 7fb1c5d4a640 1 --2- 172.21.15.3:0/1287010132 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb1c01007f0 0x7fb1c019d600 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb1b000cc60 tx=0x7fb1b000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:32:28.692 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:28.683+0000 7fb1beffd640 1 -- 172.21.15.3:0/1287010132 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb1b000ad30 con 0x7fb1c01007f0 2024-09-21T12:32:28.692 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:28.683+0000 7fb1beffd640 1 -- 172.21.15.3:0/1287010132 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fb1b0005020 con 0x7fb1c01007f0 2024-09-21T12:32:28.692 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:28.683+0000 7fb1c7fae640 1 -- 172.21.15.3:0/1287010132 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1c0197a70 con 0x7fb1c01007f0 2024-09-21T12:32:28.692 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:28.683+0000 7fb1beffd640 1 -- 172.21.15.3:0/1287010132 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fb1b000f660 con 0x7fb1c01007f0 2024-09-21T12:32:28.692 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:28.683+0000 7fb1c7fae640 1 -- 172.21.15.3:0/1287010132 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1c0198000 con 0x7fb1c01007f0 2024-09-21T12:32:28.692 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:28.684+0000 7fb1c7fae640 1 -- 172.21.15.3:0/1287010132 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1c0101f30 con 0x7fb1c01007f0 2024-09-21T12:32:28.692 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:28.685+0000 7fb1beffd640 1 -- 172.21.15.3:0/1287010132 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7fb1b00051d0 con 0x7fb1c01007f0 2024-09-21T12:32:28.692 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:28.685+0000 7fb1beffd640 1 --2- 172.21.15.3:0/1287010132 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fb1a807af30 0x7fb1a807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:28.692 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:28.685+0000 7fb1beffd640 1 -- 172.21.15.3:0/1287010132 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6414+0+0 (secure 0 0 0) 0x7fb1b009e6c0 con 0x7fb1c01007f0 2024-09-21T12:32:28.692 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:28.685+0000 7fb1c5549640 1 --2- 172.21.15.3:0/1287010132 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fb1a807af30 0x7fb1a807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:28.692 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:28.686+0000 7fb1c5549640 1 --2- 172.21.15.3:0/1287010132 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fb1a807af30 0x7fb1a807d3f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb1b4031460 tx=0x7fb1b40095f0 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:32:28.693 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:28.690+0000 7fb1beffd640 1 -- 172.21.15.3:0/1287010132 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fb1b0014030 con 0x7fb1c01007f0 2024-09-21T12:32:28.915 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:28.913+0000 7fb1c7fae640 1 -- 172.21.15.3:0/1287010132 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 26, "format": "json"} v 0) -- 0x7fb1c0109d90 con 0x7fb1c01007f0 2024-09-21T12:32:28.915 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:28.914+0000 7fb1beffd640 1 -- 172.21.15.3:0/1287010132 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 26, "format": "json"}]=0 dumped fsmap epoch 26 v35) ==== 107+0+4465 (secure 0 0 0) 0x7fb1b006c0e0 con 0x7fb1c01007f0 2024-09-21T12:32:28.916 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:32:28.916 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":26,"btime":"2024-09-21T12:29:54:973619+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34314,"name":"cephfs.smithi003.ebjgyl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6827/1616995236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":1616995236},{"type":"v1","addr":"172.21.15.3:6827","nonce":1616995236}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16},{"gid":34346,"name":"cephfs.smithi003.gfkngj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6829/1282732153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":1282732153},{"type":"v1","addr":"172.21.15.3:6829","nonce":1282732153}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T12:17:38.260099+0000","modified":"2024-09-21T12:29:54.973615+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24337},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24337":{"gid":24337,"name":"cephfs.smithi192.ktdqns","rank":0,"incarnation":23,"state":"up:active","state_seq":184,"addr":"172.21.15.192:6827/318800854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":318800854},{"type":"v1","addr":"172.21.15.192:6827","nonce":318800854}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24337,"qdb_cluster":[24337]},"id":1}]} 2024-09-21T12:32:28.916 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 26 2024-09-21T12:32:28.918 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:28.916+0000 7fb1c7fae640 1 -- 172.21.15.3:0/1287010132 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fb1a807af30 msgr2=0x7fb1a807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:28.918 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:28.916+0000 7fb1c7fae640 1 --2- 172.21.15.3:0/1287010132 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fb1a807af30 0x7fb1a807d3f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb1b4031460 tx=0x7fb1b40095f0 comp rx=0 tx=0).stop 2024-09-21T12:32:28.918 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:28.916+0000 7fb1c7fae640 1 -- 172.21.15.3:0/1287010132 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb1c01007f0 msgr2=0x7fb1c019d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:28.918 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:28.916+0000 7fb1c7fae640 1 --2- 172.21.15.3:0/1287010132 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb1c01007f0 0x7fb1c019d600 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fb1b000cc60 tx=0x7fb1b000a620 comp rx=0 tx=0).stop 2024-09-21T12:32:28.918 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:28.916+0000 7fb1c7fae640 1 -- 172.21.15.3:0/1287010132 shutdown_connections 2024-09-21T12:32:28.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:28.916+0000 7fb1c7fae640 1 --2- 172.21.15.3:0/1287010132 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fb1a807af30 0x7fb1a807d3f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:28.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:28.916+0000 7fb1c7fae640 1 --2- 172.21.15.3:0/1287010132 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb1c01067f0 0x7fb1c019db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:28.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:28.916+0000 7fb1c7fae640 1 --2- 172.21.15.3:0/1287010132 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb1c01007f0 0x7fb1c019d600 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:28.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:28.916+0000 7fb1c7fae640 1 -- 172.21.15.3:0/1287010132 >> 172.21.15.3:0/1287010132 conn(0x7fb1c00fc550 msgr2=0x7fb1c0069e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:32:28.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:28.916+0000 7fb1c7fae640 1 -- 172.21.15.3:0/1287010132 shutdown_connections 2024-09-21T12:32:28.919 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:28.917+0000 7fb1c7fae640 1 -- 172.21.15.3:0/1287010132 wait complete. 2024-09-21T12:32:29.268 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:32:29 smithi003 ceph-mon[108723]: from='client.? 172.21.15.3:0/1287010132' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 26, "format": "json"} : dispatch 2024-09-21T12:32:29.268 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:32:29 smithi003 ceph-mon[108723]: pgmap v351: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:32:29.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:32:29 smithi192 ceph-mon[80326]: from='client.? 172.21.15.3:0/1287010132' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 26, "format": "json"} : dispatch 2024-09-21T12:32:29.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:32:29 smithi192 ceph-mon[80326]: pgmap v351: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:32:29.581 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 27 2024-09-21T12:32:29.842 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:32:30.283 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:32:30 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:32:30.309 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:30.281+0000 7f5904e41640 1 -- 172.21.15.3:0/2893150786 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5900102ac0 msgr2=0x7f5900102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:30.309 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:30.281+0000 7f5904e41640 1 --2- 172.21.15.3:0/2893150786 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5900102ac0 0x7f5900102ea0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f58f0009c20 tx=0x7f58f002aa00 comp rx=0 tx=0).stop 2024-09-21T12:32:30.309 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:30.281+0000 7f5904e41640 1 -- 172.21.15.3:0/2893150786 shutdown_connections 2024-09-21T12:32:30.309 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:30.281+0000 7f5904e41640 1 --2- 172.21.15.3:0/2893150786 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f59001033e0 0x7f590010b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:30.309 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:30.281+0000 7f5904e41640 1 --2- 172.21.15.3:0/2893150786 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5900102ac0 0x7f5900102ea0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:30.309 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:30.281+0000 7f5904e41640 1 -- 172.21.15.3:0/2893150786 >> 172.21.15.3:0/2893150786 conn(0x7f59000fc520 msgr2=0x7f59000fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:32:30.309 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:30.281+0000 7f5904e41640 1 -- 172.21.15.3:0/2893150786 shutdown_connections 2024-09-21T12:32:30.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:30.281+0000 7f5904e41640 1 -- 172.21.15.3:0/2893150786 wait complete. 2024-09-21T12:32:30.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:30.282+0000 7f5904e41640 1 Processor -- start 2024-09-21T12:32:30.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:30.282+0000 7f5904e41640 1 -- start start 2024-09-21T12:32:30.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:30.283+0000 7f5904e41640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5900102ac0 0x7f590019d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:30.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:30.283+0000 7f5904e41640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f59001033e0 0x7f590019db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:30.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:30.283+0000 7f5904e41640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f590010edf0 con 0x7f5900102ac0 2024-09-21T12:32:30.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:30.283+0000 7f5904e41640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f590010ec70 con 0x7f59001033e0 2024-09-21T12:32:30.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:30.283+0000 7f58fe59c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5900102ac0 0x7f590019d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:30.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:30.283+0000 7f58fe59c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5900102ac0 0x7f590019d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:43962/0 (socket says 172.21.15.3:43962) 2024-09-21T12:32:30.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:30.283+0000 7f58fe59c640 1 -- 172.21.15.3:0/2654008726 learned_addr learned my addr 172.21.15.3:0/2654008726 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:32:30.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:30.283+0000 7f58fdd9b640 1 --2- 172.21.15.3:0/2654008726 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f59001033e0 0x7f590019db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:30.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:30.283+0000 7f58fe59c640 1 -- 172.21.15.3:0/2654008726 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f59001033e0 msgr2=0x7f590019db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:30.310 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:30.283+0000 7f58fe59c640 1 --2- 172.21.15.3:0/2654008726 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f59001033e0 0x7f590019db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:30.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:30.283+0000 7f58fe59c640 1 -- 172.21.15.3:0/2654008726 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59001977c0 con 0x7f5900102ac0 2024-09-21T12:32:30.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:30.283+0000 7f58fe59c640 1 --2- 172.21.15.3:0/2654008726 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5900102ac0 0x7f590019d640 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f58f002af20 tx=0x7f58f002ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:32:30.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:30.284+0000 7f58ef7fe640 1 -- 172.21.15.3:0/2654008726 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f58f0047070 con 0x7f5900102ac0 2024-09-21T12:32:30.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:30.284+0000 7f58ef7fe640 1 -- 172.21.15.3:0/2654008726 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f58f002eeb0 con 0x7f5900102ac0 2024-09-21T12:32:30.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:30.284+0000 7f5904e41640 1 -- 172.21.15.3:0/2654008726 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5900197a50 con 0x7f5900102ac0 2024-09-21T12:32:30.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:30.284+0000 7f58ef7fe640 1 -- 172.21.15.3:0/2654008726 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f58f0033050 con 0x7f5900102ac0 2024-09-21T12:32:30.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:30.284+0000 7f5904e41640 1 -- 172.21.15.3:0/2654008726 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5900197f80 con 0x7f5900102ac0 2024-09-21T12:32:30.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:30.285+0000 7f5904e41640 1 -- 172.21.15.3:0/2654008726 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f590006aa90 con 0x7f5900102ac0 2024-09-21T12:32:30.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:30.285+0000 7f58ef7fe640 1 -- 172.21.15.3:0/2654008726 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f58f004a070 con 0x7f5900102ac0 2024-09-21T12:32:30.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:30.286+0000 7f58ef7fe640 1 --2- 172.21.15.3:0/2654008726 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f58e807af40 0x7f58e807d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:30.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:30.286+0000 7f58ef7fe640 1 -- 172.21.15.3:0/2654008726 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6414+0+0 (secure 0 0 0) 0x7f58f003e030 con 0x7f5900102ac0 2024-09-21T12:32:30.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:30.286+0000 7f58fdd9b640 1 --2- 172.21.15.3:0/2654008726 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f58e807af40 0x7f58e807d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:30.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:30.286+0000 7f58fdd9b640 1 --2- 172.21.15.3:0/2654008726 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f58e807af40 0x7f58e807d400 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5900108900 tx=0x7f58f4005f90 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:32:30.311 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:30.290+0000 7f58ef7fe640 1 -- 172.21.15.3:0/2654008726 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f58f008a730 con 0x7f5900102ac0 2024-09-21T12:32:30.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:32:30 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:32:30.518 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:30.517+0000 7f5904e41640 1 -- 172.21.15.3:0/2654008726 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 27, "format": "json"} v 0) -- 0x7f5900198230 con 0x7f5900102ac0 2024-09-21T12:32:30.519 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:30.518+0000 7f58ef7fe640 1 -- 172.21.15.3:0/2654008726 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 27, "format": "json"}]=0 dumped fsmap epoch 27 v35) ==== 107+0+5315 (secure 0 0 0) 0x7f58f008f5e0 con 0x7f5900102ac0 2024-09-21T12:32:30.519 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:32:30.519 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":27,"btime":"2024-09-21T12:29:58:254833+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34314,"name":"cephfs.smithi003.ebjgyl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6827/1616995236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":1616995236},{"type":"v1","addr":"172.21.15.3:6827","nonce":1616995236}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16},{"gid":34346,"name":"cephfs.smithi003.gfkngj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6829/1282732153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":1282732153},{"type":"v1","addr":"172.21.15.3:6829","nonce":1282732153}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":44321,"name":"cephfs.smithi192.ywqqxe","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6825/3113020545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3113020545},{"type":"v1","addr":"172.21.15.192:6825","nonce":3113020545}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T12:17:38.260099+0000","modified":"2024-09-21T12:29:54.973615+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24337},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24337":{"gid":24337,"name":"cephfs.smithi192.ktdqns","rank":0,"incarnation":23,"state":"up:active","state_seq":184,"addr":"172.21.15.192:6827/318800854","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":318800854},{"type":"v1","addr":"172.21.15.192:6827","nonce":318800854}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24337,"qdb_cluster":[24337]},"id":1}]} 2024-09-21T12:32:30.520 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 27 2024-09-21T12:32:30.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:30.520+0000 7f5904e41640 1 -- 172.21.15.3:0/2654008726 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f58e807af40 msgr2=0x7f58e807d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:30.521 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:30.520+0000 7f5904e41640 1 --2- 172.21.15.3:0/2654008726 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f58e807af40 0x7f58e807d400 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f5900108900 tx=0x7f58f4005f90 comp rx=0 tx=0).stop 2024-09-21T12:32:30.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:30.520+0000 7f5904e41640 1 -- 172.21.15.3:0/2654008726 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5900102ac0 msgr2=0x7f590019d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:30.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:30.520+0000 7f5904e41640 1 --2- 172.21.15.3:0/2654008726 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5900102ac0 0x7f590019d640 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f58f002af20 tx=0x7f58f002ed40 comp rx=0 tx=0).stop 2024-09-21T12:32:30.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:30.520+0000 7f5904e41640 1 -- 172.21.15.3:0/2654008726 shutdown_connections 2024-09-21T12:32:30.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:30.520+0000 7f5904e41640 1 --2- 172.21.15.3:0/2654008726 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f58e807af40 0x7f58e807d400 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:30.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:30.520+0000 7f5904e41640 1 --2- 172.21.15.3:0/2654008726 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f59001033e0 0x7f590019db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:30.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:30.520+0000 7f5904e41640 1 --2- 172.21.15.3:0/2654008726 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f5900102ac0 0x7f590019d640 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:30.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:30.520+0000 7f5904e41640 1 -- 172.21.15.3:0/2654008726 >> 172.21.15.3:0/2654008726 conn(0x7f59000fc520 msgr2=0x7f590010af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:32:30.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:30.520+0000 7f5904e41640 1 -- 172.21.15.3:0/2654008726 shutdown_connections 2024-09-21T12:32:30.522 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:30.520+0000 7f5904e41640 1 -- 172.21.15.3:0/2654008726 wait complete. 2024-09-21T12:32:31.180 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 28 2024-09-21T12:32:31.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:32:31 smithi003 ceph-mon[108723]: from='client.? 172.21.15.3:0/2654008726' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 27, "format": "json"} : dispatch 2024-09-21T12:32:31.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:32:31 smithi003 ceph-mon[108723]: pgmap v352: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:32:31.452 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:32:31.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:32:31 smithi192 ceph-mon[80326]: from='client.? 172.21.15.3:0/2654008726' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 27, "format": "json"} : dispatch 2024-09-21T12:32:31.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:32:31 smithi192 ceph-mon[80326]: pgmap v352: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:32:31.874 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:31.872+0000 7f6b15874640 1 -- 172.21.15.3:0/3960459819 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6b10101900 msgr2=0x7f6b10101d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:31.875 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:31.872+0000 7f6b15874640 1 --2- 172.21.15.3:0/3960459819 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6b10101900 0x7f6b10101d60 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f6b04009880 tx=0x7f6b0402a4a0 comp rx=0 tx=0).stop 2024-09-21T12:32:31.875 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:31.872+0000 7f6b15874640 1 -- 172.21.15.3:0/3960459819 shutdown_connections 2024-09-21T12:32:31.875 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:31.872+0000 7f6b15874640 1 --2- 172.21.15.3:0/3960459819 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6b10101900 0x7f6b10101d60 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:31.875 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:31.872+0000 7f6b15874640 1 --2- 172.21.15.3:0/3960459819 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b10107900 0x7f6b10107ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:31.875 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:31.872+0000 7f6b15874640 1 -- 172.21.15.3:0/3960459819 >> 172.21.15.3:0/3960459819 conn(0x7f6b100fd600 msgr2=0x7f6b100ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:32:31.875 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:31.872+0000 7f6b15874640 1 -- 172.21.15.3:0/3960459819 shutdown_connections 2024-09-21T12:32:31.875 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:31.872+0000 7f6b15874640 1 -- 172.21.15.3:0/3960459819 wait complete. 2024-09-21T12:32:31.875 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:31.872+0000 7f6b15874640 1 Processor -- start 2024-09-21T12:32:31.875 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:31.873+0000 7f6b15874640 1 -- start start 2024-09-21T12:32:31.875 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:31.873+0000 7f6b15874640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b10101900 0x7f6b100744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:31.875 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:31.873+0000 7f6b15874640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6b10107900 0x7f6b10074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:31.876 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:31.873+0000 7f6b15874640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f6b1010edd0 con 0x7f6b10107900 2024-09-21T12:32:31.876 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:31.873+0000 7f6b15874640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f6b1010ec50 con 0x7f6b10101900 2024-09-21T12:32:31.876 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:31.873+0000 7f6b0e7fc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6b10107900 0x7f6b10074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:31.876 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:31.873+0000 7f6b0e7fc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6b10107900 0x7f6b10074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56336/0 (socket says 172.21.15.3:56336) 2024-09-21T12:32:31.876 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:31.873+0000 7f6b0e7fc640 1 -- 172.21.15.3:0/615771025 learned_addr learned my addr 172.21.15.3:0/615771025 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:32:31.876 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:31.873+0000 7f6b0effd640 1 --2- 172.21.15.3:0/615771025 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b10101900 0x7f6b100744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:31.877 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:31.873+0000 7f6b0e7fc640 1 -- 172.21.15.3:0/615771025 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b10101900 msgr2=0x7f6b100744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:31.877 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:31.873+0000 7f6b0e7fc640 1 --2- 172.21.15.3:0/615771025 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b10101900 0x7f6b100744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:31.877 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:31.873+0000 7f6b0e7fc640 1 -- 172.21.15.3:0/615771025 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b10074f70 con 0x7f6b10107900 2024-09-21T12:32:31.877 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:31.874+0000 7f6b0e7fc640 1 --2- 172.21.15.3:0/615771025 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6b10107900 0x7f6b10074a30 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6b04031460 tx=0x7f6b040045e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:32:31.877 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:31.874+0000 7f6b14872640 1 -- 172.21.15.3:0/615771025 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6b0403f070 con 0x7f6b10107900 2024-09-21T12:32:31.877 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:31.874+0000 7f6b15874640 1 -- 172.21.15.3:0/615771025 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b10075200 con 0x7f6b10107900 2024-09-21T12:32:31.877 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:31.874+0000 7f6b14872640 1 -- 172.21.15.3:0/615771025 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f6b040035f0 con 0x7f6b10107900 2024-09-21T12:32:31.878 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:31.874+0000 7f6b14872640 1 -- 172.21.15.3:0/615771025 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f6b04035030 con 0x7f6b10107900 2024-09-21T12:32:31.878 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:31.874+0000 7f6b15874640 1 -- 172.21.15.3:0/615771025 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b101a3d60 con 0x7f6b10107900 2024-09-21T12:32:31.878 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:31.875+0000 7f6b15874640 1 -- 172.21.15.3:0/615771025 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b10103040 con 0x7f6b10107900 2024-09-21T12:32:31.878 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:31.876+0000 7f6b14872640 1 -- 172.21.15.3:0/615771025 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f6b04042070 con 0x7f6b10107900 2024-09-21T12:32:31.878 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:31.876+0000 7f6b14872640 1 --2- 172.21.15.3:0/615771025 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f6af807af30 0x7f6af807d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:31.878 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:31.876+0000 7f6b0effd640 1 --2- 172.21.15.3:0/615771025 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f6af807af30 0x7f6af807d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:31.878 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:31.876+0000 7f6b14872640 1 -- 172.21.15.3:0/615771025 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6414+0+0 (secure 0 0 0) 0x7f6b040bea10 con 0x7f6b10107900 2024-09-21T12:32:31.879 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:31.877+0000 7f6b0effd640 1 --2- 172.21.15.3:0/615771025 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f6af807af30 0x7f6af807d3f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6b00005fd0 tx=0x7f6b0000b390 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:32:31.882 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:31.881+0000 7f6b14872640 1 -- 172.21.15.3:0/615771025 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f6b04089f10 con 0x7f6b10107900 2024-09-21T12:32:32.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:32.105+0000 7f6b15874640 1 -- 172.21.15.3:0/615771025 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 28, "format": "json"} v 0) -- 0x7f6b10075a20 con 0x7f6b10107900 2024-09-21T12:32:32.107 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:32.106+0000 7f6b14872640 1 -- 172.21.15.3:0/615771025 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 28, "format": "json"}]=0 dumped fsmap epoch 28 v35) ==== 107+0+4446 (secure 0 0 0) 0x7f6b0408edc0 con 0x7f6b10107900 2024-09-21T12:32:32.108 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:32:32.108 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":28,"btime":"2024-09-21T12:30:09:931135+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34314,"name":"cephfs.smithi003.ebjgyl","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6827/1616995236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":1616995236},{"type":"v1","addr":"172.21.15.3:6827","nonce":1616995236}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":16},{"gid":34346,"name":"cephfs.smithi003.gfkngj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6829/1282732153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":1282732153},{"type":"v1","addr":"172.21.15.3:6829","nonce":1282732153}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":44321,"name":"cephfs.smithi192.ywqqxe","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6825/3113020545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3113020545},{"type":"v1","addr":"172.21.15.192:6825","nonce":3113020545}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T12:17:38.260099+0000","modified":"2024-09-21T12:30:09.931128+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T12:32:32.108 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 28 2024-09-21T12:32:32.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:32.108+0000 7f6b15874640 1 -- 172.21.15.3:0/615771025 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f6af807af30 msgr2=0x7f6af807d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:32.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:32.108+0000 7f6b15874640 1 --2- 172.21.15.3:0/615771025 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f6af807af30 0x7f6af807d3f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6b00005fd0 tx=0x7f6b0000b390 comp rx=0 tx=0).stop 2024-09-21T12:32:32.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:32.108+0000 7f6b15874640 1 -- 172.21.15.3:0/615771025 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6b10107900 msgr2=0x7f6b10074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:32.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:32.108+0000 7f6b15874640 1 --2- 172.21.15.3:0/615771025 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6b10107900 0x7f6b10074a30 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f6b04031460 tx=0x7f6b040045e0 comp rx=0 tx=0).stop 2024-09-21T12:32:32.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:32.108+0000 7f6b15874640 1 -- 172.21.15.3:0/615771025 shutdown_connections 2024-09-21T12:32:32.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:32.108+0000 7f6b15874640 1 --2- 172.21.15.3:0/615771025 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f6af807af30 0x7f6af807d3f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:32.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:32.108+0000 7f6b15874640 1 --2- 172.21.15.3:0/615771025 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f6b10107900 0x7f6b10074a30 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:32.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:32.108+0000 7f6b15874640 1 --2- 172.21.15.3:0/615771025 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f6b10101900 0x7f6b100744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:32.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:32.108+0000 7f6b15874640 1 -- 172.21.15.3:0/615771025 >> 172.21.15.3:0/615771025 conn(0x7f6b100fd600 msgr2=0x7f6b100fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:32:32.110 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:32.108+0000 7f6b15874640 1 -- 172.21.15.3:0/615771025 shutdown_connections 2024-09-21T12:32:32.111 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:32.109+0000 7f6b15874640 1 -- 172.21.15.3:0/615771025 wait complete. 2024-09-21T12:32:32.476 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:32:32 smithi003 ceph-mon[108723]: from='client.? 172.21.15.3:0/615771025' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 28, "format": "json"} : dispatch 2024-09-21T12:32:32.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:32:32 smithi192 ceph-mon[80326]: from='client.? 172.21.15.3:0/615771025' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 28, "format": "json"} : dispatch 2024-09-21T12:32:32.805 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 29 2024-09-21T12:32:33.067 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:32:33.480 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:32:33 smithi003 ceph-mon[108723]: pgmap v353: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:32:33.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:33.486+0000 7f2e85ccc640 1 -- 172.21.15.3:0/3660085357 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2e80107900 msgr2=0x7f2e80107ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:33.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:33.486+0000 7f2e85ccc640 1 --2- 172.21.15.3:0/3660085357 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2e80107900 0x7f2e80107ce0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f2e70009c20 tx=0x7f2e7002a970 comp rx=0 tx=0).stop 2024-09-21T12:32:33.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:33.486+0000 7f2e85ccc640 1 -- 172.21.15.3:0/3660085357 shutdown_connections 2024-09-21T12:32:33.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:33.486+0000 7f2e85ccc640 1 --2- 172.21.15.3:0/3660085357 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2e80101900 0x7f2e80101d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:33.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:33.486+0000 7f2e85ccc640 1 --2- 172.21.15.3:0/3660085357 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2e80107900 0x7f2e80107ce0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:33.488 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:33.486+0000 7f2e85ccc640 1 -- 172.21.15.3:0/3660085357 >> 172.21.15.3:0/3660085357 conn(0x7f2e800fd600 msgr2=0x7f2e800ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:32:33.489 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:33.486+0000 7f2e85ccc640 1 -- 172.21.15.3:0/3660085357 shutdown_connections 2024-09-21T12:32:33.489 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:33.486+0000 7f2e85ccc640 1 -- 172.21.15.3:0/3660085357 wait complete. 2024-09-21T12:32:33.489 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:33.487+0000 7f2e85ccc640 1 Processor -- start 2024-09-21T12:32:33.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:33.487+0000 7f2e85ccc640 1 -- start start 2024-09-21T12:32:33.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:33.487+0000 7f2e85ccc640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2e80101900 0x7f2e8019d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:33.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:33.487+0000 7f2e85ccc640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2e80107900 0x7f2e8019dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:33.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:33.487+0000 7f2e85ccc640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f2e8010edd0 con 0x7f2e80107900 2024-09-21T12:32:33.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:33.487+0000 7f2e85ccc640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2e8010ec50 con 0x7f2e80101900 2024-09-21T12:32:33.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:33.487+0000 7f2e7effd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2e80107900 0x7f2e8019dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:33.490 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:33.487+0000 7f2e7effd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2e80107900 0x7f2e8019dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56342/0 (socket says 172.21.15.3:56342) 2024-09-21T12:32:33.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:33.487+0000 7f2e7effd640 1 -- 172.21.15.3:0/2369164913 learned_addr learned my addr 172.21.15.3:0/2369164913 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:32:33.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:33.488+0000 7f2e7f7fe640 1 --2- 172.21.15.3:0/2369164913 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2e80101900 0x7f2e8019d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:33.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:33.488+0000 7f2e7effd640 1 -- 172.21.15.3:0/2369164913 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2e80101900 msgr2=0x7f2e8019d680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:33.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:33.488+0000 7f2e7effd640 1 --2- 172.21.15.3:0/2369164913 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2e80101900 0x7f2e8019d680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:33.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:33.488+0000 7f2e7effd640 1 -- 172.21.15.3:0/2369164913 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e80197800 con 0x7f2e80107900 2024-09-21T12:32:33.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:33.488+0000 7f2e7effd640 1 --2- 172.21.15.3:0/2369164913 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2e80107900 0x7f2e8019dbc0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2e6800e970 tx=0x7f2e6800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:32:33.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:33.488+0000 7f2e7cff9640 1 -- 172.21.15.3:0/2369164913 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2e6800cac0 con 0x7f2e80107900 2024-09-21T12:32:33.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:33.488+0000 7f2e7cff9640 1 -- 172.21.15.3:0/2369164913 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2e680054e0 con 0x7f2e80107900 2024-09-21T12:32:33.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:33.488+0000 7f2e85ccc640 1 -- 172.21.15.3:0/2369164913 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e80197af0 con 0x7f2e80107900 2024-09-21T12:32:33.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:33.488+0000 7f2e7cff9640 1 -- 172.21.15.3:0/2369164913 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2e68010430 con 0x7f2e80107900 2024-09-21T12:32:33.491 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:33.488+0000 7f2e85ccc640 1 -- 172.21.15.3:0/2369164913 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e80198080 con 0x7f2e80107900 2024-09-21T12:32:33.492 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:33.489+0000 7f2e85ccc640 1 -- 172.21.15.3:0/2369164913 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e80103040 con 0x7f2e80107900 2024-09-21T12:32:33.492 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:33.490+0000 7f2e7cff9640 1 -- 172.21.15.3:0/2369164913 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f2e68004e80 con 0x7f2e80107900 2024-09-21T12:32:33.492 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:33.491+0000 7f2e7cff9640 1 --2- 172.21.15.3:0/2369164913 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f2e6c07af30 0x7f2e6c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:33.492 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:33.491+0000 7f2e7cff9640 1 -- 172.21.15.3:0/2369164913 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6414+0+0 (secure 0 0 0) 0x7f2e6809e890 con 0x7f2e80107900 2024-09-21T12:32:33.492 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:33.491+0000 7f2e7f7fe640 1 --2- 172.21.15.3:0/2369164913 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f2e6c07af30 0x7f2e6c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:33.493 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:33.491+0000 7f2e7f7fe640 1 --2- 172.21.15.3:0/2369164913 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f2e6c07af30 0x7f2e6c07d3f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2e70005fc0 tx=0x7f2e70005f30 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:32:33.496 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:33.495+0000 7f2e7cff9640 1 -- 172.21.15.3:0/2369164913 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2e68069cf0 con 0x7f2e80107900 2024-09-21T12:32:33.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:32:33 smithi192 ceph-mon[80326]: pgmap v353: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:32:33.720 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:33.719+0000 7f2e85ccc640 1 -- 172.21.15.3:0/2369164913 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 29, "format": "json"} v 0) -- 0x7f2e80109e70 con 0x7f2e80107900 2024-09-21T12:32:33.721 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:33.720+0000 7f2e7cff9640 1 -- 172.21.15.3:0/2369164913 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 29, "format": "json"}]=0 dumped fsmap epoch 29 v35) ==== 107+0+4457 (secure 0 0 0) 0x7f2e6806eba0 con 0x7f2e80107900 2024-09-21T12:32:33.721 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:32:33.721 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":29,"btime":"2024-09-21T12:30:09:936710+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34346,"name":"cephfs.smithi003.gfkngj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6829/1282732153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":1282732153},{"type":"v1","addr":"172.21.15.3:6829","nonce":1282732153}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":44321,"name":"cephfs.smithi192.ywqqxe","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6825/3113020545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3113020545},{"type":"v1","addr":"172.21.15.192:6825","nonce":3113020545}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T12:17:38.260099+0000","modified":"2024-09-21T12:30:09.936694+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34314},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34314":{"gid":34314,"name":"cephfs.smithi003.ebjgyl","rank":0,"incarnation":29,"state":"up:replay","state_seq":1,"addr":"172.21.15.3:6827/1616995236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":1616995236},{"type":"v1","addr":"172.21.15.3:6827","nonce":1616995236}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T12:32:33.722 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 29 2024-09-21T12:32:33.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:33.722+0000 7f2e85ccc640 1 -- 172.21.15.3:0/2369164913 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f2e6c07af30 msgr2=0x7f2e6c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:33.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:33.722+0000 7f2e85ccc640 1 --2- 172.21.15.3:0/2369164913 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f2e6c07af30 0x7f2e6c07d3f0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f2e70005fc0 tx=0x7f2e70005f30 comp rx=0 tx=0).stop 2024-09-21T12:32:33.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:33.722+0000 7f2e85ccc640 1 -- 172.21.15.3:0/2369164913 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2e80107900 msgr2=0x7f2e8019dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:33.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:33.722+0000 7f2e85ccc640 1 --2- 172.21.15.3:0/2369164913 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2e80107900 0x7f2e8019dbc0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f2e6800e970 tx=0x7f2e6800ed70 comp rx=0 tx=0).stop 2024-09-21T12:32:33.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:33.722+0000 7f2e85ccc640 1 -- 172.21.15.3:0/2369164913 shutdown_connections 2024-09-21T12:32:33.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:33.722+0000 7f2e85ccc640 1 --2- 172.21.15.3:0/2369164913 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f2e6c07af30 0x7f2e6c07d3f0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:33.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:33.722+0000 7f2e85ccc640 1 --2- 172.21.15.3:0/2369164913 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2e80107900 0x7f2e8019dbc0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:33.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:33.722+0000 7f2e85ccc640 1 --2- 172.21.15.3:0/2369164913 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2e80101900 0x7f2e8019d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:33.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:33.722+0000 7f2e85ccc640 1 -- 172.21.15.3:0/2369164913 >> 172.21.15.3:0/2369164913 conn(0x7f2e800fd600 msgr2=0x7f2e800fdf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:32:33.724 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:33.722+0000 7f2e85ccc640 1 -- 172.21.15.3:0/2369164913 shutdown_connections 2024-09-21T12:32:33.725 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:33.722+0000 7f2e85ccc640 1 -- 172.21.15.3:0/2369164913 wait complete. 2024-09-21T12:32:34.366 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:32:34 smithi003 ceph-mon[108723]: from='client.? 172.21.15.3:0/2369164913' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 29, "format": "json"} : dispatch 2024-09-21T12:32:34.397 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 30 2024-09-21T12:32:34.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:32:34 smithi192 ceph-mon[80326]: from='client.? 172.21.15.3:0/2369164913' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 29, "format": "json"} : dispatch 2024-09-21T12:32:34.659 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:32:35.119 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:35.118+0000 7fb009a82640 1 -- 172.21.15.3:0/1963180254 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb0041007f0 msgr2=0x7fb004100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:35.120 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:35.118+0000 7fb009a82640 1 --2- 172.21.15.3:0/1963180254 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb0041007f0 0x7fb004100c50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fafec009880 tx=0x7fafec02a4a0 comp rx=0 tx=0).stop 2024-09-21T12:32:35.120 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:35.118+0000 7fb009a82640 1 -- 172.21.15.3:0/1963180254 shutdown_connections 2024-09-21T12:32:35.120 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:35.118+0000 7fb009a82640 1 --2- 172.21.15.3:0/1963180254 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb0041007f0 0x7fb004100c50 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:35.120 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:35.118+0000 7fb009a82640 1 --2- 172.21.15.3:0/1963180254 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0041067f0 0x7fb004106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:35.120 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:35.118+0000 7fb009a82640 1 -- 172.21.15.3:0/1963180254 >> 172.21.15.3:0/1963180254 conn(0x7fb0040fc550 msgr2=0x7fb0040fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:32:35.120 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:35.118+0000 7fb009a82640 1 -- 172.21.15.3:0/1963180254 shutdown_connections 2024-09-21T12:32:35.120 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:35.118+0000 7fb009a82640 1 -- 172.21.15.3:0/1963180254 wait complete. 2024-09-21T12:32:35.122 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:35.119+0000 7fb009a82640 1 Processor -- start 2024-09-21T12:32:35.122 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:35.119+0000 7fb009a82640 1 -- start start 2024-09-21T12:32:35.122 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:35.119+0000 7fb009a82640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0041007f0 0x7fb0041987b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:35.122 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:35.119+0000 7fb009a82640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb0041067f0 0x7fb004198cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:35.122 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:35.119+0000 7fb009a82640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fb00410dca0 con 0x7fb0041067f0 2024-09-21T12:32:35.122 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:35.119+0000 7fb009a82640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fb00410db20 con 0x7fb0041007f0 2024-09-21T12:32:35.122 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:35.119+0000 7faffaffd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb0041067f0 0x7fb004198cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:35.122 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:35.119+0000 7faffaffd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb0041067f0 0x7fb004198cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56356/0 (socket says 172.21.15.3:56356) 2024-09-21T12:32:35.123 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:35.119+0000 7faffaffd640 1 -- 172.21.15.3:0/2327402415 learned_addr learned my addr 172.21.15.3:0/2327402415 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:32:35.123 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:35.120+0000 7fb0037fe640 1 --2- 172.21.15.3:0/2327402415 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0041007f0 0x7fb0041987b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:35.123 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:35.120+0000 7faffaffd640 1 -- 172.21.15.3:0/2327402415 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0041007f0 msgr2=0x7fb0041987b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:35.123 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:35.120+0000 7faffaffd640 1 --2- 172.21.15.3:0/2327402415 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0041007f0 0x7fb0041987b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:35.123 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:35.120+0000 7faffaffd640 1 -- 172.21.15.3:0/2327402415 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb004199260 con 0x7fb0041067f0 2024-09-21T12:32:35.123 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:35.120+0000 7fb0037fe640 1 --2- 172.21.15.3:0/2327402415 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0041007f0 0x7fb0041987b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:32:35.123 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:35.120+0000 7faffaffd640 1 --2- 172.21.15.3:0/2327402415 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb0041067f0 0x7fb004198cf0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fafec031460 tx=0x7fafec0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:32:35.123 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:35.120+0000 7fb0017fa640 1 -- 172.21.15.3:0/2327402415 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fafec03f070 con 0x7fb0041067f0 2024-09-21T12:32:35.123 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:35.120+0000 7fb009a82640 1 -- 172.21.15.3:0/2327402415 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0041994f0 con 0x7fb0041067f0 2024-09-21T12:32:35.123 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:35.120+0000 7fb0017fa640 1 -- 172.21.15.3:0/2327402415 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fafec004cf0 con 0x7fb0041067f0 2024-09-21T12:32:35.123 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:35.120+0000 7fb0017fa640 1 -- 172.21.15.3:0/2327402415 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fafec035030 con 0x7fb0041067f0 2024-09-21T12:32:35.123 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:35.120+0000 7fb009a82640 1 -- 172.21.15.3:0/2327402415 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0041a1aa0 con 0x7fb0041067f0 2024-09-21T12:32:35.124 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:35.121+0000 7fb009a82640 1 -- 172.21.15.3:0/2327402415 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb004101f30 con 0x7fb0041067f0 2024-09-21T12:32:35.124 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:35.122+0000 7fb0017fa640 1 -- 172.21.15.3:0/2327402415 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7fafec042070 con 0x7fb0041067f0 2024-09-21T12:32:35.124 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:35.123+0000 7fb0017fa640 1 --2- 172.21.15.3:0/2327402415 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7faff007af30 0x7faff007d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:35.124 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:35.123+0000 7fb0017fa640 1 -- 172.21.15.3:0/2327402415 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6414+0+0 (secure 0 0 0) 0x7fafec0bebc0 con 0x7fb0041067f0 2024-09-21T12:32:35.124 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:35.123+0000 7fb0037fe640 1 --2- 172.21.15.3:0/2327402415 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7faff007af30 0x7faff007d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:35.125 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:35.123+0000 7fb0037fe640 1 --2- 172.21.15.3:0/2327402415 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7faff007af30 0x7faff007d3f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7faff400abe0 tx=0x7faff400a5c0 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:32:35.128 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:35.127+0000 7fb0017fa640 1 -- 172.21.15.3:0/2327402415 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fafec08a0c0 con 0x7fb0041067f0 2024-09-21T12:32:35.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:32:35 smithi003 ceph-mon[108723]: pgmap v354: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:32:35.357 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:35.356+0000 7fb009a82640 1 -- 172.21.15.3:0/2327402415 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 30, "format": "json"} v 0) -- 0x7fb0041a1d50 con 0x7fb0041067f0 2024-09-21T12:32:35.358 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:35.356+0000 7fb0017fa640 1 -- 172.21.15.3:0/2327402415 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 30, "format": "json"}]=0 dumped fsmap epoch 30 v35) ==== 107+0+4461 (secure 0 0 0) 0x7fafec08ef70 con 0x7fb0041067f0 2024-09-21T12:32:35.358 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:32:35.358 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":30,"btime":"2024-09-21T12:30:18:963439+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34346,"name":"cephfs.smithi003.gfkngj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6829/1282732153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":1282732153},{"type":"v1","addr":"172.21.15.3:6829","nonce":1282732153}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":44321,"name":"cephfs.smithi192.ywqqxe","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6825/3113020545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3113020545},{"type":"v1","addr":"172.21.15.192:6825","nonce":3113020545}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T12:17:38.260099+0000","modified":"2024-09-21T12:30:18.503570+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34314},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34314":{"gid":34314,"name":"cephfs.smithi003.ebjgyl","rank":0,"incarnation":29,"state":"up:reconnect","state_seq":19,"addr":"172.21.15.3:6827/1616995236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":1616995236},{"type":"v1","addr":"172.21.15.3:6827","nonce":1616995236}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T12:32:35.358 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 30 2024-09-21T12:32:35.360 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:35.359+0000 7fb009a82640 1 -- 172.21.15.3:0/2327402415 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7faff007af30 msgr2=0x7faff007d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:35.360 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:35.359+0000 7fb009a82640 1 --2- 172.21.15.3:0/2327402415 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7faff007af30 0x7faff007d3f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7faff400abe0 tx=0x7faff400a5c0 comp rx=0 tx=0).stop 2024-09-21T12:32:35.360 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:35.359+0000 7fb009a82640 1 -- 172.21.15.3:0/2327402415 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb0041067f0 msgr2=0x7fb004198cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:35.361 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:35.359+0000 7fb009a82640 1 --2- 172.21.15.3:0/2327402415 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb0041067f0 0x7fb004198cf0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fafec031460 tx=0x7fafec0048f0 comp rx=0 tx=0).stop 2024-09-21T12:32:35.361 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:35.359+0000 7fb009a82640 1 -- 172.21.15.3:0/2327402415 shutdown_connections 2024-09-21T12:32:35.361 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:35.359+0000 7fb009a82640 1 --2- 172.21.15.3:0/2327402415 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7faff007af30 0x7faff007d3f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:35.361 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:35.359+0000 7fb009a82640 1 --2- 172.21.15.3:0/2327402415 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fb0041067f0 0x7fb004198cf0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:35.361 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:35.359+0000 7fb009a82640 1 --2- 172.21.15.3:0/2327402415 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fb0041007f0 0x7fb0041987b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:35.361 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:35.359+0000 7fb009a82640 1 -- 172.21.15.3:0/2327402415 >> 172.21.15.3:0/2327402415 conn(0x7fb0040fc550 msgr2=0x7fb0040fcd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:32:35.361 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:35.359+0000 7fb009a82640 1 -- 172.21.15.3:0/2327402415 shutdown_connections 2024-09-21T12:32:35.361 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:35.359+0000 7fb009a82640 1 -- 172.21.15.3:0/2327402415 wait complete. 2024-09-21T12:32:35.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:32:35 smithi192 ceph-mon[80326]: pgmap v354: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:32:36.005 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 31 2024-09-21T12:32:36.269 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:32:36.478 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:32:36 smithi003 ceph-mon[108723]: from='client.? 172.21.15.3:0/2327402415' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 30, "format": "json"} : dispatch 2024-09-21T12:32:36.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:32:36 smithi192 ceph-mon[80326]: from='client.? 172.21.15.3:0/2327402415' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 30, "format": "json"} : dispatch 2024-09-21T12:32:36.745 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:36.743+0000 7fd2e4ce6640 1 -- 172.21.15.3:0/3951305108 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd2e01033e0 msgr2=0x7fd2e010b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:36.745 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:36.743+0000 7fd2e4ce6640 1 --2- 172.21.15.3:0/3951305108 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd2e01033e0 0x7fd2e010b8d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fd2c8009880 tx=0x7fd2c802a530 comp rx=0 tx=0).stop 2024-09-21T12:32:36.745 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:36.743+0000 7fd2e4ce6640 1 -- 172.21.15.3:0/3951305108 shutdown_connections 2024-09-21T12:32:36.745 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:36.743+0000 7fd2e4ce6640 1 --2- 172.21.15.3:0/3951305108 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd2e01033e0 0x7fd2e010b8d0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:36.745 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:36.743+0000 7fd2e4ce6640 1 --2- 172.21.15.3:0/3951305108 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd2e0102ac0 0x7fd2e0102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:36.745 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:36.743+0000 7fd2e4ce6640 1 -- 172.21.15.3:0/3951305108 >> 172.21.15.3:0/3951305108 conn(0x7fd2e00fc520 msgr2=0x7fd2e00fe940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:32:36.745 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:36.743+0000 7fd2e4ce6640 1 -- 172.21.15.3:0/3951305108 shutdown_connections 2024-09-21T12:32:36.745 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:36.743+0000 7fd2e4ce6640 1 -- 172.21.15.3:0/3951305108 wait complete. 2024-09-21T12:32:36.747 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:36.744+0000 7fd2e4ce6640 1 Processor -- start 2024-09-21T12:32:36.747 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:36.744+0000 7fd2e4ce6640 1 -- start start 2024-09-21T12:32:36.747 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:36.744+0000 7fd2e4ce6640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd2e0102ac0 0x7fd2e0100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:36.747 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:36.744+0000 7fd2e4ce6640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd2e01033e0 0x7fd2e0100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:36.747 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:36.744+0000 7fd2e4ce6640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e010edf0 con 0x7fd2e01033e0 2024-09-21T12:32:36.747 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:36.744+0000 7fd2e4ce6640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e010ec70 con 0x7fd2e0102ac0 2024-09-21T12:32:36.747 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:36.745+0000 7fd2ddd9b640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd2e01033e0 0x7fd2e0100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:36.748 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:36.745+0000 7fd2ddd9b640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd2e01033e0 0x7fd2e0100c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56368/0 (socket says 172.21.15.3:56368) 2024-09-21T12:32:36.748 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:36.745+0000 7fd2ddd9b640 1 -- 172.21.15.3:0/2429953799 learned_addr learned my addr 172.21.15.3:0/2429953799 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:32:36.748 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:36.745+0000 7fd2de59c640 1 --2- 172.21.15.3:0/2429953799 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd2e0102ac0 0x7fd2e0100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:36.748 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:36.745+0000 7fd2ddd9b640 1 -- 172.21.15.3:0/2429953799 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd2e0102ac0 msgr2=0x7fd2e0100720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:36.748 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:36.745+0000 7fd2ddd9b640 1 --2- 172.21.15.3:0/2429953799 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd2e0102ac0 0x7fd2e0100720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:36.748 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:36.745+0000 7fd2ddd9b640 1 -- 172.21.15.3:0/2429953799 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2e01011a0 con 0x7fd2e01033e0 2024-09-21T12:32:36.748 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:36.745+0000 7fd2ddd9b640 1 --2- 172.21.15.3:0/2429953799 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd2e01033e0 0x7fd2e0100c60 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd2c8031460 tx=0x7fd2c8004530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:32:36.748 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:36.745+0000 7fd2d77fe640 1 -- 172.21.15.3:0/2429953799 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd2c803f070 con 0x7fd2e01033e0 2024-09-21T12:32:36.748 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:36.745+0000 7fd2d77fe640 1 -- 172.21.15.3:0/2429953799 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fd2c80035f0 con 0x7fd2e01033e0 2024-09-21T12:32:36.748 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:36.745+0000 7fd2e4ce6640 1 -- 172.21.15.3:0/2429953799 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2e0101430 con 0x7fd2e01033e0 2024-09-21T12:32:36.748 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:36.745+0000 7fd2d77fe640 1 -- 172.21.15.3:0/2429953799 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fd2c8035030 con 0x7fd2e01033e0 2024-09-21T12:32:36.748 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:36.745+0000 7fd2e4ce6640 1 -- 172.21.15.3:0/2429953799 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2e01a3de0 con 0x7fd2e01033e0 2024-09-21T12:32:36.749 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:36.746+0000 7fd2e4ce6640 1 -- 172.21.15.3:0/2429953799 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2e006aa90 con 0x7fd2e01033e0 2024-09-21T12:32:36.749 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:36.747+0000 7fd2d77fe640 1 -- 172.21.15.3:0/2429953799 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7fd2c8042070 con 0x7fd2e01033e0 2024-09-21T12:32:36.749 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:36.748+0000 7fd2d77fe640 1 --2- 172.21.15.3:0/2429953799 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fd2cc07af30 0x7fd2cc07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:36.749 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:36.748+0000 7fd2d77fe640 1 -- 172.21.15.3:0/2429953799 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6414+0+0 (secure 0 0 0) 0x7fd2c80bea00 con 0x7fd2e01033e0 2024-09-21T12:32:36.749 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:36.748+0000 7fd2de59c640 1 --2- 172.21.15.3:0/2429953799 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fd2cc07af30 0x7fd2cc07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:36.750 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:36.748+0000 7fd2de59c640 1 --2- 172.21.15.3:0/2429953799 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fd2cc07af30 0x7fd2cc07d3f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd2d0005fd0 tx=0x7fd2d000b390 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:32:36.753 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:36.752+0000 7fd2d77fe640 1 -- 172.21.15.3:0/2429953799 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fd2c8089f00 con 0x7fd2e01033e0 2024-09-21T12:32:36.983 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:36.982+0000 7fd2e4ce6640 1 -- 172.21.15.3:0/2429953799 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 31, "format": "json"} v 0) -- 0x7fd2e0105f60 con 0x7fd2e01033e0 2024-09-21T12:32:36.984 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:36.982+0000 7fd2d77fe640 1 -- 172.21.15.3:0/2429953799 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 31, "format": "json"}]=0 dumped fsmap epoch 31 v35) ==== 107+0+4458 (secure 0 0 0) 0x7fd2c808edb0 con 0x7fd2e01033e0 2024-09-21T12:32:36.984 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:32:36.984 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":31,"btime":"2024-09-21T12:30:19:968305+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34346,"name":"cephfs.smithi003.gfkngj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6829/1282732153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":1282732153},{"type":"v1","addr":"172.21.15.3:6829","nonce":1282732153}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":44321,"name":"cephfs.smithi192.ywqqxe","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6825/3113020545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3113020545},{"type":"v1","addr":"172.21.15.192:6825","nonce":3113020545}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T12:17:38.260099+0000","modified":"2024-09-21T12:30:18.971081+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34314},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34314":{"gid":34314,"name":"cephfs.smithi003.ebjgyl","rank":0,"incarnation":29,"state":"up:rejoin","state_seq":20,"addr":"172.21.15.3:6827/1616995236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":1616995236},{"type":"v1","addr":"172.21.15.3:6827","nonce":1616995236}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-21T12:32:36.984 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 31 2024-09-21T12:32:36.986 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:36.985+0000 7fd2e4ce6640 1 -- 172.21.15.3:0/2429953799 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fd2cc07af30 msgr2=0x7fd2cc07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:36.986 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:36.985+0000 7fd2e4ce6640 1 --2- 172.21.15.3:0/2429953799 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fd2cc07af30 0x7fd2cc07d3f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd2d0005fd0 tx=0x7fd2d000b390 comp rx=0 tx=0).stop 2024-09-21T12:32:36.987 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:36.985+0000 7fd2e4ce6640 1 -- 172.21.15.3:0/2429953799 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd2e01033e0 msgr2=0x7fd2e0100c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:36.987 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:36.985+0000 7fd2e4ce6640 1 --2- 172.21.15.3:0/2429953799 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd2e01033e0 0x7fd2e0100c60 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd2c8031460 tx=0x7fd2c8004530 comp rx=0 tx=0).stop 2024-09-21T12:32:36.987 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:36.985+0000 7fd2e4ce6640 1 -- 172.21.15.3:0/2429953799 shutdown_connections 2024-09-21T12:32:36.987 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:36.985+0000 7fd2e4ce6640 1 --2- 172.21.15.3:0/2429953799 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fd2cc07af30 0x7fd2cc07d3f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:36.987 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:36.985+0000 7fd2e4ce6640 1 --2- 172.21.15.3:0/2429953799 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fd2e01033e0 0x7fd2e0100c60 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:36.987 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:36.985+0000 7fd2e4ce6640 1 --2- 172.21.15.3:0/2429953799 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fd2e0102ac0 0x7fd2e0100720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:36.987 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:36.985+0000 7fd2e4ce6640 1 -- 172.21.15.3:0/2429953799 >> 172.21.15.3:0/2429953799 conn(0x7fd2e00fc520 msgr2=0x7fd2e0108f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:32:36.987 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:36.985+0000 7fd2e4ce6640 1 -- 172.21.15.3:0/2429953799 shutdown_connections 2024-09-21T12:32:36.987 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:36.985+0000 7fd2e4ce6640 1 -- 172.21.15.3:0/2429953799 wait complete. 2024-09-21T12:32:37.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:32:37 smithi003 ceph-mon[108723]: pgmap v355: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:32:37.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:32:37 smithi003 ceph-mon[108723]: from='client.? 172.21.15.3:0/2429953799' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 31, "format": "json"} : dispatch 2024-09-21T12:32:37.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:32:37 smithi192 ceph-mon[80326]: pgmap v355: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:32:37.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:32:37 smithi192 ceph-mon[80326]: from='client.? 172.21.15.3:0/2429953799' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 31, "format": "json"} : dispatch 2024-09-21T12:32:37.703 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 32 2024-09-21T12:32:37.963 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:32:38.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:38.442+0000 7fea7f041640 1 -- 172.21.15.3:0/3894057768 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fea781000e0 msgr2=0x7fea781004c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:38.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:38.442+0000 7fea7f041640 1 --2- 172.21.15.3:0/3894057768 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fea781000e0 0x7fea781004c0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fea68009c20 tx=0x7fea6802a970 comp rx=0 tx=0).stop 2024-09-21T12:32:38.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:38.442+0000 7fea7f041640 1 -- 172.21.15.3:0/3894057768 shutdown_connections 2024-09-21T12:32:38.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:38.442+0000 7fea7f041640 1 --2- 172.21.15.3:0/3894057768 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fea78100a90 0x7fea781065d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:38.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:38.442+0000 7fea7f041640 1 --2- 172.21.15.3:0/3894057768 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fea781000e0 0x7fea781004c0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:38.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:38.442+0000 7fea7f041640 1 -- 172.21.15.3:0/3894057768 >> 172.21.15.3:0/3894057768 conn(0x7fea780fbc90 msgr2=0x7fea780fe0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:32:38.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:38.442+0000 7fea7f041640 1 -- 172.21.15.3:0/3894057768 shutdown_connections 2024-09-21T12:32:38.444 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:38.442+0000 7fea7f041640 1 -- 172.21.15.3:0/3894057768 wait complete. 2024-09-21T12:32:38.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:38.443+0000 7fea7f041640 1 Processor -- start 2024-09-21T12:32:38.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:38.443+0000 7fea7f041640 1 -- start start 2024-09-21T12:32:38.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:38.443+0000 7fea7f041640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fea781000e0 0x7fea7819d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:38.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:38.443+0000 7fea7f041640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fea78100a90 0x7fea7819dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:38.446 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:38.443+0000 7fea7f041640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7fea7810ee30 con 0x7fea781000e0 2024-09-21T12:32:38.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:38.443+0000 7fea7f041640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7fea7810ecb0 con 0x7fea78100a90 2024-09-21T12:32:38.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:38.443+0000 7fea7cddd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fea781000e0 0x7fea7819d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:38.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:38.443+0000 7fea7cddd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fea781000e0 0x7fea7819d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56384/0 (socket says 172.21.15.3:56384) 2024-09-21T12:32:38.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:38.443+0000 7fea7cddd640 1 -- 172.21.15.3:0/2986869242 learned_addr learned my addr 172.21.15.3:0/2986869242 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:32:38.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:38.444+0000 7fea77fff640 1 --2- 172.21.15.3:0/2986869242 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fea78100a90 0x7fea7819dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:38.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:38.444+0000 7fea7cddd640 1 -- 172.21.15.3:0/2986869242 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fea78100a90 msgr2=0x7fea7819dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:38.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:38.444+0000 7fea7cddd640 1 --2- 172.21.15.3:0/2986869242 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fea78100a90 0x7fea7819dcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:38.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:38.444+0000 7fea7cddd640 1 -- 172.21.15.3:0/2986869242 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea7819e370 con 0x7fea781000e0 2024-09-21T12:32:38.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:38.444+0000 7fea77fff640 1 --2- 172.21.15.3:0/2986869242 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fea78100a90 0x7fea7819dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:32:38.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:38.444+0000 7fea7cddd640 1 --2- 172.21.15.3:0/2986869242 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fea781000e0 0x7fea7819d780 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fea68005cc0 tx=0x7fea6802f5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:32:38.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:38.444+0000 7fea75ffb640 1 -- 172.21.15.3:0/2986869242 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fea68047070 con 0x7fea781000e0 2024-09-21T12:32:38.447 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:38.444+0000 7fea75ffb640 1 -- 172.21.15.3:0/2986869242 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7fea6802f7e0 con 0x7fea781000e0 2024-09-21T12:32:38.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:38.444+0000 7fea7f041640 1 -- 172.21.15.3:0/2986869242 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea78197a00 con 0x7fea781000e0 2024-09-21T12:32:38.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:38.444+0000 7fea75ffb640 1 -- 172.21.15.3:0/2986869242 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7fea68034070 con 0x7fea781000e0 2024-09-21T12:32:38.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:38.444+0000 7fea7f041640 1 -- 172.21.15.3:0/2986869242 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea78197f00 con 0x7fea781000e0 2024-09-21T12:32:38.448 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:38.445+0000 7fea7f041640 1 -- 172.21.15.3:0/2986869242 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea781031a0 con 0x7fea781000e0 2024-09-21T12:32:38.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:38.446+0000 7fea75ffb640 1 -- 172.21.15.3:0/2986869242 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7fea6804a070 con 0x7fea781000e0 2024-09-21T12:32:38.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:38.447+0000 7fea75ffb640 1 --2- 172.21.15.3:0/2986869242 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fea6407af80 0x7fea6407d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:38.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:38.447+0000 7fea77fff640 1 --2- 172.21.15.3:0/2986869242 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fea6407af80 0x7fea6407d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:38.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:38.447+0000 7fea75ffb640 1 -- 172.21.15.3:0/2986869242 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6414+0+0 (secure 0 0 0) 0x7fea680bef60 con 0x7fea781000e0 2024-09-21T12:32:38.449 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:38.447+0000 7fea77fff640 1 --2- 172.21.15.3:0/2986869242 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fea6407af80 0x7fea6407d440 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fea780fe280 tx=0x7fea6000a5c0 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:32:38.452 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:38.451+0000 7fea75ffb640 1 -- 172.21.15.3:0/2986869242 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7fea6803f070 con 0x7fea781000e0 2024-09-21T12:32:38.677 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:38.676+0000 7fea7f041640 1 -- 172.21.15.3:0/2986869242 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 32, "format": "json"} v 0) -- 0x7fea781004c0 con 0x7fea781000e0 2024-09-21T12:32:38.678 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:38.676+0000 7fea75ffb640 1 -- 172.21.15.3:0/2986869242 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 32, "format": "json"}]=0 dumped fsmap epoch 32 v35) ==== 107+0+4467 (secure 0 0 0) 0x7fea6808a4e0 con 0x7fea781000e0 2024-09-21T12:32:38.678 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:32:38.678 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":32,"btime":"2024-09-21T12:30:20:973861+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34346,"name":"cephfs.smithi003.gfkngj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6829/1282732153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":1282732153},{"type":"v1","addr":"172.21.15.3:6829","nonce":1282732153}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":44321,"name":"cephfs.smithi192.ywqqxe","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6825/3113020545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3113020545},{"type":"v1","addr":"172.21.15.192:6825","nonce":3113020545}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T12:17:38.260099+0000","modified":"2024-09-21T12:30:20.973857+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34314},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34314":{"gid":34314,"name":"cephfs.smithi003.ebjgyl","rank":0,"incarnation":29,"state":"up:active","state_seq":21,"addr":"172.21.15.3:6827/1616995236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":1616995236},{"type":"v1","addr":"172.21.15.3:6827","nonce":1616995236}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34314,"qdb_cluster":[34314]},"id":1}]} 2024-09-21T12:32:38.678 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 32 2024-09-21T12:32:38.681 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:38.679+0000 7fea7f041640 1 -- 172.21.15.3:0/2986869242 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fea6407af80 msgr2=0x7fea6407d440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:38.681 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:38.679+0000 7fea7f041640 1 --2- 172.21.15.3:0/2986869242 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fea6407af80 0x7fea6407d440 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fea780fe280 tx=0x7fea6000a5c0 comp rx=0 tx=0).stop 2024-09-21T12:32:38.681 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:38.679+0000 7fea7f041640 1 -- 172.21.15.3:0/2986869242 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fea781000e0 msgr2=0x7fea7819d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:38.681 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:38.679+0000 7fea7f041640 1 --2- 172.21.15.3:0/2986869242 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fea781000e0 0x7fea7819d780 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fea68005cc0 tx=0x7fea6802f5f0 comp rx=0 tx=0).stop 2024-09-21T12:32:38.681 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:38.679+0000 7fea7f041640 1 -- 172.21.15.3:0/2986869242 shutdown_connections 2024-09-21T12:32:38.681 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:38.679+0000 7fea7f041640 1 --2- 172.21.15.3:0/2986869242 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7fea6407af80 0x7fea6407d440 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:38.681 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:38.679+0000 7fea7f041640 1 --2- 172.21.15.3:0/2986869242 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7fea78100a90 0x7fea7819dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:38.681 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:38.679+0000 7fea7f041640 1 --2- 172.21.15.3:0/2986869242 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7fea781000e0 0x7fea7819d780 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:38.681 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:38.679+0000 7fea7f041640 1 -- 172.21.15.3:0/2986869242 >> 172.21.15.3:0/2986869242 conn(0x7fea780fbc90 msgr2=0x7fea780fd0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:32:38.681 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:38.679+0000 7fea7f041640 1 -- 172.21.15.3:0/2986869242 shutdown_connections 2024-09-21T12:32:38.681 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:38.679+0000 7fea7f041640 1 -- 172.21.15.3:0/2986869242 wait complete. 2024-09-21T12:32:38.972 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:32:38 smithi003 ceph-mon[108723]: from='client.? 172.21.15.3:0/2986869242' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 32, "format": "json"} : dispatch 2024-09-21T12:32:39.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:32:38 smithi192 ceph-mon[80326]: from='client.? 172.21.15.3:0/2986869242' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 32, "format": "json"} : dispatch 2024-09-21T12:32:39.294 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 33 2024-09-21T12:32:39.554 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:32:39.929 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:32:39 smithi003 ceph-mon[108723]: pgmap v356: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:32:40.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:32:39 smithi192 ceph-mon[80326]: pgmap v356: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:32:40.025 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:40.007+0000 7f3348e9d640 1 -- 172.21.15.3:0/2408255853 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3344103430 msgr2=0x7f334410b920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:40.025 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:40.007+0000 7f3348e9d640 1 --2- 172.21.15.3:0/2408255853 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3344103430 0x7f334410b920 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f33380098b0 tx=0x7f333802a560 comp rx=0 tx=0).stop 2024-09-21T12:32:40.025 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:40.007+0000 7f3348e9d640 1 -- 172.21.15.3:0/2408255853 shutdown_connections 2024-09-21T12:32:40.025 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:40.007+0000 7f3348e9d640 1 --2- 172.21.15.3:0/2408255853 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3344103430 0x7f334410b920 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:40.026 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:40.007+0000 7f3348e9d640 1 --2- 172.21.15.3:0/2408255853 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3344102b10 0x7f3344102ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:40.026 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:40.007+0000 7f3348e9d640 1 -- 172.21.15.3:0/2408255853 >> 172.21.15.3:0/2408255853 conn(0x7f33440fc550 msgr2=0x7f33440fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:32:40.026 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:40.007+0000 7f3348e9d640 1 -- 172.21.15.3:0/2408255853 shutdown_connections 2024-09-21T12:32:40.026 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:40.007+0000 7f3348e9d640 1 -- 172.21.15.3:0/2408255853 wait complete. 2024-09-21T12:32:40.026 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:40.008+0000 7f3348e9d640 1 Processor -- start 2024-09-21T12:32:40.026 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:40.008+0000 7f3348e9d640 1 -- start start 2024-09-21T12:32:40.026 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:40.008+0000 7f3348e9d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3344102b10 0x7f334419d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:40.026 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:40.008+0000 7f3348e9d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3344103430 0x7f334419dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:40.026 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:40.008+0000 7f3348e9d640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f334410edc0 con 0x7f3344103430 2024-09-21T12:32:40.026 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:40.008+0000 7f3348e9d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f334410ec40 con 0x7f3344102b10 2024-09-21T12:32:40.026 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:40.008+0000 7f3341d9b640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3344103430 0x7f334419dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:40.026 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:40.008+0000 7f3341d9b640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3344103430 0x7f334419dbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:56404/0 (socket says 172.21.15.3:56404) 2024-09-21T12:32:40.026 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:40.008+0000 7f3341d9b640 1 -- 172.21.15.3:0/2626219895 learned_addr learned my addr 172.21.15.3:0/2626219895 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:32:40.027 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:40.008+0000 7f334259c640 1 --2- 172.21.15.3:0/2626219895 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3344102b10 0x7f334419d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:40.027 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:40.009+0000 7f3341d9b640 1 -- 172.21.15.3:0/2626219895 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3344102b10 msgr2=0x7f334419d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:40.027 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:40.009+0000 7f3341d9b640 1 --2- 172.21.15.3:0/2626219895 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3344102b10 0x7f334419d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:40.027 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:40.009+0000 7f3341d9b640 1 -- 172.21.15.3:0/2626219895 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33441977f0 con 0x7f3344103430 2024-09-21T12:32:40.027 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:40.009+0000 7f334259c640 1 --2- 172.21.15.3:0/2626219895 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3344102b10 0x7f334419d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:32:40.027 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:40.009+0000 7f3341d9b640 1 --2- 172.21.15.3:0/2626219895 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3344103430 0x7f334419dbb0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3338031460 tx=0x7f33380045c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:32:40.027 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:40.009+0000 7f33337fe640 1 -- 172.21.15.3:0/2626219895 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f333803f070 con 0x7f3344103430 2024-09-21T12:32:40.027 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:40.009+0000 7f33337fe640 1 -- 172.21.15.3:0/2626219895 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f33380035f0 con 0x7f3344103430 2024-09-21T12:32:40.027 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:40.009+0000 7f33337fe640 1 -- 172.21.15.3:0/2626219895 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f3338035030 con 0x7f3344103430 2024-09-21T12:32:40.027 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:40.009+0000 7f3348e9d640 1 -- 172.21.15.3:0/2626219895 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3344197a80 con 0x7f3344103430 2024-09-21T12:32:40.027 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:40.009+0000 7f3348e9d640 1 -- 172.21.15.3:0/2626219895 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3344197fb0 con 0x7f3344103430 2024-09-21T12:32:40.027 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:40.010+0000 7f3348e9d640 1 -- 172.21.15.3:0/2626219895 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f334406a520 con 0x7f3344103430 2024-09-21T12:32:40.027 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:40.011+0000 7f33337fe640 1 -- 172.21.15.3:0/2626219895 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f3338042070 con 0x7f3344103430 2024-09-21T12:32:40.028 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:40.011+0000 7f33337fe640 1 --2- 172.21.15.3:0/2626219895 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f332c07af30 0x7f332c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:40.028 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:40.011+0000 7f33337fe640 1 -- 172.21.15.3:0/2626219895 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6414+0+0 (secure 0 0 0) 0x7f33380beab0 con 0x7f3344103430 2024-09-21T12:32:40.028 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:40.011+0000 7f334259c640 1 --2- 172.21.15.3:0/2626219895 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f332c07af30 0x7f332c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:40.028 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:40.012+0000 7f334259c640 1 --2- 172.21.15.3:0/2626219895 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f332c07af30 0x7f332c07d3f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f33340058c0 tx=0x7f3334005850 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:32:40.028 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:40.016+0000 7f33337fe640 1 -- 172.21.15.3:0/2626219895 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f3338089fb0 con 0x7f3344103430 2024-09-21T12:32:40.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:40.242+0000 7f3348e9d640 1 -- 172.21.15.3:0/2626219895 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 33, "format": "json"} v 0) -- 0x7f3344105fa0 con 0x7f3344103430 2024-09-21T12:32:40.244 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:40.243+0000 7f33337fe640 1 -- 172.21.15.3:0/2626219895 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 33, "format": "json"}]=0 dumped fsmap epoch 33 v35) ==== 107+0+5317 (secure 0 0 0) 0x7f333808ee60 con 0x7f3344103430 2024-09-21T12:32:40.245 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:32:40.245 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":33,"btime":"2024-09-21T12:30:21:978257+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34346,"name":"cephfs.smithi003.gfkngj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6829/1282732153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":1282732153},{"type":"v1","addr":"172.21.15.3:6829","nonce":1282732153}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":44321,"name":"cephfs.smithi192.ywqqxe","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6825/3113020545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3113020545},{"type":"v1","addr":"172.21.15.192:6825","nonce":3113020545}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":44349,"name":"cephfs.smithi192.ktdqns","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6827/3169061902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":3169061902},{"type":"v1","addr":"172.21.15.192:6827","nonce":3169061902}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T12:17:38.260099+0000","modified":"2024-09-21T12:30:20.973857+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34314},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34314":{"gid":34314,"name":"cephfs.smithi003.ebjgyl","rank":0,"incarnation":29,"state":"up:active","state_seq":21,"addr":"172.21.15.3:6827/1616995236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":1616995236},{"type":"v1","addr":"172.21.15.3:6827","nonce":1616995236}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34314,"qdb_cluster":[34314]},"id":1}]} 2024-09-21T12:32:40.245 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 33 2024-09-21T12:32:40.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:40.245+0000 7f3348e9d640 1 -- 172.21.15.3:0/2626219895 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f332c07af30 msgr2=0x7f332c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:40.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:40.245+0000 7f3348e9d640 1 --2- 172.21.15.3:0/2626219895 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f332c07af30 0x7f332c07d3f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f33340058c0 tx=0x7f3334005850 comp rx=0 tx=0).stop 2024-09-21T12:32:40.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:40.245+0000 7f3348e9d640 1 -- 172.21.15.3:0/2626219895 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3344103430 msgr2=0x7f334419dbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:40.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:40.245+0000 7f3348e9d640 1 --2- 172.21.15.3:0/2626219895 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3344103430 0x7f334419dbb0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3338031460 tx=0x7f33380045c0 comp rx=0 tx=0).stop 2024-09-21T12:32:40.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:40.245+0000 7f3348e9d640 1 -- 172.21.15.3:0/2626219895 shutdown_connections 2024-09-21T12:32:40.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:40.245+0000 7f3348e9d640 1 --2- 172.21.15.3:0/2626219895 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f332c07af30 0x7f332c07d3f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:40.247 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:40.245+0000 7f3348e9d640 1 --2- 172.21.15.3:0/2626219895 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f3344103430 0x7f334419dbb0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:40.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:40.245+0000 7f3348e9d640 1 --2- 172.21.15.3:0/2626219895 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f3344102b10 0x7f334419d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:40.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:40.245+0000 7f3348e9d640 1 -- 172.21.15.3:0/2626219895 >> 172.21.15.3:0/2626219895 conn(0x7f33440fc550 msgr2=0x7f3344103d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:32:40.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:40.246+0000 7f3348e9d640 1 -- 172.21.15.3:0/2626219895 shutdown_connections 2024-09-21T12:32:40.248 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:40.246+0000 7f3348e9d640 1 -- 172.21.15.3:0/2626219895 wait complete. 2024-09-21T12:32:40.860 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph fs dump --format=json 34 2024-09-21T12:32:41.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:32:40 smithi192 ceph-mon[80326]: from='client.? 172.21.15.3:0/2626219895' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 33, "format": "json"} : dispatch 2024-09-21T12:32:41.047 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:32:40 smithi003 ceph-mon[108723]: from='client.? 172.21.15.3:0/2626219895' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 33, "format": "json"} : dispatch 2024-09-21T12:32:41.122 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:32:41.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:41.594+0000 7f2fe93f9640 1 -- 172.21.15.3:0/767193936 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2fe41007f0 msgr2=0x7f2fe4100c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:41.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:41.594+0000 7f2fe93f9640 1 --2- 172.21.15.3:0/767193936 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2fe41007f0 0x7f2fe4100c50 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f2fd8009880 tx=0x7f2fd802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:32:41.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:41.594+0000 7f2fe93f9640 1 -- 172.21.15.3:0/767193936 shutdown_connections 2024-09-21T12:32:41.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:41.594+0000 7f2fe93f9640 1 --2- 172.21.15.3:0/767193936 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2fe41007f0 0x7f2fe4100c50 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:41.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:41.594+0000 7f2fe93f9640 1 --2- 172.21.15.3:0/767193936 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2fe41067f0 0x7f2fe4106bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:41.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:41.594+0000 7f2fe93f9640 1 -- 172.21.15.3:0/767193936 >> 172.21.15.3:0/767193936 conn(0x7f2fe40fc550 msgr2=0x7f2fe40fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:32:41.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:41.595+0000 7f2fe93f9640 1 -- 172.21.15.3:0/767193936 shutdown_connections 2024-09-21T12:32:41.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:41.595+0000 7f2fe93f9640 1 -- 172.21.15.3:0/767193936 wait complete. 2024-09-21T12:32:41.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:41.595+0000 7f2fe93f9640 1 Processor -- start 2024-09-21T12:32:41.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:41.595+0000 7f2fe93f9640 1 -- start start 2024-09-21T12:32:41.608 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:41.596+0000 7f2fe93f9640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2fe41007f0 0x7f2fe41987b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:41.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:41.596+0000 7f2fe93f9640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2fe41067f0 0x7f2fe4198cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:41.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:41.596+0000 7f2fe93f9640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe410dcc0 con 0x7f2fe41007f0 2024-09-21T12:32:41.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:41.596+0000 7f2fe93f9640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f2fe410db40 con 0x7f2fe41067f0 2024-09-21T12:32:41.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:41.596+0000 7f2fe2ffd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2fe41007f0 0x7f2fe41987b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:41.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:41.596+0000 7f2fe2ffd640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2fe41007f0 0x7f2fe41987b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41200/0 (socket says 172.21.15.3:41200) 2024-09-21T12:32:41.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:41.596+0000 7f2fe2ffd640 1 -- 172.21.15.3:0/3524670246 learned_addr learned my addr 172.21.15.3:0/3524670246 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:32:41.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:41.596+0000 7f2fe27fc640 1 --2- 172.21.15.3:0/3524670246 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2fe41067f0 0x7f2fe4198cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:41.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:41.596+0000 7f2fe2ffd640 1 -- 172.21.15.3:0/3524670246 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2fe41067f0 msgr2=0x7f2fe4198cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:41.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:41.596+0000 7f2fe2ffd640 1 --2- 172.21.15.3:0/3524670246 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2fe41067f0 0x7f2fe4198cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:41.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:41.596+0000 7f2fe2ffd640 1 -- 172.21.15.3:0/3524670246 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fe4199340 con 0x7f2fe41007f0 2024-09-21T12:32:41.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:41.596+0000 7f2fe27fc640 1 --2- 172.21.15.3:0/3524670246 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2fe41067f0 0x7f2fe4198cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-21T12:32:41.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:41.596+0000 7f2fe2ffd640 1 --2- 172.21.15.3:0/3524670246 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2fe41007f0 0x7f2fe41987b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2fd400d6f0 tx=0x7f2fd400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:32:41.609 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:41.597+0000 7f2fcbfff640 1 -- 172.21.15.3:0/3524670246 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2fd4017070 con 0x7f2fe41007f0 2024-09-21T12:32:41.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:41.597+0000 7f2fe93f9640 1 -- 172.21.15.3:0/3524670246 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fe41a1820 con 0x7f2fe41007f0 2024-09-21T12:32:41.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:41.597+0000 7f2fcbfff640 1 -- 172.21.15.3:0/3524670246 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f2fd400de00 con 0x7f2fe41007f0 2024-09-21T12:32:41.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:41.597+0000 7f2fcbfff640 1 -- 172.21.15.3:0/3524670246 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f2fd4004bb0 con 0x7f2fe41007f0 2024-09-21T12:32:41.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:41.597+0000 7f2fe93f9640 1 -- 172.21.15.3:0/3524670246 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fe41a1c20 con 0x7f2fe41007f0 2024-09-21T12:32:41.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:41.598+0000 7f2fe93f9640 1 -- 172.21.15.3:0/3524670246 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fe4101f30 con 0x7f2fe41007f0 2024-09-21T12:32:41.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:41.599+0000 7f2fcbfff640 1 -- 172.21.15.3:0/3524670246 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f2fd4004e60 con 0x7f2fe41007f0 2024-09-21T12:32:41.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:41.599+0000 7f2fcbfff640 1 --2- 172.21.15.3:0/3524670246 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f2fcc07af30 0x7f2fcc07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:41.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:41.599+0000 7f2fcbfff640 1 -- 172.21.15.3:0/3524670246 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6414+0+0 (secure 0 0 0) 0x7f2fd409dd50 con 0x7f2fe41007f0 2024-09-21T12:32:41.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:41.599+0000 7f2fe27fc640 1 --2- 172.21.15.3:0/3524670246 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f2fcc07af30 0x7f2fcc07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:41.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:41.600+0000 7f2fe27fc640 1 --2- 172.21.15.3:0/3524670246 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f2fcc07af30 0x7f2fcc07d3f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2fe406a830 tx=0x7f2fd8031400 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:32:41.610 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:41.604+0000 7f2fcbfff640 1 -- 172.21.15.3:0/3524670246 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f2fd4069250 con 0x7f2fe41007f0 2024-09-21T12:32:41.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:41.846+0000 7f2fe93f9640 1 -- 172.21.15.3:0/3524670246 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 34, "format": "json"} v 0) -- 0x7f2fe4108d60 con 0x7f2fe41007f0 2024-09-21T12:32:41.847 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:41.846+0000 7f2fcbfff640 1 -- 172.21.15.3:0/3524670246 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 34, "format": "json"}]=0 dumped fsmap epoch 34 v35) ==== 107+0+5317 (secure 0 0 0) 0x7f2fd406e100 con 0x7f2fe41007f0 2024-09-21T12:32:41.848 INFO:teuthology.orchestra.run.smithi003.stdout: 2024-09-21T12:32:41.848 INFO:teuthology.orchestra.run.smithi003.stdout:{"epoch":34,"btime":"2024-09-21T12:30:29:559368+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34346,"name":"cephfs.smithi003.gfkngj","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.3:6829/1282732153","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6828","nonce":1282732153},{"type":"v1","addr":"172.21.15.3:6829","nonce":1282732153}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":20},{"gid":44321,"name":"cephfs.smithi192.ywqqxe","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6825/3113020545","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6824","nonce":3113020545},{"type":"v1","addr":"172.21.15.192:6825","nonce":3113020545}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":44349,"name":"cephfs.smithi192.ktdqns","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.192:6827/3169061902","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.192:6826","nonce":3169061902},{"type":"v1","addr":"172.21.15.192:6827","nonce":3169061902}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":33}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-21T12:17:38.260099+0000","modified":"2024-09-21T12:30:28.561999+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":81,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34314},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34314":{"gid":34314,"name":"cephfs.smithi003.ebjgyl","rank":0,"incarnation":29,"state":"up:active","state_seq":21,"addr":"172.21.15.3:6827/1616995236","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.3:6826","nonce":1616995236},{"type":"v1","addr":"172.21.15.3:6827","nonce":1616995236}]},"join_fscid":1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34314,"qdb_cluster":[34314]},"id":1}]} 2024-09-21T12:32:41.848 INFO:teuthology.orchestra.run.smithi003.stderr:dumped fsmap epoch 34 2024-09-21T12:32:41.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:41.848+0000 7f2fe93f9640 1 -- 172.21.15.3:0/3524670246 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f2fcc07af30 msgr2=0x7f2fcc07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:41.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:41.848+0000 7f2fe93f9640 1 --2- 172.21.15.3:0/3524670246 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f2fcc07af30 0x7f2fcc07d3f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2fe406a830 tx=0x7f2fd8031400 comp rx=0 tx=0).stop 2024-09-21T12:32:41.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:41.848+0000 7f2fe93f9640 1 -- 172.21.15.3:0/3524670246 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2fe41007f0 msgr2=0x7f2fe41987b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:41.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:41.848+0000 7f2fe93f9640 1 --2- 172.21.15.3:0/3524670246 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2fe41007f0 0x7f2fe41987b0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f2fd400d6f0 tx=0x7f2fd400dbb0 comp rx=0 tx=0).stop 2024-09-21T12:32:41.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:41.848+0000 7f2fe93f9640 1 -- 172.21.15.3:0/3524670246 shutdown_connections 2024-09-21T12:32:41.850 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:41.848+0000 7f2fe93f9640 1 --2- 172.21.15.3:0/3524670246 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f2fcc07af30 0x7f2fcc07d3f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:41.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:41.848+0000 7f2fe93f9640 1 --2- 172.21.15.3:0/3524670246 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f2fe41067f0 0x7f2fe4198cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:41.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:41.848+0000 7f2fe93f9640 1 --2- 172.21.15.3:0/3524670246 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f2fe41007f0 0x7f2fe41987b0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:41.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:41.848+0000 7f2fe93f9640 1 -- 172.21.15.3:0/3524670246 >> 172.21.15.3:0/3524670246 conn(0x7f2fe40fc550 msgr2=0x7f2fe40fcda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:32:41.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:41.849+0000 7f2fe93f9640 1 -- 172.21.15.3:0/3524670246 shutdown_connections 2024-09-21T12:32:41.851 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:41.849+0000 7f2fe93f9640 1 -- 172.21.15.3:0/3524670246 wait complete. 2024-09-21T12:32:42.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:32:41 smithi192 ceph-mon[80326]: pgmap v357: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:32:42.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:32:41 smithi003 ceph-mon[108723]: pgmap v357: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:32:42.443 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-21T12:32:42.453 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-21T12:32:42.453 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-09-21T12:32:42.453 DEBUG:teuthology.orchestra.run.smithi003:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T12:32:42.472 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-09-21T12:32:42.472 DEBUG:teuthology.orchestra.run.smithi003:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T12:32:42.530 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph osd blocklist ls 2024-09-21T12:32:42.835 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:32:43.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:32:42 smithi192 ceph-mon[80326]: from='client.? 172.21.15.3:0/3524670246' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 34, "format": "json"} : dispatch 2024-09-21T12:32:43.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:32:42 smithi003 ceph-mon[108723]: from='client.? 172.21.15.3:0/3524670246' entity='client.admin' cmd={"prefix": "fs dump", "epoch": 34, "format": "json"} : dispatch 2024-09-21T12:32:43.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:43.298+0000 7f1cb901d640 1 -- 172.21.15.3:0/4075466073 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1cb4100860 msgr2=0x7f1cb4100cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:43.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:43.298+0000 7f1cb901d640 1 --2- 172.21.15.3:0/4075466073 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1cb4100860 0x7f1cb4100cc0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8009880 tx=0x7f1ca802a4a0 comp rx=0 tx=0).stop 2024-09-21T12:32:43.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:43.298+0000 7f1cb901d640 1 -- 172.21.15.3:0/4075466073 shutdown_connections 2024-09-21T12:32:43.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:43.298+0000 7f1cb901d640 1 --2- 172.21.15.3:0/4075466073 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1cb4100860 0x7f1cb4100cc0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:43.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:43.298+0000 7f1cb901d640 1 --2- 172.21.15.3:0/4075466073 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1cb4106860 0x7f1cb4106c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:43.315 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:43.298+0000 7f1cb901d640 1 -- 172.21.15.3:0/4075466073 >> 172.21.15.3:0/4075466073 conn(0x7f1cb40fc580 msgr2=0x7f1cb40fe9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:32:43.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:43.298+0000 7f1cb901d640 1 -- 172.21.15.3:0/4075466073 shutdown_connections 2024-09-21T12:32:43.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:43.298+0000 7f1cb901d640 1 -- 172.21.15.3:0/4075466073 wait complete. 2024-09-21T12:32:43.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:43.299+0000 7f1cb901d640 1 Processor -- start 2024-09-21T12:32:43.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:43.299+0000 7f1cb901d640 1 -- start start 2024-09-21T12:32:43.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:43.299+0000 7f1cb901d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1cb4100860 0x7f1cb419c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:43.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:43.299+0000 7f1cb901d640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1cb4106860 0x7f1cb419cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:43.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:43.299+0000 7f1cb901d640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f1cb410dd30 con 0x7f1cb4100860 2024-09-21T12:32:43.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:43.299+0000 7f1cb901d640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f1cb410dbb0 con 0x7f1cb4106860 2024-09-21T12:32:43.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:43.299+0000 7f1cb2d9d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1cb4100860 0x7f1cb419c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:43.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:43.299+0000 7f1cb2d9d640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1cb4100860 0x7f1cb419c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41218/0 (socket says 172.21.15.3:41218) 2024-09-21T12:32:43.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:43.299+0000 7f1cb2d9d640 1 -- 172.21.15.3:0/299035447 learned_addr learned my addr 172.21.15.3:0/299035447 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:32:43.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:43.300+0000 7f1cb259c640 1 --2- 172.21.15.3:0/299035447 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1cb4106860 0x7f1cb419cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:43.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:43.300+0000 7f1cb2d9d640 1 -- 172.21.15.3:0/299035447 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1cb4106860 msgr2=0x7f1cb419cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:43.316 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:43.300+0000 7f1cb2d9d640 1 --2- 172.21.15.3:0/299035447 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1cb4106860 0x7f1cb419cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:43.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:43.300+0000 7f1cb2d9d640 1 -- 172.21.15.3:0/299035447 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cb4196720 con 0x7f1cb4100860 2024-09-21T12:32:43.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:43.300+0000 7f1cb2d9d640 1 --2- 172.21.15.3:0/299035447 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1cb4100860 0x7f1cb419c650 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f1ca400d6f0 tx=0x7f1ca400dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:32:43.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:43.300+0000 7f1c9bfff640 1 -- 172.21.15.3:0/299035447 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1ca4017070 con 0x7f1cb4100860 2024-09-21T12:32:43.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:43.300+0000 7f1c9bfff640 1 -- 172.21.15.3:0/299035447 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f1ca400de00 con 0x7f1cb4100860 2024-09-21T12:32:43.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:43.300+0000 7f1cb901d640 1 -- 172.21.15.3:0/299035447 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cb4196a10 con 0x7f1cb4100860 2024-09-21T12:32:43.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:43.300+0000 7f1c9bfff640 1 -- 172.21.15.3:0/299035447 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f1ca4004bb0 con 0x7f1cb4100860 2024-09-21T12:32:43.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:43.300+0000 7f1cb901d640 1 -- 172.21.15.3:0/299035447 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cb4196ec0 con 0x7f1cb4100860 2024-09-21T12:32:43.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:43.301+0000 7f1cb901d640 1 -- 172.21.15.3:0/299035447 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cb4101fa0 con 0x7f1cb4100860 2024-09-21T12:32:43.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:43.302+0000 7f1c9bfff640 1 -- 172.21.15.3:0/299035447 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f1ca4004e60 con 0x7f1cb4100860 2024-09-21T12:32:43.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:43.302+0000 7f1c9bfff640 1 --2- 172.21.15.3:0/299035447 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f1c9c07af30 0x7f1c9c07d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:43.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:43.302+0000 7f1c9bfff640 1 -- 172.21.15.3:0/299035447 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6414+0+0 (secure 0 0 0) 0x7f1ca409dd50 con 0x7f1cb4100860 2024-09-21T12:32:43.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:43.302+0000 7f1cb259c640 1 --2- 172.21.15.3:0/299035447 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f1c9c07af30 0x7f1c9c07d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:43.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:43.303+0000 7f1cb259c640 1 --2- 172.21.15.3:0/299035447 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f1c9c07af30 0x7f1c9c07d3f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1cb4197f70 tx=0x7f1ca8031400 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:32:43.317 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:43.307+0000 7f1c9bfff640 1 -- 172.21.15.3:0/299035447 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f1ca4069250 con 0x7f1cb4100860 2024-09-21T12:32:43.508 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:43.507+0000 7f1cb901d640 1 -- 172.21.15.3:0/299035447 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f1cb41971a0 con 0x7f1cb4100860 2024-09-21T12:32:43.509 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:43.507+0000 7f1c9bfff640 1 -- 172.21.15.3:0/299035447 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 37 entries v81) ==== 81+0+2175 (secure 0 0 0) 0x7f1ca406e100 con 0x7f1cb4100860 2024-09-21T12:32:43.509 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.192:6827/318800854 2024-09-22T12:30:09.930853+0000 2024-09-21T12:32:43.509 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.192:6826/318800854 2024-09-22T12:30:09.930853+0000 2024-09-21T12:32:43.509 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.192:6825/4055220871 2024-09-22T12:29:44.450632+0000 2024-09-21T12:32:43.509 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:6829/3710817325 2024-09-22T12:29:22.613352+0000 2024-09-21T12:32:43.509 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:6801/2568399820 2024-09-22T12:11:18.903614+0000 2024-09-21T12:32:43.509 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:0/3532186966 2024-09-22T12:20:32.033566+0000 2024-09-21T12:32:43.509 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:6801/3011223684 2024-09-22T12:12:46.501201+0000 2024-09-21T12:32:43.509 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:6827/2374828346 2024-09-22T12:17:52.583978+0000 2024-09-21T12:32:43.510 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:6800/3011223684 2024-09-22T12:12:46.501201+0000 2024-09-21T12:32:43.510 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.192:0/1296841829 2024-09-22T12:21:58.772913+0000 2024-09-21T12:32:43.510 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:0/3077524060 2024-09-22T12:20:32.033566+0000 2024-09-21T12:32:43.510 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:0/2241193596 2024-09-22T12:12:46.501201+0000 2024-09-21T12:32:43.510 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.192:6824/4055220871 2024-09-22T12:29:44.450632+0000 2024-09-21T12:32:43.510 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:0/4128411278 2024-09-22T12:12:46.501201+0000 2024-09-21T12:32:43.510 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.192:0/422104600 2024-09-22T12:21:58.772913+0000 2024-09-21T12:32:43.510 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.192:0/286364961 2024-09-22T12:21:58.772913+0000 2024-09-21T12:32:43.510 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:0/533261896 2024-09-22T12:11:18.903614+0000 2024-09-21T12:32:43.510 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:0/4271646487 2024-09-22T12:11:50.998065+0000 2024-09-21T12:32:43.510 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:0/942012167 2024-09-22T12:11:18.903614+0000 2024-09-21T12:32:43.510 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:0/299469671 2024-09-22T12:11:18.903614+0000 2024-09-21T12:32:43.510 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.192:6828/1528605296 2024-09-22T12:21:58.772913+0000 2024-09-21T12:32:43.511 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:6828/3710817325 2024-09-22T12:29:22.613352+0000 2024-09-21T12:32:43.511 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.192:0/2719407315 2024-09-22T12:21:58.772913+0000 2024-09-21T12:32:43.511 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.192:0/839776341 2024-09-22T12:21:58.772913+0000 2024-09-21T12:32:43.511 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:6826/2374828346 2024-09-22T12:17:52.583978+0000 2024-09-21T12:32:43.511 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:6800/2480880781 2024-09-22T12:20:32.033566+0000 2024-09-21T12:32:43.511 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:6800/2568399820 2024-09-22T12:11:18.903614+0000 2024-09-21T12:32:43.511 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.192:0/1693257842 2024-09-22T12:21:58.772913+0000 2024-09-21T12:32:43.511 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:6800/219393181 2024-09-22T12:11:50.998065+0000 2024-09-21T12:32:43.511 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:0/2487235713 2024-09-22T12:20:32.033566+0000 2024-09-21T12:32:43.511 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:6801/2480880781 2024-09-22T12:20:32.033566+0000 2024-09-21T12:32:43.511 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:0/814089744 2024-09-22T12:11:50.998065+0000 2024-09-21T12:32:43.511 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:0/1985406757 2024-09-22T12:12:46.501201+0000 2024-09-21T12:32:43.511 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:6801/219393181 2024-09-22T12:11:50.998065+0000 2024-09-21T12:32:43.511 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.192:6829/1528605296 2024-09-22T12:21:58.772913+0000 2024-09-21T12:32:43.511 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:0/1113697961 2024-09-22T12:20:32.033566+0000 2024-09-21T12:32:43.512 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:0/897407664 2024-09-22T12:11:50.998065+0000 2024-09-21T12:32:43.512 INFO:teuthology.orchestra.run.smithi003.stderr:listed 37 entries 2024-09-21T12:32:43.512 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:43.509+0000 7f1cb901d640 1 -- 172.21.15.3:0/299035447 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f1c9c07af30 msgr2=0x7f1c9c07d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:43.512 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:43.509+0000 7f1cb901d640 1 --2- 172.21.15.3:0/299035447 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f1c9c07af30 0x7f1c9c07d3f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f1cb4197f70 tx=0x7f1ca8031400 comp rx=0 tx=0).stop 2024-09-21T12:32:43.512 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:43.509+0000 7f1cb901d640 1 -- 172.21.15.3:0/299035447 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1cb4100860 msgr2=0x7f1cb419c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:43.512 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:43.509+0000 7f1cb901d640 1 --2- 172.21.15.3:0/299035447 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1cb4100860 0x7f1cb419c650 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f1ca400d6f0 tx=0x7f1ca400dbb0 comp rx=0 tx=0).stop 2024-09-21T12:32:43.512 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:43.509+0000 7f1cb901d640 1 -- 172.21.15.3:0/299035447 shutdown_connections 2024-09-21T12:32:43.513 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:43.509+0000 7f1cb901d640 1 --2- 172.21.15.3:0/299035447 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f1c9c07af30 0x7f1c9c07d3f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:43.513 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:43.509+0000 7f1cb901d640 1 --2- 172.21.15.3:0/299035447 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f1cb4106860 0x7f1cb419cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:43.513 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:43.509+0000 7f1cb901d640 1 --2- 172.21.15.3:0/299035447 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f1cb4100860 0x7f1cb419c650 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:43.513 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:43.509+0000 7f1cb901d640 1 -- 172.21.15.3:0/299035447 >> 172.21.15.3:0/299035447 conn(0x7f1cb40fc580 msgr2=0x7f1cb40fce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:32:43.513 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:43.510+0000 7f1cb901d640 1 -- 172.21.15.3:0/299035447 shutdown_connections 2024-09-21T12:32:43.513 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:43.510+0000 7f1cb901d640 1 -- 172.21.15.3:0/299035447 wait complete. 2024-09-21T12:32:43.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:32:43 smithi003 ceph-mon[108723]: pgmap v358: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:32:43.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:32:43 smithi003 ceph-mon[108723]: from='client.? 172.21.15.3:0/299035447' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T12:32:44.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:32:43 smithi192 ceph-mon[80326]: pgmap v358: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:32:44.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:32:43 smithi192 ceph-mon[80326]: from='client.? 172.21.15.3:0/299035447' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T12:32:44.109 DEBUG:teuthology.orchestra.run.smithi003:> set -ex 2024-09-21T12:32:44.109 DEBUG:teuthology.orchestra.run.smithi003:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-21T12:32:44.128 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:squid shell --fsid 641beec0-7812-11ef-baf6-efdc52797490 -- ceph osd blocklist ls 2024-09-21T12:32:44.430 INFO:teuthology.orchestra.run.smithi003.stderr:Inferring config /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/mon.smithi003/config 2024-09-21T12:32:44.802 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:32:44 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:32:44.905 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:44.882+0000 7f73e8e16640 1 -- 172.21.15.3:0/1812699413 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f73e4102b50 msgr2=0x7f73e4102f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:44.905 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:44.882+0000 7f73e8e16640 1 --2- 172.21.15.3:0/1812699413 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f73e4102b50 0x7f73e4102f30 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f73d4009c20 tx=0x7f73d402aa00 comp rx=0 tx=0).stop 2024-09-21T12:32:44.905 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:44.882+0000 7f73e8e16640 1 -- 172.21.15.3:0/1812699413 shutdown_connections 2024-09-21T12:32:44.906 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:44.882+0000 7f73e8e16640 1 --2- 172.21.15.3:0/1812699413 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f73e4103470 0x7f73e410b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:44.906 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:44.882+0000 7f73e8e16640 1 --2- 172.21.15.3:0/1812699413 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f73e4102b50 0x7f73e4102f30 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:44.906 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:44.882+0000 7f73e8e16640 1 -- 172.21.15.3:0/1812699413 >> 172.21.15.3:0/1812699413 conn(0x7f73e40fc550 msgr2=0x7f73e40fe970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:32:44.906 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:44.882+0000 7f73e8e16640 1 -- 172.21.15.3:0/1812699413 shutdown_connections 2024-09-21T12:32:44.906 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:44.882+0000 7f73e8e16640 1 -- 172.21.15.3:0/1812699413 wait complete. 2024-09-21T12:32:44.906 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:44.883+0000 7f73e8e16640 1 Processor -- start 2024-09-21T12:32:44.906 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:44.883+0000 7f73e8e16640 1 -- start start 2024-09-21T12:32:44.906 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:44.883+0000 7f73e8e16640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f73e4102b50 0x7f73e419d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:44.906 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:44.883+0000 7f73e8e16640 1 --2- >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f73e4103470 0x7f73e419db70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:44.906 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:44.883+0000 7f73e8e16640 1 -- --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_getmap magic: 0 -- 0x7f73e410edc0 con 0x7f73e4102b50 2024-09-21T12:32:44.906 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:44.883+0000 7f73e8e16640 1 -- --> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] -- mon_getmap magic: 0 -- 0x7f73e410ec40 con 0x7f73e4103470 2024-09-21T12:32:44.906 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:44.883+0000 7f73e259c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f73e4102b50 0x7f73e419d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:44.906 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:44.883+0000 7f73e259c640 1 --2- >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f73e4102b50 0x7f73e419d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.3:3300/0 says I am v2:172.21.15.3:41242/0 (socket says 172.21.15.3:41242) 2024-09-21T12:32:44.907 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:44.883+0000 7f73e259c640 1 -- 172.21.15.3:0/1055277678 learned_addr learned my addr 172.21.15.3:0/1055277678 (peer_addr_for_me v2:172.21.15.3:0/0) 2024-09-21T12:32:44.907 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:44.883+0000 7f73e1d9b640 1 --2- 172.21.15.3:0/1055277678 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f73e4103470 0x7f73e419db70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:44.907 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:44.883+0000 7f73e259c640 1 -- 172.21.15.3:0/1055277678 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f73e4103470 msgr2=0x7f73e419db70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:44.907 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:44.883+0000 7f73e259c640 1 --2- 172.21.15.3:0/1055277678 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f73e4103470 0x7f73e419db70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:44.907 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:44.883+0000 7f73e259c640 1 -- 172.21.15.3:0/1055277678 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73e41977b0 con 0x7f73e4102b50 2024-09-21T12:32:44.907 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:44.883+0000 7f73e259c640 1 --2- 172.21.15.3:0/1055277678 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f73e4102b50 0x7f73e419d630 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f73d4006010 tx=0x7f73d402ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:32:44.907 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:44.884+0000 7f73d37fe640 1 -- 172.21.15.3:0/1055277678 <== mon.0 v2:172.21.15.3:3300/0 1 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f73d4047070 con 0x7f73e4102b50 2024-09-21T12:32:44.907 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:44.884+0000 7f73e8e16640 1 -- 172.21.15.3:0/1055277678 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73e4197a40 con 0x7f73e4102b50 2024-09-21T12:32:44.907 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:44.884+0000 7f73d37fe640 1 -- 172.21.15.3:0/1055277678 <== mon.0 v2:172.21.15.3:3300/0 2 ==== config(27 keys) ==== 1109+0+0 (secure 0 0 0) 0x7f73d4003e30 con 0x7f73e4102b50 2024-09-21T12:32:44.907 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:44.884+0000 7f73d37fe640 1 -- 172.21.15.3:0/1055277678 <== mon.0 v2:172.21.15.3:3300/0 3 ==== mon_map magic: 0 ==== 357+0+0 (secure 0 0 0) 0x7f73d4033050 con 0x7f73e4102b50 2024-09-21T12:32:44.907 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:44.884+0000 7f73e8e16640 1 -- 172.21.15.3:0/1055277678 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73e4197f70 con 0x7f73e4102b50 2024-09-21T12:32:44.907 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:44.885+0000 7f73e8e16640 1 -- 172.21.15.3:0/1055277678 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73e406a4e0 con 0x7f73e4102b50 2024-09-21T12:32:44.907 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:44.885+0000 7f73d37fe640 1 -- 172.21.15.3:0/1055277678 <== mon.0 v2:172.21.15.3:3300/0 4 ==== mgrmap(e 33) ==== 103318+0+0 (secure 0 0 0) 0x7f73d404a070 con 0x7f73e4102b50 2024-09-21T12:32:44.908 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:44.886+0000 7f73d37fe640 1 --2- 172.21.15.3:0/1055277678 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f73cc07af40 0x7f73cc07d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-21T12:32:44.908 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:44.886+0000 7f73d37fe640 1 -- 172.21.15.3:0/1055277678 <== mon.0 v2:172.21.15.3:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 6414+0+0 (secure 0 0 0) 0x7f73d403e030 con 0x7f73e4102b50 2024-09-21T12:32:44.908 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:44.886+0000 7f73e1d9b640 1 --2- 172.21.15.3:0/1055277678 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f73cc07af40 0x7f73cc07d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-21T12:32:44.908 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:44.886+0000 7f73e1d9b640 1 --2- 172.21.15.3:0/1055277678 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f73cc07af40 0x7f73cc07d400 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f73d8005e10 tx=0x7f73d8005da0 comp rx=0 tx=0).ready entity=mgr.14756 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-21T12:32:44.908 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:44.890+0000 7f73d37fe640 1 -- 172.21.15.3:0/1055277678 <== mon.0 v2:172.21.15.3:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+198400 (secure 0 0 0) 0x7f73d408a890 con 0x7f73e4102b50 2024-09-21T12:32:45.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:32:44 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:32:45.091 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:45.089+0000 7f73e8e16640 1 -- 172.21.15.3:0/1055277678 --> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f73e4198ce0 con 0x7f73e4102b50 2024-09-21T12:32:45.091 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:45.090+0000 7f73d37fe640 1 -- 172.21.15.3:0/1055277678 <== mon.0 v2:172.21.15.3:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 37 entries v81) ==== 81+0+2175 (secure 0 0 0) 0x7f73d408f740 con 0x7f73e4102b50 2024-09-21T12:32:45.091 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.192:6827/318800854 2024-09-22T12:30:09.930853+0000 2024-09-21T12:32:45.091 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.192:6826/318800854 2024-09-22T12:30:09.930853+0000 2024-09-21T12:32:45.091 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.192:6825/4055220871 2024-09-22T12:29:44.450632+0000 2024-09-21T12:32:45.092 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:6829/3710817325 2024-09-22T12:29:22.613352+0000 2024-09-21T12:32:45.092 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:6801/2568399820 2024-09-22T12:11:18.903614+0000 2024-09-21T12:32:45.092 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:0/3532186966 2024-09-22T12:20:32.033566+0000 2024-09-21T12:32:45.092 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:6801/3011223684 2024-09-22T12:12:46.501201+0000 2024-09-21T12:32:45.092 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:6827/2374828346 2024-09-22T12:17:52.583978+0000 2024-09-21T12:32:45.092 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:6800/3011223684 2024-09-22T12:12:46.501201+0000 2024-09-21T12:32:45.092 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.192:0/1296841829 2024-09-22T12:21:58.772913+0000 2024-09-21T12:32:45.092 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:0/3077524060 2024-09-22T12:20:32.033566+0000 2024-09-21T12:32:45.092 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:0/2241193596 2024-09-22T12:12:46.501201+0000 2024-09-21T12:32:45.092 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.192:6824/4055220871 2024-09-22T12:29:44.450632+0000 2024-09-21T12:32:45.092 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:0/4128411278 2024-09-22T12:12:46.501201+0000 2024-09-21T12:32:45.092 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.192:0/422104600 2024-09-22T12:21:58.772913+0000 2024-09-21T12:32:45.092 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.192:0/286364961 2024-09-22T12:21:58.772913+0000 2024-09-21T12:32:45.092 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:0/533261896 2024-09-22T12:11:18.903614+0000 2024-09-21T12:32:45.093 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:0/4271646487 2024-09-22T12:11:50.998065+0000 2024-09-21T12:32:45.093 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:0/942012167 2024-09-22T12:11:18.903614+0000 2024-09-21T12:32:45.093 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:0/299469671 2024-09-22T12:11:18.903614+0000 2024-09-21T12:32:45.093 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.192:6828/1528605296 2024-09-22T12:21:58.772913+0000 2024-09-21T12:32:45.093 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:6828/3710817325 2024-09-22T12:29:22.613352+0000 2024-09-21T12:32:45.093 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.192:0/2719407315 2024-09-22T12:21:58.772913+0000 2024-09-21T12:32:45.093 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.192:0/839776341 2024-09-22T12:21:58.772913+0000 2024-09-21T12:32:45.093 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:6826/2374828346 2024-09-22T12:17:52.583978+0000 2024-09-21T12:32:45.093 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:6800/2480880781 2024-09-22T12:20:32.033566+0000 2024-09-21T12:32:45.093 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:6800/2568399820 2024-09-22T12:11:18.903614+0000 2024-09-21T12:32:45.093 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.192:0/1693257842 2024-09-22T12:21:58.772913+0000 2024-09-21T12:32:45.093 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:6800/219393181 2024-09-22T12:11:50.998065+0000 2024-09-21T12:32:45.093 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:0/2487235713 2024-09-22T12:20:32.033566+0000 2024-09-21T12:32:45.094 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:6801/2480880781 2024-09-22T12:20:32.033566+0000 2024-09-21T12:32:45.094 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:0/814089744 2024-09-22T12:11:50.998065+0000 2024-09-21T12:32:45.094 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:0/1985406757 2024-09-22T12:12:46.501201+0000 2024-09-21T12:32:45.094 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:6801/219393181 2024-09-22T12:11:50.998065+0000 2024-09-21T12:32:45.094 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.192:6829/1528605296 2024-09-22T12:21:58.772913+0000 2024-09-21T12:32:45.094 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:0/1113697961 2024-09-22T12:20:32.033566+0000 2024-09-21T12:32:45.094 INFO:teuthology.orchestra.run.smithi003.stdout:172.21.15.3:0/897407664 2024-09-22T12:11:50.998065+0000 2024-09-21T12:32:45.095 INFO:teuthology.orchestra.run.smithi003.stderr:listed 37 entries 2024-09-21T12:32:45.095 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:45.092+0000 7f73e8e16640 1 -- 172.21.15.3:0/1055277678 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f73cc07af40 msgr2=0x7f73cc07d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:45.095 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:45.092+0000 7f73e8e16640 1 --2- 172.21.15.3:0/1055277678 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f73cc07af40 0x7f73cc07d400 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f73d8005e10 tx=0x7f73d8005da0 comp rx=0 tx=0).stop 2024-09-21T12:32:45.095 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:45.092+0000 7f73e8e16640 1 -- 172.21.15.3:0/1055277678 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f73e4102b50 msgr2=0x7f73e419d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-21T12:32:45.095 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:45.092+0000 7f73e8e16640 1 --2- 172.21.15.3:0/1055277678 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f73e4102b50 0x7f73e419d630 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f73d4006010 tx=0x7f73d402ee50 comp rx=0 tx=0).stop 2024-09-21T12:32:45.095 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:45.092+0000 7f73e8e16640 1 -- 172.21.15.3:0/1055277678 shutdown_connections 2024-09-21T12:32:45.095 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:45.092+0000 7f73e8e16640 1 --2- 172.21.15.3:0/1055277678 >> [v2:172.21.15.3:6800/1284098095,v1:172.21.15.3:6801/1284098095] conn(0x7f73cc07af40 0x7f73cc07d400 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:45.095 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:45.092+0000 7f73e8e16640 1 --2- 172.21.15.3:0/1055277678 >> [v2:172.21.15.192:3300/0,v1:172.21.15.192:6789/0] conn(0x7f73e4103470 0x7f73e419db70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:45.095 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:45.092+0000 7f73e8e16640 1 --2- 172.21.15.3:0/1055277678 >> [v2:172.21.15.3:3300/0,v1:172.21.15.3:6789/0] conn(0x7f73e4102b50 0x7f73e419d630 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-21T12:32:45.095 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:45.092+0000 7f73e8e16640 1 -- 172.21.15.3:0/1055277678 >> 172.21.15.3:0/1055277678 conn(0x7f73e40fc550 msgr2=0x7f73e4108f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-21T12:32:45.096 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:45.092+0000 7f73e8e16640 1 -- 172.21.15.3:0/1055277678 shutdown_connections 2024-09-21T12:32:45.096 INFO:teuthology.orchestra.run.smithi003.stderr:2024-09-21T12:32:45.092+0000 7f73e8e16640 1 -- 172.21.15.3:0/1055277678 wait complete. 2024-09-21T12:32:45.816 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi003.front.sepia.ceph.com... 2024-09-21T12:32:45.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-21T12:32:45.816 DEBUG:teuthology.orchestra.run.smithi003:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-21T12:32:45.843 INFO:teuthology.orchestra.run:waiting for 300 2024-09-21T12:32:46.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:32:45 smithi192 ceph-mon[80326]: pgmap v359: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:32:46.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:32:45 smithi192 ceph-mon[80326]: from='client.? 172.21.15.3:0/1055277678' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T12:32:46.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:32:45 smithi003 ceph-mon[108723]: pgmap v359: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:32:46.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:32:45 smithi003 ceph-mon[108723]: from='client.? 172.21.15.3:0/1055277678' entity='client.admin' cmd={"prefix": "osd blocklist ls"} : dispatch 2024-09-21T12:32:48.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:32:47 smithi192 ceph-mon[80326]: pgmap v360: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:32:48.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:32:47 smithi003 ceph-mon[108723]: pgmap v360: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:32:50.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:32:50 smithi192 ceph-mon[80326]: pgmap v361: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:32:50.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:32:50 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:32:50.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:32:50 smithi003 ceph-mon[108723]: pgmap v361: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:32:50.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:32:50 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:32:51.499 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:32:51 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:32:51.500 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:32:51 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:32:51.500 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:32:51 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:32:51.500 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:32:51 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:32:51.500 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:32:51 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:32:51.500 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:32:51 smithi192 ceph-mon[80326]: pgmap v362: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:32:51.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:32:51 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:32:51.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:32:51 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:32:51.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:32:51 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:32:51.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:32:51 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:32:51.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:32:51 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:32:51.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:32:51 smithi003 ceph-mon[108723]: pgmap v362: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:32:54.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:32:54 smithi192 ceph-mon[80326]: pgmap v363: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:32:54.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:32:54 smithi003 ceph-mon[108723]: pgmap v363: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:32:56.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:32:56 smithi192 ceph-mon[80326]: pgmap v364: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:32:56.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:32:56 smithi003 ceph-mon[108723]: pgmap v364: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:32:57.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:32:57 smithi003 ceph-mon[108723]: pgmap v365: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:32:57.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:32:57 smithi192 ceph-mon[80326]: pgmap v365: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:33:00.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:33:00 smithi192 ceph-mon[80326]: pgmap v366: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:33:00.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:33:00 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:33:00.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:33:00 smithi003 ceph-mon[108723]: pgmap v366: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:33:00.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:33:00 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:33:02.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:33:02 smithi192 ceph-mon[80326]: pgmap v367: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:33:02.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:33:02 smithi003 ceph-mon[108723]: pgmap v367: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:33:03.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:33:03 smithi003 ceph-mon[108723]: pgmap v368: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:33:03.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:33:03 smithi192 ceph-mon[80326]: pgmap v368: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:33:06.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:33:06 smithi192 ceph-mon[80326]: pgmap v369: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:33:06.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:33:06 smithi003 ceph-mon[108723]: pgmap v369: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:33:07.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:33:07 smithi003 ceph-mon[108723]: pgmap v370: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:33:07.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:33:07 smithi192 ceph-mon[80326]: pgmap v370: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:33:10.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:33:10 smithi192 ceph-mon[80326]: pgmap v371: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:33:10.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:33:10 smithi003 ceph-mon[108723]: pgmap v371: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:33:11.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:33:11 smithi003 ceph-mon[108723]: pgmap v372: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:33:11.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:33:11 smithi192 ceph-mon[80326]: pgmap v372: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:33:14.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:33:14 smithi003 ceph-mon[108723]: pgmap v373: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:33:14.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:33:14 smithi192 ceph-mon[80326]: pgmap v373: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:33:15.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:33:15 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:33:15.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:33:15 smithi003 ceph-mon[108723]: pgmap v374: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:33:15.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:33:15 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:33:15.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:33:15 smithi192 ceph-mon[80326]: pgmap v374: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:33:18.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:33:18 smithi003 ceph-mon[108723]: pgmap v375: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:33:18.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:33:18 smithi192 ceph-mon[80326]: pgmap v375: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:33:19.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:33:19 smithi003 ceph-mon[108723]: pgmap v376: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:33:19.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:33:19 smithi192 ceph-mon[80326]: pgmap v376: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:33:21.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:33:21 smithi003 ceph-mon[108723]: pgmap v377: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:33:21.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:33:21 smithi192 ceph-mon[80326]: pgmap v377: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:33:23.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:33:23 smithi003 ceph-mon[108723]: pgmap v378: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:33:23.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:33:23 smithi192 ceph-mon[80326]: pgmap v378: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:33:25.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:33:25 smithi003 ceph-mon[108723]: pgmap v379: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:33:25.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:33:25 smithi192 ceph-mon[80326]: pgmap v379: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:33:27.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:33:27 smithi003 ceph-mon[108723]: pgmap v380: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:33:27.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:33:27 smithi192 ceph-mon[80326]: pgmap v380: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:33:29.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:33:29 smithi003 ceph-mon[108723]: pgmap v381: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:33:29.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:33:29 smithi192 ceph-mon[80326]: pgmap v381: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:33:30.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:33:30 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:33:30.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:33:30 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:33:31.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:33:31 smithi003 ceph-mon[108723]: pgmap v382: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:33:31.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:33:31 smithi192 ceph-mon[80326]: pgmap v382: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:33:33.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:33:33 smithi003 ceph-mon[108723]: pgmap v383: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:33:33.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:33:33 smithi192 ceph-mon[80326]: pgmap v383: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:33:35.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:33:35 smithi003 ceph-mon[108723]: pgmap v384: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:33:35.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:33:35 smithi192 ceph-mon[80326]: pgmap v384: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:33:37.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:33:37 smithi003 ceph-mon[108723]: pgmap v385: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:33:37.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:33:37 smithi192 ceph-mon[80326]: pgmap v385: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:33:39.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:33:39 smithi003 ceph-mon[108723]: pgmap v386: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:33:39.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:33:39 smithi192 ceph-mon[80326]: pgmap v386: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:33:41.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:33:41 smithi003 ceph-mon[108723]: pgmap v387: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:33:41.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:33:41 smithi192 ceph-mon[80326]: pgmap v387: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:33:43.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:33:43 smithi003 ceph-mon[108723]: pgmap v388: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:33:43.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:33:43 smithi192 ceph-mon[80326]: pgmap v388: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:33:45.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:33:44 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:33:45.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:33:44 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:33:46.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:33:45 smithi192 ceph-mon[80326]: pgmap v389: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:33:46.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:33:45 smithi003 ceph-mon[108723]: pgmap v389: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:33:47.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:33:47 smithi003 ceph-mon[108723]: pgmap v390: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:33:47.346 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:33:47 smithi192 ceph-mon[80326]: pgmap v390: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:33:49.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:33:49 smithi003 ceph-mon[108723]: pgmap v391: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:33:49.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:33:49 smithi192 ceph-mon[80326]: pgmap v391: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:33:51.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:33:50 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:33:51.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:33:50 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:33:52.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:33:51 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:33:52.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:33:51 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:33:52.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:33:51 smithi192 ceph-mon[80326]: pgmap v392: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:33:52.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:33:51 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:33:52.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:33:51 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:33:52.258 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:33:51 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:33:52.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:33:51 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:33:52.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:33:51 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:33:52.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:33:51 smithi003 ceph-mon[108723]: pgmap v392: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:33:52.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:33:51 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:33:52.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:33:51 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:33:52.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:33:51 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:33:53.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:33:53 smithi003 ceph-mon[108723]: pgmap v393: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:33:53.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:33:53 smithi192 ceph-mon[80326]: pgmap v393: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:33:55.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:33:55 smithi003 ceph-mon[108723]: pgmap v394: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:33:55.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:33:55 smithi192 ceph-mon[80326]: pgmap v394: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:33:57.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:33:57 smithi003 ceph-mon[108723]: pgmap v395: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:33:57.500 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:33:57 smithi192 ceph-mon[80326]: pgmap v395: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:33:59.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:33:59 smithi003 ceph-mon[108723]: pgmap v396: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:33:59.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:33:59 smithi192 ceph-mon[80326]: pgmap v396: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:34:00.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:34:00 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:34:00.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:34:00 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:34:01.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:34:01 smithi003 ceph-mon[108723]: pgmap v397: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:34:01.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:34:01 smithi192 ceph-mon[80326]: pgmap v397: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:34:03.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:34:03 smithi003 ceph-mon[108723]: pgmap v398: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:34:03.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:34:03 smithi192 ceph-mon[80326]: pgmap v398: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:34:05.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:34:05 smithi003 ceph-mon[108723]: pgmap v399: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:34:05.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:34:05 smithi192 ceph-mon[80326]: pgmap v399: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:34:07.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:34:07 smithi003 ceph-mon[108723]: pgmap v400: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:34:07.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:34:07 smithi192 ceph-mon[80326]: pgmap v400: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:34:09.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:34:09 smithi003 ceph-mon[108723]: pgmap v401: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:34:09.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:34:09 smithi192 ceph-mon[80326]: pgmap v401: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:34:11.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:34:11 smithi003 ceph-mon[108723]: pgmap v402: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:34:11.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:34:11 smithi192 ceph-mon[80326]: pgmap v402: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:34:13.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:34:13 smithi003 ceph-mon[108723]: pgmap v403: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:34:13.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:34:13 smithi192 ceph-mon[80326]: pgmap v403: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:34:15.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:34:14 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:34:15.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:34:14 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:34:16.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:34:15 smithi192 ceph-mon[80326]: pgmap v404: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:34:16.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:34:15 smithi003 ceph-mon[108723]: pgmap v404: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:34:17.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:34:17 smithi003 ceph-mon[108723]: pgmap v405: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:34:17.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:34:17 smithi192 ceph-mon[80326]: pgmap v405: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:34:19.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:34:19 smithi003 ceph-mon[108723]: pgmap v406: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:34:19.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:34:19 smithi192 ceph-mon[80326]: pgmap v406: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:34:21.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:34:21 smithi003 ceph-mon[108723]: pgmap v407: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:34:21.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:34:21 smithi192 ceph-mon[80326]: pgmap v407: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:34:23.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:34:23 smithi192 ceph-mon[80326]: pgmap v408: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:34:23.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:34:23 smithi003 ceph-mon[108723]: pgmap v408: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:34:25.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:34:25 smithi003 ceph-mon[108723]: pgmap v409: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:34:25.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:34:25 smithi192 ceph-mon[80326]: pgmap v409: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:34:27.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:34:27 smithi003 ceph-mon[108723]: pgmap v410: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:34:27.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:34:27 smithi192 ceph-mon[80326]: pgmap v410: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:34:29.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:34:29 smithi003 ceph-mon[108723]: pgmap v411: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:34:29.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:34:29 smithi192 ceph-mon[80326]: pgmap v411: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:34:30.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:34:30 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:34:30.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:34:30 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:34:31.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:34:31 smithi003 ceph-mon[108723]: pgmap v412: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:34:31.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:34:31 smithi192 ceph-mon[80326]: pgmap v412: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:34:33.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:34:33 smithi003 ceph-mon[108723]: pgmap v413: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:34:33.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:34:33 smithi192 ceph-mon[80326]: pgmap v413: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:34:35.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:34:35 smithi003 ceph-mon[108723]: pgmap v414: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:34:35.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:34:35 smithi192 ceph-mon[80326]: pgmap v414: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:34:37.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:34:37 smithi003 ceph-mon[108723]: pgmap v415: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:34:37.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:34:37 smithi192 ceph-mon[80326]: pgmap v415: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:34:39.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:34:39 smithi003 ceph-mon[108723]: pgmap v416: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:34:39.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:34:39 smithi192 ceph-mon[80326]: pgmap v416: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:34:41.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:34:41 smithi003 ceph-mon[108723]: pgmap v417: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:34:41.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:34:41 smithi192 ceph-mon[80326]: pgmap v417: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:34:43.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:34:43 smithi003 ceph-mon[108723]: pgmap v418: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:34:43.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:34:43 smithi192 ceph-mon[80326]: pgmap v418: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:34:45.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:34:44 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:34:45.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:34:44 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:34:46.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:34:45 smithi192 ceph-mon[80326]: pgmap v419: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:34:46.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:34:45 smithi003 ceph-mon[108723]: pgmap v419: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:34:47.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:34:47 smithi003 ceph-mon[108723]: pgmap v420: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:34:47.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:34:47 smithi192 ceph-mon[80326]: pgmap v420: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:34:49.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:34:49 smithi003 ceph-mon[108723]: pgmap v421: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:34:49.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:34:49 smithi192 ceph-mon[80326]: pgmap v421: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:34:51.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:34:51 smithi003 ceph-mon[108723]: pgmap v422: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:34:51.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:34:51 smithi192 ceph-mon[80326]: pgmap v422: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:34:52.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:34:52 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:34:52.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:34:52 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:34:52.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:34:52 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:34:52.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:34:52 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:34:52.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:34:52 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:34:52.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:34:52 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:34:52.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:34:52 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:34:52.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:34:52 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:34:53.348 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:34:53 smithi192 ceph-mon[80326]: pgmap v423: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:34:53.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:34:53 smithi003 ceph-mon[108723]: pgmap v423: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:34:56.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:34:55 smithi192 ceph-mon[80326]: pgmap v424: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:34:56.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:34:55 smithi003 ceph-mon[108723]: pgmap v424: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:34:57.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:34:57 smithi003 ceph-mon[108723]: pgmap v425: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:34:57.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:34:57 smithi192 ceph-mon[80326]: pgmap v425: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:34:59.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:34:59 smithi003 ceph-mon[108723]: pgmap v426: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:34:59.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:34:59 smithi192 ceph-mon[80326]: pgmap v426: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:35:00.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:35:00 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:35:00.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:35:00 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:35:01.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:35:01 smithi192 ceph-mon[80326]: pgmap v427: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:35:01.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:35:01 smithi003 ceph-mon[108723]: pgmap v427: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:35:03.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:35:03 smithi003 ceph-mon[108723]: pgmap v428: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:35:03.502 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:35:03 smithi192 ceph-mon[80326]: pgmap v428: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:35:05.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:35:05 smithi003 ceph-mon[108723]: pgmap v429: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:35:05.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:35:05 smithi192 ceph-mon[80326]: pgmap v429: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:35:07.330 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:35:07 smithi003 ceph-mon[108723]: pgmap v430: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:35:07.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:35:07 smithi192 ceph-mon[80326]: pgmap v430: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:35:09.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:35:09 smithi003 ceph-mon[108723]: pgmap v431: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:35:09.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:35:09 smithi192 ceph-mon[80326]: pgmap v431: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:35:11.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:35:11 smithi003 ceph-mon[108723]: pgmap v432: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:35:11.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:35:11 smithi192 ceph-mon[80326]: pgmap v432: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:35:13.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:35:13 smithi192 ceph-mon[80326]: pgmap v433: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:35:13.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:35:13 smithi003 ceph-mon[108723]: pgmap v433: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:35:15.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:35:14 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:35:15.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:35:14 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:35:16.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:35:15 smithi192 ceph-mon[80326]: pgmap v434: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:35:16.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:35:15 smithi003 ceph-mon[108723]: pgmap v434: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:35:17.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:35:17 smithi192 ceph-mon[80326]: pgmap v435: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:35:17.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:35:17 smithi003 ceph-mon[108723]: pgmap v435: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:35:19.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:35:19 smithi192 ceph-mon[80326]: pgmap v436: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:35:19.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:35:19 smithi003 ceph-mon[108723]: pgmap v436: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:35:21.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:35:21 smithi192 ceph-mon[80326]: pgmap v437: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:35:21.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:35:21 smithi003 ceph-mon[108723]: pgmap v437: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:35:23.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:35:23 smithi192 ceph-mon[80326]: pgmap v438: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:35:23.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:35:23 smithi003 ceph-mon[108723]: pgmap v438: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:35:25.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:35:25 smithi192 ceph-mon[80326]: pgmap v439: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:35:25.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:35:25 smithi003 ceph-mon[108723]: pgmap v439: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:35:27.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:35:27 smithi192 ceph-mon[80326]: pgmap v440: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:35:27.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:35:27 smithi003 ceph-mon[108723]: pgmap v440: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:35:29.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:35:29 smithi192 ceph-mon[80326]: pgmap v441: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:35:29.422 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:35:29 smithi003 ceph-mon[108723]: pgmap v441: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:35:30.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:35:30 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:35:30.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:35:30 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:35:31.481 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:35:31 smithi003 ceph-mon[108723]: pgmap v442: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:35:31.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:35:31 smithi192 ceph-mon[80326]: pgmap v442: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:35:33.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:35:33 smithi192 ceph-mon[80326]: pgmap v443: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:35:33.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:35:33 smithi003 ceph-mon[108723]: pgmap v443: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:35:35.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:35:35 smithi192 ceph-mon[80326]: pgmap v444: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:35:35.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:35:35 smithi003 ceph-mon[108723]: pgmap v444: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:35:37.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:35:37 smithi192 ceph-mon[80326]: pgmap v445: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:35:37.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:35:37 smithi003 ceph-mon[108723]: pgmap v445: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:35:39.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:35:39 smithi192 ceph-mon[80326]: pgmap v446: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:35:39.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:35:39 smithi003 ceph-mon[108723]: pgmap v446: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:35:41.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:35:41 smithi192 ceph-mon[80326]: pgmap v447: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:35:41.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:35:41 smithi003 ceph-mon[108723]: pgmap v447: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:35:43.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:35:43 smithi192 ceph-mon[80326]: pgmap v448: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:35:43.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:35:43 smithi003 ceph-mon[108723]: pgmap v448: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:35:45.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:35:44 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:35:45.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:35:44 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:35:46.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:35:45 smithi192 ceph-mon[80326]: pgmap v449: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:35:46.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:35:45 smithi003 ceph-mon[108723]: pgmap v449: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:35:47.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:35:47 smithi192 ceph-mon[80326]: pgmap v450: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:35:47.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:35:47 smithi003 ceph-mon[108723]: pgmap v450: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:35:49.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:35:49 smithi192 ceph-mon[80326]: pgmap v451: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:35:49.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:35:49 smithi003 ceph-mon[108723]: pgmap v451: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:35:51.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:35:51 smithi192 ceph-mon[80326]: pgmap v452: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:35:51.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:35:51 smithi003 ceph-mon[108723]: pgmap v452: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:35:52.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:35:52 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:35:52.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:35:52 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:35:53.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:35:53 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:35:53.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:35:53 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:35:53.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:35:53 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:35:53.508 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:35:53 smithi192 ceph-mon[80326]: pgmap v453: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:35:53.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:35:53 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:35:53.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:35:53 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:35:53.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:35:53 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:35:53.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:35:53 smithi003 ceph-mon[108723]: pgmap v453: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:35:55.104 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:35:55 smithi003 ceph-mon[108723]: pgmap v454: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:35:55.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:35:55 smithi192 ceph-mon[80326]: pgmap v454: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:35:57.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:35:57 smithi192 ceph-mon[80326]: pgmap v455: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:35:57.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:35:57 smithi003 ceph-mon[108723]: pgmap v455: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:35:59.346 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:35:59 smithi192 ceph-mon[80326]: pgmap v456: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:35:59.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:35:59 smithi003 ceph-mon[108723]: pgmap v456: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:36:00.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:36:00 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:36:00.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:36:00 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:36:01.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:36:01 smithi192 ceph-mon[80326]: pgmap v457: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:36:01.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:36:01 smithi003 ceph-mon[108723]: pgmap v457: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:36:03.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:36:03 smithi192 ceph-mon[80326]: pgmap v458: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:36:03.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:36:03 smithi003 ceph-mon[108723]: pgmap v458: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:36:06.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:36:05 smithi192 ceph-mon[80326]: pgmap v459: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:36:06.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:36:05 smithi003 ceph-mon[108723]: pgmap v459: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:36:07.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:36:07 smithi192 ceph-mon[80326]: pgmap v460: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:36:07.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:36:07 smithi003 ceph-mon[108723]: pgmap v460: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:36:09.499 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:36:09 smithi192 ceph-mon[80326]: pgmap v461: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:36:09.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:36:09 smithi003 ceph-mon[108723]: pgmap v461: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:36:11.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:36:11 smithi192 ceph-mon[80326]: pgmap v462: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:36:11.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:36:11 smithi003 ceph-mon[108723]: pgmap v462: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:36:13.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:36:13 smithi192 ceph-mon[80326]: pgmap v463: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:36:13.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:36:13 smithi003 ceph-mon[108723]: pgmap v463: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:36:15.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:36:14 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:36:15.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:36:14 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:36:16.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:36:15 smithi192 ceph-mon[80326]: pgmap v464: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:36:16.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:36:15 smithi003 ceph-mon[108723]: pgmap v464: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:36:17.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:36:17 smithi192 ceph-mon[80326]: pgmap v465: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:36:17.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:36:17 smithi003 ceph-mon[108723]: pgmap v465: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:36:19.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:36:19 smithi192 ceph-mon[80326]: pgmap v466: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:36:19.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:36:19 smithi003 ceph-mon[108723]: pgmap v466: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:36:21.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:36:21 smithi192 ceph-mon[80326]: pgmap v467: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:36:21.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:36:21 smithi003 ceph-mon[108723]: pgmap v467: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:36:23.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:36:23 smithi192 ceph-mon[80326]: pgmap v468: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:36:23.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:36:23 smithi003 ceph-mon[108723]: pgmap v468: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:36:25.371 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:36:25 smithi003 ceph-mon[108723]: pgmap v469: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:36:25.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:36:25 smithi192 ceph-mon[80326]: pgmap v469: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:36:27.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:36:27 smithi192 ceph-mon[80326]: pgmap v470: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:36:27.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:36:27 smithi003 ceph-mon[108723]: pgmap v470: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:36:29.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:36:29 smithi192 ceph-mon[80326]: pgmap v471: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:36:29.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:36:29 smithi003 ceph-mon[108723]: pgmap v471: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:36:30.457 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:36:30 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:36:30.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:36:30 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:36:31.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:36:31 smithi192 ceph-mon[80326]: pgmap v472: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:36:31.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:36:31 smithi003 ceph-mon[108723]: pgmap v472: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:36:33.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:36:33 smithi192 ceph-mon[80326]: pgmap v473: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:36:33.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:36:33 smithi003 ceph-mon[108723]: pgmap v473: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:36:35.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:36:35 smithi192 ceph-mon[80326]: pgmap v474: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:36:35.544 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:36:35 smithi003 ceph-mon[108723]: pgmap v474: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:36:37.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:36:37 smithi192 ceph-mon[80326]: pgmap v475: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:36:37.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:36:37 smithi003 ceph-mon[108723]: pgmap v475: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:36:39.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:36:39 smithi192 ceph-mon[80326]: pgmap v476: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:36:39.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:36:39 smithi003 ceph-mon[108723]: pgmap v476: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:36:41.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:36:41 smithi192 ceph-mon[80326]: pgmap v477: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:36:41.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:36:41 smithi003 ceph-mon[108723]: pgmap v477: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:36:43.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:36:43 smithi192 ceph-mon[80326]: pgmap v478: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:36:43.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:36:43 smithi003 ceph-mon[108723]: pgmap v478: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:36:45.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:36:44 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:36:45.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:36:44 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:36:46.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:36:45 smithi192 ceph-mon[80326]: pgmap v479: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:36:46.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:36:45 smithi003 ceph-mon[108723]: pgmap v479: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:36:47.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:36:47 smithi192 ceph-mon[80326]: pgmap v480: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:36:47.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:36:47 smithi003 ceph-mon[108723]: pgmap v480: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:36:49.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:36:49 smithi192 ceph-mon[80326]: pgmap v481: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:36:49.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:36:49 smithi003 ceph-mon[108723]: pgmap v481: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:36:51.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:36:51 smithi192 ceph-mon[80326]: pgmap v482: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:36:51.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:36:51 smithi003 ceph-mon[108723]: pgmap v482: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:36:52.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:36:52 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:36:52.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:36:52 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config dump", "format": "json"} : dispatch 2024-09-21T12:36:53.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:36:53 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:36:53.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:36:53 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:36:53.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:36:53 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:36:53.757 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:36:53 smithi192 ceph-mon[80326]: pgmap v483: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:36:53.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:36:53 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "config generate-minimal-conf"} : dispatch 2024-09-21T12:36:53.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:36:53 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "auth get", "entity": "client.admin"} : dispatch 2024-09-21T12:36:53.829 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:36:53 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' 2024-09-21T12:36:53.830 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:36:53 smithi003 ceph-mon[108723]: pgmap v483: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:36:55.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:36:55 smithi192 ceph-mon[80326]: pgmap v484: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:36:55.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:36:55 smithi003 ceph-mon[108723]: pgmap v484: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:36:57.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:36:57 smithi192 ceph-mon[80326]: pgmap v485: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:36:57.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:36:57 smithi003 ceph-mon[108723]: pgmap v485: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:36:59.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:36:59 smithi192 ceph-mon[80326]: pgmap v486: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:36:59.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:36:59 smithi003 ceph-mon[108723]: pgmap v486: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:37:00.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:37:00 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:37:00.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:37:00 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:37:01.329 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:37:01 smithi003 ceph-mon[108723]: pgmap v487: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:37:01.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:37:01 smithi192 ceph-mon[80326]: pgmap v487: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:37:03.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:37:03 smithi192 ceph-mon[80326]: pgmap v488: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:37:03.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:37:03 smithi003 ceph-mon[108723]: pgmap v488: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:37:05.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:37:05 smithi192 ceph-mon[80326]: pgmap v489: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:37:05.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:37:05 smithi003 ceph-mon[108723]: pgmap v489: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:37:07.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:37:07 smithi192 ceph-mon[80326]: pgmap v490: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:37:07.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:37:07 smithi003 ceph-mon[108723]: pgmap v490: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:37:09.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:37:09 smithi192 ceph-mon[80326]: pgmap v491: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:37:09.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:37:09 smithi003 ceph-mon[108723]: pgmap v491: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:37:11.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:37:11 smithi192 ceph-mon[80326]: pgmap v492: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:37:11.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:37:11 smithi003 ceph-mon[108723]: pgmap v492: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:37:13.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:37:13 smithi192 ceph-mon[80326]: pgmap v493: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:37:13.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:37:13 smithi003 ceph-mon[108723]: pgmap v493: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:37:15.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:37:14 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:37:15.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:37:14 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:37:16.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:37:15 smithi192 ceph-mon[80326]: pgmap v494: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:37:16.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:37:15 smithi003 ceph-mon[108723]: pgmap v494: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:37:17.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:37:17 smithi192 ceph-mon[80326]: pgmap v495: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:37:17.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:37:17 smithi003 ceph-mon[108723]: pgmap v495: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:37:19.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:37:19 smithi192 ceph-mon[80326]: pgmap v496: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:37:19.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:37:19 smithi003 ceph-mon[108723]: pgmap v496: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:37:21.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:37:21 smithi192 ceph-mon[80326]: pgmap v497: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:37:21.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:37:21 smithi003 ceph-mon[108723]: pgmap v497: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:37:23.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:37:23 smithi192 ceph-mon[80326]: pgmap v498: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:37:23.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:37:23 smithi003 ceph-mon[108723]: pgmap v498: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:37:25.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:37:25 smithi192 ceph-mon[80326]: pgmap v499: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:37:25.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:37:25 smithi003 ceph-mon[108723]: pgmap v499: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:37:27.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:37:27 smithi192 ceph-mon[80326]: pgmap v500: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:37:27.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:37:27 smithi003 ceph-mon[108723]: pgmap v500: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:37:29.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:37:29 smithi192 ceph-mon[80326]: pgmap v501: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:37:29.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:37:29 smithi003 ceph-mon[108723]: pgmap v501: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:37:30.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:37:30 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:37:30.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:37:30 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:37:31.481 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:37:31 smithi003 ceph-mon[108723]: pgmap v502: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:37:31.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:37:31 smithi192 ceph-mon[80326]: pgmap v502: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:37:33.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:37:33 smithi192 ceph-mon[80326]: pgmap v503: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:37:33.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:37:33 smithi003 ceph-mon[108723]: pgmap v503: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:37:35.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:37:35 smithi192 ceph-mon[80326]: pgmap v504: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:37:35.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:37:35 smithi003 ceph-mon[108723]: pgmap v504: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:37:37.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:37:37 smithi192 ceph-mon[80326]: pgmap v505: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:37:37.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:37:37 smithi003 ceph-mon[108723]: pgmap v505: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:37:39.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:37:39 smithi192 ceph-mon[80326]: pgmap v506: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:37:39.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:37:39 smithi003 ceph-mon[108723]: pgmap v506: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:37:41.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:37:41 smithi192 ceph-mon[80326]: pgmap v507: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:37:41.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:37:41 smithi003 ceph-mon[108723]: pgmap v507: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:37:43.507 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:37:43 smithi192 ceph-mon[80326]: pgmap v508: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:37:43.579 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:37:43 smithi003 ceph-mon[108723]: pgmap v508: 65 pgs: 65 active+clean; 276 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-09-21T12:37:44.910 ERROR:tasks.cephfs.fuse_mount:process failed to terminate after unmount. This probably indicates a bug within ceph-fuse. 2024-09-21T12:37:44.911 ERROR:teuthology.run_tasks:Manager failed: ceph-fuse Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_5c1cdc3c470dae78e91a0ed2bcf13509a046d301/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_5c1cdc3c470dae78e91a0ed2bcf13509a046d301/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-21T12:37:44.912 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-21T12:37:44.923 INFO:tasks.cephadm:Teardown begin 2024-09-21T12:37:44.923 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_5c1cdc3c470dae78e91a0ed2bcf13509a046d301/qa/tasks/cephadm.py", line 2374, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_5c1cdc3c470dae78e91a0ed2bcf13509a046d301/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_5c1cdc3c470dae78e91a0ed2bcf13509a046d301/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-21T12:37:44.925 DEBUG:teuthology.orchestra.run.smithi003:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T12:37:44.959 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T12:37:44.992 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-21T12:37:44.992 DEBUG:teuthology.orchestra.run.smithi003:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T12:37:45.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:37:44 smithi192 ceph-mon[80326]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:37:45.018 DEBUG:teuthology.orchestra.run.smithi192:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-21T12:37:45.036 INFO:tasks.cephadm:Stopping all daemons... 2024-09-21T12:37:45.036 INFO:tasks.cephadm.mon.smithi003:Stopping mon.smithi003... 2024-09-21T12:37:45.036 DEBUG:teuthology.orchestra.run.smithi003:> sudo systemctl stop ceph-641beec0-7812-11ef-baf6-efdc52797490@mon.smithi003 2024-09-21T12:37:45.079 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:37:44 smithi003 ceph-mon[108723]: from='mgr.14756 172.21.15.3:0/3208614883' entity='mgr.smithi003.wztftl' cmd={"prefix": "osd blocklist ls", "format": "json"} : dispatch 2024-09-21T12:37:45.351 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:37:45 smithi003 systemd[1]: Stopping Ceph mon.smithi003 for 641beec0-7812-11ef-baf6-efdc52797490... 2024-09-21T12:37:45.659 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:37:45 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-mon-smithi003[108719]: 2024-09-21T12:37:45.350+0000 7f794d60c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi003 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T12:37:45.659 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:37:45 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-mon-smithi003[108719]: 2024-09-21T12:37:45.350+0000 7f794d60c640 -1 mon.smithi003@0(leader) e2 *** Got Signal Terminated *** 2024-09-21T12:37:45.659 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:37:45 smithi003 podman[149866]: 2024-09-21 12:37:45.534639133 +0000 UTC m=+0.281689269 container died 4f2b2b2daf19a7576f564282b324a7e3a2d0bc644f7040d0aa279b2089d24874 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-mon-smithi003, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-21T12:37:46.286 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:37:45 smithi003 podman[149866]: 2024-09-21 12:37:45.959205241 +0000 UTC m=+0.706255376 container cleanup 4f2b2b2daf19a7576f564282b324a7e3a2d0bc644f7040d0aa279b2089d24874 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-mon-smithi003, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T12:37:46.287 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:37:45 smithi003 bash[149866]: ceph-641beec0-7812-11ef-baf6-efdc52797490-mon-smithi003 2024-09-21T12:37:46.537 DEBUG:teuthology.orchestra.run.smithi003:> sudo pkill -f 'journalctl -f -n 0 -u ceph-641beec0-7812-11ef-baf6-efdc52797490@mon.smithi003.service' 2024-09-21T12:37:46.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:37:46 smithi003 podman[149878]: 2024-09-21 12:37:46.285910786 +0000 UTC m=+0.747496553 container remove 4f2b2b2daf19a7576f564282b324a7e3a2d0bc644f7040d0aa279b2089d24874 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-mon-smithi003, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T12:37:46.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:37:46 smithi003 systemd[1]: ceph-641beec0-7812-11ef-baf6-efdc52797490@mon.smithi003.service: Deactivated successfully. 2024-09-21T12:37:46.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:37:46 smithi003 systemd[1]: Stopped Ceph mon.smithi003 for 641beec0-7812-11ef-baf6-efdc52797490. 2024-09-21T12:37:46.580 INFO:journalctl@ceph.mon.smithi003.smithi003.stdout:Sep 21 12:37:46 smithi003 systemd[1]: ceph-641beec0-7812-11ef-baf6-efdc52797490@mon.smithi003.service: Consumed 9.977s CPU time. 2024-09-21T12:37:46.626 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T12:37:46.627 INFO:tasks.cephadm.mon.smithi003:Stopped mon.smithi003 2024-09-21T12:37:46.627 INFO:tasks.cephadm.mon.smithi192:Stopping mon.smithi192... 2024-09-21T12:37:46.627 DEBUG:teuthology.orchestra.run.smithi192:> sudo systemctl stop ceph-641beec0-7812-11ef-baf6-efdc52797490@mon.smithi192 2024-09-21T12:37:46.938 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:37:46 smithi192 systemd[1]: Stopping Ceph mon.smithi192 for 641beec0-7812-11ef-baf6-efdc52797490... 2024-09-21T12:37:47.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:37:46 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-mon-smithi192[80322]: 2024-09-21T12:37:46.936+0000 7f10a00b3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi192 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T12:37:47.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:37:46 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-mon-smithi192[80322]: 2024-09-21T12:37:46.936+0000 7f10a00b3640 -1 mon.smithi192@1(peon) e2 *** Got Signal Terminated *** 2024-09-21T12:37:47.257 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:37:47 smithi192 podman[113578]: 2024-09-21 12:37:47.171689524 +0000 UTC m=+0.344274450 container died 11edc5c1baba1a058459f81ba7a38375f20d4812b187b9ad298f4da49159a0f5 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-mon-smithi192, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2) 2024-09-21T12:37:48.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:37:47 smithi192 podman[113578]: 2024-09-21 12:37:47.72945481 +0000 UTC m=+0.902039724 container cleanup 11edc5c1baba1a058459f81ba7a38375f20d4812b187b9ad298f4da49159a0f5 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-mon-smithi192, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-21T12:37:48.007 INFO:journalctl@ceph.mon.smithi192.smithi192.stdout:Sep 21 12:37:47 smithi192 bash[113578]: ceph-641beec0-7812-11ef-baf6-efdc52797490-mon-smithi192 2024-09-21T12:37:48.176 DEBUG:teuthology.orchestra.run.smithi192:> sudo pkill -f 'journalctl -f -n 0 -u ceph-641beec0-7812-11ef-baf6-efdc52797490@mon.smithi192.service' 2024-09-21T12:37:48.220 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T12:37:48.221 INFO:tasks.cephadm.mon.smithi192:Stopped mon.smithi192 2024-09-21T12:37:48.221 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-21T12:37:48.221 DEBUG:teuthology.orchestra.run.smithi003:> sudo systemctl stop ceph-641beec0-7812-11ef-baf6-efdc52797490@osd.0 2024-09-21T12:37:48.540 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:37:48 smithi003 systemd[1]: Stopping Ceph osd.0 for 641beec0-7812-11ef-baf6-efdc52797490... 2024-09-21T12:37:48.829 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:37:48 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-0[117249]: 2024-09-21T12:37:48.538+0000 7f747bd14640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T12:37:48.829 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:37:48 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-0[117249]: 2024-09-21T12:37:48.538+0000 7f747bd14640 -1 osd.0 81 *** Got signal Terminated *** 2024-09-21T12:37:48.829 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:37:48 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-0[117249]: 2024-09-21T12:37:48.538+0000 7f747bd14640 -1 osd.0 81 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T12:37:54.329 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:37:54 smithi003 podman[150001]: 2024-09-21 12:37:54.076735577 +0000 UTC m=+5.657171252 container died 0f2234f333eccf3398f01842fad43f70bae9b4fd5c26c96a4a3c4c18589f369e (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-21T12:37:54.733 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:37:54 smithi003 podman[150001]: 2024-09-21 12:37:54.48870505 +0000 UTC m=+6.069140691 container cleanup 0f2234f333eccf3398f01842fad43f70bae9b4fd5c26c96a4a3c4c18589f369e (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-21T12:37:54.733 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:37:54 smithi003 bash[150001]: ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-0 2024-09-21T12:37:55.079 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:37:54 smithi003 podman[150018]: 2024-09-21 12:37:54.73223755 +0000 UTC m=+0.642926626 container remove 0f2234f333eccf3398f01842fad43f70bae9b4fd5c26c96a4a3c4c18589f369e (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-0, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2) 2024-09-21T12:37:55.445 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:37:55 smithi003 podman[150108]: 2024-09-21 12:37:55.086519181 +0000 UTC m=+0.017410433 image pull 8f4d013db793795fef09ff5edf96e6b42ba8cd2c9158b2f0b7a5d7c1e657c063 quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 2024-09-21T12:37:55.445 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:37:55 smithi003 podman[150108]: 2024-09-21 12:37:55.199845604 +0000 UTC m=+0.130736850 container create b1baae3eec404c78c01ba64bf76769ef056ab731866dc84b33454832fcaf5cf5 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-0-deactivate, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-21T12:37:55.445 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:37:55 smithi003 podman[150108]: 2024-09-21 12:37:55.444196155 +0000 UTC m=+0.375087392 container init b1baae3eec404c78c01ba64bf76769ef056ab731866dc84b33454832fcaf5cf5 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-0-deactivate, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-21T12:37:55.829 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:37:55 smithi003 podman[150108]: 2024-09-21 12:37:55.448196592 +0000 UTC m=+0.379087841 container start b1baae3eec404c78c01ba64bf76769ef056ab731866dc84b33454832fcaf5cf5 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-0-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-21T12:37:55.829 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:37:55 smithi003 podman[150108]: 2024-09-21 12:37:55.544150621 +0000 UTC m=+0.475041858 container attach b1baae3eec404c78c01ba64bf76769ef056ab731866dc84b33454832fcaf5cf5 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-0-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731) 2024-09-21T12:37:55.829 INFO:journalctl@ceph.osd.0.smithi003.stdout:Sep 21 12:37:55 smithi003 podman[150108]: 2024-09-21 12:37:55.651898494 +0000 UTC m=+0.582789741 container died b1baae3eec404c78c01ba64bf76769ef056ab731866dc84b33454832fcaf5cf5 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-0-deactivate, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=) 2024-09-21T12:37:56.416 DEBUG:teuthology.orchestra.run.smithi003:> sudo pkill -f 'journalctl -f -n 0 -u ceph-641beec0-7812-11ef-baf6-efdc52797490@osd.0.service' 2024-09-21T12:37:56.463 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T12:37:56.463 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-21T12:37:56.463 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-21T12:37:56.463 DEBUG:teuthology.orchestra.run.smithi003:> sudo systemctl stop ceph-641beec0-7812-11ef-baf6-efdc52797490@osd.1 2024-09-21T12:37:56.579 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:37:56 smithi003 systemd[1]: Stopping Ceph osd.1 for 641beec0-7812-11ef-baf6-efdc52797490... 2024-09-21T12:37:57.079 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:37:56 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-1[122588]: 2024-09-21T12:37:56.793+0000 7f700b522640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T12:37:57.079 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:37:56 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-1[122588]: 2024-09-21T12:37:56.793+0000 7f700b522640 -1 osd.1 81 *** Got signal Terminated *** 2024-09-21T12:37:57.079 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:37:56 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-1[122588]: 2024-09-21T12:37:56.793+0000 7f700b522640 -1 osd.1 81 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T12:38:02.479 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:38:02 smithi003 podman[150211]: 2024-09-21 12:38:02.21284591 +0000 UTC m=+5.547434947 container died 198ba21d051848d81e773372782a2cbdd1466f05669932b5584bbfc115902802 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-1, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, ceph=True) 2024-09-21T12:38:02.829 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:38:02 smithi003 podman[150211]: 2024-09-21 12:38:02.584652112 +0000 UTC m=+5.919241148 container cleanup 198ba21d051848d81e773372782a2cbdd1466f05669932b5584bbfc115902802 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-1, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-21T12:38:02.829 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:38:02 smithi003 bash[150211]: ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-1 2024-09-21T12:38:03.228 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:38:02 smithi003 podman[150239]: 2024-09-21 12:38:02.869230292 +0000 UTC m=+0.651446334 container remove 198ba21d051848d81e773372782a2cbdd1466f05669932b5584bbfc115902802 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-1, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-21T12:38:03.540 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:38:03 smithi003 podman[150325]: 2024-09-21 12:38:03.130475221 +0000 UTC m=+0.017149772 image pull 8f4d013db793795fef09ff5edf96e6b42ba8cd2c9158b2f0b7a5d7c1e657c063 quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 2024-09-21T12:38:03.540 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:38:03 smithi003 podman[150325]: 2024-09-21 12:38:03.245442935 +0000 UTC m=+0.132117519 container create 3c40c89f361b32919d00fdab09714617577a9ef1722f48ef89759ac06f3b749d (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-1-deactivate, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-21T12:38:03.540 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:38:03 smithi003 podman[150325]: 2024-09-21 12:38:03.456625645 +0000 UTC m=+0.343300196 container init 3c40c89f361b32919d00fdab09714617577a9ef1722f48ef89759ac06f3b749d (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-1-deactivate, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T12:38:03.540 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:38:03 smithi003 podman[150325]: 2024-09-21 12:38:03.460212167 +0000 UTC m=+0.346886709 container start 3c40c89f361b32919d00fdab09714617577a9ef1722f48ef89759ac06f3b749d (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-1-deactivate, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-21T12:38:03.540 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:38:03 smithi003 podman[150325]: 2024-09-21 12:38:03.53950613 +0000 UTC m=+0.426180677 container attach 3c40c89f361b32919d00fdab09714617577a9ef1722f48ef89759ac06f3b749d (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-21T12:38:03.829 INFO:journalctl@ceph.osd.1.smithi003.stdout:Sep 21 12:38:03 smithi003 podman[150325]: 2024-09-21 12:38:03.655682521 +0000 UTC m=+0.542357070 container died 3c40c89f361b32919d00fdab09714617577a9ef1722f48ef89759ac06f3b749d (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-1-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T12:38:04.306 DEBUG:teuthology.orchestra.run.smithi003:> sudo pkill -f 'journalctl -f -n 0 -u ceph-641beec0-7812-11ef-baf6-efdc52797490@osd.1.service' 2024-09-21T12:38:04.349 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T12:38:04.350 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-21T12:38:04.350 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-21T12:38:04.350 DEBUG:teuthology.orchestra.run.smithi003:> sudo systemctl stop ceph-641beec0-7812-11ef-baf6-efdc52797490@osd.2 2024-09-21T12:38:04.579 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:38:04 smithi003 systemd[1]: Stopping Ceph osd.2 for 641beec0-7812-11ef-baf6-efdc52797490... 2024-09-21T12:38:05.079 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:38:04 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-2[128187]: 2024-09-21T12:38:04.704+0000 7f46680b7640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T12:38:05.079 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:38:04 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-2[128187]: 2024-09-21T12:38:04.704+0000 7f46680b7640 -1 osd.2 81 *** Got signal Terminated *** 2024-09-21T12:38:05.079 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:38:04 smithi003 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-2[128187]: 2024-09-21T12:38:04.704+0000 7f46680b7640 -1 osd.2 81 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T12:38:10.389 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:38:10 smithi003 podman[150430]: 2024-09-21 12:38:10.102166907 +0000 UTC m=+5.512459069 container died e630341e13d42b1dd592c7d5af862d9c3ba31b208e91b9d7aea828e79c7e60a2 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-2, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-21T12:38:10.773 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:38:10 smithi003 podman[150430]: 2024-09-21 12:38:10.487515083 +0000 UTC m=+5.897807245 container cleanup e630341e13d42b1dd592c7d5af862d9c3ba31b208e91b9d7aea828e79c7e60a2 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-21T12:38:10.774 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:38:10 smithi003 bash[150430]: ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-2 2024-09-21T12:38:11.079 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:38:10 smithi003 podman[150446]: 2024-09-21 12:38:10.772415885 +0000 UTC m=+0.665294788 container remove e630341e13d42b1dd592c7d5af862d9c3ba31b208e91b9d7aea828e79c7e60a2 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-21T12:38:11.375 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:38:11 smithi003 podman[150531]: 2024-09-21 12:38:11.025865539 +0000 UTC m=+0.017209013 image pull 8f4d013db793795fef09ff5edf96e6b42ba8cd2c9158b2f0b7a5d7c1e657c063 quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 2024-09-21T12:38:11.375 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:38:11 smithi003 podman[150531]: 2024-09-21 12:38:11.131731307 +0000 UTC m=+0.123074761 container create a97865500182994391a4cf4611a0a7aa52f5a9cc2420d6139c38adfb2754da44 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-2-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-21T12:38:11.375 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:38:11 smithi003 podman[150531]: 2024-09-21 12:38:11.359436796 +0000 UTC m=+0.350780273 container init a97865500182994391a4cf4611a0a7aa52f5a9cc2420d6139c38adfb2754da44 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-2-deactivate, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T12:38:11.376 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:38:11 smithi003 podman[150531]: 2024-09-21 12:38:11.364282297 +0000 UTC m=+0.355625759 container start a97865500182994391a4cf4611a0a7aa52f5a9cc2420d6139c38adfb2754da44 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-2-deactivate, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_CLEAN=True) 2024-09-21T12:38:11.829 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:38:11 smithi003 podman[150531]: 2024-09-21 12:38:11.476112374 +0000 UTC m=+0.467455850 container attach a97865500182994391a4cf4611a0a7aa52f5a9cc2420d6139c38adfb2754da44 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-2-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, ceph=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-21T12:38:11.829 INFO:journalctl@ceph.osd.2.smithi003.stdout:Sep 21 12:38:11 smithi003 podman[150531]: 2024-09-21 12:38:11.569243005 +0000 UTC m=+0.560586464 container died a97865500182994391a4cf4611a0a7aa52f5a9cc2420d6139c38adfb2754da44 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-2-deactivate, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-21T12:38:12.162 DEBUG:teuthology.orchestra.run.smithi003:> sudo pkill -f 'journalctl -f -n 0 -u ceph-641beec0-7812-11ef-baf6-efdc52797490@osd.2.service' 2024-09-21T12:38:12.201 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T12:38:12.202 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-21T12:38:12.202 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-21T12:38:12.202 DEBUG:teuthology.orchestra.run.smithi192:> sudo systemctl stop ceph-641beec0-7812-11ef-baf6-efdc52797490@osd.3 2024-09-21T12:38:12.501 INFO:journalctl@ceph.osd.3.smithi192.stdout:Sep 21 12:38:12 smithi192 systemd[1]: Stopping Ceph osd.3 for 641beec0-7812-11ef-baf6-efdc52797490... 2024-09-21T12:38:12.757 INFO:journalctl@ceph.osd.3.smithi192.stdout:Sep 21 12:38:12 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-3[88249]: 2024-09-21T12:38:12.499+0000 7f1fc20fa640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T12:38:12.757 INFO:journalctl@ceph.osd.3.smithi192.stdout:Sep 21 12:38:12 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-3[88249]: 2024-09-21T12:38:12.499+0000 7f1fc20fa640 -1 osd.3 81 *** Got signal Terminated *** 2024-09-21T12:38:12.757 INFO:journalctl@ceph.osd.3.smithi192.stdout:Sep 21 12:38:12 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-3[88249]: 2024-09-21T12:38:12.499+0000 7f1fc20fa640 -1 osd.3 81 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T12:38:16.507 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:38:16 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-4[92979]: 2024-09-21T12:38:16.188+0000 7fe045342640 -1 osd.4 81 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-21T12:37:52.644099+0000 front 2024-09-21T12:37:52.644238+0000 (oldest deadline 2024-09-21T12:38:15.544254+0000) 2024-09-21T12:38:16.508 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:38:16 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-5[97727]: 2024-09-21T12:38:16.130+0000 7f4b5e30c640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-21T12:37:49.912381+0000 front 2024-09-21T12:37:49.912360+0000 (oldest deadline 2024-09-21T12:38:15.212263+0000) 2024-09-21T12:38:17.507 INFO:journalctl@ceph.osd.3.smithi192.stdout:Sep 21 12:38:17 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-3[88249]: 2024-09-21T12:38:17.224+0000 7f1fba707640 -1 osd.3 81 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-21T12:37:53.352894+0000 front 2024-09-21T12:37:53.352772+0000 (oldest deadline 2024-09-21T12:38:16.252796+0000) 2024-09-21T12:38:17.508 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:38:17 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-4[92979]: 2024-09-21T12:38:17.207+0000 7fe045342640 -1 osd.4 81 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-21T12:37:52.644099+0000 front 2024-09-21T12:37:52.644238+0000 (oldest deadline 2024-09-21T12:38:15.544254+0000) 2024-09-21T12:38:17.508 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:38:17 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-5[97727]: 2024-09-21T12:38:17.097+0000 7f4b5e30c640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-21T12:37:49.912381+0000 front 2024-09-21T12:37:49.912360+0000 (oldest deadline 2024-09-21T12:38:15.212263+0000) 2024-09-21T12:38:18.199 INFO:journalctl@ceph.osd.3.smithi192.stdout:Sep 21 12:38:17 smithi192 podman[113710]: 2024-09-21 12:38:17.930277429 +0000 UTC m=+5.541361264 container died 1b5fae2f2dd9a6890b335f3a54d25c770a77b2fac0a58e5cf698f2de43787c50 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-3, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.license=GPLv2, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-21T12:38:18.200 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:38:18 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-5[97727]: 2024-09-21T12:38:18.120+0000 7f4b5e30c640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-21T12:37:49.912381+0000 front 2024-09-21T12:37:49.912360+0000 (oldest deadline 2024-09-21T12:38:15.212263+0000) 2024-09-21T12:38:18.508 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:38:18 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-4[92979]: 2024-09-21T12:38:18.197+0000 7fe045342640 -1 osd.4 81 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-21T12:37:52.644099+0000 front 2024-09-21T12:37:52.644238+0000 (oldest deadline 2024-09-21T12:38:15.544254+0000) 2024-09-21T12:38:18.508 INFO:journalctl@ceph.osd.3.smithi192.stdout:Sep 21 12:38:18 smithi192 podman[113710]: 2024-09-21 12:38:18.366687564 +0000 UTC m=+5.977771398 container cleanup 1b5fae2f2dd9a6890b335f3a54d25c770a77b2fac0a58e5cf698f2de43787c50 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-3, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T12:38:18.508 INFO:journalctl@ceph.osd.3.smithi192.stdout:Sep 21 12:38:18 smithi192 bash[113710]: ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-3 2024-09-21T12:38:18.993 INFO:journalctl@ceph.osd.3.smithi192.stdout:Sep 21 12:38:18 smithi192 podman[113731]: 2024-09-21 12:38:18.56001186 +0000 UTC m=+0.621895110 container remove 1b5fae2f2dd9a6890b335f3a54d25c770a77b2fac0a58e5cf698f2de43787c50 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-3, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True) 2024-09-21T12:38:19.257 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:38:19 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-4[92979]: 2024-09-21T12:38:19.190+0000 7fe045342640 -1 osd.4 81 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-21T12:37:52.644099+0000 front 2024-09-21T12:37:52.644238+0000 (oldest deadline 2024-09-21T12:38:15.544254+0000) 2024-09-21T12:38:19.257 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:38:19 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-5[97727]: 2024-09-21T12:38:19.081+0000 7f4b5e30c640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-21T12:37:49.912381+0000 front 2024-09-21T12:37:49.912360+0000 (oldest deadline 2024-09-21T12:38:15.212263+0000) 2024-09-21T12:38:19.258 INFO:journalctl@ceph.osd.3.smithi192.stdout:Sep 21 12:38:18 smithi192 podman[113818]: 2024-09-21 12:38:18.895096482 +0000 UTC m=+0.015923497 image pull 8f4d013db793795fef09ff5edf96e6b42ba8cd2c9158b2f0b7a5d7c1e657c063 quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 2024-09-21T12:38:19.258 INFO:journalctl@ceph.osd.3.smithi192.stdout:Sep 21 12:38:19 smithi192 podman[113818]: 2024-09-21 12:38:19.002616885 +0000 UTC m=+0.123443930 container create 4c4b549a69a9ce582bec44b42075f97675cd9ad093f583fdff86bb3fb7f9c60d (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-3-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-21T12:38:19.258 INFO:journalctl@ceph.osd.3.smithi192.stdout:Sep 21 12:38:19 smithi192 podman[113818]: 2024-09-21 12:38:19.238540724 +0000 UTC m=+0.359367729 container init 4c4b549a69a9ce582bec44b42075f97675cd9ad093f583fdff86bb3fb7f9c60d (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-3-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True) 2024-09-21T12:38:19.258 INFO:journalctl@ceph.osd.3.smithi192.stdout:Sep 21 12:38:19 smithi192 podman[113818]: 2024-09-21 12:38:19.242013524 +0000 UTC m=+0.362840527 container start 4c4b549a69a9ce582bec44b42075f97675cd9ad093f583fdff86bb3fb7f9c60d (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-3-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T12:38:19.743 INFO:journalctl@ceph.osd.3.smithi192.stdout:Sep 21 12:38:19 smithi192 podman[113818]: 2024-09-21 12:38:19.364014316 +0000 UTC m=+0.484841319 container attach 4c4b549a69a9ce582bec44b42075f97675cd9ad093f583fdff86bb3fb7f9c60d (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-3-deactivate, ceph=True, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-21T12:38:19.743 INFO:journalctl@ceph.osd.3.smithi192.stdout:Sep 21 12:38:19 smithi192 podman[113818]: 2024-09-21 12:38:19.437533429 +0000 UTC m=+0.558360439 container died 4c4b549a69a9ce582bec44b42075f97675cd9ad093f583fdff86bb3fb7f9c60d (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-3-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-21T12:38:20.052 DEBUG:teuthology.orchestra.run.smithi192:> sudo pkill -f 'journalctl -f -n 0 -u ceph-641beec0-7812-11ef-baf6-efdc52797490@osd.3.service' 2024-09-21T12:38:20.092 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T12:38:20.092 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-21T12:38:20.092 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-21T12:38:20.092 DEBUG:teuthology.orchestra.run.smithi192:> sudo systemctl stop ceph-641beec0-7812-11ef-baf6-efdc52797490@osd.4 2024-09-21T12:38:20.423 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:38:20 smithi192 systemd[1]: Stopping Ceph osd.4 for 641beec0-7812-11ef-baf6-efdc52797490... 2024-09-21T12:38:20.423 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:38:20 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-4[92979]: 2024-09-21T12:38:20.206+0000 7fe045342640 -1 osd.4 81 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-21T12:37:52.644099+0000 front 2024-09-21T12:37:52.644238+0000 (oldest deadline 2024-09-21T12:38:15.544254+0000) 2024-09-21T12:38:20.423 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:38:20 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-4[92979]: 2024-09-21T12:38:20.421+0000 7fe04cd35640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T12:38:20.423 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:38:20 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-4[92979]: 2024-09-21T12:38:20.421+0000 7fe04cd35640 -1 osd.4 81 *** Got signal Terminated *** 2024-09-21T12:38:20.423 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:38:20 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-4[92979]: 2024-09-21T12:38:20.421+0000 7fe04cd35640 -1 osd.4 81 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T12:38:20.424 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:38:20 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-5[97727]: 2024-09-21T12:38:20.055+0000 7f4b5e30c640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-21T12:37:49.912381+0000 front 2024-09-21T12:37:49.912360+0000 (oldest deadline 2024-09-21T12:38:15.212263+0000) 2024-09-21T12:38:21.442 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:38:21 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-4[92979]: 2024-09-21T12:38:21.163+0000 7fe045342640 -1 osd.4 81 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-21T12:37:52.644099+0000 front 2024-09-21T12:37:52.644238+0000 (oldest deadline 2024-09-21T12:38:15.544254+0000) 2024-09-21T12:38:21.442 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:38:21 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-5[97727]: 2024-09-21T12:38:21.075+0000 7f4b5e30c640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-21T12:37:49.912381+0000 front 2024-09-21T12:37:49.912360+0000 (oldest deadline 2024-09-21T12:38:15.212263+0000) 2024-09-21T12:38:22.508 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:38:22 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-4[92979]: 2024-09-21T12:38:22.206+0000 7fe045342640 -1 osd.4 81 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-21T12:37:52.644099+0000 front 2024-09-21T12:37:52.644238+0000 (oldest deadline 2024-09-21T12:38:15.544254+0000) 2024-09-21T12:38:22.508 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:38:22 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-5[97727]: 2024-09-21T12:38:22.052+0000 7f4b5e30c640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-21T12:37:49.912381+0000 front 2024-09-21T12:37:49.912360+0000 (oldest deadline 2024-09-21T12:38:15.212263+0000) 2024-09-21T12:38:23.507 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:38:23 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-4[92979]: 2024-09-21T12:38:23.212+0000 7fe045342640 -1 osd.4 81 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-21T12:37:52.644099+0000 front 2024-09-21T12:37:52.644238+0000 (oldest deadline 2024-09-21T12:38:15.544254+0000) 2024-09-21T12:38:23.508 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:38:23 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-5[97727]: 2024-09-21T12:38:23.008+0000 7f4b5e30c640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-21T12:37:49.912381+0000 front 2024-09-21T12:37:49.912360+0000 (oldest deadline 2024-09-21T12:38:15.212263+0000) 2024-09-21T12:38:24.257 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:38:24 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-4[92979]: 2024-09-21T12:38:24.198+0000 7fe045342640 -1 osd.4 81 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-21T12:37:52.644099+0000 front 2024-09-21T12:37:52.644238+0000 (oldest deadline 2024-09-21T12:38:15.544254+0000) 2024-09-21T12:38:24.257 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:38:24 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-5[97727]: 2024-09-21T12:38:23.999+0000 7f4b5e30c640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-21T12:37:49.912381+0000 front 2024-09-21T12:37:49.912360+0000 (oldest deadline 2024-09-21T12:38:15.212263+0000) 2024-09-21T12:38:25.244 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:38:24 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-5[97727]: 2024-09-21T12:38:24.955+0000 7f4b5e30c640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-21T12:37:49.912381+0000 front 2024-09-21T12:37:49.912360+0000 (oldest deadline 2024-09-21T12:38:15.212263+0000) 2024-09-21T12:38:25.245 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:38:24 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-5[97727]: 2024-09-21T12:38:24.955+0000 7f4b5e30c640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.3:6814 osd.1 since back 2024-09-21T12:38:00.513193+0000 front 2024-09-21T12:38:00.513128+0000 (oldest deadline 2024-09-21T12:38:24.012958+0000) 2024-09-21T12:38:25.507 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:38:25 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-4[92979]: 2024-09-21T12:38:25.242+0000 7fe045342640 -1 osd.4 81 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-21T12:37:52.644099+0000 front 2024-09-21T12:37:52.644238+0000 (oldest deadline 2024-09-21T12:38:15.544254+0000) 2024-09-21T12:38:26.140 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:38:25 smithi192 podman[113922]: 2024-09-21 12:38:25.825393917 +0000 UTC m=+5.511805590 container died 5b1bd4bec479fd230f88b04a4e822dc0c3d24796ea8bf288e37c05de8d63a564 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-4, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T12:38:26.141 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:38:25 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-5[97727]: 2024-09-21T12:38:25.938+0000 7f4b5e30c640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-21T12:37:49.912381+0000 front 2024-09-21T12:37:49.912360+0000 (oldest deadline 2024-09-21T12:38:15.212263+0000) 2024-09-21T12:38:26.141 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:38:25 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-5[97727]: 2024-09-21T12:38:25.938+0000 7f4b5e30c640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.3:6814 osd.1 since back 2024-09-21T12:38:00.513193+0000 front 2024-09-21T12:38:00.513128+0000 (oldest deadline 2024-09-21T12:38:24.012958+0000) 2024-09-21T12:38:26.424 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:38:26 smithi192 podman[113922]: 2024-09-21 12:38:26.246352019 +0000 UTC m=+5.932763691 container cleanup 5b1bd4bec479fd230f88b04a4e822dc0c3d24796ea8bf288e37c05de8d63a564 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-4, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS) 2024-09-21T12:38:26.424 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:38:26 smithi192 bash[113922]: ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-4 2024-09-21T12:38:26.757 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:38:26 smithi192 podman[113937]: 2024-09-21 12:38:26.423083581 +0000 UTC m=+0.594707204 container remove 5b1bd4bec479fd230f88b04a4e822dc0c3d24796ea8bf288e37c05de8d63a564 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-4, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-21T12:38:27.177 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:38:26 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-5[97727]: 2024-09-21T12:38:26.961+0000 7f4b5e30c640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-21T12:37:49.912381+0000 front 2024-09-21T12:37:49.912360+0000 (oldest deadline 2024-09-21T12:38:15.212263+0000) 2024-09-21T12:38:27.177 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:38:26 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-5[97727]: 2024-09-21T12:38:26.961+0000 7f4b5e30c640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.3:6814 osd.1 since back 2024-09-21T12:38:00.513193+0000 front 2024-09-21T12:38:00.513128+0000 (oldest deadline 2024-09-21T12:38:24.012958+0000) 2024-09-21T12:38:27.177 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:38:26 smithi192 podman[114024]: 2024-09-21 12:38:26.767649856 +0000 UTC m=+0.016081974 image pull 8f4d013db793795fef09ff5edf96e6b42ba8cd2c9158b2f0b7a5d7c1e657c063 quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 2024-09-21T12:38:27.177 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:38:26 smithi192 podman[114024]: 2024-09-21 12:38:26.865579392 +0000 UTC m=+0.114011494 container create e3068d513d01f108c5b3bd56ccf92b8d096ea36b43e2a4b94d1d45bb23d21707 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-4-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T12:38:27.177 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:38:27 smithi192 podman[114024]: 2024-09-21 12:38:27.093355837 +0000 UTC m=+0.341787954 container init e3068d513d01f108c5b3bd56ccf92b8d096ea36b43e2a4b94d1d45bb23d21707 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-4-deactivate, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-21T12:38:27.177 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:38:27 smithi192 podman[114024]: 2024-09-21 12:38:27.096662866 +0000 UTC m=+0.345094974 container start e3068d513d01f108c5b3bd56ccf92b8d096ea36b43e2a4b94d1d45bb23d21707 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-4-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-21T12:38:27.178 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:38:27 smithi192 podman[114024]: 2024-09-21 12:38:27.176535525 +0000 UTC m=+0.424967642 container attach e3068d513d01f108c5b3bd56ccf92b8d096ea36b43e2a4b94d1d45bb23d21707 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-4-deactivate, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-21T12:38:27.507 INFO:journalctl@ceph.osd.4.smithi192.stdout:Sep 21 12:38:27 smithi192 podman[114024]: 2024-09-21 12:38:27.296363935 +0000 UTC m=+0.544796053 container died e3068d513d01f108c5b3bd56ccf92b8d096ea36b43e2a4b94d1d45bb23d21707 (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-4-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-21T12:38:27.949 DEBUG:teuthology.orchestra.run.smithi192:> sudo pkill -f 'journalctl -f -n 0 -u ceph-641beec0-7812-11ef-baf6-efdc52797490@osd.4.service' 2024-09-21T12:38:27.993 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T12:38:27.993 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-21T12:38:27.993 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-21T12:38:27.993 DEBUG:teuthology.orchestra.run.smithi192:> sudo systemctl stop ceph-641beec0-7812-11ef-baf6-efdc52797490@osd.5 2024-09-21T12:38:28.258 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:38:28 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-5[97727]: 2024-09-21T12:38:28.002+0000 7f4b5e30c640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-21T12:37:49.912381+0000 front 2024-09-21T12:37:49.912360+0000 (oldest deadline 2024-09-21T12:38:15.212263+0000) 2024-09-21T12:38:28.258 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:38:28 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-5[97727]: 2024-09-21T12:38:28.002+0000 7f4b5e30c640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.3:6814 osd.1 since back 2024-09-21T12:38:00.513193+0000 front 2024-09-21T12:38:00.513128+0000 (oldest deadline 2024-09-21T12:38:24.012958+0000) 2024-09-21T12:38:28.258 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:38:28 smithi192 systemd[1]: Stopping Ceph osd.5 for 641beec0-7812-11ef-baf6-efdc52797490... 2024-09-21T12:38:28.757 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:38:28 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-5[97727]: 2024-09-21T12:38:28.350+0000 7f4b65cff640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-21T12:38:28.757 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:38:28 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-5[97727]: 2024-09-21T12:38:28.350+0000 7f4b65cff640 -1 osd.5 81 *** Got signal Terminated *** 2024-09-21T12:38:28.757 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:38:28 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-5[97727]: 2024-09-21T12:38:28.350+0000 7f4b65cff640 -1 osd.5 81 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-21T12:38:29.257 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:38:28 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-5[97727]: 2024-09-21T12:38:28.972+0000 7f4b5e30c640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-21T12:37:49.912381+0000 front 2024-09-21T12:37:49.912360+0000 (oldest deadline 2024-09-21T12:38:15.212263+0000) 2024-09-21T12:38:29.257 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:38:28 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-5[97727]: 2024-09-21T12:38:28.972+0000 7f4b5e30c640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.3:6814 osd.1 since back 2024-09-21T12:38:00.513193+0000 front 2024-09-21T12:38:00.513128+0000 (oldest deadline 2024-09-21T12:38:24.012958+0000) 2024-09-21T12:38:30.257 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:38:29 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-5[97727]: 2024-09-21T12:38:29.963+0000 7f4b5e30c640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-21T12:37:49.912381+0000 front 2024-09-21T12:37:49.912360+0000 (oldest deadline 2024-09-21T12:38:15.212263+0000) 2024-09-21T12:38:30.258 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:38:29 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-5[97727]: 2024-09-21T12:38:29.963+0000 7f4b5e30c640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.3:6814 osd.1 since back 2024-09-21T12:38:00.513193+0000 front 2024-09-21T12:38:00.513128+0000 (oldest deadline 2024-09-21T12:38:24.012958+0000) 2024-09-21T12:38:31.257 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:38:30 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-5[97727]: 2024-09-21T12:38:30.991+0000 7f4b5e30c640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-21T12:37:49.912381+0000 front 2024-09-21T12:37:49.912360+0000 (oldest deadline 2024-09-21T12:38:15.212263+0000) 2024-09-21T12:38:31.257 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:38:30 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-5[97727]: 2024-09-21T12:38:30.991+0000 7f4b5e30c640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.3:6814 osd.1 since back 2024-09-21T12:38:00.513193+0000 front 2024-09-21T12:38:00.513128+0000 (oldest deadline 2024-09-21T12:38:24.012958+0000) 2024-09-21T12:38:32.257 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:38:31 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-5[97727]: 2024-09-21T12:38:31.991+0000 7f4b5e30c640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-21T12:37:49.912381+0000 front 2024-09-21T12:37:49.912360+0000 (oldest deadline 2024-09-21T12:38:15.212263+0000) 2024-09-21T12:38:32.257 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:38:31 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-5[97727]: 2024-09-21T12:38:31.991+0000 7f4b5e30c640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.3:6814 osd.1 since back 2024-09-21T12:38:00.513193+0000 front 2024-09-21T12:38:00.513128+0000 (oldest deadline 2024-09-21T12:38:24.012958+0000) 2024-09-21T12:38:33.257 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:38:32 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-5[97727]: 2024-09-21T12:38:32.964+0000 7f4b5e30c640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.3:6806 osd.0 since back 2024-09-21T12:37:49.912381+0000 front 2024-09-21T12:37:49.912360+0000 (oldest deadline 2024-09-21T12:38:15.212263+0000) 2024-09-21T12:38:33.258 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:38:32 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-5[97727]: 2024-09-21T12:38:32.964+0000 7f4b5e30c640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.3:6814 osd.1 since back 2024-09-21T12:38:00.513193+0000 front 2024-09-21T12:38:00.513128+0000 (oldest deadline 2024-09-21T12:38:24.012958+0000) 2024-09-21T12:38:33.258 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:38:32 smithi192 ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-5[97727]: 2024-09-21T12:38:32.964+0000 7f4b5e30c640 -1 osd.5 81 heartbeat_check: no reply from 172.21.15.3:6822 osd.2 since back 2024-09-21T12:38:08.014121+0000 front 2024-09-21T12:38:08.014182+0000 (oldest deadline 2024-09-21T12:38:32.113931+0000) 2024-09-21T12:38:33.977 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:38:33 smithi192 podman[114129]: 2024-09-21 12:38:33.718241122 +0000 UTC m=+5.501607637 container died 584f3f6124835b81677284187402f627c212bee436047c023f99a9fa2d56d60f (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-5, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, ceph=True, io.buildah.version=1.37.2) 2024-09-21T12:38:34.257 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:38:34 smithi192 podman[114129]: 2024-09-21 12:38:34.041624608 +0000 UTC m=+5.824991111 container cleanup 584f3f6124835b81677284187402f627c212bee436047c023f99a9fa2d56d60f (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T12:38:34.257 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:38:34 smithi192 bash[114129]: ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-5 2024-09-21T12:38:34.685 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:38:34 smithi192 podman[114146]: 2024-09-21 12:38:34.27645146 +0000 UTC m=+0.552080343 container remove 584f3f6124835b81677284187402f627c212bee436047c023f99a9fa2d56d60f (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-5, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=) 2024-09-21T12:38:34.989 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:38:34 smithi192 podman[114235]: 2024-09-21 12:38:34.587491113 +0000 UTC m=+0.016043194 image pull 8f4d013db793795fef09ff5edf96e6b42ba8cd2c9158b2f0b7a5d7c1e657c063 quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472 2024-09-21T12:38:34.989 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:38:34 smithi192 podman[114235]: 2024-09-21 12:38:34.693910379 +0000 UTC m=+0.122462448 container create 3d34c2e57004a9f31c5022cf78e8d11999783cd2645c506ae0677d8d88421e6f (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-5-deactivate, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T12:38:34.989 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:38:34 smithi192 podman[114235]: 2024-09-21 12:38:34.905029965 +0000 UTC m=+0.333582042 container init 3d34c2e57004a9f31c5022cf78e8d11999783cd2645c506ae0677d8d88421e6f (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-5-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T12:38:34.989 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:38:34 smithi192 podman[114235]: 2024-09-21 12:38:34.908606383 +0000 UTC m=+0.337158454 container start 3d34c2e57004a9f31c5022cf78e8d11999783cd2645c506ae0677d8d88421e6f (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-5-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.license=GPLv2, ceph=True) 2024-09-21T12:38:34.989 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:38:34 smithi192 podman[114235]: 2024-09-21 12:38:34.988246824 +0000 UTC m=+0.416798893 container attach 3d34c2e57004a9f31c5022cf78e8d11999783cd2645c506ae0677d8d88421e6f (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-5-deactivate, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-21T12:38:35.257 INFO:journalctl@ceph.osd.5.smithi192.stdout:Sep 21 12:38:35 smithi192 podman[114235]: 2024-09-21 12:38:35.092172107 +0000 UTC m=+0.520724194 container died 3d34c2e57004a9f31c5022cf78e8d11999783cd2645c506ae0677d8d88421e6f (image=quay.ceph.io/ceph-ci/ceph@sha256:3855b8c483c85027fea24c112434955a9e8e6f629214baaca7b99a8fabb55472, name=ceph-641beec0-7812-11ef-baf6-efdc52797490-osd-5-deactivate, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=wip-guits-main-2024-09-21-0813-5c1cdc3, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-21T12:38:35.664 DEBUG:teuthology.orchestra.run.smithi192:> sudo pkill -f 'journalctl -f -n 0 -u ceph-641beec0-7812-11ef-baf6-efdc52797490@osd.5.service' 2024-09-21T12:38:35.702 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-21T12:38:35.702 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-21T12:38:35.703 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 641beec0-7812-11ef-baf6-efdc52797490 --force --keep-logs 2024-09-21T12:38:35.918 INFO:teuthology.orchestra.run.smithi003.stdout:Deleting cluster with fsid: 641beec0-7812-11ef-baf6-efdc52797490 2024-09-21T12:38:40.287 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi003.stderr:ceph-fuse[76329]: fuse finished with error 0 and tester_r 0 2024-09-21T12:38:57.841 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 641beec0-7812-11ef-baf6-efdc52797490 --force --keep-logs 2024-09-21T12:38:58.044 INFO:teuthology.orchestra.run.smithi192.stdout:Deleting cluster with fsid: 641beec0-7812-11ef-baf6-efdc52797490 2024-09-21T12:39:11.173 DEBUG:teuthology.orchestra.run.smithi003:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T12:39:11.208 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-21T12:39:11.236 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-21T12:39:11.237 DEBUG:teuthology.misc:Transferring archived files from smithi003:/var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/crash to /home/teuthworker/archive/gabrioux-2024-09-21_10:07:29-orch:cephadm-wip-guits-main-2024-09-21-0813-distro-default-smithi/7913909/remote/smithi003/crash 2024-09-21T12:39:11.238 DEBUG:teuthology.orchestra.run.smithi003:> sudo tar c -f - -C /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/crash -- . 2024-09-21T12:39:11.277 INFO:teuthology.orchestra.run.smithi003.stderr:tar: /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T12:39:11.277 INFO:teuthology.orchestra.run.smithi003.stderr:tar: Error is not recoverable: exiting now 2024-09-21T12:39:11.278 DEBUG:teuthology.misc:Transferring archived files from smithi192:/var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/crash to /home/teuthworker/archive/gabrioux-2024-09-21_10:07:29-orch:cephadm-wip-guits-main-2024-09-21-0813-distro-default-smithi/7913909/remote/smithi192/crash 2024-09-21T12:39:11.279 DEBUG:teuthology.orchestra.run.smithi192:> sudo tar c -f - -C /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/crash -- . 2024-09-21T12:39:11.303 INFO:teuthology.orchestra.run.smithi192.stderr:tar: /var/lib/ceph/641beec0-7812-11ef-baf6-efdc52797490/crash: Cannot open: No such file or directory 2024-09-21T12:39:11.303 INFO:teuthology.orchestra.run.smithi192.stderr:tar: Error is not recoverable: exiting now 2024-09-21T12:39:11.304 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-21T12:39:11.305 DEBUG:teuthology.orchestra.run.smithi003:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/641beec0-7812-11ef-baf6-efdc52797490/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-21T12:39:11.356 INFO:tasks.cephadm:Compressing logs... 2024-09-21T12:39:11.356 DEBUG:teuthology.orchestra.run.smithi003:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T12:39:11.399 DEBUG:teuthology.orchestra.run.smithi192:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-21T12:39:11.424 INFO:teuthology.orchestra.run.smithi003.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/641beec0-7812-11ef-baf6-efdc52797490/ceph-osd.0.log 2024-09-21T12:39:11.424 INFO:teuthology.orchestra.run.smithi003.stderr:: No such file or directory 2024-09-21T12:39:11.424 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/641beec0-7812-11ef-baf6-efdc52797490/ceph-osd.1.log 2024-09-21T12:39:11.424 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/641beec0-7812-11ef-baf6-efdc52797490/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/641beec0-7812-11ef-baf6-efdc52797490/ceph-mds.cephfs.smithi003.ebjgyl.log 2024-09-21T12:39:11.425 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/641beec0-7812-11ef-baf6-efdc52797490/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/641beec0-7812-11ef-baf6-efdc52797490/ceph-volume.log 2024-09-21T12:39:11.425 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/641beec0-7812-11ef-baf6-efdc52797490/ceph-mds.cephfs.smithi003.ebjgyl.log: gzip -5 --verbose -- /var/log/ceph/641beec0-7812-11ef-baf6-efdc52797490/ceph-mgr.smithi003.wztftl.log 2024-09-21T12:39:11.425 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/641beec0-7812-11ef-baf6-efdc52797490/ceph.audit.log 2024-09-21T12:39:11.425 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/641beec0-7812-11ef-baf6-efdc52797490/ceph-volume.log: /var/log/ceph/641beec0-7812-11ef-baf6-efdc52797490/ceph-mgr.smithi003.wztftl.log: gzip -5 --verbose -- /var/log/ceph/641beec0-7812-11ef-baf6-efdc52797490/ceph-client.ceph-exporter.smithi003.log 2024-09-21T12:39:11.426 INFO:teuthology.orchestra.run.smithi192.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/641beec0-7812-11ef-baf6-efdc52797490/ceph-mgr.smithi192.qsaprd.log 2024-09-21T12:39:11.426 INFO:teuthology.orchestra.run.smithi192.stderr:: No such file or directory 2024-09-21T12:39:11.426 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/641beec0-7812-11ef-baf6-efdc52797490/ceph-mon.smithi192.log 2024-09-21T12:39:11.427 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/641beec0-7812-11ef-baf6-efdc52797490/ceph-volume.log 2024-09-21T12:39:11.427 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/641beec0-7812-11ef-baf6-efdc52797490/ceph-mgr.smithi192.qsaprd.log: gzip -5 --verbose -- /var/log/ceph/641beec0-7812-11ef-baf6-efdc52797490/ceph-osd.4.log 2024-09-21T12:39:11.433 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/641beec0-7812-11ef-baf6-efdc52797490/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/641beec0-7812-11ef-baf6-efdc52797490/ceph.cephadm.log 2024-09-21T12:39:11.434 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/641beec0-7812-11ef-baf6-efdc52797490/ceph-client.ceph-exporter.smithi003.log: 94.0% -- replaced with /var/log/ceph/641beec0-7812-11ef-baf6-efdc52797490/ceph-client.ceph-exporter.smithi003.log.gz 2024-09-21T12:39:11.434 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/641beec0-7812-11ef-baf6-efdc52797490/ceph-mon.smithi003.log 2024-09-21T12:39:11.434 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/641beec0-7812-11ef-baf6-efdc52797490/ceph.cephadm.log: 91.5% 86.5% -- replaced with /var/log/ceph/641beec0-7812-11ef-baf6-efdc52797490/ceph.cephadm.log.gz 2024-09-21T12:39:11.434 INFO:teuthology.orchestra.run.smithi003.stderr: -- replaced with /var/log/ceph/641beec0-7812-11ef-baf6-efdc52797490/ceph.audit.log.gz 2024-09-21T12:39:11.434 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/641beec0-7812-11ef-baf6-efdc52797490/ceph-osd.2.log 2024-09-21T12:39:11.439 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/641beec0-7812-11ef-baf6-efdc52797490/ceph-mon.smithi192.log: /var/log/ceph/641beec0-7812-11ef-baf6-efdc52797490/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/641beec0-7812-11ef-baf6-efdc52797490/ceph.audit.log 2024-09-21T12:39:11.439 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/641beec0-7812-11ef-baf6-efdc52797490/ceph-mds.cephfs.smithi192.ywqqxe.log 2024-09-21T12:39:11.439 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/641beec0-7812-11ef-baf6-efdc52797490/ceph-osd.4.log: /var/log/ceph/641beec0-7812-11ef-baf6-efdc52797490/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/641beec0-7812-11ef-baf6-efdc52797490/ceph.cephadm.log 2024-09-21T12:39:11.440 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/641beec0-7812-11ef-baf6-efdc52797490/ceph-mds.cephfs.smithi192.ywqqxe.log: gzip -5 --verbose -- /var/log/ceph/641beec0-7812-11ef-baf6-efdc52797490/ceph-osd.5.log 2024-09-21T12:39:11.440 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/641beec0-7812-11ef-baf6-efdc52797490/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/641beec0-7812-11ef-baf6-efdc52797490/ceph.log 2024-09-21T12:39:11.440 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/641beec0-7812-11ef-baf6-efdc52797490/ceph-osd.5.log: 85.1% -- replaced with /var/log/ceph/641beec0-7812-11ef-baf6-efdc52797490/ceph.cephadm.log.gz 2024-09-21T12:39:11.440 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/641beec0-7812-11ef-baf6-efdc52797490/ceph-client.ceph-exporter.smithi192.log 2024-09-21T12:39:11.440 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/641beec0-7812-11ef-baf6-efdc52797490/ceph.log: 91.6% -- replaced with /var/log/ceph/641beec0-7812-11ef-baf6-efdc52797490/ceph.audit.log.gz 2024-09-21T12:39:11.440 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/641beec0-7812-11ef-baf6-efdc52797490/ceph-mds.cephfs.smithi192.ktdqns.log 2024-09-21T12:39:11.440 INFO:teuthology.orchestra.run.smithi192.stderr: 88.7% -- replaced with /var/log/ceph/641beec0-7812-11ef-baf6-efdc52797490/ceph.log.gz 2024-09-21T12:39:11.440 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/641beec0-7812-11ef-baf6-efdc52797490/ceph-client.ceph-exporter.smithi192.log: gzip -5 --verbose -- /var/log/ceph/641beec0-7812-11ef-baf6-efdc52797490/ceph-osd.3.log 2024-09-21T12:39:11.440 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/641beec0-7812-11ef-baf6-efdc52797490/ceph-mds.cephfs.smithi192.ktdqns.log: 94.0% -- replaced with /var/log/ceph/641beec0-7812-11ef-baf6-efdc52797490/ceph-client.ceph-exporter.smithi192.log.gz 2024-09-21T12:39:11.440 INFO:teuthology.orchestra.run.smithi192.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.log 2024-09-21T12:39:11.442 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/641beec0-7812-11ef-baf6-efdc52797490/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T12:39:11.447 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/641beec0-7812-11ef-baf6-efdc52797490/ceph-mon.smithi003.log: gzip -5 --verbose -- /var/log/ceph/641beec0-7812-11ef-baf6-efdc52797490/ceph-mds.cephfs.smithi003.gfkngj.log 2024-09-21T12:39:11.452 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/641beec0-7812-11ef-baf6-efdc52797490/ceph-osd.2.log: 91.3% -- replaced with /var/log/ceph/641beec0-7812-11ef-baf6-efdc52797490/ceph-volume.log.gz 2024-09-21T12:39:11.467 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/641beec0-7812-11ef-baf6-efdc52797490/ceph.log 2024-09-21T12:39:11.468 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/641beec0-7812-11ef-baf6-efdc52797490/ceph-mds.cephfs.smithi003.gfkngj.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-09-21T12:39:11.469 INFO:teuthology.orchestra.run.smithi192.stderr:/var/log/ceph/ceph-client.1.log: /var/log/ceph/cephadm.log: 92.3% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T12:39:11.469 INFO:teuthology.orchestra.run.smithi192.stderr: 91.3% -- replaced with /var/log/ceph/641beec0-7812-11ef-baf6-efdc52797490/ceph-volume.log.gz 2024-09-21T12:39:11.471 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/641beec0-7812-11ef-baf6-efdc52797490/ceph.log: 88.6% -- replaced with /var/log/ceph/641beec0-7812-11ef-baf6-efdc52797490/ceph.log.gz 2024-09-21T12:39:11.472 INFO:teuthology.orchestra.run.smithi003.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-21T12:39:11.476 INFO:teuthology.orchestra.run.smithi192.stderr: 89.3% -- replaced with /var/log/ceph/641beec0-7812-11ef-baf6-efdc52797490/ceph-mgr.smithi192.qsaprd.log.gz 2024-09-21T12:39:11.530 INFO:teuthology.orchestra.run.smithi003.stderr:/var/log/ceph/ceph-client.0.log: /var/log/ceph/cephadm.log: 91.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-21T12:39:11.915 INFO:teuthology.orchestra.run.smithi192.stderr: 92.5% -- replaced with /var/log/ceph/641beec0-7812-11ef-baf6-efdc52797490/ceph-mon.smithi192.log.gz 2024-09-21T12:39:11.972 INFO:teuthology.orchestra.run.smithi003.stderr: 89.5% -- replaced with /var/log/ceph/641beec0-7812-11ef-baf6-efdc52797490/ceph-mgr.smithi003.wztftl.log.gz 2024-09-21T12:39:12.771 INFO:teuthology.orchestra.run.smithi003.stderr: 90.4% -- replaced with /var/log/ceph/641beec0-7812-11ef-baf6-efdc52797490/ceph-mon.smithi003.log.gz 2024-09-21T12:39:14.895 INFO:teuthology.orchestra.run.smithi192.stderr: 93.8% -- replaced with /var/log/ceph/641beec0-7812-11ef-baf6-efdc52797490/ceph-osd.4.log.gz 2024-09-21T12:39:16.173 INFO:teuthology.orchestra.run.smithi003.stderr: 93.7% -- replaced with /var/log/ceph/641beec0-7812-11ef-baf6-efdc52797490/ceph-osd.0.log.gz 2024-09-21T12:39:16.793 INFO:teuthology.orchestra.run.smithi003.stderr: 93.8% -- replaced with /var/log/ceph/641beec0-7812-11ef-baf6-efdc52797490/ceph-osd.2.log.gz 2024-09-21T12:39:17.046 INFO:teuthology.orchestra.run.smithi192.stderr: 93.8% -- replaced with /var/log/ceph/641beec0-7812-11ef-baf6-efdc52797490/ceph-osd.5.log.gz 2024-09-21T12:39:17.796 INFO:teuthology.orchestra.run.smithi192.stderr: 94.9% -- replaced with /var/log/ceph/641beec0-7812-11ef-baf6-efdc52797490/ceph-mds.cephfs.smithi192.ktdqns.log.gz 2024-09-21T12:39:17.886 INFO:teuthology.orchestra.run.smithi003.stderr: 93.8% -- replaced with /var/log/ceph/641beec0-7812-11ef-baf6-efdc52797490/ceph-osd.1.log.gz 2024-09-21T12:39:18.498 INFO:teuthology.orchestra.run.smithi003.stderr: 94.9% -- replaced with /var/log/ceph/641beec0-7812-11ef-baf6-efdc52797490/ceph-mds.cephfs.smithi003.ebjgyl.log.gz 2024-09-21T12:39:18.559 INFO:teuthology.orchestra.run.smithi192.stderr: 93.8% -- replaced with /var/log/ceph/641beec0-7812-11ef-baf6-efdc52797490/ceph-osd.3.log.gz 2024-09-21T12:39:19.513 INFO:teuthology.orchestra.run.smithi192.stderr: 94.9% -- replaced with /var/log/ceph/641beec0-7812-11ef-baf6-efdc52797490/ceph-mds.cephfs.smithi192.ywqqxe.log.gz 2024-09-21T12:39:26.387 INFO:teuthology.orchestra.run.smithi192.stderr:gzip: /var/log/ceph/ceph-client.1.log: file size changed while zipping 2024-09-21T12:39:26.387 INFO:teuthology.orchestra.run.smithi192.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.1.log.gz 2024-09-21T12:39:26.389 INFO:teuthology.orchestra.run.smithi192.stderr: 2024-09-21T12:39:26.389 INFO:teuthology.orchestra.run.smithi192.stderr:real 0m14.976s 2024-09-21T12:39:26.389 INFO:teuthology.orchestra.run.smithi192.stderr:user 0m44.822s 2024-09-21T12:39:26.389 INFO:teuthology.orchestra.run.smithi192.stderr:sys 0m1.305s 2024-09-21T12:39:28.276 INFO:teuthology.orchestra.run.smithi003.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-09-21T12:40:55.481 INFO:teuthology.orchestra.run.smithi003.stderr: 93.0% -- replaced with /var/log/ceph/641beec0-7812-11ef-baf6-efdc52797490/ceph-mds.cephfs.smithi003.gfkngj.log.gz 2024-09-21T12:40:55.483 INFO:teuthology.orchestra.run.smithi003.stderr: 2024-09-21T12:40:55.483 INFO:teuthology.orchestra.run.smithi003.stderr:real 1m44.072s 2024-09-21T12:40:55.483 INFO:teuthology.orchestra.run.smithi003.stderr:user 2m21.378s 2024-09-21T12:40:55.483 INFO:teuthology.orchestra.run.smithi003.stderr:sys 0m4.178s 2024-09-21T12:40:55.483 INFO:tasks.cephadm:Archiving logs... 2024-09-21T12:40:55.484 DEBUG:teuthology.misc:Transferring archived files from smithi003:/var/log/ceph to /home/teuthworker/archive/gabrioux-2024-09-21_10:07:29-orch:cephadm-wip-guits-main-2024-09-21-0813-distro-default-smithi/7913909/remote/smithi003/log 2024-09-21T12:40:55.485 DEBUG:teuthology.orchestra.run.smithi003:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T12:41:14.383 DEBUG:teuthology.misc:Transferring archived files from smithi192:/var/log/ceph to /home/teuthworker/archive/gabrioux-2024-09-21_10:07:29-orch:cephadm-wip-guits-main-2024-09-21-0813-distro-default-smithi/7913909/remote/smithi192/log 2024-09-21T12:41:14.384 DEBUG:teuthology.orchestra.run.smithi192:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-21T12:41:19.793 INFO:tasks.cephadm:Removing cluster... 2024-09-21T12:41:19.793 DEBUG:teuthology.orchestra.run.smithi003:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 641beec0-7812-11ef-baf6-efdc52797490 --force 2024-09-21T12:41:20.005 INFO:teuthology.orchestra.run.smithi003.stdout:Deleting cluster with fsid: 641beec0-7812-11ef-baf6-efdc52797490 2024-09-21T12:41:20.403 DEBUG:teuthology.orchestra.run.smithi192:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 641beec0-7812-11ef-baf6-efdc52797490 --force 2024-09-21T12:41:20.606 INFO:teuthology.orchestra.run.smithi192.stdout:Deleting cluster with fsid: 641beec0-7812-11ef-baf6-efdc52797490 2024-09-21T12:41:20.890 INFO:tasks.cephadm:Removing cephadm ... 2024-09-21T12:41:20.890 DEBUG:teuthology.orchestra.run.smithi003:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T12:41:20.907 DEBUG:teuthology.orchestra.run.smithi192:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-21T12:41:20.923 INFO:tasks.cephadm:Teardown complete 2024-09-21T12:41:20.923 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-21T12:41:20.934 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/install/__init__.py", line 641, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_5c1cdc3c470dae78e91a0ed2bcf13509a046d301/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_5c1cdc3c470dae78e91a0ed2bcf13509a046d301/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-21T12:41:20.934 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-21T12:41:20.934 DEBUG:teuthology.orchestra.run.smithi003:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T12:41:20.950 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-21T12:41:21.029 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-21T12:41:21.040 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-21T12:41:21.041 DEBUG:teuthology.orchestra.run.smithi003:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T12:41:21.043 DEBUG:teuthology.orchestra.run.smithi192:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-21T12:41:21.056 INFO:teuthology.orchestra.run.smithi003.stderr:bash: line 1: ntpq: command not found 2024-09-21T12:41:21.058 INFO:teuthology.orchestra.run.smithi192.stderr:bash: line 1: ntpq: command not found 2024-09-21T12:41:21.061 INFO:teuthology.orchestra.run.smithi003.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T12:41:21.061 INFO:teuthology.orchestra.run.smithi003.stdout:=============================================================================== 2024-09-21T12:41:21.061 INFO:teuthology.orchestra.run.smithi003.stdout:^* hv01.front.sepia.ceph.com 3 7 377 19 +109us[ +114us] +/- 36ms 2024-09-21T12:41:21.061 INFO:teuthology.orchestra.run.smithi003.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 16 -356us[ -356us] +/- 65ms 2024-09-21T12:41:21.061 INFO:teuthology.orchestra.run.smithi003.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 18 +313us[ +313us] +/- 67ms 2024-09-21T12:41:21.061 INFO:teuthology.orchestra.run.smithi003.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T12:41:21.062 INFO:teuthology.orchestra.run.smithi192.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-21T12:41:21.063 INFO:teuthology.orchestra.run.smithi192.stdout:=============================================================================== 2024-09-21T12:41:21.063 INFO:teuthology.orchestra.run.smithi192.stdout:^* hv01.front.sepia.ceph.com 3 6 377 17 +63us[ +82us] +/- 36ms 2024-09-21T12:41:21.063 INFO:teuthology.orchestra.run.smithi192.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 14 -344us[ -344us] +/- 65ms 2024-09-21T12:41:21.063 INFO:teuthology.orchestra.run.smithi192.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 16 +262us[ +262us] +/- 67ms 2024-09-21T12:41:21.063 INFO:teuthology.orchestra.run.smithi192.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-21T12:41:21.063 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-21T12:41:21.074 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-21T12:41:21.074 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-21T12:41:21.086 DEBUG:teuthology.orchestra.run.smithi003:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T12:41:21.185 DEBUG:teuthology.orchestra.run.smithi192:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-21T12:41:21.256 DEBUG:teuthology.orchestra.run.smithi003:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T12:41:21.285 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T12:41:21.286 DEBUG:teuthology.orchestra.run.smithi192:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-09-21T12:41:21.314 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T12:41:21.314 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-21T12:41:21.330 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-21T12:41:21.350 INFO:teuthology.task.internal:Duration was 2257.211603 seconds 2024-09-21T12:41:21.350 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-21T12:41:21.360 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-21T12:41:21.361 DEBUG:teuthology.orchestra.run.smithi003:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T12:41:21.363 DEBUG:teuthology.orchestra.run.smithi192:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-21T12:41:21.401 INFO:teuthology.orchestra.run.smithi003.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T12:41:21.402 INFO:teuthology.orchestra.run.smithi192.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-21T12:41:21.796 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-21T12:41:21.797 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi003.front.sepia.ceph.com 2024-09-21T12:41:21.797 DEBUG:teuthology.orchestra.run.smithi003:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T12:41:21.819 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi192.front.sepia.ceph.com 2024-09-21T12:41:21.819 DEBUG:teuthology.orchestra.run.smithi192:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-21T12:41:21.861 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-21T12:41:21.861 DEBUG:teuthology.orchestra.run.smithi003:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T12:41:21.864 DEBUG:teuthology.orchestra.run.smithi192:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-21T12:41:21.927 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-21T12:41:21.928 DEBUG:teuthology.orchestra.run.smithi003:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T12:41:21.932 DEBUG:teuthology.orchestra.run.smithi192:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-21T12:41:22.588 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-21T12:41:22.599 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-21T12:41:22.600 DEBUG:teuthology.orchestra.run.smithi003:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T12:41:22.626 DEBUG:teuthology.orchestra.run.smithi192:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-21T12:41:22.652 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-21T12:41:22.664 DEBUG:teuthology.orchestra.run.smithi003:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T12:41:22.668 DEBUG:teuthology.orchestra.run.smithi192:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-21T12:41:22.690 INFO:teuthology.orchestra.run.smithi003.stdout:kernel.core_pattern = core 2024-09-21T12:41:22.717 INFO:teuthology.orchestra.run.smithi192.stdout:kernel.core_pattern = core 2024-09-21T12:41:22.737 DEBUG:teuthology.orchestra.run.smithi003:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T12:41:22.770 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T12:41:22.770 DEBUG:teuthology.orchestra.run.smithi192:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-21T12:41:22.792 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T12:41:22.792 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-21T12:41:22.804 INFO:teuthology.task.internal:Transferring archived files... 2024-09-21T12:41:22.804 DEBUG:teuthology.misc:Transferring archived files from smithi003:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/gabrioux-2024-09-21_10:07:29-orch:cephadm-wip-guits-main-2024-09-21-0813-distro-default-smithi/7913909/remote/smithi003 2024-09-21T12:41:22.805 DEBUG:teuthology.orchestra.run.smithi003:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T12:41:22.860 DEBUG:teuthology.misc:Transferring archived files from smithi192:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/gabrioux-2024-09-21_10:07:29-orch:cephadm-wip-guits-main-2024-09-21-0813-distro-default-smithi/7913909/remote/smithi192 2024-09-21T12:41:22.860 DEBUG:teuthology.orchestra.run.smithi192:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-21T12:41:22.899 INFO:teuthology.task.internal:Removing archive directory... 2024-09-21T12:41:22.899 DEBUG:teuthology.orchestra.run.smithi003:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T12:41:22.902 DEBUG:teuthology.orchestra.run.smithi192:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-21T12:41:22.948 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-21T12:41:22.959 INFO:teuthology.task.internal:Not uploading archives. 2024-09-21T12:41:22.959 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-21T12:41:22.970 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-21T12:41:22.971 DEBUG:teuthology.orchestra.run.smithi003:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T12:41:22.973 DEBUG:teuthology.orchestra.run.smithi192:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-21T12:41:22.986 INFO:teuthology.orchestra.run.smithi003.stdout: 265340 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Sep 21 12:41 /home/ubuntu/cephtest 2024-09-21T12:41:22.986 INFO:teuthology.orchestra.run.smithi003.stdout: 531318 4 d--------- 2 ubuntu ubuntu 4096 Sep 21 12:18 /home/ubuntu/cephtest/mnt.0 2024-09-21T12:41:22.987 INFO:teuthology.orchestra.run.smithi003.stderr:find: ‘/home/ubuntu/cephtest/mnt.0’: Permission denied 2024-09-21T12:41:22.987 INFO:teuthology.orchestra.run.smithi003.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-09-21T12:41:22.990 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-21T12:41:22.990 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_5c1cdc3c470dae78e91a0ed2bcf13509a046d301/qa/tasks/ceph_fuse.py", line 248, in task mount.umount_wait() File "/home/teuthworker/src/git.ceph.com_ceph-c_5c1cdc3c470dae78e91a0ed2bcf13509a046d301/qa/tasks/cephfs/fuse_mount.py", line 403, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/run_tasks.py", line 160, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 153, in __exit__ self.gen.throw(typ, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi003 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-09-21T12:41:22.991 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-21T12:41:23.004 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-21T12:41:23.017 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: MaxWhileTries: reached maximum tries (50) after waiting for 300 seconds 2024-09-21T12:41:23.020 INFO:teuthology.run:Summary data: description: orch:cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/squid 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 2257.2116029262543 failure_reason: reached maximum tries (50) after waiting for 300 seconds flavor: default owner: scheduled_gabrioux@teuthology status: fail success: false 2024-09-21T12:41:23.020 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-21T12:41:23.102 INFO:teuthology.run:FAIL